Considering the inhomogeneous or heterogeneous background, we have demonstrated that if the background and thehalf-immersed object are both non-absorbing, the transferred photon momentum to the pulled object can be considered as the one of Minkowski exactly at the interface. In contrast, the presence of loss inside matter, either in the half-immersed object or in the background, causes optical pushing of the object. Our analysis suggests that for half-immersed plasmonic or lossy dielectric, the transferred momentum of photon can mathematically be modeled as the type of Minkowski and also of Abraham. However, according to a final critical analysis, the idea of Abraham momentum transfer has been rejected. Hence, an obvious question arises: whence the Abraham momentum? It is demonstrated that though the transferred momentum to a half-immersed Mie object (lossy or lossless) can better be considered as the Minkowski momentum, Lorentz force analysis suggests that the momentum of a photon traveling through the continuous background, however, can be modeled as the type of Abraham. Finally, as an interesting sidewalk, a machine leaing based system has been developed to predict the time-averaged force within a very short time avoiding time-consuming full wave simulation.