We systematically investigate the motion of slowly moving matter-wave gap solitons in a nonlinear potential, produced by the weak random spatial variation of the atomic scattering length. With the weak randomness, we construct an effective-particle theory to study the motion of gap solitons. Based on the effective-particle theory, the effect of the randomness on gap solitous is obtained, and the motion of gap solitons is finally solved. Moreover, the analytic results for the general behaviours of gap soliton motion, such as the ensemble-average speed and the reflection probability depending on the weak randomness are obtained. We find that with the increase of the random strength the ensemble-average speed of gap solitons decreases slowly where the reduction is proportional to the variance of the weak randomness, and the reflection probability becomes larger. The theoretical results are in good agreement with the numerical simulations based on the Gross-Pitaevskii equation.