The runoff and sediment yield data from the Qiaozidonggou, Qiaozixigou, and Luergou watersheds, in the Loess Plateau of China are used to calibrate and validate the runoff and sediment yield simulated by GeoWEPP model of the WEPP Model at watershed scale. The indices of relative error, R, correlation coefficient, R2, and Nash-Suttcliffe efficiency coefficient En5 are used to evaluate the model fit. The eco-hydrological responses in the Luoyugou and Luergou watersheds are also forecast based on the WEPP Model. Meanwhile, the relation between vegetation pattern changes and sediment yield in the watershed is discussed, and the responses of runoff and sediment yield in the watersheds concerning forest growth stages are studied. The results show that the relative errors of simulated values of runoff and sediment yield are below 30%, the correlation coefficients are above 0.90, and the Nash-Suttcliffe efficiency coefficients are above 0.80. The simulation results present satisfactory performance, thus, the model could be used to simulate the runoff and sediment yield in these small watersheds. It is also observed that soil erosion tended to become severe as precipitation increased in the watershed, while soil erosion has a decreasing trend as forest cover increases and vegetation pattern is optimized. When the watershed is fully covered by forest, erosion and sediment yield are minimized. When the forest cover is about 30% and evenly distributed in the watershed, the erosion intensity is lower than if the forest cover is collectively distributed in the watershed. Erosion varies with different forest growth stages in the watershed; it is more serious at the young and near planting stage and is the smallest at the mature forest stage.