Electromagnetic scattering from a rough surface of layered medium is investigated, and the formulae of the scattering coefficients for different polarizations are derived using the small perturbation method. A rough surface with exponential correlation function is presented for describing a rough soil surface of layered medium, the formula of its scattering coefficient is derived by considering the spectrum of the rough surface with exponential correlation function; the curves of the bistatic scattering coefficient of HH polarization with variation of the scattering angle are obtained by numerical calculation. The influence of the permittivity of layered medium, the mean layer thickness of intermediate medium, the roughness surface parameters and the frequency of the incident wave on the bistatic scattering coefficient is discussed. Numerical results show that the influence of the permittivity of layered medium, the mean layer thickness of intermediate medium, the rms and the correlation length of the rough surface, and the frequency of the incident wave on the bistatic scattering coefficient is very complex.