In this paper, some V-cycle multigrid algorithms are presented for the coupling system arising from the discretization of the Dirichlet exterior problem by coupling the natural boundary element method and finite element method. The convergence of these multigrid algorithms is obtained even with only one smoothing on all levels. The rate of convergence is found uniformly bounded independent of the number of levels and the mesh sizes of all levels, which indicates that these multigrid algorithms are optimal. Some numerical results are also reported.