It is well known that the transient behaviors of the traditional adaptive control may be very poor in general, and that the adaptive control designed based on switching between multiple models is an intuitively appealing and practically feasible approach to improve the transient performances. In this paper, we shall prove that for a typical class of linear systems disturbed by random noises, the multiple model based least-squares (LS)adaptive switching control is stable and convergent, and has the same convergence rate as that established for the standard least-squares-based self-tunning regulators. Moreover,the mixed case combining adaptive models with fixed models is also considered.