The vertical stability of a magnetic tip over a superconducting material is investigated by using the critical state and the frozen image models. The analytical expressions of the stiffness and the vibration frequency about the equilibrium position are derived in term of the geometrical parameters of the magnet/superconductor system. It is found that the stability of the system depends on the shape of the superconductor as well as its thickness.