In this paper,AdaBoost algorithm is applied to fast detect and track human faces; differential template-based multi-algorithms are used to localize human eyes and recognize eye slates; PERCLOS algorithm is adopted to analyze and determine whether a person is fatigue.The speed and accuracy of the fatigue driving detection system is enhanced after applying these algorithms.