The invention discloses a fatigue driving recognition method and system based on multiple features, and the method and system carry out the preprocessing of an image, filter noise, and avoid problemsthat the image quality is poor and the detection precision is low because the image is affected by an external environment factor. The AdaBoost algorithm is adopted to stably, quickly and efficientlydetect the human face, so that the complexity of human face detection is reduced. According to the scale space-based face target tracking algorithm, a self-adaptive high-confidence updating strategy is adopted, and when an error occurs in a target tracking stage, the confidence of target detection is relatively low, and a model is not updated, so that the risk of drifting of the tracking algorithmis effectively reduced, and the tracking precision is improved. The SVM classifier is adopted for eye state recognition, the precision of eye state recognition is improved, and therefore the method is high in recognition precision and high in adaptability to the environment.