The invention discloses a fatigue driving detection method, which comprises the following steps of authenticating the driver identity, accumulating the driving time, extracting the expression state, extracting the body state, collecting the road condition information, extracting the vehicle control state and detecting the fatigue driving. The invention also provides a fatigue driving detection system. According to the invention, the facial expression and the body movement of a driver is tracked through the face recognition, and the driver becomes fatigue from a normal state, for example, the eye-closed time is getting longer, the nod frequency is increased, and the like; the vehicle control state of the driver is tracked and judged whether to become bad along with the time, for example, the steering wheel rotation variance is getting larger, so the driver is detected whether to be in a fatigue driving state. The fatigue driving detection method and system avoid presetting a define threshold, and the accuracy can not be affect by the individual differences of drivers.