The invention provides an MS-KCF (MobileNet-SSD-kernelized correlation filters) based rapid and stable detection method of a human face in an image sequence. To solve the problem about detection of the human face with larger angle change and very severe shielding in the image sequence, a new automatic DTD (detection-tracking-detection) mode integrating rapid and accurate target detection model MSand rapid tracking model KCF is provided, that is, an MS-KCF human face detection model is provided. The method comprises steps as follows: S1, establishing an MS detection network; S2, detecting a target by use of the MS network; S3, updating the tracking model to predict the position of the next frame of human face target; S4, updating an MS detection network after tracking several frames, and performing redetection and positioning on the human face target; S5, comparing and analyzing experiment results. Experiments prove that the MS-KFC model guarantees the detection stability of the humanface with larger angle change and very severe shielding in the image sequence, and besides, the detection speed is greatly increased.