The invention discloses a face tracking method and
system based on
deep learning, and the method comprises the steps: S1, obtaining a starting frame of a video
stream as a current frame, and setting n= 0; s2, judging whether the current frame n of the video
stream meets the condition that n% N is equal to 0 or not, if so, executing the step S3, and if not, executing the step S4, wherein N is a preset interval frame number; s3, performing
face detection on the current frame, if a face is detected, outputting a face candidate box, and executing the step S4, otherwise, obtaining the next frame of the video
stream as the current frame, setting n to be equal to 0, and executing the step S2; s4, performing
face verification on the face candidate box, verifying whether the face candidate box contains a face or not, if so, outputting a face frame image, and executing the step S5, otherwise, obtaining a next frame of the video stream as a current frame, setting n to be equal to 0, and executing the step S2; s5, performing key point positioning on the face frame image, and calculating an external rectangular frame of a face key point; and S6, expanding the external rectangular frame to obtain an expanded rectangular frame, extracting a next frame of the video stream as a current frame, setting n = n + 1, setting the expanded rectangular frame as a face candidate frame, and executing thestep S2. The method is compatible with single-face and multi-face tracking, is not influenced by a scene environment, and is high in face tracking robustness and high in real-time performance.