Lightweight distraction judging method based on deep learning face recognition

A facial recognition and deep learning technology, applied in the field of deep learning image recognition and analysis, can solve the problems of lack of model performance, scarcity of data set network models, and inapplicability to business scenarios, achieving strong practical effects, taking into account real-time and accuracy. Effect

Inactive Publication Date: 2021-11-05
无锡我懂了教育科技有限公司
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, existing datasets and models are limited to facial expression recognition tasks that reflect basic emotions such as anger, high sex, sadness, and surprise. The DAiSEE mind-wandering recognition dataset proposed by Indian scholars is also not applicable due to racial differences

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Lightweight distraction judging method based on deep learning face recognition
  • Lightweight distraction judging method based on deep learning face recognition
  • Lightweight distraction judging method based on deep learning face recognition

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0062] Next, the technical solutions in the embodiments of the present invention will be described in connection with the drawings of the embodiments of the present invention, and it is understood that the described embodiments are merely the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art are in the range of the present invention without making creative labor premise.

[0063] See Figure 1-8 The present invention provides the following technical solutions:

[0064] STRIKE God estimation method based on the depth of learning facial recognition lightweight, comprising the steps of:

[0065] S1: using face detection algorithm ResNet10-SSD in the video stream based on key frames for face detection. Face detection module ResNet10 selected as a skeleton, feature extracting depth of the input image, and then into a series of successive convolution of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a lightweight distraction judging method based on deep learning face recognition, which is used for processing video stream data and comprises the following steps of: carrying out face detection on a key frame, then carrying out distraction recognition on a detected face region, and finally obtaining a distraction state recognition result of the frame; the method mainly comprises two modules: a face detection algorithm based on ResNet10-SSD, and a distracting recognition algorithm based on MobileNet+GRU. The face detection module continues to use the SSD, the distracting recognition module adopts depth separable convolution of MobileNet to build a feature extractor, a CBAM structure retaining identical mapping is added, and face key point positioning and head posture estimation are adopted as auxiliary data for additional supervision; due to the fact that ResNet10 and other lightweight backbone networks are adopted and MobileNet is used for acceleration, the lightweight facial distraction recognition method gives consideration to precision and speed, can be deployed on various mobile devices, has the distraction recognition accuracy reaching 90%, and has high practical value in practical application scenes.

Description

technical field [0001] The invention relates to the field of deep learning image recognition and analysis, in particular to a light-weight mind-wandering discrimination method based on deep learning facial recognition. Background technique [0002] The development of information technology has brought great convenience to people's lives, especially for the online education industry. The form of live video allows students to complete classroom learning at home, which is even more important in a society under the epidemic. In order to improve the quality of students' lectures and allow teachers to get timely feedback, it is necessary to intelligently identify whether students are distracted during the live broadcast process, and summarize the results for teachers' reference and processing. For the video stream captured by the camera of the student's listening device, it is necessary to detect the location of the student's face in the key frame, and then perform distraction rec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00
Inventor 王静
Owner 无锡我懂了教育科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products