Fatigue detection system and method based on facial skeleton model, medium and detection equipment

A skeleton model and detection method technology, applied in the field of image recognition, can solve the problems of low recognition degree of fatigue detection, difficult installation, and inconvenient wearing of the fatigue detection system.

Pending Publication Date: 2022-01-11
HARBIN INST OF TECH AT WEIHAI
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current fatigue detection system still has many problems such as convenience, real-time performance and poor accuracy.
[0006] (2) Existing technology based on wearable fatigue detection system is inconvenient to wear
[0007] (3) In the existing fatigue dr

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fatigue detection system and method based on facial skeleton model, medium and detection equipment
  • Fatigue detection system and method based on facial skeleton model, medium and detection equipment
  • Fatigue detection system and method based on facial skeleton model, medium and detection equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0051] Such as figure 1 As shown, according to the disclosed embodiments of the present invention, a method for detecting driving fatigue based on a facial skeleton model is provided, including:

[0052] S101, obtain the driver's real-time RGB image and depth image through the camera equipment, and use the OpenPose human body posture detection model to recognize the obtained image;

[0053] S102, perform 3D skeletalization of the obtained recognition image through the pinhole camera model, use the OpenFace face detection model to extract head posture features and face features, and use the extracted head and face posture features, Calculation of fatigue characteristics;

[0054] S103, using a classifier to detect the fatigue characteristics obtained, obtaining a fatigue detection model, using the fatigue detection model to classify and judge fatigue, and using the APP to interact and remind the user.

[0055] Such as figure 2 As shown, according to the disclosed embodiment...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a driving fatigue detection system and method based on a facial skeleton model, a medium and detection equipment, and relates to the technical field of image recognition. The method comprises the following steps: identifying an obtained image by using a human body posture detection model; performing 3D skeletization on the obtained recognition image through a pinhole camera model, extracting head posture features and face features by using a face detection model, and calculating fatigue features by using the extracted head and face posture features; detecting the obtained fatigue features by using a classifier to obtain a fatigue detection model, carrying out grading judgment on fatigue by using the fatigue detection model, and interacting with a user by using an APP. According to the method, fatigue behaviors are analyzed, fatigue recognition features are extracted, and a fatigue detection model fusing multiple fatigue features is obtained by using a random forest algorithm. The whole system is realized on the Raspberry Pi, development of a rear end and an APP end is completed, and the whole fatigue detection system has high integrity.

Description

technical field [0001] The invention belongs to the technical field of image recognition, and in particular relates to a fatigue detection system, method, medium and detection equipment based on a facial skeleton model. Background technique [0002] At present, with the continuous development of the automobile industry, driving has become one of the most important ways of travel. The car ownership rate of Chinese families continues to rise, and more and more people have driver's licenses, which brings about aggravated traffic congestion. Frequent traffic accidents and other issues, the importance of traffic safety issues continue to rise, becoming one of the major threats to national life safety. According to relevant information, from 2010 to now, the traffic accident rate, especially the probability of major traffic accidents, has increased every year, and the rate of increase has increased every year, which has brought serious consequences to people's traffic safety. cha...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06V20/59G06V40/16G06V40/20G06V10/40G06V10/764
CPCG06F18/241
Inventor 丁德琼胡鑫孟升亚初佃辉
Owner HARBIN INST OF TECH AT WEIHAI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products