Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Robust multi-pose fatigue monitoring method based on face shape regression model

A regression model, fatigue monitoring technology, applied in character and pattern recognition, instruments, computer parts, etc., can solve problems such as difficult application, difficult fatigue monitoring, false alarm, etc., to achieve accurate and stable results, improve stability and applicability , the effect of improving the robustness

Active Publication Date: 2015-01-21
ZHEJIANG ICARE VISION TECH
View PDF3 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

There are also academics who directly use the above-mentioned edge analysis, active shape model, texture model and other algorithms to detect the eyelid contour line, and directly judge whether the eyes are closed according to the shape of the eyelid. However, due to the low detection accuracy of the eyelid contour line, a large number of false alarms and false alarms are caused. , this type of technology is currently limited to academic research and is difficult to apply in practical scenarios
[0004] In the above two types of methods, the precise positioning of the human eye position is a prerequisite for accurate fatigue monitoring. In practical applications, due to the complex and changeable posture of the person, the current product uses the face surface modeling method, such as the active shape model ASM Algorithm, texture model AAM and its derivative algorithm CLM, etc., for human eye positioning, are seriously affected by scale, rotation, lighting, etc., especially sensitive to rotation in the plane of the face, and the effect is not ideal when the person turns sideways, which affects fatigue monitoring products The scope of application is currently limited to the field of train drivers, but for people in complex scenarios, such as trucks, buses, private cars and other ordinary vehicle drivers, the background, lighting and other factors change frequently, making it difficult to achieve stability and reliability. fatigue monitoring

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Robust multi-pose fatigue monitoring method based on face shape regression model
  • Robust multi-pose fatigue monitoring method based on face shape regression model
  • Robust multi-pose fatigue monitoring method based on face shape regression model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0067] Collect and mark face images of different people and poses. The images can be visible light images or infrared images. The number of images should not be less than 3,000.

[0068] Step 1: Perform necessary zoom processing on the image. The size of the face in the image is a rectangular area of ​​150x150 to 300x300 to avoid the face being too large or too small. The sample mark refers to the face shape definition;

[0069] Step 2: Use the face detector to mark the position and size of the face in the image, scale the face image so that the size of the face area is 60x60, set the initial shape S0, and perform three rotations, translations, and scalings on the sample set Perturbation, each image is perturbed 10 times to obtain an expanded sample set;

[0070] Step 3: Calculate the LBP feature description of the corresponding position in the sample set, combine them to obtain the matrix T, and calculate the linear mode:

[0071] H = ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a robust multi-pose fatigue monitoring method based on a face shape regression model. According to the robust multi-pose fatigue monitoring method, the face alignment technology is adopted, an existing face alignment method is improved to be used for accurate human eye location according to practical problems in practical application of fatigue monitoring, and the face pose information can be provided at the same time; the stable human eye position can be provided on the condition of complex light environments and different poses of personnel, and the accurate human eye position can be provided even if the personnel turn away; during application of fatigue monitoring, the closing state sequence of the human eyes can be judged preliminarily according to the given human eye area, and the stability and the applicability of a fatigue monitoring product are further improved because the fatigue state of the personnel is judged through the face pose cooperatively; the closing state of the eyes in a front face image can be accurately judged, and the closing state of the eyes in a sideway face image can be judged. The fatigue state is judged through the face pose information cooperatively, and therefore the robustness is further improved, and the fatigue monitoring requirement of the personnel in a complex scene can be met.

Description

technical field [0001] The invention belongs to the technical field of video intelligent monitoring, and relates to a robust multi-posture fatigue monitoring method based on a human face shape regression model. Background technique [0002] In daily life, you will encounter situations such as too little sleep time the previous day, poor sleep quality, or boring work, which will lead to inattention and fatigue, which will induce work mistakes and cause great losses to society and individuals. Fatigue monitoring system is undoubtedly an effective means to avoid work mistakes. [0003] In the application of fatigue monitoring based on video analysis, it is mainly based on information such as eye closure status and closing frequency to determine whether a person is driving fatigued. At present, the industry mainly detects the position of human eyes in video sequences through edge analysis, active shape model, texture model and their derivative algorithms, and trains classifiers...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/66
CPCG06V40/165G06V30/194G06F18/2411
Inventor 尚凌辉高勇高华蒋宗杰于晓静
Owner ZHEJIANG ICARE VISION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products