Fatigue driving misconduct monitoring method and active safety driving monitoring system

A behavioral and driver technology, applied in transmission systems, instruments, calculations, etc., can solve problems such as inaccuracy, high cost, and inability to distinguish the degree of distraction, so as to relieve driver fatigue and avoid missing alarms.

Active Publication Date: 2022-06-17
JIANGLING MOTORS
View PDF12 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, Chinese patent CN 110275608A introduces to obtain the human eye feature at the reference position corresponding to the target human eye feature according to the functional relationship, and obtain the unknown line of sight position according to the human eye feature at the reference position corresponding to the target human eye feature, only to locate the line of sight position, Inaccurate; Chinese patent CN 111401130 A proposes a driver distraction detection method based on continuous head posture estimation, judging the state of distraction according to the head posture, and cannot distinguish the degree of distraction; Chinese patent CN109050397.A only introduces a A warning device for the driver to leave the steering wheel, which detects the time when the driver leaves the steering wheel and compares it with the time threshold to determine whether to let go; This method requires the vehicle to be in adaptive cruise mode and rely on ADAS maps to obtain road information, which is costly and limited to use scenarios

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Fatigue driving misconduct monitoring method and active safety driving monitoring system
  • Fatigue driving misconduct monitoring method and active safety driving monitoring system
  • Fatigue driving misconduct monitoring method and active safety driving monitoring system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0036] see Figure 1-Figure 2 The present invention is a method for monitoring driver fatigue driving and misbehavior based on eye tracking technology, collects the data inside and outside the vehicle and the driver's face, and inputs it to the controller for execution, detects the driver's distraction level, and further completes the judgment of the time to let go, The difference from the prior art is that the fusion scheme of the stable line of sight algorithm and the precise line of sight tracking algorithm is adopted to comprehensively cover different application scenarios; the specific steps are as follows:

[0037] 1) Use the face detection module to collect the driver's face data to obtain the infrared image, and locate the face information in the image;

[0038] 2) According to the face information positioned by the infrared image, continuously detect the driver's head posture, compare it with the database face data, and confirm the real face;

[0039] 3) using the st...

Embodiment 2

[0043] The present embodiment is a method for monitoring driver fatigue driving and misbehavior based on eye tracking technology, which is different from Embodiment 1. Further, the precise eye tracking method uses both bright pupil and dark pupil during initial calibration. For calibration, in subsequent actual scenes, the algorithm can match the bright pupil and dark pupil scenes to switch the matching algorithm in real time to improve the accuracy; by locating the center of the outer edge of the pupil and the center of the corneal virtual sphere, the driver's line of sight can be output. towards.

[0044] The described method for monitoring driver fatigue driving and misbehavior based on sight tracking technology uses a stable sight line algorithm to locate 68 feature points of the face, and adaptively establishes a 3D model of the head, so as to obtain the posture of the head and determine the orientation of the head. , and further get the center position of the pupil.

Embodiment 3

[0046] join Figure 1-Figure 7 , the sight tracking of the present invention adopts a stable sight line and a precise sight line fusion scheme to cover different application scenarios more comprehensively. To stabilize the line of sight is to establish a 3D model of the head adaptively after locating the 68 feature points of the face, so as to obtain the posture of the head, determine the orientation of the head, and further obtain the center position of the pupil. Precise sight is the use of corneal reflection method combining bright pupil and dark pupil to obtain the precise sight of the driver.

[0047] The principle of the corneal reflection method is as follows: when the infrared fill light illuminates the human eye, the cornea is similar to a convex mirror, and the light source is reflected by the convex mirror to form a bright spot. The precise corneal virtual sphere center can be calculated by the position of the light spot, such as image 3 shown;

[0048] In the c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an active or auxiliary protection method and system for safe driving of a vehicle. A monitoring method for driver fatigue driving and improper driving behavior based on eye-tracking technology, which adopts the fusion scheme of stable line-of-sight algorithm and precise line-of-sight tracking algorithm: collect face data, locate face information in the image; continuously monitor the driver's head posture Detection, database face data comparison, confirm the real face; use the stable line of sight algorithm to locate the feature points in the image, adaptively build a 3D head model, and determine the driver's behavior, head orientation, line of sight orientation, and eye status; accurate The eye-tracking algorithm uses the corneal reflection method combining bright and dark pupils to obtain the driver's precise line of sight; determines the driver's distraction level according to the head posture and line of sight direction, and further determines the allowable time for the driver to let go. An active safety driving monitoring system, including a driver's face detection module, a front-view monocular camera, a DMS control module, a human-computer interaction system, and a T‑box vehicle network communication terminal.

Description

technical field [0001] The invention relates to active protection or auxiliary measures for safe driving of vehicles, in particular to a strategy for early warning, monitoring and alarming of driver fatigue and driving misbehavior, and a high-level driving assistance function release time strategy. Background technique [0002] With the continuous increase of car ownership and the development of the road transportation industry, the frequency of traffic accidents has also continued to increase. According to the statistics of the Ministry of Communications, there were 165,000 road traffic accidents nationwide in 2016, resulting in 51,800 deaths. , 599,000 people were injured, and the main cause of traffic accidents was illegal driving and fatigued driving. For freight drivers, bus drivers and online car-hailing drivers who drive long distances, they often encounter behaviors such as smoking, answering phone calls, sending and receiving text messages, and operating the central...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G08B21/06G08B25/10H04L67/10H04L67/125G06V20/59G06V40/16G06V40/18G06V10/25
CPCG08B21/06G08B25/10H04L67/10H04L67/125G06V40/171G06V40/193G06V20/597G06V10/25
Inventor 刘卫东吴方义王爱春黄少堂
Owner JIANGLING MOTORS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products