Blink Frequency and Gaze Estimation Method Based on Eye Region Generative Network

A blinking frequency and line of sight technology, which is applied in the field of driver fatigue driving warning, can solve the problems of affecting subsequent feature extraction, training time-consuming, long time, etc., and achieve the effect of meeting real-time requirements, saving processing time, and fast processing

Active Publication Date: 2021-07-27
XIAN UNIV OF SCI & TECH
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the process of traditional target detection, the sliding window strategy is used to traverse the entire image, and different scales and different lengths and widths need to be set, which makes the complexity too high, produces too many redundant windows, and takes a long time
This seriously affects subsequent feature extraction
In the deep learning target detection algorithm of Region Proposal (candidate area), the extraction of candidate areas has been greatly improved, but it is still not close to the real range of the target. The R-CNN training under development is divided into multiple stages. It is cumbersome, time-consuming to train, and takes up a lot of disk space. It takes 47s to process an image using the GPU, VGG16 model, and the processing speed is slow. However, the improved versions of SPP-NET, Fast R-CNN, and Faster R-CNN, although in terms of processing speed and The processing steps are simplified, but the extraction of candidate regions takes a lot of time and cannot meet the real-time requirements

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Blink Frequency and Gaze Estimation Method Based on Eye Region Generative Network
  • Blink Frequency and Gaze Estimation Method Based on Eye Region Generative Network
  • Blink Frequency and Gaze Estimation Method Based on Eye Region Generative Network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The present invention mainly relates to the combination of SSD target detection and ellipse fitting method, and the specific scheme is as follows:

[0030] Pre-training stage: SSD target detection to get the circumscribed rectangle of eyes and pupils

[0031] 1. If figure 1 As shown, SSD uses a feature pyramid structure for detection, that is, the feature maps (feature maps) of conv4-3, conv-7 (FC7), conv6-2, conv7-2, conv8_2, and conv9_2 are used for detection. Simultaneously perform softmax (regression classifier) ​​classification and position regression on multiple feature maps, which enables layer-by-layer prediction of feature images, and can quickly and accurately locate the effect of feature maps. The feature images mentioned here are thousands. The face pictures of the driver during the driving process can also be directly extracted from the dlib face feature library for training.

[0032] 2. A Prior Box (a network structure) is introduced into each convolutio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a blinking frequency and line-of-sight prediction method based on eye area generation network, which can be used for driver fatigue driving warning. The specific steps are as follows: Firstly, machine deep learning is used to extract the characteristic area of ​​the driver's eye captured by the camera, and the driver's eye is simulated by ellipse fitting on the feature area, and the blink frequency and The pupil position estimation method gives the blink frequency and the driver's gaze direction, which provides supporting data for the driver fatigue monitoring system and driver dynamic behavior analysis.

Description

technical field [0001] The invention belongs to the field of automobile safety and relates to a method for estimating the driver's blinking frequency and line of sight, and the method can be used for early warning of driver's fatigue driving. Background technique [0002] At present, traffic accidents caused by fatigue driving still occupy the main component. Therefore, the successful early warning of drivers under driving fatigue has become a problem that people pay more and more attention to. This has also led most researchers to propose many effective auxiliary measures for this problem. The development of image processing technology and the extraction of facial features have provided a theoretical basis for the research on driver fatigue warning methods, but they are still immature. period. For example: [0003] Since the target may appear anywhere in the image, and the size and aspect ratio of the target are also uncertain. In the process of traditional target detect...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06N3/04
CPCG06V40/171G06V40/18G06V20/597G06N3/045
Inventor 赵栓峰许倩张传伟
Owner XIAN UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products