Check patentability & draft patents in minutes with Patsnap Eureka AI!

Eye state detection method and computer readable storage medium

A state detection and eye technology, applied in the field of image processing, can solve problems such as miscalibration, blink recognition errors, difficult operation, etc., and achieve the effect of improving accuracy and avoiding false detection

Active Publication Date: 2021-01-22
FUJIAN TIANQUAN EDUCATION TECH LTD
View PDF6 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the calculation complexity of the openpose algorithm is very high. When the current high-performance discrete graphics card 1080ti runs this algorithm, it can only process more than a dozen images per second, not to mention the small smart terminal with relatively low computing power, which is difficult to achieve smooth to run
Although the facial feature point calibration of the dlib algorithm runs very fast and has good results in the daily use of mobile phone software, but when the camera is far away from the person, the eye resolution is very low, and the calibrated eye contour is not enough Accurate, miscalibration often occurs, resulting in blink recognition errors, which is not conducive to remote human-computer interaction

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Eye state detection method and computer readable storage medium
  • Eye state detection method and computer readable storage medium
  • Eye state detection method and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0078] Please refer to Figure 2-7 , Embodiment 1 of the present invention is: an eye state detection method, which can be applied to the eye state detection of low-resolution images, such as figure 2 described, including the following steps:

[0079] S1: Obtain the image to be tested, that is, collect the image through the camera.

[0080] S2: Using a face detection algorithm, identify a face area in the image to be tested. Further, if no human face is detected, the next image to be tested is obtained, that is, the execution returns to step S1.

[0081] The face detection algorithm in this embodiment can use dlib, mtcnn and other algorithms.

[0082] S3: Using the face feature point calibration algorithm, calibrate the eye calibration points in the face area.

[0083] In this embodiment, the 5-point calibration or 68-point calibration of dlib can be used to calibrate the facial feature points, and the obtained eye calibration points are 1 or 6. Among them, the schematic ...

Embodiment 2

[0118] Please refer to Figure 8-10 , this embodiment is another implementation manner of step S7 in the first embodiment.

[0119] In this embodiment, the feature extraction operator used is a growth-type feature extraction operator. At this time, the operator is no longer a fixed size, but is continuously enlarged according to the actual situation of the eye region image.

[0120] like Figure 8 As shown, the step S7 specifically includes the following steps:

[0121] S721: Use an initial feature extraction operator as a current feature extraction operator, where the size of the initial feature extraction operator is a preset initial size. Preferably, for a feature extraction operator with a cross-shaped mask area, its initial size may be 3*3; for a feature extraction operator with a m-shaped mask area, its initial size may be 5*5.

[0122] S722: Acquire a feature extraction area corresponding to the current pixel point according to the size of the current feature extract...

Embodiment 3

[0133] This embodiment is a computer-readable storage medium corresponding to the above-mentioned embodiments, on which a computer program is stored, and when the program is executed by a processor, the following steps are implemented:

[0134] Get the image to be tested;

[0135] acquiring an eye region image in the image to be tested;

[0136] performing binarization processing on the eye region image according to a preset binarization threshold, and performing normalization processing on the binarized eye region image according to a preset normalization size;

[0137] Traversing the image of the eye region, sequentially acquiring one pixel as the current pixel;

[0138] Extract the feature value corresponding to the current pixel according to the preset feature extraction operator, the feature extraction operator is a square mask map, the pixel value of the pixel point in the mask area in the mask map is 1, and other The pixel value of the pixel points in the area is 0, a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an eye state detection method and a computer readable storage medium. The method comprises the steps of obtaining a to-be-detected image and obtaining an eye region image; performing binarization and normalizationon the eye region image; traversing the eye region image, and sequentially obtaining a pixel point as a current pixel point; according to a preset feature extraction operator, extracting a feature value corresponding to the current pixel point, wherein the feature extraction operator is a square mask image, the pixel value of the pixel point of a mask area in the mask image is 1, pixel values of the pixel points of other areas are 0, and the mask area is centered and is in a preset centrosymmetric geometrical shape; generating an eye feature vector corresponding to the to-be-detected image according to the feature value corresponding to each pixel point in the eye region image; and inputting the eye feature vector into the trained classifier to obtain an eye state corresponding to the to-be-detected image. According to the invention, the eye state can be accurately identified in the low-resolution image.

Description

technical field [0001] The present invention relates to the technical field of image processing, in particular to an eye state detection method and a computer-readable storage medium. Background technique [0002] With the rapid development of image processing technology, facial feature point calibration algorithms have achieved good results, which can accurately calibrate the contours of key organs such as eyes, nose, and mouth, such as dlib, openpose, etc. Blink detection can be well used in human-computer interaction, such as unlocking mobile phones after face recognition, blinking to control robots, etc. Ideally, it becomes very simple to identify the state of the eye (blink detection) based on this type of algorithm, as long as the eye contour is used to easily identify the state of the eye. [0003] However, the calculation complexity of the openpose algorithm is very high. When the current high-performance discrete graphics card 1080ti runs this algorithm, it can onl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/193G06V40/197G06F18/214
Inventor 刘德建陈春雷郭玉湖陈宏
Owner FUJIAN TIANQUAN EDUCATION TECH LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More