241 results about "Eye state" patented technology

The auxiliary safety operation equipment based on omnibearing computer vision includes an omnibearing vision sensor for acquiring omnibearing video information outside and inside the vehicle, and an auxiliary safety operation controller for detecting fatigue operation and warning on fatigue operation. The omnibearing vision sensor installed in the right of the driver's seat and connected to the auxiliary safety operation controller detects the facial state, eye state and mouth state of the driver and the steering wheel state, monitors the vehicle direction, speed, etc, and warns the fatigue operation in case of detecting fatigue operation state. The present invention detects the characteristic parameter of fatigue operation state, and has high judgment precision and high measurement precision.

The invention, which is an embodiment of what the inventor calls, “Active Behavior Enhanced Iris Recognition Authentication”, employs a sequential iris imaging process where the authenticating party directs his or her gaze in specific directions, or closes their eyes for each image, so that an “eye state order” can be used to improve authentication security. Authentication security is strengthened based upon the reduced likelihood that a potential intruder would 1.) know what the correct sequence of eye states (i.e. up, down, left, right, camera view and closed) were associated with the control authentication template; 2.) be able to successfully “hack” the authentication server in order to gain access to the iris image information and also the eye state order information which would be required in order to fully compromise the authentication system. The technique embodied by the invention represents an overlay of a known, ordered sequence, over the iris recognition authentication process itself.

The invention discloses an eye positioning and eye state recognizing method, wherein first setting an self-adaptive threshold value to pretreat a face image, according to the face geometry character, designing an eye classifier, positioning eye initially, for some edge images, based on the symmetry face and eye, accurately positioning eye, thereby providing a method for positioning face symmetry axis based on lip auxiliary positioning, then dividing one eye from a positioned eye binary picture, according to the black pixel character of pupil, judging the eye state. The inventive method has real-time property, with the application for different backgrounds, lights, rotation and bias angles, and face details or the like to position eye and recognize eye state.

The invention relates to a method for detecting fatigue driving and driving in an abnormal posture under multiple postures. The method comprises the following steps: step 1, image acquisition: acquiring driver image information; step 2, image recognition: carrying out real-time face detection on the acquired images; step 3, face feature point calibration: calibrating feature points of eyes and a mouth of the detected face; step 4, judgment of the states of the eyes and the mouth: for the feature points, analyzing the closing states of the eyes and the mouth by adopting an eye state detection method on the basis of face width information; step 5, detecting of three-dimensional posture of the head: detecting the three-dimensional posture of the head through geometrical characteristics; step 6, judging of the states of fatigue driving and driving in the abnormal posture: judging whether the driver is in fatigue or not according to the closing states of the eyes and the mouth, and judging whether the driver is in the abnormal driving state or not according to the three-dimensional posture of the head.

The invention discloses driver fatigue state recognition method and system based on information fusion, wherein the method comprises the steps of: acquiring eye state information of a driver, operating state information of a steering wheel and track driving state information of a vehicle; processing the eye state information of the driver, the operating state information of the steering wheel and the track driving state information of the vehicle to obtain fatigue expression information of the driver; and carrying out weighting fusion processing on the fatigue expression information to obtain a fatigue membership degree corresponding to a drive fatigue grade, and obtaining the fatigue degree of the driver according to the fatigue membership degree. The invention improves the reliability and the accuracy of monitoring the driver fatigue state, can reduce the quantity of traffic accidents caused by the fatigue driving of the driver, ensures the road traffic safety, and has strong practicability because the acquisition of multi-source information does not cause the interference on the driving of the driver.

The present invention is to provide a method of restoring closed-eye portrait photo, which comprises the steps of detecting the locations and range of the eyes of a portrait photo being taken, retrieving a patch of a designated range of the eyes area and its neighboring area which represents the expression of the eyes and its neighboring area, determining whether the eyes of said patch are open or closed by using an eyes state classifier, temporarily storing said patch as an open-eye templet when it is determined that the eyes are open, detecting the locations and range of the eyes of a subsequently taken portrait photo, calculating an eyes restoration area when it is determined that the eyes are closed, replacing the closed-eye patch with said open-eye templet, and performing fusion operation toward said eyes restoration area to ensure that each portrait photo generated is with the eyes opened.

A method for sensing the state of an eye of a subject comprises measuring light reflected from an ocular surface and comparing the measured light to a reference. A method for treating an eye of a subject comprises sensing the state of the eye as described above, and controlling whether a substance is delivered to the eye whereby the substance is so delivered only when the eye is sensed to be open. A device for sensing the state of an eye comprises a light source that directs light to an ocular surface of a subject, and a sensor for measuring light reflected from the ocular surface. An apparatus for treating an eye of a subject comprises a device for sensing the state of an eye as described above, an applicator for delivering a substance to the eye, and a control system that permits delivery of the substance when the sensing device detects that the eye is open but prevents delivery of the substance when the sensing device detects that the eye is closed.

Control of a head-mounted display includes providing a head-mounted display, the head-mounted display includes a switchable viewing area that is switched between a transparent viewing state and an information viewing state. The transparent viewing state is transparent with respect to the viewing area and enables a user of the head-mounted display to view the scene outside the head-mounted display in the user's line of sight. The information viewing state is opaque with respect to the viewing area and displays information in the switchable viewing area visible to a user of the head-mounted display. A user-eye detector provides an external stimulus notification in response to a detected change in the state of the eye of the user; and causes the viewing state to automatically switch in response to the external stimulus notification.

The invention discloses an automatic sleep control system of a display device and a control method thereof. The automatic sleep control system of the display device comprises an eye locating unit, an eye state unit and a command unit. The eye locating unit is used for carrying out detection and recognition on users and locating human eyes. The eye state unit is used for carrying out detection on the located human eyes, generating and sending human eye state commands and then sending the generated human eye state commands to command modules. The command unit is used for judging the human eye state commands and controlling the display device to enter a sleep mode or a power-off mode according to the commands. The automatic sleep control system of the display device overcomes the defects in the prior art, is environment-friendly and humanized in design, and achieves energy conservation and emission reduction. The automatic sleep control system of the display device can automatically enter the sleep mode or the power-off mode when detecting that people close eyes or nobody watches over a certain time.

The invention provides a vision-based interactive electronic equipment control system and a control method thereof. The system comprises a target detecting and identifying module, a state monitoring and identifying module and an instruction identifying and setting module, wherein the target detecting and identifying module is used for detecting and identifying the face of a user and positioning the eyes; the state monitoring and identifying module is used for detecting the state of the positioned eyes, generating an eye state instruction and sending the generated eye state instruction to the instruction identifying and setting module; and the instruction identifying and setting module is used for judging the validity of the eye state instruction and correspondingly controlling the electronic equipment according to the eye state instruction.

The invention discloses a method for testing driver fatigue based on monocular vision. The method achieves the purpose reminding the driver of safe driving through monitoring the working state of a driver by means of detection and tracking of a human face, detection and positioning of human eyes and identification of eye states. The method is specially characterized in that a camera facing towards the face of the driver is installed above a dashboard in a cab, the lens of the camera is peripherally provided with infrared LED illuminating light sources; the facial images of the driver are acquired by using the camera, every acquired frame image is subjected to the detection and tracking of human faces, and the detection and positioning of human eyes are performed in a human face area resulting from the detection, the opening and closing states of human eyes are identified by means of left/right eye areas, and finally, fatigue detection is accomplished through the detection state of continuous frames. The method disclosed in the invention can achieve the accurate prompt of driver fatigue, and has the advantages of no disturbance to driver, high real-time property, high robustness, low hardware cost and easiness in popularization.

The invention discloses an image processing method and device and image processing equipment, and belongs to the technical field of images. The image processing method comprises the steps that it is determined that a current shooting mode is a group photo shooting mode; multiple frames of shot images of targets to be shot at multiple assigned shooting angles are obtained; eye state recognition processing is carried out on the multiple frames of shot images, and a recognition result is obtained; according to the recognition result, in at least one frame of shot image corresponding to each assigned shooting angle, assigned images with the smallest number of targets to be shot with the closed eyes is selected; composition processing is carried out on the multiple assigned images, and a composite image in which the eyes of each target to be shot are open is obtained. Due to the fact that in the group photo shooting mode, the targets to be short with the closed eyes in the shot images can be automatically processed, the composite image in which the eyes of each target to be shot are open is obtained, image processing is intelligent, easy and convenient, and labor and image processing time are saved.

The invention discloses a near infrared eye positioning and eye state identification method, belongs to the field of image processing and mode identification, and is applied to driver fatigue detection and visual line tracking. The method involves, first of all, performing face positioning on an input near infrared image, then positioning an eye area by use of an near infrared eye positioning algorithm based on a cascade structure, and finally determining an eye state by use of an eye state identification algorithm based on HOG-LBP characteristic fusion. The method can robustly position two situations, i.e., eye opening and eye closing under an infrared condition and accurately identify the eye state. At the same time, the calculation complexity is not high, and the real-time performance is satisfied.

The invention relates to an eye and mouth state recognition method based on a convolutional neural network. SR-Net (State recognition nets) designed through the method learn a large amount of different eye and mouth state samples. Face state recognition can be regarded as eye state recognition and mouth state recognition. Eye and mouth states can be recognized and classified more accurately. Due to the convolutional neural network, extraction of artificial features is avoided, and recognition on eye and mouth states has high robustness. Due to the method of the invention, the recognition rate in a sunglass wearing condition is enhanced, the average accuracy for eye state recognition is improved to more than 98.41%, the average recognition rate for eye states without glasses is 98.92%, and the average recognition rate for the mouth states is 99.33%.

The utility model relates to a detection method of eye state based on cascade sort and Hough circle transform, belonging to the field of pattern recognition, which is characterized in the following steps: to acquire a face image; to carry out skin color segmentation in the YCbCr color space to acquire the position information of the skin color area using an ellipse skin model; to detect the rectangular eye area with the method of eye detecting window traversal with a cascade eye classifier; to merge a rectangle by rectangular merge method to get a merged eye rectangular linked list; to operate edge detection and binarization in turn on every rectangular eye area in the merged eye rectangular linked list with a Sobel operator to get an binary image; to detect the eye state of every binary image in turn with horizontal projection method; to further detect the eye state by Hough circle transform detection method if whether the present state is eye closure is not certain. The utility model increases the speed of eye detection, tracks and analyzes the eye state with the skin color segmentation, which is suitable for attention detection and fatigue detection.

The invention relates to a driver fatigue detecting method and a system based on vision, belonging to the technical field of computers. The method comprises an image acquisition part, a human eye detection part, a fatigue judgment part and a fatigue alarming part. In the image acquisition part, a camera is used to acquire the facial image of a driver and the image is transmitted to a mobile phone end by a local area network constructed by a wireless router; in the human eye detection part, adaboost algorithm is used to carry out human face detection and human eye detection and the eye state can be judged by human eye area binarization; in the fatigue judgment part, the fatigue degree can be calculated by combining frequency of wink with the P80 measurement method of PERCLOS according to the open and close states of the human eyes; and in the fatigue alarming part, and when the fatigue state is judged, a mobile phone alarms by ringing and simultaneously triggers an alarm to alarm. By the method and the system disclosed by the invention, alarm signals can be sent in time when a driver is in fatigue driving, and the safety of life and property of drivers is guaranteed. The method and the system can be as applied to general driving safety accessories and traffic supervision and the like, and also can be used for fatigue detection of pilots and the crew. The method and the system disclosed by the invention has high reliability, low cost and good applicability.

The invention provides an automatic screen brightness regulating method and device which are used for an intelligent terminal. The automatic screen brightness regulating method comprises the following steps: the intelligent terminal detects eye states of a user through a front camera; the eye states comprise eye opening amplitude between the upper eyelid and the lower eyelid, and eye closing and blinking frequencies; the brightness of an intelligent terminal screen is automatically regulated according to the eye states of the user; when the eye opening amplitude of the user is smaller than a preset amplitude or the blinking frequency is greater than a preset value, the brightness of the intelligent terminal screen is controlled to be lowered. According to the automatic screen brightness regulating method and device provided by the invention, the brightness of the intelligent terminal screen is automatically regulated according to the detected eye states of the user to protect the eyes of the user and prevent over-fatigue of the eyes of the user.

The invention discloses a method and a device for detecting a fatigue state based on a video image. The method comprises the following steps of: carrying out face detection on a video frame image of a user collected in real time, so as to acquire a face image of the user; analyzing the acquired face image, and positioning the position of eyes of the user, so as to obtain an eye image; analyzing the eye image, and determining whether the eyes of the user are opened or closed; and counting the eye states of the user within the counting time of the preset eye state, and determining whether the user is fatigue according to the counting result. By the method, the state of the user can be automatically identified, and voice prompt or alarming can be performed after the fatigue state of the user is detected.

The invention discloses a method and system for automatically regulating screen display. The method includes the following steps: photographing a face part photo of a user; acquiring a light feature and an eye state in the face part photo; acquiring a screen display parameter corresponding to the light feature, the screen display parameters including screen brightness parameter; adjusting the screen brightness parameter in the screen display parameter in accordance with the eye state; using the adjusted screen display parameter to regulate the screen display. According to the invention, the system, through photographing the face part photo of the user, regulates the screen display in accordance with the light feature and eye state in the face part photo, which enables human eyes to be at a comfortable state and achieves the effect of effectively protecting eyesight of the user.

The invention discloses a driver state monitoring method based on vision information fusion and a driver state monitoring system based on vision information fusion. The method comprises steps that: a driver face image and a road image in front of an automobile are acquired, and the images are pre-processed; face positioning on the pre-processed driver face image is carried out to acquire a face area; an eye pupil mass center and a pupil area in the face area are positioned to acquire eye state parameters, and eyes are tracked; track line detection and identification on the pre-processed road image in front of the automobile are carried out; according to a detected track line, an automobile driving direction and a navigation line included angle are calculated to determine whether the automobile deviates from the track; the driving state of the driver is discriminated according to the eye characteristics of the driver and the automobile deviation degree. The driver state monitoring method integrates two computer vision modes, improves detection efficiency, realizes real-time monitoring and alarm when the driver is under abnormal driving states, e.g., fatigue driving, after-drinking driving and driving with disperse attention, and thereby automobile safety driving is guaranteed.

The invention discloses a fatigue detection method based on face detection and eye state identification, comprising the following steps: first, sampling a monitoring video of a driver to get a face sample set; then, loading a to-be-detected image frame in the face sample set to a final classifier trained using an adaptive boosting algorithm, scanning image pixels to get a face image set, binarizing precise face areas under different light conditions based on different thresholds through use of an Otsu method, getting the optimal threshold, and precisely positioning the eye area through use of a vertical gray-level projection method to get the best eye shapes in the open state and in the closed state respectively; and finally, judging the fatigue state of the detected person through use of a PERCLOS method. The beneficial effects are as follows: the running speed is high, and the identification effect is good; and effective warning can be issued according to the state of a driver, and thus, effective help is provided for the avoidance of fatigue driving and traffic accidents caused thereby.

An eye state identification device and an eye state identification method based on infrared detection are provided. The eye state identification device comprises an infrared transmitting module and an infrared receiving module which are arranged around an eye. The infrared transmitting module and the infrared receiving module are connected with a single chip microcomputer module, and the single chip microcomputer module is connected with a positioning module. The single chip microcomputer module is further connected with a communication module and an alarm module. According to the eye state identification device and the eye state identification method based on infrared detection, the eye movement is monitored by transmitting infrared light actively and detecting the intensity of reflected light in different eye positions based on the fact that different optical surfaces have different reflectivity to infrared light. The device and the method have the characteristics of simple structure, small size, a small amount of calculation, and good real-time performance.

The invention discloses a student class attention detection method. The method comprises the following steps: a teaching image of a teaching teacher and a face image of a class student is collected; Aspectral extinction method based on the set depth data extracts the state of the eyes of the student in the frame image; the sight orientation of student eyes is calculated; the moment of distractionof the student is recorded in the classroom teaching process, cross comparison with the teaching image is performed, and the cause of distraction of the student is analyzed. The attention condition of the student can be calculated by only extracting the eye state of the student and utilizing the continuity of the position and the eye state of the student in the classroom teaching process. According to the detection method, the video recognition algorithm is optimized, the calculation amount is reduced, the classroom attention condition of each student can be obtained through data unification,the large-area distraction time points of the students and the teaching content of the teacher are compared in a crossed mode, the teacher can find out the lack of teaching, the teaching level is improved, and the teaching quality is improved.

The embodiment of the invention provides a terminal processing method and device, and a mobile terminal. The method comprises the steps of starting an iris detector to collect eye image information of a user when the mobile terminal is used by the user; determining whether pupil size information is in a first range or not according to the eye image information; and adjusting screen brightness of the mobile terminal to enable the pupil size information to satisfy the first range when the pupil size information is not in the first range. Pupil sizes can represent user eye states, the screen brightness is automatically adjusted through the pupil sizes, and the brightness adjustment accuracy is improved.

An eye-tracking-based method and system of managing multi-screen view on a single display screen are disclosed. The method includes: when the display screen of a mobile terminal is under the multi-screen mode, determining the user's current eye gaze coordinates on the display screen using eye-tracking technology; determining whether a duration the user's gaze point stays within a specified range about the current gaze coordinates exceeds a preset gaze threshold, if exceeds, analyzing the user's eye movement information using the eye-tracking technology; when the eye movement information denotes an open-eye state, then determining whether the duration the gaze point stays within the specified range about the current gaze coordinates exceeds a preset full-screen threshold, if exceeds, display in full screen the split screen where the current gaze coordinates are located. Thus, the eye-tracking technology can be used to obtain the current gaze coordinates and the corresponding gaze duration and the eye movement information, and determinations can then be made whether to make the split screen of interest full-screen or to exit the full-screen view, providing convenience to the user.

The invention relates to a driver fatigue monitor system based on infrared eye state identification, which comprises a video acquisition module, an eye initial positioning module, an eye tracking predicting module, an eye accurate positioning module, an eye state identifying module, a fatigue state computing module and a driver fatigue prewarning module, wherein the video acquisition module is used for acquiring a head video image of a driver; the eye initial positioning module is used for processing the head video image by adopting a background difference technology for initially positioningeyes; the eye tracking predicting module is used for tracking and predicting the positions of the eyes by adopting a kalman filter; the eye accurate positioning module is used for realizing accurate positioning of the final positions of the eyes by adopting an improved Mean-Shift of fusion infrared image space textures; the eye state identifying module is used for carrying out binary or edge detection on an eye region and obtaining length and width information of the eyes; the fatigue state computing module is used for judging eye fatigue state according to a P80 standard of PERCLOS in accordance with the eye state of a current detection time period; and the driver fatigue prewarning module is used for judging the current state as a fatigue state and sending a warning command. The invention has high reliability, relatively smaller computation amount of the system, and good real-time.