170results about "Acquiring/recognising eyes" patented technology

The application discloses a driver distraction monitoring method, aiming at solving the problems of false alarm or missed alarm of the existing driver monitoring system caused by individual differences of drivers, environmental changes, and single sensor failure. The application obtains the face image collected by the vehicle-mounted DMS camera and the eye movement data collected by the AR glasses worn by the driver in parallel, respectively calculates the first state parameter and its confidence, the second state parameter and its confidence. Based on the confidence evaluation result, the fusion strategy is dynamically selected: when both channels have high confidence, the or logical judgment is adopted; when the judgment results conflict, the high confidence channel result is used as the criterion; when the single channel confidence is lower than the threshold, the channel judgment is suspended and the other channel is completely relied on. In addition, the change of the pupil diameter based on the AR glasses can distinguish visual distraction and cognitive distraction. The application realizes intelligent collaboration of multi-source heterogeneous sensors, and significantly improves the accuracy and robustness of distraction monitoring in complex scenes.

According to an embodiment of the disclosure, a method for providing privacy enabled eye tracking performed by an electronic device may be provided. The method may include obtaining a first image of at least one eye of a user. The method may include extracting gaze information of the at least one eye, based on the first image. The method may include generating an image prompt based on the gaze information of the user. The method may include providing the image prompt with the gaze information to a pre-trained artificial intelligence (AI) model to generate a second image of the at least one eye of the user. The biometric information of the at least one of the user may be anonymized in the second image.

The application discloses an eye movement detection method and system and a storage medium, which are applied to eye movement measurement requiring a subject to gaze at a visual target, and relate to the biomedical field, in particular to the technical field of eye movement detection. The eye movement detection method comprises the following steps: acquiring head posture data of the subject; determining a compensation amount of the visual target according to the head posture data, wherein the compensation amount comprises a compensation displacement amount and / or a compensation rotation amount; updating a display position and / or an orientation of the visual target according to the compensation amount of the visual target, so that a direction in which a center of an eyeball of the subject points to the visual target is consistent with a direction in which the center of the eyeball of the subject points to the visual target in a preset reference state; collecting eye image data of the subject during presentation of the visual target; determining at least one eye movement parameter based on the eye image data; and outputting an eye movement measurement result of the subject based on the head posture data and the eye movement parameter. According to the scheme, the influence of non-target eye position adjustment of the subject on the eye movement measurement result caused by the subject for maintaining the gaze is reduced, and the accuracy of the eye movement measurement is improved.

A system for assessing an eye using an optical coherence tomography (“OCT”) device includes a controller having at least one processor and at least one non-transitory, tangible memory on which instructions are recorded. The controller is adapted to receive an original OCT image of the eye captured via an OCT device. At least one learning module is selectively executable by the controller. The learning module is trained by a training network with a dataset having respective historical ultrasound bio-microscopy images and respective historical OCT images. The controller is adapted to receive input data, including the original OCT image and biometric parameters of the eye. The controller is adapted to execute the at least one learning module to generate one or more quantified image features based on the original OCT input data. The quantified image features include a lens thickness and a lens diameter.

The present invention relates to an apparatus (10) for determining at least one intent of at least one user. The apparatus (10) includes an eye movement sensing device (19) configured to sense at least one eye movement signal from the user, the eye movement signal being indicative of at least one eye movement of the user, and a head movement sensing device (24) configured to sense at least one head movement signal from the user, the head movement signal being indicative of at least one head movement of the user. The apparatus (10) is configured to determine at least one degree of correlation between the eye movement signal and the head movement signal and to determine at least one intent of the user based on the determined degree of correlation. The invention further relates to a corresponding method.

Methods for performing user authentication based on a similarity scoring technique for devices, such as head-mounted display devices, are disclosed. An image may be captured of an eye and may then be transformed into an iris feature representation. A similarity scoring technique may be determined based on discrimination factors of the iris feature representation and / or discrimination factors of one or more reference iris feature representations associated with a user identifier (ID). The similarity scoring technique may produce a similarity score based on applying a selected or modified scoring algorithm to the iris feature representation and the one or more reference iris feature representations. The similarity score may be compared to a threshold to provide an indication of whether the respective representations constitute a match. An authentication operation based on the user ID and the indication may be performed.

Methods and apparatus for providing eye model matching in a device are disclosed. When a user activates a device and the presence of the user's eye is detected, an image of the user's eye is captured. An eye model matching process is then implemented to determine a stored eye model (e.g., an eye model stored after enrollment of the eye on the device) that best matches the eye in the captured image. Determination of the best matching eye model may be based on matching between properties of the user's eye in the captured image (such as cornea and pupil features) and properties of the user's eye determined by the eye model. The best matching eye model may then be implemented in, for example, an eye gaze tracking process. In certain instances, the best matching eye model satisfies a threshold for matching before being implemented in the downstream process.

The present disclosure provides an electronic device, a control method of an electronic device, a program, and a medium. The electronic device includes a plurality of irradiation units configured to irradiate an eyeball of a user with infrared light, an image capturing unit configured to capture an ocular image obtained when the infrared light from the plurality of irradiation units is reflected by the eyeball, one or more memories, and one or more processors in communication with the one or more memories. The one or more processors and the one or more memories are configured to calculate a gaze position of a user viewing a display unit based on a combination of corneal reflection images included in the ocular image, and set an order with respect to each of the combinations of the corneal reflection images based on a predetermined condition during a calibration process for improving a calculation precision of the gaze position.

A blinking monitoring method, system, medium and product in a strong light environment, the method comprising: a blinking monitoring system determining a user eyelid contour and a visible part of a user pupil from a user eye image, predicting an invisible part of the user pupil based on complete pupil information of the user, and then calculating a visible pupil ratio, an effective pixel ratio, and an eyelid height-width ratio. When the difference between the visible pupil ratio and the effective pixel ratio is within a preset error range, the blinking monitoring system calculates the degree of closure of the user's eyes corresponding to the user eye image according to a first weight of the eyelid height-width ratio and a second weight of the visible pupil ratio. In a preset time period, the blinking monitoring system obtains a plurality of user eye images with the same time interval, and determines the degree of closure of the user's eyes for each user eye image in turn to evaluate the blinking of the user in the preset time period. By implementing the method, the blinking indicators of the user can be accurately obtained, thereby predicting the fatigue state of the user.

Described herein is an image pre-processing system and method. One embodiment provides a method (500) including: at step (501), receiving a plurality of images captured at a first frame rate, the plurality of images captured under at least two different image conditions; pre-processing the plurality of images by: at step (502) identifying one or more regions of interest within the images; at step (503), performing a visibility measure on the one or more regions of interest; and, at step (504), selecting a subset of the plurality of images based on the visibility measure; and, at step (505), feeding the subset of images to an image processing pipeline for subsequent processing at a second frame rate that is lower than the first frame rate.

A method includes receiving, by a processor, a video of an illuminated face. Video frames in the video are associated with different time instants of a time series, respectively. The method includes determining a region of interest (ROI) that includes a closed eye on the face based on at least one frame in a plurality of video frames in the video. The method includes slicing each ROI based on slice parameters for selecting a vertical slice that includes a eye centroid of the closed eye, and selecting a horizontal slice that intersects the vertical slice at a pivot (P) located lp pixels from the eye centroid. The method includes determining an eyeball motion signal according to the time series, based on a measured value of a shadow intensity of the eye within at least one of the vertical slice or the horizontal slice at each of the different time instants.

Some embodiments provide display eyewear with hearing augmentation. In general, one disclosed aspect features a head-mounted device that includes a microphone, a display panel visible to a wearer, an eye-tracking device configured to determine a direction of gaze of a wearer of the head-mounted device, and a controller configured to extract speech from sounds collected by the microphone from the determined direction and present the extracted speech on the display panel.

The invention relates to a method for reducing glare experienced by a driver of a vehicle due to light sources located outside the vehicle, wherein the driver's glare is determined based on the measured pupil diameter of each driver's eye. According to the invention, the glare is reduced by a pupillary light reflex of the driver's eye initiated based on light emitted from an activated lighting unit in the vehicle.

In certain embodiments, an ophthalmic system includes a camera system and a computer. The camera system obtains eye images of an eye (that has an eyelid) during an imaging period. The computer system receives the eye images of the eye from the camera system and extracts a column image from each eye image of the eye images to yield column images. Each column image has a respective longitudinal axis substantially parallel to a vertical axis of the eye. Each column image shows at least the eyelid of the eye at a respective time during the imaging period. The computer system generates a time sequence image from the column images. The time sequence image comprises the column images in temporal order and indicates the position of the eyelid at respective times during the imaging period. The computer system outputs a blink analysis output that includes the time sequence image.

In some aspects, a user device may receive, from a vision sensor of a user device, first image data associated with a first set of images. The user device may determine, using an image processing model, that a set of images depict a particular type of eye activity of an eye of a user. The user device may cause, based at least in part on determining that the first set of images depict the particular type of eye activity, a power level of a camera of the user device to be reduced.

An eyeball tracking method and a virtual reality device are disclosed. The eyeball tracking method is applied to the virtual reality device, the virtual reality device comprises at least two cameras, and shooting areas of the cameras are partially overlapped. The eyeball tracking method comprises the steps of: acquiring images captured by at least two cameras at a same moment; superimposing overlapping areas in the images to obtain a target image including an eyeball area; and performing eyeball tracking according to the target image. The accuracy of eyeball tracking can be improved.

A method for training an image processing model includes: acquiring a to-be-corrected eye image set matching a usage environment of the image processing model; performing style transfer on to-be-corrected eye images in the to-be-corrected eye image set through a style transfer network in the image processing model, to obtain a target eye image; acquiring a training sample matching the usage environment of the image processing model based on the to-be-corrected eye images and the target eye image, the training sample including object eye images matching different gaze positions; and training a correction network in the image processing model through the training sample matching the usage environment of the image processing model, to obtain a model update parameter matching the correction network, and generating a trained image processing model based on the model update parameter.

A method for determining the attention of a driver of a vehicle, wherein: - the driver's gaze direction is determined; - an attention value is continuously determined that is representative of the driver's attention to a predefined area, wherein the attention value is determined by: - ​​determining, depending on the determined gaze direction, whether the driver is looking into the predefined area; - if it is determined that the driver is looking into the predefined area, determining the attention value using a predefined loading function, where the loading function is a predefined exponential function; and - if it is determined that the driver is not looking into the predefined area, determining the attention value using a predefined unloading function.

Provided is a wearable electronic device which may adjust the transmittance of a visor and the intensity of a display. According to various example embodiments, a wearable electronic device may include a visor adjusting the amount of external light entering a user's eyes depending on a transmittance, a display outputting the light projected on the user's eyes through an optical waveguide, a camera capturing an image of the user's eyes, and a processor tracking the user's gaze direction from the image of the user's eyes and supplying a control signal to the visor and the display, wherein the processor may determine the transmittance of the visor and the intensity of light output from the display.

Disclosed in the present invention is an optimized driver fatigue monitoring method. On the basis of performing feature extraction on driving images by means of face detection, face position prediction is incorporated, and whether to perform feature extraction on the driving images by means of face detection or perform feature extraction on the driving images by means of face prediction is determined on the basis of a prediction confidence level of a predicted face position. Only when the prediction confidence level of the predicted face position does not reach a confidence level threshold, face prediction is used to perform feature extraction on the driving images, thereby reducing the number of times of performing feature extraction on the driving images by means of face prediction, and saving computing power and time. Further disclosed is an apparatus for implementing the driver fatigue monitoring method.

A method for detecting an iris in an image of an eye of a user captured by a camera of an eye tracking system, the method comprising: processing the image to estimate a pupil position in a 3D coordinate system; estimating an approximate optical axis in the 3D coordinate system; estimating an iris centre in the 3D coordinate system based on the pupil position in the 3D coordinate system; and estimating an iris outline in the 3D coordinate system as a circle lying in a plane with a normal parallel to the approximate optical axis, centred at the iris centre with an estimated iris diameter; and estimating an image iris outline by transforming the iris outline in the 3D coordinate system to an image coordinate system.

A wearable electronic device may include: a camera including a first camera and a second camera; a display; at least one processor comprising processing circuitry; and a memory for storing instructions. When executed by the at least one processor, the instructions can cause the wearable electronic device to: acquire the location of the hand of a user based on at least one first image acquired through the first camera; acquire the gaze point of the user based on at least one second image acquired through the second camera; identify whether the location of the hand corresponds to the gaze point; acquire, based on the location of the hand corresponding to the gaze point, a skeleton including key points related to the hand; and perform an operation related to the hand on the basis of the acquired skeleton.

In certain embodiments, an ophthalmic system includes a camera system and a computer. The camera system obtains eye images of an eye (that has an eyelid) during an imaging period. The computer system receives the eye images of the eye from the camera system and extracts a column image from each eye image of the eye images to yield column images. Each column image has a respective longitudinal axis substantially parallel to a vertical axis of the eye. Each column image shows at least the eyelid of the eye at a respective time during the imaging period. The computer system generates a time sequence image from the column images. The time sequence image comprises the column images in temporal order and indicates the position of the eyelid at respective times during the imaging period. The computer system outputs a blink analysis output that includes the time sequence image.