108 results about "Eye tracking system" patented technology

Examples relate to systems and methods for enhancing generative AI outputs using eye tracking data. An eye tracking system accesses eye gaze information associated with a field of view of a head-wearable apparatus and generates contextual information associated with the field of view of the head-wearable apparatus based on the eye gaze information. The eye tracking system processes, by a generative machine learning model, the contextual information and at least one image of the field of view of the head-wearable apparatus to generate an output and presents on a display of the head-wearable apparatus the output generated by the generative machine learning model.

An optical device can include a first securement arm, a second securement arm, and a lens frame defining a lens aperture and including a nose bridge, the lens frame connected to the first and second securement arms. The optical device can also include an eye-tracking camera mounted to a platform extending from the lens frame, the platform disposed proximate the nose bridge. An electronic component is disposed in the lens frame, the electronic component electronically connected to the camera.

The embodiment of the invention discloses an eye movement tracking system and wearable equipment. The eye movement tracking system comprises a first light source module, a second light source module, a waveguide, an image acquisition module and a control module. Wherein the control module is configured to control the first light source module and the second light source module to be turned on in a time-sharing manner so as to alternately emit light rays towards the first eye and the second eye, and the waveguide transmits reflected light of the first eye and the second eye to the image acquisition module so that the image acquisition module can acquire image information of the first eye and the second eye. And the control module determines the fixation point information according to the image information. Therefore, the eye movement tracking system is favorable for reducing the production complexity and cost, improving the yield, and improving the aesthetic property and the user experience.

Disclosed are gaming systems, methods and machines that include one or more eye gaze tracking systems. In particular, the eye gaze tracking system may be incorporated with a gaming system, or located with a gaming environment and otherwise connected to a gaming system. When the focus of the user's gaze is identified, the gaming system can activate a response in the feature associated with the user's gaze. This can include a virtual feature on a display screen or a feature, such as lighting or signage, on the gaming system or within the gaming environment.

The invention discloses an eye movement tracking stability enhancing method, system and device and a storage medium, and belongs to the field of human-computer interaction and computer vision. The method comprises the following steps: acquiring an eye image and an original sight fixation point coordinate; performing quantitative evaluation on the image from five dimensions of definition, contrast and the like to generate an eye image quality evaluation grade; calculating the moving speed and acceleration of the current point based on the historical sight fixation point sequence; fusing, and judging and correcting the original coordinates. Through multi-modal information fusion and hierarchical adaptive correction, noise jump caused by poor image quality can be accurately distinguished and filtered out, meanwhile, the real eye movement dynamic state is effectively reserved, and the output stability and reliability of an eye movement tracking system are remarkably improved.

An eye tracking system for a head-mounted device includes an imaging assembly and an illumination assembly. The imaging assembly is configured to optically focus light from an object plane of an eye onto an image plane of an image sensor, and the illumination assembly is configured to optically project light from an illumination source onto the object plane of the eye. The imaging assembly is configured with an imaging angle coding mapping for optical relay coupling imaging. The illumination assembly is configured with an illumination angle coding mapping for optically coupling a projection.

The invention relates to the technical field of man-machine interaction, and discloses an eye movement tracking method, intelligent glasses, a mobile terminal and an eye movement tracking system.The method comprises the steps that current head movement data of a wearer is collected and sent to the mobile terminal; receiving the current gazing direction of the wearing user fed back by the mobile terminal, and tracking the eye movement of the wearing user according to the current gazing direction; wherein the current gazing direction is obtained through the mobile terminal according to the current head movement data and a current eyeball image of the wearing user, and the current eyeball image is obtained by shooting eyeballs of the wearing user through a camera. Since the mobile terminal with the camera arranged outside is utilized to complete eyeball collection and fixation direction determination of the wearing user, an independent camera and an independent computing power unit do not need to be arranged in the intelligent glasses, and the size of the intelligent glasses is reduced.

An eye tracking system for detecting position and movements of a user's eyes in a head-mounted display (HMD). The eye tracking system includes at least one eye tracking camera, an illumination source that emits infrared light towards the user's eyes, and diffraction gratings located at the eyepieces. The diffraction gratings redirect or reflect at least a portion of infrared light reflected off the user's eyes, while allowing visible light to pass. The cameras capture images of the user's eyes from the infrared light that is redirected or reflected by the diffraction gratings.

The invention is related a method and a remote eye tracking system for determining a position of at least one eye of a subject. The method comprises the steps of: illuminating a face of a subject using at least one infrared (IR) illuminator off-axis from at least one image sensor; capturing at least one image of the face using the at least one image sensor at a time instant; and using a processing circuitry of the remote eye tracking system, performing processing steps of: determining at least one pupil candidate associated with the at least one image; determining at least one glint candidate associated with the at least one image; determining at least one pupil-glint candidate group, comprising at least one pupil candidate and at least one corresponding glint candidate; generating a score value for each of the at least one pupil-glint candidate groups; and determining an eye position of at least one eye of the subject in the at least one image based on the pupil-glint candidate group with the highest score value.

An apparatus, system, and method for an eye tracking system for a head-mounted device include a light source, an image sensor, and a frame tracking system. The light source and image sensor may be configured to determine absolute and relative eye orientations. The frame tracking system may be configured to determine the displacement of a head-mounted device frame relative to the face of the user. The frame tracking system may provide displacement data for the displacement of the head-mounted device frame to the eye tracking system to enable the eye tracking system to compensate for frame slippage, frame jostling, or other frame displacement (relative to the face of the user). The frame tracking system may include one or more position sensors disposed on the head-mounted device frame and logic configured to determine displacement data using information from the one or more position sensors.

To provide a more efficient system / method for eye motion tracking.SOLUTION: A system and method for eye motion tracking. An anchor point and a plurality of auxiliary points are selected from the reference image. Individual live images in the sequence of images are then searched for a match between the anchor point and the ancillary point. First, an anchor point is found, and then the search for individual auxiliary points is limited to a search window defined by the known distance and / or orientation of the auxiliary point to be searched relative to the anchor point.SELECTED DRAWING: Figure 4

The invention discloses an eye movement tracking system and method based on a position sensitive detector. The eye movement tracking system comprises an infrared lighting module, an optical element, the position sensitive detector and an MCU. The infrared lighting module emits infrared light which can be borne by human eyes to a cornea area of a user, the optical element performs angle compression and beam shrinkage on reflected light obtained after the infrared light is reflected in the cornea area of the user, and then the reflected light enters the position sensitive detector; four paths of voltage signals output by the position sensitive detector are input into the MCU; a reflected light spot position calculation module and a nonlinear mapping relation model between a reflected light spot position and an eyeball rotation angle are integrated in the MCU; the reflection light spot position calculation module is used for carrying out normalization processing on the four paths of voltage signals and calculating a ratio to obtain a reflection light spot position; the nonlinear mapping relation model between the reflected light spot position and the eyeball rotation angle takes the reflected light spot position as input and the eyeball rotation angle as output to realize eye movement tracking.

To provide systems and methods for eye tracking for use in various applications such as virtual reality or augmented reality applications that include head-mounted display devices.SOLUTION: An eye tracking subsystem may be provided, comprising a plurality of assemblies, each including a light source such as an LED, a light detector such as a silicon photodiode, and a polarizer configured to prevent light reflected via specular reflection from reaching the light detectors so that only scattered light is detected by the light detectors. Machine learning or other techniques may be used to track or otherwise determine a gaze direction of a user, which may be used by one or more components of an HMD device to improve its functionality in various ways.SELECTED DRAWING: Figure 5

A system and method of projecting augmentation imagery in a head-mounted display are disclosed. The system includes an eye tracking system configured to generate eye tracking data at an eye-tracking rate in response to a position of a pupil of a user, a head tracking system configured to estimate a change in orientation of the user's head at a head tracking rate and generate jitter data at a jitter sensing rate, a controller configured generate a field mapping in response to render data at a projector update rate, a light generator configured to generate a color encoded light associated with the augmentation imagery, the light generator includes a 2D pixelated display and an optical system configured to image the color encoded light into a field of view of the user, wherein the optical system includes a foveated optical system.

Systems may include an eye-tracking illumination source, a waveguide optically coupled to the eye-tracking illumination source, and an optical sensor positioned to detect light from the eye-tracking illumination source. The waveguide may include at least one optical element for directing light from the eye-tracking illumination source toward an eye of a user. Various other related systems, devices, and methods are also disclosed.

Examples relate to a system (110), a method, and a computer program for a surgical imaging system (100), and to a corresponding surgical imaging system comprising such a system for a surgical imaging system. The system (110) is configured to obtain an eye-tracking sensor signal from an eye-tracking system (130). The system is configured to determine a gaze of a user of a surgical imaging device (120) of the surgical imaging system on a portion of a field of view of the surgical imaging device based on the eye-tracking sensor signal. The system is configured to adjust the field of view of the surgical imaging device based on the gaze of the user on the portion of the field of view.

An eye tracking system operable to image an eye of a user includes an illumination source operable to illuminate the eye and an optical system including a first imaging surface, an aperture stop, and a second imaging surface. The optical system is operable to image an object plane corresponding to the eye. The eye tracking system also includes an image sensor having an image plane parallel to the first imaging surface, the second imaging surface, and the object plane.

A robot eye and two different eye tracking systems may be used in tandem to determine the accuracy of eye tracking software that is used as part of one of the eye tracking systems. If inaccurate, the eye tracking software may then be adjusted in response. In various example embodiments, a camera may be used in one of the eye tracking systems to then track movement of the robot eye using the eye tracking software itself. Also in various example embodiments, the other eye tracking system may include components such magnetic sensors, optical sensors like CMOS sensors, and / or lasers for tracking the same movement of the robot eye.

The present disclosure allows for accurate and computationally efficient gaze tracking without requiring a corneal reflection. Eye tracking systems and methods are provided. They include obtaining images of the user's face, detecting a head pose, and locating the centre eye rotation, the pupil centre, the optical axis, the cornea centre and finally the visual axis corresponding to the gaze direction using user-specific parameters. Calibration systems and methods are also provided for acquiring the user-specific parameters. They include at least twice displaying a target point for the user to glaze at, directing light to obtain a corneal reflection, obtaining an image of the user's face, detecting the head pose, inferring a transformation to convert coordinates between the world coordinate system and a head coordinate system, and locating the corneal reflection, the cornea centre, the pupil centres and the optical axes. The data acquired thereby is used to compute the parameters.

The present invention relates to a head mountable device (100) comprising an eye-tracking system (200), comprising a first detecting subsystem (210) configured to detect at least one first gaze parameter of a respective eye to be tracked when a user wears the head mountable device (100) so as to generate a first signal, wherein the first detecting subsystem (210) is of a low power monitoring type, and a second detecting subsystem (220) configured to detect at least one second gaze parameter of the respective eye so as to generate a second signal, the second detecting subsystem (220) comprises a plurality of detecting elements (221, 222), a processing and control unit (230) associated to the first detecting subsystem (210) and to the second detecting subsystem (220) configured to estimate a region of interest (400) among a predetermined plurality of regions of interest on the basis of said first signal, wherein the estimated region of interest (400) comprises the direction of the gaze of a respective eye to be tracked, the processing and control unit (230) is configured to selectively activate one or more of the detecting elements (221, 222) on the basis of the estimated region of interest (400) for subsequently estimating the direction of the gaze of the respective eye to be tracked inside the estimated region of interest (400) on the basis of said second signal with optimized hardware and computing energy consumption.

An apparatus includes a near eye display 1, an eye tracking system 36 and an array of shutter pixels 30. The eye tracking system determines a user pupil region 8 within an eye box 4 of the near eye display. The array of shutter pixels are across the optical path of the near eye display, or between the near eye display and the eye box. The apparatus controls the near eye display to output at least 24 frames-per-second. Each frame is output as a union of a sequence of two or more sub-frames. The apparatus controls the array of shutter pixels to provide one or more apertures 7. A location of each aperture is determined based on a combination of the user pupil location 33 and which sub-frame is being output, so that light passing that aperture reaches a primary display exit pupil 60 coinciding with the user pupil region. The one or more apertures are sized so that the primary display exit pupil 60 has a diameter of less than or equal to 5 mm at the user pupil region. The optic path of the near eye display may include an output optical element.

A processing unit (9) is configured to receive a first tracking signal (111) from a first receiving unit (151) and a second tracking signal (112) from a second receiving unit (152), wherein the first and second tracking signals (111, 112) are each a function of a user's cornea's rotational speed and position, respectively. The processing unit (9) is further configured to determine the user's cornea's position (7) from the first and second tracking signals (111, 112).

A system and method for inputting to a statistical model a reference image, which is associated with a known direction of gaze of a person and which includes at least a portion of the person's retina, and an input image which is associated with an unknown direction of gaze of the person and which includes at least a portion of the person's retina. The statistical model is trained on multiple images of portions of retinas obtained at known directions of gaze and can output an estimation of a change in orientation of an eye of the person. A signal generated based on the estimation can be used to control a device.

An apparatus includes a near eye display (1). The apparatus also includes an eye tracking system (36) configured to determine a user pupil region (8) within an eye box (4) of the near eye display (1). The apparatus also includes an array of shutter pixels (12, 30) disposed across the optical path of the near eye display (1), or between the near eye display (1) and the eye box (4). The apparatus is configured to control to the near eye display (1) to output at least 24 frames-per-second. Each frame is output as a union of a sequence of two or more sub-frames. The apparatus is also configured to control the array of shutter pixels (12, 30) to provide one or more apertures (7). A location of each aperture (7) is determined based on a combination of the user pupil location (8) and which sub-frame is being output, such that light passing that aperture (7) reaches a primary display exit pupil (60a) coinciding with the user pupil region (8). The one or more apertures (7) are sized such that the primary display exit pupil (60) has a diameter of less than or equal to 5 mm at the user pupil region (8).

An eye tracking system that includes a reference estimator that estimates a rotational model of the eye with N (e.g., five) degrees of freedom and a gaze estimator that estimates a gaze vector with the rotational model as a constraint. The rotational model may include a centroid region rather than a fixed eye center. The rotational model may remain static until a trigger event, at which time a new rotational model is estimated. One or both estimators may include a trained neural network. Model and gaze estimation may depend on eye features extracted from images; the eye features may include glints, but other eye features than glints may be used if the device does not include dedicated eye-illuminating light sources. A glint-based gaze vector and a feature-based gaze vector may be estimated, and a final gaze vector may be determined from the two estimated gaze vectors.

Embodiments relate to an eye tracking system. A headset of the system includes an eye tracking sensor that captures eye tracking data indicating positions and movements of a user's eye. A controller (e.g., in the headset) of the tracking system analyzes eye tracking data from the sensors to determine eye tracking feature values of the eye during a time period. The controller determines an activity of the user during the time period based on the eye tracking feature values. The controller updates an activity history of the user with the determined activity.

This disclosure relates generally to mixed reality, and more particularly to augmented reality systems and methods for the visually impaired. In one embodiment, an augmented-reality electronic glass apparatus is disclosed, comprising: a smart frame, comprising: a printed circuit board, a light emitting diode, a battery, and a communication module with integrated antenna; and a digital lens, comprising: a liquid crystal device display, a lens assembly, a magnetic stackable optic, an eye tracking system, a camera module, a lidar module, wherein the digital lens is magnetically attached to the smart frame.

A holographic display includes an illuminator, a spatial light modulator (SLM) coupled to the illuminator, a beam redirector and an ocular lens coupled to the SLM. A controller is operably coupled to the SLM and the beam redirector and configured to provide exit pupils at eyebox locations where a holographic image may be observed. The exit pupils provided in a time-sequential manner, forming a grid of exit pupils / eyebox locations. An eye tracking system may be used to center the grid around the current eye pupil position, to provide a larger overall eyebox for viewing the holographically generated image.

An augmented reality (AR) system includes a wearable device including: a frame, a projector coupled to the frame, a display optically coupled to the projector, and an eye tracking system. The AR system also includes a memory and a processor configured to: receive an eye gaze location from the eye tracking system, generate an image, and generate a foveation map based on the eye gaze location. The foveation map includes a first region of the image and a second region of the image. The processor is also configured to compress the first region of the image using a first quality setting and the second region of the image using a second quality setting. The first quality setting (e.g., a setting of 100%) can be greater than the second quality setting.

An apparatus, system, and method for a waveguide system may be used to support eye tracking in a head mounted display (HMD). The waveguide system may be positioned in a user's field of view and within a lens assembly of the HMD to capture light that is reflected from an eye. The waveguide system may include a holographic optical element (HOE) configured to in-couple light into a waveguide and direct the light to an out-coupling grating. The HOE may be configured to map a number of incident light rays to a corresponding number of total internal reflection (TIR) angles. The incident light rays may include at least some oblique light rays that are non-normal to an input surface of the HOE. The HOE may have a field of view (FOV) of an eyebox region that is at least partially outside of a periphery of the input surface of the HOE.