257 results about "Eye tracking system" patented technology

The invention belongs to the field of eye movement tracking, and particularly relates to an eye movement tracking system, method and equipment integrating electroencephalogram signals and a non-contact eye tracker. The objective of the invention is to solve the problems of limited acquisition range of a non-contact eye tracker and low spatial resolution of eye movement behavior deduction by EEG signals in the prior art. The method comprises the steps that eye movement data and electroencephalogram signals are synchronously collected, after calibration mapping and time sequence alignment preprocessing are conducted, an electroencephalogram modal behavior recognition model is supervised and trained through eye movement fixation point labels, and the incidence relation of the two modals is established. A dynamic fusion strategy is adopted in the online stage, when eye movement data are valid, a model prediction result and the eye movement data are fused to output a fixation point, when eye movement fails, the fixation point is calculated in combination with model prediction and historical data, enhanced compensation of eye movement tracking by electroencephalogram signals is achieved, the defect that the spatial resolution of a single EEG signal is low is effectively overcome, and the accuracy of eye movement tracking is improved. And the robustness and the tracking precision of the system in a complex scene are improved.

A system enables a user to query based on a user's gaze by receiving a query from the user and capturing, via an eye tracking system on a headset, the user's gaze location near an object in a local area. The system captures one or more images of the local area with the object and formats the images based in part on a region of interest in the one or more images that includes the object. The system generates a formatted query based in part on the query. The formatted query is provided to a search engine. Information describing the object determined from the one or more formatted images and information describing the query are used by the search engine to determine an answer to the query about the object. The system presents the answer to the query about the object.

Particular embodiments are directed to passthrough image generation for a mixed-reality experience. A device may determine, using an eye-tracking system of a head-mounted device, eye-tracking data associated with a user of the head-mounted device. The device may determine, based on the eye-tracking data, a desired scene depth for the user. The device may instruct a first autofocus camera of the head-mounted device to adjust a first focus distance based on the desired scene depth and capture a first image of a real-world environment of the user. The device may generate a first passthrough image based on the first image. The device may display the first passthrough image to a first eye of the user via a first display of the head-mounted device.

The invention discloses an eye movement tracking test device and method for VR / AR equipment. The eye movement tracking test device comprises an eyeball simulation module, a pitching module, a rotating module, an interpupillary distance control module, a driving module, a driving control module and a main control module. The main control module sets a test task type and a test track, the rotating module and the pitching module drive the simulation eyeball module to realize rotating motion and pitching motion, and the attitude sensor and the driving control module detect the pitching angle and the rotating angle of the simulation eyeball module and control the corresponding modules to perform error compensation. And the main control module compares the current staring point with a staring point given by the VR / AR equipment eye movement tracking system to realize precision analysis of the VR / AR equipment eye movement tracking system. The VR / AR equipment eye movement tracking test device effectively simulates human eye movement, solves the problem that an existing test device lacks actual movement image information, visually and accurately reflects various real movement of human eyes, and improves the stability of VR / AR equipment eye movement tracking test.

A picture generation unit emits a light field. A mirror reflects the light field toward a windshield of a motor vehicle such that the light field is reflected off of the windshield and is visible to the driver as a virtual image. An infrared emitter transmits infrared energy through the mirror such that the infrared energy is substantially co-axial with the light field, and such that the infrared energy is reflected off of the windshield toward the human driver. An infrared camera captures infrared images based on the transmitted infrared energy reflected off of the human driver and received by the infrared camera. Eye tracking is performed based on the captured infrared images. The infrared energy is transmitted at a higher power level at a beginning of the eye tracking than after the beginning of the eye tracking.

Examples relate to systems and methods for enhancing generative AI outputs using eye tracking data. An eye tracking system accesses eye gaze information associated with a field of view of a head-wearable apparatus and generates contextual information associated with the field of view of the head-wearable apparatus based on the eye gaze information. The eye tracking system processes, by a generative machine learning model, the contextual information and at least one image of the field of view of the head-wearable apparatus to generate an output and presents on a display of the head-wearable apparatus the output generated by the generative machine learning model.

Techniques for controlling light sources used in eye tracking are described. In an example, an eye tracking system generates a first image and a second image showing at least a portion of the user eye illuminated by a predetermined set of illuminators of the eye tracking system. The eye tracking system determines a first position of a glint in the first image and a second position of the glint in the second image. Each of the first position and the second position is relative to a pupil edge. The eye tracking system predicts a third position of the glint relative to the pupil edge based on the first position and the second position. Further, the eye tracking system determines, from the predetermined set, an illuminator that corresponds to the glint and determines, based on the third position, whether to power off the illuminator to generate a third image of at least the portion of the user eye.

To provide a vision line tracking system, a vision line tracking method, and a vision line tracking program which cause an attention degree of parts to which various operators give attention to be confirmed with a high level of actual feeling.SOLUTION: In a vision line tracking method with a vision line tracking system, vision line information is acquired while a user such as a skilled person, while wearing a viewing operation terminal, performs an inspection operation for an object to be observed which is a substantial object such as mechanical equipment. Then, vision line tracking processing is started which tracks a vision line of the user performing an inspection with careful viewing of a spot thought to be in need thereof from the inspection of the object to be observed. Then, viewpoint confirmation processing is started which is preparation of creation of vision line data. Then, the skilled person as an educator, while wearing the viewing operation terminal, observes the object to be observed or a three-dimensional object of the object to be observed for a check and an inspection, creating the vision line data. Then, the vision line data is stored in a vision line information database of a storage unit.SELECTED DRAWING: Figure 3

An optical device can include a first securement arm, a second securement arm, and a lens frame defining a lens aperture and including a nose bridge, the lens frame connected to the first and second securement arms. The optical device can also include an eye-tracking camera mounted to a platform extending from the lens frame, the platform disposed proximate the nose bridge. An electronic component is disposed in the lens frame, the electronic component electronically connected to the camera.

Systems, methods, and computer programs for eye tracking. In one embodiment, an eye tracking system includes a head-mounted device that takes measurements indicative of a position of the eye of a user. A head-mounted camera captures an image of the eye. A computer calculates the position of the eye based on the measurements, utilizes the position of the eye to crop the image around the pupil, and provides a cropped image to a video-based eye tracker. Optionally, the size of the cropped image is less than a third of the size of its respective uncropped image. Optionally, the head-mounted device includes one or more of the following: a photosensor-oculography device (PSOG), an electrooculography device (EOG), an electromyography device (EMG), an optical flow sensor, and a range sensor. Optionally, the image-based eye tracker calculates, based on the cropped image, at least one of pupil diameter and pupillary response.

An eye tracking system can include a first camera configured to capture a first plurality of visual data of a right eye at a first sampling rate. The system can include a second camera configured to capture a second plurality of visual data of a left eye at a second sampling rate. The second plurality of visual data can be captured during different sampling times than the first plurality of visual data. The system can estimate, based on at least some visual data of the first and second plurality of visual data, visual data of at least one of the right or left eye at a sampling time during which visual data of an eye for which the visual data is being estimated are not being captured. Eye movements of the eye based on at least some of the estimated visual data and at least some visual data of the first or second plurality of visual data can be determined.

The invention provides a machine learning and deep learning combined calibration-free eye movement tracking system and method, and the system comprises the following modules: a pre-calibration module which is used for collecting a near-to-eye image of the eyes of a user through a near-to-eye camera and an infrared light source, extracting pupil center coordinates and cornea reflection point coordinates, and outputting the pupil center coordinates and the cornea reflection point coordinates; calculating a personalized kappa angle of the user based on the extracted pupil center coordinates and cornea reflection point coordinates; the decision maker module adopts an AdaBoost ensemble learning algorithm, classifies the users according to the kappa angle obtained through calculation, and outputs a corresponding weight combination; and the deep learning module is used for receiving the output weight combination and the real-time near-eye image, and predicting the coordinates of the fixation point of the user through a convolutional neural network and a residual connection structure. According to the invention, the application flexibility and user friendliness of the eye movement tracking technology are greatly enhanced while the precision is guaranteed.

Systems and methods for performing eye tracking using a scanning light signal with low power consumption are disclosed herein. In one embodiment, respective position(s) of feature(s) of the eye at a future time step are estimated based on the current position of the center of the eye and the current gaze angle. An active subregion of the scan region is determined based on the feature position(s), such that the active region contains, with high probability, all of the feature(s). The photodetectors and light sources are disabled while scanning portions of the scan region outside of the active subregion, and are re-enabled while the scanner scans the active subregion.

The invention provides a head-mounted display eye movement precision test method and device, and relates to the technical field of eye movement tracking precision test.The method comprises the steps that when an artificial eye moves according to preset parameters, first eye movement data, obtained by an encoder collection module, of the artificial eye is obtained, acquiring second eye movement data of the artificial eye sent by an eye movement program in the head-mounted display; comparing the first eye movement data with the second eye movement data to obtain a comparison result; judging whether the eye movement tracking precision of the head-mounted display meets a preset precision requirement or not according to the comparison result; if the eye movement tracking precision meets the preset precision requirement, determining that an eye movement tracking system of the head-mounted display is normal; and if the eye movement tracking precision does not meet the preset precision requirement, determining that the eye movement tracking system of the head-mounted display is abnormal. The technical effect of the invention is that the precision of the eye movement tracking system of the head-mounted display can be effectively tested.

The embodiment of the invention discloses an eye movement tracking system and wearable equipment. The eye movement tracking system comprises a first light source module, a second light source module, a waveguide, an image acquisition module and a control module. Wherein the control module is configured to control the first light source module and the second light source module to be turned on in a time-sharing manner so as to alternately emit light rays towards the first eye and the second eye, and the waveguide transmits reflected light of the first eye and the second eye to the image acquisition module so that the image acquisition module can acquire image information of the first eye and the second eye. And the control module determines the fixation point information according to the image information. Therefore, the eye movement tracking system is favorable for reducing the production complexity and cost, improving the yield, and improving the aesthetic property and the user experience.

Disclosed are gaming systems, methods and machines that include one or more eye gaze tracking systems. In particular, the eye gaze tracking system may be incorporated with a gaming system, or located with a gaming environment and otherwise connected to a gaming system. When the focus of the user's gaze is identified, the gaming system can activate a response in the feature associated with the user's gaze. This can include a virtual feature on a display screen or a feature, such as lighting or signage, on the gaming system or within the gaming environment.

The present invention relates to an eye tracking system (100). The system comprises at least one projection means (3) adapted to project a light beam (4) on a predetermined area of a cornea (2) of an eye (1). The system further comprises at least one optical sensor (6) capable of detecting reflected light (5) from the eye (1) and determining the location of detection thereon. The reflected light (5) from the eye (1) comprises at least one, preferably two, specular reflection, preferably at least a first Purkinje reflection (P1), more preferably at least a first Purkinje reflection (P1) and a fourth Purkinje reflection (P4). The system (100) is adapted to calculate the lateral and / or angular translation of the eye (1), or the change thereof, based on the location of detection and / or the displacement thereof.

A three-dimensional (3D) compressive sensing based eye tracking system using single photon avalanche diode (SPAD) sensors achieves high resolution depth measurement by using low resolution SPAD sensors and active encoded illumination such as two- or three-dimensional fringe patterns, random speckles, random patterns, and / or superimposed patterns projected onto a surface of an eye. The patterns may be projected by high speed illuminators such as a digital micromirror device (DMD) or micro-electromechanical system (MEMS) projector in series changing at the same rate as the SPAD sensor capture rate. A processor may employ compressive sensing techniques to obtain a high resolution image and depth information from the captured images of varying patterns.

The invention discloses an eye movement tracking stability enhancing method, system and device and a storage medium, and belongs to the field of human-computer interaction and computer vision. The method comprises the following steps: acquiring an eye image and an original sight fixation point coordinate; performing quantitative evaluation on the image from five dimensions of definition, contrast and the like to generate an eye image quality evaluation grade; calculating the moving speed and acceleration of the current point based on the historical sight fixation point sequence; fusing, and judging and correcting the original coordinates. Through multi-modal information fusion and hierarchical adaptive correction, noise jump caused by poor image quality can be accurately distinguished and filtered out, meanwhile, the real eye movement dynamic state is effectively reserved, and the output stability and reliability of an eye movement tracking system are remarkably improved.

A lens assembly for a head-mounted display (HMD) comprises a reflective polarizer and an eye-tracking waveguide. The reflective polarizer is in an optical element. The eye-tracking waveguide is also included in the optical element. The eye-tracking waveguide is configured to direct near-infrared received illumination light to an eye-tracking camera.

A system enables a user to query based on a user's gaze by receiving a query from the user and capturing, via an eye tracking system on a headset, the user's gaze location near an object in a local area. The system captures one or more images of the local area with the object and formats the images based in part on a region of interest in the one or more images that includes the object. The system generates a formatted query based in part on the query. The formatted query is provided to a search engine. Information describing the object determined from the one or more formatted images and information describing the query are used by the search engine to determine an answer to the query about the object. The system presents the answer to the query about the object.

An eye tracking system for a head-mounted device includes an imaging assembly and an illumination assembly. The imaging assembly is configured to optically focus light from an object plane of an eye onto an image plane of an image sensor, and the illumination assembly is configured to optically project light from an illumination source onto the object plane of the eye. The imaging assembly is configured with an imaging angle coding mapping for optical relay coupling imaging. The illumination assembly is configured with an illumination angle coding mapping for optically coupling a projection.

The invention relates to the technical field of man-machine interaction, and discloses an eye movement tracking method, intelligent glasses, a mobile terminal and an eye movement tracking system.The method comprises the steps that current head movement data of a wearer is collected and sent to the mobile terminal; receiving the current gazing direction of the wearing user fed back by the mobile terminal, and tracking the eye movement of the wearing user according to the current gazing direction; wherein the current gazing direction is obtained through the mobile terminal according to the current head movement data and a current eyeball image of the wearing user, and the current eyeball image is obtained by shooting eyeballs of the wearing user through a camera. Since the mobile terminal with the camera arranged outside is utilized to complete eyeball collection and fixation direction determination of the wearing user, an independent camera and an independent computing power unit do not need to be arranged in the intelligent glasses, and the size of the intelligent glasses is reduced.

The present disclosure relates to an optical system comprising: a lightguide (110) having opposing first (112) and second (114) non-parallel optical surfaces, wherein at least one of the first or second optical surfaces is curved; an in-coupling diffractive optical element (120) arranged to receive reflected light from an object and couple the reflected light into the lightguide at a first location, wherein the reflected light propagates along the lightguide and exits the light guide at a second location; and a light detector (140) arranged proximal to the second location to receive the reflected light from the light guide. A head mounted eye tracking system or a world facing camera system may comprise the optical system.

The invention provides an eye movement tracking system for aphasia rehabilitation training, a vocabulary difficulty adaptive adjustment method, equipment and a medium. The method comprises the following steps: determining semantic diffusion characteristics of a current vocabulary for representing a target user; determining a semantic recognition gradient of a target user on the initial rehabilitation training voice; performing response feedback analysis on speech recognition of the target user in the initial rehabilitation training process based on the semantic diffusion features and the semantic recognition gradient to obtain a semantic response deviation of the target user in the current stage; determining a gaze association relationship of the target user under different semantic structure features; and adaptively adjusting the vocabulary difficulty of the rehabilitation training voice in the next stage according to the cognitive performance index of the target user in the current stage determined by the semantic response deviation and all the gaze association relationships. By adopting the scheme of the invention, the eye movement fixation characteristics of the patient can be deeply associated with the word order structure of the training voice content, and then the training voice in the rehabilitation training process can be adaptively adjusted.

A three-dimensional (3D) compressive sensing based eye movement tracking system using a single photon avalanche diode (SPAD) sensor achieves high resolution depth measurements by using a low resolution SPAD sensor and actively coded illumination (e.g., two or three dimensional fringe patterns, random spots, random patterns, and / or overlay patterns) projected onto the surface of the eye. These patterns may be projected by a high speed illuminator, such as a digital micromirror device (DMD) or a micro-electro-mechanical system (MEMS) projector, varying continuously at the same rate as the SPAD sensor acquisition rate. The processor may employ compressed sensing techniques to obtain high resolution images and depth information from the acquired images of the varying patterns.

An eye tracking system (1) comprising a radiation source (2) configured to provide a radiation, a waveguide (3), and a volume phase hologram (4) is specified, wherein the waveguide (3) provides a propagation medium between the radiation source (2) and the volume phase hologram (3), and wherein the radiation reflected off or scattered at a part of a user's eye (9) and coupled back into the radiation source (2) causes a self-mixing interferometry signal.

An eye tracking system for detecting position and movements of a user's eyes in a head-mounted display (HMD). The eye tracking system includes at least one eye tracking camera, an illumination source that emits infrared light towards the user's eyes, and diffraction gratings located at the eyepieces. The diffraction gratings redirect or reflect at least a portion of infrared light reflected off the user's eyes, while allowing visible light to pass. The cameras capture images of the user's eyes from the infrared light that is redirected or reflected by the diffraction gratings.

The invention is related a method and a remote eye tracking system for determining a position of at least one eye of a subject. The method comprises the steps of: illuminating a face of a subject using at least one infrared (IR) illuminator off-axis from at least one image sensor; capturing at least one image of the face using the at least one image sensor at a time instant; and using a processing circuitry of the remote eye tracking system, performing processing steps of: determining at least one pupil candidate associated with the at least one image; determining at least one glint candidate associated with the at least one image; determining at least one pupil-glint candidate group, comprising at least one pupil candidate and at least one corresponding glint candidate; generating a score value for each of the at least one pupil-glint candidate groups; and determining an eye position of at least one eye of the subject in the at least one image based on the pupil-glint candidate group with the highest score value.

The present invention relates to an eye tracking system (100). The system comprises at least one projection means (3) adapted to project a light beam (4) on a predetermined area of a cornea (2) of an eye (1). The system further comprises at least one optical sensor (6) capable of detecting reflected light (5) from the eye (1) and determining the location of detection thereon. The reflected light (5) from the eye (1) comprises at least one, preferably two, specular reflection, preferably at least a first Purkinje reflection (P1), more preferably at least a first Purkinje reflection (P1) and a fourth Purkinje reflection (P4). The system (100) is adapted to calculate the lateral and / or angular translation of the eye (1), or the change thereof, based on the location of detection and / or the displacement thereof.