297 results about "Eye tracking" patented technology

The invention discloses an ideological and political large-scale course teaching attention assessment data acquisition method based on sight tracking. The method comprises the following steps: S1, high-definition large-scene eye movement tracking photographing equipment captures eye images of students in a course teaching process in real time through an infrared camera; s2, performing pupil area detection and pupil center fitting on the eye image to obtain sight tracking data; s3, performing gaze hotspot analysis and gaze duration statistics according to the sight tracking data to quantify attention distribution and change trend of the students and visually display the attention distribution and change trend; and S4, generating a teaching quality evaluation report and teaching optimization suggestions according to the gazing hotspot analysis and gazing duration statistical results. The classroom teaching effect can be objectively evaluated in real time, subjective evaluation errors are reduced, the accuracy and efficiency of teaching feedback are improved, the method is suitable for various scenes such as traditional classrooms, online education and experiment teaching, and the method has the industrial application prospect of education digital transformation.

The invention provides a teaching interaction-oriented digital human three-dimensional reconstruction system, and relates to the technical field of human-computer interaction, and the system comprises a data collection module which is used for collecting a voice signal, gesture action data, eye tracking data and facial expression data of a user in real time through a multi-modal sensor array, and obtaining a teaching type identifier, an interaction stage state parameter and a participant role identifier of the current teaching scene through a preset teaching scene database. According to the invention, accurate adaptation of teaching scenes and intelligent generation and dynamic optimization of interaction strategies are realized, the accuracy and suitability of teaching interaction are improved, and personalized and high-quality teaching interaction experience is brought to users.

The invention relates to the technical field of visual health management, in particular to a ciliary muscle adjustment training system and method based on eye movement tracking, and the method comprises the steps: collecting eye movement data of a fixation point track, an adjustment amplitude change rate and pupil response time in real time, and combining personalized parameters such as the age of a user, diopter and a training target; inputting a ciliary muscle training dynamic planning algorithm module, dynamically generating a stage scheme containing a training action type, a single-group duration, a stimulation interval and a focal length adjustment strategy, and adaptively adjusting the strategy according to real-time adjustment stability and a historical ability curve; through multi-dimensional matching analysis of a pre-stored standard eye movement template, a training specification score is calculated from the track goodness of fit, speed uniformity, amplitude standard-reaching rate and binocular coordination, visual fatigue parameters are obtained based on continuous training duration, pupil fluctuation and retina reflex change, a scoring result is dynamically corrected, and a visual fatigue evaluation result is obtained. Personalized, self-adaptive and quantitative safety control of the training process is realized.

Calibration for eye tracking calibration in a head-mounted display can refined during use by tracking head rotation of a user during a time period while the head-mounted display is worn by the user, tracking eye rotation of the user during the time period, comparing the eye rotation of the user to the head rotation of the user during the time period, and refining a calibration state of eye tracking for the head-mounted display based on comparing the eye rotation of the user to the head rotation of the user during the time period.

An eye tracking device including an event-based optical sensor, configured to receive radiation reflected off an eye of a user and produce a signal stream of events, each event corresponding to detection of a temporal change in the received radiation at one or more pixels of said optical sensor, and a controller, which is connected to said optical sensor and configured to: a) receive the signal stream of events from the optical sensor, b) generate an inference frame based on the stream of events, c) utilize the inference frame as input to a machine learning module and operate the machine learning module to obtain output data, and e) extract from the output data information related to the eye of the user, wherein the controller is configured to generate the inference frame utilizing a first artificial neural network.

A multi-screen cockpit display system is suitable for being installed in a cockpit, and includes a first display device, a control unit and a second display device. The first display device is disposed in front of a driver's seat in the cockpit, and is suitable for displaying a first dynamic information. The control unit is electrically connected to the first display device. The control unit is suitable for providing the first dynamic information to the first display device according to an operating state of the cockpit. Another multi-screen cockpit display system with an eye tracking module is also provided.

Techniques related to the computation of gaze vectors of users of wearable devices are disclosed. A neural network may be trained through first and second training steps. The neural network may include a set of feature encoding layers and a plurality of sets of task-specific layers that each operate on an output of the set of feature encoding layers. During the first training step, a first image of a first eye may be provided to the neural network, eye segmentation data may be generated using the neural network, and the set of feature encoding layers may be trained. During the second training step, a second image of a second eye may be provided to the neural network, network output data may be generated using the neural network, and the plurality of sets of task-specific layers may be trained.

Methods, systems, and storage media for performing multi-user gaze tracking in a vehicle space using multi-surface optical reflections are disclosed. Implementations may: acquire face and eye region image data of a plurality of occupants within a field of view of at least one camera associated with a vehicle; evaluate reflected image quality thresholds; locate and match occupants within the vehicle space; and perform eye tracking for multiple occupants independently via reflected multi-view images provided to a deep learning model.

A user's accommodative spasm can be evaluated and mitigated via a virtual reality (VR) system, which can include a VR headset in electronic communication with a computing device. The computing device causes virtual environments, which can include objects, optotypes, various lighting conditions, and various weather conditions, to be displayed on the VR headset. Using varying combinations of eye-tracking sensors, eye-tracking cameras, motion-tracking sensors, handheld devices, and microphones, the VR headset collects data about the user as she focuses on various objects placed at different distances away from her in the virtual environments. Optionally, advanced algorithms in the computing device dynamically alter the virtual environments and the visual tasks and analyze the user's responses to evaluate the user's accommodative spasm.

According to the AI glasses-based driver sight tracking and augmented reality early warning system and method provided by the invention, the attention focus of a driver is monitored in real time through deep fusion of a high-precision eyeball tracking technology and an AR display technology, and correlation analysis is carried out on the attention focus and environmental perception data of an intelligent driving system, so that the driver sight tracking and augmented reality early warning effect is improved. When a driver is found to be invisible to a key dangerous target, the attention of the driver can be actively and accurately guided, and key safety information is ensured to be effectively received and confirmed, so that the man-machine cooperation efficiency and the driving safety are remarkably improved. The problems that an existing early warning system is not visual in information transmission and cannot confirm whether a driver really receives information or not are solved, the driving safety and the man-machine interaction efficiency are remarkably improved through a closed-loop vehicle perception-driver cognition-danger confirmation mechanism, and more accurate, more visual and more efficient driving safety early warning is achieved.

A system includes a first camera located within a cockpit of an aircraft to track the eye movement of at least one pilot, and a second camera to track an ambient light source. The system includes an electrochromic panel having an array of dimmable cells. The system further includes a controller, equipped with one or more processors responsible for modifying the array of dimmable cells. The controller receives eye tracking data from the first camera associated with a gaze target of the pilot, and light tracking data from the second camera, which includes parameters associated with the ambient light source. Based on the eye tracking and light tracking data, the controller determines a glare location on a surface of the electrochromic panel where the gaze target intersects. The controller may then selectively modify a tint level of specific dimmable cells in the panel to address the determined glare location.

An information handling system peripheral display has plural display assemblies coupled to stand supports of a display stand to present visual images a display panel included in each display assembly. Sensors, such as an eye tracker sensor or a mouse cursor presentation location, are applied to analyze end user interaction at each display panel and selectively dim and / or turn off brightness at each display panel. A contact pad at the rear of each display assembly interfaces with a contact pins of each display support to determine the location of the display assembly at the display stand and the rotational orientation of the display assembly.

A machine learning model is constructed by machine learning based on image data that is obtained by imaging each portion provided in a substrate processing device and sound data of sounds emitted when the portions operate. As the sound data, both the data of a normal sound that is emitted when each portion operates normally and the data of an abnormal sound that is emitted when each portion is abnormally operated are collected. When abnormality detection is performed, an eye tracking function identifies a position that is being viewed by a worker wearing smart glasses in which a machine learning model is installed. An image of a region including the identified viewed position is captured, and a sound is collected in a state in which the worker is viewing the viewed position. The collected image data and sound data are input into the machine learning model.

Techniques for gaze-based video conference prompts are described that leverage eye-tracking algorithms within a video conference setting to perform a variety of functionality. For instance, a computing device displays a user interface of a video conference session that includes representations of video conference attendees. The computing device receives video content that depicts a user of the computing device and uses eye tracking techniques to determine a gaze location of the user based on the video content. The gaze location corresponds to one of the representations of an attendee. The computing device then communicates a prompt to one or more of the attendees that indicates the gaze location. In another example, the computing device detects a behavior of the user, e.g., a scanning behavior. Responsive to detection of the behavior, the computing device performs an action within the user interface, such as to display a roster view of the attendees.

An optical sensing system comprises a human interface structure to be applied to a user. The system comprises a time-of-flight sensor with an array of laser diodes with Bragg reflectors operating in the near-infrared, a detection system, and a processor generating a time-of-flight measurement and a first image. The system also includes a first camera system capturing a second image, and a second camera system illuminated by light emitting diodes to monitor one or more eyes of the user. In communication with or operating on the processor is an artificial intelligence assistant, which comprises a multi-modal generative artificial intelligence model. The system may be part of wearable eyewear such as smart glasses or extended reality goggles. The system may perform gesture analysis, eye tracking and speed recognition, and video and verbal outputs can be provided to the user. An artificial intelligence agent may have awareness of the environment.

The invention discloses an optical module, an eye camera and an eyeball tracking method, and the optical module comprises a light modulation element which is used for receiving incident light from a target object and generating a first polarized light signal and a second polarized light signal, the first polarized light signal is orthogonal to the polarization state of the incident light, and the second polarized light signal is orthogonal to the polarization state of the target object; the inner product of the second polarized light signal and the Jones vector of the incident light is larger than 0 or smaller than 0, the light sensor is used for receiving the first polarized light signal and the second polarized light signal to generate data information, and the processor is coupled with the light sensor and used for determining image information of a target object according to the data information. According to the optical module provided by the invention, dual optimization of reflection suppression and detail enhancement in a target recognition scene can be realized, the target object distinction degree is improved, the detail richness of imaging is considered, and the applicability of polarization imaging in a scene with a low signal-to-noise ratio and a high dynamic range is expanded.

Vision safety protocols in workplaces (e.g., a construction site, factory, or hospital) can be evaluated via a virtual reality (VR) system, which can include a VR headset in electronic communication with a computing device. The computing device causes virtual environments with virtual hazards to be displayed on the VR headset. The computing device can prompt the user to complete a task in the virtual environment while adhering to a set of vision safety protocols. Using varying combinations of eye-tracking sensors, eye-tracking cameras, motion-tracking sensors, handheld devices, and microphones, the VR headset collects data about the user as she completes the task. Optionally, algorithms in the computing device can assess the efficacy of the vision safety protocols based on the user's performance of the task and recommend changes to the vision safety protocols that increase workplace safety and efficiency. Optionally, the computing device can cause the virtual hazards to be changed.

A user's visual disorders can be treated via a virtual reality (VR) system, which can include a VR headset in electronic communication with a computing device. The computing device causes vision tests to be displayed on the VR headset. Using varying combinations of eye-tracking sensors, eye-tracking cameras, motion-tracking sensors, handheld devices, and microphones, the VR headset can collect data about the user as she completes the vision tests. Using the data collected by the VR headset, the computing device can evaluate the user for various visual disorders and develop a personalized vision therapy plan for the user. Optionally, advanced algorithms in the computing device dynamically alter the vision therapy plan based on the user's performance and the progression of her visual disorders.

The group of inventions relates to optical elements with integrated electronic components and specifically to contact lenses with a built-in ultrathin digital camera, which are applicable for capturing video images, object recognition, implementing the user eye-tracking function, including, without limitation, while forming virtual, augmented, mixed or extended reality (VR / AR / MR / XR), as well as for diagnosing and compensating ophthalmic diseases, and for other applications. The contact lens housing (1) made of an optically transparent material contains a built-in electronic component containing a power source (2) and a camera (3) with at least one receiver (4) in the form of a matrix (8) of photosensitive elements. The camera (3) is equipped with an optical system implemented as at least one coding mask (5) separated from the receiver (4) by an intermediate layer (9) of homogeneous optically transparent material and disposed on the surface of or inside the lens housing (1). The invention makes it possible to significantly reduce the thickness of the contact lens containing an integrated camera and to produce an operational device that is comfortable for daily wearing.

System, process, and device configurations are provided for eye tracking and interactive game control. A method can include detecting eye tracking data for at least one user during the presentation of the gaming content and determining a player engagement parameter for the gaming content based on the eye tracking data. Presentation of the gaming content may be updated using the player engagement parameter. Embodiments can include use of the player engagement parameter for one or more of identifying game play objects of interest, player engagement level, user effect of the gaming content, player type, player profiles and audio immersion preferences. The player engagement parameter can be used to update gaming content, audio output and control sound output for gaming content.

A head-mountable electronic device includes an optical module frame, a display coupled to the optical module frame and extending in a display plane, and an eye-tracking assembly. The eye-tracking assembly includes a flat electrical cable, for example a flexible printed circuit (FPC), coupled to the optical module frame and disposed about a perimeter of the display, and a light emitting diode (LED) electrically coupled to the flat electrical cable and configured to direct light away from the display. The flat electrical cable defines a major plane oriented generally orthogonal to the display.

A system adapted to interact with a user by monitoring activity of a user's eye gaze, the system comprising: a user web camera configured to determine a location at which the user's eyes gaze on a user display configured to display digital content to the user; an operator display configured to view the live interaction of the eye gaze of the user from a movement of the eye gaze controlled cursor projected in the operator display; a processor having a gaze estimation module for receiving eye movement and head movement signals from the user web camera as calibration data for estimating eye gaze, the processor configured to: generate an interactive stimulus to the user display; stimulating an interaction with the interaction via a user's gaze-based interaction or blink-based interaction; and analyzing and determining a user focus based on eye tracking of the interaction from the interaction stimulus.

A display may use a waveguide to provide image light to an eye box. An emitter may emit infrared light collimated at different angles relative to a collimated axis and divergent along an orthogonal axis. The waveguide may propagate the infrared light and may include overlapping one-dimensional diffractive gratings with parallel periodic structures. Each grating may diffract, towards the eye box, a respective portion of the infrared light from a respective incident angle onto a respective output angle relative to the collimated axis. A camera may capture glints of the infrared light as reflected off a user's eye at the eye box for performing gaze tracking. The emitter and the gratings may effectively form a one-dimensional line of infrared emitters overlapping the eye box while allowing the optical emitter to remain invisible to a user.

An optics assembly includes an eyepiece operable to receive virtual image light and project the virtual image light toward an eye side of the optics assembly. The optics assembly includes a rear lens disposed between the eyepiece and the eye side of the optics assembly. The optics assembly includes one or more wedge prisms integrated with the rear lens along a periphery of the rear lens. The optics assembly includes an eye tracking camera disposed outside the periphery of the rear lens in alignment with the one or more wedge prisms and operable to capture light that propagates from the eye side of the optics assembly and is refracted through the one or more wedge prisms.

A head-mounted display and a method for eye tracking calibration are provided. The head-mounted display includes a display, an image capture device, and a processor. The image capture device captures an eye image during a display of calibration points. The processor is coupled to the display and the image capture device, wherein the processor is configured to: display the calibration points on positions of a position set sequentially in an order according to a current time and number of positions via the display; and generate calibration data according to the eye image.

Eye tracking device and eye tracking assembly. The invention relates to an eye tracking device (1) adapted to track the eye movement (5) of a user, comprising: - a support structure (7) adapted to be mounted on the head (3) of a user, - a video data acquisition means, comprising a camera (17) adapted to acquire video of said eyes, - an infrared wave emission means, adapted to emit infrared waves in the direction of said user's eyes, - a data transfer means adapted to transfer said acquired data to a data processing device comprising a pupil detection algorithm. According to the invention, the device (1) includes an optical accessory attachment interface (35) adapted to receive at least one external optical accessory.The invention also relates to an assembly for the acquisition of ocular data comprising such a device (1). Figure 3.

In one implementation, a method is performed for generating metadata estimations based on metadata subdivisions. The method includes: obtaining an input image; obtaining metadata associated with the input image; subdividing the metadata into a plurality of metadata subdivisions; determining a viewport relative to the input image based on at least one of head pose information and eye tracking information; generating one or more metadata estimations by performing an estimation algorithm on at least a portion of the plurality of metadata subdivisions based on the viewport; and generating an output image by performing an image processing algorithm on the input image based on the one or more metadata estimations.

A head mounted display (HMD) apparatus may include: a display; an optical lens adjacent to a first side of the display; at least one light source configured to emit light; and at least one eye-tracking sensor adjacent to a second side of the display and configured to obtain gaze information about a user by receiving reflected light that is the light emitted from the at least one light source and reflected off eyes of the user. The display may include a second display region corresponding to a position of the at least one eye-tracking sensor, and a first display region other than the second display region. A number of pixels per unit area of the first display region may be greater than a number of pixels per unit area of the second display region.

The present invention relates to a power-efficient eye-tracking method capable of providing a full range of users' eye features using an edge computing device, embeddable in a general head-mounted device, such as AR / VR / XR or smartglasses. The invention is further focused on an eye-tracking unit and / or a head-mounted device embedding the eye-tracking unit using the invented method.

The invention discloses a retrieval result display method and system, and relates to the technical field of data processing.The method comprises the steps that a retrieval result tree containing hierarchical nodes is constructed and displayed on a superficial layer of a terminal interface, and an expandable mark is set; collecting user browsing behaviors through sight tracking, and calculating attention popularity; recognizing a retrieval intention in combination with the popularity, the result tree and the user portrait; and generating a deep display instruction according to the retrieval intention, controlling an interface to display a deeper result, and realizing personalized information presentation. Therefore, the technical effects of accurate intention recognition, active information pushing and personalized and efficient retrieval result display are achieved.