389 results about "Eye tracking" patented technology

A display device may receive eye tracking data. A display device may detect an eye gaze intent state based on the eye tracking data. A display device may receive an input device signal of an input device. A display device may determine to switch from a first input modality to a second input modality based on at least one of the eye gaze intent state or the input device signal. A display device may move a position indicator on a display of the display device using at least one of the first input modality or the second input modality.

The invention discloses an ideological and political large-scale course teaching attention assessment data acquisition method based on sight tracking. The method comprises the following steps: S1, high-definition large-scene eye movement tracking photographing equipment captures eye images of students in a course teaching process in real time through an infrared camera; s2, performing pupil area detection and pupil center fitting on the eye image to obtain sight tracking data; s3, performing gaze hotspot analysis and gaze duration statistics according to the sight tracking data to quantify attention distribution and change trend of the students and visually display the attention distribution and change trend; and S4, generating a teaching quality evaluation report and teaching optimization suggestions according to the gazing hotspot analysis and gazing duration statistical results. The classroom teaching effect can be objectively evaluated in real time, subjective evaluation errors are reduced, the accuracy and efficiency of teaching feedback are improved, the method is suitable for various scenes such as traditional classrooms, online education and experiment teaching, and the method has the industrial application prospect of education digital transformation.

An XR system is disclosed having a night mode to optimize performance in low light conditions. The system estimates a user's dark adaptation level based on captured image data and selects a rendering configuration aligned with the user's vision. For example, spatial resolution, temporal resolution, color mode, and brightness are adjusted based on whether the adaptation level is scotopic, mesopic, or photopic. With eye tracking, foveated rendering is used for cones and periphery rendering for rods. Without eye tracking, modes with different wavelengths and colorization are employed. The night mode aims to maximize information visible on the display, conserve power by only showing what eyes can perceive, and preserve night vision by avoiding over-stimulating rods.

The invention provides a teaching interaction-oriented digital human three-dimensional reconstruction system, and relates to the technical field of human-computer interaction, and the system comprises a data collection module which is used for collecting a voice signal, gesture action data, eye tracking data and facial expression data of a user in real time through a multi-modal sensor array, and obtaining a teaching type identifier, an interaction stage state parameter and a participant role identifier of the current teaching scene through a preset teaching scene database. According to the invention, accurate adaptation of teaching scenes and intelligent generation and dynamic optimization of interaction strategies are realized, the accuracy and suitability of teaching interaction are improved, and personalized and high-quality teaching interaction experience is brought to users.

The invention relates to the technical field of brightness control, in particular to a welding machine screen display brightness control method and system. The method comprises the following steps: acquiring a welding machine screen image, environment perception data and a user face image; performing illumination intensity calculation on the environment perception data to generate environment illumination intensity data; performing glare analysis on the environment perception data through the environment illumination intensity data to generate environment glare influence data; performing environment perception brightness adjustment on the welding machine screen image based on the environment glare influence data to generate environment perception brightness adjustment data; performing visual perception feature analysis on the user face image based on the environmental perception brightness adjustment data to generate user visual perception feature data; and performing eyeball tracking on the user face image by using a computer vision technology to generate user eyeball tracking data. According to the invention, efficient and accurate brightness control is realized.

The invention relates to the technical field of visual health management, in particular to a ciliary muscle adjustment training system and method based on eye movement tracking, and the method comprises the steps: collecting eye movement data of a fixation point track, an adjustment amplitude change rate and pupil response time in real time, and combining personalized parameters such as the age of a user, diopter and a training target; inputting a ciliary muscle training dynamic planning algorithm module, dynamically generating a stage scheme containing a training action type, a single-group duration, a stimulation interval and a focal length adjustment strategy, and adaptively adjusting the strategy according to real-time adjustment stability and a historical ability curve; through multi-dimensional matching analysis of a pre-stored standard eye movement template, a training specification score is calculated from the track goodness of fit, speed uniformity, amplitude standard-reaching rate and binocular coordination, visual fatigue parameters are obtained based on continuous training duration, pupil fluctuation and retina reflex change, a scoring result is dynamically corrected, and a visual fatigue evaluation result is obtained. Personalized, self-adaptive and quantitative safety control of the training process is realized.

Calibration for eye tracking calibration in a head-mounted display can refined during use by tracking head rotation of a user during a time period while the head-mounted display is worn by the user, tracking eye rotation of the user during the time period, comparing the eye rotation of the user to the head rotation of the user during the time period, and refining a calibration state of eye tracking for the head-mounted display based on comparing the eye rotation of the user to the head rotation of the user during the time period.

An eye tracking device including an event-based optical sensor, configured to receive radiation reflected off an eye of a user and produce a signal stream of events, each event corresponding to detection of a temporal change in the received radiation at one or more pixels of said optical sensor, and a controller, which is connected to said optical sensor and configured to: a) receive the signal stream of events from the optical sensor, b) generate an inference frame based on the stream of events, c) utilize the inference frame as input to a machine learning module and operate the machine learning module to obtain output data, and e) extract from the output data information related to the eye of the user, wherein the controller is configured to generate the inference frame utilizing a first artificial neural network.

The invention discloses an intelligent exhibition service system for an art display space, and belongs to the technical field of art display services, and the system comprises an audience information collection module which obtains the personal information of audiences and the data of art interests at the entrance of the art display space through a terminal registration or code scanning mode; according to the system, multiple modules of audience information collection, interaction intention recognition, emotional interest analysis, personalized service planning and display service control are integrated, so that comprehensive intelligent upgrading of audience experience in an art display space is realized; according to the method, the behavior habits and emotional states of audiences are analyzed in an all-around and multi-dimensional mode, and the highly personalized service planning greatly improves the visiting experience of the audiences, so that the audiences can freely select visiting routes and interaction modes according to own interests and preferences, and the interactivity and interestingness of exhibition are remarkably enhanced.

A multi-screen cockpit display system is suitable for being installed in a cockpit, and includes a first display device, a control unit and a second display device. The first display device is disposed in front of a driver's seat in the cockpit, and is suitable for displaying a first dynamic information. The control unit is electrically connected to the first display device. The control unit is suitable for providing the first dynamic information to the first display device according to an operating state of the cockpit. Another multi-screen cockpit display system with an eye tracking module is also provided.

The disclosed method that may be used for eye tracking includes measuring, by a controller, a distance to an object (316) based on a combination of polarization information of detected light and time-of-flight information of the detected light, wherein the detected light results from at least one of scattering or reflection of a light beam from the object (316). The disclosed method additionally includes performing, by an artificial reality system that includes the controller, one or more user interaction procedures based on information that includes the measured distance to the object (316). A system includes a laser scanning polarization imager including and a detector system (302) including a plurality of photodetectors 304. Each photodetector (306) includes a polarizer (308) having a particular polarization direction oriented at zero, 45, 90 and 135 degrees. A light source (310) may include a vertical cavity surface emitting laser (VCSEL) to emit a light beam (312). A reflector (314), such as a MEMS scanner, directs the light beam (312) onto the object (316), such as an eye. Light (318), e.g., specular and / or diffusive, is reflected and / or scattered from the object (316) and detected by the detector system (302). A controller measures a distance to the object (316) based on this detected light (318). Additionally, the controller measures position and / or size of one or more regions (320) of the object, such as a pupil and / or cornea.

Techniques related to the computation of gaze vectors of users of wearable devices are disclosed. A neural network may be trained through first and second training steps. The neural network may include a set of feature encoding layers and a plurality of sets of task-specific layers that each operate on an output of the set of feature encoding layers. During the first training step, a first image of a first eye may be provided to the neural network, eye segmentation data may be generated using the neural network, and the set of feature encoding layers may be trained. During the second training step, a second image of a second eye may be provided to the neural network, network output data may be generated using the neural network, and the plurality of sets of task-specific layers may be trained.

Methods, systems, and storage media for performing multi-user gaze tracking in a vehicle space using multi-surface optical reflections are disclosed. Implementations may: acquire face and eye region image data of a plurality of occupants within a field of view of at least one camera associated with a vehicle; evaluate reflected image quality thresholds; locate and match occupants within the vehicle space; and perform eye tracking for multiple occupants independently via reflected multi-view images provided to a deep learning model.

A buoyancy control system, GPS sensor and data analysis engine, a wind direction sensor, and a controller to detect significant wind direction changes. Upon calculation that the desired location within the eye wall has been reached the buoy descends to depths where ocean currents are reduced, preventing drift from the hurricane eye. A solar sensor triggers ascent when sunlight indicates reentry into the eye.

A user's accommodative spasm can be evaluated and mitigated via a virtual reality (VR) system, which can include a VR headset in electronic communication with a computing device. The computing device causes virtual environments, which can include objects, optotypes, various lighting conditions, and various weather conditions, to be displayed on the VR headset. Using varying combinations of eye-tracking sensors, eye-tracking cameras, motion-tracking sensors, handheld devices, and microphones, the VR headset collects data about the user as she focuses on various objects placed at different distances away from her in the virtual environments. Optionally, advanced algorithms in the computing device dynamically alter the virtual environments and the visual tasks and analyze the user's responses to evaluate the user's accommodative spasm.

According to the AI glasses-based driver sight tracking and augmented reality early warning system and method provided by the invention, the attention focus of a driver is monitored in real time through deep fusion of a high-precision eyeball tracking technology and an AR display technology, and correlation analysis is carried out on the attention focus and environmental perception data of an intelligent driving system, so that the driver sight tracking and augmented reality early warning effect is improved. When a driver is found to be invisible to a key dangerous target, the attention of the driver can be actively and accurately guided, and key safety information is ensured to be effectively received and confirmed, so that the man-machine cooperation efficiency and the driving safety are remarkably improved. The problems that an existing early warning system is not visual in information transmission and cannot confirm whether a driver really receives information or not are solved, the driving safety and the man-machine interaction efficiency are remarkably improved through a closed-loop vehicle perception-driver cognition-danger confirmation mechanism, and more accurate, more visual and more efficient driving safety early warning is achieved.

A system includes a first camera located within a cockpit of an aircraft to track the eye movement of at least one pilot, and a second camera to track an ambient light source. The system includes an electrochromic panel having an array of dimmable cells. The system further includes a controller, equipped with one or more processors responsible for modifying the array of dimmable cells. The controller receives eye tracking data from the first camera associated with a gaze target of the pilot, and light tracking data from the second camera, which includes parameters associated with the ambient light source. Based on the eye tracking and light tracking data, the controller determines a glare location on a surface of the electrochromic panel where the gaze target intersects. The controller may then selectively modify a tint level of specific dimmable cells in the panel to address the determined glare location.

An information handling system peripheral display has plural display assemblies coupled to stand supports of a display stand to present visual images a display panel included in each display assembly. Sensors, such as an eye tracker sensor or a mouse cursor presentation location, are applied to analyze end user interaction at each display panel and selectively dim and / or turn off brightness at each display panel. A contact pad at the rear of each display assembly interfaces with a contact pins of each display support to determine the location of the display assembly at the display stand and the rotational orientation of the display assembly.

A machine learning model is constructed by machine learning based on image data that is obtained by imaging each portion provided in a substrate processing device and sound data of sounds emitted when the portions operate. As the sound data, both the data of a normal sound that is emitted when each portion operates normally and the data of an abnormal sound that is emitted when each portion is abnormally operated are collected. When abnormality detection is performed, an eye tracking function identifies a position that is being viewed by a worker wearing smart glasses in which a machine learning model is installed. An image of a region including the identified viewed position is captured, and a sound is collected in a state in which the worker is viewing the viewed position. The collected image data and sound data are input into the machine learning model.

The present application provides a deep learning-based eye tracking glint detection method and apparatus. The method comprises: processing data sets of single-channel sample eye images having glints, and storing the processed data sets in a txt file; generating first multi-channel label images of the single-channel sample eye images; performing semantic segmentation on the data sets corresponding to the single-channel sample eye images by means of a primary neural network model and outputting second multi-channel label images; determining a loss function on the basis of the first multi-channel label images and the second multi-channel label images; iteratively optimizing the primary neural network model by means of the loss function to obtain a final neural network model; and processing, by means of the final neural network model, the single-channel eye images to be detected, and performing reasoning to obtain glint centers of the single-channel eye images to be detected and a glint sequence. The present application can implement accurate eye glint detection to confirm glint serial numbers.

Techniques for gaze-based video conference prompts are described that leverage eye-tracking algorithms within a video conference setting to perform a variety of functionality. For instance, a computing device displays a user interface of a video conference session that includes representations of video conference attendees. The computing device receives video content that depicts a user of the computing device and uses eye tracking techniques to determine a gaze location of the user based on the video content. The gaze location corresponds to one of the representations of an attendee. The computing device then communicates a prompt to one or more of the attendees that indicates the gaze location. In another example, the computing device detects a behavior of the user, e.g., a scanning behavior. Responsive to detection of the behavior, the computing device performs an action within the user interface, such as to display a roster view of the attendees.

An optical sensing system comprises a human interface structure to be applied to a user. The system comprises a time-of-flight sensor with an array of laser diodes with Bragg reflectors operating in the near-infrared, a detection system, and a processor generating a time-of-flight measurement and a first image. The system also includes a first camera system capturing a second image, and a second camera system illuminated by light emitting diodes to monitor one or more eyes of the user. In communication with or operating on the processor is an artificial intelligence assistant, which comprises a multi-modal generative artificial intelligence model. The system may be part of wearable eyewear such as smart glasses or extended reality goggles. The system may perform gesture analysis, eye tracking and speed recognition, and video and verbal outputs can be provided to the user. An artificial intelligence agent may have awareness of the environment.

The invention discloses an optical module, an eye camera and an eyeball tracking method, and the optical module comprises a light modulation element which is used for receiving incident light from a target object and generating a first polarized light signal and a second polarized light signal, the first polarized light signal is orthogonal to the polarization state of the incident light, and the second polarized light signal is orthogonal to the polarization state of the target object; the inner product of the second polarized light signal and the Jones vector of the incident light is larger than 0 or smaller than 0, the light sensor is used for receiving the first polarized light signal and the second polarized light signal to generate data information, and the processor is coupled with the light sensor and used for determining image information of a target object according to the data information. According to the optical module provided by the invention, dual optimization of reflection suppression and detail enhancement in a target recognition scene can be realized, the target object distinction degree is improved, the detail richness of imaging is considered, and the applicability of polarization imaging in a scene with a low signal-to-noise ratio and a high dynamic range is expanded.

Vision safety protocols in workplaces (e.g., a construction site, factory, or hospital) can be evaluated via a virtual reality (VR) system, which can include a VR headset in electronic communication with a computing device. The computing device causes virtual environments with virtual hazards to be displayed on the VR headset. The computing device can prompt the user to complete a task in the virtual environment while adhering to a set of vision safety protocols. Using varying combinations of eye-tracking sensors, eye-tracking cameras, motion-tracking sensors, handheld devices, and microphones, the VR headset collects data about the user as she completes the task. Optionally, algorithms in the computing device can assess the efficacy of the vision safety protocols based on the user's performance of the task and recommend changes to the vision safety protocols that increase workplace safety and efficiency. Optionally, the computing device can cause the virtual hazards to be changed.

This application relates to naked-eye 3D display technology, and discloses an eye tracking device, including: an eye tracker, including a first black-and-white camera configured to capture a first black-and-white image and a second black-and-white camera configured to capture a second black-and-white image; an eye tracking image processor configured to identify the presence of eyes based on at least one of the first black-and-white image and the second black-and-white image and determine the spatial position of the eyes based on the eyes identified in the first black-and-white image and the second black-and-white image. The above device can achieve high-precision determination of the spatial positions of the user's binocular eyes respectively and high-speed eye identification, or in other words, real-time eye tracking. This application also discloses an eye tracking method and a 3D display device and method.

A user's visual disorders can be treated via a virtual reality (VR) system, which can include a VR headset in electronic communication with a computing device. The computing device causes vision tests to be displayed on the VR headset. Using varying combinations of eye-tracking sensors, eye-tracking cameras, motion-tracking sensors, handheld devices, and microphones, the VR headset can collect data about the user as she completes the vision tests. Using the data collected by the VR headset, the computing device can evaluate the user for various visual disorders and develop a personalized vision therapy plan for the user. Optionally, advanced algorithms in the computing device dynamically alter the vision therapy plan based on the user's performance and the progression of her visual disorders.

The group of inventions relates to optical elements with integrated electronic components and specifically to contact lenses with a built-in ultrathin digital camera, which are applicable for capturing video images, object recognition, implementing the user eye-tracking function, including, without limitation, while forming virtual, augmented, mixed or extended reality (VR / AR / MR / XR), as well as for diagnosing and compensating ophthalmic diseases, and for other applications. The contact lens housing (1) made of an optically transparent material contains a built-in electronic component containing a power source (2) and a camera (3) with at least one receiver (4) in the form of a matrix (8) of photosensitive elements. The camera (3) is equipped with an optical system implemented as at least one coding mask (5) separated from the receiver (4) by an intermediate layer (9) of homogeneous optically transparent material and disposed on the surface of or inside the lens housing (1). The invention makes it possible to significantly reduce the thickness of the contact lens containing an integrated camera and to produce an operational device that is comfortable for daily wearing.

A head worn augmented reality (AR) display device with a plurality of haptic feedback devices mounted at spatially separate positions. Position data for the wearer and information relating to the wear

System, process, and device configurations are provided for eye tracking and interactive game control. A method can include detecting eye tracking data for at least one user during the presentation of the gaming content and determining a player engagement parameter for the gaming content based on the eye tracking data. Presentation of the gaming content may be updated using the player engagement parameter. Embodiments can include use of the player engagement parameter for one or more of identifying game play objects of interest, player engagement level, user effect of the gaming content, player type, player profiles and audio immersion preferences. The player engagement parameter can be used to update gaming content, audio output and control sound output for gaming content.

A head-mountable electronic device includes an optical module frame, a display coupled to the optical module frame and extending in a display plane, and an eye-tracking assembly. The eye-tracking assembly includes a flat electrical cable, for example a flexible printed circuit (FPC), coupled to the optical module frame and disposed about a perimeter of the display, and a light emitting diode (LED) electrically coupled to the flat electrical cable and configured to direct light away from the display. The flat electrical cable defines a major plane oriented generally orthogonal to the display.