163 results about "Eye tracking" patented technology

The invention relates to the technical field of visual health management, in particular to a ciliary muscle adjustment training system and method based on eye movement tracking, and the method comprises the steps: collecting eye movement data of a fixation point track, an adjustment amplitude change rate and pupil response time in real time, and combining personalized parameters such as the age of a user, diopter and a training target; inputting a ciliary muscle training dynamic planning algorithm module, dynamically generating a stage scheme containing a training action type, a single-group duration, a stimulation interval and a focal length adjustment strategy, and adaptively adjusting the strategy according to real-time adjustment stability and a historical ability curve; through multi-dimensional matching analysis of a pre-stored standard eye movement template, a training specification score is calculated from the track goodness of fit, speed uniformity, amplitude standard-reaching rate and binocular coordination, visual fatigue parameters are obtained based on continuous training duration, pupil fluctuation and retina reflex change, a scoring result is dynamically corrected, and a visual fatigue evaluation result is obtained. Personalized, self-adaptive and quantitative safety control of the training process is realized.

A multi-screen cockpit display system is suitable for being installed in a cockpit, and includes a first display device, a control unit and a second display device. The first display device is disposed in front of a driver's seat in the cockpit, and is suitable for displaying a first dynamic information. The control unit is electrically connected to the first display device. The control unit is suitable for providing the first dynamic information to the first display device according to an operating state of the cockpit. Another multi-screen cockpit display system with an eye tracking module is also provided.

Techniques related to the computation of gaze vectors of users of wearable devices are disclosed. A neural network may be trained through first and second training steps. The neural network may include a set of feature encoding layers and a plurality of sets of task-specific layers that each operate on an output of the set of feature encoding layers. During the first training step, a first image of a first eye may be provided to the neural network, eye segmentation data may be generated using the neural network, and the set of feature encoding layers may be trained. During the second training step, a second image of a second eye may be provided to the neural network, network output data may be generated using the neural network, and the plurality of sets of task-specific layers may be trained.

A user's accommodative spasm can be evaluated and mitigated via a virtual reality (VR) system, which can include a VR headset in electronic communication with a computing device. The computing device causes virtual environments, which can include objects, optotypes, various lighting conditions, and various weather conditions, to be displayed on the VR headset. Using varying combinations of eye-tracking sensors, eye-tracking cameras, motion-tracking sensors, handheld devices, and microphones, the VR headset collects data about the user as she focuses on various objects placed at different distances away from her in the virtual environments. Optionally, advanced algorithms in the computing device dynamically alter the virtual environments and the visual tasks and analyze the user's responses to evaluate the user's accommodative spasm.

According to the AI glasses-based driver sight tracking and augmented reality early warning system and method provided by the invention, the attention focus of a driver is monitored in real time through deep fusion of a high-precision eyeball tracking technology and an AR display technology, and correlation analysis is carried out on the attention focus and environmental perception data of an intelligent driving system, so that the driver sight tracking and augmented reality early warning effect is improved. When a driver is found to be invisible to a key dangerous target, the attention of the driver can be actively and accurately guided, and key safety information is ensured to be effectively received and confirmed, so that the man-machine cooperation efficiency and the driving safety are remarkably improved. The problems that an existing early warning system is not visual in information transmission and cannot confirm whether a driver really receives information or not are solved, the driving safety and the man-machine interaction efficiency are remarkably improved through a closed-loop vehicle perception-driver cognition-danger confirmation mechanism, and more accurate, more visual and more efficient driving safety early warning is achieved.

An information handling system peripheral display has plural display assemblies coupled to stand supports of a display stand to present visual images a display panel included in each display assembly. Sensors, such as an eye tracker sensor or a mouse cursor presentation location, are applied to analyze end user interaction at each display panel and selectively dim and / or turn off brightness at each display panel. A contact pad at the rear of each display assembly interfaces with a contact pins of each display support to determine the location of the display assembly at the display stand and the rotational orientation of the display assembly.

Vision safety protocols in workplaces (e.g., a construction site, factory, or hospital) can be evaluated via a virtual reality (VR) system, which can include a VR headset in electronic communication with a computing device. The computing device causes virtual environments with virtual hazards to be displayed on the VR headset. The computing device can prompt the user to complete a task in the virtual environment while adhering to a set of vision safety protocols. Using varying combinations of eye-tracking sensors, eye-tracking cameras, motion-tracking sensors, handheld devices, and microphones, the VR headset collects data about the user as she completes the task. Optionally, algorithms in the computing device can assess the efficacy of the vision safety protocols based on the user's performance of the task and recommend changes to the vision safety protocols that increase workplace safety and efficiency. Optionally, the computing device can cause the virtual hazards to be changed.

A user's visual disorders can be treated via a virtual reality (VR) system, which can include a VR headset in electronic communication with a computing device. The computing device causes vision tests to be displayed on the VR headset. Using varying combinations of eye-tracking sensors, eye-tracking cameras, motion-tracking sensors, handheld devices, and microphones, the VR headset can collect data about the user as she completes the vision tests. Using the data collected by the VR headset, the computing device can evaluate the user for various visual disorders and develop a personalized vision therapy plan for the user. Optionally, advanced algorithms in the computing device dynamically alter the vision therapy plan based on the user's performance and the progression of her visual disorders.

A system adapted to interact with a user by monitoring activity of a user's eye gaze, the system comprising: a user web camera configured to determine a location at which the user's eyes gaze on a user display configured to display digital content to the user; an operator display configured to view the live interaction of the eye gaze of the user from a movement of the eye gaze controlled cursor projected in the operator display; a processor having a gaze estimation module for receiving eye movement and head movement signals from the user web camera as calibration data for estimating eye gaze, the processor configured to: generate an interactive stimulus to the user display; stimulating an interaction with the interaction via a user's gaze-based interaction or blink-based interaction; and analyzing and determining a user focus based on eye tracking of the interaction from the interaction stimulus.

A display may use a waveguide to provide image light to an eye box. An emitter may emit infrared light collimated at different angles relative to a collimated axis and divergent along an orthogonal axis. The waveguide may propagate the infrared light and may include overlapping one-dimensional diffractive gratings with parallel periodic structures. Each grating may diffract, towards the eye box, a respective portion of the infrared light from a respective incident angle onto a respective output angle relative to the collimated axis. A camera may capture glints of the infrared light as reflected off a user's eye at the eye box for performing gaze tracking. The emitter and the gratings may effectively form a one-dimensional line of infrared emitters overlapping the eye box while allowing the optical emitter to remain invisible to a user.

A head-mounted display and a method for eye tracking calibration are provided. The head-mounted display includes a display, an image capture device, and a processor. The image capture device captures an eye image during a display of calibration points. The processor is coupled to the display and the image capture device, wherein the processor is configured to: display the calibration points on positions of a position set sequentially in an order according to a current time and number of positions via the display; and generate calibration data according to the eye image.

Eye tracking device and eye tracking assembly. The invention relates to an eye tracking device (1) adapted to track the eye movement (5) of a user, comprising: - a support structure (7) adapted to be mounted on the head (3) of a user, - a video data acquisition means, comprising a camera (17) adapted to acquire video of said eyes, - an infrared wave emission means, adapted to emit infrared waves in the direction of said user's eyes, - a data transfer means adapted to transfer said acquired data to a data processing device comprising a pupil detection algorithm. According to the invention, the device (1) includes an optical accessory attachment interface (35) adapted to receive at least one external optical accessory.The invention also relates to an assembly for the acquisition of ocular data comprising such a device (1). Figure 3.

In one implementation, a method is performed for generating metadata estimations based on metadata subdivisions. The method includes: obtaining an input image; obtaining metadata associated with the input image; subdividing the metadata into a plurality of metadata subdivisions; determining a viewport relative to the input image based on at least one of head pose information and eye tracking information; generating one or more metadata estimations by performing an estimation algorithm on at least a portion of the plurality of metadata subdivisions based on the viewport; and generating an output image by performing an image processing algorithm on the input image based on the one or more metadata estimations.

A head mounted display (HMD) apparatus may include: a display; an optical lens adjacent to a first side of the display; at least one light source configured to emit light; and at least one eye-tracking sensor adjacent to a second side of the display and configured to obtain gaze information about a user by receiving reflected light that is the light emitted from the at least one light source and reflected off eyes of the user. The display may include a second display region corresponding to a position of the at least one eye-tracking sensor, and a first display region other than the second display region. A number of pixels per unit area of the first display region may be greater than a number of pixels per unit area of the second display region.

The present invention relates to a power-efficient eye-tracking method capable of providing a full range of users' eye features using an edge computing device, embeddable in a general head-mounted device, such as AR / VR / XR or smartglasses. The invention is further focused on an eye-tracking unit and / or a head-mounted device embedding the eye-tracking unit using the invented method.

The invention discloses a rendering method and device of wearable equipment, equipment and a storage medium, relates to the technical field of wearable equipment, and discloses the rendering method of the wearable equipment, the method is applied to the wearable equipment, an eye tracking device is arranged, and the eye tracking device is used for monitoring eye movement. The method comprises the following steps: analyzing an eye tracking image collected by an eye tracking device, and determining a gazing point location and gazing parameters; determining a device offset state according to the gaze parameter; and when the state is not shifted, determining a target rendering area according to the fixation point location and the equipment interaction information, and performing image enhancement rendering in the area. Through the above mode, whether deviation exists between the equipment and the eyes of the user is determined based on the gaze parameter, the rendering area is determined by combining the gaze point location and the equipment interaction information when deviation does not occur, rendering is enhanced in the area, visual delay and scene deviation are effectively reduced, motion sickness of the user is relieved, and user experience is improved.

The set of inventions relates to a user eye tracking method and may be used for AR / VR / MR / XR formation systems. According to a user eye tracking method, a camera monitors a user's eye, a corneal contact lens containing an optical structure forming a stereoscopic image is placed on the user's eye, and a position of the user's eye is determined from a linear size and an angular position of the image with respect to the camera. The optical structure can be implemented as an auto-stereogram and decoding slit grid, wherein the auto-stereogram is formed by reflecting the slit grid in a specular coating or by a shadow projected by the slit grid on a diffusely reflective coating. The optical structure may be formed from a real image or a hologram. The present invention makes it possible to improve the accuracy in measuring the position of a corneal contact lens and thereby measuring the position of a user's eye.

Techniques for optimizing which LEDs in a HMD to use, the brightness of those LEDs, and camera exposure are divulged based on the particular function to be performed. For instance, one set of optimization parameters may be implemented for eye tracking purposes while a different set of optimization parameters may be implemented for eye-based authentication purposes.

A head-mountable device can include components that provide eye tracking and image capture of an external environment from a position at one or more arms of the head-mountable device. The frame can provide one or more lenses that facilitate optical detection by a camera at the one or more arms. Thus, the frame of the present disclosure need not include components for managing eye tracking and image capture of the external environment. Based on a set of one or more images, the head-mountable device can determine whether to perform one or more actions based on detected environmental conditions and / or detected eye conditions.

The application discloses a new energy vehicle modeling design method and system, electronic equipment and a storage medium, and belongs to the technical field of vehicle industrial design. The method comprises the following steps: based on an interval 2-type trapezoidal fuzzy Kano model, the weight of the user emotional vocabulary obtained through the evaluation construction diagram is calculated and sorted to identify key emotional needs; based on a limit gradient boosting model optimized by a hippo optimization algorithm, a nonlinear mapping relationship between the key emotional vocabulary and the new energy vehicle form design features is established; the mapping relationship is used to predict and generate an optimal form feature combination with the highest emotional evaluation value; the generated design scheme is comprehensively evaluated subjectively and objectively by combining eye tracking technology and a discrete information data fluctuation weighting method, and a final design scheme is screened out. The method can accurately quantify and sort the subjective and fuzzy emotional needs of users, establish a nonlinear mapping relationship between the emotional needs of users and specific product design features, and improve the efficiency of new energy vehicle modeling design.

A method includes obtaining, via an eye tracker, a gaze input directed to a physical object that is operable in a first state or a second state. The physical object is currently in the first state. The method includes detecting a gesture performed by a user of the device while the gaze input is directed to the physical object. The method includes switching the physical object from the first state to the second state in response to the gesture satisfying a state change criterion associated with the second state.

The invention provides a three-dimensional display device and a display method. The three-dimensional display device comprises an eyeball tracking device, a processor and a display. The eyeball tracking device tracks a left eye position and a right eye position. The processor calculates a plurality of left-eye viewpoints and a plurality of right-eye viewpoints according to the left-eye position and the right-eye position, and generates a plurality of views. The display comprises a plurality of light emitting units and a plurality of light splitting units. The plurality of light emitting units emit a plurality of light beams. The plurality of light splitting units distribute a plurality of beams of light emitted by the plurality of light emitting units. The processor calculates the field angles and the optical paths of the plurality of light beams emitted by the plurality of light emitting units penetrating through the plurality of light splitting units so as to generate viewpoints through which the plurality of light beams pass. The processor performs light intensity comparison post-processing on views corresponding to at least one of the plurality of left eye viewpoints and at least one of the plurality of right eye viewpoints. The three-dimensional display device and the display method disclosed by the invention can provide a good three-dimensional image display method.

The disclosure provides an eye tracking-based data generation method, a model training method and related equipment. The data generation method comprises: acquiring a plurality of first eye images and a plurality of first masks corresponding to the plurality of first eye images; training an initial model based on the plurality of first eye images and the plurality of first masks to obtain a target model; generating a plurality of gaze information and a plurality of second masks corresponding to the plurality of gaze information based on an eye model; inputting the plurality of second masks into the target model to obtain a plurality of second eye images; and generating a plurality of eye tracking data based on the plurality of second eye images and the plurality of gaze information.

System for eye tracking during sleep and in altered states of consciousness comprising an eye tracking device including a wearable eye mask comprising an eye mask casing with a form fit border configured for placing over a person's eyes, the eye mask casing and form fit border being opaque configured to prevent light from entering inside of the eye mask casing when worn in a form fit manner by the wearer, an electronic control and communications system and power source for transmission and reception of data with a computing system, a humidifier mounted on an inner side of the eye mask casing, eye tracking sensors mounted on an inner side of a front panel of the eye mask casing, and an infrared illumination source mounted on an inner side of the eye mask casing and configured to illuminate a position of the eyes of a person wearing the eye tracking device

A reader assistance device employs eye tracking to infer an individual's reading progress which is then used to provide visual aids by highlighting words as they have been read and the next line of words as well as to provide additional magnification or spoken versions of words that are difficult to comprehend reflected by the inferred reading progress. The inferred reading progress may also indicate skimming behavior to trigger a summarizer for the skimmed section.

A computing system may detect a user input. The computing system may capture, a screen buffer indicating a state of a user interface of a remote desktop session. The computing system may capture a screen buffer indicating a state of a user interface of the remote desktop session. The computing system may input the screen buffer into a model, to output user interface elements. The computing system may construct user interface element tree based on the hierarchical position of individual elements detected by the model. The computing system may identify a target UI element, and may identify, using a stored ruleset associated with the target element, an action to perform on the target element, and execute the action. The computing system may add transparent overlay on the screen or supply the user interface element position information to client operating system to enable accessibility and eye tracking based interaction.

A method of determining a sensing region of a gaze tracking sensor may include obtaining first eyeball data from a first sensing region. According to an embodiment of the disclosure, a method of determining a sensing region of a gaze tracking sensor may include obtaining an eye model, based on the obtained first eyeball data. According to an embodiment of the disclosure, a method of determining a sensing region of a gaze tracking sensor may include determining a second sensing region, based on the obtained eye model.

A virtual reality (VR) system can be implemented for evaluating color perception under varying luminosities and backgrounds. The system can use an electronic device featuring a head-mounted display (HMD) and eye-tracking sensors. The system can generate a VR user interface that creates an immersive three-dimensional virtual environment, rendered on the HMD. Within this virtual space, the system can present a variety of color perception tasks, systematically altering luminosity and background conditions. As users engage with these tasks, the eye-tracking sensors can continuously monitor responses in real-time. The system can then analyze the data gathered from these interactions to assess the user's color perception performance.

Embodiments described herein include a portable device having a user detection device, such as an eye tracker device or other sensor, and data including such a portable device or data collected from such a device, such as eye tracking data and / or other multi-modal data, some examples of the system may provide useful assessments for developmental disorders and may generate normative treatment plans that have separate lengths of time for different treatment-specific skill fields over a period of time.

A method and apparatus for controlling a head-up display and a head-up display device are provided. The method includes confirming an eye tracking state based on a result of eye tracking, and confirming a rendering mode of a HUD image as one of a two-dimensional (2D) rendering mode and a three-dimensional (3D) rendering mode based on the eye tracking state.