20 results about "Pupil movement" patented technology

A computer-implemented system and method for pupil-directed retinal projection in near-eye displays are disclosed. The computer-implemented system provides smart glasses with directed physical pixels that project light beams / signals directly onto a user's retina based on pupil position and size. The glasses comprise a frame, lenses with directed pixel layers, and sensors for tracking pupil movement. Each directed pixel may generate multiple virtual pixels by rapidly changing its emission angle. The glasses function as prescription lenses, virtual reality displays, and augmented reality devices without traditional optical systems. Additional features include depth sensors, cameras, and connectivity to peripheral devices. The glasses enable a seamless blend of virtual and real-world experiences, creating an immersive “Mixverse” environment. Various input methods, including gesture recognition and brain-computer interfaces, allow for intuitive control and interaction.

The invention discloses an image processing algorithm for pupil center real-time extraction and trajectory tracking in an eye closing state. According to the algorithm, from the angle of digital image processing, graying, contrast enhancement and smoothing processing are firstly carried out on an input eye video frame by frame, and then the boundary of a pupil area can be accurately extracted by adopting an adaptive threshold segmentation technology and combining morphological operation and a Canny edge detection operator. And then, accurate fitting of ellipse parameters is performed on the pupil contour by using a geometric distance-based least square method, so that center coordinates and area information of the pupil are obtained, and the accuracy and reliability of pupil monitoring in an eye closing state are remarkably improved. Through recording and analyzing pupil center position changes in a time sequence, real-time tracking of pupil movement tracks is realized. And finally, evaluating pupil light reflex (PLR) in an eye closing state before and after white light excitation by adopting baseline correction and smooth filtering processing. The method has the advantages of high robustness, adaptability to illumination variation, high real-time performance, high precision and the like.

A computer-implemented system and method for pupil-directed retinal projection in near-eye displays are disclosed. The computer-implemented system provides smart glasses with directed physical pixels that project light beams / signals directly onto user's retina based on pupil position and size. The glasses comprise frame, lenses with directed pixel layers, sensors for tracking pupil movement. Each directed pixel generates multiple virtual pixels by rapidly changing its emission angle. Each directed pixel with pupil's real-time tracking, provides automatic adjustments to virtual contents, ensuring accurate alignment of images with field of view of users while identifying vergence-accommodation conflict. The glasses function as prescription lenses, virtual reality displays, augmented reality devices without traditional optical systems. Additional features include depth sensors, cameras, connectivity to peripheral devices. The glasses enable seamless blend of virtual and real-world experiences, creating immersive “Mixverse” environment. Various input methods, including gesture recognition and brain-computer interfaces, allow for intuitive control and interaction.

To express a more lifelike quality. [Solution] The robot 100 includes a detection unit for detecting objects, an eye unit 150 that mimics an eye and can change the position and size of the pupil, and a control unit 110 that performs a first control to move the position of the pupil in the eye unit 150 to indicate that the robot is looking at an object detected by the detection unit, and a second control to change the position or size of the pupil in the eye unit 150 in a wavering manner, which is a different pupil movement from the movement of the pupil position by the first control.

To generate an avatar of a user with a VR headset being removed.SOLUTION: An imaging computing device generates a two-dimensional (2D) image of at least one user wearing a VR-headset on which one or more sensors are mounted by using a camera device. Movement of pupils of the user is tracked by using the one or more sensors and a headset image is removed from the generated 2D image of the user wearing the headset. In order that other user can view a VR image of the user as if the user were wearing no headset, a detected and recorded pupillary image of the user rendered by the one or more sensors of the VR-headset is stitched and overlaid on a region where the headset image has been removed from the generated 2D image of the user.SELECTED DRAWING: Figure 1

The present disclosure provides a pupil movement tracking method, device, equipment and storage medium. The method comprises: preprocessing an N+1th frame image in an eye video to obtain a corresponding binary image; performing class circle region detection on the binary image to determine position information of a suspected pupil region in the binary image; performing mask processing on the binary image based on the position information to obtain a binary image after mask processing; performing pupil contour extraction on the binary image after mask processing to obtain corresponding suspected pupil contour feature points, and screening the suspected pupil contour feature points based on the position information to obtain pupil contour feature points; determining a coefficient of variation of the pupil contour feature points in the N+1th frame image based on the pupil contour feature points and a pupil center point in an Nth frame image in the eye video; and determining a pupil center point in the N+1th frame image based on the coefficient of variation, to be used for pupil movement tracking.

The invention discloses an intelligent glasses interaction method based on pupil tracking, and the method comprises the steps: setting a reference coordinate system of intelligent glasses for tracking pupil movement glasses, monitoring and analyzing pupil movement state data, and obtaining pupil movement state monitoring and analysis data; according to the pupil motion state monitoring analysis data, automatically creating an association relationship between the pupil tracking position of the intelligent glasses and glasses interaction information; according to the association relationship between the pupil position and glasses interaction information, automatically tracking the pupil position of the pupil movement, marking the coordinate value in a glasses reference coordinate system, and obtaining an intelligent glasses pupil tracking monitoring tracking pupil position used for triggering an interaction control instruction; performing individual adaptive pupil tracking and intelligent glasses stereoscopic image display control interaction according to the pupil tracking position monitoring of the intelligent glasses; the invention discloses an intelligent glasses interaction system based on pupil tracking. The adaptation intelligence degree and the interaction accuracy of various scenes are remarkably improved, and the control interaction diversification is remarkably improved.

A computer-implemented system and method for pupil-directed retinal projection in a near-eye display is disclosed. The computer-implemented system provides the smart glasses with directional physical pixels that project light beams / signals directly onto the retina of the user based on the position and size of the pupil. Eyeglasses include a frame, lenses having directional pixel layers, and a sensor for tracking pupil movement. Each directional pixel may generate a plurality of virtual pixels by rapidly changing its emission angle. Glasses are used as prescription lenses, virtual reality displays, and augmented reality devices without conventional optical systems. Additional features include depth sensors, cameras, and connectivity with peripheral devices. According to the glasses, seamless fusion of virtual world experience and real world experience can be realized, so that an immersive mixverse environment is created. Various input methods, including gesture recognition and brain-computer interface, allow for intuitive control and interaction.

A light based pupil size measuring system includes at least one semiconductor light source including a cavity and configured to emit light onto an eye target. The system further includes at least one light sensor for converting a self-mixing interferometric (SMI) signal of the light backscattered from the eye target into the cavity into an electrical current or voltage and includes at least one processor configured to determine ocular pupillary movement of the eye target based on the converted SMI signal from the at least one light sensor.

To provide an arousal level measurement method that identifies the occurrence order of specific ocular and pupillary movements that appear with a decrease in arousal, and determines the arousal level.SOLUTION: An arousal level measurement method measures changes in eye movement and pupil diameter by performing ocular and pupillary measurements, detects, as an ocular alertness index (Ocular Alertness Index) for evaluating arousal, a shortening of intersaccadic intervals (Frequent saccade), a decrease in peak saccadic velocity (Slow saccade), slow fluctuations in eye position (Slow eye movement), and the co-occurrence (Div-mio) of divergence contrary to the near reflex (Divergence) and miosis (Miosis), and evaluates the decrease level of arousal on the basis of the occurrence order of the ocular alertness indices.SELECTED DRAWING: Figure 14

This application discloses an image distortion detection method, apparatus, electronic device, and readable storage medium, applied in the field of computer vision technology. The image distortion detection method includes: acquiring at least one reference pixel grayscale value corresponding to a target pixel in an image to be detected; performing distortion enhancement on the image to be detected based on the grayscale values ​​of each reference pixel to obtain a distortion-enhanced image; and performing image distortion detection on the image to be detected based on the distorted pixels in the distortion-enhanced image to obtain an image distortion detection result. This application solves the technical problem of low detection accuracy for pupil movement distortion in images.

The invention relates to a method for detecting and evaluating pupil movements of a living body, in particular a human, preferably for detecting and analyzing nystagmus, comprising the following steps: creating (1) a video record by means of a mobile device, in particular by means of a smartphone or tablet, wherein the video record contains at least a portion of an eye-containing region of the face of the organism; extracting (2) still images from the video record at defined time intervals; a pupil center is defined (4) in each still image using a neural network, in particular a convolutional neural network, preferably a u-net convolutional neural network.

The head-mounted vestibular rehabilitation training system based on VR technology of the present invention comprises: a head-mounted VR device is provided with left and right eye movement tracking cameras and a posture sensor, and a control host comprises: a patient information management module manages patient information; a training program management module manages the patient's vestibular rehabilitation training program; a visual target movement parameter setting module is used to set the moving speed, acceleration and moving path length of the visual target image of each training; the control module retrieves the vestibular rehabilitation training program of the target patient, controls the head-mounted VR device to display the visual target image and moves it according to the visual target movement parameters and training method set in the i-th training session, prompts the target patient to track according to the training mode and tracking mode of the i-th training session, i is selected from 1 to N, obtains the pupil movement video image and / or head movement of each training session, analyzes the eye movement tracking and / or head tracking of each training session, and evaluates the vestibular rehabilitation training effect of the target patient in this training.

The embodiments disclose an apparatus including an eyewear pupilometer for detecting, measuring and processing a wearer's pupil movement and size, for detecting and processing retinal images, for detecting and processing a wearer's field of view, for broadcasting alerts, for pre-diagnostic screening, for overriding vehicle operation and for measuring, recording and transmitting circadian responses, at least one eyewear pupilometer module including a lens fiber optic camera module, an image processor module, a retinal image infrared detector module, an outward camera module, at least one alert module, an alert light and message projector, a WI-FI module, an automated pullover module, an automated steering module, fiber optic & data cables, a contact lens pupilometer image, sensor and processor module, and at least one eyewear pupilometer module coupled to and / or embedded into eyewear frames and lenses, contact lenses, a vehicle wind shield and protective covers for hand held devices and laptop computers.

A computer-implemented system and method for pupil-directed retinal projection in near-eye displays are disclosed. The computer-implemented system provides smart glasses with directed physical pixels that project light beams / signals directly onto user's retina based on pupil position and size. The glasses comprise frame, lenses with directed pixel layers, sensors for tracking pupil movement. Each directed pixel generates multiple virtual pixels by rapidly changing its emission angle. Each directed pixel with pupil's real-time tracking, provides automatic adjustments to virtual contents, ensuring accurate alignment of images with field of view of users while identifying vergence-accommodation conflict. The glasses function as prescription lenses, virtual reality displays, augmented reality devices without traditional optical systems. Additional features include depth sensors, cameras, connectivity to peripheral devices. The glasses enable seamless blend of virtual and real-world experiences, creating immersive "Mixverse" environment. Various input methods, including gesture recognition and brain-computer interfaces, allow for intuitive control and interaction.

A light based pupil size measuring system includes at least one semiconductor light source including a cavity and configured to emit light onto an eye target. The system further includes at least one light sensor for converting a self-mixing interferometric (SMI) signal of the light backscattered from the eye target into the cavity into an electrical current or voltage and includes at least one processor configured to determine ocular pupillary movement of the eye target based on the converted SMI signal from the at least one light sensor.

There is provided a method for threat detection based on facial image analysis, the method comprises identifying a face from a facial image acquired from a camera, inferring an emotion corresponding to the face to obtain an emotion-based threat score based on the inferred emotion, obtaining an eye-based threat score based on a blink frequency of eyes on the face and a number of pupil movements in the face, and detecting whether a person corresponding to the face is in a threat situation based on a total threat score calculated by combining the emotion-based threat score and the eye-based threat score.

The embodiment of the invention discloses an information display optimization method and device for an intelligent device and a medium, and relates to the technical field of intelligent device.The method comprises the steps that real-time eye movement data and current device display information of a user are collected, and a pupil movement prediction model and the real-time eye movement data which are constructed in advance are used for predicting the pupil movement of the user; predicting the visual position of the user, and determining a predicted attention area of the user; analyzing current equipment display information, and determining at least one corresponding current information dense area and an information element display weight corresponding to each current information dense area; information arrangement is carried out through the current information dense area and the predicted attention area, initial delivery parameters corresponding to the target delivery object are determined, and the initial delivery parameters comprise position parameters and display parameters; and based on the information element display weight corresponding to each current information dense area, adjusting the display parameter of the initial putting parameter, determining a target putting parameter, and performing display putting on the target putting object.

The invention discloses a virtual reality-based depression adjuvant therapy system, and relates to the field of photoelectric application virtual reality. The system comprises VR glasses, a camera module and a data processing module, and the data processing module is integrated in the VR glasses. After the patient wears the VR glasses, the VR glasses play the virtual interaction scene; the camera module is used for shooting a face image and a pupil image of a patient in real time; and the data processing module determines the emotion of each frame of the patient by adopting an emotion recognition model according to each frame of facial image, and tracks pupil position change by adopting a pupil tracking algorithm according to each frame of pupil image to obtain pupil movement change data of each frame, so that continuous multi-frame emotion and pupil movement change data are fused and analyzed, and the emotion and pupil movement change data are analyzed. Outputting a comprehensive emotion index of the patient; the VR glasses dynamically adjust virtual interaction scene parameters or switch virtual interaction scenes according to the comprehensive emotion index of the patient. The application can assist in treating depression, is convenient to use, and reduces the cost.

The present invention discloses an image processing algorithm for real-time extraction of pupil center and trajectory tracking in the closed-eye state. From the perspective of digital image processing, this algorithm first performs grayscale conversion, contrast enhancement, and smoothing processing on each frame of the input eye video. Then, by using adaptive threshold segmentation technology and combining morphological operations and the Canny edge detection operator, it can accurately extract the boundary of the pupil region. Subsequently, the least squares method based on geometric distance is used to accurately fit the elliptical parameters of the pupil contour, thereby obtaining the center coordinates and area information of the pupil, significantly improving the accuracy and reliability of pupil monitoring in the closed-eye state. By recording and analyzing the changes in the pupil center position in the time series, real-time tracking of the pupil movement trajectory is achieved. Finally, baseline correction and smoothing filtering processing are adopted to evaluate the pupil light reflex (PLR) in the closed-eye state before and after white light excitation. This method has the advantages of strong robustness, adaptability to light changes, high real-time performance, and high precision.