509 results about "Eye position" patented technology

Systems and methods for generating a 3D effect for a video stream are provided. A first video stream from a first client device of a first participant of a virtual meeting and a second video stream from a second client device of a second participant of the virtual meeting is identified. A background and a foreground layer of the first video stream is determined. A first and a second eye position of the second participant of the second video stream are determined. A presentation position of the background layer relative to the foreground layer is determined based on movement between the first and the second eye position of the second participant of the second video stream. A UI presenting the first video stream reflecting the determined presentation position of the background layer relative to the foreground layer is provided for display on the second client device.

The invention discloses an automobile rearview mirror angle automatic adjusting and angle metering method and device, and belongs to the field of automobile rearview mirror automatic adjusting.The method comprises the following steps that coordinates of the head position and the eye position of a driver are obtained, and the eye height of the driver is obtained through the eye movement tracking technology; calculating an optimal reference angle of the rearview mirror according to the height of the eye position, and taking the optimal reference angle as a reference angle theta base of the rearview mirror; the head action of a driver and the dynamic state of a vehicle are sensed in real time through sensor data, data of various sensors are integrated through a fusion algorithm, the fused head angle of the driver, vehicle body posture information and adjustment gain factors are obtained, and the angle of a rearview mirror is dynamically adjusted according to the information. And the driver can always obtain the optimal view angle through closed-loop feedback and a self-calibration mechanism. By means of a personalized adjusting mode, it is ensured that a driver can always see the road condition behind at the most comfortable position.

The invention discloses a visual angle tracking grating stereo display system comprising a 3D camera grating display device used for obtaining viewer 3D information; the eyeball position tracking module is used for acquiring real-time spatial position coordinates of the eyes of the audience relative to the 3D camera; the pose calibration module is used for acquiring a spatial relationship between the 3D camera and the display; and the visual angle rendering and grating interlaced graph generation module is used for calculating the spatial position of the human eyes on the display screen and the mapping of each grating strip in a screen pixel coordinate system after acquiring the positions of the eyes and the relative poses of the display screen and the 3D camera, generating a grating stereoscopic display image suitable for the eyes, and sending the grating stereoscopic display image to a display to be output. According to the method and the device, the viewpoint self-adaptive three-dimensional display of the eyes of one or more audiences is realized, the calculation complexity is reduced, the three-dimensional vision consistency can be ensured, the picture which should be seen by the viewing angle can be accurately rendered, and the problem of blurring or 3D picture distortion is avoided.

The invention relates to an eye thermal therapy instrument with a massage assembly, and relates to the technical field of eye thermal therapy instruments, the eye thermal therapy instrument comprises a thermal therapy instrument shell and a physical therapy mechanism arranged on the thermal therapy instrument shell; the physiotherapy mechanism comprises a massage assembly and a hot compress assembly which are used for carrying out massage and hot compress on the eyes of the human body, and a sealing assembly which is used for carrying out sealing fit on the thermal therapy instrument shell and the eyes of the human body. The hot compress assembly comprises a water tank, a heating wire and a plurality of atomizing nozzles which are arranged on the thermal therapy instrument shell, a water storage part for storing water for the plurality of atomizing nozzles, an adjusting part for automatically adjusting the water yield of the atomizing nozzles, and a heating part for heating the heating wire. The purpose that the thermal therapy instrument precisely regulates and controls the massage force of the designated eye position of the patient and the spraying amount of the liquid medicine at the corresponding eye position is achieved, the larger the pressing force of the designated eye position of the patient is, the larger the spraying amount of the liquid medicine at the corresponding acupuncture point is, the phenomenon that the skin absorbs the liquid medicine unevenly is avoided, and the eye hot compress effect is guaranteed.

An electronic device with dynamic lighting effect and a method for generating dynamic lighting effect are provided. The method for generating dynamic lighting effect includes the following steps. A lighting effect tracking frame is provided according to an eye position of a user, a dynamic lighting effect frame is received, or a predefined lighting effect frame is stored. The lighting effect tracking frame, the dynamic lighting effect frame or the predefined lighting effect frame is obtained. A size adjustment procedure is performed on the lighting effect tracking frame, the dynamic lighting effect frame or the predefined lighting effect frame to obtain a lighting effect control map. The dynamic lighting effect device is controlled according to the lighting effect control map to generate the dynamic lighting effect.

The invention relates to the technical field of deep learning, and discloses an eyeball tracking method and device and electronic equipment, and the method comprises the steps: obtaining an eye image data set of a user, inputting the eye image data set into a preset deep learning model, determining the eyeball position information and the eyeball movement mode of the user, based on the eyeball position information and the eyeball movement mode, the intelligent robot is controlled to perform eye interaction with the user, and eye recognition and dynamic position real-time tracking can be accurately performed through a preset deep learning model.

The invention discloses a BIM-based gymnasium stand sight line rise difference optimization method and system, and relates to the technical field of gymnasium construction, and the method comprises the steps: 1, obtaining a pre-established stand model; analyzing the model to obtain a competition field sideline, a stand position of any model area and a step point coordinate L1 of each row of steps in the model area; calculating eye point coordinates L2 when the person sits by matching a preset human body model / human body simulation parameter with the step point coordinates L1, and generating a sight line by taking the eye position of each person as a starting point and a viewpoint as an ending point; the viewpoints are intersection points of the sight lines and the competition field side lines; calculating the vertical distance between the sight of the next row of audiences and the eyes of the previous row of audiences to obtain a corresponding sight rise difference C; marking steps with the sight line rising difference C smaller than a preset lower limit threshold value, and generating a to-be-optimized area; and step 2, optimizing parameters of the grandstand. The method has the effect that related workers can conveniently and efficiently design the stand with better visual sense of audiences in the back row.

Systems, methods, and computer programs for eye tracking. In one embodiment, an eye tracking system includes a head-mounted device that takes measurements indicative of a position of the eye of a user. A head-mounted camera captures an image of the eye. A computer calculates the position of the eye based on the measurements, utilizes the position of the eye to crop the image around the pupil, and provides a cropped image to a video-based eye tracker. Optionally, the size of the cropped image is less than a third of the size of its respective uncropped image. Optionally, the head-mounted device includes one or more of the following: a photosensor-oculography device (PSOG), an electrooculography device (EOG), an electromyography device (EMG), an optical flow sensor, and a range sensor. Optionally, the image-based eye tracker calculates, based on the cropped image, at least one of pupil diameter and pupillary response.

A beam of light is directed onto, and scanned across, a controllably-selected portion of a concave-curved light-redirecting surface that provides for redirecting and redistributing the light and illuminating a two-dimensional image-display modulation array. A virtual image of the two-dimensional image-display modulation array is formed by an optical subsystem. Light thereof propagating from an aperture of the optical subsystem is collected onto a subpupil within an exit pupil of the optical subsystem on a surface proximate to an outer surface of an eye location. The subpupil is associated with the controllably-selected portion of the concave-curved light-redirecting surface, and with a corresponding portion less than all of the light of the virtual image that is associated with a gaze direction of the eye when viewing the subpupil. A location of the subpupil within the exit pupil corresponds to a location of the controllably-selected portion on the concave-curved light-redirecting surface.

A system includes a tracker, an autostereoscopic display, and at least one processor. The at least one processor is configured to track an eye position of a given eye of a given user relative to an image plane of the autostereoscopic display, using the tracker. The at least one processor is further configured to detect when the eye position of given eye is no longer trackable by the tracker. When the eye position is no longer trackable, the at least one processor is configured to generate or retrieve an image for display to the given eye, increment a tracking counter, map a value of the tracking counter to a transition level, and perform at least one of modifying pixel intensity values of the image based on the transition level to fade out the image, or interpolating a virtual depth in the image based on transition level, and display the image.

The invention provides a man-machine interaction sight tracking method, which comprises the following steps of: intercepting and amplifying eye positions in a whole image, training a Yolov5 algorithm by adopting a data set to mark pupil positions and light spot positions from the image, and determining the position of a pupil according to a central position coordinate and a height value and a width value of a detection frame. Marking the pupil position and the light spot position; then, according to a better embodiment of the invention, a 3 * 3 rotation matrix is adopted, the head posture of the interaction object is marked, and the rotation angle of the head posture is obtained; finally, in the mapping process of the coordinates of the display area, the rotation angle of the head posture and the difference value of the pupil light spot position are fitted, so that the tracking precision is remarkably improved, and especially the positioning accuracy of the edge position of the display area is improved.

A method is performed using a transparent display alignment system in a vehicle. The transparent display alignment system includes a transparent display through which a user's eyes behind the transparent display view an external scene in front of the transparent display. The method comprises: receiving an eye position of the eyes, a vehicle position for the vehicle, and an external object position of an external object in the external scene; computing a parallax-free position on the transparent display that intersects with a line-of-sight from the eye position to the external object position through the transparent display, at least based on the eye position, the vehicle position, and the external object position; and positioning a graphic object on the transparent display at the parallax-free position to align the eye position, the graphic object, and the external object to avoid parallax when the eyes view the external object through the transparent display.

The invention discloses a data processing and interaction control system based on dynamic eye position tracking, and particularly relates to the technical field of man-machine interaction and eye movement tracking, which comprises an image acquisition module, a data processing module, an interaction control module and an equipment interface module. The image acquisition module controls a near-infrared camera to capture an eye video; the data processing module executes dynamic calibration, triggers calibration points based on a historical gaze point distribution sparse region, updates a sight line mapping model online by adopting a recursive least square method, and recognizes an interaction intention through a state machine in combination with a gaze point sequence and an eye movement event mode; the interaction control module carries out logic binding on the eye movement intention and signals such as head postures, gestures and voice, and a composite control instruction is generated through complementary fusion, concurrent binding and conflict arbitration; and the device interface module standardizes the instruction and then outputs the instruction to the controlled device. The system realizes non-intrusive dynamic calibration, effectively improves tracking precision and interaction robustness, and is suitable for a multi-modal fusion control scene.

The invention discloses a causal feature selection-based graph neural network refined strabismus diagnosis method, system and device and a medium, and the method comprises the steps: obtaining nine face photos of a patient, and carrying out the image preprocessing of the nine face photos, so as to construct a nine-eye bitmap; detecting an orbit part of each eye position in the nine-eye-position map by adopting a target detection algorithm so as to extract a characteristic variable related to strabismus refined diagnosis in each eye position; a causal feature selection algorithm is adopted to screen out key feature variables having a direct causal relationship with strabismus refined diagnosis from the feature variables related to each eye position; and inputting the key feature variable of each eye position into a graph neural convolutional network model, and carrying out training optimization in a strabismus disease data set through a propagation formula to output a refined diagnosis result. According to the method, irrelevant details on the whole face image are removed to extract main eye areas to construct the nine-eye bitmap, so that the calculation cost is reduced; the key feature variable of each eye position is extracted by adopting a causal feature algorithm, and the key feature variable of each eye position is learned through the graph neural convolutional network model, so that the graph neural convolutional network model is more interpretable, and refined strabismus diagnosis is realized.

An optical sighting device includes an eyepiece positioned to receive optical radiation along an optical axis to produce a real exit pupil located remote from the eyepiece. The real exit pupil is positioned at an eye relief distance from the eyepiece along the optical axis. A digital signal processor determines an axial distance from the eyepiece to an eye positioned proximate the real exit pupil along the optical axis. An aperture stop is centered along the optical axis to direct the optical radiation in a direction of the eyepiece. The eye relief distance is based at least in part on a position of the aperture stop along the optical axis. The optical sighting device further includes an eye relief actuator to translate the aperture stop along the optical axis to null a spatial offset between the eye relief distance and the axial distance to the eye.

The invention relates to an image distortion correction method and system, a storage medium, a controller and a vehicle, and the method is applied to the image distortion correction system, a plurality of reference positions are determined based on the eye box range of a head-up display device, set test images and standard images corresponding to the test images are respectively collected at each reference position, and the test images and the standard images are obtained. And finally, generating a distortion correction parameter according to the projection characteristic difference, and carrying out distortion correction processing on the to-be-projected image based on the distortion correction parameter. Wherein the reference position is a visual angle eye position when a user observes an image of the head-up display device, the test image is an image with distortion defects, and the standard image is an image without distortion defects. According to the invention, the precision of image distortion correction can be improved.

The invention provides an eye muscle derived compensatory head position auxiliary identification device based on instantaneous eye movement capture, and relates to the technical field of medical instruments, the eye muscle derived compensatory head position auxiliary identification device comprises a rotary video playing module, a skeletal muscle key point capture module, a capture module and a photo output module; the detected person watches the video, the video rotates in the reverse direction from the compensatory head position to the horizontal position, if the head position at the horizontal position is not improved, the video rotates towards the compensatory head position, in the rotating process, skeletal muscle key points capture the opposite sides of face and neck key points of the detected person and the head position is digitized, a capture module is started, photos are automatically captured, and eye position abnormity is analyzed through the photos; when eye position abnormity exists in the snapshot image, the snapshot image can be determined as an eye muscle source compensatory head position, and when the head position improvement is not obvious, one eye of the examiner is covered, and the other eye continues to watch the video. And the detected person watches the video, and after the video stops rotating, the head position and the fixation point are kept stable until the photo is automatically captured. When the head position of the snapshot image is improved, the head position can be clearly determined as the eye muscle-derived compensatory head position.

The invention discloses an output control method and device for multiple display units based on an exhibition stand. The method comprises the following steps: in response to arrival of a detection period, acquiring images of respective acquisition areas through a plurality of image acquisition modules; determining identity information of visitors; acquiring eye positions and head orientations of visitors in the images, determining sight ranges of the visitors based on the eye positions and the head orientations, and determining display units to which the visitors belong for the visitors based on the sight ranges; determining corresponding output display content for each display unit based on the identity information of the visitors belonging to each display unit; and outputting through the determined display unit according to the determined display content. According to the invention, the experience effect of visitors is improved, and the exhibition display effect is improved.

The present disclosure relates to a head-mounted display device with vision correction. A head-mounted display may include a display system and an optical system in a housing. The display system may have a display that produces an image. A positioner may be used to move the display relative to the eye position of a user's eye. The adjustable optical system may include an adjustable lens, such as an adjustable cylindrical liquid crystal lens. When the user's eye is at the eye position, the display can be viewed through the lens. A sensor may be incorporated into the head-mounted display to measure the refractive error of the user's eye. The sensor may include a waveguide and a volume hologram and a camera for collecting light reflected from the retina of the user's eye. Viewing comfort may be improved by adjusting the display position relative to the eye position and / or by adjusting the lens setting based on the content presented on the display and / or the measured refractive error.

The invention relates to the technical field of naked-eye 3D display, and discloses a control method of a naked-eye 3D display device, which comprises the following steps of: S1, detecting a viewpoint of a user and acquiring parameters, acquiring the position, the viewing angle and the viewing distance of the eyes of the user through a sensor, and calculating a theoretical parallax value based on the acquired parameters; and S2, dynamic optimal parallax matching calculation: on the basis of obtaining the eye position, the viewing angle and the viewing distance of the user, combining depth information of the display content, and calculating optimal parallax distribution in the current environment. A dynamic optimal parallax matching technical scheme is adopted, user eye movement tracking information and display content depth information are combined, parallax distribution is optimized in real time, it is ensured that a 3D picture is always in an optimal watching state, compared with an existing naked eye 3D display scheme with fixed parallax parameters, the method can adapt to watching angles, eye distances and distances of different users, and the user experience is improved. The problem that a fixed parallax scheme is poor in adaptability is solved, the watching comfort is greatly improved, and visual fatigue is reduced.

The invention discloses a pseudo 3D display method and system based on eye movement tracking and affine transformation, particularly relates to the technical field of display and man-machine interaction, and comprises the steps of 3D model preprocessing, real-time eye movement tracking, view angle parameter calculation, dynamic projection generation, affine transformation correction, display image adjustment and dynamic pseudo 3D display effect realization. The pseudo 3D effect that the visual angle is dynamically adjusted along with the eye position of the user can be achieved through a common 2D screen, special 3D display equipment is not needed, pixel-level perspective correction is achieved, the depth perception of a pseudo 3D image observed by the user is closer to a real three-dimensional space, the visual immersion and interaction naturalness are effectively improved, and the user experience is improved. The core problems that traditional pseudo 3D depth perception is fuzzy and distortion is easily generated due to view angle deviation are solved, the user immersion and interaction naturalness are remarkably improved, and the method can be widely applied to scenes such as virtual social contact, vehicle-mounted HMI, telemedicine and education simulation.

The invention provides a fatigue screening method based on critical flash fusion frequency and multi-modal eye features, and the method comprises the steps: processing an eye response image set, extracting the diameter of a pupil, and forming reference eye position data; and finally generating a user fatigue value representing the fatigue sensitivity of the user in combination with a CFF critical value model. In the normal driving process, the system continues to collect a current monitoring image through flickering irradiation of the light source, and monitoring eye position data are extracted from the current monitoring image. And comparing the monitored eye position data with a previously generated user fatigue value, if the monitored eye position data exceeds the user fatigue value, considering that the driver is possibly in a fatigue state, generating a fatigue signal by the system, and triggering a corresponding early warning mechanism. In combination with flicker frequency induced visual perception change and eye feature analysis, the limitation of only depending on eye movement or CFF is broken through, and the detection precision of central fatigue is improved. The method is completed through light source and image acquisition and is suitable for continuous fatigue monitoring in the actual driving process.

The invention provides a vehicle rearview mirror adjusting method and electronic equipment, and the method comprises the steps: obtaining the eye position of a driver in a vehicle, and determining the target angle of a rearview mirror in the vehicle according to the eye position, thereby achieving the self-adaptive adjustment of the rearview mirror based on the eye position of the driver, enabling the rearview mirror to provide a proper visual field for the driver, and improving the user experience. Individual difference requirements of drivers are met, then driving information of the vehicle is obtained, the target angle is adjusted according to the driving information, the rearview mirror is adjusted through the adjusted target angle, rearview mirror adjustment based on the driving state of the vehicle is achieved, the view provided by the rearview mirror can further meet the requirements of the vehicle in the driving state, and the driving safety of the vehicle is improved. Therefore, the rearview mirror can provide a visual field better meeting the requirements of a driver, the driving safety of a vehicle is guaranteed, and the problems that in the prior art, the manual adjustment efficiency of the rearview mirror is low, adjustment is inaccurate, and safety risks are likely to be caused are solved.

A vision detection apparatus is provided which comprises an eye lens, and the followings which are juxtaposed, with the eye lens as a common component: an ocular axial length measurement light path for measuring an ocular axial length of a detected eye; a diopter detection light path for obtaining refractive error information of the tested eye; an optotype light path for providing a fixation image for the detected eye 1 and enabling the detected eye to gaze stably; an eye position monitoring light path for performing three-dimensional positioning for the detected eye and collect imaging information of the detected eye. Through the present disclosure, it is possible to obtain information on refractive errors in the eyes, measure the anterior and posterior segment regions, and obtain eye parameters such as axial length, which has high practical value in vision detection of the teenagers.

The present application relates to a strabismus detection method, a strabismus detection device and a wearable device. Among them, the strabismus detection method includes: obtaining the eye movement fluctuation information of each eye of a detection object based on a first detection rule; when the eye movement fluctuation information of each eye of the detection object is lower than a first threshold, obtaining the first eye movement information of each eye of the detection object when performing strabismus detection based on the first detection rule; wherein, the eye movement fluctuation information and the first eye movement information are associated with the change between the mean values of the eye movement direction vectors of the eyes during each eye movement plateau period when performing strabismus detection based on the first detection rule; when the first eye movement information of any eye is greater than a second threshold, it is determined that the detection object has an eye position deviation. It realizes an objective and unified eye position deviation measurement process and improves the efficiency of strabismus detection.

A system includes an eye tracker having a camera, the eye tracker being configured and arranged to track an eye movement of a subject, and a processor in communication with the eye tracker, the processor being configured and arranged to create a dataset of the eye movement, generate a plot of the dataset, the plot reflecting a timecourse of eye position versus time, and identify one or more streaking vertical lines in the plot to indicate a deficit in cranial nerve II function.

Non-transitory computer-readable media described herein store instructions that, when executed by at least one processor, direct a display device with a first display for a first eye and a second display for a second eye to perform processes for binocular extended reality display alignment based on eye position. For example, one illustrative process may include: changing between a monocular presentation of an image on the first display and a binocular presentation of the image on the first display and the second display; detecting an eye position modification associated with the second eye in response to the changing between the monocular presentation and the binocular presentation; and determining, based on the eye position modification associated with the second eye, an alignment of the first display with respect to the second display. Corresponding methods and devices are also disclosed.

A method performed by a surgical robotic system that includes a seat that is arranged for a user to sit and a display column that includes at least one display for displaying a three-dimensional (3D) surgical presentation. The method includes receiving an indication that the user has manually adjusted the seat and in response, determining, while the user is sitting on the seat, a position of the user's eyes, determining a configuration for the display column based on the determined position of the user's eyes, and adjusting the display column by actuating one or more actuators of the display column according to the determined configuration.

A method for robust adaptation of a device that is automatically trackable to a varying eye position of a user of the device for use in a vehicle, the method including ascertaining a current change in the eye position of the user, returning to ascertaining a change in the eye position if at least one of predetermined ignoring criteria that classifies the currently ascertained change as irrelevant is satisfied and none of predetermined exceptional circumstances that classify tracking as necessary is satisfied, and tracking the device according to the currently ascertained change in the eye position if none of the predetermined ignoring criteria is satisfied or if at least one of the predetermined exceptional circumstances is satisfied.

A display method includes obtaining image information, where the image information includes an eye of a first user, determining an eye position and a line-of-sight direction of the first user based on the image information, and adjusting a display manner of a first area in a display area based on the eye position and the line-of-sight direction of the first user. The display area is a display area of a head-up display or a display area of an augmented reality head-up display, and the first area includes privacy information of a second user.