140 results about "Eyeball movements" patented technology

The invention discloses an intelligent glasses image adjusting system based on eye movement tracking and gesture fusion, and relates to the technical field of intelligent equipment. A multi-modal sensing module is arranged to construct a multi-modal sensing layer to capture eyeball movement tracks and gesture actions; a fixation point prediction module is set to process a dynamic scene through a space-time attention mechanism to obtain a fixation point prediction area, a gesture semantic understanding module is set to process gesture actions based on a Transform architecture, and the gesture actions of a user are converted into image adjustment instructions. An image enhancement strategy setting module designs a multi-stage image enhancement strategy according to the fixation point prediction area and the image adjustment instruction, and sets a dynamic adjustment intensity control module to perform adaptive adjustment to obtain a dynamic adjustment intensity control result; an eye movement-gesture cooperative control module is arranged to provide an eye movement-gesture cooperative control mechanism to realize image area selection and parameter adjustment, and accurate image area selection and parameter adjustment are realized.

The invention discloses a naked-eye 3D display optimization method based on real-time eyeball tracking, and particularly relates to the technical field of naked-eye 3D display, and the method comprises the steps: capturing eyeball movement data in real time through a visual angle tracking sensor, and collecting illumination information in combination with an ambient light sensor; depth perception parameters are calculated based on pupil diameter variation and frequency, and a time sequence prediction type dynamic compensation coefficient is generated in combination with eyeball movement acceleration; acquiring an initial fixation point coordinate by using an improved spherical projection mapping model, and performing compensation coefficient correction to obtain a real-time coordinate; and finally, according to the real-time coordinates, dynamically adjusting the refractive index distribution of the nanostructure layer, the rotation angle of the polarizer, the focal length of the optical lens and other optical modulation parameters. The real-time distance is calculated through the binocular parallax algorithm, the depth mapping value is generated by combining the focal length of the camera and the baseline distance, the method can adapt to the illumination change and the user view angle, and the 3D display effect is optimized.

The invention provides a community open space psychological recovery effect assessment method and system based on multi-modal perception. The method comprises the following steps: acquiring a physiological signal, a movement track, eyeball movement data and a panoramic image of a user; analyzing the image, extracting environmental element space distribution parameters, and calculating an environmental information entropy value; according to the physiological signal, calculating physiological stress deviation as a first type of error, analyzing the matching degree of a moving track and an environment structure as a second type of error, and combining eye movement characteristics and visual attraction distribution to calculate attention deviation as a third type of error; inputting the three types of errors and entropy values into an evaluation model, and outputting a recovery efficiency index and a multi-dimensional index representing error mitigation; and associating the environment parameters with the multi-dimensional indexes, explaining and extracting an environment intervention critical value and a recovery effect function, and generating a space optimization evaluation report in combination with dynamic indexes. According to the method, quantitative evaluation and accurate optimization decision support of the psychological recovery effect of the open space of the community are realized.

The invention relates to the technical field of augmented reality glasses optical correction, and specifically provides an eye movement distortion detection method. The method comprises the following steps: acquiring an AR glasses playing image and identifying a visual saliency region to establish an attention priority order; detecting an eyeball movement track direction vector and an instantaneous speed in real time; determining a predicted attention target according to the motion direction and the attention priority; generating a distortion correction parameter set in combination with eyeball arrival time and spatial distribution information; performing pre-distortion compensation rendering on the candidate area in a pre-generation period before eyeballs reach the actual attention area to form a pre-corrected image buffer area; and finally, outputting a pre-corrected image matched with the actual stay area. Space-time synchronization of eyeball movement and image compensation is achieved through predictive rendering, the image distortion and color separation phenomena in the glancing process are eliminated while the low-delay characteristic is maintained, and the visual definition and comfort in a dynamic scene are remarkably improved.

The invention provides an application of WNT7B in construction of a myopia animal model. Homologous genes wnt7ba and wnt7bb of the WNT7B in the zebra fish are knocked out or knocked down by applying a CRISPR / Cas9 gene editing technology, an animal model of which the eye axis length is remarkably increased, the eyeball movement frequency is remarkably reduced and the light response is reduced is obtained, and the result shows that the WNT7B is related to the high myopia. The model provides a favorable tool for pathogenesis and drug screening of high myopia, and has a good application prospect.

The invention belongs to the field of visual training, and particularly relates to a multispectral dynamic visual function training system and method. The multispectral dynamic visual function training system comprises an image acquisition module, an intelligent analysis module, a control module, a training execution module and a multispectral light source module, the image acquisition module is arranged at a position corresponding to an eye and is used for acquiring image information near eyeballs of a user, personal information of the user and a vision diagnosis result in real time, and the image information comprises eyeball movement tracks, pupil sizes and forms, cornea edge contours and eye white elastic states; and the intelligent analysis module combines the image information and the acquisition time of the image information. According to the scheme, through collection, analysis, regulation and control of a closed loop, the problems that in the prior art, a real-time analysis mechanism based on eyeball images is lacked, the adaptability of a training scheme and eye dynamic characteristics is weak, and precise regulation and control of functions such as light nutrition supplement and choroid stimulation cannot be achieved are solved; and precise training is also realized, and the effects of prevention and protection, cooperative improvement, compliance improvement and the like are achieved.

A system includes a first camera located within a cockpit of an aircraft to track the eye movement of at least one pilot, and a second camera to track an ambient light source. The system includes an electrochromic panel having an array of dimmable cells. The system further includes a controller, equipped with one or more processors responsible for modifying the array of dimmable cells. The controller receives eye tracking data from the first camera associated with a gaze target of the pilot, and light tracking data from the second camera, which includes parameters associated with the ambient light source. Based on the eye tracking and light tracking data, the controller determines a glare location on a surface of the electrochromic panel where the gaze target intersects. The controller may then selectively modify a tint level of specific dimmable cells in the panel to address the determined glare location.

To provide a balance function management system for balance function state information generation and a balance function rehabilitation program.SOLUTION: A memory configured to store at least one processor and at least one artificial neural network model that stores instructions executable by the processor and is executed on a computing device, wherein the at least one processor is configured to input frame images of n (where n is a natural number) videos obtained by photographing a subject through n cameras to the at least one artificial neural network model, At least one of information related to the coordinates of the head, the coordinates of the center of the pupil, and the phase change of the eyeball of the subject according to the order of the frame images of the m-th (m is a natural number from 1 to n) moving image may be acquired, and information related to the movement of the head and the movement of the eyeball for generating the balance state information or performing the balance rehabilitation program may be generated using the acquired information.SELECTED DRAWING: Figure 1

The invention discloses a vehicle rearview mirror adjusting method and device, equipment and a storage medium, and aims to solve the problem that an electric rearview mirror needs to be manually and repeatedly adjusted and cannot quickly adapt to sight lines and postures of different drivers in the prior art. Whether the driver is observing the rearview mirror or not is judged by collecting the eyeball movement track and the head posture data of the driver; after the observation behavior is determined, the included angle between the sight line and the mirror surface is further detected, and the rearview mirror is adjusted for the first time according to the included angle; and then, the position of the vehicle door handle in the rearview mirror image is judged according to the sight line of the driver, and secondary adjustment is performed on the rearview mirror according to the position information, so that automatic and accurate matching of the rearview mirror angle and the view field requirement of the driver is realized, and improvement of the adjustment efficiency and the driving safety is facilitated. The method can be widely applied to the technical field of vehicles.

A device, system and methodology for horizontal gaze nystagmus (HGN) testing. Prior to a test subject taking an action that is verboten in an impaired state, such as driving a vehicle or operating complex or dangerous machinery, the test subject is positioned within a face recognition box of a screen and a HGN simulation test performed, capturing HGN eye movements of the test subject from which the present HGN physiological state of the test subject is determined. The present HGN physiological state of the test subject is compared to a reference HGN state to determine whether the test subject is impaired. Impairment causes temporary restriction of the functionality of the machinery or vehicle.

The invention provides an image-based ophthalmology robot control method, system and device and a medium, and the method comprises the steps: obtaining an intraoperative three-dimensional OCT image sequence and a visual evoked potential signal, and segmenting an optic nerve region to generate an optic nerve space model; performing dynamic registration on the optic nerve space model and the visual evoked potential signal according to an eyeball motion compensation algorithm to generate a fusion data volume; calculating a visual function injury risk coefficient and a postoperative vision recovery predicted value through a pre-trained neural network prediction model based on the fusion data body and the real-time operation parameters of the robot end instrument; and dynamically generating a robot operation correction control instruction according to the injury risk coefficient and the postoperative vision recovery predicted value. By adopting the method, the individualized precision of an operation scheme and the postoperative visual function protection effect can be improved.

A virtual eye test can be conducted to evaluate visual acuity and perception in a virtual reality (VR) environment. The test can be conducted using an electronic device that includes a head-mounted display (HMD) and a camera. The electronic device can generate a VR user interface corresponding to photorealistic virtual environment and render the VR user interface on the HMD. The electronic device can simulate one or more real-world scenarios and while simulating the one or more real-world scenarios, in real time, track eye movements and responses from the wearer for testing visual acuity and perception of the wearer.

The invention discloses a method and system for preventing screen information leakage based on UWB positioning, relates to the field of smart screens, and aims to capture facial features, eyeball movement and other information of an observer carrying shooting equipment in front of a screen in real time by combining a UWB positioning technology and a high-speed camera, and identify whether the observer is a legal user or not through a deep learning algorithm. For an unauthorized observer, the system can generate false information which is similar to the screen content but has no practical significance in real time to replace the display content of the sensitive area. According to the dynamic replacement technology, illegal observers cannot obtain effective information without affecting legal user experience, further, an attention tracking algorithm is introduced, the sight focus of the observers is predicted, only areas which are possibly concerned are protected, and therefore the calculation load is reduced.

The invention provides an iris collection method and device based on eye movement prediction, equipment and a storage medium, and the method comprises the steps: collecting image frames and event streams in a mixed manner through an event camera and an RGB camera, obtaining eye feature point coordinates through key point detection, and converting the event streams into an event frame sequence; performing spatial-temporal feature extraction and filtering processing on the eye feature point coordinates and the event frame sequence by using a time sequence prediction network, and predicting eyeball positions and gazing directions at future moments; calculating the optimal optical axis direction of iris imaging according to the predicted eyeball position and gazing direction, and converting the optimal optical axis direction into control parameters such as a pan-tilt angle and a lens focal length of an imaging system; and synchronously adjusting the imaging system and triggering acquisition when the prediction time arrives. According to the method, active iris tracking acquisition is realized by predicting the eyeball movement track, the problem of response lag of traditional passive tracking is solved, and the success rate of iris acquisition is improved.

The application provides an image registration data processing method and system, relates to the technical field of image registration, and obtains a plurality of structural feature images in a plurality of monochrome laser images; according to the plurality of structural feature images, a plurality of ghosting areas with excessive eye movement are obtained, each of the ghosting areas includes a corresponding ghosting floating image and a ghosting reference image; a feature point corresponding relationship is obtained; a plurality of feature point pairs with accuracy greater than a preset threshold are obtained, feature point matching processing is performed, and a processed ghosting floating image is obtained; pixel registration processing is performed, and a region registration image is obtained; a plurality of region registration images are aligned and fused, a reference image and a floating image are combined, and a registration image is obtained. The application solves the technical problems of the prior art, such as inconsistent image offset in the image acquisition process, low whole-image registration accuracy, and the like, and achieves the technical effects of correcting the partial image offset caused by patient eye movement and improving real-time registration accuracy.

The described voting system comprises two main components: an online verification device and an offline voting device. The verification device utilises a data interface to communicate with central databases for real-time voter verification, employing biometric sensors to ensure accurate voter identification and prevent duplicate voting. This system enhances security by generating a unique verification code for each verified voter. The offline voting device, designed to be immune to network-based threats, uses this code along with biometric verification to authenticate voters. It features a user interface that employs eye gesture technology, allowing voters to select candidates privately and securely through eye movements, without any visible indication of their choices to onlookers. This setup not only protects the integrity of the vote from cyber threats but also safeguards voter privacy and reduces the potential for voter intimidation, for a free, fair, and secure voting process.

The invention provides an endoscope sharing control method based on a human body signal and a game theory, and belongs to the field of medical instruments, and the endoscope sharing control method comprises the following steps: obtaining eyeball movement data; based on the eyeball movement data, determining eye movement control position data used for representing a manual control intention through gaze thermodynamic diagram analysis; based on the eyeball movement data, through quantitative analysis of sight, eye opening degree and pupil size, obtaining reference indexes used for representing intention integrating degree and manual control burden; machine control position data used for representing the expected moving distance of the endoscope are obtained by analyzing the position relation between a target object and the endoscope in an endoscope image, and the endoscope image is collected in real time through the endoscope; based on the machine control position data, the eye movement control position data and the reference index, determining shared control position data through a cooperative game strategy; movement of the endoscope is controlled based on the shared control position data.

The invention discloses an AI glasses real-time cooperation system and method based on user intention prediction, relates to the technical field of education scene computer vision, and proposes the following scheme: obtaining a classroom panoramic image, and collecting a user head steering angle and an eyeball fixation coordinate sequence at the same time; the method comprises the following steps: segmenting a classroom panoramic image into different functional areas through semantic segmentation, distributing differentiated illumination weights according to optical characteristics of the functional areas, calculating an eyeball motion vector based on an eyeball fixation coordinate sequence, and superposing the eyeball motion vector and a head steering angle to generate a future continuous multi-frame prediction view area. And dividing all the functional areas into uniform grids. According to the method, the functional area is divided into the uniform grids, the theoretical illumination value of the predicted visual field area is weighted and calculated based on the illumination weight of the functional area, the brightness weight distribution difference of the light environment area is quantified in the spatial dimension, the nonlinear illumination sequence conforming to the actual optical gradient is generated, and distortion mapping of a linear model to the transition gradient of the functional area is eliminated.

Eye tracking device and eye tracking assembly. The invention relates to an eye tracking device (1) adapted to track the eye movement (5) of a user, comprising: - a support structure (7) adapted to be mounted on the head (3) of a user, - a video data acquisition means, comprising a camera (17) adapted to acquire video of said eyes, - an infrared wave emission means, adapted to emit infrared waves in the direction of said user's eyes, - a data transfer means adapted to transfer said acquired data to a data processing device comprising a pupil detection algorithm. According to the invention, the device (1) includes an optical accessory attachment interface (35) adapted to receive at least one external optical accessory.The invention also relates to an assembly for the acquisition of ocular data comprising such a device (1). Figure 3.

A head-mountable device renders a graphical user interface and causes user-interface changes responsive to facial expressions of a user. The device receives sensor data from user-facing sensor assemblies, including imaging of left and right eye regions, and eye-tracking data indicative of eye movement. The device derives eye-openness data for each eye from the sensor data, including measurements based on eyelid geometry. In response to a facial expression, the device causes a user-interface change that is conditional, at least in part, on the eye-tracking data and the eye-openness data. Facial expressions may include winking, blinking, and squinting. In some embodiments, the device determines an amplitude and / or duration of the facial expression and varies a magnitude or speed of the user-interface change based on the determined parameter(s), enabling text entry, selection, navigation, and manipulation of displayed objects and applications.

A virtual vision test can be performed to evaluate response time in detecting subtle visual changes under varying light conditions in a virtual reality (VR) environment. The test can be conducted using an electronic device with a head-mounted display (HMD) and a camera. The device can generate and render a VR user interface in a photorealistic virtual environment, simulating dynamic lighting scenarios. The device can continuously track eye movements in response to visual stimuli presented in these scenarios. The system can then evaluate the detection of subtle visual changes based on the tracked eye movements, and provide a comprehensive assessment of visual acuity and responsiveness under different lighting conditions.

A communication robot includes an auditory information processing portion configured to recognize a volume of voice collected by a sound collection portion and generate an auditory attention map by projecting a sound position in a three-dimensional space onto a two-dimensional attention map in which the robot is located at a center, a visual information processing portion configured to generate a visual attention map using a face detection result obtained by detecting a face of a person from an image captured by an imaging portion and a motion detection result obtained by detecting a motion of the person, an attention map generation portion configured to generate an attention map by integrating the auditory attention map and the visual attention map, and a motion processing portion configured to control eyeball movements and motions of the communication robot using the attention map.

The invention relates to the technical field of bionic robot motion control systems, in particular to a neck-eye cooperative control method and system based on binocular vision, and the method comprises the steps: obtaining the position information of a target in a three-dimensional space, and calculating the offset state of the target in an eyeball coordinate system; acquiring rotation angles of eyeballs, rotation angles of the neck and motion parameters of the head; fusing the data; based on the fused system state information, whether a neck-eye cooperation mode is triggered or not is judged according to a preset comfort region judgment rule, when the neck-eye cooperation mode is triggered, the amount of motion of eyeballs and the neck is dynamically allocated according to the offset state, and a trajectory planning algorithm is adopted to generate a cooperative motion trajectory of the eyeballs and the neck; generating an eyeball motion control instruction and a neck motion control instruction according to the cooperative motion track, and driving an execution mechanism to move so as to track the target; according to the method, the technical contradiction that a traditional method cannot consider large range, high continuity and high adaptability at the same time is solved.

A method includes receiving, by a processor, a video of an illuminated face. Video frames in the video are associated with different time instants of a time series, respectively. The method includes determining a region of interest (ROI) that includes a closed eye on the face based on at least one frame in a plurality of video frames in the video. The method includes slicing each ROI based on slice parameters for selecting a vertical slice that includes a eye centroid of the closed eye, and selecting a horizontal slice that intersects the vertical slice at a pivot (P) located lp pixels from the eye centroid. The method includes determining an eyeball motion signal according to the time series, based on a measured value of a shadow intensity of the eye within at least one of the vertical slice or the horizontal slice at each of the different time instants.

The invention belongs to the technical field of eye vision optics, and relates to a scanning type human eye peripheral aberration measuring system and method based on wavefront sensing. The system comprises a measuring light path, an off-axis scanning structure, a full meridian scanning structure, an echo light beam restraining and folding lens group, a conjugate adjusting structure, a sighting mark module, an aligning and imaging module and a control and communication system. The off-axis scanning structure comprises a galvanometer and a linear displacement mechanism, and through the linkage of the position and the angle of the galvanometer, the incident main light enters the entrance pupil center of the detected eye at different off-axis angles; in the full meridian scanning structure, a rotating table drives a front structure to rotate around a system main shaft; echo beams enter a rear fixed light path through the center of the rotary table via the reflector. According to the system, full meridian, large off-axis angle and programmable path human eye peripheral aberration measurement can be realized under the condition that the head and eyeballs of a subject do not need to move, and the system has the advantages of compact structure, small additional aberration, high measurement precision and efficiency and the like.

A virtual eye test for evaluating dynamic visual acuity can be conducted in a virtual reality (VR) environment. The test utilizes an electronic device equipped with a head-mounted display (HMD) and a camera. The device generates a VR user interface corresponding to a three-dimensional virtual environment and renders it on the HMD. Real-world motion and target recognition visual tasks are simulated within the VR interface. Using the camera, the device tracks eye movements and response times to visual stimuli presented during these tasks. Dynamic visual acuity is measured based on the tracked eye movements and response times, providing a comprehensive assessment of visual performance in motion-based scenarios.

The invention provides an image display method and device and an eyeball tracker detection system. The method comprises the following steps: acquiring current three-dimensional data and historical three-dimensional data when an eyeball tracker tracks and simulates eyeball movement; determining a rotation angle of the current three-dimensional data according to the current three-dimensional data and the historical three-dimensional data; rotating the current three-dimensional data according to the rotation angle; mapping the rotated current three-dimensional data into current two-dimensional data; and displaying the current two-dimensional data in the display area. According to the method, the rotation angle of the current three-dimensional data is determined through the current three-dimensional data and the historical three-dimensional data, the current three-dimensional data is rotated, the rotated three-dimensional data is mapped into the current two-dimensional data and is displayed, and error data and eyeball movement data can be displayed in a combined manner; therefore, a user can intuitively connect the distribution rule of the error data along with the change of the sight direction.

Embodiments of the present application provide a webpage translation method, an electronic device, a storage medium and a program product, relating to the technical field of computer, and the method comprises: determining a target display area where a user gazes according to eye movement information of the user, wherein the target display area is used to display a target content block of a target webpage; identifying a source object node corresponding to the target content block from an object node tree of the target webpage, wherein the object node tree is obtained by analyzing a source code file of the target webpage; parsing the source object node to obtain source language information in the target content block; and displaying target language information corresponding to the source language information in the target display area. The translation method can ensure accurate extraction of translated content in the webpage translation scene of dynamic and complex layout, thereby improving translation accuracy and translation speed.

A method for detecting content of interest to a user includes obtaining a first data stream indicative of eye movement and / or gaze direction of the user as the user is viewing a scene in a field of view of the user, obtaining a second data stream indicative of visual content in the field of view of the user, determining, based on the first data stream and the second data stream, that content of interest to the user is present in the scene in the field of view of the user, and, in response to determining that content of interest to the user is present in the scene in the field of view of the user, triggering, with the processor, an operation to be performed with respect to the scene in the field of view of the user.

The invention relates to a method for displaying visual display contents to a vehicle occupant by means of at least one vehicle-mounted display device for which an associated maximum eyebox window is specified from which the entire display region of the display is visible to said occupant; the method comprising the steps of: - dynamically capturing a current seat and / or eye position of the occupant; - based on this, dynamically detecting whether and how their eyes move in a predetermined eyebox transition region which lies within the eyebox window of a display device currently used by them or adjoins same in such a way that a part of its specified display region is still visible to them; and - changing the display of the display device, in a manner synchronised with the dynamically detected eye movement of the occupant in the eyebox transition region of the respective display device, such that the occupant's leaving the eyebox window, and the movement direction that led to this, is intuitively indicated and / or explicitly displayed to the occupant.