218 results about "Eyeball movements" patented technology

The invention discloses an ophthalmologic operation real-time navigation system and method based on dynamic visual field tracking, and relates to the technical field of medical systems. Comprising the following steps: matching operation data closest to a current operation from a database, and generating standard operation navigation of the current operation; the real-time image of the operation process is compared with the image of the standard operation navigation in real time, the step of the current operation is determined, and meanwhile subsequent image navigation of the operation of the patient is displayed; generating a spatial mapping matrix between an eyeball movement track and a target region by combining target region boundary data of preoperative OCT image segmentation and an intra-operative navigation coordinate system; the virtual navigation path of the surgical instrument is dynamically corrected according to the real-time eyeball movement track, so that the surgical instrument is aligned with the target area, the spatial relation between the instrument and the target area can be visually mastered through the overlapping display of the three-dimensional virtual path and the real-time image, unconscious displacement or physiological tremor of a patient in an operation is actively adapted, and the operation accuracy is improved. And the continuous accuracy of the navigation path is ensured.

The invention discloses an intelligent head-mounted device with a camera capable of rotating along with the camera, and the device comprises an eye movement tracking camera which is used for collecting and measuring the image data of the iris of the two eyes of a wearer; the IMU sensor is used for detecting head movement data of a wearer; the image acquisition and processing module is used for generating eyeball movement data according to the image data of the iris of the two eyes, and converting the eyeball movement data and the head movement data into a rotation instruction; the binocular camera motion control device executes the rotation instruction, drives the binocular camera to move, moves along with the iris and the eyeball, and collects image data in real time to realize line-of-sight tracking; and the image acquisition and processing module is also used for carrying out image and / or video fusion processing according to the received image acquired by the binocular camera in combination with the head movement data and the eyeball movement data. According to the invention, the problem of limitation in the aspects of acquiring depth information and expanding the visual field can be solved, and a more flexible camera tracking and adjusting mechanism is designed, so that wider and clearer image acquisition is realized.

The invention discloses an intelligent glasses image adjusting system based on eye movement tracking and gesture fusion, and relates to the technical field of intelligent equipment. A multi-modal sensing module is arranged to construct a multi-modal sensing layer to capture eyeball movement tracks and gesture actions; a fixation point prediction module is set to process a dynamic scene through a space-time attention mechanism to obtain a fixation point prediction area, a gesture semantic understanding module is set to process gesture actions based on a Transform architecture, and the gesture actions of a user are converted into image adjustment instructions. An image enhancement strategy setting module designs a multi-stage image enhancement strategy according to the fixation point prediction area and the image adjustment instruction, and sets a dynamic adjustment intensity control module to perform adaptive adjustment to obtain a dynamic adjustment intensity control result; an eye movement-gesture cooperative control module is arranged to provide an eye movement-gesture cooperative control mechanism to realize image area selection and parameter adjustment, and accurate image area selection and parameter adjustment are realized.

The invention discloses a naked-eye 3D display optimization method based on real-time eyeball tracking, and particularly relates to the technical field of naked-eye 3D display, and the method comprises the steps: capturing eyeball movement data in real time through a visual angle tracking sensor, and collecting illumination information in combination with an ambient light sensor; depth perception parameters are calculated based on pupil diameter variation and frequency, and a time sequence prediction type dynamic compensation coefficient is generated in combination with eyeball movement acceleration; acquiring an initial fixation point coordinate by using an improved spherical projection mapping model, and performing compensation coefficient correction to obtain a real-time coordinate; and finally, according to the real-time coordinates, dynamically adjusting the refractive index distribution of the nanostructure layer, the rotation angle of the polarizer, the focal length of the optical lens and other optical modulation parameters. The real-time distance is calculated through the binocular parallax algorithm, the depth mapping value is generated by combining the focal length of the camera and the baseline distance, the method can adapt to the illumination change and the user view angle, and the 3D display effect is optimized.

The invention relates to a child attention evaluation and training method and system, and the method comprises the steps: obtaining a brain wave mode, an eyeball movement track, an emotion activation level and autonomic nervous system function data of a child in real time, and generating multi-dimensional biological signal data; based on the multi-dimensional biological signal data, generating evaluation task data; generating dynamic task parameters according to biological signal data and behavior performance data in the evaluation task data; generating an attention feedback signal based on the dynamic task parameters; according to the attention feedback signal, a training task integrating work memory, suppression control and cognitive flexibility is constructed, and cognitive function training data is generated; and based on the cognitive function training data, synchronously sharing the attention performance data of the children to the parent terminal and the teacher terminal, generating life situation intervention suggestions, and iteratively optimizing evaluation parameters according to a long-term effect evaluation result. Therefore, the accuracy of children attention evaluation and training can be improved.

The invention discloses a multi-effect ultrastructure composite lens for preventing and delaying myopia, which comprises a lens main body, a functional area is arranged in the lens main body, and the functional area comprises a central optical correction area and an ultrastructure area which are arranged on the inner side. Compared with the prior art, the method has the advantages that the small central optical area is adopted to correct vision, and the prevention and control effect is enhanced. The ultramicro soft light area has prevention and control and visual transition effects. The ultra-micro lenses and the ultra-micro structure ring cylindrical lenses are alternately arranged on the outer side, due to the fact that the area is reduced, the number of the ultra-micro structures in the unit area is increased, the filling rate of the functional area of the whole lens is increased, the ultra-micro structures enable the brain to be not easy to perceive, visual perception is not easy to interfere, and the three ultra-micro structures have the effect of improving visual activity along with eyeball movement of visual activity. Signals entering the eyes are kept in dynamic change all the time, so that the visual experience is further improved while the prevention and control effect and imaging intervention are guaranteed, and long-term wearing is facilitated.

The invention discloses an intelligent cognitive assessment method and system based on a virtual reality environment. According to the method, through accurate eye movement calibration and electroencephalogram calibration, resting-state electroencephalogram information, digital cognitive evaluation task parameters and eyeball movement track parameters of a subject in a virtual reality environment are collected, and through professional preprocessing and feature extraction, deep analysis and fusion are conducted on data through a common-attention multi-mode feature noise reduction fusion model. Through training and prediction of the neural network model, the cognitive function state of the subject can be effectively evaluated, the accuracy and efficiency of cognitive evaluation are improved, and meanwhile, the user experience is optimized. By utilizing the method, early recognition of cognitive impairment is facilitated, a scientific basis is provided for clinical diagnosis and intervention, and the method is of great significance in preventing and delaying dementia of old people.

The invention provides a community open space psychological recovery effect assessment method and system based on multi-modal perception. The method comprises the following steps: acquiring a physiological signal, a movement track, eyeball movement data and a panoramic image of a user; analyzing the image, extracting environmental element space distribution parameters, and calculating an environmental information entropy value; according to the physiological signal, calculating physiological stress deviation as a first type of error, analyzing the matching degree of a moving track and an environment structure as a second type of error, and combining eye movement characteristics and visual attraction distribution to calculate attention deviation as a third type of error; inputting the three types of errors and entropy values into an evaluation model, and outputting a recovery efficiency index and a multi-dimensional index representing error mitigation; and associating the environment parameters with the multi-dimensional indexes, explaining and extracting an environment intervention critical value and a recovery effect function, and generating a space optimization evaluation report in combination with dynamic indexes. According to the method, quantitative evaluation and accurate optimization decision support of the psychological recovery effect of the open space of the community are realized.

The invention provides switchable test equipment, a switchable test method, electronic equipment, a storage medium and a program product, and belongs to the technical field of visual equipment. The switchable test equipment comprises a simulated eyeball, a motion controller, a first driving assembly, a second driving assembly and at least one test device installed on the simulated eyeball. The motion controller is connected with the first motion driving assembly and the second driving assembly, and the first motion driving assembly and the second driving assembly are connected with the simulated eyeball; the motion controller is used for controlling the first motion driving assembly and the second driving assembly according to test requirements so as to drive the simulated eyeball and the test device to rotate synchronously until the target test device is switched to a test position; wherein the target test device is one of the at least one test device. According to the technical scheme, the test device can be rotated to the test position under the condition that eyeball rotation is simulated, and integration of test functions on one device is achieved.

The invention relates to the technical field of deep learning, and discloses an eyeball tracking method and device and electronic equipment, and the method comprises the steps: obtaining an eye image data set of a user, inputting the eye image data set into a preset deep learning model, determining the eyeball position information and the eyeball movement mode of the user, based on the eyeball position information and the eyeball movement mode, the intelligent robot is controlled to perform eye interaction with the user, and eye recognition and dynamic position real-time tracking can be accurately performed through a preset deep learning model.

The invention discloses a vision correction method based on VR eyeball following movement, and relates to the field of vision and vision correction, in particular to a method for correcting vision through eyeball following movement of a human body based on a VR technology, a glasses tool, corollary equipment and an application method. Comprising the steps of training acquisition, training video selection, following judgment, video adjustment and the like, the following condition of the eyeball can be evaluated more accurately by calculating the angle difference and the eyeball movement following degree, and the problems that misjudgment possibly exists in a traditional method and the training effect is poor due to the fact that the eyeball cannot follow are solved. According to the technology, the parameters of the training video can be dynamically adjusted according to real-time feedback of the eyeball following degree, and the vision correction effect is improved; by means of the VR technology, tools, equipment and other methods, eyeballs move along with the VR technology, tools, equipment and the like, and the vision of people is improved and corrected; therefore, extraocular muscles are trained to drive eyeballs to move, eyeball crystalline lenses move back and forth along with the video, and the effect of improving the naked eye vision is achieved.

The invention relates to the technical field of augmented reality glasses optical correction, and specifically provides an eye movement distortion detection method. The method comprises the following steps: acquiring an AR glasses playing image and identifying a visual saliency region to establish an attention priority order; detecting an eyeball movement track direction vector and an instantaneous speed in real time; determining a predicted attention target according to the motion direction and the attention priority; generating a distortion correction parameter set in combination with eyeball arrival time and spatial distribution information; performing pre-distortion compensation rendering on the candidate area in a pre-generation period before eyeballs reach the actual attention area to form a pre-corrected image buffer area; and finally, outputting a pre-corrected image matched with the actual stay area. Space-time synchronization of eyeball movement and image compensation is achieved through predictive rendering, the image distortion and color separation phenomena in the glancing process are eliminated while the low-delay characteristic is maintained, and the visual definition and comfort in a dynamic scene are remarkably improved.

The invention provides an application of WNT7B in construction of a myopia animal model. Homologous genes wnt7ba and wnt7bb of the WNT7B in the zebra fish are knocked out or knocked down by applying a CRISPR / Cas9 gene editing technology, an animal model of which the eye axis length is remarkably increased, the eyeball movement frequency is remarkably reduced and the light response is reduced is obtained, and the result shows that the WNT7B is related to the high myopia. The model provides a favorable tool for pathogenesis and drug screening of high myopia, and has a good application prospect.

The present invention discloses a method for intervening in the subjective feeling of motion sickness in virtual reality based on perceptual theory, which relates to the technical field of virtual reality. The method comprises: acquiring proprioception parameter information of a current user, wherein the proprioception parameter information includes but is not limited to head movement data, eye movement data, and physiological data; performing real-time analysis on the currently acquired data using a data analysis algorithm to determine whether the user has early signs of motion sickness; determining, by the data analysis algorithm, that the user has early signs of motion sickness, and immediately initiating a visual perception adjustment step. Furthermore, by real-time capturing and analyzing the user's physiological signals in a virtual reality experience, it is possible to identify and intervene in the early stages of motion sickness, and to formulate an intervention method in a timely manner for users who have subjective feelings of motion sickness, thereby facilitating rapid relief of user discomfort.

The invention discloses a near-infrared contact lens for eye movement tracking and a preparation method, the contact lens comprises a contact lens layer, a processing circuit module, a wireless power supply coil, a near-infrared LED lamp and a photoelectric detector, the photoelectric detector is adjacent to the near-infrared LED lamp, the near-infrared LED lamp is used for emitting near-infrared light to the fundus, and the processing circuit module is used for processing the near-infrared light. The photoelectric detector is used for receiving near-infrared light reflected back from the fundus and detecting the movement direction and angle of the eyeball in real time by comparing irradiation values of the photoelectric detector, and the processing circuit module is connected with the photoelectric detector and used for comparing the difference of the irradiation values of the near-infrared light received by the photoelectric detector and determining the movement direction and angle of the eyeball. And the wireless power supply coil is directly connected with the processing circuit module and is used for wirelessly supplying power to the processing circuit module and the near-infrared LED lamp. According to the near-infrared contact lens, infrared waves generated by the near-infrared LED lamp avoid the visible range of human eyes, and meanwhile, all modules of the near-infrared contact lens are distributed around the contact lens, so that the daily life of a user is not influenced.

To provide a vertigo diagnostic device which automatically removes noise, such as eye blinking and the like, and tracks and quantifies purely eyeball movement so as to allow doctors to use the values in diagnosis.SOLUTION: The present invention relates to: a technique for tracking changes in eyeballs and a head position to diagnose vertigo, and more specifically, a vertigo diagnostic device and method using a deep learning model for tracking movement of the eyeball and the head of a patient from a video including a patient to diagnose vertigo on the basis of a deep learning model, and also relates to; a recording medium storing a program for achieving the vertigo diagnosis; and the computer program stored in the recording medium.SELECTED DRAWING: Figure 1

The invention discloses a center positioning system and method for a femtosecond laser ophthalmic corneal refraction operation, and relates to the technical field of image processing. The method comprises the following steps of S1, performing multi-source data synchronous acquisition on eyeballs of a patient before an operation; s2, fusing and preprocessing the collected multi-source data; s3, establishing an eyeball dynamics method, outputting six-degree-of-freedom position data in real time, and predicting the position of a laser action point; s4, dynamically adjusting the dual coordinate system according to the cornea; s5, constructing a real-time feedback system, and realizing closed-loop control, safety boundary control and a fault-tolerant mechanism; and S6, generating parameters of an operation process, constructing a four-dimensional cutting model, and performing path planning of the laser model. According to the method, the OCT, the Placido ring and the iris vein composite features are combined, the positioning precision is improved, Kalman filtering and neural network prediction compensation are utilized, eyeball movement is tracked in real time, and the accuracy of operation pupil positioning is improved.

The invention belongs to the field of visual training, and particularly relates to a multispectral dynamic visual function training system and method. The multispectral dynamic visual function training system comprises an image acquisition module, an intelligent analysis module, a control module, a training execution module and a multispectral light source module, the image acquisition module is arranged at a position corresponding to an eye and is used for acquiring image information near eyeballs of a user, personal information of the user and a vision diagnosis result in real time, and the image information comprises eyeball movement tracks, pupil sizes and forms, cornea edge contours and eye white elastic states; and the intelligent analysis module combines the image information and the acquisition time of the image information. According to the scheme, through collection, analysis, regulation and control of a closed loop, the problems that in the prior art, a real-time analysis mechanism based on eyeball images is lacked, the adaptability of a training scheme and eye dynamic characteristics is weak, and precise regulation and control of functions such as light nutrition supplement and choroid stimulation cannot be achieved are solved; and precise training is also realized, and the effects of prevention and protection, cooperative improvement, compliance improvement and the like are achieved.

The invention relates to the field of medical instruments, and provides a cannula pose recognition method and system based on binocular vision, and the method comprises the steps: firstly, building a binocular camera system with a shooting range covering eyeballs, collecting a group of binocular images, and respectively recognizing cannulas and cannula holes in the two images; then, a disparity map is generated based on the casing pipe and the casing pipe hole in the two images, the disparity map is converted into a depth map in combination with the internal reference of the binocular camera system, and the boundary point cloud of the casing pipe hole is obtained; and finally, determining a fitting plane of the casing position and the casing hole according to the boundary point cloud, and taking a normal vector as a casing posture. According to the method, the operation complexity of aligning the instrument to the cannula in the robot-assisted surgery can be reduced, additional arrangement of a marker is not needed, the precision and speed of cannula pose recognition are effectively improved, eyeball movement is directly recognized through cannula pose changes, the compensation effect of eyeball movement is enhanced, and the safety of the robot-assisted surgery is improved.

The invention relates to the technical field of ophthalmology medical information systems, in particular to a child vision screening and tracking system and method based on computer vision, and the system comprises an eyeball movement analysis module which is used for collecting and analyzing eyeball movement data; the AR test module is used for carrying out eyeball movement enhancement and vision test; the vision development prediction module is used for predicting the vision development trend; the vision knowledge base is used for providing professional knowledge support; the intelligent assistant module is used for providing personalized suggestions; the system background is used for realizing data uploading and statistical analysis; according to the invention, a comprehensive and intelligent children vision health management platform is constructed. By integrating advanced technologies such as computer vision, augmented reality, artificial intelligence and the like, the system realizes full-process automation from data acquisition, analysis and processing to prediction and suggestion. The efficiency and accuracy of vision screening are greatly improved, and powerful technical support is provided for long-term management of vision health of children.

The invention provides an early warning method for an abnormal driving state of a driver and related equipment, and is applied to the technical field of vehicle safety auxiliary driving, and the method comprises the steps: obtaining the eyeball movement information of the driver collected by a calibrated eyeball tracking sensor, processing the eyeball movement information through a plurality of detection models, and obtaining an abnormal driving state of the driver; a plurality of state detection results are obtained, an abnormal driving detection strategy is applied to process eyeball operation information, and a fatigue detection result and an attention distraction detection result are obtained; and according to the fatigue detection result, the attention distraction detection result and the plurality of state detection results, determining whether to carry out abnormal driving state early warning reminding. The eyeball movement information, collected by the eyeball tracking sensor, of the driver is processed through multiple modes such as the detection model and the abnormal driving detection strategy, multiple modes of detection results are obtained, driving state detection is comprehensively carried out, the abnormal driving state of the driver is detected in time, and early warning is carried out in time.

The invention discloses a virtual reality motion sickness subjective feeling intervention method based on a perception theory, and relates to the technical field of virtual reality, and the method comprises the steps: collecting current user body feeling parameter information, the body feeling parameter information comprises but is not limited to head motion data, eyeball motion data and physiological data; performing real-time analysis on the currently acquired data by using a data analysis algorithm, and judging whether the user has early data of motion sickness or not; an early sign of motion sickness of a user is judged through a data analysis algorithm, a visual perception adjustment step is started immediately, and then a physiological signal of the user is captured and analyzed in real time in virtual reality experience, so that the motion sickness can be recognized and intervened in time in the early stage of motion sickness; an intervention method can be timely formulated for a user who generates subjective feeling of motion sickness, and discomfort of the user can be quickly relieved.

According to an aspect of the present invention, there is provided a computer graphics processing and selective visual display system, comprising: a computer graphics processing and selective visual display system with a screen; an eye tracking device; a processor; one or more computer memory devices; wherein the processor is arranged for operations comprising: measuring the user's eye movements to ascertain the specific word on which the user is fixated, by the eye tracking device; modifying the display at the user's current fixation point; applying a delay between the presentation of successive graphic elements based on the user's calculated rate to accommodate the user's required time; and presenting elements to the user at a rate based upon the user's required time.

Aspects of the disclosure relate to processing images and identifying features in the images. Images of a user captured using a camera are processed to enhance subsequent analysis. A face is located in the images using Haar cascades, a Histogram of Oriented Gradients, a Viola-Jones framework, and / or a first deep learning algorithm. An eye in the face is located using a plurality of located facial landmarks and / or a convolutional neural network. Movements of the eye in the images is determined. Eye jerking in the images is detected using the determined eye movements. A distance of the detected eye jerking of the eye and how long the detected eye jerking lasted is determined and used to generate an indicator. At least partly in response to the indicator, messages are generated and transmitted to electronic destinations.

A system includes a first camera located within a cockpit of an aircraft to track the eye movement of at least one pilot, and a second camera to track an ambient light source. The system includes an electrochromic panel having an array of dimmable cells. The system further includes a controller, equipped with one or more processors responsible for modifying the array of dimmable cells. The controller receives eye tracking data from the first camera associated with a gaze target of the pilot, and light tracking data from the second camera, which includes parameters associated with the ambient light source. Based on the eye tracking and light tracking data, the controller determines a glare location on a surface of the electrochromic panel where the gaze target intersects. The controller may then selectively modify a tint level of specific dimmable cells in the panel to address the determined glare location.

The invention discloses a mixed reality eye movement interaction system and method based on dense map semantic segmentation, and relates to the field of man-machine interaction, and the system comprises a head-mounted device which integrates a communication module, a mixed reality display module, an eye movement tracking module and a three-dimensional environment perception module. The three-dimensional environment perception module obtains images and depth data of the surrounding environment and carries out three-dimensional reconstruction to obtain a dense map, the dense map is divided into different blocks, and semantic information of the blocks is marked; the eye movement tracking module emits rays to the dense map in the gazing direction, and a gazing target is determined according to the real object information of the collision point position of the rays and the dense map; the communication module communicates with the real object of the watching target according to the watching target and the label of the real object information; and the eye movement tracking module obtains a control instruction according to the eyeball movement and a preset control rule, and sends the control instruction to a real object watching the target. The problem that the immersion feeling is insufficient due to the fact that natural eye movement interaction with a real object cannot be carried out in an existing mixed reality scene is solved.

The invention discloses a visual function detection method and system based on a 3D visual imaging technology, and the method comprises the steps: obtaining three-dimensional visual imaging data, carrying out the modeling and rendering of the illumination, texture and geometric structure in a visual environment, and constructing a virtual scene model which is highly similar to a real scene; acquiring eyeball movement characteristics and pupil change data of the user, analyzing visual characteristics of the user according to the data, and adaptively designing a personalized visual stimulation mode matched with the visual characteristics; and processing captured eyeball image data by using a deep learning algorithm, extracting features of the eyeball image through a convolutional neural network, and modeling the eyeball motion trajectory by using a long-short-term memory network, thereby realizing recognition and prediction of the eyeball motion mode. According to the method, the visual behaviors of the user are accurately captured and analyzed through multi-dimensional data fusion and intelligent algorithm analysis, and an effective means is provided for timely discovering potential visual function abnormalities.

To provide a balance function management system for balance function state information generation and a balance function rehabilitation program.SOLUTION: A memory configured to store at least one processor and at least one artificial neural network model that stores instructions executable by the processor and is executed on a computing device, wherein the at least one processor is configured to input frame images of n (where n is a natural number) videos obtained by photographing a subject through n cameras to the at least one artificial neural network model, At least one of information related to the coordinates of the head, the coordinates of the center of the pupil, and the phase change of the eyeball of the subject according to the order of the frame images of the m-th (m is a natural number from 1 to n) moving image may be acquired, and information related to the movement of the head and the movement of the eyeball for generating the balance state information or performing the balance rehabilitation program may be generated using the acquired information.SELECTED DRAWING: Figure 1

The invention discloses a vehicle rearview mirror adjusting method and device, equipment and a storage medium, and aims to solve the problem that an electric rearview mirror needs to be manually and repeatedly adjusted and cannot quickly adapt to sight lines and postures of different drivers in the prior art. Whether the driver is observing the rearview mirror or not is judged by collecting the eyeball movement track and the head posture data of the driver; after the observation behavior is determined, the included angle between the sight line and the mirror surface is further detected, and the rearview mirror is adjusted for the first time according to the included angle; and then, the position of the vehicle door handle in the rearview mirror image is judged according to the sight line of the driver, and secondary adjustment is performed on the rearview mirror according to the position information, so that automatic and accurate matching of the rearview mirror angle and the view field requirement of the driver is realized, and improvement of the adjustment efficiency and the driving safety is facilitated. The method can be widely applied to the technical field of vehicles.

A device, system and methodology for horizontal gaze nystagmus (HGN) testing. Prior to a test subject taking an action that is verboten in an impaired state, such as driving a vehicle or operating complex or dangerous machinery, the test subject is positioned within a face recognition box of a screen and a HGN simulation test performed, capturing HGN eye movements of the test subject from which the present HGN physiological state of the test subject is determined. The present HGN physiological state of the test subject is compared to a reference HGN state to determine whether the test subject is impaired. Impairment causes temporary restriction of the functionality of the machinery or vehicle.