185 results about "Eyeball movements" patented technology

The invention discloses an intelligent glasses image adjusting system based on eye movement tracking and gesture fusion, and relates to the technical field of intelligent equipment. A multi-modal sensing module is arranged to construct a multi-modal sensing layer to capture eyeball movement tracks and gesture actions; a fixation point prediction module is set to process a dynamic scene through a space-time attention mechanism to obtain a fixation point prediction area, a gesture semantic understanding module is set to process gesture actions based on a Transform architecture, and the gesture actions of a user are converted into image adjustment instructions. An image enhancement strategy setting module designs a multi-stage image enhancement strategy according to the fixation point prediction area and the image adjustment instruction, and sets a dynamic adjustment intensity control module to perform adaptive adjustment to obtain a dynamic adjustment intensity control result; an eye movement-gesture cooperative control module is arranged to provide an eye movement-gesture cooperative control mechanism to realize image area selection and parameter adjustment, and accurate image area selection and parameter adjustment are realized.

The invention discloses a naked-eye 3D display optimization method based on real-time eyeball tracking, and particularly relates to the technical field of naked-eye 3D display, and the method comprises the steps: capturing eyeball movement data in real time through a visual angle tracking sensor, and collecting illumination information in combination with an ambient light sensor; depth perception parameters are calculated based on pupil diameter variation and frequency, and a time sequence prediction type dynamic compensation coefficient is generated in combination with eyeball movement acceleration; acquiring an initial fixation point coordinate by using an improved spherical projection mapping model, and performing compensation coefficient correction to obtain a real-time coordinate; and finally, according to the real-time coordinates, dynamically adjusting the refractive index distribution of the nanostructure layer, the rotation angle of the polarizer, the focal length of the optical lens and other optical modulation parameters. The real-time distance is calculated through the binocular parallax algorithm, the depth mapping value is generated by combining the focal length of the camera and the baseline distance, the method can adapt to the illumination change and the user view angle, and the 3D display effect is optimized.

The invention relates to a child attention evaluation and training method and system, and the method comprises the steps: obtaining a brain wave mode, an eyeball movement track, an emotion activation level and autonomic nervous system function data of a child in real time, and generating multi-dimensional biological signal data; based on the multi-dimensional biological signal data, generating evaluation task data; generating dynamic task parameters according to biological signal data and behavior performance data in the evaluation task data; generating an attention feedback signal based on the dynamic task parameters; according to the attention feedback signal, a training task integrating work memory, suppression control and cognitive flexibility is constructed, and cognitive function training data is generated; and based on the cognitive function training data, synchronously sharing the attention performance data of the children to the parent terminal and the teacher terminal, generating life situation intervention suggestions, and iteratively optimizing evaluation parameters according to a long-term effect evaluation result. Therefore, the accuracy of children attention evaluation and training can be improved.

The invention discloses a multi-effect ultrastructure composite lens for preventing and delaying myopia, which comprises a lens main body, a functional area is arranged in the lens main body, and the functional area comprises a central optical correction area and an ultrastructure area which are arranged on the inner side. Compared with the prior art, the method has the advantages that the small central optical area is adopted to correct vision, and the prevention and control effect is enhanced. The ultramicro soft light area has prevention and control and visual transition effects. The ultra-micro lenses and the ultra-micro structure ring cylindrical lenses are alternately arranged on the outer side, due to the fact that the area is reduced, the number of the ultra-micro structures in the unit area is increased, the filling rate of the functional area of the whole lens is increased, the ultra-micro structures enable the brain to be not easy to perceive, visual perception is not easy to interfere, and the three ultra-micro structures have the effect of improving visual activity along with eyeball movement of visual activity. Signals entering the eyes are kept in dynamic change all the time, so that the visual experience is further improved while the prevention and control effect and imaging intervention are guaranteed, and long-term wearing is facilitated.

The invention discloses an intelligent cognitive assessment method and system based on a virtual reality environment. According to the method, through accurate eye movement calibration and electroencephalogram calibration, resting-state electroencephalogram information, digital cognitive evaluation task parameters and eyeball movement track parameters of a subject in a virtual reality environment are collected, and through professional preprocessing and feature extraction, deep analysis and fusion are conducted on data through a common-attention multi-mode feature noise reduction fusion model. Through training and prediction of the neural network model, the cognitive function state of the subject can be effectively evaluated, the accuracy and efficiency of cognitive evaluation are improved, and meanwhile, the user experience is optimized. By utilizing the method, early recognition of cognitive impairment is facilitated, a scientific basis is provided for clinical diagnosis and intervention, and the method is of great significance in preventing and delaying dementia of old people.

The invention provides a community open space psychological recovery effect assessment method and system based on multi-modal perception. The method comprises the following steps: acquiring a physiological signal, a movement track, eyeball movement data and a panoramic image of a user; analyzing the image, extracting environmental element space distribution parameters, and calculating an environmental information entropy value; according to the physiological signal, calculating physiological stress deviation as a first type of error, analyzing the matching degree of a moving track and an environment structure as a second type of error, and combining eye movement characteristics and visual attraction distribution to calculate attention deviation as a third type of error; inputting the three types of errors and entropy values into an evaluation model, and outputting a recovery efficiency index and a multi-dimensional index representing error mitigation; and associating the environment parameters with the multi-dimensional indexes, explaining and extracting an environment intervention critical value and a recovery effect function, and generating a space optimization evaluation report in combination with dynamic indexes. According to the method, quantitative evaluation and accurate optimization decision support of the psychological recovery effect of the open space of the community are realized.

The invention relates to the technical field of augmented reality glasses optical correction, and specifically provides an eye movement distortion detection method. The method comprises the following steps: acquiring an AR glasses playing image and identifying a visual saliency region to establish an attention priority order; detecting an eyeball movement track direction vector and an instantaneous speed in real time; determining a predicted attention target according to the motion direction and the attention priority; generating a distortion correction parameter set in combination with eyeball arrival time and spatial distribution information; performing pre-distortion compensation rendering on the candidate area in a pre-generation period before eyeballs reach the actual attention area to form a pre-corrected image buffer area; and finally, outputting a pre-corrected image matched with the actual stay area. Space-time synchronization of eyeball movement and image compensation is achieved through predictive rendering, the image distortion and color separation phenomena in the glancing process are eliminated while the low-delay characteristic is maintained, and the visual definition and comfort in a dynamic scene are remarkably improved.

The invention provides an application of WNT7B in construction of a myopia animal model. Homologous genes wnt7ba and wnt7bb of the WNT7B in the zebra fish are knocked out or knocked down by applying a CRISPR / Cas9 gene editing technology, an animal model of which the eye axis length is remarkably increased, the eyeball movement frequency is remarkably reduced and the light response is reduced is obtained, and the result shows that the WNT7B is related to the high myopia. The model provides a favorable tool for pathogenesis and drug screening of high myopia, and has a good application prospect.

The present invention discloses a method for intervening in the subjective feeling of motion sickness in virtual reality based on perceptual theory, which relates to the technical field of virtual reality. The method comprises: acquiring proprioception parameter information of a current user, wherein the proprioception parameter information includes but is not limited to head movement data, eye movement data, and physiological data; performing real-time analysis on the currently acquired data using a data analysis algorithm to determine whether the user has early signs of motion sickness; determining, by the data analysis algorithm, that the user has early signs of motion sickness, and immediately initiating a visual perception adjustment step. Furthermore, by real-time capturing and analyzing the user's physiological signals in a virtual reality experience, it is possible to identify and intervene in the early stages of motion sickness, and to formulate an intervention method in a timely manner for users who have subjective feelings of motion sickness, thereby facilitating rapid relief of user discomfort.

The invention discloses a center positioning system and method for a femtosecond laser ophthalmic corneal refraction operation, and relates to the technical field of image processing. The method comprises the following steps of S1, performing multi-source data synchronous acquisition on eyeballs of a patient before an operation; s2, fusing and preprocessing the collected multi-source data; s3, establishing an eyeball dynamics method, outputting six-degree-of-freedom position data in real time, and predicting the position of a laser action point; s4, dynamically adjusting the dual coordinate system according to the cornea; s5, constructing a real-time feedback system, and realizing closed-loop control, safety boundary control and a fault-tolerant mechanism; and S6, generating parameters of an operation process, constructing a four-dimensional cutting model, and performing path planning of the laser model. According to the method, the OCT, the Placido ring and the iris vein composite features are combined, the positioning precision is improved, Kalman filtering and neural network prediction compensation are utilized, eyeball movement is tracked in real time, and the accuracy of operation pupil positioning is improved.

The invention belongs to the field of visual training, and particularly relates to a multispectral dynamic visual function training system and method. The multispectral dynamic visual function training system comprises an image acquisition module, an intelligent analysis module, a control module, a training execution module and a multispectral light source module, the image acquisition module is arranged at a position corresponding to an eye and is used for acquiring image information near eyeballs of a user, personal information of the user and a vision diagnosis result in real time, and the image information comprises eyeball movement tracks, pupil sizes and forms, cornea edge contours and eye white elastic states; and the intelligent analysis module combines the image information and the acquisition time of the image information. According to the scheme, through collection, analysis, regulation and control of a closed loop, the problems that in the prior art, a real-time analysis mechanism based on eyeball images is lacked, the adaptability of a training scheme and eye dynamic characteristics is weak, and precise regulation and control of functions such as light nutrition supplement and choroid stimulation cannot be achieved are solved; and precise training is also realized, and the effects of prevention and protection, cooperative improvement, compliance improvement and the like are achieved.

The invention relates to the field of medical instruments, and provides a cannula pose recognition method and system based on binocular vision, and the method comprises the steps: firstly, building a binocular camera system with a shooting range covering eyeballs, collecting a group of binocular images, and respectively recognizing cannulas and cannula holes in the two images; then, a disparity map is generated based on the casing pipe and the casing pipe hole in the two images, the disparity map is converted into a depth map in combination with the internal reference of the binocular camera system, and the boundary point cloud of the casing pipe hole is obtained; and finally, determining a fitting plane of the casing position and the casing hole according to the boundary point cloud, and taking a normal vector as a casing posture. According to the method, the operation complexity of aligning the instrument to the cannula in the robot-assisted surgery can be reduced, additional arrangement of a marker is not needed, the precision and speed of cannula pose recognition are effectively improved, eyeball movement is directly recognized through cannula pose changes, the compensation effect of eyeball movement is enhanced, and the safety of the robot-assisted surgery is improved.

The invention provides an early warning method for an abnormal driving state of a driver and related equipment, and is applied to the technical field of vehicle safety auxiliary driving, and the method comprises the steps: obtaining the eyeball movement information of the driver collected by a calibrated eyeball tracking sensor, processing the eyeball movement information through a plurality of detection models, and obtaining an abnormal driving state of the driver; a plurality of state detection results are obtained, an abnormal driving detection strategy is applied to process eyeball operation information, and a fatigue detection result and an attention distraction detection result are obtained; and according to the fatigue detection result, the attention distraction detection result and the plurality of state detection results, determining whether to carry out abnormal driving state early warning reminding. The eyeball movement information, collected by the eyeball tracking sensor, of the driver is processed through multiple modes such as the detection model and the abnormal driving detection strategy, multiple modes of detection results are obtained, driving state detection is comprehensively carried out, the abnormal driving state of the driver is detected in time, and early warning is carried out in time.

According to an aspect of the present invention, there is provided a computer graphics processing and selective visual display system, comprising: a computer graphics processing and selective visual display system with a screen; an eye tracking device; a processor; one or more computer memory devices; wherein the processor is arranged for operations comprising: measuring the user's eye movements to ascertain the specific word on which the user is fixated, by the eye tracking device; modifying the display at the user's current fixation point; applying a delay between the presentation of successive graphic elements based on the user's calculated rate to accommodate the user's required time; and presenting elements to the user at a rate based upon the user's required time.

Aspects of the disclosure relate to processing images and identifying features in the images. Images of a user captured using a camera are processed to enhance subsequent analysis. A face is located in the images using Haar cascades, a Histogram of Oriented Gradients, a Viola-Jones framework, and / or a first deep learning algorithm. An eye in the face is located using a plurality of located facial landmarks and / or a convolutional neural network. Movements of the eye in the images is determined. Eye jerking in the images is detected using the determined eye movements. A distance of the detected eye jerking of the eye and how long the detected eye jerking lasted is determined and used to generate an indicator. At least partly in response to the indicator, messages are generated and transmitted to electronic destinations.

A system includes a first camera located within a cockpit of an aircraft to track the eye movement of at least one pilot, and a second camera to track an ambient light source. The system includes an electrochromic panel having an array of dimmable cells. The system further includes a controller, equipped with one or more processors responsible for modifying the array of dimmable cells. The controller receives eye tracking data from the first camera associated with a gaze target of the pilot, and light tracking data from the second camera, which includes parameters associated with the ambient light source. Based on the eye tracking and light tracking data, the controller determines a glare location on a surface of the electrochromic panel where the gaze target intersects. The controller may then selectively modify a tint level of specific dimmable cells in the panel to address the determined glare location.

The invention discloses a visual function detection method and system based on a 3D visual imaging technology, and the method comprises the steps: obtaining three-dimensional visual imaging data, carrying out the modeling and rendering of the illumination, texture and geometric structure in a visual environment, and constructing a virtual scene model which is highly similar to a real scene; acquiring eyeball movement characteristics and pupil change data of the user, analyzing visual characteristics of the user according to the data, and adaptively designing a personalized visual stimulation mode matched with the visual characteristics; and processing captured eyeball image data by using a deep learning algorithm, extracting features of the eyeball image through a convolutional neural network, and modeling the eyeball motion trajectory by using a long-short-term memory network, thereby realizing recognition and prediction of the eyeball motion mode. According to the method, the visual behaviors of the user are accurately captured and analyzed through multi-dimensional data fusion and intelligent algorithm analysis, and an effective means is provided for timely discovering potential visual function abnormalities.

To provide a balance function management system for balance function state information generation and a balance function rehabilitation program.SOLUTION: A memory configured to store at least one processor and at least one artificial neural network model that stores instructions executable by the processor and is executed on a computing device, wherein the at least one processor is configured to input frame images of n (where n is a natural number) videos obtained by photographing a subject through n cameras to the at least one artificial neural network model, At least one of information related to the coordinates of the head, the coordinates of the center of the pupil, and the phase change of the eyeball of the subject according to the order of the frame images of the m-th (m is a natural number from 1 to n) moving image may be acquired, and information related to the movement of the head and the movement of the eyeball for generating the balance state information or performing the balance rehabilitation program may be generated using the acquired information.SELECTED DRAWING: Figure 1

The invention discloses a vehicle rearview mirror adjusting method and device, equipment and a storage medium, and aims to solve the problem that an electric rearview mirror needs to be manually and repeatedly adjusted and cannot quickly adapt to sight lines and postures of different drivers in the prior art. Whether the driver is observing the rearview mirror or not is judged by collecting the eyeball movement track and the head posture data of the driver; after the observation behavior is determined, the included angle between the sight line and the mirror surface is further detected, and the rearview mirror is adjusted for the first time according to the included angle; and then, the position of the vehicle door handle in the rearview mirror image is judged according to the sight line of the driver, and secondary adjustment is performed on the rearview mirror according to the position information, so that automatic and accurate matching of the rearview mirror angle and the view field requirement of the driver is realized, and improvement of the adjustment efficiency and the driving safety is facilitated. The method can be widely applied to the technical field of vehicles.

A device, system and methodology for horizontal gaze nystagmus (HGN) testing. Prior to a test subject taking an action that is verboten in an impaired state, such as driving a vehicle or operating complex or dangerous machinery, the test subject is positioned within a face recognition box of a screen and a HGN simulation test performed, capturing HGN eye movements of the test subject from which the present HGN physiological state of the test subject is determined. The present HGN physiological state of the test subject is compared to a reference HGN state to determine whether the test subject is impaired. Impairment causes temporary restriction of the functionality of the machinery or vehicle.

The invention provides an image-based ophthalmology robot control method, system and device and a medium, and the method comprises the steps: obtaining an intraoperative three-dimensional OCT image sequence and a visual evoked potential signal, and segmenting an optic nerve region to generate an optic nerve space model; performing dynamic registration on the optic nerve space model and the visual evoked potential signal according to an eyeball motion compensation algorithm to generate a fusion data volume; calculating a visual function injury risk coefficient and a postoperative vision recovery predicted value through a pre-trained neural network prediction model based on the fusion data body and the real-time operation parameters of the robot end instrument; and dynamically generating a robot operation correction control instruction according to the injury risk coefficient and the postoperative vision recovery predicted value. By adopting the method, the individualized precision of an operation scheme and the postoperative visual function protection effect can be improved.

A virtual eye test can be conducted to evaluate visual acuity and perception in a virtual reality (VR) environment. The test can be conducted using an electronic device that includes a head-mounted display (HMD) and a camera. The electronic device can generate a VR user interface corresponding to photorealistic virtual environment and render the VR user interface on the HMD. The electronic device can simulate one or more real-world scenarios and while simulating the one or more real-world scenarios, in real time, track eye movements and responses from the wearer for testing visual acuity and perception of the wearer.

The invention discloses an artificial intelligence-based eye movement calibration identification method, device and system, and the method comprises the steps: obtaining the eye movement data of a subject in an eye movement calibration process; based on the eye movement data, constructing input data of at least two different dimensions, including a first type of data used for representing eyeball movement track changes; the second type of data is used for representing spatial distribution characteristics of eyeball positions; the first type of data and the second type of data are input into a trained intelligent recognition model, and the intelligent recognition model is constructed based on a deep neural network structure, has at least two branch coding structures and is used for extracting features of input data of different dimensions; the recognition model further comprises a cross-modal feature fusion mechanism which is used for carrying out fusion processing on feature vectors output by the branch coding structures. And recognizing and outputting an eye movement calibration result through the intelligent recognition model. According to the invention, intelligent identification of eye movement calibration is realized, and evaluation accuracy and processing efficiency are improved.

The invention discloses a method and system for preventing screen information leakage based on UWB positioning, relates to the field of smart screens, and aims to capture facial features, eyeball movement and other information of an observer carrying shooting equipment in front of a screen in real time by combining a UWB positioning technology and a high-speed camera, and identify whether the observer is a legal user or not through a deep learning algorithm. For an unauthorized observer, the system can generate false information which is similar to the screen content but has no practical significance in real time to replace the display content of the sensitive area. According to the dynamic replacement technology, illegal observers cannot obtain effective information without affecting legal user experience, further, an attention tracking algorithm is introduced, the sight focus of the observers is predicted, only areas which are possibly concerned are protected, and therefore the calculation load is reduced.

The invention provides an informatization wound ticket giving system based on facial recognition, and relates to the technical field of identity verification. The system comprises a physiological status monitoring module, a permission adjustment control module, an identity adaptability matching module, a gait behavior verification module and a terminal data linkage module. By analyzing eyeball movement, blinking frequency, pupil change and facial muscle activity and monitoring the physiological state of an individual, dynamic permission adjustment during identity verification is achieved, matching precision is optimized through micro-expression analysis, mismatching caused by emotion fluctuation is reduced, the adaptability of identity verification is enhanced through behavior data in gait analysis, high accuracy is maintained, and the identity verification efficiency is improved. The real-time performance of bill management and access control is improved through a data linkage mechanism among multiple devices, and the verification safety and the remote operation stability are enhanced in combination with multi-dimensional biological characteristics.

The invention provides an iris collection method and device based on eye movement prediction, equipment and a storage medium, and the method comprises the steps: collecting image frames and event streams in a mixed manner through an event camera and an RGB camera, obtaining eye feature point coordinates through key point detection, and converting the event streams into an event frame sequence; performing spatial-temporal feature extraction and filtering processing on the eye feature point coordinates and the event frame sequence by using a time sequence prediction network, and predicting eyeball positions and gazing directions at future moments; calculating the optimal optical axis direction of iris imaging according to the predicted eyeball position and gazing direction, and converting the optimal optical axis direction into control parameters such as a pan-tilt angle and a lens focal length of an imaging system; and synchronously adjusting the imaging system and triggering acquisition when the prediction time arrives. According to the method, active iris tracking acquisition is realized by predicting the eyeball movement track, the problem of response lag of traditional passive tracking is solved, and the success rate of iris acquisition is improved.

The application provides an image registration data processing method and system, relates to the technical field of image registration, and obtains a plurality of structural feature images in a plurality of monochrome laser images; according to the plurality of structural feature images, a plurality of ghosting areas with excessive eye movement are obtained, each of the ghosting areas includes a corresponding ghosting floating image and a ghosting reference image; a feature point corresponding relationship is obtained; a plurality of feature point pairs with accuracy greater than a preset threshold are obtained, feature point matching processing is performed, and a processed ghosting floating image is obtained; pixel registration processing is performed, and a region registration image is obtained; a plurality of region registration images are aligned and fused, a reference image and a floating image are combined, and a registration image is obtained. The application solves the technical problems of the prior art, such as inconsistent image offset in the image acquisition process, low whole-image registration accuracy, and the like, and achieves the technical effects of correcting the partial image offset caused by patient eye movement and improving real-time registration accuracy.

The described voting system comprises two main components: an online verification device and an offline voting device. The verification device utilises a data interface to communicate with central databases for real-time voter verification, employing biometric sensors to ensure accurate voter identification and prevent duplicate voting. This system enhances security by generating a unique verification code for each verified voter. The offline voting device, designed to be immune to network-based threats, uses this code along with biometric verification to authenticate voters. It features a user interface that employs eye gesture technology, allowing voters to select candidates privately and securely through eye movements, without any visible indication of their choices to onlookers. This setup not only protects the integrity of the vote from cyber threats but also safeguards voter privacy and reduces the potential for voter intimidation, for a free, fair, and secure voting process.

The invention provides an endoscope sharing control method based on a human body signal and a game theory, and belongs to the field of medical instruments, and the endoscope sharing control method comprises the following steps: obtaining eyeball movement data; based on the eyeball movement data, determining eye movement control position data used for representing a manual control intention through gaze thermodynamic diagram analysis; based on the eyeball movement data, through quantitative analysis of sight, eye opening degree and pupil size, obtaining reference indexes used for representing intention integrating degree and manual control burden; machine control position data used for representing the expected moving distance of the endoscope are obtained by analyzing the position relation between a target object and the endoscope in an endoscope image, and the endoscope image is collected in real time through the endoscope; based on the machine control position data, the eye movement control position data and the reference index, determining shared control position data through a cooperative game strategy; movement of the endoscope is controlled based on the shared control position data.

The invention discloses an AI glasses real-time cooperation system and method based on user intention prediction, relates to the technical field of education scene computer vision, and proposes the following scheme: obtaining a classroom panoramic image, and collecting a user head steering angle and an eyeball fixation coordinate sequence at the same time; the method comprises the following steps: segmenting a classroom panoramic image into different functional areas through semantic segmentation, distributing differentiated illumination weights according to optical characteristics of the functional areas, calculating an eyeball motion vector based on an eyeball fixation coordinate sequence, and superposing the eyeball motion vector and a head steering angle to generate a future continuous multi-frame prediction view area. And dividing all the functional areas into uniform grids. According to the method, the functional area is divided into the uniform grids, the theoretical illumination value of the predicted visual field area is weighted and calculated based on the illumination weight of the functional area, the brightness weight distribution difference of the light environment area is quantified in the spatial dimension, the nonlinear illumination sequence conforming to the actual optical gradient is generated, and distortion mapping of a linear model to the transition gradient of the functional area is eliminated.