Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

339 results about "Eyeball movements" patented technology

Vehicle-mounted display control method and system based on human-computer interaction

The invention provides a vehicle-mounted display control method and system based on man-machine interaction, and relates to the technical field of display control, and the method comprises the steps: collecting a face image of a driver through a vehicle-mounted camera, extracting eyeball movement features, and calculating the coordinates of a real-time fixation point; matching the fixation point coordinate with a preset interaction area, and triggering an activation state; generating interactive display content according to the activated state, and calculating a dynamic projection position; detecting a moving track of the fixation point in the activation area, and identifying an interaction gesture to trigger a control instruction; and updating a display interface according to the control instruction and sending a feedback prompt tone. According to the method, the interaction efficiency and safety of the vehicle-mounted display system are improved.
Owner:JIANGSU NJSTAR NEW ENERGY TECH CO LTD

Ophthalmologic operation real-time navigation system and method based on dynamic visual field tracking

The invention discloses an ophthalmologic operation real-time navigation system and method based on dynamic visual field tracking, and relates to the technical field of medical systems. Comprising the following steps: matching operation data closest to a current operation from a database, and generating standard operation navigation of the current operation; the real-time image of the operation process is compared with the image of the standard operation navigation in real time, the step of the current operation is determined, and meanwhile subsequent image navigation of the operation of the patient is displayed; generating a spatial mapping matrix between an eyeball movement track and a target region by combining target region boundary data of preoperative OCT image segmentation and an intra-operative navigation coordinate system; the virtual navigation path of the surgical instrument is dynamically corrected according to the real-time eyeball movement track, so that the surgical instrument is aligned with the target area, the spatial relation between the instrument and the target area can be visually mastered through the overlapping display of the three-dimensional virtual path and the real-time image, unconscious displacement or physiological tremor of a patient in an operation is actively adapted, and the operation accuracy is improved. And the continuous accuracy of the navigation path is ensured.
Owner:SICHUAN ACADEMY OF MEDICAL SCI SICHUAN PROVINCIAL PEOPLES HOSPITAL

Intelligent head-mounted device with camera capable of rotating along with movement

PendingCN119653067Areal-time computingSteroscopic systemsHead movementsExtended field of view
The invention discloses an intelligent head-mounted device with a camera capable of rotating along with the camera, and the device comprises an eye movement tracking camera which is used for collecting and measuring the image data of the iris of the two eyes of a wearer; the IMU sensor is used for detecting head movement data of a wearer; the image acquisition and processing module is used for generating eyeball movement data according to the image data of the iris of the two eyes, and converting the eyeball movement data and the head movement data into a rotation instruction; the binocular camera motion control device executes the rotation instruction, drives the binocular camera to move, moves along with the iris and the eyeball, and collects image data in real time to realize line-of-sight tracking; and the image acquisition and processing module is also used for carrying out image and / or video fusion processing according to the received image acquired by the binocular camera in combination with the head movement data and the eyeball movement data. According to the invention, the problem of limitation in the aspects of acquiring depth information and expanding the visual field can be solved, and a more flexible camera tracking and adjusting mechanism is designed, so that wider and clearer image acquisition is realized.
Owner:AFARON (SHANDONG) TECH CO LTD

Video perspective method based on virtual reality

A video perspective method based on virtual reality relates to the technical field of virtual reality, and comprises: at least two cameras for capturing video information in real time, the cameras being provided with spatial positions and angles; performing geometric correction on the video information; the eye movement tracking module monitors the gazing direction of the eyes of the user in real time and adjusts the display position; the eye movement tracking module tracks eyeball movement; reconstructing a three-dimensional model of the surrounding environment of the user; based on the three-dimensional model, determining a relative position relationship between the virtual object and the real object; the head posture sensor obtains head movement information of a user; performing semantic segmentation on the video frame through a deep learning algorithm; and synthesizing the video information and the virtual content on the head-mounted display device, and outputting the synthesized video information and virtual content. The technical problems of visual discomfort and dizziness caused by position mismatching can be solved, and natural fusion of a real scene and a virtual scene is realized.
Owner:QINGDAO VIRTUAL REALITY RES INST CO LTD

Intelligent glasses image adjusting system based on eye movement tracking and gesture fusion

The invention discloses an intelligent glasses image adjusting system based on eye movement tracking and gesture fusion, and relates to the technical field of intelligent equipment. A multi-modal sensing module is arranged to construct a multi-modal sensing layer to capture eyeball movement tracks and gesture actions; a fixation point prediction module is set to process a dynamic scene through a space-time attention mechanism to obtain a fixation point prediction area, a gesture semantic understanding module is set to process gesture actions based on a Transform architecture, and the gesture actions of a user are converted into image adjustment instructions. An image enhancement strategy setting module designs a multi-stage image enhancement strategy according to the fixation point prediction area and the image adjustment instruction, and sets a dynamic adjustment intensity control module to perform adaptive adjustment to obtain a dynamic adjustment intensity control result; an eye movement-gesture cooperative control module is arranged to provide an eye movement-gesture cooperative control mechanism to realize image area selection and parameter adjustment, and accurate image area selection and parameter adjustment are realized.
Owner:MINAMI ACOUSTICS LTD

Naked eye 3D display optimization method based on real-time eyeball tracking

The invention discloses a naked-eye 3D display optimization method based on real-time eyeball tracking, and particularly relates to the technical field of naked-eye 3D display, and the method comprises the steps: capturing eyeball movement data in real time through a visual angle tracking sensor, and collecting illumination information in combination with an ambient light sensor; depth perception parameters are calculated based on pupil diameter variation and frequency, and a time sequence prediction type dynamic compensation coefficient is generated in combination with eyeball movement acceleration; acquiring an initial fixation point coordinate by using an improved spherical projection mapping model, and performing compensation coefficient correction to obtain a real-time coordinate; and finally, according to the real-time coordinates, dynamically adjusting the refractive index distribution of the nanostructure layer, the rotation angle of the polarizer, the focal length of the optical lens and other optical modulation parameters. The real-time distance is calculated through the binocular parallax algorithm, the depth mapping value is generated by combining the focal length of the camera and the baseline distance, the method can adapt to the illumination change and the user view angle, and the 3D display effect is optimized.
Owner:SHENZHEN EASYQUICK TECH CO LTD

Pilot SA ability evaluation system based on eye movement tracking and spatial orientation flight simulation

The invention relates to a pilot SA ability evaluation system based on eye movement tracking and space directional flight simulation, and the system comprises a space directional flight simulator which is used for simulating a real flight environment; the eye tracker is used for recording an eyeball movement track of a pilot in real time in a simulated real flight environment to obtain eye movement track time sequence data and shooting a flight training video; the microprocessor evaluation module comprises a time sequence data processing module and a Ti-SA model; the time sequence data processing module obtains corresponding AOI fixation time sequence data based on the eye movement trace time sequence data, the flight training video and a preset AOI subdivision area; the Ti-SA model is used for predicting a current SA capability value of a pilot based on the eye movement trace time sequence data and the AOI fixation time sequence data and judging whether the predicted SA capability value is lower than a preset SA threshold value or not, and if the predicted SA capability value is lower than the preset SA threshold value, an early warning instruction is sent to the early warning and voice broadcasting module; and the early warning and voice broadcasting module is used for early warning when the SA capability value is lower than a preset SA threshold value.
Owner:AIR FORCE MEDICAL CENT PLA

Method and system for evaluating and training attention of children

The invention relates to a child attention evaluation and training method and system, and the method comprises the steps: obtaining a brain wave mode, an eyeball movement track, an emotion activation level and autonomic nervous system function data of a child in real time, and generating multi-dimensional biological signal data; based on the multi-dimensional biological signal data, generating evaluation task data; generating dynamic task parameters according to biological signal data and behavior performance data in the evaluation task data; generating an attention feedback signal based on the dynamic task parameters; according to the attention feedback signal, a training task integrating work memory, suppression control and cognitive flexibility is constructed, and cognitive function training data is generated; and based on the cognitive function training data, synchronously sharing the attention performance data of the children to the parent terminal and the teacher terminal, generating life situation intervention suggestions, and iteratively optimizing evaluation parameters according to a long-term effect evaluation result. Therefore, the accuracy of children attention evaluation and training can be improved.
Owner:NANFANG HOSPITAL OF SOUTHERN MEDICAL UNIV

Smarthire – ai-driven automated interviewing and evaluation platform

The present invention relates to the fields of Computer Science, Artificial Intelligence, Machine Learning and Deep Learning, specifically focusing on Human Resources technology, automated interviewing, and evaluation processes. The present invention discloses various embodiments of an AI-driven interview method that enables automated and structured interviews of various prospective candidates. The various embodiments disclose a scalable intelligent bot framework which is configured for an automated interview process using generative AI, speech recognition adapted to analyse sentiment, confidence, clarity of speech etc., speech synthesis and real-time talking video synthesis for conversation and analyses a plurality of input parameters such as body language, facial expression and eye movements, and allows for an unbiased evaluation of prospective candidates, featuring various safeguards such as fraud detection.
Owner:POSSOBUILD TECHNOLOGIES PVT LTD

Multi-effect ultrastructure composite lens for preventing and delaying myopia

The invention discloses a multi-effect ultrastructure composite lens for preventing and delaying myopia, which comprises a lens main body, a functional area is arranged in the lens main body, and the functional area comprises a central optical correction area and an ultrastructure area which are arranged on the inner side. Compared with the prior art, the method has the advantages that the small central optical area is adopted to correct vision, and the prevention and control effect is enhanced. The ultramicro soft light area has prevention and control and visual transition effects. The ultra-micro lenses and the ultra-micro structure ring cylindrical lenses are alternately arranged on the outer side, due to the fact that the area is reduced, the number of the ultra-micro structures in the unit area is increased, the filling rate of the functional area of the whole lens is increased, the ultra-micro structures enable the brain to be not easy to perceive, visual perception is not easy to interfere, and the three ultra-micro structures have the effect of improving visual activity along with eyeball movement of visual activity. Signals entering the eyes are kept in dynamic change all the time, so that the visual experience is further improved while the prevention and control effect and imaging intervention are guaranteed, and long-term wearing is facilitated.
Owner:HENAN BAOSHIDA VISUAL HEALTH TECH CO LTD

Intelligent cognitive assessment method and system based on virtual reality environment

The invention discloses an intelligent cognitive assessment method and system based on a virtual reality environment. According to the method, through accurate eye movement calibration and electroencephalogram calibration, resting-state electroencephalogram information, digital cognitive evaluation task parameters and eyeball movement track parameters of a subject in a virtual reality environment are collected, and through professional preprocessing and feature extraction, deep analysis and fusion are conducted on data through a common-attention multi-mode feature noise reduction fusion model. Through training and prediction of the neural network model, the cognitive function state of the subject can be effectively evaluated, the accuracy and efficiency of cognitive evaluation are improved, and meanwhile, the user experience is optimized. By utilizing the method, early recognition of cognitive impairment is facilitated, a scientific basis is provided for clinical diagnosis and intervention, and the method is of great significance in preventing and delaying dementia of old people.
Owner:NANJING ZHIJINGLING EDUCATIONAL TECH CO LTD

Artificial intelligence-driven automated online proctoring system

A method for automated online proctoring, in accordance with one embodiment, includes using an AI system to consider monitored aspects of activities of a student taking a test to calculate a trust score indicative of academic integrity, the aspects including at least user interaction with one or more input devices, and eye movements of the student. The AI system is used to provide guidance to the student during the test for improving a submission input by the student during the test. An automated online proctoring system, in accordance with one embodiment, includes a facial recognition module; a lockdown test monitor module; and an AI system configured to consider a plurality of monitored aspects of activities of the student to calculate a trust score that characterizes an authenticity and originality of a submission by the student during the test, and to provide guidance to the student during the test.
Owner:SILICON VALLEY HIGH SCHOOL INC

Community open space psychological recovery effect evaluation method and system based on multi-modal perception

The invention provides a community open space psychological recovery effect assessment method and system based on multi-modal perception. The method comprises the following steps: acquiring a physiological signal, a movement track, eyeball movement data and a panoramic image of a user; analyzing the image, extracting environmental element space distribution parameters, and calculating an environmental information entropy value; according to the physiological signal, calculating physiological stress deviation as a first type of error, analyzing the matching degree of a moving track and an environment structure as a second type of error, and combining eye movement characteristics and visual attraction distribution to calculate attention deviation as a third type of error; inputting the three types of errors and entropy values into an evaluation model, and outputting a recovery efficiency index and a multi-dimensional index representing error mitigation; and associating the environment parameters with the multi-dimensional indexes, explaining and extracting an environment intervention critical value and a recovery effect function, and generating a space optimization evaluation report in combination with dynamic indexes. According to the method, quantitative evaluation and accurate optimization decision support of the psychological recovery effect of the open space of the community are realized.
Owner:TIANFU JIANGXI LAB

Switchable test device and method, electronic device, storage medium and program product

The invention provides switchable test equipment, a switchable test method, electronic equipment, a storage medium and a program product, and belongs to the technical field of visual equipment. The switchable test equipment comprises a simulated eyeball, a motion controller, a first driving assembly, a second driving assembly and at least one test device installed on the simulated eyeball. The motion controller is connected with the first motion driving assembly and the second driving assembly, and the first motion driving assembly and the second driving assembly are connected with the simulated eyeball; the motion controller is used for controlling the first motion driving assembly and the second driving assembly according to test requirements so as to drive the simulated eyeball and the test device to rotate synchronously until the target test device is switched to a test position; wherein the target test device is one of the at least one test device. According to the technical scheme, the test device can be rotated to the test position under the condition that eyeball rotation is simulated, and integration of test functions on one device is achieved.
Owner:YONGJIANG LAB

Eyeball tracking method and device and electronic equipment

The invention relates to the technical field of deep learning, and discloses an eyeball tracking method and device and electronic equipment, and the method comprises the steps: obtaining an eye image data set of a user, inputting the eye image data set into a preset deep learning model, determining the eyeball position information and the eyeball movement mode of the user, based on the eyeball position information and the eyeball movement mode, the intelligent robot is controlled to perform eye interaction with the user, and eye recognition and dynamic position real-time tracking can be accurately performed through a preset deep learning model.
Owner:SHENZHEN AOTO ELECTRONICS

Intelligent eyesight monitoring and eye disease prediction glasses

The invention discloses a pair of intelligent eyesight monitoring and eye disease prediction glasses, and aims to solve the problems that most of existing eye health monitoring devices are used for regular inspection, cannot monitor and predict the eye health condition in real time and are difficult to take intervention measures in time, the glasses comprise glasses legs and a glasses main body, and the glasses main body is provided with an inner side facing a wearer; the glasses body further comprises a miniature camera, an optical sensor, a master control system and a battery system. The miniature camera is connected with the main control system through an application-specific integrated circuit, and the miniature camera is installed on the inner side of the glasses body facing the eyes of a wearer and used for shooting eye images of the wearer in real time and capturing the pupil size, eyeball movement and sight line direction of the wearer; the optical sensor is connected with the main control system and is used for detecting the ambient light intensity and color and adjusting the brightness of the lenses of the glasses main body; the eye health condition of the teenagers can be monitored and predicted in real time, and accurate health data support is provided for parents, teachers and ophthalmologists.
Owner:HEFEI SHUFANG INTELLIGENT TECHNOLOGY CO LTD

Vision correction method based on VR eyeball following movement

The invention discloses a vision correction method based on VR eyeball following movement, and relates to the field of vision and vision correction, in particular to a method for correcting vision through eyeball following movement of a human body based on a VR technology, a glasses tool, corollary equipment and an application method. Comprising the steps of training acquisition, training video selection, following judgment, video adjustment and the like, the following condition of the eyeball can be evaluated more accurately by calculating the angle difference and the eyeball movement following degree, and the problems that misjudgment possibly exists in a traditional method and the training effect is poor due to the fact that the eyeball cannot follow are solved. According to the technology, the parameters of the training video can be dynamically adjusted according to real-time feedback of the eyeball following degree, and the vision correction effect is improved; by means of the VR technology, tools, equipment and other methods, eyeballs move along with the VR technology, tools, equipment and the like, and the vision of people is improved and corrected; therefore, extraocular muscles are trained to drive eyeballs to move, eyeball crystalline lenses move back and forth along with the video, and the effect of improving the naked eye vision is achieved.
Owner:HANGZHOU KUANGSHI E-COMMERCE CO LTD

Eye movement distortion detection method

The invention relates to the technical field of augmented reality glasses optical correction, and specifically provides an eye movement distortion detection method. The method comprises the following steps: acquiring an AR glasses playing image and identifying a visual saliency region to establish an attention priority order; detecting an eyeball movement track direction vector and an instantaneous speed in real time; determining a predicted attention target according to the motion direction and the attention priority; generating a distortion correction parameter set in combination with eyeball arrival time and spatial distribution information; performing pre-distortion compensation rendering on the candidate area in a pre-generation period before eyeballs reach the actual attention area to form a pre-corrected image buffer area; and finally, outputting a pre-corrected image matched with the actual stay area. Space-time synchronization of eyeball movement and image compensation is achieved through predictive rendering, the image distortion and color separation phenomena in the glancing process are eliminated while the low-delay characteristic is maintained, and the visual definition and comfort in a dynamic scene are remarkably improved.
Owner:SHANGHAI JINGYUE LANTU OPTOELECTRONICS CO LTD

Application of WNT7B in construction of myopia animal model

The invention provides an application of WNT7B in construction of a myopia animal model. Homologous genes wnt7ba and wnt7bb of the WNT7B in the zebra fish are knocked out or knocked down by applying a CRISPR / Cas9 gene editing technology, an animal model of which the eye axis length is remarkably increased, the eyeball movement frequency is remarkably reduced and the light response is reduced is obtained, and the result shows that the WNT7B is related to the high myopia. The model provides a favorable tool for pathogenesis and drug screening of high myopia, and has a good application prospect.
Owner:THE EYE HOSPITAL OF WENZHOU MEDICAL UNIVERSITY +1

A subjective intervention method for virtual reality motion sickness based on perceptual theory

The present invention discloses a method for intervening in the subjective feeling of motion sickness in virtual reality based on perceptual theory, which relates to the technical field of virtual reality. The method comprises: acquiring proprioception parameter information of a current user, wherein the proprioception parameter information includes but is not limited to head movement data, eye movement data, and physiological data; performing real-time analysis on the currently acquired data using a data analysis algorithm to determine whether the user has early signs of motion sickness; determining, by the data analysis algorithm, that the user has early signs of motion sickness, and immediately initiating a visual perception adjustment step. Furthermore, by real-time capturing and analyzing the user's physiological signals in a virtual reality experience, it is possible to identify and intervene in the early stages of motion sickness, and to formulate an intervention method in a timely manner for users who have subjective feelings of motion sickness, thereby facilitating rapid relief of user discomfort.
Owner:SHANDONG UNIV +1

Bionic eye device

The invention relates to the field of robots, and provides a bionic eye device. The bionic eye device comprises two bionic eyeball bodies; the two ends of the first connecting rod are in transmission connection with the two bionic eyeball bodies through transmission assemblies respectively; the first driving part is hinged to the first connecting rod so as to drive the first connecting rod to rotate in the horizontal plane, and the first connecting rod drives the two bionic eyeballs to rotate in the horizontal plane based on the action of the first driving part; the second driving part is connected with the first driving part so as to drive the first driving part and the two bionic eyeballs to rotate in a vertical plane. According to the bionic eye device, the movement of a bionic eyeball is closer to the physiological mechanism of a real eyeball; the precise control on the movement of the bionic eyeball is realized; the bionic eyeball device is compact in structure, high in integration level and convenient to install and maintain.
Owner:TSINGHUA UNIVERSITY

Detecting reading state of a user based on visual attention information and semantic features of text

A method for detecting a reading state of a user includes obtaining a first data stream indicative of one or both of eye movement and facial expression of the user as the user is reading a text, determining, based on the first data stream, visual information indicative of one or both of eye movements and facial expressions of the user during reading of the text, obtaining a second data stream indicative of content of the text, determining, based on the second data stream, semantic information from the text, determining reading state information based on analyzing the visual information determined based on the first data stream and the semantic information determined based on the second data stream, performing, by the processor, an operation with respect to the reading state information, wherein the reading state information tracking the reading state of the user during reading of the text.
Owner:SHANG LI +4

Near-infrared contact lens for eye movement tracking and preparation method thereof

The invention discloses a near-infrared contact lens for eye movement tracking and a preparation method, the contact lens comprises a contact lens layer, a processing circuit module, a wireless power supply coil, a near-infrared LED lamp and a photoelectric detector, the photoelectric detector is adjacent to the near-infrared LED lamp, the near-infrared LED lamp is used for emitting near-infrared light to the fundus, and the processing circuit module is used for processing the near-infrared light. The photoelectric detector is used for receiving near-infrared light reflected back from the fundus and detecting the movement direction and angle of the eyeball in real time by comparing irradiation values of the photoelectric detector, and the processing circuit module is connected with the photoelectric detector and used for comparing the difference of the irradiation values of the near-infrared light received by the photoelectric detector and determining the movement direction and angle of the eyeball. And the wireless power supply coil is directly connected with the processing circuit module and is used for wirelessly supplying power to the processing circuit module and the near-infrared LED lamp. According to the near-infrared contact lens, infrared waves generated by the near-infrared LED lamp avoid the visible range of human eyes, and meanwhile, all modules of the near-infrared contact lens are distributed around the contact lens, so that the daily life of a user is not influenced.
Owner:CHANGZHOU YIHONG TECHNOLOGY CO LTD

Vertigo diagnostic device and method using ultra-fast lightweight deep running model for tracking eyeball and head position change in video image, recording medium storing program for achieving the same and computer program stored in recording medium

To provide a vertigo diagnostic device which automatically removes noise, such as eye blinking and the like, and tracks and quantifies purely eyeball movement so as to allow doctors to use the values in diagnosis.SOLUTION: The present invention relates to: a technique for tracking changes in eyeballs and a head position to diagnose vertigo, and more specifically, a vertigo diagnostic device and method using a deep learning model for tracking movement of the eyeball and the head of a patient from a video including a patient to diagnose vertigo on the basis of a deep learning model, and also relates to; a recording medium storing a program for achieving the vertigo diagnosis; and the computer program stored in the recording medium.SELECTED DRAWING: Figure 1
Owner:IND ACADEMIC COOP FOUND HALLYM UNIV +1

Centralized positioning system and method for femtosecond laser ophthalmic corneal refraction operation

PendingCN120227233ALaser surgeryImage analysisKeratorefractive surgeryImage manipulation
The invention discloses a center positioning system and method for a femtosecond laser ophthalmic corneal refraction operation, and relates to the technical field of image processing. The method comprises the following steps of S1, performing multi-source data synchronous acquisition on eyeballs of a patient before an operation; s2, fusing and preprocessing the collected multi-source data; s3, establishing an eyeball dynamics method, outputting six-degree-of-freedom position data in real time, and predicting the position of a laser action point; s4, dynamically adjusting the dual coordinate system according to the cornea; s5, constructing a real-time feedback system, and realizing closed-loop control, safety boundary control and a fault-tolerant mechanism; and S6, generating parameters of an operation process, constructing a four-dimensional cutting model, and performing path planning of the laser model. According to the method, the OCT, the Placido ring and the iris vein composite features are combined, the positioning precision is improved, Kalman filtering and neural network prediction compensation are utilized, eyeball movement is tracked in real time, and the accuracy of operation pupil positioning is improved.
Owner:ZHENGZHOU HUAXIA OPTOMETRY HOSPITAL CO LTD

Multispectral dynamic visual function training system and method

The invention belongs to the field of visual training, and particularly relates to a multispectral dynamic visual function training system and method. The multispectral dynamic visual function training system comprises an image acquisition module, an intelligent analysis module, a control module, a training execution module and a multispectral light source module, the image acquisition module is arranged at a position corresponding to an eye and is used for acquiring image information near eyeballs of a user, personal information of the user and a vision diagnosis result in real time, and the image information comprises eyeball movement tracks, pupil sizes and forms, cornea edge contours and eye white elastic states; and the intelligent analysis module combines the image information and the acquisition time of the image information. According to the scheme, through collection, analysis, regulation and control of a closed loop, the problems that in the prior art, a real-time analysis mechanism based on eyeball images is lacked, the adaptability of a training scheme and eye dynamic characteristics is weak, and precise regulation and control of functions such as light nutrition supplement and choroid stimulation cannot be achieved are solved; and precise training is also realized, and the effects of prevention and protection, cooperative improvement, compliance improvement and the like are achieved.
Owner:CHENSHIMING HEALTH TECHNOLOGY (CHONGQING) CO LTD

Cannula pose recognition method and system based on binocular vision

The invention relates to the field of medical instruments, and provides a cannula pose recognition method and system based on binocular vision, and the method comprises the steps: firstly, building a binocular camera system with a shooting range covering eyeballs, collecting a group of binocular images, and respectively recognizing cannulas and cannula holes in the two images; then, a disparity map is generated based on the casing pipe and the casing pipe hole in the two images, the disparity map is converted into a depth map in combination with the internal reference of the binocular camera system, and the boundary point cloud of the casing pipe hole is obtained; and finally, determining a fitting plane of the casing position and the casing hole according to the boundary point cloud, and taking a normal vector as a casing posture. According to the method, the operation complexity of aligning the instrument to the cannula in the robot-assisted surgery can be reduced, additional arrangement of a marker is not needed, the precision and speed of cannula pose recognition are effectively improved, eyeball movement is directly recognized through cannula pose changes, the compensation effect of eyeball movement is enhanced, and the safety of the robot-assisted surgery is improved.
Owner:BEIJING XIANWEI MEDICAL TECH CO LTD

Child vision screening and tracking system and method based on computer vision

The invention relates to the technical field of ophthalmology medical information systems, in particular to a child vision screening and tracking system and method based on computer vision, and the system comprises an eyeball movement analysis module which is used for collecting and analyzing eyeball movement data; the AR test module is used for carrying out eyeball movement enhancement and vision test; the vision development prediction module is used for predicting the vision development trend; the vision knowledge base is used for providing professional knowledge support; the intelligent assistant module is used for providing personalized suggestions; the system background is used for realizing data uploading and statistical analysis; according to the invention, a comprehensive and intelligent children vision health management platform is constructed. By integrating advanced technologies such as computer vision, augmented reality, artificial intelligence and the like, the system realizes full-process automation from data acquisition, analysis and processing to prediction and suggestion. The efficiency and accuracy of vision screening are greatly improved, and powerful technical support is provided for long-term management of vision health of children.
Owner:SHANGHAI CHILDRENS MEDICAL CENT AFFILIATED TO SHANGHAI JIAOTONG UNIV SCHOOL OF MEDICINE

Early warning method for abnormal driving state of driver and related equipment

ActiveCN120440044ADriver/operatorSimulation
The invention provides an early warning method for an abnormal driving state of a driver and related equipment, and is applied to the technical field of vehicle safety auxiliary driving, and the method comprises the steps: obtaining the eyeball movement information of the driver collected by a calibrated eyeball tracking sensor, processing the eyeball movement information through a plurality of detection models, and obtaining an abnormal driving state of the driver; a plurality of state detection results are obtained, an abnormal driving detection strategy is applied to process eyeball operation information, and a fatigue detection result and an attention distraction detection result are obtained; and according to the fatigue detection result, the attention distraction detection result and the plurality of state detection results, determining whether to carry out abnormal driving state early warning reminding. The eyeball movement information, collected by the eyeball tracking sensor, of the driver is processed through multiple modes such as the detection model and the abnormal driving detection strategy, multiple modes of detection results are obtained, driving state detection is comprehensively carried out, the abnormal driving state of the driver is detected in time, and early warning is carried out in time.
Owner:BEIJING JINGWEI HIRAIN TECH CO INC

Virtual reality motion sickness subjective feeling intervention method based on perception theory

The invention discloses a virtual reality motion sickness subjective feeling intervention method based on a perception theory, and relates to the technical field of virtual reality, and the method comprises the steps: collecting current user body feeling parameter information, the body feeling parameter information comprises but is not limited to head motion data, eyeball motion data and physiological data; performing real-time analysis on the currently acquired data by using a data analysis algorithm, and judging whether the user has early data of motion sickness or not; an early sign of motion sickness of a user is judged through a data analysis algorithm, a visual perception adjustment step is started immediately, and then a physiological signal of the user is captured and analyzed in real time in virtual reality experience, so that the motion sickness can be recognized and intervened in time in the early stage of motion sickness; an intervention method can be timely formulated for a user who generates subjective feeling of motion sickness, and discomfort of the user can be quickly relieved.
Owner:SHANDONG UNIV +1