An eye movement tracking interaction method and system of near-to-eye display equipment

Abstract

The invention belongs to the technical field of near-to-eye display equipment application, and discloses an eye movement tracking interaction method and system for near-to-eye display equipment. The method comprises the steps: carrying out the sight line tracking through an eye movement tracking module on the near-to-eye display equipment, carrying out the calculation of the obtained eye movementinformation, and mapping the eye movement information to the coordinate position of an optical imaging screen button of the near-to-to-eye display equipment; clicking the imaging screen button, and executing the interaction function program after interaction succeeds. Compared with blink selection of existing eye movement interaction, attention of a user in the interactive control process througheyeballs is greatly reduced, meanwhile, cognitive loads in subjective consciousness are reduced, and discomfort caused by inharmonious control over monocular blink muscles is avoided; Compared with gesture recognition interaction control, the method has the advantages that the concealment is high, the operation is convenient and fast, and the method is suitable for application scenarios with privacy requirements.

Description

technical field [0001] The invention belongs to the field of near-eye display device application technology and display interaction technology, and in particular relates to a method and system for eye-tracking interaction of a near-eye display device. Background technique [0002] At present, the existing technologies commonly used in the industry are as follows: [0003] In the application process of near-eye display devices, eye tracking is one of the important interaction methods in the use process. Of course, the eye-tracking interaction method has irreplaceable advantages such as fast mobile selection, strong privacy, less energy consumption, and convenience. When interacting with the near-eye display device or the virtual image presented on the display through a series of eye behaviors such as staring at the target for a certain period of time, binocular blinking, monocular blinking, eye movement direction (eyeball looking up, looking left and right, etc.) (Interacti...

AI Technical Summary

Problems solved by technology

Compared with pure eye movement interaction (staring at the target for a certain period of time, blinking with both eyes, blinking with one eye, etc.), the experience is not good. The above interaction methods are not like when using the mouse to click the left and right buttons. Human subjective consciousness does not need too much participation. to the operation, and the current eye movement interaction behavior, such as eye blinking "click to confirm" requires human subjective energy

Images