Field depth blending strengthening display method and system based on eye movement tracking

Abstract

The invention relates to automatic field depth blending strengthening display method and system based on eye movement tracking. The method comprises step (1) of obtaining eye movement tracking and background image data by adjusting an eye movement camera; step (2) of displaying automatic field depth blending, specific steps thereof are as follows: generating a primary training database; converting probability distribution information; inquiring the database; converting field depth and focus data; estimating pose; blending virtual and actual scenes; and romancing images. The system comprises an eye movement wireless CCD camera arranged on a helmet, a background wireless CCD camera and a microprocessor which is provided with a wireless receiver. The CCD camera adopted by the invention takes eye movement images and background images, and can carry out comparison matching tracking between the eye movement data taken in real time and synchronously taken background image data according to the training information of the field depth and the eye movement to adjust focus degree of image displayed by a transparent helmet display, thus realizing automatic focusing and strengthening display.

Description

technical field [0001] The invention relates to an augmented reality display technology, in particular to a depth-of-field fusion augmented display method and system based on eye movement track tracking. Background technique [0002] Augmented Reality (AR---Augmented Reality) system is to put VR in the real environment to check. Judging from the current development trend, this virtual experience combined with the actual environment is one of the most effective implementation technologies for the development of virtual reality technology. A helmet-mounted display (Head-Mounted Displays, HMD for short) is an important device of an AR system. It is widely used in virtual reality and augmented reality systems. Its most basic function is to provide users with an immersive sensing environment. The helmet not only plays the role of a display, but also assists in scene acquisition and tracking registration. Researchers of augmented reality technology have also adopted a similar di...

AI Technical Summary

Problems solved by technology

The above-mentioned patents and related research all rely on hardware control mechanisms to achieve depth-of-field effects, the system flexibility is poor, and focusing is achieved through optical components such as lenses (such as patents CN02121681.9, CN95193447.3 and patents CN200510008494.9, etc.)

And the eye track control device (such as CN200710040859.5 etc.) is only used to realize the effect similar to the mouse, there are no other reports, and there is no in-depth application research, and there is no research on using eye track equipment as the basis for depth of field control. There is also no research and report on the realization of augmented reality fusion display combined with head-mounted displays

Images