An augmented reality interaction method and device based on sight line tracking

Abstract

The embodiment of the invention discloses an augmented reality interaction method and device based on sight line tracking. The method comprises the following steps of: obtaining a scene image corresponding to the current scene, obtaining azimuth information of the head of a user, wherein the head azimuth information comprises head height information and head deflection angle information of the user; and determining a target image in the scene image according to the head azimuth information, obtaining the sight line information of the eyes of the user, determining a target object in the targetimage according to the sight line information, obtaining virtual enhancement information corresponding to the target object, and superposing the virtual enhancement information to a corresponding position in the scene image. Target selection of the photosensitive area is completed by using the head azimuth and the sight line information of the user, and the real scene seen by the user is fused with the virtual enhanced information through three-dimensional digital reconstruction of the computer, so that the interactivity of augmented reality is improved.

Description

technical field [0001] The present invention relates to the field of augmented reality technology, in particular to an augmented reality interaction method and device based on gaze tracking. Background technique [0002] AR (Augmented Reality, Augmented Reality) is a new technology that "seamlessly" integrates real world information and virtual world information. , sound, taste, touch, etc.) through computers and other science and technology, after simulation, the real environment and virtual objects are superimposed on the same picture or space in real time, and the virtual information is applied to the real world. Perceived, so as to achieve a sensory experience beyond reality. Augmented reality technology not only shows the information of the real world, but also displays the virtual information at the same time, and the two kinds of information are superimposed and superimposed. [0003] At present, the 3D registration methods adopted by researchers at home and abroad,...

AI Technical Summary

Problems solved by technology

The visual channel is the most important information interface between human beings and the external environment. In addition to the head movement, the eyes are also turning when people move in the enhanced information space. The head position is used to approximate the line of sight direction without considering the human eye movement, resulting in virtual reality. There is a large error in the display position of the information in the real space

Images