An augmented reality interaction method and device based on sight line tracking

An augmented reality and eye-tracking technology, which is applied in the input/output of user/computer interaction, the input/output process of data processing, instruments, etc., can solve the problems of not considering human eye movement and large error in virtual information display position, etc. To achieve the effect of improving interactivity
CN109683701AInactive Publication Date: 2019-04-26INLIFE HANDNET CO LTD

Patent Information

Authority / Receiving Office
CN Β· China
Current Assignee / Owner
INLIFE HANDNET CO LTD
Publication Date
2019-04-26
Estimated Expiration
Not applicable Β· inactive patent

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The embodiment of the invention discloses an augmented reality interaction method and device based on sight line tracking. The method comprises the following steps of: obtaining a scene image corresponding to the current scene, obtaining azimuth information of the head of a user, wherein the head azimuth information comprises head height information and head deflection angle information of the user; and determining a target image in the scene image according to the head azimuth information, obtaining the sight line information of the eyes of the user, determining a target object in the targetimage according to the sight line information, obtaining virtual enhancement information corresponding to the target object, and superposing the virtual enhancement information to a corresponding position in the scene image. Target selection of the photosensitive area is completed by using the head azimuth and the sight line information of the user, and the real scene seen by the user is fused with the virtual enhanced information through three-dimensional digital reconstruction of the computer, so that the interactivity of augmented reality is improved.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The present invention relates to the field of augmented reality technology, in particular to an augmented reality interaction method and device based on gaze tracking. Background technique

[0002] AR (Augmented Reality, Augmented Reality) is a new technology that "seamlessly" integrates real world information and virtual world information. , sound, taste, touch, etc.) through computers and other science and technology, after simulation, the real environment and virtual objects are superimposed on the same picture or space in real time, and the virtual information is applied to the real world. Perceived, so as to achieve a sensory experience beyond reality. Augmented reality technology not only shows the information of the real world, but also displays the virtual information at the same time, and the two kinds of information are superimposed and superimposed.

[0003] At present, the 3D registration methods adopted by researchers at home and abroad,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More