Method and device for implementing augmented reality (AR) and terminal device

Abstract

The invention discloses a method and a device for implementing augmented reality (AR) and a terminal device, which is used for displaying corresponding AR information in real time on an image photographed by a user and improving the accuracy and the authenticity of AR information display. The method for implementing augmented reality comprises the steps of acquiring an image sequence of a photographed object; selecting at least one key-frame image from the image sequence, wherein the key-frame image can restore an image of local three-dimensional point cloud data of the photographed object, and the adjacent key-frame images meet a preset image spacing distance; determining a key-frame image with the photographing time being the latest as the current key-frame image; determining complete three-dimensional point cloud data of the photographed object according to the current key-frame image or the selected at least one key-frame image; acquiring AR information to be displayed; determining a display direction of the AR information on the current frame image according to the complete three-dimensional point cloud data and the current key-frame image; and displaying the AR information on the current frame image according to the display direction.

Description

technical field [0001] The present invention relates to the technical field of information processing, in particular to an augmented reality realization method, device and terminal equipment. Background technique [0002] Augmented reality (AR, Augmented Reality) is a technology that uses virtual objects to enhance the reality of real scenes. Augmented reality retains the user's actual environment as the user's main perception and interaction environment, and marks the virtual generated information such as text, two-dimensional graphics, and three-dimensional models on the objects displayed on the display screen in the user's actual environment. , so as to realize the annotation and description of the user's environment, or the effect of augmenting the reality environment. like figure 1 As shown, the user turns on the camera of the mobile terminal and points the camera at the real environment. At this time, the screen of the user's mobile terminal will display the existing...

AI Technical Summary

Problems solved by technology

In this method, due to the accumulation of errors in the sensor, the position of the user determined when shooting for a period of time or when there is violent movement is not accurate, resulting in the displayed AR information being inaccurate

At the same time, this method is suitable for objects that are farther away, and the position of the object will change more when entering and leaving the object, and the AR information placed floats on the object, making the display of AR information not realistic enough.

Images