Method and device for realizing augmented reality

Abstract

The invention discloses a method and device for realizing augmented reality. The method comprises the steps of selecting a certain frame of an environment scene image from the environment scene imagecollected in real time to serve as a first frame of the environment scene image, performing image registration on multiple adjacent frames of the environment scene image by using a Slam algorithm, andcalculating three-dimensional point cloud data of the first frame of the environment scene image and each subsequent frame of the image; obtaining newly added three-dimensional point cloud data of the ith frame relative to the (i-1)th frame of the environment scene image, and processing the newly added three-dimensional point cloud data by using a Delaunay triangulation algorithm to obtain a processed newly added triangular facet set; splicing each newly added triangular facet in the newly added triangular facet set to a plane set of the (i-1)th frame of the environment scene image to obtaina plane set of the ith frame of the environment scene image; selecting a visible plane from the plane set of the ith frame of the environment scene image to serve as a target plane based on preset conditions, and superimposing virtual information to be displayed on the selected target plane for display.

Description

technical field [0001] The present invention relates to the technical field of augmented reality, in particular to a method and equipment for realizing augmented reality. Background technique [0002] Augmented reality technology (Augmented Reality, AR) uses computer graphics technology and visualization technology to generate virtual objects that do not exist in the real environment, and accurately integrates virtual objects into the real environment through image recognition and positioning technology. The real environment is integrated and presented to the user with a real sensory experience. [0003] Existing AR-Glass devices use SLAM algorithms to obtain scene 3D information (three-dimensional reconstruction) and equipment in the scene based on input data (one or more of grayscale cameras, color cameras, depth cameras, sensor devices, etc.) attitude (position and rotation data), and present the real scene through video see-through or optical see-through. At the same t...

AI Technical Summary

Problems solved by technology

However, when displaying virtual information, it usually presets its posture in the real scene or allows the user to manually control the virtual information to move to the desired display position. This method is complicated to operate and there will be a large deviation in the fusion of virtual and real.

Images