Method for generating virtual-real fusion image for stereo display

Abstract

The invention discloses a method for generating a virtual-real fusion image for stereo display. The method comprises the following steps: (1) utilizing a monocular RGB-D camera to acquire a depth map and a color map in real scene; (2) rebuilding a three-dimensional scene surface model and calculating a camera parameter; (3) mapping, thereby acquiring the depth map and the color map in a virtual viewpoint position; (4) finishing the three-dimensional registration of a virtual object, rendering for acquiring the depth map and the color map of the virtual object, and performing virtual-real fusion, thereby acquiring a virtual-real fusion content for stereo display. According to the method provided by the invention, the monocular RGB-D camera is used for shooting, the three-dimensional scene surface model is rebuilt frame by frame and the model is simultaneously used for tracking the camera and mapping the virtual viewpoint, so that higher camera tracking precision and virtual object registration precision can be acquired, the cavities appearing in the virtual viewpoint drawing technology based on the image can be effectively handled, the shielding judgment and collision detection for the virtual-real scene can be realized and a stereo display device can be utilized to acquire a vivid stereo display effect.

Description

technical field [0001] The invention belongs to the technical field of three-dimensional stereoscopic imaging, and in particular relates to a virtual-real fusion image generation method for stereoscopic display. Background technique [0002] Stereoscopic display technology has become the main theme in the fields of IT, communications, and radio and television, and has also become a familiar term. With the improvement of stereoscopic display technology, people's enthusiasm and expectations for 3D content are also getting higher and higher. With the continuous increase of market demand, people are looking for a more convenient, quick and low-cost way to generate 3D content. The fusion of virtual and real refers to the technology of integrating virtual information into the real world through computer technology, which has broad application prospects in the fields of medicine, entertainment and military. The combination of stereoscopic display technology and virtual-real fusio...

AI Technical Summary

Problems solved by technology

On this basis, many camera tracking schemes based on monocular RGB cameras are emerging, such as the MonoSLAM system proposed by Davison, and the PTAM (Parallel Tracking and Positioning) algorithm proposed by Klein et al. 3D registration, but the tracking accuracy is still not high enough

Images