Automatic Matching and Correction Method for Video Texture Projection in 3D Virtual Reality Fusion Environment

Abstract

The invention relates to an automatic matching correction method of a video texture projection in a three-dimensional virtual-real fusion environment and a method of fusing an actual video image and a virtual scene. The automatic matching correction method comprises the steps of constructing the virtual scene, obtaining video data, fusing video textures and correcting a projector. A shot actual video is subjected to virtual scene fusion on the surface of the complicated scene such as an earth surface and a building by a texture projection mode, the expression and showing abilities of dynamic scene information in the virtual-real environment are improved, and the layered sense of the scene is enhanced. A dynamic video texture coverage effect of the large-scale virtual scene can be realized by increasing the number of the videos at different shooting angles, so that a dynamic reality effect of the virtual-real fusion of the virtual-real environment and the display scene is realized. The obvious color jump is eliminated, and a visual effect is improved by conducting color consistency processing on video frames in advance. With the adoption of an automatic correction algorithm, the virtual scene and the actual video can be fused more precisely.

Description

technical field [0001] This article relates to virtual reality, in particular to a method for fusing and correcting real video images and virtual scenes, and belongs to the technical fields of virtual reality, computer graphics, computer vision, and human-computer interaction. Background technique [0002] In a virtual reality system, it is the most common method to use static pictures to express the details of buildings or ground surfaces, which are usually realized by texture mapping. The disadvantage of this method is that the texture of the scene surface will not change once it is set, and the neglect of the changing elements of the scene model surface reduces the sense of reality of the virtual environment and cannot give people an immersive feeling. In order to eliminate the lack of realism caused by static pictures, it is an intuitive idea to use video instead of pictures. At this stage, there are also some systems that add video elements, but most of them use the fo...

AI Technical Summary

Problems solved by technology

However, these methods are all applied to two-dimensional images, and have relatively large limitations when used in three-dimensional space.

Moreover, the algorithms related to projector correction at this stage are mostly algorithms for trapezoidal correction of the projection area under the "projector-screen" system, such as: multi-projector image correction method and equipment, application number 201010500209.6, and the correction method is limited to two-dimensional space In the above method, by obtaining the independent image information of the non-overlapping area collected by the two cameras and the correction parameters corresponding to the independent images, the correction process is performed according to the video data of the camera corresponding to the correction parameters, and the correction is only for images with overlapping or small overlapping areas

Real 3D display method based on multi-projector rotating screen 3D images that can be touched, application number: 200810114457.X, by obtaining 3D space description to obtain cross-sectional images at different angles, so that the hands can directly touch the 3D images, and at the same time improve the 3D images contrast, but this application mainly relies on the rotating screen to solve the problem of touchable 3D images, which is different from the application scenario of this work

[0004] The above patent application or the feature matching method in the prior art does not have much reference value in the correction of the three-dimensional space projector

Images