A virtual-real fusion method of multiple video streams and 3D scenes

Abstract

The invention discloses a virtual and actual reality integration method of multiple video streams and a three-dimensional scene and belongs to the virtual reality technical field. The virtual and actual reality integration method comprises collecting the video image information of the environment through cameras and tracking camera collection parameters; calculating a corresponding vision cone body of every camera in a three-dimensional space according to the camera collection parameters, calculating visible cameras of a user under the current viewpoint based on the corresponding vision cone bodies and scheduling a video image of every visible camera; calculating the association relation of the video image of every visible camera and a virtual object in the three-dimensional scene and performing integration on the video images and the virtual object in the three-dimensional scene according to the association relation; performing visualization on an integration result in the virtual environment and providing the interactive roaming and automatic patrol service for the user. According to the virtual and actual reality integration method of the multiple video streams and the three-dimensional scene, the plurality of cameras in the scene are timely scheduled, the virtual and actual reality integration is performed on the video images of the cameras and the three-dimensional scene, and accordingly the purpose for reflecting the real dynamic of the environment is achieved.

Description

technical field [0001] The invention relates to a virtual-reality fusion method of multi-video streams and three-dimensional scenes, more precisely, the content of multi-video images is fused with virtual objects in three-dimensional scenes, and belongs to the field of virtual reality technology. Background technique [0002] The modeling of the virtual environment is widely used in applications such as simulation, scenic spot display, and 3D maps. When the geometric information and appearance of the virtual environment are similar to or accurately correspond to the real environment, the sense of reality of the entire virtual environment will be improved to a certain extent. However, more accurate modeling of the scene requires a lot of manpower, and because the model texture is a static picture collected in advance, the virtual environment constructed in this way cannot reflect the dynamic changes of events and activities in the real environment. Therefore, reflecting the r...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to solve the problem that the static virtual scene cannot reflect the dynamic changes of the environment, and proposes a virtual-real fusion method of multiple video streams and 3D scenes. The method dispatches multiple cameras in real time, and fuses their video images with the 3D scene draw

Images