An Efficient GPU 3D Video Fusion Rendering Method

Abstract

The invention relates to an effective GPU three-dimensional video fusion drawing method. The effective GPU three-dimensional video fusion drawing method includes steps that acquiring video data input by multi-video streaming through a video object buffer region; carrying out extensible layered decoding on the acquired video data in a GPU, wherein the decoding thread is controlled and driven by partial visual characters of the corresponding three-dimensional scene on which the video object is depended, and the visual characters comprise visibility, layered attribute and time consistency; after finishing decoding, binding all the image sequences and texture IDS obtained through decoding corresponding time slices according to a synchronization time, and storing in an image texture buffer region; using spatio-temporal texture mapping functions to sample the textures in the image texture buffer region, mapping to the surface of an object in the three-dimensional scene, finishing the other operations relevant to third dimension drawing, and outputting a video-based virtual-real fusion drawing result. The effective GPU three-dimensional video fusion drawing method is capable of meeting the effectiveness demand, precision demand and reliability demand of the virtual-real three-dimensional video fusion.

Description

technical field [0001] The invention belongs to the technical fields of computer graphics, virtual reality, and augmented reality, and in particular relates to an efficient rendering method for combining three-dimensional scenes and multi-channel video on a GPU, which can enhance the internal and external details of large-scale three-dimensional scenes, and provide users with time-sequential changes Real-time high-fidelity display of dynamic 3D scenes. Background technique [0002] In recent years, the powerful parallel computing capability of GPU has been gradually applied to video encoding and decoding. Literature [Shen 2005, G.Shen, G.-P.Gao, S.Li, H.-Y.Shum, and Y.-Q.Zhang,"Accelerate video decoding with generic GPU,"IEEE Trans.Circuits Syst.Video Technol., vol.15, no.5, pp.685-693, May 2005.] Transplanted the three modules of motion compensation, reconstruction and color space conversion in Microsoft WMV-8 decoder to GPU, and obtained better acceleration effect. Lite...

AI Technical Summary

Problems solved by technology

[0009] Aiming at the problem that the traditional entire video processing and three-dimensional graphics processing flow are completely separated architectures and the resulting low efficiency of video decoding and virtual-real fusion rendering affects the real-time performance of the system, the present invention proposes a new type of high-efficiency GPU. The 3D video fusion rendering method can greatly improve the efficiency of virtual reality fusion rendering in multi-channel video-based virtual reality systems or enhanced display systems

Images