A GPU-based real-time rendering method in a binocular system

A real-time rendering, dual-purpose technology, applied in 3D image processing, image data processing, instruments, etc., can solve the problems of bandwidth consumption, difficult application of 3DTV system, and high algorithm complexity

Active Publication Date: 2016-01-13
SHANGHAI UNIV
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The image inpainting algorithm can effectively fill the hole in the virtual viewpoint, but its algorithm complexity is extremely high, and it is difficult to apply it to the real-time 3DTV system
In addition, LDI (Layered Depth Image) can also effectively fill holes, which allows holes to be stored in the corresponding layer, so that holes can be filled with these pixels, but LDI not only increases the computational complexity but also consumes a lot of bandwidth.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A GPU-based real-time rendering method in a binocular system
  • A GPU-based real-time rendering method in a binocular system
  • A GPU-based real-time rendering method in a binocular system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] see figure 1 , the real-time rendering method based on GPU in this binocular system is characterized in that firstly the hole mask image is drawn at the sending end of the binocular system and the texture information HFI of the large hole is extracted, and then the extracted HFI is used to fill in the receiving end of the system Large holes, and use interpolation algorithm to fill small holes; in order to meet the real-time requirements, use GPU to accelerate the drawing of virtual viewpoint images; first use CUDA technology to project the pixels in the texture image into three-dimensional space, and then apply OpenGL technology The pixels of are projected onto a two-dimensional plane to complete the drawing of the virtual viewpoint image; the steps are:

[0029] (1) The sending end draws the hole mask image and extracts the texture information: draws the hole mask image, uses the hole mask image to find the maximum value of the large hole in the horizontal direction, a...

Embodiment 2

[0033] This example is basically the same as Example 1, and the special features are as follows:

[0034] The specific steps of the step (1) that the sending end draws the hole mask image and extracts the texture information are as follows:

[0035] ① Use the depth image and its corresponding vertex index to perform three-dimensional image transformation. After the transformation, the color buffer is assigned with 0 and 255 respectively, where 0 represents the hole area and 255 represents the non-hole area. According to the storage characteristics of OpenGL, the vertex index of the image, the color data of the vertex and the depth information of the vertex are stored in the vertex buffer, the color buffer and the depth buffer respectively; and the hole mask is an image that plays a marking role. Only record the position of the hole, without considering the corresponding color data;

[0036] ② Use the hole mask image to find the maximum value in the horizontal direction of the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a real-time rendering method based on a GPU in a binocular system. The real-time rendering method comprises the following steps: rendering out a cavity mask image at the sending end of the binocular system and extracting texture information of a large hole; filling the large hole by virtue of the extracted texture information at the receiving end of the system, and using an interpolation algorithm to fill a small hole. According to the invention, the GPU is used to quicken the rendering of a virtual viewpoint image; firstly, a CUDA (Compute Unified Device Architecture) technology is used to project each pixel to a three-dimensional space; and then an OpenGL (Open Graphics Library) technology is used to project the pixel in the three-dimensional space to a two-dimensional plane to finish rendering the virtual viewpoint image. The real-time rendering method greatly improves the rendering speed, and the synthesized novel viewpoint image achieves a good effect on subjective and objective quality, so that real-time rendering of the binocular system can be achieved.

Description

technical field [0001] The invention relates to a rendering technology based on a depth image in a binocular three-dimensional video system, in particular to a real-time rendering method based on a GPU (graphics processor) in a binocular system. Background technique [0002] 3DTV (three-dimensional television) is one of the main applications of stereoscopic display technology. Its typical system components are as follows: video acquisition, encoding and transmission, decoding at the receiving end, 3D (three-dimensional) scene reconstruction and 3D display. The traditional TV system only needs to transmit one channel of video, while the 3DTV system needs to transmit two or more channels of video. However, considering the cost of the camera and the limitation of bandwidth, only a limited amount of video can be transmitted. Therefore, virtual viewpoint drawing at the terminal is very difficult. It is particularly important, and the quality of 3D scene reconstruction is also dir...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T15/20
Inventor 郑专安平邬芙琼王奎张兆杨
Owner SHANGHAI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap