Virtual viewpoint synthesis method based on GPU acceleration

A technology of virtual viewpoint and synthesis method, applied in the fields of computer vision and image processing, can solve the problems that it is difficult to apply to occasions with high real-time requirements, the synthesis of virtual viewpoint images is slow, and the algorithm complexity is high, so as to improve the quality of image synthesis, The effect of avoiding blurring and simplifying the image fusion process

Inactive Publication Date: 2015-08-05
SOUTHEAST UNIV
View PDF6 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] (2) The academic community has proposed many synthesis algorithms and image repair algorithms to improve the quality of virtual viewpoint synthesis, but these algorithms are often complex and time-consuming to run, and are difficult to apply to occasions with high real-time requirements
[0006] (3) Most of the existing virtual viewpoint synthesis algorithms are implemented based on CPU, and the synthesis of virtual viewpoint images is relatively slow

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual viewpoint synthesis method based on GPU acceleration
  • Virtual viewpoint synthesis method based on GPU acceleration
  • Virtual viewpoint synthesis method based on GPU acceleration

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings, so that the advantages and features of the present invention can be more easily understood by those skilled in the art, so as to define the protection scope of the present invention more clearly.

[0031] see Figure 1-4 , the embodiment of the present invention includes:

[0032] A virtual viewpoint synthesis method based on GPU acceleration is based on the traditional virtual viewpoint rendering method, using GPU parallel computing to accelerate the rendering process, and improving the virtual viewpoint image rendering quality by improving the hole filling algorithm, including the following steps :

[0033] (100) Perform smoothing processing on the depth images of the left and right reference viewpoints; the smoothing processing is filter smoothing processing, which is used to reduce the discontinuity of the depth values ​​of the depth i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a virtual viewpoint synthesis method based on GPU acceleration, and a high-quality virtual viewpoint image is synthesized in an accelerating manner by utilizing a depth image based rendering (DIBR) technology and a GPU multithreading parallel characteristic. The method comprises the following steps: firstly, performing smoothing processing on depth images of a left reference viewpoint and a right reference viewpoint; secondly, restoring two-dimensional plane coordinates of various pixel points in the depth images, after the smoothing processing, of the left reference viewpoint and the right reference viewpoint to a three-dimensional space through 3D mapping; then projecting coordinates in the three-dimensional space to a virtual viewpoint imaging plane by using graphics API rendering so as to obtain a synthetic virtual viewpoint image; and, finally, performing hole filling of the synthetic virtual viewpoint image. The method can utilize a powerful parallel computing ability of a GPU, accelerate a traditional virtual viewpoint synthesis algorithm, effectively reduce rendering time, and provide a great reference for real-time virtual viewpoint synthesis.

Description

technical field [0001] The invention relates to the fields of computer vision and image processing, in particular to a virtual viewpoint synthesis method based on GPU acceleration. Background technique [0002] TV technology was born in the 20th century, and has experienced the development process from black and white to color, from analog to digital, and from standard definition to high definition. While the definition continues to improve, three-dimensional stereoscopic television (3DTV) is also developing continuously, becoming another development direction after high-definition television. In recent years, the continuous emergence of three-dimensional movies has also promoted the development of three-dimensional stereoscopic television and stereoscopic display technology. Multi-view TV is a development direction of stereoscopic TV. Compared with traditional 3D TV, multi-view TV provides images from multiple viewpoints, enabling people to obtain better stereoscopic experi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N13/00
Inventor 姚莉韩应栋
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap