A high-speed and high-quality free-viewpoint image synthesis method
A technology of viewpoint images and synthesis methods, which is applied in streaming media, image processing, and computer science, and can solve problems such as inability to achieve real-time performance.
Active Publication Date: 2019-07-30
ZHEJIANG UNIV OF TECH
View PDF3 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0006] In order to overcome the problem that the existing depth map-based rendering technology cannot achieve real-time performance, the present invention proposes a high-speed, high-quality free-viewpoint image synthesis method with good real-time performance, and adopts DIBR technology using GPU for parallel computing
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0074] The present invention will be further described below in conjunction with the accompanying drawings.
[0075] refer to figure 1 , a high-speed and high-quality free-viewpoint image synthesis method, including the following steps:
[0076] 1) Build the environment;
[0077] Use the application programming interface API provided by CUDA, the general parallel computing architecture launched by Nvidia, to query the platform and obtain the available device objects on the platform;
[0078] 2) Read the image to be processed and the processing matrix;
[0079] Use the central processing unit CPU as the host to read the reference viewpoint image and the depth information image of the adjacent camera, and keep the read image to be processed in the memory of the central processing unit CPU;
[0080] Read the orthogonal rotation matrix R of each camera, the size is 3×3; the translation matrix T, the size is 3×1; the internal reference matrix Q, the size is 3×4, and keep the rea...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a high-speed and high-quality freedom viewpoint image synthesis method. The method comprises the steps of reading images and depth images of reference viewpoints of adjacent cameras, carrying out three-dimensional conversion on the reference viewpoint images, searching edges of objects in left and right reference viewpoint depth images, three-dimensionally deforming edge pixels to new viewpoints, and erasing corresponding depth pixels at the positions of the new viewpoints; carrying out median filtering on the obtained depth images, comparing the filtered images with the depth images obtained through three-dimensional deformation, and marking changed pixels; carrying out reverse projection on the marked pixels and projecting the marked pixels to the positions of the original reference viewpoints; assigning pixel values in initial reference texture images to the pixels with coordinates the same as those of the marked pixels in the new viewpoint images; carrying out interpolation on shielded areas; carrying out proportional fusion on public areas according to the positions of the new viewpoints; and repairing residual cavities through utilization of an inpaint function in an OpenCV function base. According to the method, the timeliness is relatively high.
Description
technical field [0001] The invention relates to the fields of image processing, streaming media, numerical analysis, three-dimensional reconstruction, computer science, parallel computing, etc., in particular to a free-viewpoint image synthesis method based on depth map rendering technology using parallel computing. Background technique [0002] Free-viewpoint image synthesis is a process in which a limited number of cameras distributed at different viewpoints capture two or more images of the same scene, digitally process the captured real images, and synthesize a virtual image with a new viewpoint. On the one hand, the traditional passive relationship between people and computers can no longer meet people's psychological needs; on the other hand, people hope to fully participate in the application and obtain more real scene experience and feelings. Synthesis of virtual viewpoint images using multiple actually captured images to synthesize virtual viewpoint images is propos...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): H04N13/243H04N13/282H04N13/122
CPCH04N13/128H04N13/282
Inventor 冯远静李佳镜黄良鹏陈丰潘善伟杨勇胡键巧孔德平陈宏黄晨晨
Owner ZHEJIANG UNIV OF TECH