Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Virtual viewpoint generation method and device

A virtual view point and multi-view point technology, applied in the field of image processing, can solve the problems of slow speed, time-consuming, and low generation efficiency of virtual view points for parallax images, and achieve the effect of improving real-time performance and quality, and improving generation efficiency

Active Publication Date: 2022-04-26
BEIJING UNIV OF POSTS & TELECOMM +1
View PDF7 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004]However, when generating virtual viewpoints of real scenes, it is necessary to collect multi-viewpoint images through binocular camera arrays and obtain parallax images, while DIBR is collecting multi-viewpoints When processing images, it is necessary to perform time-consuming calibration and attitude calculation on the binocular camera to correct the epipolar line of the multi-viewpoint image, and the speed of obtaining the parallax image by DIBR is slow, and the real-time performance cannot be guaranteed, resulting in low generation efficiency of virtual viewpoints.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Virtual viewpoint generation method and device
  • Virtual viewpoint generation method and device
  • Virtual viewpoint generation method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of this application Examples, not all examples. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of this application.

[0039] In order to better understand the solutions, the technical terms involved in the embodiments of the present invention are explained.

[0040] Parallax is the pixel-level difference between the projection positions of the left and right images of the 3D points in the scene in the two binocular images captured by the binocular camera;

[0041] Stereo matching is the process of calculating the parallax value corresponding to ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a virtual viewpoint generation method and device. The method comprises the following steps: according to a homography matrix determined by each checkerboard image shot by each binocular camera, carrying out homography transformation on a multi-view target image collected by each binocular camera to obtain a horizontal multi-view image; inputting the horizontal multi-view image into the trained parallax estimation model to obtain a parallax image; weighting the parallax image according to the control factors corresponding to different positions, and performing forward mapping according to the weighted parallax image and the horizontal multi-viewpoint image to generate a virtual viewpoint image; wherein the parallax estimation model is determined after each virtual image and dense real parallax are input into a full convolutional network for training. According to the virtual viewpoint generation method provided by the embodiment of the invention, the generation efficiency of the virtual viewpoint can be improved.

Description

technical field [0001] The present application relates to the technical field of image processing, and in particular to a method and device for generating a virtual viewpoint. Background technique [0002] The real world is three-dimensional, but the current mainstream display devices are still two-dimensional. 3D display, especially naked-eye 3D display, has received more and more attention. Naked-eye 3D display requires dense viewpoint images, and there are many difficulties in dense viewpoint acquisition with binocular camera arrays, such as synchronous adjustment between binocular camera arrays, binocular camera calibration and attitude calculation, and data storage and transmission. Therefore, in practical applications, a small number of real stereo cameras are usually used to collect sparse viewpoints, and dense viewpoints are generated by virtual viewpoint generation methods. [0003] Virtual viewpoint generation is the key to promoting the development of 3D display...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N13/111H04N13/106H04N13/122H04N13/261
CPCH04N13/111H04N13/106H04N13/122H04N13/261
Inventor 桑新柱叶晓倩王华春齐帅郭潇徐炜张子强王葵如颜玢玢
Owner BEIJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com