Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for synthesizing virtual sight points of vehicle-mounted multi-lens camera looking-around system

A virtual viewpoint and camera technology, applied in the field of virtual viewpoint synthesis, can solve the problem of increased calculation

Active Publication Date: 2014-02-12
XI AN JIAOTONG UNIV
View PDF2 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since this method is to process the upsampled image of the reference image, the amount of calculation during synthesis will be greatly increased.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for synthesizing virtual sight points of vehicle-mounted multi-lens camera looking-around system
  • Method for synthesizing virtual sight points of vehicle-mounted multi-lens camera looking-around system
  • Method for synthesizing virtual sight points of vehicle-mounted multi-lens camera looking-around system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] The present invention will be further described in detail below in conjunction with specific embodiments, which are explanations of the present invention rather than limitations.

[0074] figure 1 It is a flow chart of the virtual viewpoint synthesis method for road traffic scene in the present invention. The main principle is as follows: First, use the graph cut method to perform disparity estimation on the left and right viewpoint input reference images, so as to obtain the left and right viewpoint depth maps corresponding to the left and right viewpoint images. Secondly, based on the estimated left and right viewpoint depth maps, use the forward mapping method to calculate the left and right viewpoint prediction depth maps of the left and right viewpoints at the virtual viewpoint, and use the median filter method to remove the predicted depth maps formed in the forward mapping process. small hollow areas. At the same time, in order to solve the problem of overlappi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method for synthesizing virtual sight points of a vehicle-mounted multi-lens camera looking-around system. The method comprises the following steps that S1, a left sight point reference image and a right sight point reference image are input in the looking-around system and disparity estimation is conducted so that a left sight point depth map and a right sight point depth map can be obtained; S2, according to the left sight point depth map and the right sight point depth map, a left sight point predicated depth map and a right sight point predicated depth map are generated respectively and correspondingly; S3, according to the left sight point reference image, the right sight point reference image, the corresponding left sight point predicated depth map and the corresponding right sight point predicated depth map, a left sight point predicated map and a right sight point predicated map are respectively generated; S4, a virtual sight point image is synthesized through the left sight point predicated map and the right sight point predicated map. According to the method for synthesizing the virtual sight points of the vehicle-mounted multi-lens camera looking-around system, the thought of a depth credible image is introduced, a shielding image is generated through the depth credible image, and the shielding image can clearly and accurately describe the information that interpolation information should come from which specific zone of which sight point when the virtual sight point image is synthesized. Theories and experiment results prove that a shielding zone can be effectively obtained through the method and the quality of the synthesized virtual sight point image is improved. However, according to existing methods, detection can not be conducted effectively and the virtual sight point image with the high quality can not be obtained.

Description

technical field [0001] The invention relates to the technical field of virtual viewpoint synthesis, in particular to a virtual viewpoint synthesis method for a vehicle-mounted multi-eye camera surround view system. Background technique [0002] Virtual viewpoint synthesis technology refers to the use of two or more real viewpoint images from the same scene to generate a new viewpoint image. It has a wide range of applications in many fields such as environmental cognition, virtual reality, geographic information system, remote video conferencing, military, medical, education, entertainment, and film and television special effects. Depth Image Based Rendering (DIBR) technology is one of the most promising technologies in virtual view synthesis technology. According to the depth information and camera parameters of the reference image, this technology projects the reference image to the target image coordinate system through 3D image mapping, and can realize the rapid renderi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04N13/00G06T7/00G06T5/00
CPCY02T10/56Y02T10/40
Inventor 刘跃虎来毅张驰苏远歧
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com