Method for correcting array multiple-view image of calibrated parallel cameras

A multi-view image and correction method technology, which is applied in image communication, image analysis, image data processing, etc., can solve problems such as not considering image rotation distortion, large cropped edges, and affecting correction efficiency, so as to improve subjective quality, The effect of small rotation angle and enlarged multi-view image area

Active Publication Date: 2015-05-06
SHANGHAI UNIV
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Kang Y S, Lee C, Ho Y S. An efficient rectification algorithm for multi-view images in parallel camera array, 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, Istanbul, Turkey: IEEE, pp.61-64 , 2008 proposed a method of using camera calibration parameters to fit a common baseline and correct multi-view images of parallel cameras, but did not consider the image rotation distortion introduced in the image correction process
If the rotation distortion introduced by the multi-view image correction process is not strictly limited, on the one hand, it will cause visual discomfort, such as the upright object becomes tilted; The number of filled holes is large, which affects the correction efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for correcting array multiple-view image of calibrated parallel cameras
  • Method for correcting array multiple-view image of calibrated parallel cameras
  • Method for correcting array multiple-view image of calibrated parallel cameras

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] see figure 1 , the multi-view image correction method of the parallel camera array has been calibrated. Firstly, using the pre-calibrated external parameters of each camera in the parallel camera array, design a uniform direction of the physical coordinate system of the camera after correction to ensure the minimum adjustment of the coordinate axis rotation; Set the origin of the physical coordinate system of each camera after correction with equal spacing on the baseline, establish the physical coordinate system of each camera after correction; finally set the internal parameters of the corrected camera uniformly, calculate the correction transformation matrix of each camera, and correct the multi-view image; the specific operation The steps are:

[0057] 1) Design a unified corrected camera physical coordinate system direction: under the minimum constraint condition of the coordinate axis rotation adjustment, determine the directions of the Y coordinate axis, Z coordi...

Embodiment 2

[0063] The application environment of the embodiment of the present invention is as follows: a parallel camera array composed of 8 Point Gray 2.0 industrial cameras is adopted, the acquisition resolution is 1280*960, and the frame rate is 25 frames per second. The internal and external parameters of each camera have been calibrated, and the captured checkerboard calibration template image is used as the test object. The camera parameters in the camera array have been pre-calibrated, respectively The rotation matrix, translation vector and internal parameter matrix of a camera, the first The projection matrix of a camera is ;

[0064] see figure 1 , the multi-view image correction method of the parallel camera array has been calibrated. Firstly, using the pre-calibrated external parameters of each camera in the parallel camera array, design a uniform direction of the physical coordinate system of the camera after correction to ensure the minimum adjustment of the coordi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for correcting an array multiple-view image of calibrated parallel cameras. The method comprises the steps of: firstly, designing a uniform corrected camera physical coordinate system direction by using each camera external parameter in a pre-calibrated parallel camera to ensure that the rotary adjustable amount of a coordinate axis is minimum; then equally setting physical coordinate system original points of all corrected cameras at intervals on a public base line, establishing physical coordinate systems of all corrected cameras; and finally, uniformly setting internal parameters of the corrected cameras, calculating a correction conversion matrix of each camera and correcting multi-view images. According to the invention, vertical optical parallax can be effectively eliminated, and horizontal optical parallax equal distribution is realized, the rotating angle of the coordinate system in a correction process is small, the corrected image rotary distortion is small and accords with the vision habit of eyes, and thus the synthetic view image quality is remarkably improved, and the further processing of the subsequent processing link is facilitated.

Description

technical field [0001] The invention relates to a method for correcting multi-view images of parallel camera arrays, in particular to a method for correcting multi-view images of calibrated parallel camera arrays. Background technique [0002] The Free Viewpoint Television (FTV) system not only brings a strong sense of stereoscopic visual impact to the audience, but also provides the audience with the function of "moving and changing scenes" to interactively select the viewing position. In the FTV system, the multi-view video is captured synchronously by the camera array, sent to the server for processing, and finally the stereoscopic image is displayed on the autostereoscopic display. Every two adjacent viewing videos form a viewpoint video, and viewers can see different viewpoint videos at different positions, so that they can interactively choose the angle to enjoy the stereoscopic video. In multi-view video processing, multi-view image correction is a key issue. Since ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N13/00G06T7/00
Inventor 安平李春华尤志翔阎吉辰张兆杨
Owner SHANGHAI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products