Method for correcting array multiple-view image of calibrated parallel cameras

A multi-view image and correction method technology, which is applied in image communication, image analysis, image data processing, etc., can solve the problems of not considering image rotation distortion, large cropped edges, and affecting correction efficiency, so as to improve subjective quality, The effect of small rotation angle and enlarged multi-view image area

Active Publication Date: 2013-05-01
SHANGHAI UNIV
View PDF2 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Kang Y S, Lee C, Ho Y S. An efficient rectification algorithm for multi-view images in parallel camera array, 3DTV Conference: The True Vision-Capture, Transmission and Display of 3D Video, Istanbul, Turkey: IEEE, pp.61-64 , 2008 proposed a method of using camera calibration parameters to fit a common baseline and correct multi-view images of parallel cameras, but did not consider the image rotation distortion introduced in the image correction process
If the rotation distortion introduced by the multi-view image correction process is not strictly limited, on the one hand, it will cause visual discomfort, such as the upright object becomes tilted; The number of filled holes is large, which affects the correction efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for correcting array multiple-view image of calibrated parallel cameras
  • Method for correcting array multiple-view image of calibrated parallel cameras
  • Method for correcting array multiple-view image of calibrated parallel cameras

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] See figure 1 , This calibrated parallel camera array multi-view image correction method first uses the external parameters of each camera in the pre-calibrated parallel camera array to design a unified corrected camera physical coordinate system direction to ensure that the coordinate axis rotation adjustment is minimal; then in the public Set the origin of the physical coordinate system of each camera after calibration, establish the physical coordinate system of each camera after calibration; finally set the internal parameters of the camera after calibration uniformly, calculate the calibration conversion matrix of each camera, and calibrate the multi-view image; its specific operation The steps are:

[0057] 1) Design a unified corrected camera physical coordinate system direction: under the minimum constraint of coordinate axis rotation adjustment, determine the Y coordinate axis, Z coordinate axis and X coordinate axis direction of the unified corrected camera physica...

Embodiment 2

[0063] The application environment of the embodiment of the present invention is as follows: a parallel camera array composed of 8 Point Grey 2.0 industrial cameras is adopted, the acquisition resolution is 1280*960, and the frame rate is 25 frames per second. The internal and external parameters of each camera have been calibrated, and the captured checkerboard calibration template image is used as the test object. The camera parameters in the camera array have been pre-calibrated, Respectively The rotation matrix, translation vector and internal parameter matrix of each camera, the first The projection matrix of each camera is ;

[0064] See figure 1 , This calibrated parallel camera array multi-view image correction method first uses the external parameters of each camera in the pre-calibrated parallel camera array to design a unified corrected camera physical coordinate system direction to ensure that the coordinate axis rotation adjustment is minimal; then in the public ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for correcting an array multiple-view image of calibrated parallel cameras. The method comprises the steps of: firstly, designing a uniform corrected camera physical coordinate system direction by using each camera external parameter in a pre-calibrated parallel camera to ensure that the rotary adjustable amount of a coordinate axis is minimum; then equally setting physical coordinate system original points of all corrected cameras at intervals on a public base line, establishing physical coordinate systems of all corrected cameras; and finally, uniformly setting internal parameters of the corrected cameras, calculating a correction conversion matrix of each camera and correcting multi-view images. According to the invention, vertical optical parallax can be effectively eliminated, and horizontal optical parallax equal distribution is realized, the rotating angle of the coordinate system in a correction process is small, the corrected image rotary distortion is small and accords with the vision habit of eyes, and thus the synthetic view image quality is remarkably improved, and the further processing of the subsequent processing link is facilitated.

Description

Technical field [0001] The invention relates to a method for correcting a multi-view image of a parallel camera array, in particular to a method for correcting a multi-view image of a calibrated parallel camera array. Background technique [0002] The Free Viewpoint Television (FTV) system not only gives the audience a strong sense of stereoscopic visual impact, but also provides the audience with the "moving and changing scenes" function for interactively choosing the viewing position. In the FTV system, the multi-view video is simultaneously captured by the camera array and sent to the server for processing. The final stereo image is displayed on the autostereoscopic display. Every two adjacent videos form a viewpoint video, and viewers can see different viewpoint videos in different positions, so that they can interactively choose the angle of viewing the stereoscopic video. In multi-view video processing, multi-view image correction is a key issue. Since the installation an...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N13/00G06T7/00
Inventor 安平李春华尤志翔阎吉辰张兆杨
Owner SHANGHAI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products