Uncalibrated multi-viewpoint image correction method for parallel camera array

A multi-viewpoint image and camera array technology, applied in image communication, image analysis, image data processing, etc., can solve difficult application requirements, high precision requirements for multi-camera calibration parameters, inability to complete multi-camera calibration, etc. , to achieve the effect of being easy to implement and increasing the scope of multi-view correction

Inactive Publication Date: 2011-05-18
SHANGHAI UNIV
View PDF5 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the above method has high requirements on the accuracy of multi-camera calibration parameters and some specific scenes cannot complete multi-camera calibration, so it is difficult to meet the requirements of all applications.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Uncalibrated multi-viewpoint image correction method for parallel camera array
  • Uncalibrated multi-viewpoint image correction method for parallel camera array
  • Uncalibrated multi-viewpoint image correction method for parallel camera array

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0056] Embodiment 1: The specific steps of the uncalibrated multi-viewpoint image correction method of this kind of parallel camera array are as follows: figure 1 The flow chart is shown. The method of the present invention is realized by programming on a computer platform, and the multi-viewpoint natural scene image collected by a parallel camera array is corrected; see figure 1 , the uncalibrated multi-viewpoint image correction method of the parallel camera array, first extracts feature points for the multi-viewpoint images collected by the parallel camera array and matches the feature points in the adjacent stereo pairs, then refines the matching information, and selects an appropriate amount of matching features Point correct each stereo pair, then project the multi-viewpoint image to the common correction plane and adjust the distance between the viewpoints, so that the corrected stereoscopic image can be synthesized to improve the quality of stereoscopic display; [0020...

Embodiment 2

[0062] Embodiment 2: This embodiment is basically the same as Embodiment 1, and the special features are as follows: see figure 2 , the specific process of the above step (1) is as follows:

[0063] (a) Establish the scale space of each viewpoint image at different scales, detect the extreme value in the scale space, and determine the position and scale of the feature point;

[0064] (b) Specify the direction parameter for each feature point according to the gradient direction distribution characteristics of the neighborhood pixels of the feature point;

[0065] (c) Generate its corresponding 128-dimensional SIFT feature vector according to the position, scale and direction characteristic information of each feature point;

[0066] (d) Take the Euclidean distance between the feature vectors as the similarity judgment measure, take a certain feature point in the left image, and find out the two feature points with the closest Euclidean distance to the right image, in these t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an uncalibrated multi-viewpoint image correction method for parallel camera array. The method comprises the steps of: at first, extracting a set of characteristic points in viewpoint images and determining matching point pairs of every two adjacent images; then introducing RANSAC (Random Sample Consensus) algorithm to enhance the matching precision of SIFT (Scale Invariant Feature Transform) characteristic points, and providing a blocking characteristic extraction method to take the fined positional information of the characteristic points as the input in the subsequent correction processes so as to calculate a correction matrix of uncalibrated stereoscopic image pairs; then projecting a plurality of non-coplanar correction planes onto the same common correction plane and calculating the horizontal distance between the adjacent viewpoints on the common correction plane; and finally, adjusting the positions of the viewpoints horizontally until parallaxes are uniform, namely completing the correction. The composite stereoscopic image after the multi-viewpoint uncalibrated correction of the invention has quite strong sense of width and breadth, prominently enhanced stereoscopic effect compared with the image before the correction, and can be applied to front-end signal processing of a great many of 3DTV application devices.

Description

technical field [0001] The invention relates to a method for correcting multi-viewpoint images, in particular to a method for correcting unmarked multi-viewpoint images of a parallel camera array. Background technique [0002] 3D TV is the next-generation TV technology after digital high-definition TV, and it has attracted more and more attention because of its unique three-dimensional, depth and roaming characteristics. The multi-camera real-time acquisition stereo display system is an important application of 3D TV. It transmits the video captured by multiple cameras in real time to the server, processes the multi-viewpoint images in the server, synthesizes the stereo images and displays them on the stereo display. For the parallel camera array, due to the unavoidable operation error and equipment precision limitation, the method of manually adjusting the camera position cannot fully simulate the placement of the ideal parallel camera array. The multi-viewpoint images...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N13/00G06T7/00G06T7/33
Inventor 张洋张兆杨安平王贺刘利亮
Owner SHANGHAI UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap