Image registration method and device

Abstract

The invention discloses an image registration method and device. The method includes: determining the target plane according to the position of the optical center of the camera in the planar camera array; and orthogonally projecting the optical center of each camera in the planar camera array to the target plane , to get the projection point of the optical center of each camera; according to the projection point of the optical center of the camera in the plane camera array, a rectangular grid is generated on the target plane; according to the rectangular grid, the target grid point of each camera is obtained; The target grid point of each camera is the origin, and the target camera coordinate system of each camera is determined; according to the spatial position relationship between the cameras in the planar camera array and the target camera coordinate system, the images collected by the cameras in the planar camera array are registered . In the embodiment of the present invention, by re-determining the target camera coordinate system of the camera, the complexity of subsequent image registration is greatly reduced.

Description

technical field [0001] The present invention relates to the field of image processing, and more particularly, to an image registration method and device. Background technique [0002] Virtual view rendering is an important means of converting 2D plane images into 3D stereoscopic images. Virtual view rendering includes steps such as image acquisition in the scene, image registration, depth map prediction, and virtual view generation. Before virtual view rendering, images in the scene need to be collected, and there are many ways to collect images in the scene, among which, the method of collecting images in the scene by means of a camera array is widely used. [0003] In the prior art, a large number of camera array arrangements have been proposed, for example, high-density camera arrays, sparse camera arrays, distributed light field cameras, and planar camera arrays, among which planar camera arrays are an effective way of image acquisition in the scene . [0004] However...

AI Technical Summary

Problems solved by technology

[0004] However, in practice, due to the error of the camera placement, it is often difficult to align the planar camera array accurately. After using unaligned horizontal or vertical adjacent cameras to collect images, the corresponding pixels between the collected images may not necessarily be located in the horizontal direction. Or in the vertical direction, it is necessary to expand the search range of corresponding pixels, resulting in high complexity of the image registration algorithm, which is not conducive to the real-time rendering of subsequent virtual viewpoints

Images