Image registration and splicing method of multi-view camera and device thereof

Abstract

The invention relates to the digital image processing technical field and discloses an image registration and splicing method of a multi-view camera and a device thereof. The multi-view camera in the invention comprises at least two cameras; the registration method comprises following steps: obtaining multiple time domain continuous synchronous image sets; extracting feature points of the synchronous images in the synchronous image sets and calculating the depth values of the synchronous images; self-adaptively dividing the feature points of the synchronous images into different feature point planes according to the depth values; matching the feature points divided into the same feature point plane, thus obtaining the matched feature points of the feature point planes, building the mapping matrixes of the feature point planes according to the matched feature points; and generating registration parameters based on the multi-dimensional mapping matrixes corresponding to the multiple feature point planes. According to the method and the device of the invention, the multi-dimensional mapping matrixes are built according to the depth information self-adaptively classified feature points; the registration of the multi-view video images are more accurate; and the problems such as irregular image splicing resulted from that single plane mapping cannot give consideration to the relatively higher depth of field problem are solved.

Description

technical field [0001] The invention relates to the technical field of digital image processing, in particular to an image registration and splicing technology of a multi-purpose camera. Background technique [0002] The current main image registration stitching technology is introduced as follows: [0003] 1) Single plane registration [0004] Image registration refers to the process of processing two overlapping images of the same scene taken by the same or different sensors from different angles. It geometrically calibrates the reference image and the image to be registered. The difference between two images mainly comes from different imaging conditions, and image registration is also called image matching. The mathematical description of image registration can be defined as spatial transformation and grayscale transformation between images to be registered. It is required that some of the images to be registered are logically the same. [0005] The feature point ma...

AI Technical Summary

Problems solved by technology

[0012] The purpose of the present invention is to provide an image registration and splicing method of a multi-eye camera and its device, which can adaptively classify the feature points according to the depth information, thereby establishing a multi-dimensional mapping matrix, so that the registration of multi-eye video images It is more accurate and overcomes the problem of uneven image stitching caused by single-plane mapping due to the inability to take into account the problem of large depth of field

Images