Depth-based light field splicing method

Abstract

The invention discloses a depth-based light field splicing method. The depth-based light field splicing method comprises: inputting a light field to be spliced and a sub-aperture image of the light field, and estimating a light field depth of the sub-aperture image of the light field to obtain a depth map of the light field; extracting feature points in the sub-aperture image of the light field, matching the feature points to obtain feature point pairs, and screening the feature point pairs to obtain matching feature point pairs; performing 4D meshing on the light field to be spliced, and predicting a global homography transformation matrix according to the matching feature point pairs; establishing a weight matrix according to the depth and position relationship between the feature pointsand center points of the meshes; and predicting the optimal homography transformation matrix of each mesh according to the global homography transformation matrix and the weight matrix, mapping the light field according to the optimal homography transformation matrix of each mesh in the light field, fusing the light field, and obtaining a light filed splicing result. The invention solves the problem of dislocation and ghosting caused by large parallax changes, and realizes a precise parallax-tolerant light field splicing method.

Description

technical field [0001] The invention relates to the fields of computer vision and digital image processing, in particular to a depth-based light field splicing method. Background technique [0002] Light field imaging records light information from all directions by adding a microlens array between the main lens and the sensor, so as to obtain a complete information optical radiation field. With the continuous increase in the resolution of optical sensors and the gradual marketization of light field cameras, the practical value of light field imaging technology is becoming higher and higher. Compared with the traditional digital camera, the light field camera based on the microlens array can record the spatial position information and direction information of the three-dimensional scene at the same time, so the light field data collected by the light field camera based on the light field camera has a wide range of applications, such as refocusing , depth estimation, signifi...

AI Technical Summary

Problems solved by technology

[0006] In order to solve the above technical problems, the present invention proposes a depth-based light field stitching method, which solves the problem of dislocation and ghosting of results caused by large parallax changes, and realizes an accurate parallax-tolerant light field stitching method

Images