A Depth-Based Light Field Stitching Method
A depth and light field technology, applied in the field of depth-based light field splicing, can solve problems such as result dislocation and ghosting, and achieve the effect of expanding the viewing angle, improving flexibility, and ensuring the consistency of spatial and angular domains.
Active Publication Date: 2020-10-02
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF12 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0006] In order to solve the above technical problems, the present invention proposes a depth-based light field stitching method, which solves the problem of dislocation and ghosting of results caused by large parallax changes, and realizes an accurate parallax-tolerant light field stitching method
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0027] The present invention will be further described below with reference to the accompanying drawings and in combination with preferred embodiments.
[0028] Such as figure 1 As shown, the preferred embodiment of the present invention discloses a depth-based light field stitching method, including the following steps:
[0029] A1: Input the light field to be spliced and the sub-aperture image of the light field, and estimate the depth of the light field on the sub-aperture image of the light field to obtain the depth map of the light field;
[0030] Specifically, the light field to be spliced is input, decoded and preprocessed to obtain a sub-aperture image of the light field; and the depth map of the light field is obtained by estimating the depth of the light field on the sub-aperture image of the light field.
[0031] In this embodiment, taking the splicing of two light fields as an example, L r (x,y,u,v) is the reference light field, L w (x, y, u, v) is the light...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a depth-based light field splicing method, comprising: inputting a light field to be spliced and a sub-aperture image of the light field, performing light field depth estimation on the sub-aperture image of the light field to obtain a depth map of the light field; Extract the feature points in the sub-aperture image of the light field, match the feature points to get the feature point pairs, and filter the feature point pairs to get the matching feature point pairs; perform 4D gridding on the light field to be spliced, and according to the matching feature points To predict the global homography transformation matrix; and establish a weight matrix according to the depth and position relationship between the feature point and the grid center point; then predict the optimal homography of each grid according to the global homography transformation matrix and weight matrix According to the optimal homography transformation matrix of each grid in the light field to map the light field, the light field is fused to obtain the light field splicing result. The invention solves the problems of result misalignment and double images caused by large parallax changes, and realizes a precise parallax-tolerant light field splicing method.
Description
technical field [0001] The invention relates to the fields of computer vision and digital image processing, in particular to a depth-based light field splicing method. Background technique [0002] Light field imaging records light information from all directions by adding a microlens array between the main lens and the sensor, so as to obtain a complete information optical radiation field. With the continuous increase in the resolution of optical sensors and the gradual marketization of light field cameras, the practical value of light field imaging technology is becoming higher and higher. Compared with the traditional digital camera, the light field camera based on the microlens array can record the spatial position information and direction information of the three-dimensional scene at the same time, so the light field data collected by the light field camera based on the light field camera has a wide range of applications, such as refocusing , depth estimation, signifi...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06T3/40G06T7/33G06T7/162G06K9/62
CPCG06T3/4038G06T7/162G06T7/337G06T2207/20221G06T2207/10052G06F18/23213
Inventor 金欣王培戴琼海
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV