Global-local adaptive optimization panoramic light field splicing method

A local self-adaptive and global technology, applied to the details of image stitching, image data processing, instruments, etc., can solve problems such as misalignment, ghosting, and inaccurate stitching results

Pending Publication Date: 2021-03-09
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing panoramic light field stitching algorithms usually have dislocation and ghosting problems caused by parallax, resulting in inaccurate stitching results.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Global-local adaptive optimization panoramic light field splicing method
  • Global-local adaptive optimization panoramic light field splicing method
  • Global-local adaptive optimization panoramic light field splicing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] The present invention will be further described below with reference to the accompanying drawings and in combination with preferred embodiments. When implementing the steps of the present invention in a specific embodiment, it can be operated in the following manner. It should be noted that the specific methods used in the implementation process are only examples, and the scope of the present invention includes but is not limited to the following methods listed.

[0055] The existing light field stitching method performs light field registration through feature matching and homography transformation matrix mapping, which is divided into two methods: global homography transformation matrix registration and grid homography transformation matrix registration. The overall shape of the light field registered by the homography transformation matrix is ​​reasonable, but it cannot solve the dislocation and ghosting caused by parallax. The grid homography transformation matrix r...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a panoramic light field splicing method based on global local adaptive optimization. The panoramic light field splicing method comprises the following steps: inputting a plurality of light fields to be spliced; extracting, matching and screening feature points of the to-be-spliced light fields to calculate a global homography transformation matrix of all the to-be-spliced light fields; respectively carrying out 4D meshing on the plurality of to-be-spliced light fields, evaluating the global registration precision of each grid according to the global homography transformation matrix, calculating a local homography transformation matrix of the grid of which the global registration precision is lower than a preset threshold, and evaluating the local registration precision of the corresponding grid according to the local homography transformation matrix; and comparing the global registration precision with the local registration precision, taking the homography transformation matrix with the highest precision for each grid, and fusing the light fields to obtain a splicing result. According to the invention, the overall and detail splicing results of the light field are most accurate, so that an accurate multi-light-field panoramic splicing method is realized.

Description

technical field [0001] The invention relates to the fields of computer vision and digital image processing, in particular to a global-local adaptive optimization panoramic light field splicing method. Background technique [0002] The microlens array between the main lens and the sensor of the light field camera can effectively capture light information, and simultaneously record the direction and intensity information of light in one shot. Therefore, the light field can accurately reproduce the stereoscopic parallax, motion parallax, reflection, refraction, refocusing and other effects in the scene, provide users with a very realistic and immersive experience, and provide a great boost to the research in the field of virtual reality. However, limited by the optical structure of the light field camera, its field of view is small, and in order to benefit from the great potential of the light field, it is necessary to expand the field of view of the light field. The panoramic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T3/40
CPCG06T3/4038G06T2200/32
Inventor 金欣周思瑶
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap