De-shielding method of synthesized aperture of light field camera

A technology for synthesizing apertures and light-field cameras, which is applied in image data processing, instruments, computing, etc., and can solve problems such as the lack of sub-aperture synthesis of light-field cameras

Active Publication Date: 2017-11-28
SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
View PDF7 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there is currently a lack of theoretical research on the subaperture synthesis problem for light field cameras

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • De-shielding method of synthesized aperture of light field camera
  • De-shielding method of synthesized aperture of light field camera
  • De-shielding method of synthesized aperture of light field camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] The present invention will be further described below with reference to the accompanying drawings and in combination with preferred embodiments.

[0058] Such as figure 1 As shown, the synthetic aperture de-occlusion method of the light field camera in the preferred embodiment of the present invention includes the following steps:

[0059] A1: Depth calculation: According to the input light field information, all sub-aperture images are obtained, all sub-aperture images include the central perspective image and other perspective images, and the depth information of the central perspective image is calculated;

[0060] In this embodiment, the input is 5D light field information, combined with the depth feature of the light field information, the depth value at each pixel of the central viewing angle is calculated by using a depth algorithm.

[0061] A2: Feature point detection: Detect feature points of all sub-aperture images and obtain their coordinates.

[0062] In t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a de-shielding method of a synthesized aperture of a light field camera. The method comprises steps of according to input light field information, obtaining all sub-aperture images; detecting characteristic points of all sub-aperture images; selecting a region on a center view angle image, keeping characteristic points in the selected region and abandoning characteristic points outside the selected region, wherein a shielding object and a shielded object on a target plane are arranged in the selected region; matching the characteristic points obtained in the previous step with characteristic points of the rest view angle images, and carrying out screening to obtain characteristic point pairs; through the screened out characteristic points, calculating homography transform matrixes of the center view angle image and the rest view angle images; through the homography transform matrixes, carrying out mapping on the rest view angle images; and averaging all mapped sub-aperture images so as to obtain the final sub-aperture synthesized image. According to the invention, small-size shielding objects in front of a lens can be removed and information behind the shielding object can be acquired.

Description

technical field [0001] The invention relates to the fields of computer vision and digital image processing, in particular to a synthetic aperture de-occlusion method for a light field camera. Background technique [0002] In 1936, Gershun proposed the concept of light field, which is used to describe the transmission characteristics of light radiance. In 1996, Marc Levoy and others at Stanford University proposed light field technology for collecting light field information. There are two main means of collecting light field information: one is through the microlens array, and the other is the camera array technology. The camera array-based synthetic aperture imaging technology proposed by Vaibhav Vaish et al. of Stanford University is very effective for the collection of light field information, and can observe the surface information of occluded objects, showing great potential in monitoring, military and other aspects . [0003] Another way to collect light field infor...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/50G06T5/00
CPCG06T5/50G06T2207/10004G06T2207/20216G06T5/77
Inventor 金欣张恒戴琼海
Owner SHENZHEN GRADUATE SCHOOL TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap