Depth estimation method for light field image

A technology of depth estimation and light field image, applied in image analysis, image data processing, computing and other directions, which can solve the problems of less attention to the robustness of depth estimation, and the development of theoretical concepts of light field imaging technology lag

Active Publication Date: 2019-08-13
NANJING INST OF TECH
View PDF6 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] In the first half of the 20th century, A. Gershun et al. have proposed the concept of light field to describe the radiation characteristics of light in three-dimensional space. However, light field imaging Technology relatively...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Depth estimation method for light field image
  • Depth estimation method for light field image
  • Depth estimation method for light field image

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0057] Such as figure 1 As shown, a depth estimation method for light field images includes the following steps:

[0058] Step 1, decode the light field image to obtain 4D light field data and central sub-aperture image. That is: according to the parameter information of the light field camera, the original light field image is decoded into 4D light field data, and the central sub-aperture image is extracted

[0059] As mentioned in step 1, the original image collected by a light field camera (such as Lytro, etc.) is usually a 12-bit Bayer format image, and a 4D light field represented in the form of 2PP (two plane parameterization) is usually used in light field analysis and processing. Therefore, it is necessary to decode the original image into 4D light field data according to the parameters provided by the light field camera or further calibration and correction parameters. The 4D light field is usually recorded as L:(i,j,k,l)→L(i,j,k,l), where (i,j) represents the pix...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a depth estimation method for a light field image. The depth estimation method comprises the following steps: decoding the light field image to obtain 4D light field data and acentral sub-aperture image; generating a focus stack image sequence through the 4D light field data; drawing a focusing curve for each pixel on the central sub-aperture image; detecting a local symmetry center of the focusing curve to obtain a disparity map D1; generating an EPI image in the horizontal direction and the vertical direction corresponding to each pixel through the 4D light field data; detecting the slope of a straight line on the EPI image to obtain a disparity map D2; based on the central sub-aperture image and the two disparity maps, drawing two focusing curve segments for each pixel; calculating the matching degrees of the two focusing curve segments and the focusing curve, and determining a final disparity map D according to the matching degrees; performing deep optimization based on energy minimization. A depth estimation result of the method is high in accuracy, and has high robustness for outdoor noise scenes, complex shielding scenes and the like.

Description

technical field [0001] The invention relates to the technical fields of computer vision and digital image processing, in particular to a depth estimation method for light field images. Background technique [0002] In the first half of the 20th century, A. Gershun and others have proposed the concept of light field to describe the radiation characteristics of light in three-dimensional space. However, the light field imaging technology lags behind the development of theoretical concepts. Light field imaging devices that have emerged one after another mainly include camera arrays, light field sensors, and microlens arrays. The hand-held light field camera designed by R.Ng et al. in 2005 has become a representative of microlens array light field acquisition equipment, which directly promoted the rapid entry of light field cameras (such as Lytro, Raytrix, etc.) into the civilian market. It set off an upsurge of applied research on light field imaging. [0003] Obtaining scene...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/557
CPCG06T7/557
Inventor 韩磊徐梦溪黄陈蓉郑胜男吴晓彬夏明亮
Owner NANJING INST OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products