Handheld Light Field Camera Distance Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current depth estimation methods using light field cameras suffer from low precision and efficiency due to the small baseline and low resolution of sub-aperture images, leading to complex algorithms with limited accuracy.
Innovation Solution
A distance estimation method for handheld light field cameras involves extracting camera parameters, setting a reference plane and calibration point, refocusing the light field image, and using a light propagation mathematical model to calculate the distance of the calibration point, which allows for high-efficiency and accurate distance estimation by analyzing the imaging diameter on the refocused image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If stereo matching principle or multi-clue fusion is used for depth estimation, then depth information can be obtained, but the measurement precision is low due to small baseline and low resolution of sub-aperture images
Solution Approach 1:
The patent changes the fundamental parameter of depth estimation from relying on sub-aperture image correlation (which is limited by small baseline and low resolution) to using defocus blur magnitude as the estimation basis. By measuring the amount of defocus blur in the light field image, the system can accurately determine depth without being constrained by the small baseline, thereby improving both precision and reliability simultaneously
Solution Approach 2:
The patent replaces the mechanical/optical constraint of small baseline with a computational approach based on defocus analysis. Instead of relying on geometric parallax from multiple viewpoints (mechanical/optical system), the invention uses image processing of defocus blur characteristics (computational system) to achieve more reliable and precise depth estimation
2Measurement precision
If complex algorithms are used for depth estimation, then depth information can be extracted, but the productivity is low due to high computational complexity
Solution Approach 1:
The patent extracts and utilizes only the defocus blur information from the light field image, separating this useful signal from the complex multi-clue processing required by traditional methods. By focusing exclusively on defocus magnitude measurement rather than performing full stereo matching or multi-clue fusion, the system achieves accurate depth estimation with significantly reduced computational complexity and improved processing efficiency
3Measurement precision
If sub-aperture image correlation is used for depth estimation, then depth information can be obtained, but the measurement precision is limited by low resolution of sub-aperture images
Solution Approach 1:
The patent changes the measurement parameter from sub-aperture image correlation (which requires high resolution and is sensitive to small baseline) to defocus blur magnitude measurement. Defocus blur is a continuous optical phenomenon that can be measured accurately even with lower resolution images, as it manifests as intensity distribution patterns rather than requiring fine spatial details, thereby overcoming the resolution limitation
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This method enables accurate and efficient distance estimation of objects by refocusing the light field image on a known reference plane, improving precision and reducing computational complexity, with potential applications in industrial distance measurement.
Implementation Method 1
the light ray emitted from the calibration point enters the main lens at an angle φ... the light ray emitted from the calibration point is refracted after entering the main lens
Implementation Method 2
a shot light field image is refocused on a reference plane... the imaging diameter of the calibration point on the refocused image
Data Source
AI summary
A distance estimation method based on a handheld light field camera is disclosed and includes: S1: extracting parameters of the light field camera; S2: setting a reference plane and a calibration point; S3: refocusing a collected light field image on the reference plane, to obtain a distance between a main lens and a microlens array of the light field camera, and recording an imaging diameter of the calibration point on the refocused image; and S4: inputting the parameters of the light field camera, the distance between the main lens and the microlens array, and the imaging diameter of the calibration point on the refocused image to a light propagation mathematical model, and outputting a distance of the calibration point. The present application has high efficiency and relatively high accuracy.