Image Processor Depth Measurement via Beam Splitting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional light field cameras suffer from reduced image resolution when obtaining depth information, and methods like using two image capturing systems or sophisticated focal length control are cumbersome, while techniques involving diffraction gratings face challenges in accurately separating zero-order and high-order light images for depth measurement.
Innovation Solution
An image processor that receives and processes images with shifted subject positions, generating color images and calculating an index value to match images, and adjusts pixel values to align them, allowing for accurate depth calculation using a single optical system without significant resolution loss.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a single-lens camera with multiple micro lenses (light field camera) is used to obtain depth information, then depth information can be calculated, but the image resolution decreases significantly
Solution Approach 1:
The patent divides the incoming light into multiple beams using a beam splitting element, with each beam captured by a separate image capturing system. This segmentation allows depth information to be obtained through positional differences of the same subject in different captured images, while each individual image maintains high resolution because it is captured by a complete image capturing system rather than micro lenses
Solution Approach 2:
The patent combines multiple captured images to generate both depth information and high-resolution images. By merging the positional information from multiple images with the high-quality capture from each image capturing system, the system achieves both accurate depth measurement and high image resolution simultaneously
2Manufacturing precision
If two image capturing systems are used to increase resolution while obtaining depth information, then resolution is improved, but the device size and manufacturing cost increase
Solution Approach 1:
The patent segments the light path using a beam splitting element positioned in front of a single image sensor, creating multiple virtual image capturing systems from one physical system. This approach achieves the functionality of multiple cameras while using only one actual camera, thereby reducing device size and cost
Solution Approach 2:
The beam splitting element acts as an intermediary that divides incoming light into multiple beams without requiring multiple complete image capturing systems. This intermediary component enables the system to achieve multi-viewpoint capture and depth measurement functionality with a single camera, reducing overall system complexity
3Measurement precision
If a diffraction grating is used to separate zero-order and high-order light images for depth measurement, then depth information can be obtained, but accurate separation of the images is difficult
Solution Approach 1:
The patent extracts depth information from the positional shift of the subject between multiple captured images rather than relying on diffraction grating separation. By taking out the depth measurement function from the optical separation process and implementing it through image processing of separately captured images, the system avoids the difficulty of separating overlapping diffraction orders
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate depth information calculation with minimized resolution decrease and easy matching of images with different luminance levels, effectively separating direct and diffracted light images for precise depth measurement.
Implementation Method 1
the incoming light is split into two divided incoming light beams, which are imaged by two image capturing systems
Implementation Method 2
an image is captured through a diffraction grating which is arranged in front of a camera, and the distance from the subject to the diffraction grating is measured based on the magnitude of positional shift between an image produced by a zero-order diffracted light beam and an image produced by a high-order diffracted light beam
Data Source
AI summary
This image processor 10 includes: an input interface 11 that receives first and second images, on one of which the position of the subject has shifted in a particular direction from the position on the other; a color image generating section 13a that generates a color image in which the pixel values of respective pixels of the first and second images are used as the values of first and second colors, respectively; a decision section 13b that calculates an index value indicating the degree of color shift between the first and second colors in the color image and that determines, based on the index value, whether or not the first and second images match each other; and an image moving section 13c that performs, if the decision has been made that the first and second images do not match each other, the processing of making the second image closer to the first image by replacing the pixel value of each pixel of the second image with the pixel value of a pixel that is adjacent to the former pixel in the particular direction.