Depth Calculation Using Interpolation and Difference Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for generating three-dimensional images of target objects using infrared rays lack accuracy in depth information, necessitating improved techniques for acquiring reliable and precise depth data.
Innovation Solution
An information processing apparatus comprising an interpolation image generation unit, a difference image generation unit, and a depth calculation unit, which generates an interpolation image from normal and pattern images, calculates depth information using a difference image, and determines reliability through luminance analysis to ensure high accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If infrared pattern light is irradiated to acquire depth information, then three-dimensional image generation is enabled, but depth information accuracy is insufficient
Solution Approach 1:
The system performs preliminary actions by capturing normal images before and after pattern image capture, then generates an interpolation image corresponding to the pattern image capture timing. This preliminary interpolation enables accurate depth calculation by providing a reference image that matches the temporal moment of pattern light irradiation, thereby improving both accuracy and reliability of depth information.
Solution Approach 2:
The interpolation image acts as an intermediary between the normal images and the pattern image. By generating this intermediate image that corresponds to the pattern image capture timing, the system enables accurate difference image calculation, which in turn improves the accuracy and reliability of depth information without requiring direct simultaneous capture of all images.
2Measurement precision
If multiple images are captured sequentially, then depth information can be calculated, but timing misalignment reduces accuracy
Solution Approach 1:
The system captures normal images before and after pattern image capture as preliminary actions, then generates an interpolation image that corresponds to the exact timing of pattern image capture. This approach compensates for timing differences inherent in sequential capture, enabling accurate depth calculation as if all images were captured simultaneously.
Solution Approach 2:
The system changes the temporal parameter by generating an interpolation image at a specific timing (corresponding to pattern image capture) rather than using raw captured images directly. This parameter transformation (from discrete captured timestamps to continuous interpolated timing) eliminates timing misalignment issues and improves measurement accuracy.
3Reliability
If infrared pattern light irradiation is performed continuously, then depth information quality is maintained, but power consumption increases
Solution Approach 1:
Instead of continuous infrared pattern light irradiation, the system uses periodic action by capturing normal images before and after pattern image capture, then generating an interpolation image. This periodic sampling approach maintains depth information reliability while significantly reducing power consumption compared to continuous irradiation.
Solution Approach 2:
The system uses the captured normal images themselves to generate the interpolation image, making the normal images serve dual purposes: both for visual information and for creating the depth calculation reference. This self-service approach eliminates the need for continuous additional infrared irradiation, reducing power consumption while maintaining reliability.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The apparatus achieves high-accuracy depth information acquisition, enabling precise three-dimensional image generation and point cloud creation, with controlled exposure and irradiation power adjustments for enhanced reliability and reduced power consumption.
Implementation Method 1
a pattern image irradiated with infrared pattern light
Data Source
AI summary
There is provided an information processing apparatus, an information processing method, and a program with which highly accurate depth information can be acquired. The information processing apparatus includes an interpolation image generation unit, a difference image generation unit, and a depth calculation unit. The interpolation image generation unit generates an interpolation image on the basis of a first normal image and a second normal image among the first normal image, a pattern image irradiated with infrared pattern light, and the second normal image, the interpolation image corresponding to a time at which the pattern image is captured. The difference image generation unit generates a difference image between the interpolation image and the pattern image. The depth calculation unit calculates depth information by using the difference image.