Handheld Depth Capture Using TOF and Stereo Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional hand-held electronic devices face challenges in accurately calculating depth information, especially for objects with short distances and those having flat surfaces or without obvious lines, leading to errors in depth calculations.
Innovation Solution
The use of a Time of Flight (TOF) image capturer, a main image capturer, a sub image capturer, and a controller to capture and combine depth information sets from effective and ineffective regions, generating a more complete and accurate overall depth map by distinguishing between objects based on their distances and image characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple image capturers are used to obtain depth information through image shifting, then depth information can be calculated, but excessive image shifting occurs when object distance is too short, resulting in greater errors
Solution Approach 1:
The patent segments the image capturing function into multiple specialized capturers: a first image capturer for normal imaging, a second image capturer for depth information, and a third image capturer for close-range depth information. This segmentation allows each capturer to be optimized for its specific function, preventing the image shifting errors that occur when using conventional multi-capturer approaches for all depth calculations.
Solution Approach 2:
The patent applies local quality by assigning different functional characteristics to different parts of the system. The third image capturer is specifically designed with a short focal length and positioned close to the first image capturer to handle close-range objects, while the second image capturer handles medium-range depth information. This local optimization ensures that each capturer operates in its optimal range, improving overall measurement precision.
2Measurement precision
If conventional image shifting method is used, then depth information can be obtained, but calculations for objects with flat surfaces or without obvious lines are not accurate
Solution Approach 1:
The patent introduces an active illumination source as an intermediary to assist the second and third image capturers in capturing depth information. By projecting structured light patterns onto the target object, the system creates artificial features that make depth calculation possible even for flat surfaces or objects without obvious lines, thereby improving adaptability to different object types.
Solution Approach 2:
The patent changes the optical parameters of the system by using an active illumination source with specific wavelength and intensity characteristics. This parameter change enables the image capturers to detect depth information from objects that would otherwise be difficult to measure, expanding the system's adaptability to various object types including flat surfaces.
3Measurement precision
If a single image capturer is used, then device complexity is low, but depth information cannot be completely and accurately calculated
Solution Approach 1:
The patent achieves multi-functionality by designing the second and third image capturers to work in different operational modes. The second image capturer can capture both color and depth information, while the third image capturer specializes in close-range depth measurement. This universal design allows the system to handle various imaging tasks with a single integrated setup, managing complexity through functional integration.
Solution Approach 2:
The patent applies the nesting principle by positioning the third image capturer within or adjacent to the first image capturer, creating a compact nested structure. This spatial nesting reduces the overall device footprint and manages complexity by efficiently arranging multiple capturers in a space-constrained hand-held device without compromising their individual functions.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for accurate calculation of depth information for objects at various distances, enhancing the quality and completeness of the depth map, thereby improving image capturing capabilities.
Implementation Method 1
a time of fly (TOF) image capturer is configured for executing an image capturing action and outputting a TOF image
Data Source
AI summary
A hand-held electronic apparatus, an image capturing apparatus and a method for obtaining depth information are provided. The image capturing apparatus includes a time of fly (TOF) image capturer, a TOF controller, a main and sub image capturers, and a controller. The TOF image capturer calculates a TOF depth map according to a TOF image, defines an effective region and an un-effective region according to the TOF depth map, and obtains a first depth information set of the effective region. The main and sub image capturers captures a first and second images, respectively. The controller obtains a second depth information set of the un-effectively region by comparing the first and second images, and generates an overall depth map by combining the first depth information set and the second depth information set.