AR Image Generation Using Range Gated Imager Depth Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing AR devices face challenges in achieving satisfactory AR rendering due to insufficient resolution, depth range, depth accuracy, frame rate, compactness, ruggedness, cost, or power efficiency of conventional depth mapping units.
Innovation Solution
A device and method for generating AR images that utilize a range gated imager to capture a third image of only the parts of the scene in front of a predetermined depth, generating occlusion information based on this image, and overlaying the original image and object image based on this information, without requiring a high-performance depth mapping unit.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a conventional depth mapping unit is used to provide depth information for AR rendering, then depth information is obtained, but the resolution, depth range, depth accuracy, frame rate, compactness, ruggedness, cost, and power efficiency are insufficient
Solution Approach 1:
The patent divides the scene into multiple depth ranges (first depth range, second depth range, third depth range) and captures images for each range separately using the same imaging device at different time points. This segmentation approach allows high-resolution depth information to be obtained without requiring a complex high-performance depth mapping unit, thus improving depth accuracy while maintaining device simplicity.
Solution Approach 2:
The patent performs preliminary depth estimation using a simple depth mapping unit to determine multiple depth ranges before capturing the actual depth images. This preliminary action enables the system to know in advance which depth ranges need to be captured, allowing the use of a simpler imaging device while still achieving high depth accuracy through selective capture of relevant depth information.
2Measurement precision
If a high-performance depth mapping unit is used to achieve high-resolution depth maps, then depth accuracy is improved, but cost, power consumption, and volume of the AR device increase significantly
Solution Approach 1:
The patent segments the depth capture process into multiple time points, capturing only specific depth ranges (first, second, and third depth ranges) separately rather than capturing the entire scene continuously at high resolution. This reduces the power consumption of the imaging device while maintaining high depth accuracy for the captured ranges.
Solution Approach 2:
The patent uses a simple depth mapping unit to perform partial depth estimation (enough to determine depth ranges) rather than requiring full high-performance depth mapping. This partial action approach achieves sufficient depth accuracy for AR rendering without the excessive power consumption of a high-performance depth mapping unit.
3Measurement precision
If a high-performance depth mapping unit is used to achieve high-resolution depth maps, then depth accuracy is improved, but the volume and cost of the AR device increase
Solution Approach 1:
The patent segments the depth information capture into multiple discrete depth ranges captured at different time points using the same imaging device. This eliminates the need for a bulky high-performance depth mapping unit, reducing device volume while achieving high depth accuracy through temporal segmentation of the capture process.
Solution Approach 2:
The patent makes the imaging device perform multiple functions: it captures both the original scene images and the depth range images using the same device. This multi-functionality eliminates the need for separate high-performance depth mapping hardware, reducing device volume and cost while maintaining depth accuracy.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for efficient handling of occlusion in AR image generation, reducing the need for high-cost, high-power, and large-volume depth mapping units, while achieving high-resolution and high-frame-rate AR image rendering.
Implementation Method 1
capture a third image of only the parts of the scene in front of the predetermined depth, wherein the third image is captured with a range gated imager
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present invention relates to the technical field of augmented reality (AR). In particular, the invention presents a device and a method, respectively, for generating an AR image (or AR video). The device is configured to obtain a first image of a scene, obtain a second image of an object, obtain a depth range, and capture a third image of only the parts of the scene inside the depth range. Further, the device is configured to generate occlusion information based on the third image, and overlay the first image and the second image based on the occlusion information, in order to generate the AR image.