360-Degree 3D Scene Capture With Overlapping HDR Depth Scans
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing Environmental Capture Systems (ECS) take a prohibitively long time to capture image data and depth data, and are unable to produce high-quality panoramic images due to anomalies in the stitching process and the inability to handle wide dynamic range lighting conditions.
Innovation Solution
An ECS that captures image data and depth information by rotating a frame-mounted image and depth capture devices about a vertical axis, taking multiple images at different exposures in overlapping fields of view, and combining them with depth information to generate panoramic 3D images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If existing ECS capture image data and depth data using traditional methods, then complete 360-degree scene coverage is achieved, but capture time becomes prohibitively long
Solution Approach 1:
The patent divides the 360-degree scene capture into multiple overlapping fields of view (FOVs). The image capture device captures images in different FOVs (e.g., first FOV, second FOV, third FOV) that overlap with each other, allowing the system to cover the complete scene while reducing the time required in each individual capture position. This segmentation of the capture space enables parallel processing and reduces total capture time while maintaining complete scene coverage through the overlapping regions.
Solution Approach 2:
The patent performs preliminary action by capturing multiple images at different exposures before moving to the next position. The system captures a plurality of images at different exposures in each FOV, and also captures depth information during rotation between positions. This preliminary capture of multiple exposure images and depth data in advance allows for more efficient processing and reduces the need for repeated captures, thereby reducing overall capture time while ensuring complete scene coverage.
2Manufacturing precision
If existing ECS use traditional stitching processes to create panoramic images, then complete panoramic coverage is achieved, but image quality deteriorates due to stitching anomalies
Solution Approach 1:
The patent uses depth information as an intermediary element to facilitate accurate stitching of panoramic images. The depth information capture device captures depth data for different portions of the scene during rotation, and this depth information serves as a mediator to align and stitch images from overlapping FOVs more accurately. By incorporating depth data as an intermediary reference, the system can match features across images more precisely, reducing stitching anomalies and improving both image quality and stitching accuracy simultaneously.
3Manufacturing precision
If existing ECS capture images in standard dynamic range, then capture speed is maintained, but image quality deteriorates in wide dynamic range lighting conditions
Solution Approach 1:
The patent applies partial action by capturing images at multiple different exposures rather than a single exposure. The image capture device captures a plurality of images at different exposures (e.g., underexposed, properly exposed, overexposed images) in each field of view. This allows the system to select or combine the most appropriate exposure for different regions of the scene, achieving high image quality in wide dynamic range lighting conditions while maintaining capture efficiency by using computational methods to process the multiple exposures rather than requiring multiple separate capture passes.
4Measurement precision
If existing ECS rotate capture devices slowly to ensure data accuracy, then measurement precision is maintained, but capture time increases significantly
Solution Approach 1:
The patent implements continuous useful action by capturing depth information continuously during the rotation of the capture devices. Rather than stopping at discrete positions to capture depth data, the system captures depth information for different portions of the scene while the drive train rotates the image and depth information capture devices about the vertical axis. This continuous capture approach maintains measurement precision by ensuring depth data is collected throughout the entire rotation, while significantly reducing total capture time by eliminating repeated start-stop cycles.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system enables rapid capture and processing of high-quality panoramic 3D images, reducing capture time to under 45 seconds and improving accuracy in both indoor and outdoor environments, allowing seamless transitions between indoor and outdoor scenes.
Implementation Method 1
depth information capture device...captures depth information for a first portion of the 360-degree scene
Implementation Method 2
image capture device...captures...a plurality of images at different exposures in a first field of view
Data Source
AI summary
An environmental capture system (ECS) captures image data and depth information in a 360-degree scene. The captured image data and depth information can be used to generate a 360-degree scene. The ECS comprises a frame, a drive train mounted to the frame, and an image capture device coupled to the drive train to capture, while pointed in a first direction, a plurality of images at different exposures in a first field of view (FOV) of the 360-degree scene. The ECS further comprises a depth information capture device coupled to the drive train. The depth information capture device and the image capture device are rotated by the drive train about a first, substantially vertical, axis from the first direction to a second direction. The depth information capture device, while being rotated from the first direction to the second direction, captures depth information for a first portion of the 360-degree scene. The image capture device captures, while pointed in the second direction, a plurality of images at different exposures in a second FOV that overlaps the first FOV of the 360-degree scene. The depth information capture device and the image capture device are rotated by the drive train about the first axis from the second direction to a third direction. The depth information capture device, while being rotated from the second direction to the third direction, captures depth information for a second portion of the 360-degree scene. The image capture device, while pointed in the third direction, captures a plurality of images at different exposures in a third FOV that overlaps the second FOV of the 360-degree scene.