360-Degree 3D Scene Capture With Overlapping HDR Views
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing Environmental Capture Systems (ECS) take a prohibitively long time to capture image data and depth data, and are unable to produce high-quality panoramic images due to anomalies in the stitching process and the inability to handle wide dynamic range lighting conditions.
Innovation Solution
An ECS that captures image data and depth information by rotating a frame-mounted image and depth capture devices about a vertical axis, taking multiple images at different exposures in overlapping fields of view, and combining them with depth information to generate a 3D panoramic image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If existing ECS capture image data and depth data using traditional methods, then complete 360-degree coverage is achieved, but the capture time becomes prohibitively long
Solution Approach 1:
The patent divides the 360-degree scene capture into multiple overlapping fields of view (FOVs). The image capture device captures images in different FOVs (e.g., first FOV, second FOV, third FOV) that overlap with each other, allowing the system to cover the complete scene while reducing the time required for each individual capture position.
Solution Approach 2:
The patent introduces multiple capture dimensions by combining horizontal rotation (azimuth) with vertical rotation (elevation). The drive train rotates the image capture device about a first vertical axis to change azimuth, and about a second horizontal axis to change elevation, creating a two-dimensional rotation space that efficiently covers the 360-degree scene.
2Manufacturing precision
If traditional stitching processes are used to create panoramic images, then complete scene coverage is achieved, but anomalies and quality degradation occur
Solution Approach 1:
The patent performs preliminary alignment and registration of images from overlapping FOVs before final stitching. By pre-processing the images to establish accurate geometric relationships and using the overlap regions for validation, the system ensures high-quality panoramic images without stitching anomalies.
Solution Approach 2:
The system uses feedback from the overlapping FOV regions to validate and adjust the stitching process. The overlap provides redundant information that allows the system to detect and correct alignment errors, ensuring reliable and high-quality panoramic image generation.
3Manufacturing precision
If single exposure images are captured, then capture speed is maintained, but high-quality panoramic images cannot be produced in varying lighting conditions
Solution Approach 1:
The patent implements periodic action by capturing multiple images at different exposures (exposure bracketing) at each field of view position. The image capture device takes a sequence of images with varying exposure times, allowing the system to handle wide dynamic range lighting conditions while maintaining capture efficiency through automated processing.
Data Source
AI summary
An environmental capture system (ECS) captures image data and depth information in a 360-degree scene. The captured image data and depth information can be used to generate a 360-degree scene. The ECS comprises a frame, a drive train mounted to the frame, and an image capture device coupled to the drive train to capture, while pointed in a first direction, a plurality of images at different exposures in a first field of view (FOV) of the 360-degree scene. The ECS further comprises a depth information capture device coupled to the drive train. The depth information capture device and the image capture device are rotated by the drive train about a first, substantially vertical, axis from the first direction to a second direction. The depth information capture device, while being rotated from the first direction to the second direction, captures depth information for a first portion of the 360-degree scene. The image capture device captures, while pointed in the second direction, a plurality of images at different exposures in a second FOV that overlaps the first FOV of the 360-degree scene. The depth information capture device and the image capture device are rotated by the drive train about the first axis from the second direction to a third direction. The depth information capture device, while being rotated from the second direction to the third direction, captures depth information for a second portion of the 360-degree scene. The image capture device, while pointed in the third direction, captures a plurality of images at different exposures in a third FOV that overlaps the second FOV of the 360-degree scene.