Hybrid Camera Rig for 6DOF and 360-Degree Reconstruction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing camera rigs for 3D reconstruction and extended reality (XR) experiences either lack the capability to capture a 360-degree scene or are limited by their degree of freedom (DOF).
Innovation Solution
A hybrid camera rig comprising a first array of image sensors in a planar configuration and a second array in a non-planar configuration, capable of capturing image streams with six degrees of freedom (6DOF), varying quality values, and field-of-views (FOVs), which are then processed to generate a 3D reconstruction of a scene.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a planar camera array is used for 3D reconstruction, then 6DOF capture quality is improved, but 360-degree scene coverage is limited
Solution Approach 1:
The patent combines planar camera arrays (for 6DOF quality) and non-planar camera arrays (for 360-degree coverage) into a single hybrid camera rig. The planar array captures high-quality 6DOF video streams while the non-planar array captures 360-degree scenes, and both are merged to achieve simultaneous 6DOF and 360-degree capabilities.
Solution Approach 2:
The hybrid camera rig is designed to perform multiple functions: it can capture 6DOF video streams with high quality using the planar array, capture 360-degree scenes using the non-planar array, and generate both 6DOF and 360-degree 3D reconstructions. This multi-functional design resolves the contradiction between specialized 6DOF capture and general 360-degree coverage.
2Adaptability or versatility
If a spherical camera configuration is used for 360-degree capture, then scene coverage is improved, but 6DOF capture capability is reduced
Solution Approach 1:
The patent merges spherical/non-planar camera configurations (for 360-degree coverage) with planar camera arrays (for 6DOF capability) in a hybrid rig. The non-planar array provides 360-degree scene capture while the planar array maintains 6DOF capture precision, resolving the trade-off between coverage and capability.
3Adaptability or versatility
If multiple camera arrays with different configurations are combined, then both 6DOF and 360-degree capabilities are achieved, but device complexity increases
Solution Approach 1:
The hybrid camera rig is segmented into distinct planar and non-planar camera arrays, each optimized for specific functions. This segmentation allows independent optimization of each sub-system while maintaining overall system functionality, managing complexity through modular design.
Solution Approach 2:
The hybrid camera rig achieves multi-functionality by integrating different camera configurations, allowing a single device to perform both 6DOF and 360-degree capture. This universal design resolves the contradiction by making one system capable of multiple functions rather than requiring separate specialized systems.
Data Source
AI summary
In one implementation, a camera rig comprises: a first array of image sensors arranged in a planar configuration, wherein the first array of image sensors is provided to capture a first image stream from a first perspective of a physical environment; a second array of image sensors arranged in a non-planar configuration, wherein the second array of image sensors is provided to capture a second image stream from a second perspective of the physical environment different from the first perspective; a buffer provided to store the first and second image streams; and an image processing engine provided to generate a 3D reconstruction of the physical environment based on the first and second image streams.