Hemispherical Camera Array for Immersive Light Field
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing light field reconstruction technologies struggle to provide a six-degree-of-freedom large-range immersive viewing experience due to limitations in baseline length and spatial resolution, which affect depth resolution and parallax in multiocular vision.
Innovation Solution
A system and method for intelligent sensing and computing of an immersive light field, comprising a mobile platform, a hemispherical support, an acquisition array of uniformly distributed cameras, a control system, and a computing system. The system acquires video images at multiple pitch angles and generates an immersive light field video using neural radiation field technology.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If a light field camera uses a dense microlens array to acquire multi-view images, then the viewing angle coverage is improved, but the spatial resolution of single-view pixels deteriorates
Solution Approach 1:
The system divides the light field acquisition into multiple separate views using multiple independent cameras instead of using a single camera with a microlens array. Each camera captures a specific view with full spatial resolution, avoiding the pixel division problem while achieving comprehensive viewing angle coverage through the combination of multiple segmented views.
2Measurement precision
If the baseline length between cameras is increased to improve depth resolution, then the depth resolution is improved, but the device size exceeds the imaging chip dimensions
Solution Approach 1:
The system transitions from a two-dimensional microlens array configuration to a three-dimensional spherical distribution of multiple cameras. By arranging cameras on a spherical surface with larger radius, the baseline between cameras is effectively increased without proportionally increasing the overall device volume, as the cameras are distributed on the surface of the sphere rather than requiring a cubic expansion.
3Adaptability or versatility
If a panoramic camera uses multiple lenses to capture all directions, then the three-degree-of-freedom viewing experience is achieved, but the six-degree-of-freedom immersive viewing experience with movement cannot be provided
Solution Approach 1:
The system employs a mobile platform that enables dynamic movement and positioning of the spherical camera array. This dynamic capability allows the system to capture light field data from multiple positions and reconstruct six-degree-of-freedom immersive views, transforming a static panoramic system into a dynamic light field acquisition system without fundamentally changing the core camera architecture.
Data Source
AI summary
A system for intelligent sensing and computing of an immersive light field includes a mobile platform, a support, an acquisition array, a control system and a computing system. The control system and the acquisition array are fixed on the support that is in form of hemisphere. The support changes a pose through the mobile platform. The acquisition array includes acquisition cameras of multiple views that are uniformly distributed and fixed on the support, and lenses of the acquisition cameras point to outside from a sphere center and are configured to acquire video images at a plurality of pitch angles. The control system is connected to the acquisition array and configured to transmit the video images to a control device for data storage, and the computing system is configured to acquire the video images in the control device and generate an immersive light field video based on the video images.