Light-field Camera Using Splitter Mirror and Mixed Quality Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current light-field acquisition technologies face challenges in achieving high-quality image capture due to limitations in cost and size, resulting in subpar quality in color reproduction, dynamic range, and signal-to-noise ratio, which restricts their application in high-quality requirements such as digital cinema productions.
Innovation Solution
A light-field camera system comprising a primary camera with high-quality optical components and a secondary camera array, where the secondary cameras have lower quality but are used to generate depth information, allowing for improved quality-to-cost ratio and using a semitransparent mirror to ensure consistent angles of view, facilitating better image processing and depth computation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If professional digital cinema cameras are used in multi-camera arrays, then image quality reaches the highest level, but system cost and size become prohibitive
Solution Approach 1:
The patent applies local quality by differentiating the quality requirements of different cameras in the array. The first camera (reference camera) uses high-quality professional digital cinema sensors to ensure excellent image quality for the primary light-field view. The second cameras (additional cameras) use lower-quality, more affordable sensors since their primary function is to provide supplementary views for light-field reconstruction rather than serving as primary imaging devices. This differentiation resolves the contradiction by optimizing quality only where most needed while reducing costs elsewhere in the system.
2Device complexity
If small sized and cheap cameras are used in multi-camera arrays, then system cost is reduced, but image quality deteriorates with poor color reproduction, dynamic range, and signal-to-noise ratio
Solution Approach 1:
The patent segments the camera array into two functional groups: a primary reference camera that captures high-quality images with excellent color reproduction, dynamic range, and signal-to-noise ratio, and secondary cameras that provide additional viewing angles with reduced quality requirements. The segmentation allows the system to achieve acceptable overall image quality by relying primarily on the reference camera while using cheaper secondary cameras to fill in spatial information, thus resolving the contradiction between cost reduction and maintaining image quality.
3Measurement precision
If multiple high-quality cameras are combined, then light-field capture quality is improved, but the quality-to-cost ratio deteriorates
Solution Approach 1:
The patent implements local quality by assigning different quality levels to different cameras based on their specific roles in the light-field capture system. The reference camera uses high-quality professional sensors optimized for excellent color reproduction, dynamic range, and signal-to-noise ratio, while the additional cameras use lower-quality, cost-effective sensors. This localized quality differentiation optimizes the quality-to-cost ratio by concentrating high-quality imaging resources where they provide maximum benefit while using affordable cameras for supplementary spatial sampling.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The system enables high-quality light-field capture with improved quality-to-cost ratio, allowing for high-quality digital two-dimensional output images and depth information, suitable for applications requiring advanced image manipulation and editing.
Implementation Method 1
a semitransparent mirror arranged in such a way that an incident light beam originating from the scene is split up in a first partial light beam, which is directed to the primary camera, and in a second partial light beam, which is directed to the secondary cameras
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The invention provides a light-field camera for capturing multiple views of a scene, the multiple views representing samples of a light-field, the light-field camera comprises: a primary camera configured for capturing a primary digital two-dimensional image of the scene; a two-dimensional camera array comprising a plurality of secondary cameras, wherein each of the secondary cameras is configured for capturing a secondary digital two-dimensional image of the scene in order to produce at least one set of secondary digital two-dimensional images of the scene; a semitransparent mirror arranged in such way that an incident light beam originating from the scene is split up in a first partial light beam, which is directed to the primary camera, and a second partial light beam, which is directed to the camera array; and a processing unit configured for receiving the primary digital two-dimensional image and the at least one set of secondary digital two-dimensional images and configured for computing depth information for the primary digital two-dimensional image or a digital two-dimensional image corresponding to the primary digital two-dimensional image based on the set of secondary digital two-dimensional images.