Pixel Beam Representation for Cross-Camera Light-Field Refocusing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing light-field acquisition devices produce diverse and proprietary file formats, making it difficult to process and integrate light-field data across different systems, and existing computational methods, such as Fourier-domain refocusing, require high computational load.
Innovation Solution
Introduce the concept of pixel beams, represented by hyperboloids or overlapping cones, which provide metadata linking sensor pixels to object space, enabling consistent processing across different optical systems by defining parameters like z_P, θ_x, θ_y, a, and pupilar parameters, allowing for standardized data representation and processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If proprietary file formats are used by different light-field acquisition devices, then each device can optimize its own data representation, but it becomes difficult to process and integrate light-field data across different systems
Solution Approach 1:
The patent introduces pixel beam parameters as an intermediary representation that bridges different proprietary light-field formats. By transforming data from various acquisition devices into a common pixel beam parameter space (defining rays in object space), the system enables integration while preserving device-specific optimization capabilities. This mediator approach allows heterogeneous data to be processed uniformly without losing the benefits of device-specific representations.
2Ease of operation
If Fourier-domain algorithms are used for refocusing, then refocusing functionality is achieved, but high computational load is required
Solution Approach 1:
The patent replaces the complex Fourier-domain computational approach with a simpler geometric optics-based method. Instead of performing Fourier transforms and domain conversions, the system directly uses pixel beam parameters to geometrically compute refocused images by projecting rays onto different focal planes. This substitution of computational mechanics dramatically reduces processing load while maintaining refocusing functionality.
3Adaptability or versatility
If diverse optical arrangements are used in light-field cameras, then different optical configurations can be optimized for specific applications, but processing becomes dependent on proprietary formats and optical characteristics
Solution Approach 1:
The patent transforms the complexity of diverse optical arrangements into a standardized parameter representation. By characterizing all optical systems through pixel beam parameters (ray definitions in object space) rather than device-specific optical configurations, the system maintains flexibility in optical design while simplifying processing. The parameter transformation approach allows any optical arrangement to be represented uniformly, decoupling optical versatility from processing complexity.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
There are several types of plenoptic devices having their proprietary file format. At present there is no standard supporting the acquisition and transmission of multi-dimensional information for an exhaustive over-view of the different parameters upon which a light-field depends. As such acquired light-field data for different cameras have a diversity of formats. The notion of pixel beam, which represents a volume occupied by a set of rays of light in an object space of an optical system of a camera is thus introduced. The method according to the invention enables to provide data representative of a collection of pixel beams describing a first optical system that is agnostic since these data are obtained by imaging the collection of pixel beams through a second optical system. Such data representative of a collection of pixel beams enable the generation of parametrized output images from which post-processing.