Light Field Data Representation Standardization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional light field cameras capture 4D data but lack a standard format for multi-dimensional information, leading to diverse formats and inefficient storage and processing due to the heterogeneity of acquisition devices and lack of standardization.
Innovation Solution
A method for formatting and processing light field data using a computer-implemented system that includes a light field data formatting module and processor, which parameterizes light field data using reference planes to generate a standardized format for storage and processing, enabling efficient representation and manipulation of light field rays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If light field data is captured using heterogeneous acquisition devices with different optical arrangements and micro-lens focal lengths, then directional information and spatial information can be obtained, but data format diversity increases and storage becomes cumbersome
Solution Approach 1:
The patent applies universality by creating a standardized data format that can accommodate multiple types of light field acquisition devices with different optical arrangements and micro-lens focal lengths. The format uses generic parameter names and data structures that can represent various device configurations without requiring device-specific formats, thereby reducing data format diversity while preserving directional information from heterogeneous devices.
Solution Approach 2:
The patent applies parameter changes by defining a standardized set of parameters for representing light field data that can adapt to different device configurations. The format includes parameters for optical arrangement type, micro-lens focal length, and other device-specific characteristics that can be specified uniformly across different devices, allowing the same data structure to represent diverse acquisition systems.
2Loss of information
If light field data is captured with full 4D information, then directional distribution and spatial information are preserved, but storage space requirements increase significantly
Solution Approach 1:
The patent applies segmentation by dividing the 4D light field data into structured components organized in a hierarchical format. The data is segmented into headers containing metadata about the acquisition device and parameters, and data arrays containing the actual light field measurements. This segmentation allows for efficient storage by organizing information logically and enabling selective processing of different data portions.
Solution Approach 2:
The patent applies dimensionality change by organizing light field data in a standardized multi-dimensional structure that efficiently represents the 4D information. The format uses structured arrays and metadata to encode spatial and angular dimensions in a compact manner, allowing the same data to be efficiently stored and later processed for various applications including refocusing and viewpoint synthesis.
3Reliability
If proprietary file formats are used for each light field camera, then device-specific characteristics are preserved, but data processing efficiency decreases and interoperability is limited
Solution Approach 1:
The patent applies universality by designing a standardized file format that can process data from multiple light field camera types including plenoptic cameras and camera arrays. The format includes generic parameter names and data structures that work across different device configurations, eliminating the need for device-specific proprietary formats while maintaining the ability to represent various optical arrangements and micro-lens characteristics.
Solution Approach 2:
The patent applies the intermediary principle by creating a standardized data format that acts as a mediator between diverse light field acquisition devices and processing applications. The format translates device-specific data into a universal representation that preserves essential characteristics while enabling efficient processing by various applications without requiring device-specific processing code.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The solution enables efficient storage and processing of light field data by standardizing the format, reducing storage requirements and improving data manipulation, allowing for applications such as refocusing, viewpoint change, and 3D image generation.
Implementation Method 1
The directional information may be obtained by the use of an array of micro-lenses, often referred to as a microlens array (MLA) associated with an image sensor
Implementation Method 2
Light sensitive technology used in such imaging devices is often based on semiconductor technology, capable of converting photons into electrons such as, for example, charge coupled devices (CCD) or complementary metal oxide technology (CMOS)
Data Source
Figure 1A
Figure 1B
Figure 2A
AI summary
A method for reducing the parameters defining an acquired light field ray which enables only the colour associated with the light field ray to be stored instead of 4 light field coordinates (x,y,i,j) and its associated colour.