Light Field Data Representation Standardization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current light-field data acquisition and storage methods are inefficient due to the heterogeneity of light-field cameras, lack of standardization, and high storage requirements, making it cumbersome to process and transmit multi-dimensional light-field data across different devices.
Innovation Solution
A computer-implemented method and device for generating metadata representing a pixel beam in an optical acquisition system, which includes obtaining intersection data of light field rays with reference planes, generating ray diagram parameters, and associating these parameters with color data and position/size parameters of the pixel beam, using techniques like Radon transform and Bresenham's algorithm to efficiently represent and store light-field data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If light-field data is captured using heterogeneous light-field cameras with different optical arrangements, then more post-processing features and interactivity are enabled, but data representation becomes non-standardized and processing becomes less efficient
Solution Approach 1:
The patent creates a universal light-field data representation format that can accommodate data from different types of light-field cameras (plenoptic cameras, camera arrays, focal plane sweeping systems). The standardized format uses consistent parameter definitions (ray parameters, reference planes, coordinate systems) that enable processing of heterogeneous camera data through a single unified interface, resolving the contradiction between versatility and complexity.
Solution Approach 2:
The patent transforms light-field data from various camera types into a standardized parameter representation system. By defining universal parameters (ray origin, direction, reference plane intersections) and coordinate transformations, the patent enables different camera architectures to output data in a common format, making the data processing pipeline independent of the specific acquisition device used.
2Loss of information
If conventional light-field data formats are used, then complete light-field information is preserved, but storage space requirements become extremely large
Solution Approach 1:
The patent extracts only the essential parameters needed to represent light-field rays (ray origin, direction, reference plane intersections) rather than storing complete raw light-field data matrices. By identifying and retaining only the critical geometric parameters that define each ray's path and properties, the patent dramatically reduces storage requirements while preserving the information necessary for refocusing, viewpoint changes, and depth extraction.
Solution Approach 2:
The patent transforms the traditional 4D light-field data structure into a parameter-based representation that uses dimensional reduction through mathematical relationships. By expressing ray information in terms of intersections with reference planes and using parametric equations, the patent compresses the data representation while maintaining the ability to reconstruct the full light-field information when needed.
3Productivity
If large amounts of light-field data are stored, then complete processing options are available, but data transmission and processing become cumbersome
Solution Approach 1:
The patent creates a compact parametric representation (a simplified copy) of the light-field data that captures the essential geometric information in a condensed format. Instead of transmitting or storing the full light-field data matrices, the system transmits the compressed parameter sets (ray parameters, reference plane definitions, coordinate transformations) that can be rapidly processed and expanded into full light-field information when needed, significantly reducing transmission time and processing overhead.
Data Source
Figure 1A~1B
Figure 2A
Figure 2B
AI summary
There are several types ot plenoptic devices and camera arrays available on the market, and all these light field acquisition devices have their proprietary file format. However, there is no standard supporting the acquisition and transmission of multi-dimensional information. It is interesting to obtain information related to a correspondence between pixels of a sensor of said optical acquisition system and an object space of said optical acquisition system. Indeed, knowing which portion of the object space of an optical acquisition system a pixel belonging to the sensor of said optical acquisition system is sensing enables the improvement of signal processing operations. The notion of pixel beam, which represents a volume occupied by a set of rays of light in an object space of an optical system of a camera along with a compact format for storing such information is thus introduce.