Light-Field Encoding Method Using Parameter Extraction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The transmission of 4D light-field data is inefficient due to large storage requirements and heterogeneity of acquisition devices, lacking a standard format for multi-dimensional information, which complicates processing and compatibility across different cameras.
Innovation Solution
A method for encoding light-field content that maps parameters representing rays of light into independent sets for compression and transmission, using video standards like MPEG-4 AVC or h265/HEVC, and supplemental enhancement information (SEI) messages, allowing for lossless or lossy coding without introducing significant errors, and enabling reconstruction of light-field data on receiving devices regardless of the acquisition system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If light-field data is transmitted using raw 4D light-field data representation, then complete light-field information is preserved, but data storage space and transmission bandwidth are excessively large
Solution Approach 1:
The patent extracts only the essential parameters needed for light-field reconstruction from the complete 4D light-field data. Instead of transmitting all raw light-field information, it identifies and transmits only the critical parameters (such as ray direction, position, and intensity parameters) that are necessary to reconstruct the light-field content at the receiving end, thereby reducing data volume while preserving essential information.
Solution Approach 2:
The patent transforms the representation of light-field data from raw pixel values to a parameter-based representation. Each pixel is associated with a set of parameters describing the light ray characteristics (direction, position, intensity). This parameterization allows for more efficient encoding and compression of the light-field information, reducing the data storage requirements while maintaining the ability to reconstruct the full light-field content.
2Manufacturing precision
If proprietary file formats are used for each light-field camera, then device-specific optimization is achieved, but processing complexity and compatibility issues increase on the receiving side
Solution Approach 1:
The patent establishes a universal parameter-based file format that can accommodate data from different types of light-field cameras (plenoptic cameras, camera arrays). The format uses standardized parameter representations that are device-agnostic, allowing receiving devices to process data from various acquisition systems without requiring device-specific processing logic, thereby reducing processing complexity and improving compatibility.
3Measurement precision
If complete 4D light-field data is transmitted, then full reconstruction quality is achieved, but transmission time and processing efficiency are reduced
Solution Approach 1:
The patent extracts and transmits only the essential parameters needed for light-field reconstruction, excluding redundant or less critical information. This selective transmission reduces the amount of data that needs to be processed and transmitted, thereby improving processing efficiency and transmission speed while maintaining sufficient reconstruction quality for most applications.
Solution Approach 2:
The patent changes the data representation from raw pixel values to compressed parameter sets. This parameter-based representation reduces data volume and enables more efficient processing algorithms, improving both transmission speed and reconstruction efficiency while maintaining acceptable quality levels.
Data Source
AI summary
The present disclosure relates to the transmission of sets of data and metadata and more particularly to the transmission of light-field contents. Light-field data take up large amounts of storage space which makes storage cumbersome and processing less efficient. In addition, light-field acquisition devices are extremely heterogeneous and each camera has its own proprietary file format. Since acquired light-field data from different cameras have a diversity of formats a complex processing is induced on the receiver side. To this end, it is proposed a method for encoding a signal representative of a light-field content in which the parameters representing the rays of light sensed by the different pixels of the sensor are mapped on the sensor. A second set of encoded parameters are used to reconstruct the light-field content from the parameters representing the rays of light sensed by the different pixels of the sensor.