Lightfield Data Processing via Ray Origin Grouping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image capturing devices lose depth information due to rendering three-dimensional scenes onto two-dimensional sensors, and processing lightfield data from four-dimensional lightfield capturing devices is challenging due to the large amount of data acquired.
Innovation Solution
A method of processing lightfield data by associating rays with 4-dimensional coordinates, determining depth information, grouping rays with the same origin, and establishing relationships between groups to simplify data representation, which includes segmenting the lightfield data based on these relationships.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If lightfield capturing devices are used to measure four-dimensional light-field data, then depth information and directional distribution information are preserved, but the amount of data acquired becomes very large making processing challenging
Solution Approach 1:
The patent segments lightfield data into multiple sub-aperture images or view images by dividing the 4D lightfield data into manageable 2D image representations. Each sub-aperture image corresponds to a specific viewpoint or angular range, allowing independent processing while preserving depth information through the collection of multiple segmented views.
Solution Approach 2:
The patent transforms 4D lightfield data into a series of 2D sub-aperture images by projecting the four-dimensional data (two spatial dimensions plus two angular dimensions) onto two-dimensional planes. This dimensionality reduction maintains the essential depth and directional information while converting the data into a format suitable for conventional image processing algorithms.
2Device complexity
If conventional image capturing devices are used to render three-dimensional scenes onto two-dimensional sensors, then the amount of data is reduced, but depth information is lost
Solution Approach 1:
The patent enables conventional 2D image sensors to capture lightfield data that contains both 2D image information and 3D depth information. By using microlens arrays or camera arrays in conjunction with standard sensors, the system performs multiple functions: capturing conventional 2D images while simultaneously encoding depth and directional information in the lightfield data structure.
3Device complexity
If lightfield data is processed by grouping rays with the same origin, then data complexity is reduced and depth information is maintained, but additional processing steps are required
Solution Approach 1:
The patent performs preliminary grouping of light rays by their origin points before conducting detailed processing operations. By pre-organizing the lightfield data into ray groups that share common origins, the system prepares the data structure in advance to facilitate efficient depth map generation, focal stacking, and other processing tasks that require coherent ray bundles.
Data Source
Figure 1~3
Figure 2A~2B
Figure 4~5
AI summary
Method and device adapted for the processing of lightfield data representative of a scene, said lightfield data comprising a plurality of elements, 4-dimensional coordinates being associated with each element. Following operations are performed: associating a ray with each element, the ray being obtained from the 4-dimensional coordinates associated with each element; determining a depth information for each element; determining an origin of each ray in the scene according to the depth information; grouping rays having a same origin in the scene to form a plurality of groups; processing the lightfield data according to the plurality of groups.