Light Field Camera Inter-Frame Parallax Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Light field cameras generate extremely large amounts of data due to the division of light rays by microlenses, leading to increased data storage and processing challenges, necessitating effective compression techniques.
Innovation Solution
An image processing apparatus with multiple optical systems and photoelectric conversion elements that inter-frame prediction encode image frames with different parallax, reducing data volume through efficient encoding methods like motion compensation prediction encoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If light field camera uses microlenses to divide light rays and obtain directional information, then image quality and depth information are improved, but data amount increases extremely large
Solution Approach 1:
The patent segments the light field data into multiple image frames with different parallaxes, where each frame corresponds to a specific depth plane. This segmentation allows the system to process and compress data more efficiently by treating each depth layer independently, thereby reducing the overall data burden while preserving depth information.
Solution Approach 2:
The patent transforms the four-dimensional light field data (two spatial dimensions plus two angular dimensions) into a series of two-dimensional image frames with different parallaxes. This dimensional transformation enables the use of conventional 2D image compression techniques while still capturing the essential depth and directional information of the light field.
2Loss of information
If light field camera captures all light ray information including angle of incidence, then comprehensive image information is obtained, but data storage and processing become extremely difficult
Solution Approach 1:
The patent extracts only the essential parallax information from the complete light field data, discarding redundant angular details. By taking out only the necessary depth-related parallax components and representing them as separate image frames, the system maintains comprehensive depth information while dramatically simplifying data storage and processing requirements.
3Quantity of substance
If ordinary compression techniques are applied to light field data, then some data reduction is achieved, but compression ratio is insufficient due to data characteristics
Solution Approach 1:
The patent applies dynamic compression strategies by selecting different reference frames and prediction modes for each image frame based on its parallax characteristics. This dynamic approach allows the system to achieve high compression ratios while adapting to the specific features of each depth layer, thereby maintaining image quality even at high compression levels.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
The proposed solution achieves high compression ratios, significantly reducing the data amount and enabling efficient storage and processing of light field data while maintaining image quality.
Implementation Method 1
a plurality of photoelectric conversion elements which are two-dimensionally arranged for each of the plurality of optical systems and are used to photoelectrically convert an image from each of the optical systems
Data Source
AI summary
An image processing apparatus has a plurality of optical systems arranged two-dimensionally and a plurality of photoelectric conversion elements which are two-dimensionally arranged for each of the plurality of optical systems and are used to photoelectrically convert an image from each optical system, and inter-frame prediction encodes a plurality of image frames each having a different parallax, which are formed by the plurality of photoelectric conversion elements.