Plenoptic Camera View Encoding to Reduce Light-Flux Variation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for encoding data from a plenoptic camera's matrix of image views do not effectively address how to select reference images, leading to issues with light flux variation among sub-aperture images, which affects video encoding efficiency.
Innovation Solution
A method that involves obtaining a reference image view by averaging all image views in the matrix and using an invertible mixing matrix to combine these views for encoding, compliant with HEVC or H.264 techniques, and generating metadata for the encoding process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If classical encoding techniques (HEVC or MV-HEVC) are used with selected reference images, then encoding can be performed with standard multi-view techniques, but light flux variation among sub-aperture images affects encoding efficiency and quality
Solution Approach 1:
The patent changes the reference image selection parameter from individual sub-aperture images to a synthesized reference image created by combining multiple sub-aperture images. This parameter change eliminates light flux variation issues while maintaining compatibility with standard HEVC/MV-HEVC encoding frameworks, thereby improving encoding efficiency without sacrificing ease of implementation
Solution Approach 2:
The patent introduces an intermediary synthesized reference image that mediates between the multiple sub-aperture images and the encoding process. This intermediary image combines information from multiple views to create a stable reference that eliminates the harmful light flux variation effect, allowing standard encoding techniques to work efficiently
2Ease of operation
If sub-aperture images are encoded independently using intra-encoding techniques, then each image can be encoded without reference to others, but compression efficiency is reduced due to ignoring inter-view correlations
Solution Approach 1:
The patent segments the encoding process into two stages: first creating a synthesized reference image from multiple sub-aperture images, then using this reference for inter-view prediction. This segmentation allows the system to exploit inter-view correlations for improved compression while maintaining operational simplicity through the standardized encoding pipeline
Solution Approach 2:
The patent merges multiple sub-aperture images into a single synthesized reference image that captures common information across views. This merging operation enables the encoding system to exploit inter-view correlations and redundancy, significantly improving compression efficiency while the standardized process maintains ease of operation
3Adaptability or versatility
If one or more reference images are selected among sub-aperture images using classical multi-view techniques, then encoding can proceed with standard algorithms, but the selection does not optimize for light flux variation issues
Solution Approach 1:
The patent changes the reference image selection parameter from choosing individual sub-aperture images to synthesizing a new reference image through combination. This parameter change optimizes the reference selection to eliminate light flux variation while maintaining adaptability through the flexible combining process and compatibility with standard encoding algorithms
Data Source
Figure 1
Figure 2
Figure 3
AI summary
In one embodiment of the disclosure, it is proposed a method for encoding a matrix of image views obtained from data acquired by a plenoptic camera. The method is remarkable in that it comprises: obtaining at least one reference image view from a combination of at least two image views from said matrix of image views; encoding image views that are different from said at least one reference image view, based on said at least one reference image view.