Plenoptic Image Encoding Central Block Spatial Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video codecs, such as H.264 and HEVC, are not optimized for encoding light field imaging data from plenoptic cameras, leading to suboptimal compression and processing of the unique characteristics of plenoptic imaging.
Innovation Solution
A method and device for encoding and decoding plenoptic images using a transmitter and receiver architecture that employs spatial interleaving of unidirectional and bidirectional predictions, with a central block encoded without spatial prediction, and subsequent blocks encoded using spatially interleaved predictions, accounting for disparity and vignetting effects to enhance compression efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If known video codecs (H.264, HEVC) are used to encode plenoptic images, then general video compression is achieved, but compression efficiency is suboptimal due to lack of optimization for light field imaging data characteristics
Solution Approach 1:
The patent applies local quality by differentiating the encoding treatment of the central block versus surrounding blocks. The central block is encoded without spatial prediction to preserve its unique information, while surrounding blocks use spatial prediction from the central block to achieve compression. This localized differentiation optimizes compression efficiency specifically for plenoptic image characteristics where the central block contains distinct information not predictable from surrounding areas.
2Loss of energy
If spatial prediction is applied to all blocks in plenoptic images, then compression is improved, but fidelity is reduced due to propagation of prediction errors from borders to center
Solution Approach 1:
The patent inverts the conventional spatial prediction approach by encoding the central block first without prediction, then using it to predict surrounding blocks outward. This reversal prevents prediction errors from propagating into the central block, preserving fidelity of the most important region while still achieving compression through the outward prediction process.
Solution Approach 2:
The patent applies local quality by differentiating the encoding treatment of the central block versus surrounding blocks. The central block is encoded without spatial prediction to preserve its unique information, while surrounding blocks use spatial prediction from the central block to achieve compression. This localized differentiation optimizes compression efficiency specifically for plenoptic image characteristics where the central block contains distinct information not predictable from surrounding areas.
3Device complexity
If conventional encoding approaches are used, then encoding simplicity is maintained, but processing capabilities for plenoptic images are insufficient
Solution Approach 1:
The patent segments the plenoptic image into a central block and surrounding blocks, applying different encoding strategies to each segment. This segmentation enables the system to handle plenoptic-specific characteristics while maintaining a relatively simple encoding process. The segmentation approach allows for specialized processing of the central block without requiring complex modifications to the overall encoding architecture.
Data Source
Figure 1~2
Figure 3~4
Figure 5
AI summary
A method for encoding a plenoptic image divided into blocks is disclosed. The method comprises: - encoding (S120) a block in a central region of the plenoptic image, called central block, without spatial prediction; and - predictively encoding (S130) blocks immediately surrounding said central block by spatially interleaving spatial unidirectional prediction and spatial bi-directional prediction.