Adaptive Patch Packing Block Size for Multi-View Video Atlases
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multi-view video encoding technologies face inefficiencies due to fixed patch packing block sizes, leading to discarded patches when sizes are too large and increased grid-edge information when sizes are too small, affecting encoding efficiency and synthesis performance.
Innovation Solution
Adaptive adjustment of patch packing block size based on the ratio of discarded patches, adjusting the block size until the ratio falls within predetermined thresholds to optimize packing efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If a fixed large patch packing block size is used, then the atlas frame size is reduced, but many patches are discarded leading to loss of valid pixels
Solution Approach 1:
The patch packing block size is changed from a fixed value to a dynamically adjustable parameter. The system adaptively adjusts the block size based on the characteristics of the current frame group (GOF), allowing it to optimize between atlas frame size and valid pixel retention for each specific encoding scenario rather than using a one-size-fits-all approach.
Solution Approach 2:
The invention changes the parameter of patch packing block size adaptively for each GOF based on the ratio of valid pixels in discarded patches. By monitoring this ratio and adjusting the block size parameter accordingly, the system optimizes the balance between keeping the atlas frame compact and preserving all valid pixel information from patches.
2Loss of substance
If a fixed small patch packing block size is used, then more patches are retained, but increased grid-edge information is introduced affecting synthesis performance
Solution Approach 1:
Rather than using a consistently small block size, the system dynamically adjusts the block size based on the actual patch packing results. When the ratio of valid pixels in discarded patches is high, the system increases the block size to retain more patches, and when the ratio is low, it can use larger blocks to reduce grid-edge effects, optimizing for each encoding scenario.
Solution Approach 2:
The patch packing block size parameter is adjusted based on the calculated ratio of valid pixels in discarded patches. This adaptive parameter change allows the system to find the optimal block size that minimizes both patch disc loss and grid-edge information, rather than being constrained to a fixed small size.
3Productivity
If adaptive adjustment of patch packing block size is implemented, then encoding efficiency and synthesis performance are improved, but computational complexity increases
Solution Approach 1:
The system implements a feedback mechanism where the ratio of valid pixels in discarded patches is calculated after each patch packing operation. This feedback information is then used to adjust the patch packing block size for the next GOF, creating a closed-loop control system that automatically optimizes encoding efficiency without requiring complex external control mechanisms.
Solution Approach 2:
The adaptive adjustment process is self-regulating, using the encoding results themselves (the ratio of valid pixels in discarded patches) to guide future encoding decisions. The system serves itself by using its own performance metrics to optimize its parameters, reducing the need for external complex control systems.
Data Source
AI summary
Proposed are a method and apparatus for adjusting an adaptive patch packing block size of a multi-view video. The method may include receiving an initial patch packing block size as an input, and calculating a width and height of an atlas frame according to the patch packing block size. The method may also include performing patch packing according to the patch packing block size and a size of the atlas frame, and calculating a ratio of the number of valid pixels in patches that are not packed and discarded as a result of the patch packing. The method may further include adjusting adaptively the patch packing block size according to the calculated ratio of the number of valid pixels in the discarded patches, and re-performing the patch packing according to the adjusted patch packing block size.