Adaptive Video Partitioning Using Source Variance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video encoding techniques are computationally intensive and not suitable for real-time applications like video conferencing, as they require significant resources for determining the optimal partitioning scheme, which can lead to imprecise results due to encoding errors in reference frames.
Innovation Solution
Adaptive source variance-based partitioning, which measures variances between current and previous frames to dynamically select partition sizes for blocks, switching between fixed and adaptive partitioning based on motion analysis to improve encoding efficiency and quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If computationally intensive encoding techniques are used to determine optimal partitioning scheme, then manufacturing precision is improved, but productivity deteriorates
Solution Approach 1:
The patent changes the parameter basis for partitioning from complex rate-distortion optimization to simple variance-based metrics. By calculating variance of pixel values and variance of differences from reference frames, the system determines partition sizes using straightforward computational parameters rather than intensive optimization algorithms, thus improving encoding speed while maintaining adequate partitioning precision
Solution Approach 2:
The patent segments the encoding process into distinct stages: first calculating variance for each block, then using predefined thresholds to determine partition sizes. This segmentation replaces the monolithic computationally intensive optimization process with multiple simpler, sequential steps that are faster to execute while achieving comparable partitioning quality
2Manufacturing precision
If computationally intensive encoding techniques are used to determine optimal partitioning scheme, then manufacturing precision is improved, but device complexity worsens
Solution Approach 1:
The patent uses simple, easily computable variance metrics as disposable proxies for the complex rate-distortion optimization process. These variance calculations are computationally inexpensive and can be performed quickly for each block, replacing the need for complex encoding algorithms while achieving sufficient partitioning precision
Solution Approach 2:
The patent substitutes the mechanical complexity of iterative optimization algorithms with a simpler statistical approach based on variance calculation. Instead of using complex encoding/decoding loops to determine optimal partitions, the system uses direct variance computation and threshold comparison, significantly reducing device complexity
3Device complexity
If fixed partitioning is used, then device complexity is reduced, but manufacturing precision deteriorates
Solution Approach 1:
The patent introduces dynamic adaptability by using variance-based thresholds to automatically adjust partition sizes. Instead of fixed partitioning, the system dynamically selects from multiple partition sizes (e.g., 16x16, 32x32, 64x64) based on the calculated variance of each block and its difference from the reference frame, thereby improving partitioning precision while keeping device complexity low through predefined threshold rules
4Productivity
If adaptive partitioning based on variance is used, then productivity is improved, but manufacturing precision may deteriorate
Solution Approach 1:
The patent performs preliminary variance calculation and partition size selection before the actual encoding process. By pre-determining partition sizes based on variance thresholds, the system avoids computationally intensive optimization during encoding, improving productivity while ensuring adequate partitioning precision through the preliminary analysis
Data Source
AI summary
Frames including in a video bitstream may be partitioned using source difference variance based partitioning before encoding. Variances between blocks of a current video frame and blocks of a previous video frame are used to partition the current video frame into varying block sizes depending upon the magnitude of the variances. Blocks with low variance may be combined with other low variance blocks to form larger blocks, while blocks with high variance may be further partitioned into smaller blocks to improve coding efficiency. In cases where partitioning is unlikely to provide improved efficiency, the variation calculations may be skipped in favor of using fixed partitioning for a frame. The partitioned frames are decoded.