Video Block Color Segmentation for Motion Vector Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video compression schemes, such as VPx and H.264, face challenges in efficiently encoding and decoding high-quality video signals over limited bandwidth channels, particularly in accurately predicting and encoding motion vectors across frames with varying pixel colors.
Innovation Solution
The method involves color segmentation of video blocks into segments based on pixel colors, determining motion vectors for each segment, and encoding using these vectors to improve prediction accuracy and efficiency, with the decoder reconstructing blocks using segment maps and motion vectors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If block-based motion estimation is used to predict motion vectors, then bandwidth consumption is reduced through compression, but prediction accuracy deteriorates when blocks contain multiple colors with different motion characteristics
Solution Approach 1:
The patent divides a video block into multiple color segments based on pixel color similarity. Each color segment is then independently processed to generate its own motion vector. This segmentation allows different motion characteristics within a single block to be captured accurately, resolving the contradiction between compression efficiency and prediction accuracy for multi-color blocks.
2Measurement precision
If color segmentation is implemented to improve prediction accuracy for different colored regions, then prediction accuracy improves, but device complexity increases due to additional processing steps
Solution Approach 1:
The patent applies different processing strategies to different regions within a block based on their color characteristics. By identifying color segments and applying motion estimation only where color variations indicate different motion, the system achieves local optimization without uniformly increasing complexity across the entire block.
Solution Approach 2:
Instead of performing full motion estimation on every block regardless of color uniformity, the patent performs color segmentation and partial motion estimation only on blocks that benefit from it. This selective approach achieves the necessary prediction accuracy improvement while avoiding unnecessary complexity in blocks that are already well-suited for standard block-based estimation.
Data Source
AI summary
Disclosed herein is method for encoding a video signal having at least one frame with a plurality of blocks having pixels. The method includes identifying a first color of pixels in a block in the at least one frame, assigning pixels in the block having the first color to a first source segment and assigning pixels in the block having a color different than the first color to a second source segment and determining a set of motion vectors derived from first source segment and a set of motion vectors derived from the second source segment.