Video Transform Selection Using Depth and Motion Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently compressing video content while maintaining quality, particularly in contexts where depth and motion information are available, such as cloud-based gaming.
Innovation Solution
A system and method for processing video blocks based on depth and motion information, where a video processing device determines whether to apply multiple transform selection (MTS), transform skip (TrSkip), or subblock transform (SBT) to a video block, and processes the block accordingly, using motion and depth information to optimize transform decisions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional video coding methods are used, then the processing is simple and fast, but the compression efficiency is insufficient and quality maintenance is poor
Solution Approach 1:
The patent implements dynamic transform selection by evaluating multiple transform types (first transform, second transform, third transform) based on motion information and depth information. The system adaptively chooses the optimal transform type for each video block rather than using a fixed transform, thereby improving compression efficiency while managing processing complexity through informed decision-making.
Solution Approach 2:
The patent changes the transform parameter selection based on motion and depth information. By analyzing motion vectors and depth maps, the system adjusts which transform type to apply (first, second, or third transform) to each block, optimizing the compression process for different video content characteristics and achieving better compression efficiency.
2Productivity
If transform operations are applied to all video blocks, then the compression is maximized, but the processing time and computational load increase
Solution Approach 1:
The patent applies transform operations selectively rather than universally. Based on motion information and depth information analysis, the system determines whether to apply the first transform, second transform, or third transform to each specific video block. This partial application of transform operations optimizes compression efficiency for blocks that benefit from transformation while avoiding unnecessary processing for blocks where other methods are more effective.
3Productivity
If multiple transform types are evaluated for each block, then the compression efficiency improves, but the decision-making complexity increases
Solution Approach 1:
The patent employs feedback mechanisms by using motion information and depth information to guide transform selection. The system continuously analyzes the video block characteristics and selects the transform type that maximizes compression efficiency for each block, creating a feedback loop where the results of transform application inform future decisions and optimize overall compression performance.
Data Source
AI summary
Systems, methods, and instrumentalities are disclosed herein for processing a video block based on depth information, motion information, and/or other types of information associated with the video block. The information may be obtained by a video processing device such as a video encoder or a video decoder in addition to texture information of the video block. Utilizing the depth, motion, and/or additional information described herein, the video processing device may determine whether to apply one or more transform modes or transform tools to the video block. The video processing device may also determine how to partition the video block (e.g., for transform coding purposes) based on the depth, motion, and/or additional information described herein