Video Block Partitioning Using Depth and Motion Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding techniques do not effectively utilize depth and motion information to improve compression efficiency and video quality, particularly in contexts like cloud-based gaming where this information is available.
Innovation Solution
A video processing device configured to obtain depth information and determine a partition of a video block based on binary segmentation of the depth map, allowing for efficient encoding and decoding by using the partition to process the video block.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If video blocks are partitioned using conventional methods without depth or motion information, then the processing is simpler and faster, but the compression efficiency and video quality are insufficient
Solution Approach 1:
The patent applies preliminary action by using depth information and motion vectors to pre-determine optimal partition boundaries before actual video coding processing. The depth map and motion vectors are processed in advance to identify significant depth edges and motion boundaries, which then guide the partitioning of video blocks into coding units. This preliminary determination of partitioning parameters based on depth and motion information enables more effective compression without increasing real-time processing complexity during the actual encoding/decoding operation.
2Measurement precision
If video blocks are partitioned based on depth information, then partitioning accuracy and compression efficiency improve, but the processing time and computational complexity increase
Solution Approach 1:
The patent applies segmentation by dividing the video block into multiple coding units based on depth edges and motion boundaries identified in the depth map. The depth map is processed to identify significant depth edges, which then segment the video block into appropriate coding units. This segmentation approach enables accurate partitioning that reflects actual content structure while maintaining efficient processing by using the pre-computed depth information and motion vectors to guide the segmentation process.
3Reliability
If depth and motion information are used for partitioning, then video quality and compression improve, but the system complexity and processing requirements increase
Solution Approach 1:
The patent applies the intermediary principle by using depth information and motion vectors as intermediary elements that mediate between the raw video data and the final coding decision. The depth map and motion vectors serve as intermediary structures that contain spatial and temporal information about the video content, enabling the system to make informed partitioning decisions. These intermediary data structures allow the system to achieve high video quality through accurate partitioning while managing complexity by leveraging pre-available depth and motion information rather than performing complex real-time analysis.
Data Source
AI summary
Systems, methods, and instrumentalities are disclosed herein for processing a video block based on depth and/or motion information associated with the video block. The depth and motion information may be obtained by a video processing device such as an encoder and/or a decoder in addition to the video block. By utilizing the depth and/or motion information, the video processing device may determine one or more split lines or one or more split curves for partitioning the video block and may improve the video coding speed and/or efficiency based on the partitioning.