Sub-region Motion Refinement for Video Coding Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video processing technologies face challenges in efficiently managing bandwidth demand due to the high data requirements of digital video, particularly as the number of connected devices increases, and existing video coding standards struggle with refining motion information effectively.
Innovation Solution
The implementation of sub-region based motion information refinement methods, including optical flow-based techniques and decoder-side motion vector refinement, to enhance video processing efficiency by refining motion information within specific regions of video blocks and applying these refinements during conversion between video blocks and their coded representations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If optical flow-based motion information refinement is applied to the entire current video block, then motion information accuracy is improved, but computational complexity and processing time increase significantly
Solution Approach 1:
The current video block is divided into multiple sub-regions, and motion information refinement is applied selectively to specific sub-regions rather than the entire block. This segmentation approach maintains motion accuracy in regions where it is most beneficial while reducing overall computational complexity by excluding regions where refinement would provide minimal improvement.
Solution Approach 2:
Different levels of motion information refinement are applied to different sub-regions based on their specific characteristics. Regions with high motion variability or importance receive full refinement, while other regions receive reduced or no refinement, optimizing the balance between accuracy and computational cost.
2Stability of the object's composition
If motion vector offsets are clipped to a limited range, then processing stability is improved, but motion information precision is reduced
Solution Approach 1:
The clipping range for motion vector offsets is made adaptive rather than fixed. The range parameters N and M are determined dynamically based on the specific characteristics of the video content, motion magnitude, and reference frame differences, allowing the system to maintain stability while preserving precision when larger offsets are justified by the content.
3Loss of energy
If sub-region based motion refinement is implemented, then bandwidth efficiency is improved, but decoding complexity increases
Solution Approach 1:
Motion information refinement is performed at the encoder side before transmission, allowing the decoder to work with pre-refined motion data. This preliminary refinement reduces the amount of data that needs to be transmitted and processed at the decoder, improving bandwidth efficiency while limiting the complexity increase to the encoder side.
Data Source
AI summary
Devices, systems, and methods for video processing are described. In one aspect, a video processing method is provided to include determining, for a conversion between a current video block of a video and a coded representation of the video, that a motion information of the current video block is refined using an optical flow-based method in which at least one motion vector offset is derived for a region within the current video block; clipping the at least one motion vector offset to a range [−N,M], where N and M are integers based on a rule; and performing the conversion based on at least one clipped motion vector offset.