Video Upsampling Using Adaptive Masking for Screen Content Sharpness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video compression technologies, such as HEVC and VVC, face challenges in achieving high-quality upsampling of screen content images and videos, particularly in preserving sharpness and utilizing local and non-local information, leading to blurred outputs and inefficient coding.
Innovation Solution
A method for video processing that determines whether to apply refinement or sharpness enhancement processes based on coding information, using a mask generation and unsharp masking architecture to classify pixels and enhance high-frequency content, thereby improving upsampling and coding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If conventional video compression technologies (HEVC, VVC) are used for upsampling screen content, then coding efficiency is maintained at acceptable levels, but visual quality deteriorates with blurred outputs and loss of sharpness
Solution Approach 1:
The patent applies different processing strategies to different regions of the video content. It identifies screen content regions versus natural content regions and applies appropriate upsampling techniques to each, preserving sharpness in screen content while maintaining coding efficiency through region-adaptive processing
Solution Approach 2:
The patent segments video content into different types (screen content vs. natural content) and processes each segment differently. This segmentation allows selective application of sharpness-preserving techniques only where needed, rather than uniformly across all content
2Quantity of substance
If upsampling is applied to increase video resolution, then the number of pixels increases, but visual quality deteriorates due to blurriness and artifacts
Solution Approach 1:
The patent introduces an intermediary classification step that analyzes coding information to determine whether a block is screen content or natural content. This intermediary analysis enables selective application of appropriate upsampling techniques, preventing the direct application of generic upsampling that causes blurriness
Solution Approach 2:
The patent changes processing parameters based on content type identification. For screen content blocks, it applies techniques that preserve edges and sharpness, while for natural content, it uses traditional upsampling methods, thereby adapting parameters to maintain visual quality while increasing pixel count
3Manufacturing precision
If refinement or enhancement processes are applied to all video blocks, then visual quality improves, but computational complexity and processing time increase
Solution Approach 1:
The patent applies refinement and enhancement processes selectively only to screen content blocks rather than all video blocks. By using coding information to identify which blocks need enhancement, it performs partial action that achieves visual quality improvement while avoiding unnecessary computational complexity in already-adequate regions
Data Source
AI summary
Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: determining, during a conversion between a current video part of a video and a bitstream of the video, a process applied to the current video part at least based on coding information of the current video part, the determined process comprises at least one of an upsampling process or an enhancement process; and performing the conversion based on the determined process. The method in accordance with the present disclosure improves the coding process of the current video unit. Compared with the conventional solution, the proposed method can advantageously improve the coding efficiency and an image/video of larger size with more pixels and better visual quality is achieved.