Transform Skip Module for Screen Content Video Compression

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing end-to-end image compression schemes are inefficient for screen content images due to differences in statistical properties compared to natural scene images, leading to degraded rate and distortion performance.

Innovation Solution

The introduction of a transform skip module into the end-to-end compression framework, which can be implemented as a long connection or a subset with fewer feature extraction units and larger scaling ratios, applied in various stages such as transform analysis, hyperprior analysis, and synthesis stages to improve coding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional video compression standards (MPEG-2, MPEG-4, H.264, HEVC, VVC) are used, then video encoding and decoding can be performed, but coding efficiency is insufficient and performance is degraded

Engineering Contradiction:
Improvecoding efficiencyVSAvoidperformance
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies parameter changes by modifying the transform block size and type dynamically based on prediction mode and block characteristics. Specifically, it uses different transform block sizes (4x4, 8x8, 16x16, etc.) and transform types (DST, DCT) depending on the prediction mode (intra vs. inter) and block size, optimizing the transformation process for different video content scenarios to improve coding efficiency

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent implements dynamics by making the transform skip module controllable and adaptive. The transform skip operation is selectively applied based on prediction mode, block size, and other conditions, allowing the system to dynamically switch between traditional transform and transform skip operations to achieve optimal performance for different video content

Inventive Principle:
Principle #15Dynamics

2Productivity

If transform skip module is introduced to improve coding efficiency, then performance is enhanced, but device complexity increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoidcompression framework complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the transform process into separate controllable modules. The transform skip module is implemented as a distinct, selectable component that can be independently controlled based on prediction mode and block characteristics, allowing the system to apply transform skip only where beneficial rather than uniformly across all blocks

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by selectively applying transform skip operation only to specific blocks where it provides benefit, rather than applying it universally. The transform skip is conditionally applied based on prediction mode, block size, and other factors, performing the operation partially rather than completely to balance complexity and performance

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20240422315A1Method, apparatus, and medium for video processing
Publication Date: 2024.12.19 DOUYIN VISION CO LTD
  • US20240422315A1 patent drawing
  • US20240422315A1 patent drawing
  • US20240422315A1 patent drawing

AI summary

Embodiments of the present disclosure provide a solution for video processing. A method for video processing is proposed. The method comprises: applying, during a conversion between a video unit of a video and a bitstream of the video unit, a compression process to the video unit based on a compression framework, wherein the compression framework comprises a transform skip module; and performing the conversion based on the compressed video unit.