Adaptive Frame Compression for Video Decoding Buffer Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional frame compression techniques in video processing systems use a fixed compression ratio for all reference frames, leading to quality degradation due to noise propagation, especially in advanced video coding standards like HEVC, where the size of the frame buffer increases significantly with picture resolution, necessitating an adaptive approach that considers the nature of reference frames and system information.

Innovation Solution

An adaptive frame compression method that adjusts compression parameters based on decoder system information and bitstream syntax elements, such as system bandwidth, frame buffer size, and picture type, allowing for varying compression ratios to optimize storage and quality, applicable to both scalable and multi-layer video coding systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Volume of stationary object

If lossy compression is used for frame compression to achieve higher degree of data reduction, then frame buffer size is reduced, but noise is introduced that degrades quality of the reconstructed video

Engineering Contradiction:
Improveframe buffer sizeVSAvoidvideo quality
Core Design Contradiction:
Volume of stationary objectVSReliability

Solution Approach 1:

The patent applies different compression ratios to different reference frames based on their picture types (I-frames, P-frames, B-frames). I-frames receive lower compression ratios to preserve quality as they are most critical for reference, while P-frames and B-frames receive higher compression ratios. This local differentiation resolves the contradiction by applying compression selectively rather than uniformly.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts compression parameters (compression ratio) based on the nature of reference frames and system information. The compression ratio is not fixed but varies according to frame type, system bandwidth, frame buffer status, and other parameters, allowing optimization between size reduction and quality preservation.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If conventional frame compression uses fixed compression ratio for all reference frames, then implementation is simple, but noise impact is not minimized and quality degradation occurs

Engineering Contradiction:
Improvecompression control complexityVSAvoidvideo quality
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent transitions from static fixed compression ratio to dynamic adaptive compression ratio. The compression parameter is continuously adjusted based on real-time analysis of reference frame nature and system status, enabling the system to respond to varying conditions and optimize quality without excessive complexity.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent incorporates feedback mechanisms where system information (bandwidth, frame buffer size, processing load) and frame nature (picture type, reference frame indicator) are continuously monitored and used to adjust compression parameters. This feedback loop enables quality optimization while managing complexity through automated control.

Inventive Principle:
Principle #23Feedback

3Productivity

If more reference frames are used in advanced coding systems like HEVC, then coding efficiency is improved, but frame buffer size increases significantly

Engineering Contradiction:
Improvecoding efficiencyVSAvoidframe buffer size
Core Design Contradiction:
ProductivityVSVolume of stationary object

Solution Approach 1:

The patent applies differential compression to different reference frames within the same buffer. By identifying which frames are most critical (I-frames) and applying lower compression to those while applying higher compression to less critical frames (P-frames, B-frames), the system maintains coding efficiency while reducing overall buffer size requirements.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent changes compression parameters dynamically based on the number and importance of reference frames. When more reference frames are used in advanced coding systems, the system adjusts compression ratios to balance the increased buffer burden with the need to maintain reference frame quality for efficient coding.

Inventive Principle:
Principle #35Parameter changes

4Reliability

If picture resolution is increased for HDTV signals, then video quality is improved, but storage requirement for reference frames increases six times

Engineering Contradiction:
Improvevideo qualityVSAvoidstorage requirement
Core Design Contradiction:
ReliabilityVSVolume of stationary object

Solution Approach 1:

The patent applies selective compression based on the importance of each reference frame. For high-resolution HDTV signals, I-frames receive lower compression to preserve quality, while P-frames and B-frames receive higher compression. This local differentiation allows the system to maintain overall video quality while significantly reducing the storage requirement compared to uniform compression approaches.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10171824B2System and method for adaptive frame re-compression in video processing system
Publication Date: 2019.01.01 MEDIATEK INC
  • US10171824B2 patent drawing
  • US10171824B2 patent drawing
  • US10171824B2 patent drawing

AI summary

Method and system of video decoding incorporating frame compression to reduce frame buffer size are disclosed. The method adjusts parameters of the frame compression according to decoder system information or syntax element in the video bitstream. The decoder system information may be selected from a group consisting of system status, system parameter and a combination of system status and system parameter. The decoder system information may include system bandwidth, frame buffer size, frame buffer status, system power consumption, and system processing load. The syntax element comprises reference frame indicator, initial picture QP (quantization parameter), picture type, and picture size. The adaptive frame compression may be applied to adjust compression ratio. Furthermore, the adaptive frame compression may be applied to a decoder for a scalable video coding system or a multi-layer video coding system.