Video Frame Energy Mapping for Adaptive Quantization Encoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding methods struggle to adapt to complex scenarios in encoding, particularly in managing bit rates for smooth and complex regions of video frames.

Innovation Solution

A method involving determining energy maps based on alternating current energy of macro blocks of varying sizes, followed by adaptive quantization parameters, to encode video frames effectively.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If macro block-level adaptive quantization is used to allocate more bit rates for smooth regions, then visual quality is improved, but adaptability to complex scenarios deteriorates

Engineering Contradiction:
Improvevisual qualityVSAvoidadaptability to complex scenarios
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent divides the video frame into multiple macro blocks of different sizes (e.g., 16x16, 32x32, 64x64 blocks) and calculates alternating current energy for each size separately. This multi-scale segmentation allows the method to capture both fine-grained and coarse-grained energy distributions, enabling better adaptation to complex scenarios with large resolution changes while maintaining visual quality through targeted bit rate allocation.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If multiple macro block sizes are analyzed to improve adaptability, then adaptability to complex scenarios is improved, but computational complexity increases

Engineering Contradiction:
Improveadaptability to complex scenariosVSAvoidcomputational complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies different macro block sizes to different regions of the video frame based on local energy characteristics. By calculating alternating current energy at multiple scales and using region-based adaptive quantization, the method focuses computational resources on complex regions while using simpler processing for smooth regions, thereby improving adaptability without uniformly increasing complexity across the entire frame.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12531989B2Method for video processing, electronic device, and storage medium
Publication Date: 2026.01.20 SHANGHAI SENSETIME INTELLIGENT TECH CO LTD
  • US12531989B2 patent drawing
  • US12531989B2 patent drawing
  • US12531989B2 patent drawing

AI summary

A video processing method, an electronic device and a storage medium are provided. The method includes: a target frame is determined in a video to be processed; at least two first energy images corresponding to the target frame are determined based on at least two preset macro block sizes respectively, each first energy image represents alternating current energy of first macro block(s) corresponding to a respective macro block size and the first macro block(s) are obtained by segmenting the target frame based on the respective macro block size; a first energy map corresponding to the target frame is determined based on the first energy images, the first energy map represents energy distribution in the target frame; and an adaptive quantization parameter corresponding to the target frame is determined based on the first energy map and the target frame is encoded using the adaptive quantization parameter.