Video Codec Resolution Adaptation via Motion Vector Energy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding and decoding technologies face inefficiencies due to complex processing operations, resulting in low peak signal-to-noise ratio (PSNR) and increased distortion, especially under limited bandwidth conditions.

Innovation Solution

A method that determines a target resolution for video frames based on the energy parameters of motion vectors (MV) in reference frames, such as average and variance values, to adaptively select optimal resolutions for encoding and decoding, thereby improving efficiency and reducing distortion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a codec uses a high resolution under a small transmission bandwidth, then the video quality is maintained, but the PSNR is relatively small while the distortion of the image frames is relatively large

Engineering Contradiction:
Improvevideo qualityVSAvoidPSNR
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The patent applies dynamics by making the resolution adaptive rather than fixed. The codec dynamically adjusts the resolution of video frames based on motion characteristics (motion energy calculation) and bandwidth conditions. Frames with high motion content are encoded at lower resolutions while frames with low motion content maintain higher resolutions, optimizing the balance between video quality and transmission bandwidth utilization.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the resolution parameter adaptively based on motion energy calculations. By calculating motion energy for each frame and comparing it against thresholds, the system adjusts the resolution parameter to optimize encoding efficiency. This parameter change strategy allows the codec to maintain acceptable video quality while improving PSNR under varying bandwidth conditions.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If a codec uses a low resolution under a high transmission bandwidth, then the encoding speed is improved, but the PSNR is also relatively small while the distortion of the image frames is relatively large

Engineering Contradiction:
Improveencoding speedVSAvoidPSNR
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The system dynamically adjusts resolution based on actual motion content in each frame rather than using a fixed low resolution. When motion energy is low, the codec automatically increases resolution to maintain high PSNR, while maintaining fast encoding speed when motion energy is high. This dynamic adaptation resolves the contradiction between encoding speed and video quality.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The resolution parameter is changed adaptively based on motion energy calculations. The codec calculates motion energy for each frame and adjusts the resolution parameter accordingly, allowing PSNR to be maintained at high levels when bandwidth permits while keeping encoding efficient through selective resolution adjustment rather than universal low-resolution encoding.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If complex processing operations are used for resolution determination, then the video quality can be optimized, but the encoding and decoding efficiency is reduced

Engineering Contradiction:
Improvevideo qualityVSAvoidencoding and decoding efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent extracts only the essential motion information needed for resolution determination by calculating motion energy from motion vectors. Instead of performing complex full-frame analysis, the system extracts motion energy metrics and uses these simplified features to make resolution decisions, maintaining video quality optimization while significantly reducing processing complexity and improving encoding/decoding efficiency.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system changes from complex processing operations to simplified parameter-based decisions. By calculating motion energy (a simplified parameter) and comparing it against predetermined thresholds, the codec determines resolution without requiring complex image analysis. This parameter-based approach maintains video quality optimization while dramatically improving encoding and decoding efficiency.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11979577B2Video encoding method, video decoding method, and related apparatuses
Publication Date: 2024.05.07 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US11979577B2 patent drawing
  • US11979577B2 patent drawing
  • US11979577B2 patent drawing

AI summary

This application discloses a video decoding method, a video encoding method, and related apparatuses. The method includes: determining a current video frame; obtaining, from video frames that have been decoded, an energy parameter of an MV in a reference frame associated with the current video frame, the energy parameter including at least one of the following: an average value of the MV and a variance of the MV; determining, according to the energy parameter, a target resolution used for decoding the current video frame; and decoding the current video frame by using the target resolution. In this application, the technical problem of relatively low video encoding and decoding efficiency caused by complex processing operations in the related art is resolved.