Sub-pixel Interpolation Mode for Video Frame Resolution Matching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video encoding methods encode all video frames indiscriminately, leading to low utilization efficiency of reference frames and inflexible reference relationships, especially when frames have different resolutions, resulting in poor video quality at limited bandwidth.

Innovation Solution

A method and apparatus that determine a sub-pixel interpolation mode to process reference frames based on the resolution of current frames, adjusting the reference frames to match the current frame's resolution, allowing for flexible reference relationships and improved encoding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If all video frames are encoded indiscriminately with the same resolution, then the encoding process is simple, but the utilization efficiency of reference frames is low and video quality is poor

Engineering Contradiction:
Improveencoding efficiencyVSAvoidvideo quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent segments the reference frame processing into different resolution levels. Instead of treating all reference frames uniformly, the system divides them into different resolution categories and processes each according to its specific resolution requirements, enabling selective reference frame usage at appropriate resolutions

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic resolution adaptation where the reference frame resolution is dynamically adjusted based on the current frame's resolution requirements. The system can switch between different reference frame resolutions (e.g., full resolution, half resolution, quarter resolution) depending on the encoding needs, making the reference frame utilization flexible and adaptive

Inventive Principle:
Principle #15Dynamics

2Productivity

If reference frames with different resolutions are used, then the utilization efficiency of reference frames is improved, but the encoding process becomes more complex

Engineering Contradiction:
Improvereference frame utilization efficiencyVSAvoidencoding process complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent changes the resolution parameter of reference frames dynamically. By adjusting the resolution parameter based on the current frame's requirements, the system can efficiently utilize reference frames at appropriate resolutions without requiring complex processing. The resolution parameter is modified through standard image processing operations like downsampling and upsampling

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces resolution adaptation as an intermediary process between the reference frame and the current frame. This intermediary step (resolution matching) simplifies the overall encoding process by ensuring that reference frames are at the correct resolution before being used for prediction, avoiding the need for complex multi-resolution processing throughout the encoding pipeline

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If reference frames are processed to match current frame resolution, then inter-frame prediction accuracy is improved, but processing time increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies partial processing to reference frames based on their resolution relationship with the current frame. Instead of always performing full resolution matching, the system performs only the necessary processing - for example, using a downsampled reference frame when the current frame is also downsampled, avoiding unnecessary upsampling operations that would consume excessive time

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11563974B2Method and apparatus for video decoding
Publication Date: 2023.01.24 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US11563974B2 patent drawing
  • US11563974B2 patent drawing
  • US11563974B2 patent drawing

AI summary

This application relates to a method and apparatus, a storage medium, and a computer device for video encoding and decoding. The video encoding method includes: determining a sub-pixel interpolation mode, the sub-pixel interpolation mode comprising one of a direct sub-pixel interpolation mode or a sampled sub-pixel interpolation mode; acquiring motion estimation pixel precision corresponding to a current video frame; performing sub-pixel interpolation processing on a reference frame corresponding to the current video frame according to a resolution relationship between the current video frame and the reference frame, the motion estimation pixel precision, and the sub-pixel interpolation mode, to obtain a target reference frame; and encoding the current video frame according to the target reference frame, to obtain encoded data corresponding to the current video frame.