Video Image Processing Method for HEVC Encoding Speed

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current high efficiency video coding (HEVC) protocols require high machine performance for real-time encoding due to extensive interpolation needs, leading to lowered video compression performance.

Innovation Solution

A video image processing method that performs half pixel estimation to identify optimal locations within a coding tree unit, reduces interpolation areas, and focuses quarter pixel estimation on specific partitions with minimal rate distortion costs, thereby improving encoding speed and lowering calculation complexity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If extensive interpolation is performed according to integer pixel to obtain reference pixels in HEVC coding, then motion estimation accuracy is improved, but calculation complexity increases and encoding speed decreases

Engineering Contradiction:
Improvemotion estimation accuracyVSAvoidcalculation complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent divides the search area into multiple partitions and performs quarter pixel estimation only in the first partition containing the optimal half pixel location, rather than performing interpolation across the entire area. This segmentation reduces the number of interpolation operations while maintaining motion estimation accuracy in the most relevant region.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs quarter pixel estimation partially - only in the first partition rather than in all partitions. This partial action is sufficient to achieve good motion estimation results while significantly reducing calculation complexity compared to performing full area estimation.

Inventive Principle:
Principle #16Partial or excessive action

2Measurement precision

If quarter pixel estimation is performed in all areas, then motion estimation precision is improved, but encoding speed decreases

Engineering Contradiction:
Improvemotion estimation precisionVSAvoidencoding speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the estimation process into two stages: half pixel estimation across the entire area, followed by quarter pixel estimation only in the first partition. This segmentation allows the system to achieve high precision where needed while maintaining encoding speed by limiting expensive quarter pixel operations to a smaller region.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs half pixel estimation as a preliminary action before quarter pixel estimation. This preliminary estimation identifies the optimal half pixel location and determines the first partition, which then guides the more computationally intensive quarter pixel estimation to only the necessary area.

Inventive Principle:
Principle #10Preliminary action

3Loss of substance

If HEVC encoding with multiple block sizes and prediction methods is implemented, then compression rate is improved, but machine performance requirements increase

Engineering Contradiction:
Improvecompression rateVSAvoidmachine performance
Core Design Contradiction:
Loss of substanceVSPower

Solution Approach 1:

The patent applies segmentation to the estimation process by dividing it into half pixel and quarter pixel stages, and by partitioning the search area. This segmented approach reduces the overall computational power required while maintaining the compression benefits of HEVC encoding.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses partial action by performing quarter pixel estimation only in the first partition rather than throughout the entire search area. This reduces machine performance requirements while still achieving sufficient motion estimation accuracy for effective compression.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11589073B2Method and device for processing video image
Publication Date: 2023.02.21 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US11589073B2 patent drawing
  • US11589073B2 patent drawing
  • US11589073B2 patent drawing

AI summary

Embodiments of the present disclosure disclose a video image processing method performed at a computing device, including: after performing deblocking and sample adaptive offset on a reconstructed coding tree unit within a target image frame, performing half pixel estimation on the coding tree unit of the target image frame to obtain an optimal half pixel location having a minimum rate distortion cost; dividing a surrounding area of the optimal half pixel location into four partitions; selecting, among the four partitions according to rate distortion costs respectively of four half pixel locations adjacent to the optimal half pixel location, a first partition used for quarter pixel estimation; performing quarter pixel estimation on the first partition according to the optimal half pixel location, to obtain an optimal quarter pixel location having a minimum rate distortion cost within the first partition; and performing motion compensation to the target image frame by using at least one of the optimal half pixel location and the optimal quarter pixel location as a motion estimation result.