Video Encoding Using User-Guided Region Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video encoding processes in online gaming are hindered by high latency due to the complexity of motion estimation, which occupies a significant portion of encoding time and resources, affecting user experience and game quality.

Innovation Solution

The method involves using user-guided information to reduce motion estimation complexity by performing region of interest encoding and predicting motion vectors, thereby improving encoding efficiency and throughput.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If traditional motion estimation is used for video encoding, then encoding accuracy is maintained, but encoding time and computational resources increase significantly

Engineering Contradiction:
Improveencoding accuracyVSAvoidencoding time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent segments the video picture into multiple regions based on motion characteristics. Different encoding strategies are applied to different regions: high-motion regions use traditional motion estimation while low-motion regions use simplified prediction methods. This segmentation allows the system to maintain encoding accuracy for important regions while reducing overall encoding time and computational resources.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by using user-guided information to identify regions of interest and applying different prediction accuracies to different areas. Critical regions receive higher prediction accuracy with detailed motion estimation, while less important regions use simpler prediction methods. This local differentiation maintains overall encoding quality while significantly reducing total encoding time.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If comprehensive motion estimation is performed across the entire picture, then prediction accuracy is improved, but computational complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs preliminary action by using user-guided information to pre-identify motion vectors and regions of interest before the main encoding process. This preliminary step provides initial prediction data that guides subsequent encoding operations, reducing the need for exhaustive motion estimation across the entire picture and thereby lowering computational complexity while maintaining prediction accuracy for critical regions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies partial action by performing comprehensive motion estimation only for identified regions of interest rather than across the entire picture. User-guided information allows the system to focus computational resources on partial regions that require high prediction accuracy, while using simpler methods for the remainder of the picture, thus reducing overall computational complexity.

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If high bitrate is used for video transmission, then visual quality is maintained, but network bandwidth consumption increases

Engineering Contradiction:
Improvevisual qualityVSAvoidbandwidth consumption
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent changes parameters by dynamically adjusting encoding precision and bitrate allocation based on user-guided information and identified regions of interest. Instead of using high bitrate uniformly across the entire picture, the system concentrates bitrate on critical regions while using lower bitrate for less important areas. This parameter adaptation maintains visual quality for important content while significantly reducing overall bandwidth consumption.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11582478B2Video encoding technique utilizing user guided information in cloud environment
Publication Date: 2023.02.14 ALIBABA GROUP HOLDING LTD
  • US11582478B2 patent drawing
  • US11582478B2 patent drawing
  • US11582478B2 patent drawing

AI summary

The present disclosure relates to a computer-implemented method for processing video data. The method comprises receiving a user input corresponding to a first picture of the video data, generating, based on the user input, prediction information of the first picture with respect a reference picture of the video data, and encoding the first picture using the prediction information.