Video Encoding Mode Prediction Using Multi-Size Pixel Blocks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional video coding methods require traversing all prediction modes to select the optimal encoding mode, leading to increased computational complexity and prolonged processing time.

Innovation Solution

An encoding mode prediction method using a convolutional neural network trained on multi-size pixel blocks to determine the target encoding mode for video frames, reducing the need for cyclic traversal and optimizing the selection process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional video coding mode is used to traverse all prediction modes, then optimal prediction mode can be selected, but computational complexity increases greatly

Engineering Contradiction:
Improveprediction mode selection accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces the conventional mechanical traversal approach with a neural network-based prediction system. Instead of systematically iterating through all prediction modes to find the optimal one, a convolutional neural network directly predicts the most likely encoding mode based on image characteristics, substituting computational traversal with neural computation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The neural network acts as an intermediary between image input and encoding mode selection. It processes image features through multiple layers and outputs predicted encoding modes, serving as a mediator that eliminates the need for direct traversal of all possible prediction modes while maintaining selection accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If conventional video coding mode traverses all prediction modes, then optimal encoding mode is found, but processing time is prolonged

Engineering Contradiction:
Improveencoding mode optimizationVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The neural network is pre-trained on large datasets of images and their corresponding optimal encoding modes. This preliminary training allows the system to make accurate predictions about encoding modes for new images without needing to traverse all possible modes during actual processing, significantly reducing real-time computation time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent substitutes the time-consuming mechanical traversal process with neural network inference. The neural network's trained weights and architecture enable it to directly compute encoding mode predictions in a single forward pass, eliminating the iterative traversal process that would otherwise be required.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If neural network is used to predict encoding mode, then processing time is reduced, but model training complexity increases

Engineering Contradiction:
Improveprocessing speedVSAvoidmodel training complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The neural network architecture is designed to be universally applicable to various image types and encoding scenarios. By training on diverse datasets and learning general features, the model can handle multiple encoding tasks with a single unified architecture, reducing the need for separate training models for different applications.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent employs techniques such as data augmentation, normalization, and adaptive learning rates to manage training complexity. These parameter changes and adjustments allow the model to learn effectively from large datasets without requiring proportional increases in computational resources during training, balancing productivity gains with training feasibility.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250386003A1Encoding mode prediction method and apparatus, electronic device and storage medium
Publication Date: 2025.12.18 SANECHIPS TECH CO LTD
  • US20250386003A1 patent drawing
  • US20250386003A1 patent drawing
  • US20250386003A1 patent drawing

AI summary

The present disclosure provides an encoding mode prediction method and apparatus, an electronic device, and a storage medium. The method includes: acquiring information of at least two frames of images to be processed, the at least two frames of images to be processed being at least two continuous frames of images; and inputting the information of the at least two frames of images to be processed to an encoding mode prediction network for prediction, and determining a target encoding mode; and the encoding mode prediction network is a network obtained by training a convolutional neural network based on multi-size pixel blocks, and the target encoding mode is used for coding and/or decoding of the images to be processed.