Video Encoding Mode Prediction Using Multi-Size Pixel Blocks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional video coding methods require traversing all prediction modes to select the optimal encoding mode, leading to increased computational complexity and prolonged processing time.
Innovation Solution
An encoding mode prediction method using a convolutional neural network trained on multi-size pixel blocks to determine the target encoding mode for video frames, reducing the need for cyclic traversal and optimizing the selection process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional video coding mode is used to traverse all prediction modes, then optimal prediction mode can be selected, but computational complexity increases greatly
Solution Approach 1:
The patent replaces the conventional mechanical traversal approach with a neural network-based prediction system. Instead of systematically iterating through all prediction modes to find the optimal one, a convolutional neural network directly predicts the most likely encoding mode based on image characteristics, substituting computational traversal with neural computation.
Solution Approach 2:
The neural network acts as an intermediary between image input and encoding mode selection. It processes image features through multiple layers and outputs predicted encoding modes, serving as a mediator that eliminates the need for direct traversal of all possible prediction modes while maintaining selection accuracy.
2Measurement precision
If conventional video coding mode traverses all prediction modes, then optimal encoding mode is found, but processing time is prolonged
Solution Approach 1:
The neural network is pre-trained on large datasets of images and their corresponding optimal encoding modes. This preliminary training allows the system to make accurate predictions about encoding modes for new images without needing to traverse all possible modes during actual processing, significantly reducing real-time computation time.
Solution Approach 2:
The patent substitutes the time-consuming mechanical traversal process with neural network inference. The neural network's trained weights and architecture enable it to directly compute encoding mode predictions in a single forward pass, eliminating the iterative traversal process that would otherwise be required.
3Productivity
If neural network is used to predict encoding mode, then processing time is reduced, but model training complexity increases
Solution Approach 1:
The neural network architecture is designed to be universally applicable to various image types and encoding scenarios. By training on diverse datasets and learning general features, the model can handle multiple encoding tasks with a single unified architecture, reducing the need for separate training models for different applications.
Solution Approach 2:
The patent employs techniques such as data augmentation, normalization, and adaptive learning rates to manage training complexity. These parameter changes and adjustments allow the model to learn effectively from large datasets without requiring proportional increases in computational resources during training, balancing productivity gains with training feasibility.
Data Source
AI summary
The present disclosure provides an encoding mode prediction method and apparatus, an electronic device, and a storage medium. The method includes: acquiring information of at least two frames of images to be processed, the at least two frames of images to be processed being at least two continuous frames of images; and inputting the information of the at least two frames of images to be processed to an encoding mode prediction network for prediction, and determining a target encoding mode; and the encoding mode prediction network is a network obtained by training a convolutional neural network based on multi-size pixel blocks, and the target encoding mode is used for coding and/or decoding of the images to be processed.


