Learned Codec Bitrate Adaptation via Probability Model Signals

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing multimedia encoding technologies struggle to efficiently adapt to multiple bitrates and reconstruction qualities, leading to suboptimal performance in varying network conditions and user demands.

Innovation Solution

Implementing an end-to-end learned codec that utilizes adaptation signals to dynamically adjust a probability model based on neural networks, allowing for coding at different bitrates and reconstruction qualities through mechanisms like concatenation, modulation, and update of latent tensors using gradient descent optimization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a standardized codec is used for encoding media data, then compatibility and ease of operation are improved, but adaptability to multiple bitrates and reconstruction qualities deteriorates

Engineering Contradiction:
Improveease of operationVSAvoidadaptability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic adaptability by introducing adaptation signals that modify the probability model based on target bitrate and reconstruction quality requirements. The system transitions from a static standardized codec to a dynamic system where the probability model can be adapted in real-time through gradient descent optimization, allowing the same codec to efficiently handle multiple bitrates and quality levels without sacrificing compatibility.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameters of the probability model by introducing adaptation signals that modify model behavior based on encoding conditions. These adaptation signals adjust parameters such as quantization steps, probability distributions, and neural network weights dynamically, enabling the codec to optimize performance across different bitrates and reconstruction qualities while maintaining the standardized codec framework.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If adaptation signals are introduced to enable multiple bitrates, then adaptability is improved, but device complexity increases

Engineering Contradiction:
ImproveadaptabilityVSAvoiddevice complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-training the neural network components and pre-computing adaptation signals for different bitrate scenarios. The adaptation signals are generated based on predetermined target bitrates and reconstruction qualities, allowing the system to quickly switch between modes without complex real-time calculations. This pre-computation approach reduces runtime complexity while maintaining high adaptability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The adaptation signals serve as intermediaries between the standardized codec framework and the multiple bitrate requirements. Rather than directly modifying the entire codec structure, the adaptation signals act as a lightweight intermediary layer that adjusts the probability model parameters, simplifying the implementation complexity while achieving versatile bitrate adaptation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If gradient descent optimization is used to train the probability model, then manufacturing precision is improved, but loss of time increases

Engineering Contradiction:
Improvemanufacturing precisionVSAvoidloss of time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs gradient descent optimization in advance during the training phase to achieve high precision in the probability model. The neural network weights and adaptation signal generation mechanisms are pre-optimized using gradient descent, ensuring manufacturing precision is achieved before deployment. This preliminary training eliminates the need for time-consuming optimization during actual encoding operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent employs periodic action by conducting gradient descent optimization at specific intervals during training rather than continuously. The training process uses periodic updates to the probability model parameters, allowing the system to achieve high precision through structured, periodic optimization cycles rather than continuous computation, thereby reducing overall training time while maintaining precision.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS20250373831A1End-to-end learned codec for multiple bitrates
Publication Date: 2025.12.04 NOKIA TECHNOLOGIES OY
  • US20250373831A1 patent drawing
  • US20250373831A1 patent drawing
  • US20250373831A1 patent drawing

AI summary

Various embodiments provide methods, apparatuses, and computer program products. An example apparatus includes: at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to perform: using a codec for coding an input to a first bitrate and/or a first reconstruction quality; using the codec for coding the input to a second bitrate and/or a second reconstruction quality; wherein the first bitrate is different from the second bitrate; and/or wherein the first reconstruction quality is different from the second reconstruction quality.