Video Encoder Quantization Control Spatial Portions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video encoding technologies apply uniform quantization to all images or portions, which may not be suitable for varying characteristics and environments, leading to suboptimal encoding performance.

Innovation Solution

Implementing different quantization matrices and scaling parameters for different spatial frequencies and portions of images based on characteristics such as signal-to-noise ratio, target bit rate, and channel conditions to tailor quantization to specific image and transmission environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If uniform quantization is applied to all images or portions, then the encoding process is simple and fast, but the encoding performance becomes suboptimal for varying characteristics and environments

Engineering Contradiction:
Improveencoding performanceVSAvoidquantization control complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the image into multiple spatial portions (e.g., slices, blocks) and applies different quantization matrices to each portion based on its characteristics. This segmentation allows optimized quantization for each region while maintaining overall system manageability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different quantization parameters and matrices to different spatial portions of the image based on local characteristics such as signal-to-noise ratio, texture complexity, and frequency content. This local optimization improves encoding performance without requiring complete redesign of the entire quantization system.

Inventive Principle:
Principle #3Local quality

2Productivity

If different quantization matrices are applied to different spatial frequencies and portions, then encoding efficiency and visual quality improve, but the complexity of the encoding process increases

Engineering Contradiction:
Improveencoding efficiencyVSAvoidquantization matrix selection complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent dynamically selects quantization matrices based on the characteristics of each spatial portion, such as signal-to-noise ratio and frequency content. The system adapts the quantization strategy in real-time based on actual image data rather than using a fixed predetermined matrix for all cases.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes quantization parameters (such as quantization step size and matrix coefficients) based on the specific characteristics of each spatial portion. By adjusting these parameters adaptively, the system optimizes encoding efficiency while managing complexity through parameterization rather than complete system redesign.

Inventive Principle:
Principle #35Parameter changes

3Manufacturing precision

If quantization is optimized for specific image characteristics and transmission conditions, then bit rate management and visual quality improve, but the adaptability requirements and system complexity increase

Engineering Contradiction:
Improvevisual qualityVSAvoidenvironmental adaptability requirements
Core Design Contradiction:
Manufacturing precisionVSAdaptability or versatility

Solution Approach 1:

The patent incorporates feedback mechanisms that analyze image characteristics and transmission conditions to adjust quantization parameters accordingly. The system uses feedback from quality assessment and bit rate monitoring to dynamically optimize quantization for each spatial portion based on actual performance data.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary analysis of image characteristics and transmission conditions before applying quantization. By assessing factors such as signal-to-noise ratio, frequency content, and channel conditions in advance, the system pre-determines optimal quantization matrices and parameters to avoid complex real-time adjustments.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11843776B2Video encoder with quantization control
Publication Date: 2023.12.12 APPLE INC
  • US11843776B2 patent drawing
  • US11843776B2 patent drawing
  • US11843776B2 patent drawing

AI summary

In one implementation, a method of encoding an image is performed at a device including one or more processors and non-transitory memory. The method includes determining a category of a spatial portion of an image based on a relation between a plurality of thresholds associated with a plurality of quantization scaling parameters and a bit rate of the spatial portion of the image at the plurality of quantization scaling parameters. The method includes quantizing the spatial portion of the image based on the categorization.