Image Processing Apparatus Local Bit Depth Control Encoding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image encoding and decoding methods face challenges in controlling the computing precision of orthogonal transform and quantization due to changes in bit depth over time or spatially within a sequence, leading to reduced encoding efficiency.

Innovation Solution

An image processing apparatus and method that expand and normalize the number of significant figures of prediction residuals and quantized coefficients based on local bit depth, enabling precise control of computing precision during orthogonal transform and quantization, and inverse operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional sequence-level bit depth control is used, then device complexity is reduced, but encoding efficiency deteriorates when bit depth changes within a sequence

Engineering Contradiction:
Improveencoding efficiencyVSAvoidcontrol mechanism complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the sequence into local areas (spatial segmentation) and time segments, applying different bit depth control to each segment. This allows encoding efficiency to be maintained in regions where bit depth changes while avoiding complex global control mechanisms.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local bit depth control to specific regions within a sequence rather than uniform control. By determining bit depth separately for each local area and time segment, the system adapts to local characteristics, improving encoding efficiency without requiring complex sequence-wide control.

Inventive Principle:
Principle #3Local quality

2Productivity

If bit depth is changed per local area or time segment, then encoding efficiency is improved, but computing precision control becomes more complex

Engineering Contradiction:
Improveencoding efficiencyVSAvoidcomputing precision control
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent performs preliminary determination of bit depth for each local area and time segment before the actual encoding process. This advance preparation simplifies the subsequent encoding operations by pre-establishing the precision requirements, making the overall process easier to manage despite the fine-grained control.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements dynamic bit depth adjustment that adapts to changing image characteristics throughout the sequence. The system automatically modifies computing precision requirements based on local and temporal variations, simplifying operation by removing the need for manual intervention while maintaining high encoding efficiency.

Inventive Principle:
Principle #15Dynamics

3Productivity

If uniform computing precision is applied throughout the sequence, then device complexity is reduced, but encoding efficiency deteriorates when bit depth varies

Engineering Contradiction:
Improveencoding efficiencyVSAvoidprecision control mechanism
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent changes the computing precision parameter dynamically based on local area and time segment characteristics. By adjusting the precision parameter to match the actual bit depth requirements of different regions and time points, the system improves encoding efficiency without requiring overly complex control mechanisms.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11356701B2Image processing apparatus and image processing method
Publication Date: 2022.06.07 SONY GROUP CORP
  • US11356701B2 patent drawing
  • US11356701B2 patent drawing
  • US11356701B2 patent drawing

AI summary

There is provided an image processing apparatus and an image processing method capable of suppressing a reduction in encoding efficiency. The number of significant figures of a prediction residual of an image is expanded on the basis of a bit depth indicating a range of pixel values of a local level that is a data unit smaller than a sequence level of the image; the number of significant figures of a quantized coefficient obtained by performance of orthogonal transform and quantization on the prediction residual the number of significant figures of which is expanded is normalized on the basis of the bit depth of the local level; and the quantized coefficient the number of significant figures of which is normalized is encoded and a bit stream is generated. The present disclosure is applicable to, for example, an image processing apparatus, an image encoding apparatus, or an image decoding apparatus.