Image Processing Device Dynamic Code Allocation SDR HDR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing devices struggle to maintain satisfactory image quality across diverse video image signal expressions, particularly when converting between standard dynamic range (SDR) and high dynamic range (HDR) formats, leading to codec distortion and quality deterioration.

Innovation Solution

An image processing system that adjusts the code amount assigned to each partial region based on the transfer function, using a control unit to scale the quantization step according to the intensity of luminance or chrominance components, thereby optimizing image quality and reducing codec distortion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a fixed quantization parameter is used for coding, then the coding process is simple, but image quality deteriorates when converting between SDR and HDR formats

Engineering Contradiction:
Improvecoding process complexityVSAvoidimage quality
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent applies dynamics by making the quantization parameter adjustable rather than fixed. The control unit dynamically changes the quantization parameter based on the transfer function type (SDR or HDR) and the intensity of luminance or chrominance components in different regions. This allows the system to adapt to varying image characteristics and maintain high image quality across different dynamic ranges without complicating the basic coding process structure.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements local quality by dividing the image into multiple regions and applying different quantization parameters to each region based on its characteristics. The control unit determines the intensity of luminance or chrominance components in each region and adjusts the quantization parameter accordingly. This ensures that each region receives optimized coding parameters, preventing quality deterioration in high-intensity regions while maintaining simplicity in low-intensity regions.

Inventive Principle:
Principle #3Local quality

2Device complexity

If code amount is uniformly assigned to all regions, then the coding process is simple, but codec distortion increases in high intensity regions

Engineering Contradiction:
Improvecode allocation processVSAvoidcodec distortion
Core Design Contradiction:
Device complexityVSObject-generated harmful factors

Solution Approach 1:

The patent applies local quality by assigning different code amounts to different regions based on their intensity characteristics. The control unit calculates the intensity of luminance or chrominance components in each region and adjusts the quantization parameter accordingly. High intensity regions receive smaller quantization parameters (more code amounts) while low intensity regions receive larger quantization parameters (less code amounts), thereby reducing codec distortion in critical regions without uniformly increasing complexity across the entire image.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements parameter changes by dynamically adjusting the quantization parameter based on region intensity characteristics. The control unit changes the quantization parameter according to the transfer function type and the intensity of luminance or chrominance components. This parameter adjustment allows the system to allocate code amounts adaptively, reducing codec distortion in high intensity regions while maintaining coding efficiency in low intensity regions.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If quantization step is not adjusted according to transfer function, then the processing is fast, but image quality deteriorates in HDR formats

Engineering Contradiction:
Improveprocessing speedVSAvoidimage quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies dynamics by making the quantization step adjustable based on the transfer function type. The control unit dynamically changes the quantization step according to whether the input is SDR or HDR and adjusts it further based on the intensity characteristics of different regions. This allows the system to maintain fast processing by using simple quantization for SDR while implementing precise, adaptive quantization for HDR formats, thereby preserving processing speed without sacrificing HDR image quality.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements parameter changes by adjusting the quantization step parameter according to the transfer function type and region intensity. The control unit changes the quantization step based on the transfer function (SDR or HDR) and the intensity of luminance or chrominance components. This parameter adjustment ensures that HDR images receive appropriate quantization treatment to maintain image quality, while SDR images continue to be processed with standard quantization steps, preserving overall processing efficiency.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentEP3557869B1Image processing device, image processing method, and program
Publication Date: 2023.03.29 SONY GROUP CORP
  • EP3557869B1 patent drawingFigure 1A
  • EP3557869B1 patent drawingFigure 1B
  • EP3557869B1 patent drawingFigure 2A

AI summary

[Object] To provide satisfactory image quality irrespective of signal expression schemes. [Solution] Provided is an image processing device including: a coding unit that codes an image acquired on the basis of a transfer function related to conversion between light and an image signal; and a control unit that controls coding processing executed by the coding unit, on the basis of the transfer function. The control unit may control a coding amount assigned to each partial region of the image in the coding unit, on the basis of the transfer function. The control unit may control a prediction residual coding amount or a mode coding amount for mode selection when the image is coded in the coding unit, on the basis of the transfer function.