Image Processing Apparatus Dynamic Range Expansion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current HDR image display technologies face challenges in effectively managing dynamic range, leading to blown-out highlights when displaying high-brightness regions, as reducing display brightness to conserve power results in degraded image quality and difficulty in expanding the display range to match the image's brightness.

Innovation Solution

An image processing apparatus that allows users to specify and adjust the display range dynamically, performing gradation conversion to enhance high-brightness areas while maintaining image quality, by changing the display range settings and conversion characteristics based on user input and image conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If the display brightness is reduced to extend operation time, then power consumption is reduced, but the maximum brightness of the display is lowered causing blown-out highlights in HDR images

Engineering Contradiction:
Improvepower consumptionVSAvoidmaximum brightness of display
Core Design Contradiction:
Use of energy by moving objectVSIllumination intensity

Solution Approach 1:

The patent segments the dynamic range processing into two distinct paths: one for high brightness portions (applying expansion processing to prevent blown-out highlights) and one for dark areas (maintaining original gradation). This segmentation allows selective processing of different brightness regions to resolve the contradiction between power consumption and display brightness quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing characteristics to different regions of the image based on local brightness properties. High brightness portions receive expansion processing to recover highlight details, while dark areas maintain their original gradation to avoid degradation. This local quality approach ensures that power-saving display settings do not compromise the quality of critical highlight regions.

Inventive Principle:
Principle #3Local quality

2Illumination intensity

If the display range is expanded to match HDR image brightness, then blown-out highlights are reduced, but the operation becomes difficult and the display range may be expanded more than necessary

Engineering Contradiction:
Improvedisplay rangeVSAvoidease of adjusting display range
Core Design Contradiction:
Illumination intensityVSEase of operation

Solution Approach 1:

The patent implements self-service processing where the image processing apparatus automatically performs dynamic range expansion and gradation conversion without requiring manual user adjustment. The system detects blown-out highlights and automatically applies appropriate processing parameters, eliminating the need for users to manually expand the display range while still achieving the desired effect of preventing blown-out highlights.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent dynamically changes processing parameters (expansion rate, gradation conversion characteristics) based on the detected brightness distribution and blown-out highlight conditions in the image. This automatic parameter adjustment allows the system to achieve optimal display range expansion without requiring manual user intervention, thus resolving the contradiction between display range expansion and ease of operation.

Inventive Principle:
Principle #35Parameter changes

3Illumination intensity

If the entire dynamic range is compressed to fit low brightness display, then blown-out highlights are reduced, but the gradation of dark areas is degraded and the displayed image becomes dark overall

Engineering Contradiction:
Improvedisplay brightness compatibilityVSAvoidgradation resolution of dark area
Core Design Contradiction:
Illumination intensityVSManufacturing precision

Solution Approach 1:

The patent segments the image processing into distinct brightness regions (high brightness portions vs. dark areas) and applies different processing strategies to each segment. This prevents the uniform compression of the entire dynamic range, allowing highlight regions to be properly expanded while dark areas maintain their original gradation quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality processing where dark areas are excluded from expansion processing and maintain their original gradation characteristics, while only high brightness portions receive expansion processing. This local differentiation preserves the gradation resolution of dark areas while still achieving the goal of preventing blown-out highlights in bright regions.

Inventive Principle:
Principle #3Local quality

4Illumination intensity

If gradation conversion is applied to improve high brightness portion, then blown-out highlights are prevented, but the processing complexity increases

Engineering Contradiction:
Improvehigh brightness portion qualityVSAvoidprocessing complexity
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The patent performs preliminary detection of blown-out highlights and identification of high brightness portions before applying gradation conversion processing. This preliminary action allows the system to pre-determine which regions require processing and what parameters to use, simplifying the subsequent processing steps and reducing overall processing complexity while still achieving effective prevention of blown-out highlights.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11508337B2Image processing apparatus, image processing method, and non-transitory computer readable medium
Publication Date: 2022.11.22 CANON KK
  • US11508337B2 patent drawing
  • US11508337B2 patent drawing
  • US11508337B2 patent drawing

AI summary

An image processing apparatus according to the present invention, includes: an input unit configured to receive a predetermined user operation for an image displayed on a display; a change unit configured to perform control of increasing a display range of the display in a case where the predetermined user operation is received by the input unit; a processing unit configured to perform gradation conversion on the image to improve gradation of a high brightness portion, based on the display range increased by the change unit; and a control unit configured to perform control of enabling the increase in the display range in accordance with the predetermined user operation in a case where the image satisfies a predetermined condition and disabling the increase in the display range in accordance with the predetermined user operation in a case where the image does not satisfy the predetermined condition.