Image Processing Tone Conversion Using Distance-Based Object Grouping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing techniques often result in unnatural images due to gradation inversion and difficulty in performing appropriate gradation processing for scenes with objects at different distances, as they either apply uniform tone correction or struggle to select suitable gradation conversion characteristics based on focal length.

Innovation Solution

An image processing apparatus that obtains distance information, groups objects, determines whether to apply a uniform or region-specific tone characteristic, and performs tone conversion accordingly, using a combination of distance and luminance information to optimize tone processing and avoid unnatural contrast adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If image processing is applied to each region according to distance information, then contrast correction is improved, but gradation inversion occurs causing unnatural appearance

Engineering Contradiction:
Improvecontrast correction precisionVSAvoidimage naturalness
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent changes the parameter of tone characteristic selection from fixed region-based to dynamic scene-based. The determination unit selects between first tone characteristics (for single-object scenes) and second tone characteristics (for multi-object scenes) based on the extracted number of object regions, thereby adjusting the tone conversion parameters according to the overall scene composition rather than applying uniform region-based processing.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

Instead of applying different tone characteristics to each region (which causes gradation inversion), the patent inverts the approach by applying a unified tone characteristic determined from regional analysis. The determination unit uses the number of object regions to select a global tone characteristic that prevents gradation inversion while still considering spatial information.

Inventive Principle:
Principle #13The other way round (Inversion)

2Device complexity

If focal length information is used to select gradation conversion characteristics, then processing is simplified, but appropriate gradation processing for scenes with objects at different distances cannot be performed

Engineering Contradiction:
Improveprocessing complexityVSAvoidscene adaptability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent segments the image into multiple object regions based on distance information before determining the tone characteristic. The extraction unit divides the image into first through fourth object regions corresponding to different distance zones, allowing the system to analyze the composition of objects at different distances and select appropriate tone characteristics accordingly.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces distance information as an intermediary between the image data and tone conversion process. The extraction unit uses distance information to identify and group objects at different distances, and the determination unit uses this segmented information to select appropriate tone characteristics, thereby bridging the gap between simple focal length-based processing and complex scene-adaptive processing.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If uniform tone characteristic is applied to the whole image, then processing is simple, but appropriate tone conversion for different regions cannot be achieved

Engineering Contradiction:
Improveprocessing complexityVSAvoidtone conversion precision
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent makes the tone characteristic selection dynamic rather than static. The determination unit dynamically selects between first and second tone characteristics based on the extracted number of object regions in the image. This dynamic selection allows the system to adapt the tone conversion precision to the scene complexity, using simpler processing for single-object scenes and more sophisticated processing for multi-object scenes.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10650503B2Image processing apparatus, image processing method, and storage medium
Publication Date: 2020.05.12 CANON KK
  • US10650503B2 patent drawing
  • US10650503B2 patent drawing
  • US10650503B2 patent drawing

AI summary

An image processing apparatus obtains distance information indicating a distance to each of one or more objects of an image, performs grouping of the one or more objects in accordance with the distance to each object, extracts a plurality of object regions of the image in accordance with the grouping, and determines, in accordance with a number of the plurality of object regions extracted by the extraction unit, whether to perform tone conversion by applying a same tone characteristic to the image as a whole or to perform tone conversion by applying different tone characteristics for respective regions of the image.