Sharpness Estimation Area Determination in Image Processing

Solution Overview

Problem

Existing image processing techniques face difficulties in determining regions within an image for sharpness evaluation, especially when predetermined characteristics like autofocus frames or faces are not present, leading to inefficiencies in identifying areas for sharpness processing.

Innovation Solution

An image processing apparatus and method that determines the position of an estimation area for sharpness estimation based on multiple determination items, prioritizing information such as autofocus frame, face detection, object detection, and saliency maps, ensuring that sharpness evaluation can be performed even in the absence of typical image characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a predetermined image characteristic (e.g., autofocus frame, face) is used to determine the estimation area for sharpness evaluation, then the sharpness evaluation can be performed on relevant areas, but the evaluation cannot be performed when such characteristics are not present in the image

Engineering Contradiction:

Improvesharpness evaluation reliabilityVSAvoidadaptability to different image types

Core Design Contradiction:

ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent implements a dynamic determination process that adapts the estimation area selection method based on the presence or absence of specific image characteristics. The system dynamically switches between multiple determination items (autofocus frame-based, face-based, object-based, saliency map-based) depending on what is available in the input image, ensuring reliable sharpness evaluation across diverse image types without being constrained by a single predetermined characteristic

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent creates a universal sharpness evaluation system that can handle multiple types of images by implementing multiple determination items. Each determination item serves as an alternative method for identifying the estimation area, allowing the system to function effectively whether the image contains autofocus frames, faces, objects, or none of these characteristics, thus achieving both reliability and adaptability

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple determination items are used to determine the estimation area, then the system can handle various image types, but the complexity of the determination process increases

Engineering Contradiction:

Improveadaptability to different image typesVSAvoiddetermination process complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the determination process into distinct determination items, each responsible for a specific aspect of estimation area identification. The system divides the complex task of handling various image types into manageable segments (autofocus frame detection, face detection, object detection, saliency map generation), where each segment can be independently implemented and optimized, reducing overall system complexity while maintaining versatility

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements a dynamic determination process that adapts the estimation area selection method based on the presence or absence of specific image characteristics. The system dynamically switches between multiple determination items (autofocus frame-based, face-based, object-based, saliency map-based) depending on what is available in the input image, ensuring reliable sharpness evaluation across diverse image types without being constrained by a single predetermined characteristic

Inventive Principle:

Principle #15Dynamics

Solution Approach 3:

The patent performs preliminary detection of image characteristics (autofocus frames, faces, objects) before proceeding with sharpness evaluation. By pre-identifying which determination item is applicable based on the input image's content, the system avoids the complexity of simultaneously processing all determination methods, streamlining the overall process while maintaining adaptability

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11727538B2Apparatus and method for determining sharpness

Publication Date: 2023.08.15 CANON USA INC

AI summary

An image processing apparatus and method is provided and includes one or more processors; and one or more memories storing instructions that, when executed by the one or more processors, cause the apparatus to receive an input image, determine a position of an estimation area for sharpness estimation based on first information related to a first determination item and not based on second information related to a second determination item if the input image satisfies the first determination item from among a plurality of determination items; determine the position of the estimation area for sharpness estimation based on the second information related to the second determination item if the input image does not satisfy the first determination item and satisfies the second determination item among the plurality of determination items; perform sharpness estimation processing on the determined estimation area; and output a result of the sharpness estimation processing.