Two-Stage Red-Eye Detection for Real-Time Image Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing digital camera systems face challenges in minimizing 'click-to-click' time due to high computation and resource requirements for redeye defect detection and correction, which compromises accuracy and image quality, especially when additional image processing is performed during image acquisition.

Innovation Solution

A two-stage redeye filtering process is implemented, combining a speed-optimized filter for initial segmentation and detection with an analysis-optimized filter for accurate analysis, allowing for real-time redeye correction during image acquisition while also enabling background processing to enhance detection and quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If a speed-optimized filter is used for initial segmentation and detection during image acquisition, then click-to-click time is reduced and real-time correction is achieved, but detection accuracy may be compromised

Engineering Contradiction:
Improveclick-to-click timeVSAvoidredeye detection accuracy
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The invention divides the redeye detection process into two distinct stages: a speed-optimized first stage for initial segmentation and candidate identification during image acquisition, and an analysis-optimized second stage for accurate verification and false positive elimination during background processing. This segmentation allows each stage to be specialized for its specific purpose, resolving the contradiction between speed and accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The first stage performs preliminary action by identifying candidate redeye regions during image acquisition before the main processing chain completes. These candidates are then passed to the second stage for verification, allowing the system to prepare detection results in advance without compromising the main image processing timeline.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If additional image processing is performed during image acquisition, then real-time correction is achieved, but computation and resource requirements increase

Engineering Contradiction:
Improvereal-time correction capabilityVSAvoidcomputation and resource requirements
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The detection process is segmented into two stages with different computational requirements. The first stage uses simplified, speed-optimized algorithms suitable for real-time execution during image acquisition, while the second stage employs more computationally intensive analysis-optimized algorithms during background processing when resources are more available.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The first stage performs partial action by identifying only candidate regions rather than confirming all redeye cases. This partial detection approach reduces computation during acquisition, while the second stage completes the full analysis on candidates, avoiding excessive processing during the critical acquisition phase.

Inventive Principle:
Principle #16Partial or excessive action

3Extent of automation

If face detection algorithms are used to detect faces in upright frontal view, then automatic redeye detection is achieved, but rotated or out-of-plane faces cannot be detected

Engineering Contradiction:
Improveautomatic redeye detectionVSAvoidface orientation detection capability
Core Design Contradiction:
Extent of automationVSAdaptability or versatility

Solution Approach 1:

The invention changes the detection parameters from face-specific features (which require upright frontal orientation) to eye-specific features that can be detected regardless of face orientation. By directly analyzing eye region characteristics such as color, shape, and texture in the acquired image, the system achieves automatic redeye detection that is adaptable to various face orientations and positions.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS7970182B2Two stage detection for photographic eye artifacts
Publication Date: 2011.06.28 ADEIA IMAGING LLC
  • US7970182B2 patent drawing
  • US7970182B2 patent drawing
  • US7970182B2 patent drawing

AI summary

The detection of red-eye defects is enhanced in digital images for embedded image acquisition and processing systems. A two-stage redeye filtering system includes a speed optimized filter that performs initial segmentation of candidate redeye regions and optionally applies a speed-optimized set of falsing/verification filters to determine a first set of confirmed redeye regions for correction. Some of the candidate regions which are rejected during the first stage are recorded and re-analyzed during a second stage by an alternative set of analysis-optimized filters to determine a second set of confirmed redeye regions.