Facial Defect Correction in Digital Camera Image Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital cameras often capture facial defects such as head movement, blinking, or yawning, which can spoil an entire photograph, especially with children in spontaneous poses, without providing warnings or easy correction methods.

Innovation Solution

An image processing method that analyzes facial regions in both high and low-resolution images to identify defects, using Active Appearance Models (AAM) and super-resolution techniques to correct defective facial regions by combining defect-free image information from a sequence of low-resolution images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If digital cameras capture images quickly without analysis, then shooting speed is improved, but facial defects are not detected and image quality deteriorates

Engineering Contradiction:
Improveshooting speedVSAvoidimage quality
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary analysis of facial regions in preview images before final image capture. By detecting potential defects (blinking, head movement, yawning) in advance using low-resolution preview frames, the camera can warn users or automatically select better timing for capture, thus preventing defective images without slowing down the shooting process

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system continuously monitors preview images and provides feedback about facial region quality. When defects are detected in real-time, the system can notify the user to wait for a better moment or automatically choose an optimal capture time, creating a feedback loop that maintains image quality while preserving shooting speed

Inventive Principle:
Principle #23Feedback

2Reliability

If the camera waits for perfect facial conditions before capture, then image quality is improved, but shooting speed and spontaneity are reduced

Engineering Contradiction:
Improveimage qualityVSAvoidshooting speed
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system performs partial analysis only on facial regions rather than the entire image, and uses low-resolution preview frames instead of full-resolution images. This selective approach provides sufficient quality assessment to guide capture timing without requiring complete analysis of all image data, thus maintaining shooting speed while improving reliability

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If multiple high-resolution images are captured to ensure quality, then image quality is improved, but data storage requirements and processing time increase

Engineering Contradiction:
Improveimage qualityVSAvoiddata storage
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The system applies different quality standards to different parts of the image processing pipeline. Low-resolution analysis is used for defect detection in preview frames, while full-resolution capture is performed only when needed. This local differentiation allows quality assessment without storing multiple high-resolution images

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses low-resolution preview images as substitutes for high-resolution images during the defect detection phase. By working with smaller preview copies rather than full-resolution images, the system can analyze multiple frames without proportionally increasing storage requirements

Inventive Principle:
Principle #26Copying

Data Source

PatentUS9025837B2Image processing method and apparatus
Publication Date: 2015.05.05 ADEIA IMAGING LLC
  • US9025837B2 patent drawing
  • US9025837B2 patent drawing
  • US9025837B2 patent drawing

AI summary

An image processing technique includes acquiring a main image of a scene and determining one or more facial regions in the main image. The facial regions are analyzed to determine if any of the facial regions includes a defect. A sequence of relatively low resolution images nominally of the same scene is also acquired. One or more sets of low resolution facial regions in the sequence of low resolution images are determined and analyzed for defects. Defect free facial regions of a set are combined to provide a high quality defect free facial region. At least a portion of any defective facial regions of the main image are corrected with image information from a corresponding high quality defect free facial region.