Acne Removal via Active Appearance Model Fitting

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing methods fail to completely remove wrinkles and spots from images across wide frequency bands and require manual skills and time-consuming processes.

Innovation Solution

An image processing method using Active Appearance Models (AAM) that fits a statistical model of a structure, such as a human face, to an input image to automatically remove unwanted components like acne by representing the face without these features, employing principal component analysis for dimension reduction and model fitting.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual skin enhancement processing is used to remove spots and acne, then removal accuracy is improved, but processing time and operational complexity increase significantly

Engineering Contradiction:
Improveremoval accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary statistical processing on multiple images to build a model representing normal skin structure before actual removal processing. This pre-established model enables automatic removal without manual intervention during the actual processing phase, resolving the contradiction between accuracy and time consumption.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The image processing system uses its own built-in statistical model to automatically identify and remove acne and spots without requiring external manual operation. The system serves itself by using the statistical characteristics learned from training images to perform the removal, eliminating the need for manual skill-based processing.

Inventive Principle:
Principle #25Self-service

2Manufacturing precision

If manual skin enhancement processing is performed by skilled operators, then removal quality is improved, but operational complexity and skill requirements increase

Engineering Contradiction:
Improveremoval qualityVSAvoidoperational complexity
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system automatically performs high-quality removal by using its internal statistical model without requiring external manual operation. The model itself performs the judgment and removal tasks that previously required skilled operators, thereby improving ease of operation while maintaining removal quality.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical manual operation system with an automatic computational system based on statistical models. Instead of relying on human operators to manually identify and remove acne, the system uses automated image processing algorithms that compare input images against statistical models of normal skin, thereby eliminating operational complexity while maintaining or improving removal quality.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If frequency-based filtering is used to remove skin imperfections, then processing speed is improved, but removal completeness deteriorates due to limited frequency band coverage

Engineering Contradiction:
Improveprocessing speedVSAvoidremoval completeness
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent changes the fundamental parameter from frequency-based filtering to statistical characteristic-based modeling. Instead of filtering based on frequency bands, the system uses statistical parameters derived from multiple training images to represent normal skin structure. This allows comprehensive removal of acne and spots across all spatial frequencies while maintaining processing efficiency through automated model-based comparison.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS7756343B2Image processing method, image processing apparatus, and computer-readable recording medium storing image processing program
Publication Date: 2010.07.13 FUJIFILM CORP
  • US7756343B2 patent drawing
  • US7756343B2 patent drawing
  • US7756343B2 patent drawing

AI summary

An unnecessary component such as acne is removed completely from a predetermined structure such as a face in a photograph image without manual operation and skills. An acne removal unit fits to a face region as the structure in the image a mathematical model generated according to a statistical method such as AAM using sample images representing the structure without the component to be removed, and an image reconstruction unit reconstructs an image of the face region based on parameters corresponding to the face region obtained by the fitting of the model. An image is then generated by replacing the face region with the reconstructed image. Since the mathematical model has been generated from the sample images of human faces without acne, the model does not include acne. Therefore, the reconstructed face image generated by fitting the model to the face region does not include acne.