Automated Face Modification System Using AI Feature Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for modifying digital face images are limited by the need for manual user interaction, lack of advanced image processing, and inability to perform automatic or semi-automatic face detection, feature modification, hair restyling, and virtual plastic surgery procedures.

Innovation Solution

A system and method for automatically or semi-automatically modifying digital images of faces using advanced detection and localization techniques, incorporating Artificial Intelligence for visualizing facelifts, hair restyling, and feature replacement, with the ability to detect faces and features in images and blend or recolor them for a photo-realistic result, accessible through various devices including mobile phones and the internet.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual user interaction is used for face modification, then control precision over facial features is improved, but user effort and time consumption increase significantly

Engineering Contradiction:
Improvecontrol precisionVSAvoiduser effort and time consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system automatically detects facial features, establishes regions of interest, and performs modifications without requiring manual user input for each step. The computer vision algorithms self-service the tasks of face localization, feature detection, and parameter estimation, thereby reducing user effort while maintaining control precision through automated algorithms.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical interaction (users manually adjusting parameters and selecting features) with automated computer vision and machine learning systems. This substitution eliminates the need for users to manually enter parameters while maintaining precision through advanced algorithms that automatically detect and modify facial features.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Extent of automation

If advanced image processing and computer vision methodologies are implemented, then automation capability is improved, but system complexity increases

Engineering Contradiction:
Improveautomation capabilityVSAvoidsystem complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The system segments the face modification process into distinct automated stages: face detection, feature localization, region of interest establishment, and modification application. Each stage is handled by specialized algorithms, which modularizes the complexity and makes the overall system more manageable while maintaining high automation capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediate processing steps such as establishing regions of interest around detected facial features before applying modifications. This intermediary approach simplifies the overall system by creating clear boundaries and focal points for each modification operation, making the complex process more structured and easier to implement.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If automatic face detection and feature localization are performed, then processing efficiency is improved, but accuracy of feature identification may worsen

Engineering Contradiction:
Improveprocessing efficiencyVSAvoidaccuracy of feature identification
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system incorporates feedback mechanisms where the automated detection and localization results are evaluated and refined. The machine learning models learn from detection outcomes and adjust their parameters to improve accuracy while maintaining efficient processing speeds, thereby resolving the trade-off between speed and precision in feature identification.

Inventive Principle:
Principle #23Feedback

4Adaptability or versatility

If virtual plastic surgery and facelift procedures are simulated, then versatility of face modification is improved, but computational requirements and processing time increase

Engineering Contradiction:
Improveversatility of face modificationVSAvoidcomputational requirements and processing time
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent applies modifications locally to specific regions of interest around detected facial features rather than processing the entire image globally. This localized approach enables versatile face modification and virtual plastic surgery procedures while reducing computational requirements by focusing processing power only on relevant areas of the face.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS8620038B2Method, system and computer program product for automatic and semi-automatic modification of digital images of faces
Publication Date: 2013.12.31 LOREAL SA
  • US8620038B2 patent drawing
  • US8620038B2 patent drawing
  • US8620038B2 patent drawing

AI summary

The present invention is directed at modifying digital images of faces automatically or semi-automatically. In one aspect, a method of detecting faces in digital images and matching and replacing features within the digital images is provided. Techniques for blending, recoloring, shifting and resizing or portions of digital images are disclosed. In other aspects, methods of virtual “face lifts” are methods of detecting faces within digital image are provided. Advantageously, the detection and localization of faces and facial features, such as the eyes, nose, lips and hair, can be achieved on an automated or semi-automated basis. User feedback and adjustment enables fine tuning of modified images. A variety of systems for matching and replacing features within digital images is also provided, including implementation as a website, through mobile phones, handheld computers, or a kiosk. Related computer program products are also disclosed.