Facial Feature Analysis for Automated Beauty Recommendations

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for recommending beauty and anti-aging products or treatments lack advanced image processing and machine learning methodologies, requiring manual user input and being unsuitable for automatic or semi-automatic face feature modification, and are not easily accessible on mobile devices.

Innovation Solution

A method and system that uses advanced image processing and machine learning to detect facial features in digital images or videos, perform multi-level statistical analysis, and recommend products by blending recommended features into the images, allowing for automatic or semi-automatic face modification and accessible on various devices, including mobile devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual user interaction is used for facial recoloring and parameter entry, then the system can simulate cosmetic product effects, but the user has to spend significant time and effort manually entering parameters

Engineering Contradiction:
Improvemanual parameter entry effortVSAvoidtime for manual parameter entry
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system automatically detects facial features and extracts parameters from the user's face image without requiring manual input. The computer vision algorithms perform face localization, feature detection, and parameter estimation autonomously, allowing the system to serve itself rather than requiring user intervention for parameter entry.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical manual parameter entry process with automated computer vision and machine learning systems. Instead of users manually adjusting sliders or entering values, the system uses image processing algorithms to automatically detect facial features and derive parameters from the visual data.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Extent of automation

If advanced image processing and machine learning methodologies are used for automatic face detection and feature modification, then the system can automatically simulate product applications, but the device complexity increases

Engineering Contradiction:
Improveautomatic face feature detectionVSAvoidimage processing system complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The system divides the complex task of face analysis into multiple independent modules: face detection module, feature detection module, parameter estimation module, and simulation module. Each module handles a specific aspect of the analysis, making the overall system more manageable and easier to implement despite the advanced capabilities.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a multi-functional system that performs face detection, feature extraction, parameter estimation, and product simulation using a unified computer vision framework. The same image processing infrastructure supports multiple functions, reducing the need for separate specialized systems for each task.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Adaptability or versatility

If a comprehensive system for virtual plastic surgery and face modification is implemented, then the system can display treatment outcomes, but the system becomes complicated and requires professional operators

Engineering Contradiction:
Improveface modification capabilitiesVSAvoidsystem operational complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system automatically performs all face modification operations without requiring professional operators. The computer vision algorithms autonomously detect facial features, estimate parameters, and apply transformations, making the sophisticated face modification capabilities accessible to regular users without specialized training.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent introduces an automated computer vision system as an intermediary between the user's simple input (uploading a photo) and the complex face modification operations. This intermediary layer handles the complexity of parameter estimation and feature transformation, shielding users from the underlying system complexity while maintaining versatile modification capabilities.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Ease of operation

If manual methods are used for visual demonstration of cosmetics, then the system can show makeup effects, but the visualization requires manual user inputs and does not allow for advanced face modifications

Engineering Contradiction:
Improvemanual input requirementsVSAvoidface modification range
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent replaces manual user input mechanisms with automated computer vision-based parameter extraction. Instead of users manually specifying facial features and their properties, the system uses image processing algorithms to automatically detect and extract feature parameters from the user's face image, enabling both ease of operation and advanced modification capabilities.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system autonomously identifies facial features and determines appropriate modification parameters without user intervention. The computer vision system serves itself by automatically analyzing the input image, detecting features like eyes, lips, and nose, and deriving the parameters needed for realistic product simulation and advanced face modifications.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9760935B2Method, system and computer program product for generating recommendations for products and treatments
Publication Date: 2017.09.12 LOREAL SA
  • US9760935B2 patent drawing
  • US9760935B2 patent drawing
  • US9760935B2 patent drawing

AI summary

The present invention is a method, system and computer prod act operable to receive one or more images and/or video and to utilize such images/video to generate an analysis that is the basis tor recommendations for products and/or treatments provided to a user. The invention generates statistical analysis particular to person shown in the images/video. The statistical information may be displayed to a user. This statistical analysis may be utilized by the invention to generate recommendations for products and/or treatments for the person shown in the images/video. The invention may further generate an image showing the result of an application of a product or treatment to the person shown in the video. The invention may be provided to a user on a computing device, such as, for example as an App on a mobile device.