Facial Image Region Boundary Indication for Cosmetic Simulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for creating personalized advertisements fail to effectively simulate cosmetic treatments or product usage on user-uploaded photographs, lacking interactive and accurate visual representation of product effects on facial features.

Innovation Solution

A system and method that automatically detects facial features from uploaded photos, applies image processing sequences to simulate cosmetic effects, and recommends products based on facial analysis, allowing users to visualize product usage on their own images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If automatic facial feature detection and image processing sequences are applied to simulate cosmetic effects, then personalized advertisement effectiveness is improved, but system complexity and processing time increase

Engineering Contradiction:
Improvepersonalization capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the facial image processing into distinct regions (eyes, lips, cheeks, forehead) and applies specific image processing sequences to each region. This allows the system to handle complex personalization tasks by breaking them down into manageable, region-specific operations rather than processing the entire face uniformly.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary detection of facial features and segmentation of facial regions before applying cosmetic simulations. By pre-identifying facial landmarks and dividing the face into treatment zones, the system prepares the groundwork for efficient and accurate personalized ad generation without requiring complex real-time processing during the actual simulation phase.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If multiple image processing sequences are applied to simulate different cosmetic effects, then product trial accuracy is improved, but processing time and computational resources increase

Engineering Contradiction:
Improveproduct effect simulation accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Different image processing sequences are applied to different facial regions based on the specific cosmetic product being simulated. For example, eye makeup simulations are applied only to the eye region, lip products only to the lip region. This localized approach maintains high simulation accuracy for each product type while avoiding the computational overhead of applying all processing sequences to the entire face.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system applies only the necessary image processing sequences relevant to the specific cosmetic product being advertised, rather than applying all possible processing sequences. This partial action approach provides sufficient simulation accuracy for the intended purpose while significantly reducing processing time and computational resource requirements.

Inventive Principle:
Principle #16Partial or excessive action

3Adaptability or versatility

If facial feature detection and region boundary indication are implemented, then user engagement is improved, but ease of operation decreases

Engineering Contradiction:
Improveinteractive capabilityVSAvoiduser operation simplicity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system automatically performs facial feature detection, region segmentation, and boundary indication without requiring user intervention. Users simply upload their photo, and the system autonomously identifies facial features, divides the face into relevant regions, and displays boundary overlays. This self-service approach enhances interactivity and personalization while maintaining ease of operation, as users do not need to manually define regions or configure complex parameters.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9965778B2System and method for the indication of modification region boundaries on facial images
Publication Date: 2018.05.08 LOREAL SA
  • US9965778B2 patent drawing
  • US9965778B2 patent drawing
  • US9965778B2 patent drawing

AI summary

Computerized method and system for creating a personalized advertisement, and for recommending a product being advertised. An uploaded facial photograph is received, the facial photograph including a plurality of facial features. At least one facial feature of the plurality of facial features is detected. Personal information may be extracted by analyzing the at least one detected facial feature. A product being advertised may be recommended, wherein the recommended product applies to a treatment related to the extracted personal information. A tutorial may indicate on the photograph the facial region to be modified by application of the product, such as to achieve a specific look.