Makeup Color Deduction via Facial Image Analysis

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Users face inconvenience when searching for makeup items that match their skin tone and preferences, as these items may not be registered in the database, making it difficult to find suitable alternatives to their existing makeup items.

Innovation Solution

A system comprising a user terminal and a server that captures facial images before and after makeup, deduces the makeup color, and extracts similar makeup items from a database for display, allowing users to select and purchase matching items.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If users rely on database registration to find makeup items, then items in the database can be easily searched, but makeup items that match user's skin and preferences but are not registered cannot be found

Engineering Contradiction:

Improveease of makeup item searchVSAvoidability to find similar makeup items

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

The system creates a digital copy of the user's actual makeup appearance by capturing images and processing them to extract makeup color information. This copy serves as a query template to search the database for similar registered makeup items, enabling users to find alternatives even when their specific items are not in the database.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system transforms the search approach by changing from direct item name/database ID searching to searching based on extracted color parameters (hue, saturation, lightness). This parameter-based search allows the system to find makeup items with similar visual characteristics even if they are different products, resolving the contradiction between database dependency and adaptability.

Inventive Principle:

Principle #35Parameter changes

2Loss of information

If users want to know the color of makeup items before purchasing, then they can avoid wrong purchases, but they cannot know the actual color without trying it on

Engineering Contradiction:

Improveinformation about makeup colorVSAvoidconvenience of color verification

Core Design Contradiction:

Loss of informationVSEase of operation

Solution Approach 1:

The system creates a virtual representation of how the makeup item would appear on the user's specific skin tone and facial features by processing captured images. This visual copy allows users to verify the actual color effect before purchasing, eliminating the need for physical trial while providing accurate color information.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The system replaces the mechanical action of physically applying makeup to see the color with an automated image processing and analysis system. The system uses computer vision and color space transformation algorithms to predict and display the makeup color effect, substituting physical trial with digital simulation.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If the system processes detailed image analysis to accurately deduce makeup color, then color matching precision is improved, but processing time and computational complexity increase

Engineering Contradiction:

Improvemakeup color deduction accuracyVSAvoidprocessing time for image analysis

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system segments the image processing task into distinct stages: face region detection, lip region extraction, color space transformation, and makeup color calculation. This segmentation allows each stage to be optimized independently and enables parallel processing where possible, reducing overall processing time while maintaining accuracy.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system performs preliminary actions by pre-defining the color space transformation formulas and makeup color calculation methods before actual image processing. By establishing the processing framework in advance with predetermined algorithms and parameters, the system reduces computational overhead during real-time execution, balancing accuracy with processing speed.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS11478062B2Makeup item presenting system, makeup item presenting method, and makeup item presenting server

Publication Date: 2022.10.25 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD

AI summary

A terminal images first and second images respectively indicating facial images of a user before and after makeup, acquires information on a type or region of the makeup performed by the user, and transmits the first and second images and the information on the type or region of the makeup in association with each other to a server. The server deduces a makeup color of the makeup performed by the user based on the first and second images and the information on the type or region of the makeup performed by the user, and extracts at least one similar makeup item having the makeup color based on information on the makeup color and a makeup item database, and transmits information on at least one similar makeup item to the terminal. A terminal displays information on at least one similar makeup item transmitted from the server to a display unit.