Real-Time Video Makeup Simulation with Illumination Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The traditional process of selling cosmetics is cumbersome for both retailers and customers, as it involves physically applying and removing samples, limiting the number of products that can be tried on, and existing digital simulation methods fail to account for variations in illumination and position, especially in real-time video-based simulations.

Innovation Solution

A computer-implemented method using a personal computational device to capture real-time images, apply desired makeup looks, and generate composite images, adapting to illumination and position variations, allowing for real-time video-based makeup simulation and retail ordering of physical or virtual cosmetic products.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If physical samples and dedicated staff are used to apply cosmetics to customers, then customers can assess the feel and look of cosmetics, but the process becomes cumbersome and time-consuming for both retailers and customers

Engineering Contradiction:
Improveaccuracy of cosmetic assessmentVSAvoidtime for application and removal of samples
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent uses digital image processing to create a virtual copy of the customer's face and applies digital representations of cosmetic products to this copy. This allows customers to try on multiple makeup looks instantly without physical application, eliminating the time-consuming process while maintaining visual assessment accuracy.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical process of physical sample application with an automated image processing system. The system captures real-time video images, processes them through algorithms to detect facial features and skin properties, and digitally overlays cosmetic effects, substituting manual staff application with automated computational methods.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of manufacture

If image-based methods are used for digital makeup simulation, then offline makeup application is possible, but transparency properties of makeup and local illumination variations are not accounted for

Engineering Contradiction:
Improvesimplicity of digital simulationVSAvoidaccuracy of makeup appearance
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent transitions from static image-based methods to dynamic real-time video-based simulation. The system continuously captures video frames and dynamically adjusts makeup application based on changing lighting conditions, head movements, and facial expressions, maintaining accuracy throughout the simulation process.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent analyzes and adapts to variations in illumination parameters by detecting local lighting conditions on different parts of the face and adjusting the digital makeup application accordingly. The system modifies parameters such as brightness, contrast, and color balance to match the actual lighting environment and preserve the transparent properties of cosmetic products.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If real-time video-based simulation is implemented, then adaptive makeup application to position and orientation variations is achieved, but computational complexity increases

Engineering Contradiction:
Improveadaptability to face position and illuminationVSAvoidcomputational processing requirements
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent divides the facial image into multiple regions or segments corresponding to different facial features and zones. This segmentation allows the system to process and apply makeup to specific areas independently, reducing overall computational complexity while maintaining adaptability to local variations in position and illumination.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9460462B1Monetization using video-based simulation of cosmetic products
Publication Date: 2016.10.04 IMAGE METRICS LTD
  • US9460462B1 patent drawing
  • US9460462B1 patent drawing
  • US9460462B1 patent drawing

AI summary

Computer-implemented methods for vending at least one cosmetic product to a first consumer. A real-time image of a portion of a body of the consumer is captured using a personal computational device and the consumer provides a desired makeup look via the personal computational device. The desired makeup look is then applied to an image of the portion of the body of the consumer, thereby generating a composite image of the portion of the body of the first consumer with the desired makeup look, and a retail order for the cosmetic product is received from the consumer. The order may be received before or after the consumer's image is captured. Another consumer, or a product specialist, may be involved in the aforesaid process via a computer communications link.