Dynamic Facial Mapping for Distortion-Free Makeup Projection

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current makeup application systems lack the ability to accurately project digital content onto a user's facial surface, particularly in real-time, due to issues with color and geometrical distortions, and fail to account for depth contours, leading to suboptimal user experience.

Innovation Solution

A system comprising a projector and a dynamic mapping unit, including a depth camera, that establishes a dynamic correspondence between projector pixels and facial features, compensates for distortions, and projects digital content such as makeup tutorials, using structured light projection or depth-resolved digital representations to simulate various lighting conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If digital content is projected onto the user's facial surface without distortion compensation, then the projection process is simple and fast, but color and geometrical distortions occur leading to inaccurate alignment

Engineering Contradiction:

Improveprojection alignment accuracyVSAvoidsystem complexity

Core Design Contradiction:

Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system captures an image of the projected pattern on the user's face and uses this feedback to calculate and apply distortion compensation parameters, creating a closed-loop system that continuously optimizes projection accuracy

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system pre-calculates distortion compensation parameters by projecting a test pattern and capturing the distorted image before actual content projection, preparing correction data in advance to eliminate distortions during normal operation

Inventive Principle:

Principle #10Preliminary action

2Measurement precision

If a depth camera is used to determine depth contour of the facial surface, then accurate 3D mapping is achieved, but the device complexity and cost increase

Engineering Contradiction:

Improvefacial surface depth measurement accuracyVSAvoidcamera system complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

A patterned light projection serves as an intermediary that encodes depth information in the distortion of the projected pattern, allowing the standard camera to extract 3D surface geometry without requiring specialized depth sensing hardware

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system replaces complex mechanical depth sensing devices with an optical encoding approach using projected patterns and standard imaging, substituting hardware complexity with computational processing

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If real-time distortion compensation is implemented, then projection accuracy is maintained during user movement, but processing time and computational load increase

Engineering Contradiction:

Improveprojection accuracy stabilityVSAvoidreal-time processing time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

Distortion compensation parameters are calculated in advance during a calibration phase before actual use, storing pre-computed correction data that can be applied instantly without real-time computation delays

Inventive Principle:

Principle #10Preliminary action

4Manufacturing precision

If the projector projects content without considering facial depth contours, then the projection setup is simple, but the content does not align properly with facial features

Engineering Contradiction:

Improvecontent-to-feature alignment precisionVSAvoidmapping system complexity

Core Design Contradiction:

Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system creates a digital copy or map of the user's facial surface geometry by analyzing the distortion of projected patterns, using this digital replica to guide accurate content placement without requiring complex physical measurement devices

Inventive Principle:

Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system provides a precise and adaptive projection of digital makeup tutorials onto the user's facial surface, accounting for depth and dynamic changes, enhancing the user experience by ensuring accurate alignment and simulation of different lighting conditions.

Implementation Method 1

The depth camera includes at least one of a time-of-flight sensor and a Doppler-effect transducer configured to determine the depth contour of the user's facial surface

Methodology Applied

Scientific EffectTime-of-flight: Time of Flight

Implementation Method 2

The depth camera includes at least one of a time-of-flight sensor and a Doppler-effect transducer configured to determine the depth contour of the user's facial surface

Methodology Applied

Scientific EffectDoppler effect: Doppler Effect

Implementation Method 3

the beam splitter is configured to direct an image of the user's facial surface to a camera of the dynamic mapping unit

Methodology Applied

Scientific EffectLight reflection: Reflection

Data Source

PatentUS12096839B2System and method for projecting digital content onto user's facial surface

Publication Date: 2024.09.24 LOREAL SA

AI summary

In an embodiment, a makeup application system includes: a projector (22) configured to project digital content including a makeup application tutorial onto the user's facial surface; and a dynamic mapping unit (24); (30) operably coupled to the projector, wherein the dynamic mapping unit is configured to establish a dynamic correspondence between pixels of the projector (22) and features of the user's facial surface.