3D Face Mesh Guidance for Accessible Makeup Application
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Visually impaired individuals face challenges in performing cosmetic routines independently due to difficulties in visually conceptualizing and executing steps, and lack of available assistance affects their confidence and independence.
Innovation Solution
A system that generates a 3D face mesh using AI and computer vision techniques, provides step-by-step guidance, and integrates with smart devices to assist in applying, removing, or adjusting cosmetic products through audial, haptic, and visual feedback, allowing users to virtually try on products and share looks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If visual guidance methods are used for cosmetic application, then application accuracy is improved, but accessibility for visually impaired users deteriorates
Solution Approach 1:
The patent replaces visual-based mechanical guidance systems with auditory and haptic feedback systems. The mobile application substitutes visual display mechanisms with sound-based instructions and vibration patterns, enabling visually impaired users to receive guidance without relying on visual input channels.
Solution Approach 2:
The patent introduces auditory and haptic intermediaries as mediators between the cosmetic application process and the user. These intermediary feedback channels translate visual information into accessible formats, allowing visually impaired users to perceive application accuracy through sound and touch rather than direct visual observation.
2Measurement precision
If human assistance is provided for cosmetic routines, then application accuracy is improved, but user independence deteriorates
Solution Approach 1:
The patent enables self-service through an autonomous mobile application that provides guidance without requiring human assistance. The system delivers step-by-step auditory instructions and real-time feedback, allowing users to independently complete cosmetic routines with the same accuracy previously requiring human guidance.
Solution Approach 2:
The patent implements continuous feedback loops through auditory confirmation and haptic signals that inform users of their application accuracy in real-time. This feedback mechanism replaces the need for human verification, enabling users to self-correct and achieve accurate results independently.
3Measurement precision
If complex visual interfaces are used for cosmetic product selection, then product recommendation accuracy is improved, but ease of use for visually impaired users deteriorates
Solution Approach 1:
The patent replaces complex visual interface mechanisms with auditory navigation and voice-based interaction systems. The mobile application substitutes visual product catalogs and selection interfaces with sound-based product descriptions and voice command capabilities, maintaining recommendation accuracy while improving accessibility.
Data Source
AI summary
Systems and methods assist users of cosmetic products in performing cosmetic routines, such as the application, adjustment and/or removal of one or more cosmetic products. More particularly, generated assistance may be of particular use to users having one or more visual impairments such as colorblindness, severe farsightedness, cataracts, etc., by providing audial and/or haptic input and/or output to guide users through accurate performance of desired cosmetic routines. Assistance is provided via obtaining and manipulating a three-dimensional face mesh digitally representing detected points and features of interest on the face of the user, and guiding the user through use of the cosmetic product(s) with respect to the detected features. Various technologies also enable users to explore and share cosmetic products, styles of applying products, and “looks” combining products and/or styles.


