AR Cosmetics Simulation via Image Filtering

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current augmented reality systems lack the capability to generate high-quality virtual objects or layers that can be implemented on a variety of devices, particularly for simulating the application of cosmetics like lipstick, which are not only of high quality but also accessible in real-time.

Innovation Solution

A computing system processes images to identify facial features and combines them with material data, using image filtering techniques to generate augmented images that simulate the application of virtual cosmetics, allowing for real-time display across different devices with low power consumption and latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If complex scanning systems are used to create virtual objects, then the quality of virtual objects is improved, but the cost and accessibility worsen

Engineering Contradiction:

Improvequality of virtual objectsVSAvoidcomplexity of scanning systems

Core Design Contradiction:

Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent uses 2D image copying and processing techniques to create virtual cosmetic applications instead of requiring complex 3D scanning systems. By working with standard 2D images and applying filtering techniques, the system achieves high-quality virtual object creation using widely available camera technology, thus resolving the contradiction between quality and complexity

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent replaces mechanical scanning systems with image processing and computational filtering methods. Instead of using physical scanners to capture detailed 3D data, the system uses standard camera images combined with sophisticated image filtering algorithms to generate realistic virtual cosmetic effects, reducing hardware complexity while maintaining quality

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Device complexity

If simplified drawings or filters are used, then device complexity is reduced, but the quality of virtual objects deteriorates

Engineering Contradiction:

Improvesimplicity of filter applicationVSAvoidquality of virtual cosmetic simulation

Core Design Contradiction:

Device complexityVSManufacturing precision

Solution Approach 1:

The patent applies multiple image filtering operations that modify various parameters of the input image (brightness, contrast, saturation, blur, etc.) to create realistic virtual cosmetic effects. By systematically adjusting these image parameters through sequential filtering steps, the system transforms simple 2D images into high-quality virtual cosmetic simulations without requiring complex hardware

Inventive Principle:

Principle #35Parameter changes

3Manufacturing precision

If high-quality virtual cosmetics are implemented, then visual quality is improved, but processing power and energy consumption increase

Engineering Contradiction:

Improvequality of virtual cosmetic simulationVSAvoidpower consumption for processing

Core Design Contradiction:

Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent divides the image processing task into multiple sequential filtering steps, each handling a specific aspect of the virtual cosmetic application. By segmenting the processing into discrete operations (edge detection, blur application, color adjustment, etc.), the system can optimize each step independently and execute them efficiently on mobile devices, reducing overall power consumption while maintaining quality

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies a series of filtering operations that may seem excessive but are optimized to work together efficiently. By applying multiple targeted filters rather than one complex processing step, the system achieves high-quality results through cumulative refinement, with each filter contributing a specific improvement that can be computed efficiently

Inventive Principle:

Principle #16Partial or excessive action

4Ease of operation

If real-time processing is implemented, then user experience is improved, but processing speed requirements increase

Engineering Contradiction:

Improvereal-time interaction capabilityVSAvoidprocessing speed requirement

Core Design Contradiction:

Ease of operationVSSpeed

Solution Approach 1:

The patent processes images in discrete frames at standard video frame rates (e.g., 30 or 60 frames per second). By processing each frame independently using the same filtering pipeline, the system achieves real-time performance through periodic, rhythmic processing that matches display refresh rates, making speed requirements manageable through consistent, repeatable operations

Inventive Principle:

Principle #19Periodic action

Data Source

PatentUS12039675B2High quality AR cosmetics simulation via image filtering techniques

Publication Date: 2024.07.16 GOOGLE LLC

AI summary

The disclosure is directed to embodiments for producing high-quality images simulating the application of a material (e.g., virtual cosmetics) to a person's body. Example implementations can generate an augmented image displaying a virtual cosmetic layer (e.g., lipstick) on a person's face. For instance, a computing system can obtain an image depicting the face and identify a region for applying the cosmetic. The system can use augmented reality and/or image filtering to process the image into datasets that can be combined with material data related to the virtual cosmetic to generate augmented image(s) simulating application of the material.