Camera-Based Skin Care Guidance Using Hand and Face Tracking

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing skin care solutions fail to provide guidance for daily skin care and do not help users select suitable products based on their skin care actions and time, despite advancements in makeup product recommendations using image processing and neural networks.

Innovation Solution

A method and device that utilize a camera to capture images of the hand and face regions during skin care, extract target image features, and analyze these features to determine the integrity of the skin care process, including actions and durations, providing guidance through prompts and displays to ensure complete and standard skin care.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If image processing is performed on try makeup images to obtain virtual makeup effects, then makeup product recommendation capability is improved, but skin care process guidance capability remains lacking

Engineering Contradiction:

Improvemakeup product recommendation capabilityVSAvoidskin care process guidance information

Core Design Contradiction:

Adaptability or versatilityVSLoss of information

Solution Approach 1:

The system extends the existing image processing capability from makeup product recommendation to also provide skin care process guidance. The same camera and image processing modules are utilized to detect both makeup application (for product recommendation) and skin care actions (for process guidance), making the system multi-functional without adding separate hardware systems.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The image processing is divided into separate analysis streams: one for makeup product recommendation and another for skin care process guidance. The skin care guidance function segments the analysis to specifically detect hand movements, facial regions, and action durations, allowing independent optimization of each function while sharing the same hardware platform.

Inventive Principle:

Principle #1Segmentation

2Reliability

If the camera continuously captures images during skin care process, then real-time feedback capability is improved, but energy consumption increases

Engineering Contradiction:

Improvereal-time feedback capabilityVSAvoidcamera energy consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

Instead of continuous capture, the camera operates periodically at strategically chosen moments during the skin care process. The system captures images at key transition points between different skin care actions, allowing real-time feedback while significantly reducing the total number of captures and associated energy consumption.

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

The system uses passive detection methods where the camera captures images only when triggered by detected motion or when the user positions their face in the detection zone. This self-triggering mechanism eliminates the need for continuous active capture, reducing energy consumption while maintaining reliable detection capability.

Inventive Principle:

Principle #25Self-service

3Measurement precision

If multiple skin care parameters (actions, durations, integrity) are monitored and analyzed, then skin care guidance accuracy is improved, but system complexity increases

Engineering Contradiction:

Improveskin care parameter detection accuracyVSAvoidimage processing system complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The complex analysis task is segmented into distinct processing modules: hand region detection, facial region detection, action classification, duration measurement, and integrity calculation. Each module handles a specific aspect of the analysis, making the overall system more manageable and maintainable while achieving high measurement precision through specialized processing for each parameter.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system performs preliminary detection and classification of skin care actions before conducting detailed analysis. By first identifying the type of action being performed and its basic parameters, the system can then focus computational resources on precise measurement of duration and integrity, reducing overall complexity while maintaining high accuracy.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentEP4191468B1Skin care aiding method, device, and storage medium

Publication Date: 2026.04.01 HUAWEI TECH CO LTD

Figure 1~2a
Figure 2b~3
Figure 4

AI summary

A skin care auxiliary method, a device, and a storage medium are provided. The method includes: (S301), in response to a first operation performed on a first electronic device, obtaining, by the first electronic device, an image by using the camera, where the image includes a hand region and a face region, and the first operation is used to indicate a start of a skin care process; (S302), extracting a target image feature from the image, where the target image feature is a feature related to the hand region and the face region; and (S303), outputting integrity of the skin care process based on target image features corresponding to a plurality of frames of images, where the plurality of frames of images are images generated in a time sequence in the skin care process. Outputting the integrity of the skin care process can help a user understand whether a skin care action and skin care time of the user in the skin care process are complete and the like, to assist the user in skin care and provide guidance for the user.