Portrait Lip Makeup Key Point Adjustment for Dynamic Face Orientation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for automatically applying lip makeup on portraits during video shooting or internet live broadcasting face inaccuracies due to dynamic facial changes, as they rely on fixed key points without adjusting for changes in light or face angle, leading to inconsistent makeup effects.

Innovation Solution

A method that extracts lip key points from a portrait facial image, adjusts their positions based on detected facial orientation and lip shape, and selects a suitable lipstick color from a color sample library based on skin hue and color number, ensuring accurate makeup application even with changing lighting and angles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If fixed key points are used for lip makeup based on face detection, then the makeup process is simple and fast, but the accuracy of lip key point positions becomes inaccurate and inconsistent when light or face angle changes

Engineering Contradiction:
Improvemakeup processing speedVSAvoidlip key point position accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies dynamics by adjusting lip key point positions based on detected facial orientation and lip shape characteristics. Instead of using fixed key points, the system dynamically recalculates key point positions according to the actual facial state, allowing the makeup application to adapt to different lighting conditions and face angles while maintaining both speed and accuracy

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes parameters by detecting facial orientation angles and lip shape features, then using these parameters to adjust the positions of lip key points. This parameter-based adjustment enables the system to maintain key point accuracy across varying conditions without sacrificing processing efficiency

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If key point positions are adjusted based on facial orientation and lip shape, then lip key point position accuracy is improved, but the processing complexity increases

Engineering Contradiction:
Improvelip key point position accuracyVSAvoidmakeup processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-establishing the relationship between facial orientation, lip shape, and key point position adjustments. The system pre-processes the facial image to detect orientation and shape characteristics before applying makeup, so that when makeup is applied, the key points are already accurately positioned without requiring complex real-time adjustments during the coloring process

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If automatic lipstick color selection is implemented, then user operation is simplified and efficiency is improved, but the complexity of color matching algorithm increases

Engineering Contradiction:
Improveuser operation simplicityVSAvoidcolor selection algorithm complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system applies self-service by enabling automatic lipstick color selection that adapts to the user's skin tone and facial characteristics. The algorithm automatically analyzes the facial image, determines suitable color ranges, and selects the most appropriate lipstick color without requiring user input or manual color picking, making the operation simple while the complex color matching happens automatically in the background

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12067658B1Method, apparatus and device for automatically making up portrait lips, storage medium and program product
Publication Date: 2024.08.20 MIGU VIDEO TECH CO LTD
  • US12067658B1 patent drawing
  • US12067658B1 patent drawing
  • US12067658B1 patent drawing

AI summary

Embodiments of the present disclosure provide a method, apparatus and device for automatically making up portrait lips, storage medium and program product. The method includes: extracting lip key points from a portrait facial image and detecting a portrait facial orientation and a lip shape in the portrait facial image; adjusting positions of the lip key points based on the portrait facial orientation and the lip shape; detecting a skin hue and a skin color number of a facial area in the portrait facial image; and selecting a target lipstick color from a lipstick color sample library based on the skin hue and the skin color number; and performing fusion coloring by using the target lipstick color according to the positions of the lip key points.