3D Face Key Point Alignment for Virtual Makeup Fusion

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in enhancing the fit between three-dimensional human faces and virtual makeup in images, affecting the display quality of processed images.

Innovation Solution

A method that detects human face key points in a three-dimensional image, aligns and fuses a virtual makeup image with corresponding key points, ensuring precise alignment and integration of virtual makeup with the target image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If virtual makeup is added to an image using conventional image processing technology, then the image processing function is provided, but the fit degree between the three-dimensional human face and the virtual makeup is poor, affecting display quality

Engineering Contradiction:

Improvefit degree between three-dimensional human face and virtual makeupVSAvoiddisplay quality of processed image

Core Design Contradiction:

Manufacturing precisionVSReliability

Solution Approach 1:

The patent transitions from two-dimensional image processing to three-dimensional face modeling by constructing a 3D human face model with depth information. This dimensional elevation enables accurate mapping of virtual makeup onto the 3D face structure, resolving the fit degree issue by considering facial curvature and spatial relationships rather than flat 2D coordinates

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent replaces conventional 2D image processing algorithms with a 3D computer vision system that uses depth maps, point cloud data, and spatial coordinate transformations. This substitution of processing methodology enables precise alignment of virtual makeup with the actual three-dimensional facial features, significantly improving both fit degree and display quality

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11517099B2Method for processing images, electronic device, and storage medium

Publication Date: 2022.12.06 BEIJING DAJIA INTERNET INFORMATION TECH CO LTD

AI summary

A method for processing images includes: detecting a plurality of human face key points of a three-dimensional human face in a target image; acquiring a virtual makeup image, wherein the virtual makeup image includes a plurality of reference key points, the reference key points indicating human face key points of a two-dimensional human face; and acquiring a target image fused with the virtual makeup image by fusing the virtual makeup image and the target image with each of the reference key points in the virtual makeup image aligned with a corresponding human face key point.