Facial Flaw Removal Using Keypoint-Guided Skin Region Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image beautification methods fail to effectively remove facial flaws like black nevi and comedones without causing unnatural distortion or losing textures.

Innovation Solution

An image processing method that performs face detection to identify skin regions, followed by flaw detection using face key point information, and then removes flaws by replacing them with adjacent skin regions, utilizing gradient filtering and thresholding techniques.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If a degree of the refining is increased for entire image beautification, then the beautification effect is improved, but textures are lost causing unnatural distortion

Engineering Contradiction:
Improvebeautification effectVSAvoidtexture preservation
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The image processing is segmented into different regions: face region, skin region, and flaw region. By segmenting the skin region and identifying specific flaw areas, the system can apply targeted flaw removal processing only to problematic areas rather than uniformly processing the entire image. This selective approach maintains natural textures in non-flaw areas while effectively removing imperfections, thus resolving the contradiction between beautification effect and texture preservation.

Inventive Principle:
Principle #1Segmentation

2Manufacturing precision

If flaw removal processing is performed on the skin region, then facial imperfections are removed, but detection accuracy may be compromised without proper face key point information

Engineering Contradiction:
Improveflaw removal accuracyVSAvoiddetection accuracy
Core Design Contradiction:
Manufacturing precisionVSMeasurement precision

Solution Approach 1:

The system performs preliminary face detection and identification of face key points before conducting skin region detection and flaw removal. By establishing the face region boundaries and key point positions in advance, the system creates an accurate spatial framework that guides subsequent skin region identification and flaw detection. This preliminary structuring ensures that flaw removal is performed with high precision while maintaining accurate detection capabilities throughout the process.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12548127B2Skin flaw removal image processing method and apparatus, electronic device and computer readable storage medium
Publication Date: 2026.02.10 BOE TECHNOLOGY GROUP CO LTD
  • US12548127B2 patent drawing
  • US12548127B2 patent drawing
  • US12548127B2 patent drawing

AI summary

An image processing method, an image processing apparatus, an electronic device, and a computer readable storage medium are provided, and belong to the field of computer technology. The image processing method includes: performing a face detection on a first image to be processed, to determine a face region and face key point information in the first image; performing a skin detection on the first image according to the face region, to determine a skin region in the first image; performing a flaw detection on the skin region according to the face key point information, to determine a flaw region in the skin region; and performing a flaw removal processing on the flaw region in the first image to obtain a second image.