Face Image Processing with Depth Information

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional beauty effects applied to face images using smart terminals lack three-dimensional depth information, resulting in unrealistic images due to information loss.

Innovation Solution

A face image processing method that combines beauty effects with depth information by detecting face images, performing initial processing, and adding depth information to the images using feature points from a preset standard template.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional beauty effects are applied to face images using smart terminals, then skin tone adjustment and other beauty effects can be achieved, but depth information of the face in three-dimensional space is lost resulting in unrealistic images

Engineering Contradiction:
Improverealism of processed imageVSAvoiddepth information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent applies 2D beauty effects to specific regions of the face while preserving 3D depth information by excluding certain areas (eyes, eyebrows, nose, mouth) from the beauty processing. This creates a semi-3D effect where parts of the face maintain their original three-dimensional depth while other parts receive beauty enhancement, thereby resolving the contradiction between applying beauty effects and maintaining depth information.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If beauty effects are applied to the entire face image, then comprehensive beauty enhancement is achieved, but the three-dimensional pattern and depth information are completely lost

Engineering Contradiction:
Improvebeauty effect applicationVSAvoidthree-dimensional pattern
Core Design Contradiction:
Ease of operationVSShape

Solution Approach 1:

The patent applies beauty effects selectively to specific regions of the face (cheeks, forehead, chin) while excluding other regions (eyes, eyebrows, nose, mouth) from beauty processing. This local application approach allows beauty enhancement where needed while preserving the three-dimensional pattern in critical facial features, thus resolving the contradiction between comprehensive beauty enhancement and maintaining 3D shape.

Inventive Principle:
Principle #3Local quality

3Shape

If depth information is completely preserved without any beauty processing, then three-dimensional pattern is maintained, but beauty effects such as skin tone adjustment cannot be applied

Engineering Contradiction:
Improvethree-dimensional patternVSAvoidbeauty effect functionality
Core Design Contradiction:
ShapeVSEase of operation

Solution Approach 1:

The patent implements a region-based processing approach where different parts of the face receive different treatments: some regions (cheeks, forehead, chin) receive beauty effects while other regions (eyes, eyebrows, nose, mouth) maintain their original depth information without beauty processing. This resolves the contradiction by allowing both beauty enhancement and 3D pattern preservation in different locations simultaneously.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11176355B2Facial image processing method and apparatus, electronic device and computer readable storage medium
Publication Date: 2021.11.16 BEIJING MICROLIVE VISION TECH CO LTD
  • US11176355B2 patent drawing
  • US11176355B2 patent drawing
  • US11176355B2 patent drawing

AI summary

A facial image processing method and apparatus, an electronic device and a computer readable storage medium. The facial image processing method comprises: acquiring an image to be processed; detecting whether a facial image exists in the image to be processed; in response to the detected facial image, carrying out a first processing on the facial image to obtain a first image; and obtaining depth information, and adding the depth information to the first image to obtain a processed image. According to the method, the image depth information can be added after the image is processed, such that the image has a stereoscopic impression and the user operation is simplified.