Facial Expression Transformation Using Local Region Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing computer vision technologies for expression transformation in daily life applications suffer from poor expression transformation effects.

Innovation Solution

An expression transformation method and apparatus that utilizes a preset expression transformation model trained using an original face image set and a face image set subjected to local processing and displaying preset expressions, enabling the transformation of target face images into expression transformation images with added special effects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If conventional computer vision technology is used for expression transformation, then the transformation process can be implemented, but the transformation effect is poor

Engineering Contradiction:
Improveexpression transformation effectVSAvoidtransformation quality
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent segments the face image into multiple local regions (eyes, eyebrows, nose, mouth, cheeks) and processes each region independently with specialized processing modules. This segmentation allows precise control over expression transformation in different facial areas, resolving the contradiction between achieving transformation and maintaining quality by treating each region with appropriate processing strategies.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different processing strategies to different facial regions based on their characteristics. For example, the mouth region receives specific processing for smiling expressions, while the eye region receives different processing for blinking or squinting. This local quality approach ensures high transformation quality in each region while maintaining overall expression coherence.

Inventive Principle:
Principle #3Local quality

2Productivity

If a simple expression transformation model is used, then the processing speed is fast, but the transformation accuracy is poor

Engineering Contradiction:
Improveprocessing speedVSAvoidtransformation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent performs preliminary actions by pre-defining multiple processing modules for different facial regions and expressions (smiling, blinking, squinting, etc.). During actual transformation, the system quickly selects and applies the appropriate pre-prepared module, achieving both fast processing speed and high transformation accuracy without requiring complex real-time computations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements a dynamic processing framework that adapts the processing pipeline based on the input image and desired expression. The system dynamically selects which processing modules to apply and adjusts processing parameters according to the specific transformation requirements, optimizing both speed and accuracy for different scenarios.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If local processing is applied to achieve better expression effects, then the transformation quality improves, but the processing complexity increases

Engineering Contradiction:
Improveexpression transformation qualityVSAvoidprocessing system complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent divides the complex face processing task into segmented, independent regional processing modules. Each module handles a specific facial region with specialized algorithms, making the overall complex system manageable through modular design. This segmentation reduces processing complexity by breaking down the problem while maintaining high transformation quality through region-specific optimization.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal processing framework where multiple processing modules can be applied to different facial regions. The same basic processing architecture serves multiple functions by handling different expressions (smiling, blinking, squinting) and different regions (eyes, mouth, cheeks), reducing overall system complexity through multi-functionality while maintaining high transformation quality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12633163B2Expression transformation method and apparatus, electronic device, and computer readable medium
Publication Date: 2026.05.19 DOUYIN VISION CO LTD
  • US12633163B2 patent drawing
  • US12633163B2 patent drawing
  • US12633163B2 patent drawing

AI summary

An expression transformation method and apparatus, an electronic device, and a computer readable medium. The method comprises: acquiring a target face image (201); and inputting the target face image into a pre-trained expression transformation model to obtain an expression transformation image (202). The expression transformation model performs expression transformation on the target face image to achieve different expression transformation effects. A set of face images which are locally processed and have preset expressions displayed are used for training, so that the effect of the additional special effect can be achieved for the expression transformation image on the basis of transformation.