Dynamic Facial Attribute-Based Special Effect Fusion

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing image processing technologies for adding special effects to users in videos suffer from poor adaptability and realism due to mechanically applied effects that do not accurately match the user's facial attributes.

Innovation Solution

An image processing method and apparatus that determine facial attribute information of a target subject and fuse a target special effect matching those attributes, improving the matching degree between the special effect and the user.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If 3D stickers are mechanically added to users in videos, then special effects can be applied, but the matching degree between special effects and users is poor

Engineering Contradiction:

Improvematching degree between special effect and userVSAvoidrealism of special effect addition

Core Design Contradiction:

Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent changes the parameters of special effect application by transitioning from fixed 3D sticker positioning to dynamic facial attribute-based positioning. The system extracts facial attributes (eye position, nose position, mouth position, face shape) and adjusts special effect parameters to match these attributes, enabling adaptive special effect placement that conforms to individual user facial characteristics rather than using rigid predetermined positions

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The patent replaces the mechanical approach of directly overlaying 3D stickers on video frames with an information-processing system. Instead of mechanically attaching effects to fixed positions, the system processes facial attribute data and uses this information to intelligently determine optimal special effect positioning, substituting mechanical overlay with attribute-based computational matching

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If special effects are added without considering facial attributes, then the process is simple, but the adaptability and realism are poor

Engineering Contradiction:

Improveadaptability of special effectsVSAvoidcomplexity of facial attribute analysis

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-extracting and storing facial attribute information (eye position, nose position, mouth position, face shape) before the actual special effect addition process. This pre-processing of facial data enables the system to quickly match and apply appropriate special effects without repeatedly performing complex analysis during the effect application phase

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent introduces facial attribute information as an intermediary between the user's facial features and the special effects. Instead of directly overlaying effects on raw video frames, the system uses extracted facial attributes (eye position, nose position, mouth position, face shape) as an intermediate representation to mediate the matching process, enabling intelligent adaptation while organizing complexity into a structured intermediate layer

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS20250173878A1Image processing method and apparatus, electronic device, and storage medium

Publication Date: 2025.05.29 DOUYIN VISION CO LTD

AI summary

Embodiments of the present disclosure provide an image processing method and apparatus, an electronic device, and a storage medium. The method includes: obtaining, in response to a special effect trigger operation, an image to be processed that includes a target subject; and determining facial attribute information of the target subject, and fusing a target special effect matching the facial attribute information for the target subject, to obtain a target special effect image corresponding to the image to be processed.