Dynamic Face Tracking Special Effect Generation System
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current photo and video applications on intelligent terminals have limited flexibility in editing special effects, which are fixed at specific positions and cannot be easily configured or edited in real-time, leading to a reduced user experience.
Innovation Solution
A method and apparatus for generating special effects based on a face, where a standard face image is displayed, and a reference point is selected to generate a special effect parameter, allowing for dynamic positioning, sizing, and configuration of special effects on a face image recognized by an image sensor, enabling real-time editing and tracking of face movements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If special effects are pre-set and fixed at fixed positions, then the device complexity is reduced, but the ease of operation and adaptability deteriorate
Solution Approach 1:
The patent implements dynamic special effects that automatically track and adjust to face movements in real-time. The system continuously detects face position and orientation from captured images, then dynamically repositions and resizes special effect elements to maintain their relative positions on the face, transforming static fixed-position effects into dynamic adaptive effects.
Solution Approach 2:
The system changes multiple parameters including special effect position coordinates, size dimensions, rotation angles, and transparency levels based on detected face characteristics. By adjusting these parameters dynamically according to face position, orientation, and size in captured images, the system achieves flexible adaptation without requiring complex manual configuration.
2Ease of manufacture
If special effects are pre-set and fixed, then the ease of manufacture is improved, but the adaptability deteriorates
Solution Approach 1:
The patent creates a universal special effect generation system that can handle multiple types of effects (stickers, filters, animations) and apply them to various face positions and orientations. The same core algorithm detects face features and adjusts effect parameters, making the system multi-functional and highly adaptable without requiring separate development for each effect type.
Solution Approach 2:
The system performs preliminary face detection and parameter calculation before rendering special effects. By pre-processing the captured image to identify face boundaries, key points, and orientation, the system prepares all necessary parameters in advance, enabling rapid and adaptable application of special effects without complex real-time computation during rendering.
3Ease of operation
If manual editing of special effects is required, then the ease of operation deteriorates, but the manufacturing precision is improved
Solution Approach 1:
The system performs self-service by automatically detecting face features from captured images and calculating the appropriate position, size, and orientation of special effects without user intervention. The algorithm independently identifies face key points, determines relative positions, and adjusts effect parameters automatically, eliminating the need for manual editing while maintaining high positioning precision through computer vision techniques.
Data Source
AI summary
A method and an apparatus for generating a special effect based on a face, an electronic device, and a computer readable storage medium are provided. With the method, a standard face image is displayed, a reference point is selected on the standard face image in response to a received reference point selecting command, a special effect is formed on the standard face image in response to a received special effect forming operation, a parameter of the special effect is generated, a first face image recognized by an image sensor is acquired, and the special effect is generated on the first face image based on the parameter of the special effect and the reference point.