Multi-face tracking for customizable visual effects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current smart terminal applications can only apply effects to a single face and cannot track multiple faces simultaneously, limiting user experience in photography and video applications.
Innovation Solution
A method and apparatus for multi-face tracking of face effects, which involves selecting a face effect, choosing a face tracking type, generating a face tracking sequence, recognizing face images using an image sensor, and superimposing the effect on multiple faces based on the sequence, allowing for customizable tracking of multiple faces with specific effects like stickers, beauty effects, and deformation effects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If face effect is applied to single face only, then effect application is simple, but multi-face functionality is limited
Solution Approach 1:
The patent segments the face tracking process by introducing face identification numbers and tracking sequences. Each detected face is assigned a unique identifier and positioned in a specific order in the tracking sequence, allowing the system to independently track and apply effects to multiple faces simultaneously. This segmentation transforms the single-face processing system into a multi-face capable system.
Solution Approach 2:
The patent enhances the universality of the effect processing system by enabling it to handle both single-face and multi-face scenarios through the same basic framework. The face tracking sequence and identification mechanism allow the system to adaptively process any number of faces, making the effect application functionality universal across different shooting scenarios.
2Measurement precision
If face tracking sequence is generated, then tracking precision is improved, but system complexity increases
Solution Approach 1:
The patent applies preliminary action by pre-generating the face tracking sequence before actual effect application. The system detects faces, assigns identification numbers, and establishes the tracking sequence in advance, which enables precise and efficient effect application during the shooting process without real-time computational complexity.
3Adaptability or versatility
If multiple face effects are applied simultaneously, then user experience is enhanced, but processing time increases
Solution Approach 1:
The patent reduces processing time by performing preliminary face detection, identification assignment, and tracking sequence generation before the actual shooting and effect application. This pre-processing ensures that when multiple faces are detected during shooting, the system can immediately apply effects without computational delay.
Data Source
AI summary
Disclosed is a method and apparatus for multi-face tracking of a face effect, and a computer readable storage medium. The method for multi-face tracking of a face effect comprises steps of: selecting a face effect in response to an effect selection command; selecting a face tracking type of the face effect in response to a face tracking type selection command; generating a face tracking sequence based on the face tracking type; recognizing a face image captured by an image sensor; superimposing the face effect on at least one of the face images according to the face tracking sequence. In the embodiment of the invention, for the face that needs to be tracked as specified by the effect, the number of faces of superimposed faces for the face effect, the superimposition order, and the display duration of the face effect can be arbitrarily set, and different effects can be superimposed on multiple faces, so as to improve the user experience.