AR Face Animation Synthesis for Advertisements
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in efficiently performing image processing operations on digital images captured in varying conditions, such as changes in image scales, noises, lighting, movement, or geometric distortion, especially on resource-constrained devices.
Innovation Solution
The development of a messaging system that incorporates augmented reality technology, enabling face animation synthesis and efficient image data processing on power and resource-constrained devices, by reducing latency and increasing processing efficiency while minimizing power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If image processing operations are performed on digital images captured in varying conditions, then user experience with digital images is enhanced, but power consumption and resource usage increase on mobile devices
Solution Approach 1:
The system segments image processing tasks by identifying and extracting only the necessary regions or features from digital images for processing, rather than processing entire images. This reduces computational load and power consumption while maintaining image processing quality for enhanced user experience.
Solution Approach 2:
The patent applies partial processing by performing image processing operations only on specific portions or aspects of digital images that require enhancement, rather than processing all image data. This selective approach reduces power consumption while still achieving the desired improvement in image quality and user experience.
2Ease of operation
If real-time face animation synthesis is performed on mobile devices, then user interaction with augmented reality content is improved, but processing latency increases
Solution Approach 1:
The system performs preliminary actions by pre-processing and preparing image data, facial features, and animation parameters before real-time synthesis is required. This includes pre-extracting facial landmarks, pre-segmenting regions of interest, and pre-loading necessary computational models, thereby reducing processing latency during actual user interaction with augmented reality content.
3Reliability
If comprehensive image processing operations are performed on digital images, then image quality and user experience are enhanced, but device resource constraints are exceeded
Solution Approach 1:
The patent applies local quality by enhancing specific regions or features of digital images rather than processing entire images uniformly. For face animation synthesis, this means processing only facial regions, eyes, mouth, and other relevant features while leaving other image areas unchanged, thereby reducing computational resources required while maintaining high image processing capability for enhanced user experience.
Data Source
AI summary
The subject technology receives frames of a source media content, the frames of the source media content including representations of a head and a face of a source actor. The subject technology generates sets of source pose parameters. The subject technology receives at least one target image, the at least one target image including representations of a target head and a target face of a target entity. The subject technology generates, based at least in part on the sets of source pose parameters, an output media content, each frame of the output media content includes an image of the target face in at least one frame of the output media content. The subject technology provides an online advertisement based at least in part on the output media content for display on a computing device.