Adaptive Facial Expression Calibration for Low-Power Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Low-power mobile computing devices struggle to implement advanced avatar technologies due to high computational resource requirements for rendering life-like video and motion, limiting their ability to match the performance of desktop computers and servers.
Innovation Solution
A system comprising a computing device, network, and avatar database that generates avatars with facial expressions by capturing user images, performing facial measurement and comparison, and applying facial comparison data to render avatars with corresponding expressions, optimized for low-power devices through standardized image processing and data storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If advanced avatar rendering technologies are implemented, then realism and visual quality are improved, but computational resource requirements and power consumption increase
Solution Approach 1:
The patent divides the avatar rendering process into separate stages: capturing real-time facial expressions, processing and analyzing the expressions, selecting appropriate avatar expressions from a set, and rendering the avatar. This segmentation allows low-power devices to handle only the lightweight processing tasks while maintaining high visual quality through pre-rendered avatar assets.
Solution Approach 2:
The patent uses pre-rendered avatar models and expressions as templates that are copied and adapted to match the user's real-time facial expressions. Instead of generating realistic graphics from scratch on the mobile device, the system captures expression data and applies it to pre-existing high-quality avatar models, significantly reducing computational requirements while maintaining visual realism.
2Manufacturing precision
If advanced avatar rendering is performed on mobile devices, then visual quality is improved, but device complexity and processing requirements increase
Solution Approach 1:
The patent introduces an intermediary processing layer that captures facial expression data from the mobile device camera, processes this data to identify expression characteristics, and then maps these characteristics to pre-rendered avatar expressions. This intermediary approach allows the mobile device to perform only simple data capture and basic processing, while the complex rendering tasks are handled by pre-computed avatar assets.
Solution Approach 2:
The patent performs preliminary rendering of avatar models and expressions in advance, creating a library of pre-computed graphical assets. These pre-rendered avatars with various expressions are stored and can be quickly applied to match real-time facial expressions without requiring complex real-time rendering calculations on the mobile device.
3Productivity
If real-time facial expression mapping is implemented, then avatar responsiveness and realism are improved, but computational load and energy consumption increase
Solution Approach 1:
The patent implements partial action by focusing only on capturing and processing facial expression data rather than performing complete real-time 3D rendering. The system processes only the necessary expression characteristics needed to map to avatar expressions, leaving out more computationally intensive rendering operations that can be handled by pre-rendered assets.
Data Source
AI summary
Technologies for generating an avatar with a facial expression corresponding to a facial expression of a user include capturing a reference user image of the user on a computing device when the user is expressing a reference facial expression for registration. The computing device generates reference facial measurement data based on the captured reference user image and compares the reference facial measurement data with facial measurement data of a corresponding reference expression of the avatar to generate facial comparison data. After a user has been registered, the computing device captures a real-time facial expression of the user and generates real-time facial measurement data based on the captured real-time image. The computing device applies the facial comparison data to the real-time facial measurement data to generate modified expression data, which is used to generate an avatar with a facial expression corresponding with the facial expression of the user.