Supercharge Your Innovation With Domain-Expert AI Agents!

Systems and methods for realistic head turns and face animation synthesis on mobile device

A head-turning, face-based technology, applied in computer parts, character and pattern recognition, instruments, etc., can solve problems such as time-consuming, unsuitable, and unrealistic faces

Pending Publication Date: 2021-08-13
SNAP INC
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although generating faces with deformable face models can be fast, the generated faces may not be realistic
Some other current techniques for facial animation synthesis are time-consuming and may not be suitable for performing real-time facial animation synthesis on regular mobile devices

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Systems and methods for realistic head turns and face animation synthesis on mobile device
  • Systems and methods for realistic head turns and face animation synthesis on mobile device
  • Systems and methods for realistic head turns and face animation synthesis on mobile device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The following Detailed Description of the Embodiments includes references to the accompanying drawings, which form a part hereof. The approaches described in this section are not prior art to the claims and are not admitted to be prior art by inclusion in this section. The figures show diagrams according to example embodiments. These example embodiments (also referred to herein as "examples") are described in sufficient detail to enable those skilled in the art to practice the subject matter. The embodiments may be combined, other embodiments may be utilized, or structural, logical, and operational changes may be made without departing from the scope of what is claimed. Accordingly, the following detailed description should not be viewed as limiting, and the scope is defined by the appended claims and their equivalents.

[0026] The present disclosure relates to methods and systems for realistic head turning and facial animation synthesis. Embodiments provided by the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Provided are systems and methods for realistic head turns and face animation synthesis. An example method may include receiving frames of a source video with the head and the face of a source actor. The method may then proceed with generating sets of source pose parameters that represent positions of the head and facial expressions of the source actor. The method may further include receiving at least one target image including the target head and the target face of a target person, determining target identity information associated with the target face, and generating an output video based on the target identity information and the sets of source pose parameters. Each frame of the output video can include an image of the target face modified to mimic at least one of the positions of the head of the source actor and at least one of facial expressions of the source actor.

Description

technical field [0001] The present disclosure relates generally to digital image processing. More specifically, the present disclosure relates to realistic head turning and facial animation synthesis on mobile devices. Background technique [0002] Facial animation synthesis may include transferring the facial expressions of a source individual in a source video to a target individual in a target video or image. Facial animation synthesis can be used for manipulation and animation of faces in many applications such as entertainment programming, computer games, video conversations, virtual reality, augmented reality, etc. [0003] Some current techniques for facial animation synthesis utilize deformable facial models to re-render target faces with different facial expressions. Although generating faces with deformable face models can be fast, the generated faces may not be realistic. Some other current techniques for facial animation synthesis are time-consuming and may no...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06K9/46G06K9/00
CPCG06V40/176G06V10/451G06V10/82G06F18/24133G06T13/40G06T7/70G06V40/165G06V40/174G06T3/06G06T3/02G06T2207/20084G06T2207/20132G06T2207/20081
Inventor 尤里·沃尔科夫帕维尔·萨夫琴科夫马克西姆·卢金伊万·别洛诺戈夫尼古拉·斯米尔诺夫亚历山大·马什拉博夫
Owner SNAP INC
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com