Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional facial expression migration method and system

A three-dimensional face and expression migration technology, applied in the field of face expression migration, can solve problems such as large time cost, and achieve the effect of high realism and rich details

Active Publication Date: 2020-08-21
SHANDONG UNIV OF FINANCE & ECONOMICS
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, machine learning training a data set usually takes a huge time cost, and the realness of the facial expression of the target model depends on the machine learning method used and the quality of the data set

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional facial expression migration method and system
  • Three-dimensional facial expression migration method and system
  • Three-dimensional facial expression migration method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] This embodiment provides a three-dimensional facial expression transfer method;

[0045] Three-dimensional facial expression transfer method, including:

[0046] S100: Obtain the current three-dimensional face model of the controller, and obtain the current three-dimensional face model of the accused;

[0047] S200: Perform feature extraction on the controller's current 3D face model to obtain a source basic expression model sequence; perform feature extraction on the accused's current 3D face model to obtain a target basic expression model sequence and target model detail feature vectors;

[0048] S300: Use the source sequence mapping function to map the source basic expression model sequence to a low-dimensional source, and obtain a low-dimensional source basic expression model sequence;

[0049] Using the target sequence reconstruction function, the low-dimensional source basic expression model sequence is transferred to the target basic expression model sequence to...

Embodiment 2

[0209] The present embodiment provides a three-dimensional facial expression migration system;

[0210] 3D facial expression transfer system, including:

[0211] An acquisition module configured to: acquire the current three-dimensional face model of the controller, and acquire the current three-dimensional face model of the accused;

[0212] The feature extraction module is configured to: perform feature extraction on the current 3D face model of the controller to obtain the source basic expression model sequence; perform feature extraction on the current 3D face model of the accused to obtain the target basic expression model sequence and the target model detail feature vector;

[0213] The expression transfer module is configured to: use the source sequence mapping function to map the source basic expression model sequence to a low-dimensional source basic expression model sequence to obtain a low-dimensional source basic expression model sequence; use the target sequence ...

Embodiment 3

[0219] This embodiment also provides an electronic device, including a memory, a processor, and computer instructions stored in the memory and executed on the processor. When the computer instructions are executed by the processor, the method described in Embodiment 1 is completed.

[0220] It should be understood that in this embodiment, the processor can be a central processing unit CPU, and the processor can also be other general-purpose processors, digital signal processors DSP, application specific integrated circuits ASIC, off-the-shelf programmable gate array FPGA or other programmable logic devices , discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, or the like.

[0221] The memory may include read-only memory and random access memory, and provide instructions and data to the processor, and a part of the memory may also include non-volati...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a three-dimensional facial expression migration method and system, and the method comprises the steps: obtaining a current three-dimensional facial model of a controller, and obtaining a current three-dimensional facial model of a controlled person; performing feature extraction on the current three-dimensional face model of the controller to obtain a source basic expression model sequence; performing feature extraction on the current three-dimensional face model of the controlled person to obtain a target basic expression model sequence and a target model detail feature vector; mapping the source basic expression model sequence to a low dimension by using a source sequence mapping function to obtain a low-dimension source basic expression model sequence; transmitting the low-dimensional source basic expression model sequence to a target basic expression model sequence by utilizing a target sequence reconstruction function to obtain a target model with a sourceexpression; and performing detail recovery on the target model with the source expression by utilizing the detail feature vector of the target model.

Description

technical field [0001] The present disclosure relates to the technical field of facial expression transfer, in particular to a method and system for 3D facial expression transfer. Background technique [0002] The statements in this section merely mention background art related to the present disclosure and do not necessarily constitute prior art. [0003] In recent years, 3D facial expression animation has been widely used in the fields of computer animation, film and television special effects and virtual reality. However, the high complexity of the physiological structure of the human face causes computers to often generate unnatural facial expressions when simulating changes in facial expressions. The inventors found that how to reconstruct a highly realistic three-dimensional facial expression model has become a research hotspot and difficulty in the field of computer graphics. Facial expression transfer technology is to transfer the expressions of existing character ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T13/40G06K9/00
CPCG06T13/40G06T2200/08G06V40/168G06V40/174Y02D10/00
Inventor 迟静于志平叶亚男代福芸高珊珊
Owner SHANDONG UNIV OF FINANCE & ECONOMICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com