Facial expression capture method, system and device

A facial expression capture and facial expression technology, applied in the field of computer vision, can solve the problems of uncaptured, not smooth, and inaccurate facial motion capture, etc., to achieve the effect of comprehensive capture and improved computing efficiency

Active Publication Date: 2021-06-22
BEIJING HUAJIE IMI TECH CO LTD
View PDF11 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The AR applications related to facial movements in China have the following defects in effect: (1) The facial expression transfer in the domestic market is not accurate enough to capture gestures and facial movements, or some movements cannot be captured at all and are unstable , not smooth; (2) The facial sticker application only tracks the movements of the mouth, and does not track the movements around the eyes in real time; (3) It can only capture some basic facial expressions, such as opening the mouth and smiling, and cannot be copied More facial movements, i.e. facial mocap has limitations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial expression capture method, system and device
  • Facial expression capture method, system and device
  • Facial expression capture method, system and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention.

[0036] see figure 1 , which is a flow chart of a facial expression capture method in an example of the present application, the method includes the following steps:

[0037] In step 101, image data is acquired, and two-dimensional face key points are obtained through detection;

[0038] Wherein, the image data acquired here are color and depth image data streams.

[0039] First, based on the color and depth image data streams, the position of the face frame is obtained through face detection technology, such as Figure 2a As shown, the color and depth image data streams and the detected face frame are then input to the key point detection system to obtain the key point positions of the fa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The facial expression capture method, system and equipment disclosed in the present invention relate to the field of computer vision technology, and specifically involve the use of face detection technology, key point detection technology and facial motion fitting technology to obtain facial motion information in real time, and then display it through a deformation model . The facial expression capture method, system and equipment proposed by the present invention utilize rich deformation models and advanced facial motion fitting technology to capture every subtle change of the face as much as possible and improve the computing efficiency to the greatest extent. .

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to a facial expression capture method, system and equipment. Background technique [0002] Augmented reality technology (AR), which is a new technology that "seamlessly" integrates real world information and virtual world information, is to combine physical information that is difficult to experience in the real world within a certain time and space range, through computer Wait for science and technology, simulate and then superimpose, apply virtual information to the real world, and be perceived by human senses, so as to achieve a sensory experience beyond reality. The real environment and virtual objects are superimposed on the same screen or space in real time. Augmented reality technology not only shows the information of the real world, but also displays the virtual information at the same time, and the two kinds of information complement and superimpose each other. A...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00
CPCG06V40/166G06V40/174
Inventor 张彦博王行李骊周晓军盛赞李朔杨淼
Owner BEIJING HUAJIE IMI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap