Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Facial expression capturing method, system and equipment

A facial expression capture and facial expression technology, applied in the field of computer vision, can solve the problems of uncaptured, unsmooth, and inaccurate facial motion capture, etc., and achieve the effect of improving computing efficiency and capturing comprehensive effects

Active Publication Date: 2019-07-12
BEIJING HUAJIE IMI TECH CO LTD
View PDF11 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The AR applications related to facial movements in China have the following defects in effect: (1) The facial expression transfer in the domestic market is not accurate enough to capture gestures and facial movements, or some movements cannot be captured at all and are unstable , not smooth; (2) The facial sticker application only tracks the movements of the mouth, and does not track the movements around the eyes in real time; (3) It can only capture some basic facial expressions, such as opening the mouth and smiling, and cannot be copied More facial movements, i.e. facial mocap has limitations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial expression capturing method, system and equipment
  • Facial expression capturing method, system and equipment
  • Facial expression capturing method, system and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention.

[0036] see figure 1 , which is a flow chart of a facial expression capture method in an example of the present application, the method includes the following steps:

[0037] In step 101, image data is acquired, and key points of the human face are obtained through detection;

[0038] Wherein, the image data acquired here are color and depth image data streams.

[0039] First, based on the color and depth image data streams, the position of the face frame is obtained through face detection technology, such as Figure 2aAs shown, the color and depth image data streams and the detected face frame are then input to the key point detection system to obtain the key point positions of the face...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a facial expression capturing method, system and equipment, relates to the technical field of computer vision, and particularly relates to a method, system and equipment for acquiring facial action information in real time by utilizing a face detection technology, a key point detection technology and a facial action fitting technology and then displaying the facial action information through a deformation model. According to the facial expression capturing method, system and equipment, a rich deformation model is utilized, an advanced facial action fitting technology isadopted, and each subtle change of the face is captured to the maximum extent, and the operation efficiency is improved to the maximum extent.

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to a facial expression capture method, system and equipment. Background technique [0002] Augmented reality technology (AR), which is a new technology that "seamlessly" integrates real world information and virtual world information, is to combine physical information that is difficult to experience in the real world within a certain time and space range, through computer Wait for science and technology, simulate and then superimpose, apply virtual information to the real world, and be perceived by human senses, so as to achieve a sensory experience beyond reality. The real environment and virtual objects are superimposed on the same screen or space in real time. Augmented reality technology not only shows the information of the real world, but also displays the virtual information at the same time, and the two kinds of information complement and superimpose each other. A...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00
CPCG06V40/166G06V40/174
Inventor 张彦博王行李骊周晓军盛赞李朔杨淼
Owner BEIJING HUAJIE IMI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products