Three dimensional facial expression recognition method based on multiple dimensional characteristics of representative regions

A typical area, 3D face technology, applied in the field of 3D facial expression recognition based on multi-dimensional features of typical areas, can solve the problem of loss of texture, shape, etc.

Inactive Publication Date: 2016-06-15
BEIJING UNIV OF TECH
View PDF3 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since the 2D face image is a 2D plane projection of a 3D object, it will inevitably lose texture, shape and other features during the projection process, and will also be affected by posture, lighting, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three dimensional facial expression recognition method based on multiple dimensional characteristics of representative regions
  • Three dimensional facial expression recognition method based on multiple dimensional characteristics of representative regions
  • Three dimensional facial expression recognition method based on multiple dimensional characteristics of representative regions

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0091] figure 1 For the overall flow chart of the present invention, below are the specific implementation steps of the present invention:

[0092] 1. Face data preprocessing

[0093] The present invention operates on the basis of the BU-3DFE three-dimensional face database. Since the 3D face point cloud data is usually accompanied by glitches, noises, etc., in order to obtain more regular 3D face point cloud data, the obtained original 3D face point cloud data should be cut, destabilized, and smoothed according to actual needs. One or several preprocessing tasks such as hole filling, coordinate correction, and grid alignment resampling.

[0094] 2. Automatic calibration of typical areas of 3D facial expressions

[0095] According to the characteristics of three-dimensional facial expressions, the present invention divides three important facial expression-related areas, which are eye area (E area), cheek area (N area) and mouth area (M area). These three typical facial e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a three dimensional facial expression recognition method based on multiple dimensional characteristics of representative regions. The three dimensional facial expression recognition method includes the following steps: performing pretreatment operation on the three dimensional facial data, and acquiring the more normalized point cloud data; performing automatic calibration of a representative region of three dimensional facial expression; according to the position of the tip point of nose, completing automatic calibration of the eye region (E region), the nose region (N region) and the mouth region (M region); respectively extracting the three dimensional characteristics and the two dimensional characteristics of three representative regions, and performing gauss normalization and fusion of characteristics; and at last, according to the fusion characteristics of each representative region, performing SVM training to realize three dimensional facial expression recognition. The three dimensional facial expression recognition method based on multiple dimensional characteristics of representative regions not only can observe the contribution degree of different regions of the face on different expressions, but also can effectively recognize different expressions of the three dimensional face.

Description

technical field [0001] The invention relates to the fields of computer vision and pattern recognition, in particular to a three-dimensional facial expression recognition method based on multi-dimensional features of typical regions. Background technique [0002] Facial expression recognition is a hot research issue in the field of computer vision and pattern recognition, and has been paid more and more attention by researchers in the 30 years since the 1980s. At the same time, as an important branch of artificial intelligence and emotion analysis, facial expression recognition has great research value and application prospects in the fields of human-computer interaction and intensive care unit monitoring. [0003] Early facial expression recognition focused on two-dimensional images and image sequences, that is, the implementation of algorithms on videos. However, since a 2D face image is a 2D plane projection of a 3D object, features such as texture and shape will inevitab...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00
CPCG06V40/169G06V40/175G06V20/64G06F18/2411
Inventor 蔡轶珩盛楠詹昌飞崔益泽高旭蓉邱长炎
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products