Capsule-Net-based face expression recognition method

A facial expression recognition and facial expression technology, applied in character and pattern recognition, acquisition/recognition of facial features, instruments, etc., can solve the problem of inability to dig out the spatial relationship of features, achieve easy programming and maintenance, and easy implementation of actions , the effect of fast convergence

Inactive Publication Date: 2018-12-04
SOUTH CHINA UNIV OF TECH
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these classic deep learning models only have geometric invariance in a small range of images, but cannot dig out the spatial relationship between features in a large range. In an image, the nose and eyes are the relationship between the eyes and the nose. , if the position is reversed, it cannot be regarded as an image of a human face, and the traditional deep convolutional neural network will still recognize it as a human face

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Capsule-Net-based face expression recognition method
  • Capsule-Net-based face expression recognition method
  • Capsule-Net-based face expression recognition method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] The present invention will be further described below in conjunction with specific examples.

[0046] This embodiment is completed under the Ubuntu 16.04 system, and the experimental environment of Python2.7 is set up, and the graphics card with GTX1070 8G video memory and 16G memory are used. The facial expression recognition method based on Capsule Net provided by this embodiment comprises the following steps:

[0047] 1) Select the data set, select the Cohn-Kanade Plus Database expression data set, that is, CK+ expression data set, such as figure 1 Shown; Among them, the selected CK+ expression data set is selected according to the hardware device and the operating program environment.

[0048] Due to the limitation of experimental equipment conditions, the image size cannot be too large, which will make the subsequent calculation process complicated, time-consuming, and fail to achieve the expected results; the image size should not be too small, otherwise the comp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Capsule-Net-based face expression recognition method. The method comprises: step one, selecting a data set and selecting a Cohn-Kanade Plus Database expression data set, thatis, a CK+ expression data set; step two, selecting a deep learning model and using a deconvolution-version Capsule Net as an experimental model; step three, carrying out training and testing based onthe model, segmenting the CK+ expression data set into a training data set and a test data set, reading the training data set into the Capsule Net for periodic training to obtain a stable and accurate Capsule Net deep learning model; and step four, combining the trained Capsule Net deep learning model with an NAO robot, tracking the training process in real time by the NAO robot, reporting information related with the model testing regularly, and expressing an image recognition result in a voice and gesture manner. Therefore, convergence is realized quickly within short time; and the facial expression recognition accuracy and the reliability are improved.

Description

technical field [0001] The invention relates to the technical field of image processing and classification, in particular to a Capsule Net-based facial expression recognition method. Background technique [0002] Image classification is one of the research topics in the field of artificial intelligence, that is, to label the input image with a fixed category, which is one of the core issues in the field of computer vision. It has different practical applications. It is used in industry to detect, identify and classify products, which accelerates the process of intelligent industrialization. It is used in the medical field for disease diagnosis and treatment. It can also be used in robotics to process and classify images. The combination of technology and robots makes robots humanized and intelligent. [0003] Specifically, classic machine learning algorithms can be used to classify image datasets. The powerful feature extraction ability and good classification effect of th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04
CPCG06V40/175G06V40/172G06N3/045
Inventor 张京儒肖南峰
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products