Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

System and method for smiling face recognition in video sequence

A smile recognition and video sequence technology, applied in the field of face recognition, can solve the problems of poor real-time performance of smile recognition and stiff facial expressions, and achieve the effect of being persuasive, improving the recognition rate and improving the accuracy.

Inactive Publication Date: 2015-04-08
WINGTECH COMM
View PDF2 Cites 71 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In addition, the real-time performance of the smile recognition function is not good
The user faces the camera and smiles, hoping to capture and shoot his smile in the most natural way. However, the current camera captures a smile with a certain delay, or even very slow, resulting in facial expressions in the photos taken. On the contrary, it is more rigid than manual shooting

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for smiling face recognition in video sequence
  • System and method for smiling face recognition in video sequence
  • System and method for smiling face recognition in video sequence

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0066] see figure 1 , the present invention discloses a smiling face recognition system in a video sequence. The system mainly includes: a preprocessing module, a feature extraction module, and a classification and recognition module. The feature extraction module includes an Optical_PHOG feature extraction unit, and the classification identification module includes a random forest classification identification unit.

[0067] The preprocessing module obtains the face image area that can directly extract optical flow features or PHOG features through video acquisition, face detection, and mouth detection.

[0068] The feature extraction module uses the Optical_PHOG algorithm to extract the smile features, and obtains the most favorable information for smile recognition.

[0069] The classification recognition module adopts the random forest algorithm to obtain the classification standards of smiling faces and non-smiling faces according to the feature vectors of a large number...

Embodiment 2

[0239] The system designed by the present invention is divided into three groups from the perspective of feature extraction technology, which respectively realize smile recognition based on optical flow method, smile recognition based on PHOG, and smile recognition based on Optical_PHOG. The technical design scheme used by each functional module is as follows: Figure 18 shown.

[0240] (1) Preprocessing module

[0241] In the preprocessing module, the purpose of the work is to obtain the image of the region of interest that can directly extract the optical flow feature or PHOG feature. For the training process, the processing object is the Jaffe expression library, and the work done is face detection and mouth area detection. For the recognition process, the processing object is the face image directly collected by the camera. Before detection and mouth detection, a simple grayscale processing is performed first.

[0242] Among them, in the face detection step, the face fe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a system and a method for smiling face recognition in a video sequence. The system comprises a pre-processing module, a feature extraction module, and a classification recognition module. According to the pre-processing module, through video collection, face detection and mouth detection, a face image region capable of directly extracting optical flow features or PHOG features can be acquired; according to the feature extraction module, Optical-PHOG algorithm is adopted to extract smiling face features, and information most facilitating smiling face recognition is obtained; and according to the classification recognition module, random forest algorithm is adopted, and classification standards on a smiling face type and a non-smiling face type are obtained according to feature vectors of a large number of training samples obtained by the feature extraction module in a machine learning method. Comparison or matching or other operation is carried out between feature vectors of a to-be-recognized image and the classifier, and the smiling face type or the non-smiling face type to which the to-be-recognized image belongs can be recognized, and the purpose of classification recognition can be achieved. Thus, according to the system and the method for smiling face recognition in the video sequence, accuracy of smiling face recognition can be improved.

Description

technical field [0001] The invention belongs to the technical field of face recognition, and relates to a smile system, in particular to a smile recognition system in a video sequence; meanwhile, the invention also relates to a smile recognition method in a video sequence. Background technique [0002] At present, the research on smile recognition mainly focuses on the classification and recognition of smiles in a single image in a specific environment and a specific database. There are not many researches on the recognition of it applied to video sequences, and the corresponding technology is not perfect. According to the feedback from some users who use digital products, the smile function experienced is not ideal, and there are many deficiencies in practical application. [0003] First of all, the accuracy of the smile recognition function is not high. Since human expressions can be expressed in many forms, such as subtle and strong, relaxed and excited, relaxed and tens...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06V10/50G06V10/764
CPCG06V40/171G06V40/176G06V40/172G06V10/50G06V10/764G06F18/24323
Inventor 李保印
Owner WINGTECH COMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com