Video-based non-linear on-line expression pre-detection method and device

A pre-detection, non-linear technology, applied in the acquisition/recognition of facial features, instruments, biological neural network models, etc., can solve problems such as complex expression pre-detection problems

Active Publication Date: 2019-02-01
SOUTHEAST UNIV
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The technical problem to be solved by the present invention is the complexity of the facial expression pre-detection problem. The present invention proposes a video-based nonlinear online facial

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video-based non-linear on-line expression pre-detection method and device
  • Video-based non-linear on-line expression pre-detection method and device
  • Video-based non-linear on-line expression pre-detection method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0067] Below in conjunction with specific embodiment and description accompanying drawing, the present invention will be further described, those skilled in the art can understand that, unless otherwise defined, all terms (comprising technical term and scientific term) used herein have the same meaning in the field of the present invention The same meaning is commonly understood by those of ordinary skill. It should also be understood that terms such as those defined in commonly used dictionaries should be understood to have a meaning consistent with the meaning in the context of the prior art, and unless defined as herein, are not to be interpreted in an idealized or overly formal sense Explanation. The preferred embodiments described here are only used to illustrate and explain the present invention, not to limit the present invention.

[0068] Such as figure 1 as shown, figure 1 The traditional recognition method shown in (a) is to classify and distinguish a complete vid...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a video-based non-linear on-line expression pre-detection method and device thereof. The method includes performing preprocessing on video data and extracting feature information of each frame of image; video segments with different lengths are extracted from the training samples, and the nonlinear mapping between the segments and the detection function is constructed. Therepresentation of fragments is based on multi-instance learning, fully mining the effective expression information, and constructing a constraint pair for every two video fragments according to the size of the mapping value to obtain training data; at each time point, the OKMEFD model is updated with all the constraints of the current sample. By minimizing the experience loss and model complexityon the current training data set, the model is optimized with stochastic gradient descent algorithm to obtain the online updating criteria of the model, and the nonlinear expression pre-detection function at each time point is further obtained. The pre-detection method is that the data is read frame by frame to the test sample and the corresponding detection value is output. When the value is greater than the set threshold value, the expression event is considered to be pre-detected. The invention realizes the pre-detection before the end of the expression video. The invention effectively improve the timeliness of expression recognition.

Description

technical field [0001] The invention relates to an expression pre-detection method and device, belonging to the interdisciplinary technical fields of facial expression recognition, video processing, and event pre-detection. Background technique [0002] After entering the 21st century, with the rapid development of artificial intelligence technology, computer technology and related disciplines, the demand for human-computer interaction has become increasingly strong. Faced with the deepening of related research and huge application prospects, facial expression recognition based on video In the past ten years, it has become a research hotspot in the field of artificial intelligence and machine learning, and has made great progress. Although related algorithms emerge in endlessly, many theories are still incomplete, and there are almost no mature commercial results. There is a process for the generation and disappearance of expressions. The traditional recognition method is t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06N3/04G06N20/00
CPCG06V40/161G06V40/168G06V40/174G06V20/46G06V20/41G06N3/045
Inventor 谢利萍魏海坤张侃健
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap