Macaque emotion recognition method and system based on time-frequency double-branch features

An emotion recognition and frequency domain feature technology, applied in the computer field, can solve problems such as extraction and inability to feature, and achieve the effect of enhancing expressiveness, simplifying algorithm process, and improving recognition accuracy.

Active Publication Date: 2021-11-12
NANHAI RES STATION OF INST OF ACOUSTICS CHINESE ACADEMY OF SCI
View PDF6 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the call duration of macaques is relatively short, and the emotions in a call of macaques are relatively consistent (no emotional transition), so the existing complex feature extraction methods for human speech recognition usually do not work in the process of speech emotion recognition of macaques, and cannot be carried out. Effective Feature Extraction

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Macaque emotion recognition method and system based on time-frequency double-branch features
  • Macaque emotion recognition method and system based on time-frequency double-branch features
  • Macaque emotion recognition method and system based on time-frequency double-branch features

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0104] Embodiment 1 of the present invention proposes a macaque emotion recognition method based on time-frequency dual-branch features.

[0105] It should be noted that, for the convenience of description, only a part related to the embodiment of the present invention is shown in the drawings but not all content. Some exemplary embodiments are described as processes or methods depicted as flow diagrams, although flow diagrams describe operations (or steps) as sequential processes, many of which may be performed in parallel, concurrently, or simultaneously, The order of operations can be rearranged. The process may be terminated when its operations are complete, but may also have additional steps not included in the figure.

[0106] The difficulty of technical solution design of the present invention is as follows:

[0107] Most of the existing research focuses on the field of human speech recognition, and no scholars have yet proposed a scheme for recognizing the emotion of...

Embodiment 2

[0175] Embodiment 2 of the present invention provides a macaque emotion recognition system based on time-frequency dual-branch features, realized according to the emotion recognition network model constructed by any method provided in the above-mentioned embodiments, the system includes: the system includes: macaque Emotion recognition model and macaque emotion output module; wherein,

[0176] The macaque emotion output module is used to input the collected macaque voice into the pre-established and trained macaque emotion recognition model to obtain the corresponding precise emotion category; the precise emotion category includes "friendly" emotion, "offensive or threatening" emotion, " Lost or resigned" emotions and apathy;

[0177] The macaque emotion recognition model is used to extract the intermediate features of the macaque voice. Based on the time-frequency dual branch, the time domain feature and the frequency domain feature are separated and extracted, and the corres...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a macaque emotion recognition method and system based on time-frequency double-branch features, and the method comprises the steps: inputting collected macaque sounds into a pre-established and trained macaque emotion recognition model, and obtaining corresponding accurate emotion types; wherein the accurate emotion types comprise friendly emotion, attack or threat emotion, falling or compliance emotion and non-emotion; and the macaque emotion recognition model is used for extracting intermediate features of macaque sounds, performing separation and extraction on time domain features and frequency domain features based on time-frequency double branches, and determining corresponding accurate emotion categories through fusion and classification. According to the method and the system, original sound data is used as network input, emotion-related intermediate features are extracted from sound, voice preprocessing is not needed, the algorithm process is simplified, then time domain and frequency domain features are separated and extracted, compression features of the sound are obtained from different angles, the time domain and frequency domain features are fused, the expressive power of the features is enhanced, and the identification accuracy is effectively improved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a macaque emotion recognition method and system based on time-frequency double-branch features. Background technique [0002] Primates are facing a serious survival crisis. Understanding the living habits of primates has important research value for effective primate protection. In recent years, artificial intelligence (AI), especially deep learning (DL) has achieved more than classical algorithms in the application of many fields, such as the field of speech signal processing (speech recognition, speech synthesis, acoustic Pattern recognition, etc.), image processing (image recognition, image classification, image generation, instance segmentation, etc.) and text processing (text classification, text similarity detection, etc.). Because primates mostly live in dense forests and other environments, it is difficult to deploy image acquisition equipment, and monitoring equipment...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L25/63G10L25/03G10L25/18G10L25/30
CPCG10L25/63G10L25/03G10L25/18G10L25/30Y02D10/00
Inventor 李松斌唐计刚刘鹏张遥
Owner NANHAI RES STATION OF INST OF ACOUSTICS CHINESE ACADEMY OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap