Gait recognition and emotion perception method and system based on intelligent acoustic equipment

Abstract

The invention provides a gait recognition and emotion perception method and system based on intelligent acoustic equipment. The method comprises the following steps of: taking a loudspeaker as a wavesource for sending signals, and utilizing a microphone to collect a signal reflected by a target pedestrian to obtain voice frequency data; processing the voice frequency data to obtain a corresponding energy atlas, and segmenting a signal containing a gait event; for the signal containing the gait event, independently extracting macroscopic gait characteristics, microcosmic gait characteristics and the embedding representation characteristics of various neural networks; and taking the blending of the characteristic vectors of the macroscopic gait characteristics, microcosmic gait characteristics and the embedding representation characteristics of various neural networks as input, and utilizing a trained classifier to obtain thee emotion classification result of the target pedestrian. Themethod can be applied to the intelligent home environment, and can carry out emotion recognition under a situation that individual privacy is not invaded and a user is not required to carry additionalequipment.

Description

technical field [0001] The present invention relates to the technical field of situation perception, and more specifically, to a method and system for gait recognition and emotion perception based on intelligent acoustic equipment. Background technique [0002] With the popularity of IoT smart devices, natural human-computer interaction in smart home scenarios is becoming more and more important. Due to the development of smart homes, the emotional computing of the Internet of Things has the needs of realistic application scenarios, for example, to study the emotions of pedestrians through human gait, so as to obtain better human-computer interaction. [0003] In the prior art, gait recognition and emotion perception are usually performed using camera-related walking data or using wearable device-related walking data. [0004] For example, use the Kinect camera to collect gait data of human joint nodes, analyze and classify the gait data with emotional labels, and distingui...

AI Technical Summary

Problems solved by technology

First, the gait authentication and emotion recognition system based on camera images will more or less capture the pedestrian’s facial information, or external information such as clothing, which will lead to personal privacy leakage, while user privacy protection in the home scene In recent years, more and more attention has been paid to

Second, the gait authentication and emotion recognition system based on wearable devices requires the user to wear or carry a data collection device, which increases the inconvenience of the user, especially the system based on VICON equipment, which needs to be installed on the user. The key acquisition nodes of the sensor will cause inconvenience to the pedestrian's gait, and it is also inconsistent with the user's daily living conditions

Images