Method for estimating at-home activities of elderly people living alone based on sound event detection

Abstract

The invention discloses a method for estimating at-home activities of elderly people living alone based on sound event detection. The method comprises the following steps that firstly, a pickup arrayis placed in the indoor space for collecting multi-channel audio data and pre-processing the audio data, wherein pre-processing comprises framing and windowing; then log Mel spectrum features are extracted from the audio data in each channel, direction of arrival (DOA) space spectrum features are extracted from the audio data in all the channels, and the log Mel spectrum features and the DOA spacespectrum features are spliced; then, the spliced features are input a convolutional neural network for feature transformation; and finally, the transformed features are input into a convolutional neural network classifier, and the type of the activities is estimated. According to the method, the spectrum features and transformed features are extracted from the multi-channel audio data, the diversity of training data can be improved, the generalization ability of the convolutional neural network classifier is effectively improved, and when the at-home activities of elderly people are estimated, the higher accuracy rate can be obtained.

Description

technical field [0001] The invention relates to audio signal processing and deep learning technology, in particular to a method for estimating activity in the home of an elderly person living alone based on sound event detection. Background technique [0002] With the continuous improvement of medical conditions, the average life expectancy of human beings has been greatly extended, and the fertility rate of the world has been declining. The proportion of the elderly in today's society will become larger and larger. At present, most elderly people do not live together with their children, and more and more elderly people live alone. Therefore, the need for guardianship of the elderly living alone has become very urgent. [0003] At present, home activity estimation methods for the elderly mainly include: image-based video analysis methods and wearable device-based sensor signal analysis methods. These methods have the following deficiencies: first, the camera has dead angl...

AI Technical Summary

Problems solved by technology

These methods have the following deficiencies: first, the camera has dead angles and cannot monitor all the activities of the elderly; second, the camera generally does not monitor places involving privacy such as bathrooms and bedrooms, where the elderly often fall and other abnormal activities Third, the elderly may not like or often forget to wear wearable devices such as sensors, which will affect their daily activities to a certain extent

Images