Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A multi-size input HAR algorithm based on an improved LSTM-CNN

A multi-size, data technology, applied in computing, computer components, instruments, etc., can solve problems such as difficult feature extraction

Active Publication Date: 2019-04-23
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF10 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004]Traditional classification and recognition algorithms use manual extraction of effective feature values ​​for classification and recognition. For actions with great similarity, feature extraction becomes particularly difficult

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A multi-size input HAR algorithm based on an improved LSTM-CNN
  • A multi-size input HAR algorithm based on an improved LSTM-CNN
  • A multi-size input HAR algorithm based on an improved LSTM-CNN

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] The technical solution of the present invention will be described in detail below. A multi-size input HAR algorithm based on an improved LSTM-CNN, the recognition method includes a preprocessing module, a model building module, and a HAR classification and recognition module. The overall process of the system is attached figure 1 , the neural network architecture is attached figure 2 , which will be described in detail below.

[0015] 1. Preprocessing module

[0016] There is a lot of noise in the raw data collected by smartphones, which will cause great trouble for our classification. Therefore, the data should be preprocessed to remove useless information in the raw data. Preprocessing includes data denoising normalization, zero padding, and generation of multi-scale inputs.

[0017] 1) Data denoising and normalization

[0018] There are a lot of gravitational acceleration components and noise in the raw data, and the gravitational acceleration component is a lo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

In order to solve the problem that a traditional machine learning algorithm has difficulty in feature extraction and confusion of similar actions to classification and recognition, the invention provides a multi-size input HAR algorithm based on an improved LSTM-CNN. According to the algorithm, an optimized CNN convolutional neural network and a multi-layer bidirectional dynamic LSTM long-short time memory network are fused to identify HAR human body behavior activities. The method comprises multi-size input and model classification and recognition, the multi-size inpu subjects the data to theoperations of noise reduction, mean value-variance normalization, zero filling and the like to generate two different dimensions of data as model input, and an optimized CNN network and a multi-layerbidirectional dynamic LSTM network are fused for classification and recognition through model classification and recognition. According to the method, the optimized convolutional neural network and the multi-layer bidirectional dynamic long-short-term memory network are fused to construct the classifier, so that the method has good expansibility and robustness, and can realize high-precision human behavior activity recognition.

Description

technical field [0001] The invention belongs to the field of pattern recognition and artificial intelligence, and in particular relates to a multi-size input HAR algorithm based on an improved LSTM-CNN. Background technique [0002] Sensor-based human behavior recognition is an emerging research direction in the field of human behavior recognition. Judging human behavior status by analyzing the acquired human behavior information has high research value and broad application fields. Human behavior recognition has two directions, sensor-based and visual-based. Vision-based human action recognition processes and analyzes the original images collected by the camera, learns and understands the actions and behaviors in them, and establishes the mapping relationship between video content and action type descriptions, while vision-based HAR (Human Activity Recognition ) is limited by specific scenarios, time, etc., which will directly affect the correctness and robustness of HAR a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62
CPCG06F18/24G06F18/25
Inventor 王佳昊龙秋玲李亮齐秀秀谢樱姿刘珂瑄
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products