Behavior recognition system and method based on multi-convolution kernel residual network, medium and equipment

A recognition system and multi-convolution technology, applied in the field of artificial intelligence and pattern recognition, can solve the problems of difficult to extract data related features and large correlation, and achieve the effect of enhancing feature extraction ability, comprehensiveness and feature extraction ability.

Active Publication Date: 2020-04-17
SHANDONG UNIV
View PDF6 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The data collected by the sensor is usually a time series. Some sampling points may have a long distance before and after the time, but the correlation in the time series is very large. Therefore, it is difficult to extract the time before and after the time when fixed small-size convolution kernels are widely used at present. Correlation features for data at greater distances

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Behavior recognition system and method based on multi-convolution kernel residual network, medium and equipment
  • Behavior recognition system and method based on multi-convolution kernel residual network, medium and equipment
  • Behavior recognition system and method based on multi-convolution kernel residual network, medium and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0063] An action recognition system based on multi-convolution kernel residual network and adaptive weight cross-entropy loss function, such as figure 1 As shown, it includes data preparation layer, deep learning layer and recognition application layer connected in sequence.

[0064] The data preparation layer collects relevant human motion data, human physiological data, environmental state data, etc. through sensors deployed on the human body or in the environment, and uploads the data to the cloud server through wireless transmission technology, and performs data processing on the data on the server. Cleaning, data alignment, missing value processing, standardization, normalization and other preprocessing operations and data labeling, and finally transfer the data to the deep learning layer.

[0065] The deep learning layer transmits the data input by the above-mentioned data preparation layer to the deep learning model based on the multi-convolution kernel residual network...

Embodiment 2

[0082] An action recognition method based on multi-convolution kernel residual network and adaptive weight cross-entropy loss function, such as figure 2 As shown, taking the identification of 17 behaviors in the OPPTUNITY dataset as an example, the sample data is learned through the multi-convolution kernel residual network, and a deep learning model is generated to identify the 17 behaviors. The specific steps include:

[0083] Step S01: Data preprocessing:

[0084]Perform data cleaning, data alignment, missing value processing, data up / down sampling, standardization / normalization and other preprocessing operations on the data in the OPPTUNITY dataset. Data cleaning is to clean and delete data that cannot be corrected due to transmission errors. Alignment is to eliminate the problem of inconsistent receiving time of some data due to wireless propagation delay. Missing value processing is to solve the problem of missing some data due to packet loss in data transmission. Data ...

Embodiment 3

[0132] A computer-readable storage medium, in which a plurality of instructions are stored, and the instructions are suitable for being loaded by a processor of a terminal device and executing the behavior recognition method based on a multi-convolution kernel residual network given in Embodiment 2. step.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a behavior recognition system and method based on a multi-convolution kernel residual error network, a medium and equipment, and the method comprises the steps: collecting the motion physiological data or environment state data of a user, and sequentially carrying out the transmission, preprocessing and marking of the collected data to obtain a training set and a test set; constructing a behavior recognition model based on the multi-convolution kernel residual error network; classifying the training samples according to the prediction error of the training set and carrying out self-adaptive weight distribution on each class; calculating an overall loss function and partial derivatives of each parameter of the model, iteratively updating the model parameters to obtaina trained recognition model, testing by using the test set, storing the model parameters reaching the test standard, and generating a final deep learning model; inputting to-be-recognized data into the deep learning model to obtain a user behavior recognition result. According to the invention, multi-scale data features can be effectively utilized.

Description

technical field [0001] The disclosure belongs to the technical field of artificial intelligence and pattern recognition, and relates to a behavior recognition system, method, medium and equipment based on a multi-convolution kernel residual network. Background technique [0002] The statements in this section merely provide background information related to the present disclosure and do not necessarily constitute prior art. [0003] The behavior recognition system realizes the recognition of user behavior by obtaining human behavior information and processing it through models and algorithms. With the development and maturity of advanced technologies such as the Internet of Things, artificial intelligence, big data, and cloud computing, more and more scholars have begun to pay attention to the research of behavior recognition. At the same time, the development of wearable devices provides a good opportunity for user behavior recognition, and behavior recognition has become ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06V40/70G06V40/15G06N3/045Y02T10/40
Inventor 许宏吉王珏李梦荷石磊鑫张贝贝
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products