The invention provides a neural network
action recognition data processing method, and solves the problems that
feature extraction in a traditional
action recognition system depends on manual design, the model training efficiency is low, cross-platform deployment is difficult and the like. According to the method, by constructing an end-to-end
deep learning model, direct mapping from original sensor data to gesture categories or sentences is achieved, meanwhile, multi-device deployment is supported by using cross-platform characteristics of TensorFlow, and an efficient and stable
processing scheme is provided for wearable
action recognition devices. The
system specifically comprises a data preprocessing module, a 1D CNN model construction module, a model training module and a model deployment module. The data preprocessing module supports loading of an
open source triboelectric sensor action
data set from multiple formats, and
signal standardization, data enhancement and
sequence segmentation are achieved. The 1D CNN model construction module adopts a multi-layer 1D
convolution structure, and introduces a
time sequence attention mechanism and multi-scale
feature fusion, thereby improving the recognition precision. The model training module uses an Adam optimizer and a learning rate attenuation strategy to realize early stop and
check point storage. And the model deployment module supports model export,
model compression and cross-platform deployment. Experimental results show that the recognition accuracy of the 1D CNN model on a
test set reaches 91.3%, which is superior to that of a traditional method, and the 1D CNN model shows good performance in a continuous action
sentence recognition task.