Aerial handwriting inertial sensing signal generation method based on deep adversarial learning

An inertial sensing and signal generation technology, applied in the field of deep learning and artificial intelligence, which can solve the problems of difficult data cleaning and labeling, time-consuming and labor-intensive sensor data collection, and personal privacy.

Active Publication Date: 2019-09-06
SOUTH CHINA UNIV OF TECH
View PDF9 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

First, the process of sensor data collection is time-consuming and laborious
Secondly, the poor readability of inertial sensor data leads to difficulties in data cleaning and labeling
Third, handwritten data is related to the personal privacy of the collected person and is not easy to be disclosed
However, most of the current adversarial generative network structures are specially designed for image data. When directly applied to aerial handwritten data, problems such as poor generation effect and mode collapse are prone to occur.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Aerial handwriting inertial sensing signal generation method based on deep adversarial learning
  • Aerial handwriting inertial sensing signal generation method based on deep adversarial learning
  • Aerial handwriting inertial sensing signal generation method based on deep adversarial learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0059] see figure 1 and figure 2 , this embodiment discloses a method for generating inertial sensing signals for handwriting in the air based on deep confrontational learning, the specific steps are as follows:

[0060] S1. Obtain the air handwritten inertial sensing signal sequence and character category labels, and perform data preprocessing. The specific steps are as follows:

[0061] S11. Obtain the inertial sensing signal sequence and the character category label of the handwritten character in the air from the public data set 6DMG, and perform one-hot encoding on the category label. The 6-dimensional inertial sensing signal includes 3-dimensional acceleration signal and 3-dimensional angular velocity signal, and there are 62 types of category labels, including 10 Arabic numerals, 26 uppercase English letters and 26 lowercase English letters;

[0062] S12. Performing a moving average filter with a window length of 5 to denoise the acquired inertial sensing signal sequ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an aerial handwriting inertia sensing signal generation method based on deep adversarial learning, which comprises the following steps: carrying out filtering, smoothing and noise reduction on an obtained aerial handwriting inertia sensing signal sequence to serve as a training sample set; designing a deep convolution condition confrontation generation network based on timesequence feature map position coding; using the training sample set to train the generation network; and inputting the formulated sample length, the sample category label and the random noise vectorinto the trained adversarial generation network, and taking the input of the generator as a generated air handwriting inertial sensing signal sequence. According to the invention, aerial handwriting inertial sensing signal samples with certain diversity and good quality can be generated, and the effective lengths and types of the generated samples are controllable.

Description

technical field [0001] The invention relates to the technical fields of deep learning and artificial intelligence, in particular to a method for generating inertial sensing signals of handwriting in the air based on deep confrontation learning. Background technique [0002] Air handwriting recognition based on inertial sensors (accelerometers and gyroscopes) is one of the emerging cutting-edge research directions in the computer field in recent years, and has a wide range of applications in smart home, automatic driving, education, medical care, industrial production, and auxiliary communication. . A handwriting recognition model in the air often requires sufficient training samples to obtain better generalization capabilities. However, there are few public air handwriting data sets based on inertial sensors. There are three main reasons for the scarcity of data. First, the process of sensor data collection is time-consuming and laborious. Secondly, the poor readability of...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F2218/02
Inventor 薛洋徐松斌
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products