Aerial handwriting interaction method and system based on deep learning

Abstract

The invention discloses an aerial handwriting interaction method and system based on deep learning. The method comprises the steps of collecting action data through a sensor; preprocessing the actiondata to obtain an action data set; constructing a neural network, and training the neural network through the manually labeled action data set to serve as an action recognition model; recognizing theaction data collected by the sensor through an action recognition model. The main function is to facilitate character input of virtual reality, augmented reality and other devices, and compared with the most commonly used information input interaction device such as a keyboard and a writing board at present, the information input interaction device has better naturalness and high efficiency. Compared with other interaction modes such as voice interaction, the method has higher robustness, and the neural network algorithm model is adopted to perform attitude estimation analysis, so that higheraccuracy is achieved.

Description

technical field [0001] The present disclosure relates to a technology combining deep learning and data communication, and in particular to a method and system for in-air handwriting interaction based on deep learning. Background technique [0002] With the popularity and implementation of wearable devices, smart home, Internet of Things and other fields in the technology circle, building an intelligent life in an all-round way has become the next focus, and multi-channel, multimedia intelligent human-computer interaction methods will gradually become A key part of achieving this kind of life. The new human-computer interaction environment represented by virtual reality and the mobile interactive platform represented by handheld computers and smart phones are two important development trends of current computers. The human-computer interaction technology represented by mouse and keyboard is the main bottleneck affecting their development. Interacting with the (visible or in...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to propose a method and system for in-air handwriting interaction based on deep learning, to solve one or more technical problems existing in the prior art, and at least provide a beneficial choice or create conditions

Images