Tactical sign language recognition glove system based on deep learning and sensor technology and implementation method

Abstract

The invention belongs to the field of communication, and particularly discloses a tactical sign language recognition glove system based on deep learning and a sensor technology and an implementation method. Comprising a Raspberry Pi module, an arduino development board, a V5 expansion board, a power supply module, a switch module, a PC end interface module, a receiver earphone end, a bending sensing module, a gyroscope sensing module, a pressure sensing module and a satellite positioning module. According to the invention, a single-label multi-classification neural network gesture recognition model is established based on Keras, and a glove collection data-based sign language recognition system is established based on a sensor technology, so that sign language transmission information can be utilized in real time, and information exchange based on sign language recognition can be realized; remote information transmission between users can be realized, and accurate information interaction of the users under the blocking of obstacles can be established; the position condition of each user can be obtained in real time; automatic selection of emergency measure plans of emergency situations can be established, meanwhile, emergency communication of users is facilitated, and then the complete, accurate and high-real-time communication function of the whole system is achieved.

Description

technical field [0001] The invention belongs to the field of communications, and specifically discloses a tactical sign language recognition glove system and an implementation method based on deep learning and sensor technology. Background technique [0002] The 21st century is the age of information. With the quiet transition from mechanized warfare to information warfare, information warfare has become a new type of war situation in the 21st century. Collecting, utilizing, processing, and exchanging information are crucial and decisive factors in information warfare. Tactical decision-making, decision-making transmission, and teammate communication all need to rely on information as the medium to achieve. [0003] In terms of tactical sign language, in order to meet the concealment and accuracy of silent information exchange in special combat environments, tactical sign language is usually used to communicate between various operational units of the army. For example, i...

AI Technical Summary

Problems solved by technology

[0004] However, we have noticed that in the actual battlefield environment, some sign language may be misread by the action units, which will have a certain impact on the operation. For this, there have been methods of using computer vision to interpret sign language information, but in some However, this method still has strong limitations

For example, fighting at night, in extreme weather or in scenes with many obstacles, whether it is traditional sign language gestures or computer vision recognition methods will be limited by visibility

At the same time, the way of using computer vision to recognize sign language will also affect the user's efficiency in actual combat

Images