The invention relates to a sign language interpreting, displaying and sound producing
system based on electromyographic signals and
motion sensors. The sign language interpreting, displaying and sound producing
system comprises a
gesture recognition subsystem and a semantic displaying and sound producing subsystem. The
gesture recognition subsystem comprises the multi-axial
motion sensors and a multi-channel
muscle current acquisition and analysis module, the
gesture recognition subsystem is put on the left arm and the right arm of a user, and the original surface electromyogram signals of the user and motion information of the arms of the user are obtained; gestures are differentiated by
processing the electromyogram signals and data of the
motion sensors. The displaying and sound producing subsystem comprises a
semantic analyzer, a voice control module, a
loudspeaker, a displaying module, a storage module, a communication module and the like. According to the sign language interpreting, displaying and sound producing
system, by the adoption of the mode recognition technology based on the electromyographic signals of the double arms and the data of the motion sensors, the gesture recognition accuracy rate is increased; through the combination of the semantic displaying and sound producing subsystem, interpreting from commonly-used sign language to voice or text is achieved, and the efficiency of
direct communication between people with language disorders and
normal people is improved.