Chinese sign language two-way translation system, method and device

Abstract

The invention discloses a Chinese sign language two-way translation system, method and device. The Chinese sign language two-way translation system comprises a sign language model base module, an image identifying module, a sign language model matching module and a forward output module. The sign language model base module is used for storing the mathematical models of standard Chinese sign languages. The mathematical model of each sign language corresponds to identification information. The image identifying module is used for identifying a human body part and the movement information of the human body part to generate a gesture model according to the human body part and the corresponding movement information. The sign language model matching module is used for acquiring identification information corresponding to a mathematical model with the matching degree higher than a preset value. The forward output module is used for outputting corresponding forward output information according to the identification information. According to the invention, a human body part and the movement information of the human body part are identified; a gesture model is generated based on the human body part and the corresponding movement information; and the gesture identification accuracy is improved through a data fusion technology.

Description

technical field [0001] The present invention relates to a sign language translation system and method, in particular to a Chinese sign language two-way translation system, method and device. Background technique [0002] Usually, deaf-mute people communicate through sign language, which requires both parties to communicate and express to understand sign language, while it takes a lot of energy and time for able-bodied people to learn sign language. Since able-bodied people usually do not deliberately learn, the communication channels between deaf-mute and able-bodied people are not smooth, resulting in very little contact between the two in society. [0003] Although there are some sign language translation systems in the prior art, which try to obtain sign language actions and convert them into text information for display, their main defects are poor recognition accuracy and unrealistic and easy-to-understand output. Contents of the invention [0004] The technical prob...

AI Technical Summary

Problems solved by technology

[0003] Although there are some sign language translation systems in the prior art, which try to obtain sign language movements and convert them into text information for display, their main defects are poor recognition accuracy and unrealistic and easy-to-understand output

Images