Sign language interpreting system based on motion sensing technology and processing method

Abstract

The invention relates to a sign language interpreting system based on a motion sensing technology. The sign language interpreting system comprises a motion sensing device for detecting human gesture information, a sound input device for receiving to-be-translated voice, a sign language interpreting device for carrying out mutual translation on the human gesture information or the to-be-translated voice, a display device for cartooning the translated characters or the converted sign language and gestures, and a sound output device for broadcasting the translated voice. The invention further relates to a processing method for sign language interpreting based on the motion sensing technology. The sign language interpreting system and the processing method have the beneficial effects that the sign language can be translated into written text or voice in real time, and the voice can be translated into sign language to be displayed on the display device for assisting communication between deaf people and normal people; the motion sensing device adopts a depth scene CMOS sensor, and can accurately recognize gesture actions under complex background and illumination conditions, the light coding technology of the motion sensing device adopts continuous illumination but not pulse, so that the cost of the design scheme is reduced.

Description

technical field [0001] The invention relates to the technical field of sign language translation, in particular to a sign language translation system and processing method based on somatosensory technology. Background technique [0002] More than 20 million people in China are deaf or hard of hearing, and globally this number swells to about 360 million people. Researchers have spent a lot of time in recent years overcoming the challenges of sign language recognition. They have studied There is potential room for input sensors such as data gloves or special cameras, which, while good at recognition, are hard to wear and too expensive for widespread use. While webcams or stereo cameras can guarantee the accuracy and speed of tracking hand movements, it is difficult to handle complex backgrounds and lighting. Contents of the invention [0003] The present invention provides a sign language translation system and processing method based on somatosensory technology, which can...

AI Technical Summary

Problems solved by technology

[0002] More than 20 million people in China are deaf or hard of hearing, and globally this number swells to about 360 million people. Researchers have spent a lot of time in recent years overcoming the challenges of sign language recognition. They have studied Potential development space for input sensors such as data gloves or special cameras, which, while good at recognition, are hard to wear and too expensive for widespread use

While webcams or stereo cameras can guarantee the accuracy and speed of tracking hand movements, it is difficult to deal with complex backgrounds and lighting.

Images