Method and system for sign language conference based on gesture recognition

Abstract

The invention discloses a method and a system for sign language conference based on gesture recognition, comprising: performing the acquired gesture data by converting them into the data types saved in an open type tree shape gesture dictionary; comparing the data processed by a gesture processing sub-system and the data in the open type tree shape gesture dictionary; if there exists corresponding gesture information in the open type tree shape gesture dictionary, then letting the gesture processing sub-system deal with the data information; and otherwise, using a fuzzy matching algorithm: converting the data transmitted from a gesture comparing and verifying sub-system into corresponding text information and transmitting the text information to a multi-media sub-system. According to the invention, the gesture sensing and recognizing techniques are combined with a traditional conference system, which solves the problem faced by the people with speaking and hearing to communicate with ordinary people at a conference to realize barrier-free communications. With the method and the system, the costs for sign language translators could be saved; therefore, the system is highly practical in use.

Description

technical field [0001] The invention relates to the field of sign language conferences, in particular to a sign language conference method and system based on gesture recognition. Background technique [0002] According to the total population of my country in the sixth national census and the second national sample survey of disabled people, it is estimated that there were 20.54 million people with hearing disabilities in my country at the end of 2010. [0003] Gesture recognition technology mainly uses various sensors such as image sensors and infrared LEDs to collect three-dimensional images and gesture information, and converts them into data that can be processed by computers through the internal processor. Currently, it is mainly used in home entertainment, smart driving, smart Wearables, 3D modeling, auxiliary medical care and other fields, such as in the medical field, we can display various organs of the human body on the screen through 3D models, and students can o...

AI Technical Summary

Problems solved by technology

[0004] At present, my country's conference system technology is relatively mature, which increases the speaker's control over the conference, and at the same time fully expresses the conference information through different devices, which deepens people's understanding of the conference content and improves the overall conference efficiency. However, there is no one The conference system is oriented to the deaf-mute group, and the conference object is the meeting between the deaf-mute and ordinary people. Therefore, the sign language conference system based on gesture recognition is very necessary for the deaf-mute group.

Images