System and method for helping deaf-mute communicate

Abstract

A system for deaf-mute communication comprises a cloud computer and an intelligent terminal, a plurality of trained neural network models and a text-voice conversion framework are stored in the cloudcomputer, and the cloud computer bears complex calculation in the communication process; the intelligent terminal is composed of a processor, a camera, a microphone, a voice module, a communication module and a display screen, and the working modes include two communication modes of communication between the deaf-mute and a healthy person and communication between the deaf-mute using different sign languages and the deaf-mute. The invention also provides a method for deaf-mute communication. According to the invention, intelligent terminal equipment is used as a carrier, and mutual communication between healthy people and the deaf-mute and between the deaf-mute is realized based on a deep learning technology.

Description

technical field [0001] The invention relates to the field of artificial intelligence, using machine analysis technology to analyze the voice information of healthy people into sign language or the sign language of deaf-mute people into voice, and the sign language of deaf-mute people using different sign languages ​​into corresponding user sign language, thereby helping barrier-free communication between people in the above two situations. Background technique [0002] The deaf-mute is usually said to have severe deafness after birth or in early childhood, who cannot hear the sounds of the surrounding things, or who has lost the ability to speak again due to deafness. [0003] Deaf-mute people have hearing and speaking obstacles when they communicate with healthy people (with normal hearing and speaking functions), so sign language has become one of the important ways for them to receive or convey information, but because of its uniqueness, only a very small number of health...

AI Technical Summary

Problems solved by technology

[0003] Deaf-mute people have hearing and speaking obstacles when they communicate with healthy people (with normal hearing and speaking functions), so sign language has become one of the important ways for them to receive or convey information, but because of its uniqueness, only a very small number of healthy people have mastered sign language , when deaf people use sign language to communicate with the outside world, there will be certain limitations

Moreover, different countries and regions in the world have different sign language standards, so this will cause the normal communication between the deaf-mute and the deaf-mute

[0004] At present, it is used to solve the problem of deaf-mute communicating with the outside world, mainly by the deaf-mute wearing related professional equipment. For example, the sign language recognition method based on data gloves requires sign language users to wear corresponding electronic gloves, and use sensors to track finger joints, etc. Information analysis, the recognition accuracy is not high, and the wearing method of this glove is complicated, and it cannot be well extended to all deaf-mute people

Images