Sign language interaction method, system and device and storage medium

Abstract

The invention discloses a sign language interaction method, system and device and a storage medium, and relates to the technical field of artificial intelligence. The method comprises the following steps: establishing a gesture semantic database; obtaining user gesture information, and segmenting and intercepting the user gesture information to obtain a plurality of gestures; making the gestures matched with gesture data in the gesture semantic database, and outputting semantic information corresponding to the gestures in sequence; performing semantic integration on the semantic information corresponding to each gesture to generate target gesture semantic information; acquiring and recognizing user voice information, and generating voice semantic recognition information; matching the voice semantic recognition information with semantic data in the gesture semantic database to obtain corresponding target gesture information; and according to the target gesture semantic information and the target gesture information, generating and sending corresponding interaction information to a corresponding user to complete interaction. According to the method, each gesture is independently recognized, so that the recognition accuracy is ensured, and the interaction effect is improved.

Description

technical field [0001] The present invention relates to the technical field of artificial intelligence, in particular to a sign language interaction method, system, device and storage medium. Background technique [0002] Sign language is a language used by deaf-mute people to communicate. It uses gestures to compare actions, and simulates images or syllables to form certain meanings or words according to the changes in gestures. However, due to the complexity of sign language, most normal people can master and apply it. It is obviously unrealistic to communicate with the deaf-mute with sign language, which leads to obstacles in the communication between the deaf-mute and normal people. The traditional solution is to allow deaf-mute people to communicate with normal people through text, but it has certain limitations. Text communication is limited by conditions such as reading ability and pen-and-paper writing ability. [0003] With the development of artificial intelligenc...

AI Technical Summary

Problems solved by technology

[0002] Sign language is a language used by deaf-mute people to communicate. It uses gestures to compare actions, and simulates images or syllables to form certain meanings or words according to the changes in gestures. However, due to the complexity of sign language, most normal people can master and apply it. It is obviously unrealistic to communicate with the deaf-mute with sign language, which leads to obstacles in the communication between the deaf-mute and normal people

The traditional solution is to allow deaf-mute people to communicate with normal people through text, but it has certain limitations. Text communication is limited by conditions such as reading ability and pen-and-paper writing ability.

[0003] With the development of artificial intelligence technology, more and more technologies are applied to the field of people's livelihood. Among them, people with language barriers are very eager to communicate with normal social groups through artificial intelligence technology. However, there are some problems in the sign language interaction system in the existing technology. The problem is that deaf-mute people cannot accurately identify the semantics of each gesture due to too many gestures when making gestures, resulting in insufficient accuracy and unable to achieve a good interaction effect

Images