Computer assisted hand language communication method under special session context

Abstract

The invention discloses a computer assisted hand language communication method under special session context, which comprises the following steps: setting motion freedom range of each joint of a bone model through building the virtual bone model and special session context vocabulary database, and building the communication response corresponding relation of each joint motion of a virtual human and special vocabulary; identifying hand language information by picture processing and biological specificity through acquiring the hand language information sent by a dumb person to obtain the meaning of the acquired hand language information, converting the hand language sent by the dumb person into characters or language for informing an ordinary person, otherwise, automatically matching the corresponding answer speech after obtaining the character information input by the ordinary person or obtaining the meaning of the hand language sent by the identified dumb person, and processing the character information or answer speech and informing the dumb person by the hand language conversion, and realizing the session communication between the ordinary person and the dumb person under special occasion. The method can realize the communication between the ordinary person and the dumb person under special occasion.

Description

technical field [0001] The invention belongs to the technical field of image biometric feature recognition, and relates to a computer-aided sign language communication method in a specific conversation scene. Background technique [0002] In real life, normal people can obtain both visual information and auditory information, while deaf people can only use visual information. Normal people and the deaf-mute usually use sign language as a medium to communicate, but most normal people know little about sign language and cannot communicate with the deaf-mute at all, making communication barriers between normal people and deaf-mute difficult to overcome . Contents of the invention [0003] The purpose of the present invention is to provide a computer-aided sign language communication method in a specific conversation scene, which is used in a specific scene with limited vocabulary to assist normal people and deaf-mute people in conversation and communication. [0004] The te...

AI Technical Summary

Problems solved by technology

Normal people and the deaf-mute usually use sign language as a medium to communicate, but most normal people know little about sign language and cannot communicate with the deaf-mute at all, making communication barriers between normal people and deaf-mute difficult to overcome

Images