154 results about "Deaf mutes" patented technology

The present invention relates to a hand-held communication aid and method that assists the deaf-dumb and visually impaired individuals to communicate with each other and with normal individuals. The method enables deaf-dumb and visually impaired individuals to communicate with each other and with normal individuals on remote communication means without any hardware improvisation. The method enables face to face communication and remote communication aid for deaf-dumb and visually impaired individuals. This method requires no modifications in hand-held communication device used by normal individual.

A sign language interpretation system has a function to interconnect a deaf-mute person terminal, a non-deaf-mute person terminal, and a sign language interpreter terminal, and a function to synthesize a video / audio signal received from each terminal and to transmit a synthesized signal to each terminal in order to provide a videophone conversation service via sign language interpretation between the deaf-mute person and the non-deaf-mute person. A controller includes a sign language interpreter registration table in which the selection information and terminal number of a sign language interpreter as well as an availability flag are registered. An available sign language interpreter satisfying the selection conditions specified by a caller is selected by way of a call from the deaf-mute person or non-deaf-mute person. The terminal for sign language interpreters and the calling terminal are called and automatically interconnected.

A videophone sign language conversation assistance device includes a target imaging camera for imaging a target other than a sign language, a sign language imaging camera for imaging the sign language of a deaf-mute person, a waist fixing device for fixing the sign language imaging camera at the waist of the deaf-mute person, a video synthesizer for synthesizing the videos of the cameras, and a videophone connection device for supplying the synthesized video to a videophone terminal. The device further includes a display device for displaying the sign language and a fixing device for fixing the display device in front of the eyes of the deaf-mute person, such that the sign language video being received at the video telephone terminal is supplied to the display device. A sign language interpretation system provides a sign language interpretation service which can be used when a deaf-mute person converses with a non-deaf-mute person by using the above-described device.

The invention relates to a touch type voice input method for inputting Chinese character voice by touching or clicking a touch screen and a touch type voice input device. Buttons at the selection side of a consonant section or rolling wheels to control the touch screen to display consonant letters are arranged on a machine body of the device, touch or click selection areas of consonants of the consonant section, initial letters of vowels (or single vowel letters), residual parts of the vowels, tones, and the like, are arranged on the touch screen, an operator can rapidly input the expected Chinese Pinyin and the tone by using the buttons (or rolling wheels) to carry out the touch operation of the specific area of the touch screen, and a system can exclusively and accordingly determine voice data of the expected Chinese Pinyin in a standard voice database or a user voice database, thereby realizing the touch or click type rapid input of the Chinese character voice. The device can overcome the difficulties that the existing communication tool is difficult to be used by deaf-mutes, patients with aphonia, people with unclear pronunciation and infirm elderly people and overcome the difficulties that the communication tool is inconvenient to be used at the specific places which need to be quiet, at the noisy places or at the occasions needing to protect the privacy of personal calls, and the device is characterized by strong real-time property and simple operation.

The invention relates to a portable utility-typed sign language recognition vocal device which comprises three parts of a finger bending acquisition glove, a single chip and a voice circuit. The finger bending acquisition glove sends voltage signals which are generated by the finger bending degree according to the action of fingers and voltage signals which are generated by the acceleration of the hand movement to a simulation input port of the single chip. The simulation and the digital conversion are carried out on the voltage signals generated from the finger bending degree and the voltage signals generated from the acceleration of the hand movement by the single chip. The data processing is carried out on digital signals obtained by the conversion to give the kind information of the current sign language. Thus, the voice circuit is driven to vocalize. The portable utility-typed sign language recognition vocal device is beneficial for improving the living, studying and working conditions of deaf-mute disabled, so that normal people can provide better services for the disabled, and the deaf-mute disabled, especially deaf-mute people with low education level can communicate with normal people by sign language.

The invention discloses a pinyin-to-character conversion device and a method for a mobile phone. By arranging a pinyin-to-character conversion module, a character display module, a character input module, a character-to-pinyin conversion module and a function control module, the device realizes the two-way conversion from a sound signal to a character signal and from the character signal to the sound signal, and solves the problem of failing to utilize the mobile phone to perform speech information communication under special conditions (particularly deaf mutes). The device is suitable to be applied to a mobile phone special for the deaf mutes.

The invention provides a gesture sound making talking glove for the deaf and dumb. The gesture sound making talking glove for the deaf and dumb comprises a glove body, digital gyroscopes arranged on finger sleeves of the glove body, a digital gyroscope arranged on the hand back portion of the glove body, a sound making device and a control device, wherein the control device is in signal connection with the digital gyroscopes and the sound making device and receives signals detected by the digital gyroscopes, corresponding characters are found out in set codes according to acquired finger action signals, the found characters are organized into sentences, and the sound making device is controlled to make sounds according to the organized sentences. The glove has the advantages that gesture signals are acquired through the six gyroscopes, the corresponding characters are found out through the control device according to the gesture signals, and therefore the sentences formed by the characters can make sounds, the glove is convenient for the deaf and dumb to use, and great convenience is brought to the deaf and dumb.

The invention discloses special communication glasses for deaf-mutes. The glasses comprise a glasses frame, a glasses mounting and lenses. The lenses are provided with transparent displays. The glasses frame is provided with a speaker and a recorder. The glasses mounting is provided with a controller and a power module. According to the special communication glasses for deaf-mutes, the glasses frame is provided with a voice acquisition module to acquire voice signals when people speak, a single chip analyzes and processes the signals, which are converted to corresponding sign language information, and the sign language information is shown in the transparent display arranged on the lenses. When a deaf-mute makes a sign, the recorder arranged on the glasses frame can record the sign language posture of the deaf-mute in a real-time mode, converts the posture to corresponding voice information, and outputs the information through the speaker, at the same time, text information is shown on the display, and therefore, the communication problem between a normal person and a deaf-mute is solved.

The invention provides a sign language interaction method and device and a computer medium, and relates to the technical field of artificial intelligence, for solving the problem of how to smoothly communicate with deaf-mutes. The sign language interaction method comprises the steps: obtaining a to-be-recognized sign language video; performing semantic text recognition on the to-be-recognized signlanguage video to obtain a semantic text expressed by the to-be-recognized sign language video; obtaining a response text of the semantic text; and converting the response text into a response sign language animation video taking a preset animation image as a main body. According to the sign language interaction method, the response text displayed to the deaf-mute is converted into the response sign language animation video, and the deaf-mute can know the semanteme of the response text according to the sign language of the preset animation image, so that the deaf-mute can smoothly communicatewith the deaf-mute.

The invention provides an interpreting glove for the deaf and dumb sign language and an interpreting method thereof. The interpreting glove comprise a glove body which is provided with a wrist guard, a palm sleeve and five finger sleeves; the texture of the glove body satisfies the following condition that: when the interpreting glove is worn, the inside surface of the glove body is fully attached to a hand of a human body; a joint strain sensor which is used for sensing a bending angle of a joint is respectively arranged at knuckles corresponding to each finger sleeve and carpal joints corresponding to the wrist guard; the joint strain sensors are electrically connected to an interpreting module which is used for determining the sign language according to bending degrees of each joint; and the interpreting module is electrically connected with a voice output module. The glove can instantly interpret the deaf and dumb sign language into intuitive voice signals, so as to promote the communication between the deaf and dumb and the ordinary.

The invention discloses a deaf-mute flashlight bulb doorbell, characterized by comprising a button switch and a red flashlight bulb which are orderly connected via wires and are connected to a power supply. The doorbell for deaf-mutes is used by arranging the red flashlight bulb in a place where the deaf-mutes can see. When in use, the keystroke switch is pressed, and the red flashlight bulb is lighted, thereby, a doorbell indication function is realized for the deaf-mutes after the deaf-mutes see the lighted flashlight bulb.

The invention provides a communication device for deaf-mutes. The communication device comprises a main control unit, a touch display screen, a memory card, a microphone and a loudspeaker, wherein the main control unit is connected with the touch display screen, the memory card, the microphone and the loudspeaker; the micro control unit converts voice frequency obtained from the microphone into a cartoon sign language and text, and the cartoon sign language and text are output on the touch display screen; or, the micro control unit obtains text information or sign language cartoon from the touch display screen and converts into voice, and the voice is output from the loudspeaker. Deaf-mutes can conveniently communicate with ordinary people through the communication device; the device is also provided with a phonetic sign language communication button, a voice play button, a writing exercise button and a sign language corpora button, and the use functions of the device are expanded in different aspects, so that the device is more convenient to use.

The invention provides a deaf-mute communication intelligent assistant system. The system comprises a left-hand collecting and transmitting layer and a right-hand collecting and transmitting layer. The left-hand collecting and transmitting layer and the right-hand collecting and transmitting layer are connected with an application layer. The application layer is connected with a cloud management layer. The invention further discloses a method using the deaf-mute communication intelligent assistant system for communication. The deaf-mute communication intelligent assistant system provided by the invention can effectively promote communication between a deaf-mute and a hearing-listener, provides the deaf-mute with personalized sign language customization, sign language dictionary query, classroom synchronous learning and other extended functions, and has the advantages of simple structure, convenient wearing and being user-friendly.

The invention discloses a bus arrival reminding system for the deaf and the mute. The system comprises a gps (global positioning system) positioning module, a first control module, an arrival signal sending module, a plurality of wireless network base stations in a bus and an arrival reminding mobile terminal, wherein the gps positioning module, the first control module and the arrival signal sending module are arranged in the bus; the first control module is connected with the gps positioning module and the arrival signal sending module; the wireless network base stations in the bus are distributed in the bus to form a wireless network in the bus; the arrival reminding module comprises an arrival signal receiving module, a second control module and a vibration reminding module; the second control module is connected with the arrival signal receiving terminal and the vibration reminding module; and the arrival signal receiving module is connected with the arrival signal sending module through the wireless network in the bus. When the bus is going to arrive at the station, the system reminds the deaf and the mute in the vibration way, so the deaf and the mute can easily take a bus just like a healthy person, and the arrival state of the bus does not need to be concerned at every moment.

The invention discloses a simultaneous interpretation method and device, electronic equipment and a storage medium. The simultaneous interpretation method comprises the following steps: acquiring first voice data to be processed; translating the first voice data to obtain a first translated text; generating first video data by utilizing the first translation text, wherein the first video data is sign language video data; or collecting second video data to be processed, wherein the second video data is sign language video data; performing sign language recognition on the second video data to obtain a sign language recognition result; translating the second video data by utilizing a sign language recognition result to obtain a second translated text; and utilizing the second translation textto generate second voice data. By adopting the scheme of the invention, simultaneous interpretation between the deaf-mutes of different languages and the healthy people of different languages can berealized, and the communication efficiency between the deaf-mutes and the healthy people is improved, and the deaf-mutes and the healthy people around the world can communicate without barriers.

The invention provides an electronic skin and multi-sensor fusion-based sign language identification system. A front-end sensor module is used for collecting finger motion information, wrist motion information and arm motion information to form hand motion information; an internal integrated processor module performs decoding translation on the received hand motion information; and a sign languagetranslation result display module is used for display. A communication bridge is established for communication between deaf-mutes and normal persons; a signal collection device only uses electronic skin and a wristband, seen from appearance, so that the interference on a user is smaller, and the signal collection device is suitable to be worn for a long time and has the characteristics of flexibility, low cost and the like; a wearable scheme is adopted, so that the influence of external environment illumination and background complexity is avoided; the front-end sensor module captures a signal more directly and more precisely; in the aspect of translation result display, a T shirt capable of displaying texts is introduced, so that convenience is provided for a scene inconvenient for speaking; and the system also can be used in the fields of virtual reality and the like.

The invention discloses a deaf-mute alarm help-seeking system. The system at least comprises an alarm help-seeking mobile phone and a network alarm help-seeking management platform which supports the alarm help-seeking mobile phone for realizing alarm help-seeking. The alarm help-seeking mobile phone is internally provided with an alarm help-seeking app of a client, and through each function module of the alarm help-seeking app of the client, an alarm help-seeking request is brought forward for the network alarm help-seeking management platform; and the alarm help-seeking app of the client displays response information of the network alarm help-seeking management platform on the mobile phone in a dactylology video mode so as to realize direct communication with deaf-mutes. According to the invention, through connection between the mobile phone client app and the network alarm help-seeking management platform, the deaf-mutes can send alarms to seek help in real time in a standardized mode so as to obtain the help of public safety service departments timely; in particular, the communication mode in a whole alarm help-seeking process automatically realizes conversion between the dactylology video and a text; and through such a mode, the purpose of realizing alarm help-seeking of the deaf-mutes is achieved.

The invention discloses a language recognition system used for the deaf and the dumb. The language recognition system comprises skin sensors, a data acquisition module, a data analysis module, a master control module, a model matching module and a voice module, wherein the skin sensors, the data acquisition module, the data analysis module, the master control module, the model matching module andthe voice module are electrically connected in sequence, the skin sensors comprise an upper lip sensor, a lower lip sensor and a throat sensor, and the language recognition system further comprises akey module, a model library module, a voice recognition module and a display module. The invention further provides a language recognition method. The invention provides the system which can be carried by the deaf and the dumb and realizes direct communication with normal people through language, the information processing conversion can be carried out rapidly, the in-depth learning function is provided, the expression habits of users can be gradually adapted, and certain instantaneity and practicability are also available.

The embodiment of the invention provides an interaction method and device, terminal equipment and a storage medium. The method comprises the steps of obtaining sign language information in a to-be-processed video when a current mode of terminal equipment is a sign language recognition mode; identifying the sign language information, and obtaining reply sign language information corresponding to the sign language information; generating action parameters of the virtual intelligent customer service based on the reply sign language information; based on the motion parameters, driving the motion of the virtual intelligent customer service to generate a reply image sequence, the reply image sequence being composed of multiple frames of continuous behavior images generated by driving the virtualintelligent customer service; and generating and outputting a reply video for the to-be-processed video based on the reply image sequence. According to the invention, the sign language information inthe to-be-processed video is recognized, the reply sign language information corresponding to the sign language information is obtained, and the action parameters of the virtual intelligent customerservice are generated based on the reply sign language information, so that the deaf-mute can interact with the virtual intelligent customer service through the sign language.

The invention relates to a Chinese initial and final visualization method based on a combination feature, which comprises the steps of: pre-processing a voice signal; calculating the frame number of the pre-processed voice signal as a length feature, representing a resonance strength feature by correlation of a frequency domain peak amplitude and an average amplitude to obtain a resonant peak feature value of each frame signal, and calculating robust feature parameters WPTC1-WPTC20 and PMUSIC-MFCC1-PMUSIC-MFCC12; respectively encoding image width information and image length information by the length feature and the resonance strength feature; encoding the main color information by the resonant peak feature; enabling 32 feature parameters to serve as input of a neural network and the output of the neural network to be corresponding pattern information, wherein the output corresponds to 23 initials and 24 finals sequentially; and fusing the width, length, main color and pattern information in an image and displaying the image on a display screen. The Chinese initial and final visualization method has the advantages that the Chinese initial and final visualization method based on the combination feature is helpful for deaf-mutes for speech training to establish and improve auditory perception and form correct speed reflection so as to recover the speed function of the deaf-mutes.

The invention discloses a novel hearing-impairment and deaf-mute crowd assist safety and information communication device. The device comprises artificial muscle gloves, arm rings, a supporting waistcoat and auxiliary glasses. The artificial muscle gloves are put on the hands of a wearer; the arm rings sleeve the arms of the wearer and are close to the wrist parts; the supporting waistcoat is puton the upper body of the wearer; the auxiliary glasses are put on the eye parts of the wearer. The supporting waistcoat is a basic part of the whole system, and the artificial muscle gloves, the arm rings and the auxiliary glasses can be separately used or combined in use or matched with the supporting waistcoat in use. Through a group of wearable devices, various kinds of outside information canbe received, and the wearer is promoted through vibration encoding, especially, gesture and gesture language information is identified and transferred through the artificial muscle gloves so as to communicate under visionless conditions, the ability that hearing-impairment and deaf-mute crowds receive the outside information and feel the external environment is improved, the life safety and convenience are improved, and actual use requirements are met.

The invention discloses a deaf-mute sign language interaction method and a deaf-mute sign language interaction device. The method comprises steps: sign language image information is acquired from a first wearable device, and sign language features are extracted from the sign language image information; according to a sign language word mapping library and a sign language speech mapping library, the word information and the speech information corresponding to the sign language features are determined; the word information and / or the speech information corresponding to the sign language image information are / is displayed on the first wearable device; environment speech is acquired from a second wearable device, and environment word information and environment sign language information corresponding to the environment speech are determined according to a speech word mapping library and a sign language speech mapping library; and the environment word information and / or the environment signlanguage information are / is displayed on the second wearable device. The self learning-type method and the device can enable a deaf-mute to communicate with other person in a barrier-free and smoothmode.

The invention discloses a deaf language translation machine, which comprises a deaf-mute client, a normal person client, and a server in communication connection with the deaf-mute client and the normal person client, wherein a deaf language database is configured on the server, and sign language information of deaf language and text information corresponding to the sign language information are stored in the deaf language database; the deaf-mute client comprises a deaf-mute input module and a deaf-mute output module, the deaf-mute input module is used for collecting input information of a deaf-mute, and the deaf-mute output module is used for outputting input information of a normal person; and the normal person client comprises a normal person input module and a normal person output module, the normal person input module is used for collecting input information of the normal person, and the normal person output module is used for outputting input information of the deaf-mute. Throughthe deaf-mute client, the normal person client and the server which are in communication connection, the normal person client and the server, the deaf-language database is configured on the server, and communication between the deaf-mute and the common normal person is achieved.

The invention provides a deaf-mute communicator, comprising an information input module, a display module, a master module and a Bluetooth module. Users can input the communication related information by the information input module. The display module is used to display the data transmitted from the master module. The master module is applied to transmit the data from the information input module to the display module, code the data information and transmit to the Bluetooth module, decode the data information from the Bluetooth module and transmit to the display module. The Bluetooth module is for the establishment of the connection with the cell phone to realize the data transmission with the cell phone. The invention realizes the connection between the deaf-mute communicator and the cell phone through the Bluetooth interface, which greatly enhances the compatibility of the communicator.

The invention discloses a method for realizing words exchange in the telephone system, wherein the speech recognition is realized by a words circuit, a words-voice conversion circuit, a display module and a microcontroller, the circuit 10 is used for converting voice in the telephone reception channel into words, the circuit 20 is used to transform the words content to be expressed into voice andtransmit it to the telephone transmitting channel, the module 40 is used to display the words in circuit 10 and the words to be sent by the local telephone set, the microcontroller 30 is used to control the circuit 10, 20 and 40. The method by the invention can be applied to the phone calls between the blinds and deaf, or between the blinds and deaf and the normal people. íí

The invention discloses a sentence and speech conversion device for the deaf to communicate with the outside world, which comprises a deaf end device, an advanced RISC machines (ARM) microprocessor and a speech end device, wherein the deaf end device comprises a deaf input device and a deaf output device, and the speech end device comprises a speech output device and a speech input device; and the speech output device comprises a speech synthesis chip, a post-processing circuit and a speaker which are sequentially connected, and the speech input device comprises a speech recognition chip, a pre-processing circuit and a transmitter which are sequentially connected. In the sentence and speech conversion device for the deaf to communicate with the outside world, the common and easy-to-get hardware configuration is adopted, so that the whole conversion device has a simple structure; and meanwhile, information processing is carried out by more sophisticated prior art, so that the conversion and transfer of information are quick and accurate and are not affected by individual factors of users, and the normal communication barrier between the deaf and the non-deaf can be effectively eliminated.

The invention discloses a sign language recognition system and method based on space-time semantic features. The sign language recognition system comprises a video data acquisition module, a video data preprocessing module and a sign language recognition module, wherein the video data acquisition module is used for acquiring sign language video data; the video data preprocessing module preprocesses the video data; and the sign language recognition module performs sign language recognition and outputs a prediction result. According to the sign language recognition system and the method, the semantic gap between the sign language image data and text data is eliminated, the convenient communication with the deaf-mute is realized, and the frontier neural network algorithm is used as a translation tool, so that the correctness of translation is ensured. In addition, the sign language recognition system and the method can further be used as a medium for man-machine interaction, analysis is performed through continuous gestures of the user, and instruction control is performed on intelligent equipment.

The invention relates to the technical field of unmanned vehicles, automatic driving and unmanned driving, and provides an automatic driving vending truck and a man-machine interaction method thereof.The man-machine interaction method comprises the steps of recognizing a purchasing user and a position of the purchasing user; paying by the purchasing user; identifying a hand position of the purchasing user according to an image acquired by a camera in real time; sending an article purchased by the purchasing user to the hand position of the purchasing user; and prompting the purchasing user tolift the hand or open a palm through voice, and adjusting a coordinate of the sent article through the image acquired by the camera in real time till that the purchasing user acquires the article purchased by the purchasing user. The man-machine interaction method provided by the invention is suitable for shopping of various special crowds (such as blind people, deaf-mutes and disabled people with mobility difficulties), practicability of the automatic driving vending truck is improved, non-contact shopping is realized, and public health safety is improved.

The embodiment of the invention discloses a data processing method and a data processing device which are used for improving the accuracy of language information recognition in the information interaction process between the deaf-mute and the ordinary people. The data processing method disclosed by the embodiment of the invention comprises the steps that the data processing device obtains main data and auxiliary data of a first data acquisition device in the current session, wherein the main data and the auxiliary data are data which is complementary in space and / or content, the current session comprises at least two data acquisition devices, and the first data acquisition device is any one of the at least two data acquisition devices; and the data processing device performs fusion recognition on the main data and the auxiliary data to obtain corresponding target data.

The invention discloses an instant message processing method, server and system combined with the gesture language. In order to solve the problem that when instant messages are processed between an average person and a deaf-mute person, the efficiency is low, the method comprises the steps that user login information which is sent by all clients and contains user identity information is received, and according to the user identity information, the user identity of each client is recognized; according to the user identity of each client, the clients are matched with the instant message types capable of being received by the clients; instant messages sent by a sending client are received, and then according to the user identity of a receiving client, the instant messages are directly sent to the receiving client, or the instant messages are converted into a corresponding instant message type capable of being received by the receiving client and then sent to the receiving client. By means of the method, when instant messages are processed between an average person and a deaf-mute person, the efficiency is improved.