17 results about "Deaf mutes" patented technology

The invention discloses an intelligent sign language auxiliary communication method. The method comprises the following steps: acquiring video data and audio data of an environment; aI intelligent analysis is carried out on the audio and video data, the video data and the audio data are preprocessed, the identity of each person in the environment is identified from the preprocessed data, independent voice of each person is separated from the multi-sound-source mixed audio, the spatial position of a speaker is positioned, and the timbre feature of each separated voice stream is extracted and marked; performing cross-modal matching on the character, the voice and the timbre, converting the voice into character information, generating a corresponding sign language animation according to the character information, and sending the character information and the sign language animation to the deaf-mute terminal; and sending the text information input by the deaf-mute to the speaker terminal. In a multi-person dialogue scene, the deaf-mute can clearly distinguish different speakers and corresponding speaking contents through the terminal, the real-time performance of communication is ensured, the deaf-mute can accurately understand the intention of the speaker, and the communication efficiency is improved.

The application discloses a kind of tactile perception system and its use method, tactile perception system includes: information acquisition module, analysis module and output module.The use method of tactile perception system includes: obtaining information for analysis;According to the information obtained, analysis is carried out, and the information that needs to be output to user is obtained;The information that needs to be output to user is converted into tactile perception signal, and the tactile perception signal is expressed information by contacting the position of user body, and at least one of contact type, shape, contact area, action, temperature and pressure;Output tactile perception signal.Through the tactile perception system and its use method of the application, people can better utilize tactile to perceive external information, enhance the effect of perception, and can help blind, deaf-mute or help normal people in the environment that is not conducive to vision and hearing to improve the efficiency of walking, searching, using computer and intelligent device / intelligent system etc..

1. Name of the product in this design: Sign Language Translator. 2. Purpose of this design: A sign language interpretation device to assist deaf and mute people in daily life and meetings. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: 3D view 1.

The invention belongs to the technical field of interaction, and discloses a deaf-mute two-way interaction method, which comprises the steps of collecting voice of a dialogue person, converting the voice into first character information, visually displaying the first character information to a deaf-mute user, or converting the first character information into sign language actions or sign language schematic diagrams, displaying the sign language actions or sign language schematic diagrams to the deaf-mute user, capturing lip shape images of the dialogue person, and displaying the lip shape images to the deaf-mute user. Third character information is generated through matching based on the lip language database, the third character information is matched with the first character information to determine that the first character information is from the target dialogue person, a hand action image of the deaf-mute user is captured, the hand action image is converted into second character information, and the second character information is sent to the deaf-mute user. According to the method, the voice of the dialogue person is collected, the voice is converted into characters or sign language actions, the characters or sign language actions are visually displayed to the deaf-mute user, and the sign language actions are converted into the characters based on the sign language database by collecting the sign language actions of the deaf-mute user and are played in the form of voice.

The doorbell comprises a transmitting module, a receiving module, a function selection module and a master control module, the transmitting module is used for transmitting a radio frequency signal, the receiving module is used for outputting a wireless starting signal according to the radio frequency signal, the function selection module is used for selecting a deaf-mute function or a blind function, and the master control module is used for controlling the deaf-mute function or the blind function. And the main control module is used for executing lamp-on and horn-off operation according to the deaf-mute function and executing horn-off operation according to the blind function. According to the doorbell, different function modes are switched through the function selection module to meet the use requirements of the deaf-mute blind; for the deaf-mute, the main control module carries out the operation that the lamp is turned on and the loudspeaker does not sound, so that the bright light reminds the deaf-mute that someone comes to visit; and for the blind person, the main control module prompts the blind person to visit through loud sound by executing the operation that the loudspeaker is not turned on, so that not only is the use flexibility of the doorbell improved, but also the independent living ability and living quality of the blind person can be improved.

The invention relates to the technical field of medical first-aid equipment, and discloses a first-aid pager automatic alarm system based on multi-modal perception, the system is internally provided with eight modules, a multi-modal perception module collects user state data online, a special group data collection module pays attention to information of three types of crowds of deaf-mute, blind and cognitive impairment, and a first-aid pager alarm module is provided with a first-aid alarm module and a second-aid alarm module. The data analysis module calculates a session key, a permission compliance rate, a fault influence degree and a success rate of simplified operation of a cognitive impairment, the sensitive information encryption protection module performs end-to-end encryption on collected data, the fine-grained permission management and control module performs dynamic access control judgment, the distributed fault self-healing module performs self-healing strategy judgment, and the distributed fault self-healing module performs self-healing strategy judgment. The special crowd interaction optimization module performs interaction strategy evaluation, and the instruction execution module receives encryption, authority, self-healing and interaction optimization instructions issued by all the modules, uniformly controls underlying hardware and network resources to complete actions after priority arbitration, and returns an execution result log to form a closed loop.

The invention relates to the technical field of computer vision, in particular to a sign language recognition method and system. The method comprises the following steps: acquiring an initial sign language prediction text based on multiple continuous to-be-recognized sign language pictures of a user after preprocessing; and if the text is vacant, outputting the probability that the vacant part belongs to each candidate word through the linear projection layer, and taking the probability as the visual confidence. When the number of vacancies is smaller than a preset value, calculating semantic similarity between the candidate words and the initial sign language prediction text as text confidence; on the contrary, the initial sign language prediction text and the initial sign language prediction text corresponding to multiple frames before and after are spliced into a total prediction text, and then the semantic similarity is calculated to obtain the text confidence coefficient. And obtaining a dynamic adjustment factor in combination with the definition of the sign language picture, fusing the factor with the two confidence coefficients to obtain a target confidence coefficient, and complementing the vacancy with the highest confidence coefficient to obtain a final sign language recognition result. The sign language semantic recognition precision is greatly improved, and the immersion of interaction with the deaf-mute is enhanced.

This invention provides a sign language recognition and interaction system based on edge-cloud collaboration, belonging to the field of artificial intelligence technology. It includes an image acquisition module for acquiring images of gestures from deaf and mute individuals and extracting keyframe images from these images; a client processing module, wirelessly connected to the image acquisition module, for receiving keyframe images, extracting key hand points from the keyframe images, and transmitting the extracted key hand point sequence to the cloud; a cloud processing module for processing the transmitted key hand point sequence using a sign language recognition model, recognizing the gestures as text based on the key hand point sequence; the cloud processing module also transmits the text to the client processing module, which in turn performs voice playback of the text and simultaneously acquires the voice response from a hearing person, converting the voice response into text for display. This system improves the portability and accuracy of sign language translation, reduces production costs, and improves the quality of life for deaf and mute individuals.

The application provides an order reminding bracelet and a take-out order receiving assembly. The order reminding bracelet is wirelessly connected with an order receiving device. The order reminding bracelet comprises a main body and a wristband connected with the main body. The main body comprises a reminding lamp and / or a vibration assembly. One of the order reminding bracelet and the order receiving device is provided with a control device, which controls the reminding lamp to perform light reminding and / or the vibration assembly to perform vibration reminding according to take-out order information received by the order receiving device. The order reminding bracelet of the embodiment of the application can effectively improve the timely response to the take-out order through light reminding and / or vibration reminding, avoid the occurrence of the situation of missed order and delayed order receiving, and is especially suitable for the use of deaf-mute personnel to solve the problems of missed order and delayed order receiving caused by the inability to hear sound reminding due to hearing defects. Meanwhile, the order reminding bracelet is convenient to wear and carry, can ensure that the order reminding can be monitored at any time, and can avoid the occurrence of the situation of missed order and delayed order receiving.

The invention discloses a sign language translation device and method and a storage medium. The sign language translation device comprises a controller, a first display screen, a camera, a second display screen and a microphone, and the first display screen, the camera, the second display screen and the microphone are all electrically connected to the controller; wherein the first display screen faces the deaf-mute and is used for the deaf-mute to watch information; the second display screen is arranged facing the healthy hearing person and is used for the healthy hearing person to watch information; the camera is used for collecting sign language actions of the deaf-mute, the controller processes sign language information collected by the camera so that corresponding characters can be displayed on the first display screen and the second display screen at the same time, the microphone is used for collecting voice information of a healthy listener, and the controller further processes the voice information collected by the microphone so that the voice information can be displayed on the first display screen and the second display screen at the same time. And displaying the corresponding sign language video on the second display screen.

The present application relates to the technical field of computer vision, and especially relates to a sign language recognition method and system. The present application obtains initial sign language prediction text based on the pre-processed continuous multiple frames of sign language pictures to be recognized of a user; if the text has a vacancy, the probability that the vacancy part belongs to each candidate word is output by a linear projection layer as visual confidence. When the number of vacancies is less than a preset value, the semantic similarity of the candidate word and the initial sign language prediction text is calculated as text confidence; otherwise, the initial sign language prediction text and the corresponding initial sign language prediction texts of the multiple frames before and after the initial sign language prediction text are spliced into a total prediction text, and the semantic similarity is calculated to obtain text confidence. A dynamic adjustment factor is obtained in combination with the clarity of the sign language picture, the target confidence is obtained by fusing the factor and the two kinds of confidence, the highest one is taken to complete the vacancy, and the final sign language recognition result is obtained. The present application greatly improves the sign language semantic recognition accuracy and enhances the immersion of interaction with the deaf-mute.

This invention discloses an accessible graphic and text-based emergency call system for deaf and mute individuals, comprising: a first emergency call signal generation module for receiving a first emergency call signal from a silent user; a first emergency call signal response module for responding to the first emergency call signal and triggering a plurality of distributed matching requests in parallel; the plurality of matching requests include: a first matching request, a second matching request, and a third matching request; a distress signal generation module for responding to the distributed matching requests to generate a plurality of distributed distress signals; a signal encapsulation module for encapsulating the plurality of distributed distress signals to generate a distress data packet; and a data packet transmission module for transmitting the distress data packet according to the current transmission frequency. The graphic and text-based emergency call system of this invention generates multi-signal encapsulated distress data packets, enabling rescuers to quickly obtain the specific situation, urgency level, and location signal of the silent user from the distress signals, thus making a more efficient rescue response.

The invention relates to the technical field of computers, in particular to a sign language recognition and display method and system in a double-screen all-in-one machine, and the method comprises the steps: collecting sign language postures made by a deaf-mute through a camera, and obtaining to-be-recognized sign language data; after preprocessing the sign language data to be recognized, inputting the sign language data to be recognized into the AI intelligent sign language recognition model to output first semantic information corresponding to the sign language data to be recognized; converting the first semantic information into voice content, and playing the voice content through a loudspeaker; collecting voice data of a user through a microphone to obtain voice data to be recognized; preprocessing the to-be-recognized voice data, and inputting the preprocessed to-be-recognized voice data into the voice automatic recognition model to output second semantic information corresponding to the to-be-recognized voice data; and generating a sign language expression model based on the second semantic information, driving the digital person to generate a sign language animation based on the sign language expression model, and displaying the sign language animation on a display screen. The method can solve the problems that in the communication process of the deaf-mute and an ordinary person, the communication efficiency is low and translation is inconvenient due to the fact that the ordinary person does not grasp sign languages generally.

The invention discloses a rescue communication method for a deaf-mute trapped elevator car, a deaf-mute rescue communication system is constructed, the system comprises a monitoring room part and an elevator part, the monitoring room part comprises a monitoring room computer, the monitoring room computer is provided with monitoring room software, and the elevator part comprises a car monitor and an elevator main control board. The lift car monitor is installed on an operation box of a lift car, the lift main control board is installed on a lift control cabinet, the lift car monitor is connected with the lift main control board through a CANBUS of a traveling cable, and lift car monitoring software is installed on the lift car monitor. The YES button, the NO button, the lift car help seeking button and the microphone are installed on the lift car operation box, and the loudspeaker and the second camera are installed on one side of the lift car operation box. When the trapped person is a deaf-mute person, rescue communication with the deaf-mute person can be carried out, so that the state of the deaf-mute trapped person can be known in time, and the deaf-mute trapped person can be pacified.

This innovation presents innovative device equipped with AI system configured to assist deaf-mute individuals to conquer their communication barriers with hearing and speaking individuals without human assistance performing sign language. The AI system is developed and integrated to convert spoken language into sign language or text, sign language into synthesized speech, automatically detect a preferred language, distinguish speakers and speaker's language to convert spoken language into sign language or text, and adjust the speech output language accordingly. The device comprises a wearable frame, touch button, AI system, micro video camera, microphone, speaker, transparent display system, rechargeable battery and / or solar panel to supply energy, Wi-Fi system and software interface. This present innovative device equipped with AI system assists mute and / or deaf individuals to conquer their communication barriers through AI-driven converting sign language into synthesized speech and spoken language into sign language or text.

The application discloses a kind of intelligent glasses for deaf-mute communication, including glasses body, visual translation module, speech translation module, call translation module and processing unit are equipped in body, processing unit is electrically connected with each translation module.Speech translation module contains sign language acquisition unit and speech playback unit, can be converted to natural speech by the identification model of the sign language of wearer, realize two-way translation.Visual translation module contains sound acquisition unit and near-eye display unit, can be converted to caption or environmental prompt symbol projection display after processing to external sound.Call translation module contains Bluetooth communication module, miniature vibration motor and call button, after connecting mobile terminal, can realize call speech to caption, sign language to speech two-way call translation, the function of the present application realizes speech conversion text, sign language conversion speech, to realize the two-way communication of deaf-mute and other people or call, let deaf-mute equal participation normal social life.

The invention discloses a BOSSA-based deaf-mute multi-modal dynamic response interaction method, system and device, and a medium, and the method comprises the steps: obtaining to-be-processed multi-modal data, and carrying out the preprocessing of the to-be-processed multi-modal data, and obtaining the multi-modal data; obtaining a filtering signal according to the sound data and human ear physiological characteristics; obtaining a category judgment result of the sound data according to the filtering signal; generating a space activation graph according to the category judgment result; outputting a sound source optimal tracking result according to the space activation diagram; and outputting a multi-modal feedback result according to the sound source optimal tracking result and the category judgment result. The invention belongs to the field of sound interaction. According to the invention, the deaf-mute can accurately position the speaker in a complex environment.