Semantic-computing-based interaction system and method for person with hearing or language disorder

A technology for semantic computing and language barriers, applied in transmission systems, speech analysis, speech recognition, etc., can solve the problems of low education popularization and communication difficulties, so as to alleviate the serious shortage of education popularization, improve the strength and popularization, and facilitate communication. Effect

Inactive Publication Date: 2012-10-03
WUHAN UNIV
View PDF8 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention mainly solves the technical problems existing in the prior art, such as the low level of education and communication difficulties for hearing or language-impaired persons in the society; it provides an image display that converts words spoken by normal people into sign language, and realizes Normal people can convey informati

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Semantic-computing-based interaction system and method for person with hearing or language disorder
  • Semantic-computing-based interaction system and method for person with hearing or language disorder
  • Semantic-computing-based interaction system and method for person with hearing or language disorder

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0033] The communication system for hearing or language-impaired persons based on semantic computing of the present invention includes two portable terminals, that is, a first portable terminal and a second portable terminal; and a voice conversion module connected to the first portable terminal and the second portable terminal at the same time; The voice conversion module includes a voice engine unit, a semantic calculation engine unit and a sign language capture engine unit connected in sequence; the sign language capture engine unit is also connected with a sign language database, and the voice engine unit includes an audio processing engine subunit and a voice text that are connected in sequence Interchange subunits.

[0034] The present invention also includes a cloud server, and the cloud server is connected with the sign language capture engine unit.

[0035] First of all, let me introduce the process of converting voice into sign language by normal people through this ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a semantic-computing-based interaction system and a semantic-computing-based interaction method for person with hearing or language disorder. The system is characterized by comprising two parts, namely portable terminals and a cloud-computing-based cloud server, and comprises at least two types of portable terminals, namely a first-type portable terminal and a second-type portable terminal or a portable terminal combining the two types of terminals. The portable terminals are used for performing related computing, data also can be uploaded to the cloud server for accurate computing, then a result is returned to the portable terminals, and different users can customize different semantic dictionaries. The system and the method have the advantages that words spoken by normal person are converted into the animation display of hand signs, so that the normal person can transmit information to the person with the hearing or language disorder without barriers; and the hand signs of the person with the hearing or language disorder can be converted into voices for play or into texts for display, so that interaction between the normal person and the person with the hearing or language disorder is further facilitated.

Description

technical field [0001] The invention relates to a communication system and method for persons with hearing or speech impairments, in particular to a communication system and method for persons with hearing or speech impairments based on semantic computing. Background technique [0002] People with hearing or language impairments can't hear or speak, and can't communicate like normal people, which makes their living conditions very chaotic in terms of work, study, entertainment, medical treatment, and rights protection. Therefore, strengthening communication between normal people and people with hearing or language impairments and completing education has become the key to solving the social life problems of people with hearing or language impairments. [0003] It is well known that people with hearing or speech disabilities have significant educational problems. Children with hearing or speech disabilities are less likely to be enrolled in compulsory education. People w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L15/26G09B21/00H04L29/08G10L13/04G10L13/047
Inventor 胡继承方栋健庄奕峰杜肖肖柴昊天卜文博徐洁斌王倩
Owner WUHAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap