Sign language conversion voice system

A speech system and dumb language technology, applied in speech analysis, speech recognition, speech synthesis, etc., can solve the problems of high cost, limited application field, large volume, etc., and achieve the effect of high accuracy, convenient communication, and accurate recognition.

Active Publication Date: 2014-09-24
浏阳市仁杰电子科技有限公司 +1
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Although dumb language can meet the needs of communication between communicators who have mastered dumb language, but in the case where only one of the communication parties has mastered dumb language, such as when a disabled person communicates with a normal person, the dumb language is difficult for normal people to understand, and there are still communication barriers
[0004] 3D scanning first appeared as a contact measurement method, represented by a three-dimensional coordinate measuring machine. Although the accuracy reaches the micron level (0.5mm), its application field is restricted due to the shortcomings of huge volume, high cost, and inability to measure soft objects. limit
This method has great limitations in terms of content, storage, transmission, convenience, and timeliness.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sign language conversion voice system
  • Sign language conversion voice system
  • Sign language conversion voice system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] The dumb speech conversion speech system includes three parts: 3D scanning equipment, data storage and processing system, and speech synthesis module. The 3D scanning equipment adopts the KINECT equipment that Microsoft has put into the market for many years. The KINECT equipment has three lenses in total, and the middle one is RGB Camera, used to acquire 640x480 color images, at most 30 frames per second; on both sides are two depth of field (3D Depth) sensors, used to detect the relative position of the human body, the principle is the same as the stereoscopic imaging of the human eye, These two sensors use infrared light. There are microphones on both sides of Kinect, and there is a movable base below to adjust the elevation angle of Kinect. The storage and processing of the data and the synthesis of the voice are completed in the single chip microcomputer, and then the meaning and the tone of the identified corresponding bone are sent to the voice synthesis module f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a sign language conversion voice system which comprises a 3D scanning device, a data storage processing system and a voice synthesis module. The sign language conversion voice system scans human skeletons through the 3D scanning device to obtain scanning data of skeleton motions within a certain time. The data storage processing system compares the scanning data with skeleton motion storage data prestored in a database, and when the scanning data are matched with the storage data, the meaning corresponding to the storage data prestored in the database is sent to the voice synthesis module to generate a voice and play the voice. According to the sign language conversion voice system, sign language gestures can be automatically converted into voice to be output, communication between the disabled and abled persons is facilitated, the meaning conversion and expression accuracy is higher, speed is higher, and the sign language conversion voice system has the tone simulation function.

Description

technical field [0001] The invention relates to a system for converting dumb language gestures into voice output. Background technique [0002] Mute language is also called sign language: sign language was born out of the communication needs of the deaf, and it has gradually been accepted by people as a language of the deaf. Sign language includes finger language and sign language. Finger language is to use finger changes and movements to represent letters, and to spell out words in turn according to the order of pinyin; in ancient times, all human beings were in the stage of simple vocal language, and they often expressed meaning by making various gestures with their hands. Most of the gestures are indicative and image movements, called natural gestures. Since then, with the progress of society, especially the emergence and development of deaf education, gestures with language properties have been created. The sign language produced on the basis of writing and closely com...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L15/24G10L13/08
Inventor 张江杰
Owner 浏阳市仁杰电子科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products