System and method of smart sign language interpreting

A sign language translation and intelligent technology, applied in the field of sign language translation, can solve the problems of difficulty in distinguishing small movements and inconvenience, and achieve the effect of effective and convenient communication methods, improving accuracy, and effective and convenient reading, viewing and comprehension methods.

Inactive Publication Date: 2018-12-07
GREE ELECTRIC APPLIANCES INC
View PDF5 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Nowadays, people usually use chat software on smartphones or tablet computers to communicate, and the current sign language translation equipment is usually an independent device, which makes it inconvenient to use sign language translation equipment to communicate when using chat software
[0004] Because the gestures in sign language have some small movements such as finger bending, sometimes it is difficult to distinguish these small movements from the gesture images obtained by ordinary cameras

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method of smart sign language interpreting
  • System and method of smart sign language interpreting
  • System and method of smart sign language interpreting

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0074] An intelligent sign language translation system in this embodiment, the system includes:

[0075] The input module is used to input gesture image information, voice information or text information obtained by shooting, including multiple cameras that can shoot simultaneously;

[0076] A storage unit for storing standard gesture 3D models and text information corresponding to the three-dimensional models of standard sign language;

[0077] The 3D model building module is used to build the gesture 3D model according to the gesture image information obtained by shooting the gesture by multiple cameras, or convert the standard gesture 3D model into standard gesture image information;

[0078] A matching module, configured to match the obtained gesture 3D model to a corresponding standard gesture 3D model according to the standard gesture 3D model in the storage unit;

[0079] The sign language translation module is used to convert the standard gesture 3D model into corresp...

Embodiment 2

[0096] In this embodiment, the intelligent sign language translation system and the intelligent sign language translation APP are the same as those in Embodiment 1.

[0097] Such as figure 2 As shown, it is a flow chart of realizing chat tool sign language translation in this embodiment, and its specific process includes:

[0098] 1. Open WeChat / QQ and other chat software.

[0099] 2. Through the information retrieval module, the text information or voice information in the chat software is retrieved.

[0100] 3. Through the communication module, the text information or voice information is transmitted to the intelligent sign language translation APP.

[0101] 4. Recognize the voice information and convert it into text information.

[0102] 5. Through the sign language translation module, the text information is converted into the corresponding standard gesture 3D model.

[0103] 6. Through the 3D model building module, the standard gesture 3D model is converted into stan...

Embodiment 3

[0107] In this embodiment, the intelligent sign language translation system and the intelligent sign language translation APP are the same as those in Embodiment 1.

[0108] Such as image 3 As described, it is a flow chart for realizing sign language translation into voice or text in this embodiment, and its specific process includes:

[0109] 1. Open the smart sign language translation app and set the information input method.

[0110] 2. Set the information input method to gesture, automatically start the camera, and start recording gestures.

[0111] 3. Process the image information captured by multiple cameras to obtain gesture 3D image information and build a gesture 3D model.

[0112] 4. Match and recognize the gesture 3D model with the pre-stored standard gesture 3D model to obtain the matched standard gesture 3D model.

[0113] 5. Convert the standard gesture 3D model into corresponding text information.

[0114] 6. Convert the corresponding text information into ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention belongs to the technical field of sign language interpreting, and discloses a system of smart sign language interpreting and a method for mutual interpreting of sign language andcharacters and speech. The system comprises: an inputting module comprising a plurality of cameras capable of shooting at the same time; a storage unit configured to store a standard gesture 3D modeland character information corresponding to a three-dimensional model of a standard sign language; a 3D model establishing module; a matching module configured to match a corresponding standard gesture 3D model; a sign language interpreting module configured to convert between the standard gesture 3D model conversion and the corresponding character information; a speech recognition module configured to convert the character information to the corresponding speech information; and an output module. The system and method of smart sign language interpreting provide an efficient and convenient andrapid communication method and reading, watching and understanding modes between the special crowd having language and hearing disorders and the normal, are high in interpreting accuracy and are better fit for users' using habit.

Description

technical field [0001] The invention belongs to the technical field of sign language translation, in particular to a system and method for intelligent sign language translation. Background technique [0002] When the news broadcast is broadcast, an animation of a sign language teacher translating what the host said into sign language will appear at the bottom right of the screen, so that people with language and hearing impairments can understand the news content without barriers. In people’s normal communication process, in addition to making phone calls, most of them chat with relatives and friends through chat software such as QQ, WeChat, so how can people with language and hearing impairment communicate with each other without the help of a third person? People communicate and read and watch related materials? [0003] Nowadays, people usually use chat software on smartphones or tablet computers to communicate, and the current sign language translation equipment is usua...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06F3/01G09B21/00
CPCG06F3/017G09B21/00G06V40/28G06V40/113
Inventor 杨萍徐彭飞张龙
Owner GREE ELECTRIC APPLIANCES INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap