Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Sign language interpreting, displaying and sound producing system based on electromyographic signals and motion sensors

A motion sensor and sign language translation technology, which is applied in the directions of instruments, electronic digital data processing, character and pattern recognition, etc., can solve the problems of inability to detect arm and hand movement gestures, high difficulty, etc., and achieve clear combination, accurate feature value extraction, cost reduction effect

Active Publication Date: 2014-11-05
SHANGHAI OYMOTION INFORMATION TECH
View PDF4 Cites 31 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This kind of solution can monitor the myoelectric signal of the arm in real time through the equipment worn on the arm, but according to its principle, it can only detect the relative posture of the hand, but cannot detect the movement posture of the arm and hand in three-dimensional space, and the Sign language movements are precisely the tight combination of these two postures, so this method is very difficult to use in sign language translation, and there are huge technical defects

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sign language interpreting, displaying and sound producing system based on electromyographic signals and motion sensors
  • Sign language interpreting, displaying and sound producing system based on electromyographic signals and motion sensors
  • Sign language interpreting, displaying and sound producing system based on electromyographic signals and motion sensors

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The core of the present invention is to implement a brand-new natural gesture recognition technology based on the surface muscle current signal of the user's arms and motion sensor data into the real-time translation of sign language, and carry out the optimal combination of natural language through contextual semantic analysis, and The sign language meaning is finally presented in the form of text display or voice playback.

[0020] The specific technology of the present invention is implemented as two armbands designed to be retractable in shape, which can be worn on the left and right arms of the user to perform gesture recognition, and the semantic display and sounding subsystem can be integrated in one of the two armbands, or can be It is a separate external device, such as a smartphone or computer running supporting software. On the inside of the two armbands close to the skin of the arm, place multiple surface muscle current sensors according to the main muscle p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a sign language interpreting, displaying and sound producing system based on electromyographic signals and motion sensors. The sign language interpreting, displaying and sound producing system comprises a gesture recognition subsystem and a semantic displaying and sound producing subsystem. The gesture recognition subsystem comprises the multi-axial motion sensors and a multi-channel muscle current acquisition and analysis module, the gesture recognition subsystem is put on the left arm and the right arm of a user, and the original surface electromyogram signals of the user and motion information of the arms of the user are obtained; gestures are differentiated by processing the electromyogram signals and data of the motion sensors. The displaying and sound producing subsystem comprises a semantic analyzer, a voice control module, a loudspeaker, a displaying module, a storage module, a communication module and the like. According to the sign language interpreting, displaying and sound producing system, by the adoption of the mode recognition technology based on the electromyographic signals of the double arms and the data of the motion sensors, the gesture recognition accuracy rate is increased; through the combination of the semantic displaying and sound producing subsystem, interpreting from commonly-used sign language to voice or text is achieved, and the efficiency of direct communication between people with language disorders and normal people is improved.

Description

technical field [0001] The invention relates to a real-time translation system from commonly used sign language to natural language text or voice. The realization principle is based on the multi-channel surface muscle current signals of the left and right arms of the user and the detection of the movement and rotation posture of the arms to distinguish and recognize sign language actions, and through The display sound system automatically adjusts the context semantics, and finally presents it in the form of text or voice. Background technique [0002] There is a huge base of hearing-impaired and language-impaired groups. The main way for the group to communicate with the outside world is sign language. However, due to the low chances of the general population to receive sign language training, it is very difficult for language-impaired groups to communicate with the general population. In terms of providing real-time sign language recognition and translation for hearing-impa...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06F3/01G06F17/27
Inventor 不公告发明人
Owner SHANGHAI OYMOTION INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products