Intelligent sign language interaction system and method for self-adaptive gesture recognition

A gesture recognition and interactive system technology, applied in the field of intelligent sign language interactive system for adaptive gesture recognition, can solve the problems of not taking into account individual differences and regional differences, and the accuracy of sign language recognition results is not high, and achieve low-cost customization Effects of development, enrichment of data types, and simplification of device structure

Active Publication Date: 2019-07-12
陕西联森电子科技有限公司
View PDF3 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide an intelligent sign language interactive system for adaptive gesture recognition to solve the problem that the sign langua

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent sign language interaction system and method for self-adaptive gesture recognition
  • Intelligent sign language interaction system and method for self-adaptive gesture recognition
  • Intelligent sign language interaction system and method for self-adaptive gesture recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0057] Such as figure 1 As shown, in this embodiment, an intelligent sign language interactive system for adaptive gesture recognition is disclosed, including a sign language data collection module, a sign language translation module and a voice output module, and the system also includes a user feedback module and a feedback information processing module;

[0058] The sign language data collection module is used to collect the user's sign language data;

[0059] The sign language translation module is used to use the translation model to translate sign language data and obtain translation results;

[0060] The user feedback module is used to judge whether the output translation result is correct, and if the translation result is wrong, the user corrects the output translation result to generate feedback information;

[0061] The feedback information processing module is used to update the translation model according to the feedback information, and then send the updated tran...

Embodiment 2

[0118] An intelligent sign language interaction method for adaptive gesture recognition, comprising the following steps:

[0119] Step 1. Collect the sign language data of the current user, preprocess the sign language data, and obtain the preprocessed sign language data;

[0120] In this step, due to the wide variety of sign language data, it can be the motion sequence collected by the data glove, or the image action sequence collected, or a combination of the two. In order to improve the accuracy of sign language data collection, In this step, the sign language data is preprocessed.

[0121] Optionally, step 1.1, collecting user gesture action sequences;

[0122] In this embodiment, the sequence of collecting user gestures is {P 1,i,j,q ,P 2,i,j,q ,…P n,i,j,q}, where i represents the i-th sign language student, j represents the j-th standard action, q represents the q-th type sensor, P 1,i,j,q Indicates the start of the action, P n,i,j,q Indicates the end of the action...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an intelligent sign language interaction system and method for self-adaptive gesture recognition. A sign language data acquisition module is used for acquiring sign language data of a user. A sign language translation module is used for translating the sign language data by utilizing a translation model to obtain a translation result. A user feedback module is used for judging whether the translation result is correct or not, and if the translation result is wrong, the user corrects the output translation result to generate feedback information. A feedback information processing module is used for updating the translation model according to the feedback information and sending the updated translation model to the sign language translation module. A voice output module is used for outputting a translation result. Because of different sign language user individuals are different, translation error happens occasionally. According to the system and the method provided by the invention, a user autonomous feedback and cloud background intelligent judgment method is adopted, so that the problem of individual difference of the user is solved, the longer the wearingtime of the user is, the more customized trend of the product is achieved, and low-cost customized development is realized.

Description

technical field [0001] The invention relates to a sign language interaction system and method, in particular to an intelligent sign language interaction system and method for adaptive gesture recognition. Background technique [0002] Sign language is a language used by deaf-mute people to communicate. It uses gestures to compare actions, and simulates images or syllables to form certain meanings or words according to the changes in gestures. However, due to the complexity of sign language, most normal people can master and apply it. It is obviously unrealistic to communicate with the deaf-mute with sign language, which leads to obstacles in the communication between the deaf-mute and normal people. [0003] With the development of artificial intelligence technology, more and more technologies are applied to the field of people's livelihood. Among them, people with language barriers are very eager to communicate with normal social groups through artificial intelligence techn...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06F17/27
CPCG06V40/28G06F40/30
Inventor 陈瑞
Owner 陕西联森电子科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap