Sign language recognition system based on sensing equipment and working method thereof

A technology of sensing equipment and recognition system, applied in the field of gesture perception and sign language recognition, it can solve the problems of limited gesture action, unfriendly user, and troublesome scene layout, and achieve the effect of high accuracy and convenient position adjustment.

Active Publication Date: 2019-10-29
NANJING UNIV
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among them, gesture sensing technology based on sound signals is easily affected by environmental noise, and the gestures that can be recognized are limited; gesture sensing technology based on human body sensors often re...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sign language recognition system based on sensing equipment and working method thereof
  • Sign language recognition system based on sensing equipment and working method thereof
  • Sign language recognition system based on sensing equipment and working method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] In order to facilitate the understanding of those skilled in the art, the present invention will be further described below in conjunction with the embodiments and accompanying drawings, and the contents mentioned in the embodiments are not intended to limit the present invention.

[0051] A sign language recognition system based on a sensing device of the present invention, comprising:

[0052] The gesture action collection module is used to collect the joint point data of the user's hand in real time, and perform gesture action segmentation and feature extraction on the collected data;

[0053] Gesture action model library, used to store gesture action features and gesture action classification models, wherein gesture action features are obtained by modeling gesture actions, gesture action modeling is divided into static gesture modeling and dynamic gesture modeling; dynamic gesture modeling It is divided into global dynamic gesture modeling of hand movement and local...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a sign language recognition system based on sensing equipment and a working method of the sign language recognition system. The working method comprises the following steps: collecting joint point data of hands of a user in real time; performing noise reduction on the joint point data; segmenting the articulation point data after noise reduction to complete gesture action segmentation; calculating gesture features used for gesture classification; gesture features corresponding to the gesture actions are classified, and the types of the gesture actions are determined; and matching the sign language corresponding to the gesture action category, and displaying a sign language result. On the basis of gesture action modeling and gesture classification, an online sign language recognition system is designed and developed, and a solution is provided for communication between healthy listeners and deaf-mutes.

Description

technical field [0001] The invention belongs to the technical field of gesture perception and sign language recognition, and in particular relates to a sign language recognition system based on a sensing device and a working method thereof. Background technique [0002] In society, there is a group of people who cannot hear or speak, and can only live in a silent world. They are the tens of millions of deaf-mute people in our country, who cannot communicate like normal people. Their living conditions such as work, study, and medical treatment have brought great troubles. In real life, they also have a means of communication—sign language, but most hearing people cannot understand the meaning of sign language. For this reason, gesture sensing technology has been extensively studied. At present, gesture sensing technology can be divided into four categories according to sensing means, namely, gesture sensing technology based on sound signal, gesture sensing technology based ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00
CPCG06V40/113G06V40/28
Inventor 谢磊徐岩陆桑璐
Owner NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap