Sign language recognition system based on sensing equipment and working method thereof

A technology of sensing equipment and recognition system, applied in the field of gesture perception and sign language recognition, it can solve the problems of limited gesture action, unfriendly user, and troublesome scene layout, and achieve the effect of high accuracy and convenient position adjustment.
CN110390281AActive Publication Date: 2019-10-29NANJING UNIV

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
NANJING UNIV
Publication Date
2019-10-29

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a sign language recognition system based on sensing equipment and a working method of the sign language recognition system. The working method comprises the following steps: collecting joint point data of hands of a user in real time; performing noise reduction on the joint point data; segmenting the articulation point data after noise reduction to complete gesture action segmentation; calculating gesture features used for gesture classification; gesture features corresponding to the gesture actions are classified, and the types of the gesture actions are determined; and matching the sign language corresponding to the gesture action category, and displaying a sign language result. On the basis of gesture action modeling and gesture classification, an online sign language recognition system is designed and developed, and a solution is provided for communication between healthy listeners and deaf-mutes.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention belongs to the technical field of gesture perception and sign language recognition, and in particular relates to a sign language recognition system based on a sensing device and a working method thereof. Background technique

[0002] In society, there is a group of people who cannot hear or speak, and can only live in a silent world. They are the tens of millions of deaf-mute people in our country, who cannot communicate like normal people. Their living conditions such as work, study, and medical treatment have brought great troubles. In real life, they also have a means of communication—sign language, but most hearing people cannot understand the meaning of sign language. For this reason, gesture sensing technology has been extensively studied. At present, gesture sensing technology can be divided into four categories according to sensing means, namely, gesture sensing technology based on sound signal, gesture sensing technology based ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More