Chinese sign language recognition method based on kinect

Abstract

The invention relates to a Chinese sign language recognition method based on kinect. The method comprises the following steps of acquiring depth information of hands and the 3D (three-dimensional) coordinate information of bone joint points of main parts of a human body through kinect; respectively acquiring hand characteristic information, position characteristic information and direction characteristic information by processing the characteristics of the acquired information; acquiring a hand element, a position element and a direction element for the acquired hand, position and direction characteristic information by adopting different polymerization algorithm, carrying out the element matching by utilizing a neighboring method and a template matching method adopting an Euclidean distance as a similarity measurement criterion, and determining the hand sign implication. Due to the adoption of the method, a purpose for effectively recognizing the Chinese sign language with vast vocabulary can be realized; and moreover, each element is independently acquired in parallel, so that the Chinese sign language can be recognized in real time. By implementing the method, different sign languages can be recognized in real time, so that Chinese deaf-mute can effectively communicate with other people.

Description

technical field [0001] The invention relates to the field of artificial intelligence, in particular to a Kinect-based Chinese sign language recognition method. Background technique [0002] Sign language is the main method for normal information exchange and communication between deaf and normal people, and between deaf and deaf people. It is through hand shape, hand position, hand direction, arm movement, facial expression, lip movement And other gestures to express the human body visual language. As an important branch of sign language, Chinese sign language is mainly divided into finger language and sign language. Finger language describes a Chinese pinyin letter through the trajectory of the fingers. There are a total of 30 basic units, and any Chinese word can be formed with these 30 finger signs. Sign language is expressed by simulating the image features, actions, etc. of things and adding human posture and facial expressions. There are currently about 5,500 regul...

AI Technical Summary

Problems solved by technology

Therefore, methods based on visual recognition are easily affected by environmental factors such as background, lighting, and camera position.

[0004] Sign language recognition With the increase of vocabulary recognition, the recognition search space becomes larger, the categories to be distinguished also increase, and the potential similarity between words increases, making the distinction more difficult; at the same time, as the number of entries increases, the system's search operation Increased overhead and storage overhead, which will lead to a reduction in system recognition speed and a decline in recognition rate

Images