Chinese sign language recognition method based on kinect

A recognition method and sign language technology, applied in character and pattern recognition, instruments, computer parts, etc., can solve the problems of increased search operation overhead and storage overhead, reduced system recognition speed, and reduced recognition rate, etc., to facilitate communication, improve Sign language recognition effect, effect of improving naturalness

Active Publication Date: 2013-08-14
CHONGQING UNIV OF POSTS & TELECOMM
View PDF1 Cites 32 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, methods based on visual recognition are easily affected by environmental factors such as background, lighting, and camera position.
[0004] Sign language recognition With the increase of vocabulary recognition, the recognition search space becomes larger, the categories to be distinguished also increase

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Chinese sign language recognition method based on kinect
  • Chinese sign language recognition method based on kinect
  • Chinese sign language recognition method based on kinect

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0014] The specific implementation of the present invention will be further explained in detail below in conjunction with the accompanying drawings.

[0015] As mentioned above, the present invention provides a Kinect-based Chinese sign language recognition method, which can effectively improve the sign language recognition effect by combining sign language feature information acquired by Kinect with sign language primitives. The so-called primitive is to aggregate the same or highly similar components in sign language features to form the smallest unit of sign language and can be used to distinguish different sign languages. The Kinect-based Chinese sign language recognition method of the present invention makes full use of the advantages that Kinect can simultaneously obtain hand shape features, joint point coordinates of both hands and other parts of the human body to obtain position feature information of both hands and direction feature information of both hands, thereby u...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a Chinese sign language recognition method based on kinect. The method comprises the following steps of acquiring depth information of hands and the 3D (three-dimensional) coordinate information of bone joint points of main parts of a human body through kinect; respectively acquiring hand characteristic information, position characteristic information and direction characteristic information by processing the characteristics of the acquired information; acquiring a hand element, a position element and a direction element for the acquired hand, position and direction characteristic information by adopting different polymerization algorithm, carrying out the element matching by utilizing a neighboring method and a template matching method adopting an Euclidean distance as a similarity measurement criterion, and determining the hand sign implication. Due to the adoption of the method, a purpose for effectively recognizing the Chinese sign language with vast vocabulary can be realized; and moreover, each element is independently acquired in parallel, so that the Chinese sign language can be recognized in real time. By implementing the method, different sign languages can be recognized in real time, so that Chinese deaf-mute can effectively communicate with other people.

Description

technical field [0001] The invention relates to the field of artificial intelligence, in particular to a Kinect-based Chinese sign language recognition method. Background technique [0002] Sign language is the main method for normal information exchange and communication between deaf and normal people, and between deaf and deaf people. It is through hand shape, hand position, hand direction, arm movement, facial expression, lip movement And other gestures to express the human body visual language. As an important branch of sign language, Chinese sign language is mainly divided into finger language and sign language. Finger language describes a Chinese pinyin letter through the trajectory of the fingers. There are a total of 30 basic units, and any Chinese word can be formed with these 30 finger signs. Sign language is expressed by simulating the image features, actions, etc. of things and adding human posture and facial expressions. There are currently about 5,500 regul...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62
Inventor 杨勇叶梅树
Owner CHONGQING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap