A Gesture Action Recognition Method of Chinese Pule Sign Language Coding

A gesture action and gesture technology, which is applied in sign language recognition system and human-computer interaction, and in the field of gesture action recognition of China Pule sign language coding, can solve the problems of inability to achieve recognition effect, high HOG feature dimension, and inability to meet real-time efficiency and other problems

Active Publication Date: 2020-11-27
HEFEI UNIV OF TECH
View PDF10 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

When using the above-mentioned gesture recognition method to recognize Chinese Pule sign language, it cannot achieve a good recognition effect, because the direction correction method described is no longer suitable when using a conventional camera or wearing long sleeves, and the commonly used HOG feature has a relatively small dimension. High, unable to meet the real-time and efficient needs, so it is not suitable for Chinese Pule sign language coded gesture recognition

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Gesture Action Recognition Method of Chinese Pule Sign Language Coding
  • A Gesture Action Recognition Method of Chinese Pule Sign Language Coding
  • A Gesture Action Recognition Method of Chinese Pule Sign Language Coding

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] In this embodiment, a gesture recognition method of Chinese Pule sign language encoding includes: 1. First capture the gesture action video of Chinese Pule sign language encoding with a camera to obtain a frame-by-frame RGB image sequence; 2. Perform color space conversion on each frame of image And determine the gesture area; 3 determine the fitting circle according to the minimum value of the extracted gesture edge contour point sequence, and replace the palm area, and then detect the fingertip and finger root; 4 take the center of the circle and the vertically downward unit vector as the standard, Extract the angle and distance features of each contour point; 5 use the dynamic time warping algorithm to map and transform the features to obtain the similar distance features of a certain gesture; 6 use a variety of classifiers to recognize sign language actions.

[0052] In this embodiment, in order to verify the effect of the present invention on recognizing Chinese Pul...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a gesture action recognition method of Chinese Pule sign language encoding, the steps of which include: 1. First capture the gesture action video of Chinese Pule sign language encoding with a camera to obtain a frame-by-frame RGB image sequence; 2. Color each frame image Space conversion and determination of the gesture area; 3 Determine the fitting circle according to the minimum value of the extracted hand-shape edge contour point sequence, and replace the palm area, and then detect the fingertip and finger root; 4 Use the center of the circle and the vertically downward unit vector as Standard, extract the angle and distance features of each contour point; 5 use dynamic time warping algorithm to map and transform the features, and obtain the similar distance features of a certain gesture; 6 use a variety of classifiers to recognize sign language actions. The invention can effectively recognize the coded gestures of the Chinese Pule sign language, provides a solution for a Chinese sign language recognition system with a continuous and large-scale vocabulary, and is of great significance for popularizing the standardized Chinese sign language.

Description

technical field [0001] The invention belongs to the technical field of gesture recognition of Chinese sign language, and in particular relates to a gesture recognition method of Chinese Pule sign language coding, which is mainly used in sign language recognition systems, human-computer interaction and other related fields. Background technique [0002] Gesture action is an important input method of human-computer interaction, and it is applied to various information communication processes with its rich and varied meanings and flexible execution methods. Gesture recognition refers to the use of computers to detect, analyze and explain the gestures performed by people, such as the movement mode and force of arms, wrists, fingers, etc., so as to judge the intention of the movement and provide corresponding services. Gesture recognition technology is widely used in Sign language recognition, rehabilitation training, human-computer interaction, home appliance control, smart cars...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/46G06K9/62
CPCG06V40/28G06V20/42G06V10/443G06V10/752G06F18/243
Inventor 成娟魏馥琳刘羽陈勋李畅宋仁成
Owner HEFEI UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products