Space encoding-based method for realizing interconversion between sign language motion information and text message

A technology of text information and implementation methods, applied in the direction of mechanical mode conversion, animation production, data processing input/output process, etc., can solve the problems of poor speed, high cost, and poor real-time performance, and achieve small storage capacity and system operation efficiency The effect of low and fast decoding speed

Active Publication Date: 2012-07-25
ZHEJIANG UNIV OF TECH
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to overcome the disadvantages of poor speed, poor real-time performance and high cost of existing sign language recognition methods, the present invention provides a fast, real-time and low-cost realization of mutual conversion between sign language motion information and text information based on spatial coding method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Space encoding-based method for realizing interconversion between sign language motion information and text message
  • Space encoding-based method for realizing interconversion between sign language motion information and text message
  • Space encoding-based method for realizing interconversion between sign language motion information and text message

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0039] refer to Figure 1 to Figure 7 A method for converting sign language motion information based on spatial coding into text information: firstly establish text information, sign language coding information and action animations to establish a sign language dictionary database corresponding to the sequence, and the implementation method includes the following steps:

[0040] (1) Signal data acquisition: According to the baud rate of the data glove on the wearer and the position tracker, the data frame of the time period is obtained, and a series of vector data of the input data is obtained;

[0041] (2) Data preprocessing: according to the sign language habit of the wearer of the data glove, define the curvature value range, and use the position tracker to divide the space area according to the individual characteristics of the wearer, locate the mouth, left earlobe, right earlobe, The position of the left and right shoulders;

[0042] (3) Feature extraction of sign langu...

Embodiment 2

[0064] refer to Figure 1-Figure 7 A method for converting text information based on spatial coding into sign language motion information. First, text information, sign language coding information and action animations are set up to establish a sign language dictionary database corresponding to the sequence. The implementation method includes the following steps:

[0065] (1) According to the skeleton parameters of the virtual human, the demonstration space of the virtual human is set, and the demonstration space of the virtual human is defined by space division rules;

[0066] (2), record the center position of the moving palm in each area in the demonstration space and the matrix of the relevant bone positions;

[0067] (3), using the input information as a keyword to search in the sign language dictionary database, and if relevant information is retrieved, the sign language coding information is extracted;

[0068] (4) According to the sign language coding information, set...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a space encoding-based method for realizing interconversion between sign language motion information and text message, which comprises the following steps: firstly, establishing a sign language dictionary database for establishing corresponding sequences of the text message, sign language code message and action animation; and secondly, performing intelligent sign languageidentification according to a glove which is a data glove for detecting hand gesture changes of a user and a position tracker for detecting the space region of hand of the user, wherein the intelligential identification comprises that a sign language motion information to text message conversion module and a text message module to sign language information conversion module. The invention provides a space encoding-based method for realizing the interconversion between the sign language motion information and the text message, which has the advantages of high speed, strong instantaneity, and low cost.

Description

technical field [0001] The invention relates to a method for realizing real-time communication between a deaf-mute person and a normal person, in particular to a sign language communication method. Background technique [0002] Sign language is the language used by deaf people. It is a relatively stable expression system composed of hand movements supplemented by facial expressions, and a special language that communicates by movement / vision. There are more than 20 million hearing-impaired people in our country, and they mainly use sign language to communicate. Since sign language is not the common language of most people in the society, this restricts their communication with the society to a great extent. The development of the sign language communication system can solve this problem to a certain extent, play an important role in creating a barrier-free environment for the deaf, and play a great role in promoting standardized Chinese sign language. [0003] With the in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G09B21/00G06F3/01G06F3/048G06T13/00
Inventor 张宁宁顾容应文良李晓
Owner ZHEJIANG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products