Hand language searching method

A sign language, two-handed technology, applied in the field of digital media and human-computer interaction, can solve problems such as limiting user flexibility, overcome subjectivity and operational errors, quickly and effectively measure the similarity of sign language, and promote effective management.

Active Publication Date: 2011-04-06
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF3 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Existing sign language processing technology uses

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hand language searching method
  • Hand language searching method
  • Hand language searching method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] Various details involved in the technical solution of the present invention will be described in detail below in conjunction with the accompanying drawings. It should be pointed out that the described embodiments are only intended to facilitate the understanding of the present invention, rather than limiting it in any way.

[0041]The present invention proposes a method for hand tracking, feature extraction and fast retrieval in sign language news, such as Figure 1a As shown, this method tracks the hands of the host in the sign language news, obtains the movement sequence, speed and shape change sequence of the hands, and stores them in the form of XML for data exchange with other systems. The system accepts an input sign language video and returns the most similar match according to the similarity metric defined by the present invention.

[0042] 1. Face detection preprocessing

[0043] The present invention proposes to first detect whether each frame of video contai...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a hand language searching method which comprises the following steps of: S1: carrying out video decoding on the hand language, extracting texture characteristics, color characteristics and outline characteristics of the bottom layer of an image, generating a hand language characteristic library according to hand language motion characteristics, acquiring hand language characteristics comprising coordinate characteristics of two-hand motion, speed characteristics of two-hand motion and shape characteristics of two hands by adopting a method for tracking two hands by the hand language to form time sequence characteristics, and storing in character strings of the hand language characteristics; S2: expressing the video input by a user by the coordinate characteristics, the speed characteristics and the shape characteristics, and acquiring the character strings of the video input by the user; and S3: carrying out distance measurement on the character strings of the video input by the user and the character strings of the hand language characteristics by adopting a character string editing distance algorithm, and acquiring the similarity of the video input by the user and the video in the hand language characteristic library. The invention solves the problem of fast and robust two-hand positioning in the hand language, the problem of two-hand characteristic expression and the problem of fast and effective hand language similarity measurement.

Description

technical field [0001] The invention relates to the fields of digital media and human-computer interaction, and requires users to input sign language videos, and then searches similar video segments in sign language video databases. Background technique [0002] In recent years, many TV stations in China, such as Beijing News, have provided the function of sign language broadcasting to help deaf-mute and disabled people watch news content. Content-based video retrieval and management is a popular research direction in the field of digital media at present. However, for sign language videos, which is a relatively special form of video, how to effectively manage these videos according to content is an urgent problem to be solved. In this case, it is the general trend to free the storage and search of a large number of sign language videos from the manual method. To do this, the content of sign language must be analyzed and analyzed and feature generated for easy management. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30G06K9/00
Inventor 张师林李和平张树武
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap