Sign language recognition translation method based on Davinci technology

A sign language and technology technology, applied in the field of sign language recognition and translation based on Da Vinci technology, can solve the problems of low system recognition rate, real-time difference, and high system cost, and achieve fast and accurate positioning, complete skin color extraction, and less computation. Effect

Active Publication Date: 2015-03-25
GUANGDONG UNIV OF TECH
View PDF7 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The present invention overcomes the defects of low system recognition rate, poor real-time performance, inconvenient portability and high system cost described in th...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sign language recognition translation method based on Davinci technology
  • Sign language recognition translation method based on Davinci technology
  • Sign language recognition translation method based on Davinci technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0050] A sign language recognition and translation method based on Da Vinci technology, wherein the Da Vinci technology is composed of Da Vinci processors, Da Vinci software, Da Vinci development tools, and Da Vinci technical support systems.

[0051] Such as figure 1As shown, the Da Vinci processor uses the DM6446 processor. The DM6446 processor is a multi-functional high-speed chip that uses Da Vinci technology for video and image processing. It has the advantages of high performance, low power consumption, and low cost. It uses ARM Subsystem + DSP subsystem dual-core architecture open architecture, in which the ARM subsystem uses the ARM926E-J core with a working frequency of 297MHz, and the DSP subsystem uses the C64x+ core and carries a video accelerator with a working frequency of 594MHz. The DM6446 processor also includes VPSS (Video Processing Subsystem) and peripheral equipment. VPSS inputs the video image collected by the camera and outputs the video image to the dis...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a sign language recognition translation method based on the Davinci technology. The method comprises the following steps that an action video of a signer is collected; skin color blocks are extracted from a foreground image; the depth information of the extracted skin color blocks are calculated, and the face area is positioned according to the depth information of the skin color blocks; the hands are positioned according to the depth information of the skin color blocks, and key frames are extracted and the skin color blocks are repaired and filled; one or more hand shape features of the key frames are extracted; according to the extracted hand shape features, a single classifier is used for classification or multiple classifiers are used for voting, and a static gesture recognition result is obtained; the movement track of the gesture is recognized, and a track recognition result is obtained; the static gesture recognition result and the track recognition result are corrected and spliced, and a sign language recognition translation result is obtained. The sign language recognition translation method based on the Davinci technology has the advantages of being high in recognition rate and real-time performance.

Description

technical field [0001] The invention relates to the fields of image processing and pattern recognition, and more specifically, to a method of sign language recognition and translation based on Da Vinci technology. Background technique [0002] In daily life, gestures and sign language are an important means of communication. For deaf people, sign language is essential. However, most people do not know enough about sign language, so in order to allow people to understand sign language, research on sign language recognition has also been carried out. The first sign language translation system that appeared was based on data gloves, and the recognition effect was quite impressive, but it was expensive and not easy to carry. People gradually focus on the research of visual-based sign language translation systems, but they also face problems such as low system recognition rate, real-time performance gap, inconvenient portability, and high system cost. The popularization of sign...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/66
CPCG06V30/194
Inventor 陈健明周冬跃陈丽叶俊有
Owner GUANGDONG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap