A Sign Language Recognition and Translation Method Based on Da Vinci Technology
A sign language and technology technology, applied in the field of sign language recognition and translation based on Da Vinci technology, can solve the problems of low system recognition rate, high system cost, real-time difference, etc., and achieve fast and accurate positioning, less computation, and complete skin color extraction. Effect
Active Publication Date: 2017-10-27
GUANGDONG UNIV OF TECH
View PDF7 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0003] The present invention overcomes the defects of low system recognition rate, poor real-time performance, inconvenient portability and high system cost described in the above-mentioned prior art, and provides a sign language recognition translation based on Da Vinci technology with high recognition rate and strong real-time performance method
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0050] A sign language recognition and translation method based on Da Vinci technology, wherein the Da Vinci technology is composed of Da Vinci processors, Da Vinci software, Da Vinci development tools, and Da Vinci technical support systems.
[0051] Such as figure 1As shown, the Da Vinci processor uses the DM6446 processor. The DM6446 processor is a multi-functional high-speed chip that uses Da Vinci technology for video and image processing. It has the advantages of high performance, low power consumption, and low cost. It adopts ARM Subsystem + DSP subsystem dual-core architecture open architecture, in which the ARM subsystem uses the ARM926E-J core with a working frequency of 297MHz, and the DSP subsystem uses the C64x+ core and carries a video accelerator with a working frequency of 594MHz. The DM6446 processor also includes VPSS (Video Processing Subsystem) and peripheral equipment. VPSS inputs the video image collected by the camera and outputs the video image to the d...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present invention proposes a method for sign language recognition and translation based on Da Vinci technology, said method comprising the following steps: collecting the action video of the sign language person; extracting the skin color block in the foreground image; calculating the depth information of the extracted skin color block, and according to The depth information of the skin color block locates the face area; according to the depth information of the skin color block, the hand is positioned and the key frame is extracted and filled with the skin color block; one or more hand features of the key frame are extracted; according to the extracted hand shape Features, use a single classifier for classification or use multiple classifiers for voting to obtain the static gesture recognition result; recognize the motion trajectory of the gesture to obtain the trajectory recognition result; perform error correction and comparison on the static gesture recognition result and trajectory recognition result Splicing to get the recognition and translation results of sign language. The invention has the advantages of high recognition rate and strong real-time performance.
Description
technical field [0001] The invention relates to the fields of image processing and pattern recognition, and more specifically, to a method of sign language recognition and translation based on Da Vinci technology. Background technique [0002] In daily life, gestures and sign language are an important means of communication. For deaf people, sign language is essential. However, most people do not know enough about sign language, so in order to allow people to understand sign language, research on sign language recognition has also been carried out. The first sign language translation system that appeared was based on data gloves, and the recognition effect was quite impressive, but it was expensive and not easy to carry. People gradually focus on the research of visual-based sign language translation systems, but they also face problems such as low system recognition rate, real-time performance gap, inconvenient portability, and high system cost. The popularization of sign...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/66
CPCG06V30/194
Inventor 陈健明周冬跃陈丽叶俊有
Owner GUANGDONG UNIV OF TECH