Sign language recognition method and device
A recognition method and sign language technology, applied in the field of data processing, can solve problems such as low level of sign language and difficulty in communicating with deaf-mute people
Active Publication Date: 2021-07-06
UNIV OF SCI & TECH OF CHINA
View PDF6 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Sign language is an important way for deaf-mute people to obtain information and express information. Deaf-mute people usually use sign language to communicate with others, which requires both parties to communicate to understand sign language, and it takes a lot of time and energy for normal people to learn sign language , so most normal people have a low level of sign language, and it is difficult to communicate with deaf people
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0061] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
[0062] The invention is applicable to numerous general purpose or special purpose computing device environments or configurations. For example: personal computer, server computer, handheld or portable device, tablet type device, multiprocessor device, distributed computing environment including any of the above devices or devices, etc.
[0063] The embodiment of the present invention provides a sign language recognition method, which can be applied to various ...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present invention provides a sign language recognition method, comprising: performing feature extraction on each sub-video to obtain feature data corresponding to each sub-video; encoding each feature data to obtain time-series feature data corresponding to each sub-video; applying the preset The CTC decoder decodes each time-series feature data sequentially according to the time sequence of each time-series feature data, and obtains the first output result; in the first output result, selects the preset number according to the order of each first probability value from large to small natural language data to form the result set to be recognized; apply a preset LSTM decoder to determine the second probability value corresponding to each of the natural language data in the result set to be recognized; according to the first probability value and the second probability value , select the target natural language data in the result set to be recognized. Through the joint decoding of CTC decoder and LSTM decoder, the accuracy of sign language recognition can be effectively improved.
Description
technical field [0001] The invention relates to the field of data processing, in particular to a sign language recognition method and device. Background technique [0002] With the development of information technology, continuous sign language recognition technology based on machine learning has also been greatly developed. Sign language is an important way for deaf-mute people to obtain information and express information. Deaf-mute people usually use sign language to communicate with others, which requires both parties to communicate to understand sign language, and it takes a lot of time and energy for normal people to learn sign language , so most normal people have a low level of sign language, and it is difficult to communicate with deaf people. Therefore, continuous sign language recognition technology is of great significance to the communication of the deaf-mute. [0003] However, in the existing continuous sign language recognition technology based on machine le...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00
CPCG06V40/28G06V20/46
Inventor 李厚强周文罡蒲俊福
Owner UNIV OF SCI & TECH OF CHINA