Chinese lip language recognition method based on deep learning

A deep learning and recognition method technology, applied in the field of lip recognition, can solve the problems of low accuracy of lip recognition results and difficulty in upgrading, and achieve the effects of high accuracy, simplified calculation, and good positioning

A deep learning and recognition method technology, applied in the field of lip recognition, can solve the problems of low accuracy of lip recognition results and difficulty in upgrading, and achieve the effects of high accuracy, simplified calculation, and good positioning

CN110443129APending Publication Date: 2019-11-12厦门知晓物联技术服务有限公司
3 Cites 11 Cited by

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Chinese lip language recognition method based on deep learning
  • Chinese lip language recognition method based on deep learning
  • Chinese lip language recognition method based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0025] Such as Figure 1-5 Shown, a kind of Chinese lip recognition method based on deep learning, described method comprises the steps:

[0026] S1. Acquiring lip sequence images;

[0027] S2. Extracting the features of the lip sequence image from the acquired lip sequence image;

[0028] S3. Input the features of the extracted lip sequence images into the two-way long-short-term memory network for time-space feature sequence learning, and train the feature...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a Chinese lip language recognition method based on deep learning. The method comprises the following steps: S1, acquiring a lip sequence image; S2, extracting features of the lip sequence image from the obtained lip sequence image; S3, inputting the extracted features of the lip sequence image into a bidirectional long-short-term memory network to perform time-space featuresequence learning, training the features of the learned lip sequence image, and training the features of the learned lip sequence image to a lip language recognition model; and S4, decoding and recognizing the extracted features of the lip sequence image according to the trained recognition model from the features of the learned lip sequence image to the lip language, and recognizing a lip language result. The mouth positioning accuracy is high, the calculation method is simplified, and the problem of information decline is better solved by adopting the bidirectional LSTM network.

Description

technical field [0001] The invention belongs to the field of lip language recognition, in particular to a Chinese lip language recognition method based on deep learning. Background technique [0002] With the development of artificial intelligence technology, audio-visual input in complex scenes, and simple spelling text input are a thing of the past. The proportion of speech recognition is gradually increasing, and it is becoming the mainstream natural interaction method. However, pure voice interaction is easily affected by the environment and prone to noise interference, such as noisy outdoor roads, human voice disputes in conference rooms, engine or air-conditioning noise in car scenes, etc., will be greatly reduced There is a clear gap in the accuracy of speech recognition and user experience. In order to improve the problem of inaccurate speech recognition, lip recognition technology has emerged. Lip language recognition technology refers to the scheme of identifying...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
12 Nov 2019
Publication
CN110443129A
IPC
G06K9/00; G10L15/25
CPC
G10L15/25; G06V40/171; G06V40/172; G06V40/161
Inventors
林旭东; 徐俊华