Lip language recognition method and device based on deep learning

A technology of deep learning and recognition method, applied in the field of lip language recognition, can solve the problem of low voice recognition accuracy, and achieve the effect of solving the low voice recognition accuracy and improving the recognition accuracy

Pending Publication Date: 2019-04-16
ONE CONNECT SMART TECH CO LTD SHENZHEN
View PDF6 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the embodiment of the present invention provides a lip recognition method and device based on deep learning to solve the problem of low speech recognition accuracy in noisy environments in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Lip language recognition method and device based on deep learning
  • Lip language recognition method and device based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] In order to better understand the technical solutions of the present invention, the embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0020] It should be clear that the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0021] Terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. As used in the embodiments of the present invention and the appended claims, the singular forms "a", "said" and "the" are also intended to include the plural forms unless the context clearly indicates otherwise.

[0022] It should be understood that the term "an...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a lip language recognition method and device based on deep learning. The method includes the following steps that a voice signal and a video of a user are obtained, and the video is obtained by shooting the face of the user when the user sends the voice signal; the voice signal is identified by the voice recognition technology, and a first text is obtained; a to-be-recognized lip image sequence is obtained from the video; a lip feature vector is extracted from the to-be-recognized lip image sequence, and a second text is obtained according to the lip feature vector; the first text is corrected according to the second text, and a text corresponding to the voice signal of the user is obtained. According to the technical scheme, the problem of low accuracy of voice recognition in a noisy environment of the prior art can be solved.

Description

【Technical field】 [0001] The present invention relates to the technical field of lip language recognition, in particular to a lip language recognition method and device based on deep learning. 【Background technique】 [0002] At present, the commonly used human-computer interaction methods on the market are keyboard or voice input. In some noisy environments, the acquired user voice is mixed with environmental noise, and the process of recognizing the user's voice will be affected by the environmental noise, resulting in voice The recognition accuracy is low. [0003] Therefore, how to improve the accuracy of speech recognition in noisy environments has become one of the problems to be solved urgently. 【Content of invention】 [0004] In view of this, the embodiments of the present invention provide a lip recognition method and device based on deep learning to solve the problem of low speech recognition accuracy in noisy environments in the prior art. [0005] In order to ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L15/02G10L15/06G10L15/20G10L15/25G10L15/26G06K9/00G06K9/62
CPCG10L15/02G10L15/06G10L15/20G10L15/25G10L15/26G06V40/171G06V40/20G06F18/22G06F18/253
Inventor 高立志
Owner ONE CONNECT SMART TECH CO LTD SHENZHEN
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap