Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A lip recognition method and system based on neural network

A neural network and recognition method technology, applied in the field of lip language recognition methods and systems based on neural networks, can solve the problems of low accuracy of lip language recognition results, only 20%-60%, etc.

Inactive Publication Date: 2019-03-01
HUAQIAO UNIVERSITY
View PDF2 Cites 38 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Most of the traditional lip language recognition schemes include mouth detection, mouth segmentation, mouth normalization, feature extraction and construction of lip language classifiers. However, the performance of traditional lip language recognition schemes is not satisfactory, and the accuracy of lip language interpretation The rate is only 20%-60%, and the accuracy of lip recognition results is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A lip recognition method and system based on neural network
  • A lip recognition method and system based on neural network
  • A lip recognition method and system based on neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments. In particular, the following examples are only used to illustrate the present invention, but not to limit the scope of the present invention. Likewise, the following embodiments are only some but not all embodiments of the present invention, and all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0043] The present invention provides a lip language recognition method based on a neural network, which can recognize videos without being affected by environmental noise interference, and recognize lip language results. The recognized lip language results have a higher accuracy and better user experience. good.

[0044] See figure 1 , figure 1 It is a schematic flow chart of an embodiment of the neural network-based lip word recognition method o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a lip recognition method and system based on a neural network. The method comprises: a lip sequence image is acquired, and further from the acquired lip serial images, the feature of lip image is extracted, and then inputting the extracted features of the lip sequence images to the bi-directional long-short time memory network for time-space feature sequence learning, and training the features of the learned lip serial images, training features of the learned lip sequence image to a lip recognition model, and decoding and recognizing features of the extracted lip sequence image according to the trained lip sequence image features to the lip recognition model to recognize a lip result. By using the above method, it is possible to recognize the video without being influenced by the environmental noise, and recognize the lip language result, which has a high accuracy rate and a good user experience.

Description

technical field [0001] The invention relates to the technical field of lip recognition, in particular to a neural network-based lip recognition method and system. Background technique [0002] With the development of artificial intelligence technology, audio-visual input in complex scenes, and simple spelling text input are a thing of the past. The proportion of speech recognition is gradually increasing, and it is becoming the mainstream natural interaction method. However, pure voice interaction is easily affected by the environment and prone to noise interference, such as noisy outdoor roads, human voice disputes in conference rooms, engine or air-conditioning noise in car scenes, etc., will be greatly reduced There is a clear gap in the accuracy of speech recognition and user experience. [0003] In order to improve the problem of inaccurate speech recognition, lip recognition technology has emerged. Lip language recognition technology refers to the scheme of identifyi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00
CPCG06V40/161G06V40/20
Inventor 杜吉祥蔡微微张洪博
Owner HUAQIAO UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com