Lip language recognition method and device

A recognition method and lip language technology, which is applied in the computer field, can solve the problems of indistinct lip motion distinction and prone to overfitting, and achieve the effect of increasing recognition accuracy and improving recognition accuracy

Pending Publication Date: 2022-01-28
NAT UNIV OF DEFENSE TECH
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This high-complexity feature space and the influence of similar visuophones make it more challenging to decode speech content through visual information of lip movements.
Moreover, it can be seen from the above that the current lip language recognition is essentially a multi-classification task. Since the movement of the lips is subtle when speaking, the lip movement between different sentences is not clearly distinguished, which makes it extremely easy in the classification task. Overfitting occurs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Lip language recognition method and device
  • Lip language recognition method and device
  • Lip language recognition method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] Below, specific embodiments of the present invention will be described in detail in conjunction with the accompanying drawings, but they are not intended to limit the present invention.

[0042] It should be understood that various modifications may be made to the embodiments disclosed herein. Accordingly, the following description should not be viewed as limiting, but only as exemplifications of embodiments. Those skilled in the art will envision other modifications within the scope and spirit of the disclosure.

[0043] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and, together with the general description of the disclosure given above and the detailed description of the embodiments given below, serve to explain the embodiments of the disclosure. principle.

[0044] These and other characteristics of the invention will become apparent from the following description of prefe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a lip language recognition method and device, and the method comprises the steps of obtaining to-be-detected data which at least comprises a plurality of frames of continuous images related to a human face; inputting the to-be-detected data into a feature amplification network which is at least used for amplifying face features to obtain amplified data; and inputting the amplified data into a lip language recognition network for lip language recognition to obtain a lip language recognition result. According to the lip language recognition method, the lip language can be accurately and efficiently recognized, and the lip language recognition precision and efficiency are remarkably improved.

Description

technical field [0001] The embodiments of the present invention relate to the field of computer technology, and in particular to a lip recognition method and device. Background technique [0002] Lip language is also called visual language, which has irreplaceable application value in many fields. This technology can assist hearing-impaired people to communicate with others normally, and has broad application prospects in the fields of intelligent security and military intelligence. When the surrounding environment is noisy, or when the recording device is too far away from the target person, the effectiveness of speech recognition can be catastrophically affected. This is a common and difficult problem to solve. At this time, with the help of high-resolution cameras and visual lip recognition technology, the acquisition of target information can be achieved. In addition, lip language recognition technology can be used to generate the speaking face of the specified content...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06V40/20G06V40/16G06V10/72G06V10/764G06V10/774G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/049G06N3/08G06N3/047G06N3/044G06N3/045G06F18/10G06F18/2415G06F18/214
Inventor 刘丽张雪毅白亮盛常冲汤俊
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap