Lip language recognition method and device, computer equipment and storage medium

A recognition method, lip language technology, applied in the field of biometrics, can solve problems such as inability to accurately recognize lip language

Pending Publication Date: 2019-09-24
PING AN TECH (SHENZHEN) CO LTD
View PDF6 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The embodiment of the present invention provides a lip language recognition method, device, computer equipment and storage medium to solve the problem in the prior art that the lip language corresponding to a video stream cannot be accurately recognized

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Lip language recognition method and device, computer equipment and storage medium
  • Lip language recognition method and device, computer equipment and storage medium
  • Lip language recognition method and device, computer equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0036] The lip recognition method provided by this application can be applied in such as figure 1 In an application environment in which a terminal device communicates with a server through a network. The terminal devices include, but are not limited to, various personal computers, laptops, smart phones, tablet computers and portable wearable devices. The server can be implemented by an independent server or a server cluster composed of multiple serve...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a lip language recognition method and device, computer equipment and a storage medium. The lip language recognition method comprises the following steps: carrying out standardization processing on a frame rate of an obtained original video, and separating the obtained standard video to obtain an effective audio stream and an effective video stream; tracking a human face in the effective video stream by using a human face recognition algorithm, extracting a mouth area in the human face, and obtaining a frame lip action video so as to obtain a lip image sequence; segmenting the lip image sequence by adopting a sequence segmentation rule to obtain a segmented image sequence; sequentially inputting the segmented image sequences corresponding to the lip image sequences into a lip image recognition model for recognition, and obtaining a lip image recognition result; inputting the effective audio stream into a speech recognition model to obtain a speech recognition result; and when the similarity between the lip image recognition result and the original video reaches a preset value, taking the lip image recognition result as a lip language recognition result of the original video so as to ensure the accuracy of the lip image recognition result.

Description

technical field [0001] The invention relates to the field of biological identification, in particular to a lip recognition method, device, computer equipment and storage medium. Background technique [0002] In recent years, lip language recognition has been widely used in public security fields such as intelligent human-computer interaction, audio damage, video surveillance, military and criminal investigation security, and has become a research hotspot in the industry. At the same time, it has very important practical significance in the field of hearing-impaired aphasia. Traditional lip language recognition technologies mostly use traditional algorithms such as HMM (Hidden Markov Model), LBP (Local Binary Pattern) of texture features, or deep learning algorithms such as convolutional neural networks. The input is a single frame The picture does not take into account the semantic information before and after the frame of the picture, only the spatial channel features are o...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G10L15/25
CPCG10L15/25G06V40/171G06V40/20
Inventor 王义文王健宗
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap