Mouth shape image recognition system based on machine learning and method of identifying sound production through face line

A technology of image recognition and machine learning, which is applied in the field of mouth shape image recognition system based on machine learning for the deaf-mute, through facial pattern recognition, can solve the problems of limited practicality, reading voice, poor real-time performance, etc. Handling the Effects of Transformations

Inactive Publication Date: 2018-08-24
SHENZHEN DBK ELECTRONICS
View PDF10 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

It can only be input through text, and cannot read the sound through lip language, wh

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Mouth shape image recognition system based on machine learning and method of identifying sound production through face line

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In order to make the technical problems solved by the present invention, the technical solutions adopted, and the technical effects obtained easy to understand, the specific implementation manners of the present invention will be further described below in conjunction with the specific drawings.

[0033] like figure 1 Shown, a kind of mouth shape image recognition system based on machine learning comprises mouth shape video graphic acquisition module 1, video analysis module 2, main control module 8, mouth shape model matching module 4 and voice output module 5; Described lip shape video graphic acquisition module 1. The video analysis module 2, the main control module 8, the mouth shape model matching module 4 and the voice output module 5 are electrically connected in sequence, and also includes a mouth shape model library module 7, and the mouth shape model library module 7 is electrically connected with the main control module 8 .

[0034] The lip shape video image...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a mouth shape image recognition system based on machine learning. The mouth shape image recognition system based on machine learning comprises a mouth shape video image acquisition module, a video analysis module, a main control module, a mouth shape model matching module and a voice output module. The mouth shape video image acquisition module, the video analysis module, the main control module, the mouth shape model matching module and the voice output module are electrically connected in sequence. The system further comprises a mouth shape model library module, whichis electrically connected with the main control module. The mouth shape video image acquisition module acquires a lip video image of a target person through a front camera arranged in the image acquisition module. The invention also provides a method of identifying sound production through face lines. According to the invention, lip language is converted into image information through the camera,and information processing and conversion can be rapidly carried out. The system has a deep learning function, can be gradually adapted to expression habits of a user, and has certain real-time performance and practicability.

Description

technical field [0001] The invention relates to a system for recognizing the sound produced by lip language, especially suitable for deaf-mute people, belongs to the field of electronic technology, and specifically relates to a machine learning-based mouth shape image recognition system. The invention also provides a face recognition system. Pattern recognition method of vocalization. Background technique [0002] Most of the current deaf-mute interactive devices are realized through information collection and comparison of sign language images. mobile phone" patent. It can only be input through text, and cannot read the sound through lip language, which greatly limits the practicability. Poor real-time performance, not easy to use. Contents of the invention [0003] In order to solve the problems existing in the prior art, the present invention provides a mouth shape image recognition system that can directly make the sound that others want to make through the collecti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06N99/00G09B21/00G10L13/08G10L15/25G10L15/26
CPCG06N20/00G09B21/00G09B21/009G10L13/08G10L15/25G10L15/26G06V40/176
Inventor 曾金辉
Owner SHENZHEN DBK ELECTRONICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap