Lip language recognition method and device, storage medium and mobile terminal

A recognition method and mobile terminal technology, applied in the field of information processing, can solve the problems of low voice recognition accuracy, leakage of user privacy, inconvenience, etc., and achieve the effects of improving human-computer interaction experience, fast lip recognition, and improving accuracy

Inactive Publication Date: 2018-09-14
GUANGDONG OPPO MOBILE TELECOMM CORP LTD
View PDF3 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, at present, most terminal devices rely on keyboard input, handwriting input, and voice input to perform human-computer interaction, which is not convenient in many cases and cannot well reduce the interference of the external environment on users.
For example, if voice input is performed in a noisy environment, the voice recognition accuracy is low, the effect is poor, and the user's privacy is easily leaked

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Lip language recognition method and device, storage medium and mobile terminal
  • Lip language recognition method and device, storage medium and mobile terminal
  • Lip language recognition method and device, storage medium and mobile terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The technical solution of the present application will be further described below in conjunction with the accompanying drawings and through specific implementation methods. It should be understood that the specific embodiments described here are only used to explain the present application, but not to limit the present application. In addition, it should be noted that, for the convenience of description, only some structures related to the present application are shown in the drawings but not all structures.

[0025] Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the steps as sequential processing, many of the steps may be performed in parallel, concurrently, or simultaneously. Additionally, the order of steps may be rearranged. The process may be terminated when its operations are complete, but may also hav...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An embodiment of the invention discloses a lip language recognition method and device, a storage medium and a mobile terminal. The method comprises the steps as follows: when detecting that a lip language recognition event is triggered, acquiring at least one 3D lip image of a current user through a 3D camera; inputting the at least one 3D lip image into a pre-trained lip language recognition model; determining lip language information corresponding to the 3D lip image according to an output result of the lip language recognition model; providing the lip language information for the current user. With the adoption of the technical scheme, simple and rapid lip language recognition can be performed on 3D lip images through the pre-constructed lip language recognition model, the lip languagerecognition accuracy is further improved, the human-machine interaction experience of the user is effectively improved, and the demand of the user is better met.

Description

technical field [0001] The embodiments of the present application relate to the field of information processing technologies, and in particular to lip recognition methods, devices, storage media and mobile terminals. Background technique [0002] With the rapid development of electronic technology and the improvement of people's living standards, terminals such as smart phones and tablet computers have become an indispensable part of people's lives. At the same time, it is becoming more and more important to perform human-computer interaction (Human-Computer Interaction, HCI) with terminal equipment more humanely. [0003] However, at present, most terminal devices rely on keyboard input, handwriting input, and voice input to perform human-computer interaction, which is not convenient in many cases and cannot well reduce the interference of the external environment on users. For example, if voice input is performed in a relatively noisy environment, the voice recognition ac...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/20G06F18/214
Inventor 陈岩刘耀勇
Owner GUANGDONG OPPO MOBILE TELECOMM CORP LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap