Lip-reading recognition method and mobile terminal

Abstract

An embodiment of the invention provides a lip-reading recognition method and a mobile terminal. The lip-reading recognition method is applied to the mobile terminal. The mobile terminal is provided with vocal modes and silent modes by means of setting. Deep neural networks are trained in the vocal modes. In the silent modes, the lip-reading recognition method includes starting the silent modes; acquiring lip images of users; recognizing contents according to the deep neural networks. The contents correspond to the lip images. The deep neutral networks are established in the vocal modes. According to the technical scheme, the lip-reading recognition method and the mobile terminal in the embodiment of the invention have the advantages that the deep neural networks are trained in the vocal modes, the contents corresponding to the lip images are recognized in the silent modes by the aid of the deep neural networks trained in the vocal modes, and accordingly the technical problems of incapability of protecting the privacy and influence on surrounding personnel due to vocal conversation of existing users in the prior art can be solved; the privacy of the users can be protected, influenceon surrounding people can be reduced, the training time further can be saved, and the training accuracy can be improved.

Description

technical field [0001] The embodiment of the present invention relates to the technical field of mobile communication, and in particular to a lip language recognition method and a mobile terminal. Background technique [0002] At present, mobile terminals such as mobile phones and tablet computers with a calling function all need local users to make voice calls during actual calls. [0003] The inventors found that in actual conversations, on the one hand, the content of mobile phone communication is private content in many cases, and the privacy of users cannot be protected by making voice calls involving private content; Suitable for answering the phone, for example: during a meeting or in a library, if a voice call is made, it will inevitably affect the normal activities of the surrounding people. Contents of the invention [0004] In order to solve the above technical problems, the embodiment of the present invention provides a lip language recognition method and a mo...

AI Technical Summary

Problems solved by technology

[0003] The inventors found that in actual conversations, on the one hand, the content of mobile phone communication is private content in many cases, and the privacy of users cannot be protected by making voice calls involving private content; Suitable for answering the phone, for example: during a meeting or in the library, if a voice call is made, it will inevitably affect the normal activities of the surrounding people

Images