Lip reading technology based lip language input method

Abstract

The invention relates to a lip reading technology based lip language input method, mainly aims at Chinese characters in common use and Arabic numerals, belongs to the intelligent computer identification technology, is a typical image mode analysis, understanding and classified calculation problem and relates to multiple subjects of mode identification, computer vision, intelligent human-computer interaction, cognitive science and the like. Shot mouth lip movement video is subjected to key frame extraction, normalizing processing is performed for extracted images by utilizing gray processing, median filtering, dynamic threshold binarization processing and scanning for noisy point removal, then eigenvectors are extracted to obtain parameters with lip characteristics and are matched with a lip model library to identify the images as a Chinese phonetic alphabet sequence, and finally an input method module is combined to obtain corresponding Chinese characters or Arabic numerals.

Description

technical field [0001] The invention relates to a lip language input method based on lip reading technology, which is mainly aimed at commonly used Chinese characters and Arabic numerals. It belongs to computer intelligent recognition technology and is a typical problem of image pattern analysis, understanding and classification calculation, involving pattern recognition, computer vision, intelligent human-computer interaction, cognitive science and other disciplines. According to the captured lip movement video, key frame extraction, image processing and feature vector extraction are used to obtain the parameters with lip shape characteristics, which are recognized as a sequence of Chinese pinyin letters, and finally combined with the input method module to obtain the corresponding Chinese characters or Arabic numerals . Background technique [0002] With the development of science and technology, people need more humanized human-computer interaction methods. Nowadays, al...

AI Technical Summary

Problems solved by technology

[0009] Harbin Institute of Technology, Institute of Acoustics, Chinese Academy of Sciences and other institutions in China are also committed to the research of this topic, but they are still in the stage of laboratory research. Therefore, in our country, we still need to increase the strength and speed of research in this area, and strive to commercialize the research results as soon as possible.

Images