Silent lip language recognition method and system

A recognition method and lip language technology, applied in the field of information security, can solve problems such as inconvenient speech recognition

Active Publication Date: 2020-05-01
SHANGHAI JIAO TONG UNIV
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, it is not convenient for people to use speech recognition in some situations, such as occasion

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Silent lip language recognition method and system
  • Silent lip language recognition method and system
  • Silent lip language recognition method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] Such as figure 2 As shown, it is the 120GHz millimeter-wave radar sensing system that realizes the above-mentioned method that this embodiment relates to, and it has used the double-sided printed circuit board of 3.24 centimeters * 4.27 centimetres, and has frequency modulated continuous wave (FMCW ) and continuous wave (CW), both CW mode and FMCW mode allow radar interference, and the FMCW mode has ranging capability, which greatly expands the perception dimension. The sensing system uses SiliconRadar's TRX_120_001 radar radio frequency transceiver with a frequency range of 119.1GHz to 125.9GHz and a Tx power of -7dBm to 1dBm. The system includes: a power supply module and a power management circuit for providing 5v voltage, a radar transceiver in the form of a chip connected to the power supply module, a carrier generation unit and an intermediate frequency amplifying unit.

[0020] The power module includes a USB type-C connector and a low dropout voltage regulator...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a silent lip language recognition method and system. Millimeter wave signals serving as carriers are continuously sent out and focused on an oral cavity area of a user, the millimeter wave signals are modulated and partially reflected in phase through speaking behaviors of the user, reflected signals are converted to a base band and corrected, and then voice phase ambiguitylinear reconstruction based on triangular transformation is adopted to obtain speaking behavior information of the user. The method has the advantages of no contact, high penetrability, high precision and the like; fine displacement motion of the lip can be accurately tracked, and an accurate voice command can be well detected.

Description

technical field [0001] The invention relates to a technology in the field of information security, in particular to a silent lip recognition method and system based on a small 120 GHz interference radar system. Background technique [0002] As interaction with computer devices becomes more common, the trend is for interactions to become more natural and intelligent. As a result, a variety of natural user interface interfaces have been developed, such as touch screens, gaze tracking, gesture recognition, and speech recognition systems, with speech recognition receiving particular attention because it is similar to the way people issue commands in everyday life. However, it is inconvenient for people to use speech recognition in some situations, such as situations where silence should be maintained, or situations where privacy is expected to be protected in public places. In addition, some people may lose the ability to vocalize due to illness, and their need for verbal commu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L15/25
CPCG10L15/25Y02D30/70
Inventor 顾昌展温力
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products