3 results about "Phonation" patented technology

The present invention proposes a laryngeal paralysis diagnosis auxiliary method combined with audio and video processing, comprising the following steps: obtaining an original laryngoscope video with audio information and video information; predicting the audio information through a keyword recognition model to extract an effective phonation segment, and obtaining a first laryngoscope segment corresponding to the effective phonation segment from the original laryngoscope video segment according to the matching relationship between the audio information and the video information; detecting and identifying the glottis area in the first laryngoscope segment, and segmenting the glottis area from the first laryngoscope segment; marking the glottis area and calculating the physical properties of the glottis area, the physical properties including one or more of the glottis area area, vocal cord opening and closing angle, and vocal cord width. The present invention uses a multimodal analysis method combined with audio and video to segment the laryngoscope video, extract key video segments, and provide a variety of objective evaluation indicators for doctors to refer to, thereby improving diagnostic efficiency and quality.

The present invention relates to a soft, flexible, and communicative device for patients with laryngectomy and its method thereof The present invention discloses the fabrication of soft, lightweight, skin-compatible, and reusable device for silent speech interfaces (SSIs). It further comprises the unique feature to recognize speech-related information using surface electromyography (sEMG). sEMG-based speech recognition operates on signals recorded from a set of sEMG sensors that are strategically located on the face (with the help of desired form factor) and measure muscle activity associated with the phonation, resonation, and articulation of speech. sEMG sensors are printed onto strategical locations on soft, stretchable, and biocompatible membrane shaped into a form-factor of a face mask. The silent speech interfaces (SSIs) can also be deployed in acoustically challenging environment or where privacy / confidentially is a desirable such as in defense or military application and it is cost effective with reliable speech recognition accuracy of 96.2%(>95 %).

A flexible liquid metal sensor and a voiced / unvoiced speech recognition system. The flexible liquid metal sensor attached to the throat is configured to detect a hybrid-modal signal consisting of laryngeal low-frequency muscle movements and acoustic vibrations during voiced or unvoiced speech of a person. By designing discrete and continuous sensor layouts to accurately capture the frequency of laryngeal vibrations during phonation and spatial distribution characteristics of muscle movements, pressure information in different directions and at different positions is measured. Laryngeal data acquisition and filtering are achieved by means of a signal acquisition and analysis system, so as to construct a relational dataset between laryngeal acoustic-vibration hybrid-modal signals and expressed speech semantics. By establishing a deep neural network training model based on time-frequency features to train the relational dataset, the content expressed by a person during voiced or unvoiced speech can be recognized, thereby meeting the requirements of persons with speech impairments and the general population for conveying the expressed content in environments where speech is impaired.