119 results about "Speech sounds" patented technology

The invention provides a practical training method and system based on multi-modal Internet of Things perception and virtual-real symbiosis, and relates to the technical field of virtual-real symbiosis, and the method comprises the steps: collecting the multi-modal perception data of a practical training environment through a plurality of heterogeneous Internet of Things devices arranged in the practical training environment; constructing a three-dimensional digital twinborn model of the practical training environment according to the category and position information of the object in the practical training environment, the voice control instruction and the comprehensive environment parameters; the method comprises the following steps: setting training items and evaluation indexes in a virtual-real symbiotic training space, receiving a training item selection instruction input by training personnel, and loading a corresponding training item according to the selection instruction, and sending a control instruction of the practical training project to a virtual equipment model in the three-dimensional digital twinborn model and Internet of Things equipment mapped with the virtual equipment model in the practical training environment for practical training, and evaluating the practical training process and the practical training result of the practical training project according to the evaluation index after the practical training project is finished. And a training evaluation report is generated and fed back to the training management system.

The invention relates to the technical field of rehabilitation training, in particular to a multi-logic interaction system for speech disorder rehabilitation training, which comprises a voice accuracy analysis module, a voice mouth shape comparison module, a training item distribution module, a training difficulty adjustment module and a review interval optimization module. By capturing and analyzing the pronunciation information of the user in real time, pronunciation errors can be accurately recognized and corrected, the pertinence and efficiency of voice training are enhanced, a patient can visualize the pronunciation errors by combining voice data with a mouth shape image, and meanwhile, by comparing standard pronunciation images, the pronunciation errors can be accurately recognized and corrected. According to the method, integration of voice and visual information is enhanced, each patient can obtain a rehabilitation scheme meeting target requirements and ability through intelligent distribution of training content and time and dynamic adjustment of training difficulty, training distribution and difficulty adjustment are optimized, a user can train in a proper rhythm, and the training efficiency is improved. And the individuation level and the overall effect of speech disorder rehabilitation training are improved.

An estimation device includes: an instructor that instructs a speaker to repetitively utter two syllables containing (i) a sound including a velar plosive in a consonant or a sound including an alveolar fricative in a consonant, and (ii) a sound including an alveolar plosive in a consonant; a voice obtainer that obtains a voice of the speaker; an estimator that analyzes a voice feature of the voice obtained, and estimates an oral function of the speaker based on the voice feature analyzed; and a presenter that presents a condition of the oral function of the speaker which has been estimated.

The invention relates to the technical field of cough sound and pulmonary respiration sound processing and prediction, and discloses an intelligent pneumonia prediction system based on cough sound and pulmonary respiration sound. The sound collection module comprises a cough sound collection unit and a pulmonary respiration sound collection unit, and the cough sound collection unit is used for collecting cough sound and sending the cough sound to the server detection module through the data transmission module for pneumonia prediction; the pulmonary respiration sound collection unit is used for collecting pulmonary respiration sound of a user and sending the pulmonary respiration sound to the server detection module through the data transmission module for pneumonia prediction; a trained Transform model is carried in the server detection module and is used for converting the audio data transmitted by the data transmission module into pictures for processing and prediction. According to the system, an open-source cough and pulmonary respiration sound database is concluded and arranged, and available cough sound and pulmonary respiration sound data are selected to be used for training a classifier through a Transform-based voice machine learning algorithm; and the accuracy of predicting pneumonia by cough and pulmonary respiration sound higher than 80% is obtained.

The invention relates to the technical field of voice analysis, and particularly discloses a vocal music training method and system based on artificial intelligence, and the method comprises the steps: collecting and analyzing the body posture parameters of a target vocal music training person, carrying out the preprocessing, detecting the posture abnormality, forming a first abnormal training set, capturing and analyzing the pronunciation feature parameters, and recognizing the pronunciation abnormality, thereby obtaining a vocal music training result; and integrating the first abnormal training set and the second abnormal training set to generate a total abnormal parameter training set, matching a correction set, and visually displaying the body posture abnormal degree and the abnormal reason and the pronunciation abnormal degree and the reason, so that the target vocal music training personnel can visually see own posture and pronunciation problems, and self-adjustment and correction are facilitated.

A patient interface of a respiratory therapy system is provided, and includes a mask body; a mask seal secured to the mask body and configured to form a seal with the user's face, at least around the user's mouth; the mask body and mask seal being arranged to define an interior breathing chamber of the patient interface; and an inlet to the breathing chamber configured to receive a flow of breathable gases into the breathing chamber. To assist in allowing a user to speak clearly whilst wearing / using the patient interface, a user actuatable speech valve is provided on the patient interface and is operable to selectively occlude and open a speech flow path from the breathing chamber to atmosphere when the user wishes to speak.

An estimation method includes: obtaining a first voice feature group of a plurality of persons who speak a first language; obtaining a second voice feature group of a plurality of persons who speak a second language; obtaining a voice feature of a subject; correcting the voice feature of the subject according to a relationship between the first voice feature group and the second voice feature group; estimating, from the voice feature of the subject that has been corrected, an oral function or a cognitive function of the subject by using an estimation process for an oral function or a cognitive function based on the second language; and outputting a result of estimation of the oral function or the cognitive function of the subject.

A processor-implemented method for speech sensing is disclosed. A tongue position sensor (TPS) is embedded palatally in an oral cavity of a person. The TPS detects tongue movement of the person. A barometric sensor and an inertial measurement unit (IMU) sensor are both located in the oral cavity of the person and coupled to the TPS. The TPS, barometric sensor, and IMU sensor together form an intraoral mouthpad that can detect tongue movements, jaw and / or head movements, and breathing of the person. Input from the mouthpad can be analyzed on a processor coupled to the mouthpad. The processor and the mouthpad combine to form an intraoral speech sensing complex. The complex can sense human speech based on the processor output. The complex can sense normal, low-volume, or silent speech of the person. The complex can provide non-blocking audio feedback to the person through a bone conduction speaker.

The utility model discloses a lip muscle strength training device, including movable plate, locating plate, pressure monitoring mechanism, host and feedback panel, movable plate and locating plate are respectively arranged on the same side of host and can be close to each other when being pressed, pressure monitoring mechanism is installed between movable plate and locating plate, and feedback panel is installed on the host. The feedback panel is arranged on the outer wall of the main machine and provided with a voice prompt module and / or a visual prompt module capable of prompting lip muscle strength training, and the main machine is electrically connected with the pressure monitoring mechanism and the feedback panel. The lip strength training device has the advantages that the lip strength training device is suitable for lip strength training of dysarthria or dysphagia, pronunciation clarity can be improved, salivation can be avoided, and swallowing efficiency can be improved.

The invention relates to the technical field of English pronunciation learning, and discloses an AI (artificial intelligence) English learning system capable of correcting pronunciation. The system comprises a multi-source voice acquisition layer, an acoustic feature analysis layer, a pronunciation quality evaluation layer, a correction decision generation layer and a biological feedback execution layer. The multi-source voice acquisition layer captures a multi-channel sound wave signal and a maxillofacial electromyographic signal in real time when a user pronounces, and generates an original pronunciation data stream; the acoustic feature analysis layer performs time-frequency domain conversion on original data, separates multi-scale acoustic features and constructs a three-dimensional feature tensor; the pronunciation quality evaluation layer compares the standard template library to output scores and phoneme offset vectors; the correction decision generation layer constructs a pronunciation error topological graph and generates a correction instruction set containing tongue position, airflow and vocal cord parameters; and the biological feedback execution layer synchronously monitors the physiological response and updates the weight of the template library. According to the system, accurate acquisition, analysis, evaluation, correction and dynamic optimization of pronunciation learning are realized, and the English pronunciation learning effect is improved.

The embodiment of the invention provides a sound production device based on ultrasonic recognition, and the device comprises a transmitting type ultrasonic transducer which is used for transmitting an ultrasonic signal; the emission type ultrasonic transducer is installed in the oral cavity or the nasal cavity of a user or installed on the neck or the lower jaw of the user. The receiving type ultrasonic transducer is used for collecting ultrasonic signals; the analog-to-digital converter is used for converting the ultrasonic signal into a digital signal; the coding chip is used for coding the digital signal to obtain a coded signal; the processing module is used for performing voice recognition on the coded signal based on a voice recognition algorithm to obtain a synthesized voice signal; and the voice emitting module is used for driving a loudspeaker to emit a sound based on the synthesized voice signal. Therefore, the sound made by the user is more natural and rich in emotion, the communication efficiency of the user is improved, and the experience feeling of the user is improved.

The invention discloses an intelligent exoskeleton bone auxiliary conduction hearing aid system capable of being remotely controlled and having an electroencephalogram control function, and relates to the technical field of intelligent rehabilitation robots and hearing aid devices. The wearable mechanical part comprises a flexible actuator, an elastic fabric base material, an inertial measurement unit IMU, a plantar pressure sensor array, a surface myoelectricity EMG sensor and an electroencephalogram EEG sensor. And the information processing communication part comprises a central controller, a bone conduction hearing aid module, a multi-mode sensor, an embedded SoC, a DSP / AI accelerator, a 4G / 5G / Wi-Fi module and a power management unit. The flexible exoskeleton walking aid system and the bone conduction hearing aid module are integrated, the electroencephalogram EEG sensor is additionally arranged to achieve the electroencephalogram control function, and cooperation of the three functions of movement assistance, auditory perception and neural intention recognition is achieved. A user can directly control the exoskeleton action mode through electroencephalogram signals, meanwhile, intelligent assistance of lower limb joints is obtained in the walking process, and environment sounds and voice prompts are clearly received in a bone conduction mode. According to the system, the perception ability, the control flexibility and the social participation degree of old people or rehabilitation patients who are inconvenient to move and accompanied with hearing impairment in a complex environment are remarkably improved, and more natural and convenient man-machine interaction experience is provided for users.

An acoustic face mask reduces the distortion and muffling of speech sounds by a face mask wall. The distortion and muffling of speech sounds by a face mask wall may be reduced by reducing the acoustic coupling of the vocal tract and / or nasal cavity to the face mask chamber, which causes a reduction in the intelligibility of the speech. The acoustic coupling of the vocal tract and / or nasal cavity to the face mask chamber may be reduced, for example, by reducing the reflected sound energy caused by the face mask wall. For example, one or more sound absorbing members or acoustically transparent members reduce the reflected sound energy caused by the face mask wall.

A method for generating speech includes uploading a reference set of features that were extracted from sensed movements of one or more target regions of skin on faces of one or more reference human subjects in response to words articulated by the subjects and without contacting the one or more target regions. A test set of features is extracted a from the sensed movements of at least one of the target regions of skin on a face of a test subject in response to words articulated silently by the test subject and without contacting the one or more target regions. The extracted test set of features is compared to the reference set of features, and, based on the comparison, a speech output is generated, that includes the articulated words of the test subject.

The present invention relates to an apparatus (10) for the self-administration of therapies for the treatment of speech disorders comprising a stimulus delivery device (11,12) with a horizontal development substantially curved along an angular portion so as to outline a portion of a circle, comprising at least one panel (11) for the delivery of visual stimuli spatially distributed in an angular range substantially equal to the angular portion of horizontal development of the stimulus delivery device (11,12); at least one acoustic source (12) for the delivery of acoustic stimuli spatially distributed in an angular range substantially equal to the angular portion of horizontal development of the stimulus delivery device (11,12); and a local electronic processing unit configured to control the generation of visual and acoustic stimuli by means of the at least one panel (11) and the at least one acoustic source (12), and characterized in that it comprises at least one first acoustic detector (15) for detecting a reproduction of a verbal element produced by the patient, wherein the at least one first acoustic detector (15) is carried by the at least one panel (11) and positioned so as to detect acoustic signals generated in a space inside the portion of circle outlined by the stimulus delivery device (11,12).

Voice-interaction massage device for massaging at least one penis, comprising the following: a housing comprising a first massage chamber and a second massage chamber, each of the first massage chamber and the second massage chamber being configured to accommodate at least part of the penis; a massage module incorporated in the housing, wherein the massage module is configured to massage at least a part of the at least one penis that is inserted into at least one of the two massage chambers; a loudspeaker; and a first sensor configured to detect movements of the penis in the first massage chamber; a control unit that is electrically connected to the speaker and the first sensor; the control unit, as soon as the first sensor detects movements of the penis in the first massage chamber, activates the speaker to output an initial voice message.

1. The name of the product of this design: Voice Valve (II). 2. Purpose of the product with this appearance design: used for postoperative breathing, speech, swallowing and other rehabilitation training for tracheotomy patients. 3. The design key point of this appearance design product lies in the shape. 4. The picture or photo that best illustrates the design points: three-dimensional picture.

The application provides a model training method and a bipolar disorder personalized treatment dialogue generation method and device, belonging to the technical field of deep learning, aiming at the problems that the current diagnosis accuracy of bipolar mood disorder is not high and the matching of treatment dialogue with patients is poor, the model training can be performed on a multi-modal language model according to a voice signal with significant characteristics of bipolar mood disorder, and a target classification model for bipolar mood disorder classification is obtained. Since the voice signal contains characteristics such as semantics, tone, pronunciation rhythm and other characteristics directly related to bipolar mood disorder expressed by the patient, the target classification model can be used for accurate classification of bipolar mood disorder, and when the target classification model is used for classification of bipolar mood disorder, the excessive dependence on the subjective diagnosis of doctors can be avoided, and the accuracy of the classification prediction of bipolar mood disorder is effectively improved.

The present invention discloses a data processing method and system for multimodal facial motion point data and vocal cord motion data. The method includes providing text, collecting continuous facial images or videos and laryngeal vibration data of a normal person speaking, preprocessing the data, extracting temporal and spatial features, establishing a facial and neck motion model for Chinese pronunciation, and having a deaf-mute person imitate the pronunciation according to the model and obtain feedback. The system includes a depth camera, a laryngeal vibration sensor, and a microphone. By comprehensively utilizing multimodal data, it provides instant feedback to the deaf-mute, lowers the learning threshold, and improves communication efficiency. It is applicable to deaf-mute groups worldwide. This invention promotes speech vocalization training and has broad application prospects and social significance.

The present disclosure relates to a speech disorder detection method, device, equipment and readable storage medium. By acquiring standard audio-visual materials, in response to the pronunciation operation of the to-be-detected object to the standard audio-visual materials, multi-modal pronunciation data is collected, audio acoustic features are extracted based on the pronunciation audio, video visual features are extracted based on the video of the face and oral cavity activity, the audio acoustic features, the video visual features and the demographic information coding data are fused to obtain a fusion feature vector, and based on the fusion feature vector and a pre-trained prediction model, a speech disorder detection result of the to-be-detected object is obtained. Compared with the prior art, the embodiment of the present disclosure can improve the accuracy and comprehensiveness of speech disorder detection, improve the diagnosis efficiency, reduce the dependence on professionals, reduce the burden of medical resources, and clearly determine the specific type of pronunciation problem, thereby providing a scientific basis for subsequent individualized intervention treatment.

A machine learning based patient voice monitoring and analysis system can reduce the need for patient hospitalization by early detection and treatment of health conditions such as acute decompensated heart failure.

The invention relates to the technical field of children language rehabilitation training, and provides a children language rehabilitation training system based on voice and mouth shape recognition, which comprises a mouth shape simulation frame, a voice and mouth shape recognition module, a voice and mouth shape recognition module and a voice and mouth shape recognition module, an external camera is used for tracking and simulating the lips and the face of the training object in a model animation mode; and the tracking and capturing module is used for collecting face data of the training object and feeding back the face data to the model of the simulation mouth shape frame so as to fit the face of the training object and improve the training conformity. According to the invention, specific facial features and mouth shapes of each child can be individually fitted, customized rehabilitation training is provided, the mouth shapes of the children can be better fitted, more accurate pronunciation mouth shapes can be guided to be made, meanwhile, guide animations and roles which attract the attention of the children can be generated, the participation degree of the children is improved, the rehabilitation training is more interactive and interesting, and the interestingness of the children is improved. And the language learning interest and effect of the children can be improved.

The present invention relates to a method for generating a mouth shape by using a deep learning network, and comprises the steps of: receiving a face image as an input; generating a mouth shape of the face image into a preset mouth shape by using a first mouth shape generation preprocessing deep learning model; receiving speech information as an input; generating the preset mouth shape into a mouth shape synchronizing with the speech information by using a second mouth shape generation preprocessing deep learning model; and transforming the mouth shape synchronizing with the speech information into high definition by using a high definition transform postprocessing deep learning model.

Hydration of a larynx and / or vicinity with a composition comprising a salt formulation (e.g., CaCl2), MgCl2, KCl and / or NaCl) can achieve prophylactic and / or therapeutic effects (e.g., cough suppression, improving voice quality, increasing pulse oxygen saturation and / or increasing mucosal vaccination effectiveness). The composition is administered as dry particles (e.g., aerosol) or as a liquid (e.g., solution, aerosol). The liquid can have a pH of 7.0 up to around 10.0, or preferably around 7.5 up to around 9.5, or more preferably around 8.0 up to around 9.0, or even more preferably 8.0 to 8.5 or most preferably around 8.0. The droplets can have a mass median aerodynamic diameter from approximately 8 μm to approximately 15 μm or from approximately 15 μm to approximately 500 μm. A therapeutic dose (e.g., 0.5 mg to 4.0 mg mass of salt) is administered in response to an indication. Such can employ an osmolitically active composition.

The invention discloses a global nonlinear dynamics vocal cord model implementation method and system, and relates to the technical field of nonlinear dynamics and biomechanics, and the method comprises the steps: introducing a vocal cord tension coefficient, and constructing a left-right asymmetric coefficient; introducing a Brown random jitter factor to correct the left-right asymmetric coefficient so as to construct a global nonlinear dynamic vocal cord model; and introducing a river horse optimization module to realize dynamic updating of vocal cord model parameters. According to the method, the left and right asymmetric coefficients and the vocal cord tension coefficient are introduced, so that the dynamic change of the vocal cord structure can be represented more meticulously, particularly, the difference of the mass, the elastic coefficient and the damping coefficient of the left and right sides of the vocal cord is accurately described, and the dynamic tracking of the change of the vocal cord structure is realized; through the construction of a global nonlinear model, the local change of the vocal cord is combined with the overall dynamic behavior, the dynamic characteristics of the vocal cord under different sounding states or pathological conditions are reflected, and a finer modeling basis is provided for vocal cord disease diagnosis and voice research.

The invention discloses a digital human generation system and method based on a language model, and relates to the technical field of artificial intelligence. A complete digital human pronunciation modeling path from voice signal acquisition, formant frequency extraction, deviation analysis and pronunciation stability evaluation to motion compensation control and three-dimensional animation fusion is realized. Compared with the existing mode of driving the digital human pattern only based on energy envelope or mouth shape classification, the method has the advantages that the multi-frame formant frequency of the user voice is extracted and processed, so that the digital human can generate dynamic lingual surface and tongue tip actions according to the sound channel change in the real pronunciation process of the user; therefore, the physical correspondence and linguistic consistency of the pronunciation actions of the digital human are improved. According to the method, the direct mapping between the pronunciation characteristics and the three-dimensional tongue actions is realized, and the authenticity of the pronunciation animation of the digital human and the guidance in a teaching scene are remarkably improved.

According to an aspect of the present invention, there is provided a face mask, comprising: a frame defining a respiratory chamber, for receiving nose and mouth portions of a user, between a proximal end of the frame for interfacing with a face portion of the user and a distal end of the frame configured for allowing gas exchange with the environment; a vocal guide defined by a sectional portion of the frame, the guide comprising an arched nose ridge portion, side wall portions extending from the nose ridge portion and a base connecting the side wall portions, wherein the guide is configured with an inwardly-projecting contour located at one or more regions of each of the side wall portions so as to alter an output frequency response of sound waves travelling through the frame for improving speech intelligibility of the mask during use.

An object of the system according to the embodiment is to analyze a cry or an action of a pet and accurately convert an intention or an emotion into a human language.SOLUTION: A system includes a collection unit, an analysis unit, an estimation unit, and a conversion unit. The collection unit collects a cry or an action. The analysis unit analyzes the data collected by the collection unit. The estimation unit estimates an intention or a feeling on the basis of an analysis result obtained by the analysis unit. The conversion unit converts the intention or the feeling estimated by the estimation unit into human language.SELECTED DRAWING: Figure 1