12 results about "Vocal organ" patented technology

The invention discloses a three-dimensional notation coding method and system based on spatio-temporal data fusion, and belongs to the technical field of data fusion, and the method comprises the steps: collecting geographic coordinates and environment voiceprints through Beidou, GPS positioning and COMSOL acoustic modeling, and constructing a sound-space correlation model; through OpenPose and MEMS sensors, limb motions, vocal organ motions and foot stamping intensity parameters are quantified, digital conversion of body memory is completed, and a three-dimensional music score visualization framework is constructed through AR and VR systems; the AR system uses the scanning mark as an interaction entrance, body movement guidance of the Shaanbei folk song and a stage movement design visual interface are matched through a space positioning technology, and dynamic association of a performer and a virtual scene is matched; the VR system generates personalized teaching feedback based on the motion capture data, and optimizes a learning path through real-time data analysis; and the virtual human model inputs action parameters of a three-dimensional notation method to realize automatic performance of non-peoples and folk songs.

The invention discloses a pronunciation optimization method and system based on voice visual feedback, and relates to the technical field of artificial intelligence auxiliary education, and the system comprises a reference model construction module, an acoustic feature analysis module, a phonetic path deviation analysis module and a visual navigation feedback module. The reference model building module, the acoustic feature analysis module, the articulation path deviation analysis module and the visual navigation feedback module are in communication connection with one another, and the reference model building module is used for offline building a database containing acoustic features of standard pronunciation and kinematics parameters of corresponding vocal organs; the acoustic feature analysis module is used for collecting user pronunciation in real time and analyzing acoustic features of the user pronunciation; the sound structuring path deviation analysis module is used for reversely calculating the actual sound organ movement path of the user according to the real-time acoustic characteristics of the user, and comparing the actual sound organ movement path with the reference model to obtain a deviation correction instruction; the problem of inaccurate guidance in the prior art is solved.

The invention belongs to the field of intelligent medical rehabilitation engineering, particularly relates to a speech recognition-based speech disorder adjuvant therapy system, and solves the problems of high pathological speech misjudgment rate, large dialect interference and single feedback in the prior art. A phoneme fault-tolerant threshold value is dynamically adjusted by constructing an adaptive speech recognition engine, regional features and pathological features are separated by using a dialect adaptation module, and three-dimensional simulation, AR real-time correction and touch graded vibration of vocal organs are realized in combination with a multi-modal feedback device; the pathological speech recognition precision is improved; and the neural remodeling efficiency is optimized.

The invention relates to an auxiliary system for individually correcting French vocal organ actions and a construction method. The system comprises a high-definition camera, an ultrasonic scanner, recording equipment and a computer, a standard voice library is stored in the computer; the standard voice library comprises standard pronunciation audios, standard pronunciation actions and standard lip actions; through cooperation of the high-definition camera and the computer and cooperation of the ultrasonic scanner and the computer, a combination of a face model and a vocal organ model in an oral cavity such as a tongue for a learner is constructed so as to simulate actions of vocal organs, closest to standard pronunciation, of the learner; when the auxiliary system compares the pronunciation of the learner with the standard pronunciation, not only is the difference in audio frequency included, but also the specific action difference of each pronunciation organ with more details is included; the learner can obtain the guidance which is most suitable for the individual condition so as to help the learner to master the pronunciation skill; according to the construction method, the learner can obtain guidance most conforming to the individual condition of the learner, so that the learner is helped to master pronunciation skills.

The invention relates to a multi-language automatic recognition method and system, and belongs to the technical field of language recognition, and the recognition method comprises the steps: receiving an original voice signal, and carrying out the preprocessing of the original voice signal, and obtaining a preprocessed voice frame sequence; synchronously extracting an acoustic feature vector, a vocal organ motion feature matrix and a rhythm feature vector from the voice frame sequence to form a feature triple; performing language family classification according to the acoustic feature vector and the vocal organ motion feature matrix, and outputting a candidate language family set; inputting the candidate language family set and the rhythm feature vector into a dialect clustering model, and outputting a refined dialect cluster tag; calculating an acoustic feature weight value, a vocal organ motion feature weight value and a rhythm feature weight value, and carrying out weighted operation on the feature triple to generate a weighted feature vector; and inputting the weighted feature vector and the refined dialect cluster label into a language decision model, and outputting a language recognition result containing a language label and a confidence value. According to the invention, the accuracy and robustness of multilingual recognition in a complex environment are improved.

The English pronunciation correction auxiliary system comprises a microphone for collecting English pronunciation input of a user, a storage unit for storing a standard English pronunciation model and historical pronunciation data of the user, a processor for comparing and analyzing the pronunciation of the user and the standard pronunciation in real time, and a feedback unit for outputting correction feedback information, the output end of the microphone is connected with the input end of the processor, the storage unit is in bidirectional connection with the processor, and the output end of the processor is connected with the input end of the feedback unit. According to the invention, accurate correction and visual guidance of pronunciation errors are realized through a multi-mode feedback mechanism. The pronunciation of the user can be compared with the standard model in real time, the motion difference of vocal organs is visually displayed through the dynamic mouth shape animation and the highlight mark, and the user is helped to quickly understand the error source. By continuously updating the user pronunciation data and continuously optimizing the analysis model, a personalized learning path is formed, and the pronunciation accuracy and learning efficiency are effectively improved.

The invention discloses a cross-modal silent voice reconstruction method and system based on ear canal air pressure micro-motion sensing, and belongs to the technical field of man-machine interaction and wearable computing. The method comprises the following steps: acquiring a non-acoustic air pressure sequence caused by vocal organ movement by using a micro air pressure sensing unit arranged in the in-ear earphone; constructing a robust feature space through adaptive baseline drift suppression and rhythm perception data enhancement processing; and further mapping the TPVS into a high-fidelity acoustic Mel spectrum by using an end-to-end deep neural network including domain adversarial adaptation, cross-modal semantic alignment, coarse-grained Mel spectrum generation and residual detail correction. The technical bottleneck that low-frequency mechanical signals lack high-frequency acoustic features is effectively broken through, and high-precision silent voice instruction analysis in a mobile and noise scene is achieved; and coupling quality evaluation gating and trigger type start / stop control are introduced at a reasoning end, so that invalid reasoning is inhibited and power consumption is reduced under the condition of poor wearing or no trigger.

To provide a pronunciation symbol display system, a pronunciation symbol display program and a voice output system for displaying pronunciation symbols capable of visually recognizing the image of a voice and suitably expressing various pronunciations.SOLUTION: In the symbol display section 21A, a plurality of graphic pronunciation symbols are displayed side by side, the graphic pronunciation symbols using consonant-oriented morphology symbols which are symbols imitating the morphology of the pronunciation organs and correspond to the articulation parts, vowel-oriented morphology symbols in which a component part representing the front-back position of the tongues by the position in the left-right direction and a component part representing the size of the gap from the upper jaw to the tongues by the position in the up-down direction are combined, and auxiliary symbols, and pronunciations output as voices can be represented by the graphic pronunciation symbols corresponding to the respective pronunciations.SELECTED DRAWING: Figure 2

The application relates to the technical field of speech recognition, in particular to a speech-based emotion recognition method, which comprises the following steps: according to an input speech signal, frame division and windowing are carried out. The application can obtain more profound insights into emotional expression by decomposing the input speech signal into two physical sources of glottal excitation and vocal tract response for independent modeling and analysis, obtaining a vocal tract transfer function set via linear predictive coding operation, and applying inverse filtering to the original speech signal to reconstruct an approximate glottal pulse sequence, effectively stripping the influence of vocal tract resonance on the signal, so that perturbation parameters, open quotient and closed quotient and the like representing vocal cord vibration patterns can be directly calculated, at the same time, the vocal tract transfer function set is used to identify and track the dynamic trajectory of the formant, and the phase difference cosine mean between adjacent frames is combined to quantify the sound production stability, and subtle dynamic adjustment and control stability of sound production organs such as the oral cavity and tongue position caused by emotional changes are captured.

The invention relates to the technical field of language teaching, and provides a multi-modal Chinese tone mouth shape auxiliary teaching system based on multiple attention mechanisms, and the system comprises a plurality of modules: a self-adaptive vocal cord vibration signal extraction module which is used for collecting and purifying a voice signal, extracting a fundamental frequency and scoring; the multi-scale tone feature fusion module receives the fundamental frequency signals and scores, extracts features and constructs vectors; the hierarchical tone recognition module processes the feature vectors through a neural network and an attention mechanism, recognizes tones and extracts voiceprint features; the personalized vocal organ motion modeling module selects and generates a personalized vocal organ motion model based on vocal print features; the mouth shape and tongue position dynamic generation module creates a three-dimensional visual mouth shape animation; the pronunciation feedback guidance module compares the pronunciation of the user with the standard pronunciation and provides multi-modal feedback; the tone recognition accuracy is improved through the adaptive signal extraction technology, and an effective auxiliary tool is provided for Chinese teaching.

The application relates to a multilingual automatic recognition method and system, and belongs to the technical field of language recognition. The recognition method comprises the following steps: receiving an original voice signal and performing pretreatment to obtain a pretreated voice frame sequence; simultaneously extracting an acoustic feature vector, a vocal organ movement feature matrix and a prosody feature vector from the voice frame sequence to form a feature triple; performing language family classification according to the acoustic feature vector and the vocal organ movement feature matrix to output a candidate language family set; inputting the candidate language family set and the prosody feature vector into a dialect clustering model to output a refined dialect cluster label; calculating acoustic feature weight values, vocal organ movement feature weight values and prosody feature weight values, performing weighted operation on the feature triple to generate a weighted feature vector; and inputting the weighted feature vector and the refined dialect cluster label into a language decision model to output a language recognition result containing a language label and a confidence value. The application improves the accuracy and robustness of multilingual recognition in a complex environment.

A tool kit for assisting in learning or relearning the sounds of a language, in particular the French language, intended to be applied to the phonatory apparatus of a human subject, each of these tools comprising a functional part arranged at the end of a handle and shaped to come into contact with a given place of articulation among a plurality of predetermined places of articulation within the phonatory apparatus and to constrain one or more organs of said phonatory apparatus in a determined spatial configuration, each of said tools being associated with a set of consonants and comprising on its handle means for transmitting to the human subject information relating to this set of consonants simultaneously with the application of the tool. See Figure 7