91 results about "Vocal pitch" patented technology

The invention relates to a voice synthesis method and device, a computer readable medium and electronic equipment. The method comprises the steps that voice feature information of a multilingual textand language feature vectors of all languages in the multilingual text are acquired, and the voice feature information comprises phonemes, tones, segmented words and rhythm boundaries; and voice synthesis is performed according to the voice feature information and the language feature vector to obtain first audio information corresponding to the multilingual text. Therefore, the accuracy and understandability of the first audio data are improved, and a user can quickly understand the text content corresponding to the first audio data. In addition, pause can be carried out at the natural rhythmboundary during speech synthesis, so that the naturalness and fluency of the first audio information can be improved. Besides, the voice synthesis method can realize smooth conversion of different languages, supports voice synthesis of texts of various languages, and does not limit specific languages, namely, has wide applicability.

The embodiment of the invention provides a Chinese mandarin character pronunciation conversion method based on self-attention mechanism. The Chinese mandarin character pronunciation conversion methodcan be used for direct prediction from Chinese sentences to pronunciation after tone change. According to the Chinese mandarin character pronunciation conversion method, multi-task learning and relative position coding are combined with a self-attention model, a self-attention mechanism is used for capturing the dependency relationship of characters in input sentences, and extra part-of-speech andthree pinyin attributes are introduced into multi-task learning to serve as sub-tasks; a tone transfer relationship is modeled by using CRF, and position information of a sequence is effectively modeled by relative position coding; finally, pronunciation can be obtained through a main task prediction result, and can also be a result of joint judgment of three pinyin attribute subtasks. Accordingto the method, the performance of Chinese mandarin character pronunciation conversion is improved to a great extent.

Systems and methods for scoring spoken Chinese are provided. In an exemplary method, a user reads a written transcript and the user's voice is recorded. Characters of the transcript are then represented as pinyins with tone markings. The voice recording is sectioned into individual phonemes that are aligned with the phonemes of the pinyins. For each character of the transcript, a tone is determined for the phonemes in the voice recording corresponding to that character. That tone is scored as correct or incorrect by comparison to the tone marking associated with the pinyins for that character. The pronunciation of each phoneme of the voice recording is also scored relative to the corresponding phonemes of the pinyins of the characters of the transcript. Further scores for words and sentences can be developed from the tone and pronunciation scores and provided to the user with feedback.

The invention relates to the technical field of voice recognition, and provides a dialogue type voice recognition method and system, electronic equipment and a storage medium. The dialogue type voicerecognition method comprises the steps of obtaining a dual-channel audio of dialogue type voice, and performing compression reduction and channel separation on the dual-channel audio to obtain a single-channel original audio; performing framing processing on the original audio to obtain a plurality of audio frames, and performing cutting processing on the original audio according to the energy ofeach audio frame to obtain a plurality of effective audio segments; extracting Mel cepstrum features and tone features of the effective audio segments and speaker features of channels where the effective audio segments are located, and inputting the Mel cepstrum features, tone features and speaker features into a speech recognition model to obtain recognition results of the effective audio segments; and generating a voice recognition result of the original audio according to the recognition result of each effective audio segment. According to the invention, accurate cutting of the double-channel dialogue type voice can be realized, and the dialogue type voice can be accurately recognized under the condition of shielding surrounding noise.

The invention relates to a computer Chinese quick input method, for supporting the demand of quick input technique of nation, or the like, making input character with dialectal correct function, first sound recognition or the like. The invention comprises that 1, considering the key frequency of main area of keyboard, that the middle part is higher than the top part, the top part is higher than the lower part, the middle part is higher than around, 2, considering the flexibility of hand that right hand is higher than left hand, 3, considering the application frequency of initial and last consonants, and tons to consider code, 4, adding classify recognizing function on the punctuation mark, 5, directly inputting with little memory amount, large code volume, better combine effect, low repeat error, high input speed, and wide application.

The invention provides a vehicle, playing equipment thereof and an automatic multimedia playing control method. The playing equipment comprises a playing device, a microphone and a processor, whereinthe playing device is used for playing multimedia; the microphone is used for receiving a speech signal; the processor is respectively electrically connected with the playing device and the microphone, and used for identifying a scene intention corresponding to the speech signal received by the microphone according to a scene intention list, and controlling a multimedia playing state of the playing device according to the identified scene intention; and the scene intention list is a list of corresponding relations between the speech signals and the scene intentions. According to the mode of the equipment, the current user intention can be automatically identified; and when in special scenes where a user needs to make a call and the like, suspension, stopping or tone adjustment of the multimedia in playing can be automatically controlled, and the user does not need to operate manually.

The invention provides a Chinese tone recognition method based on time frequency crest line-Hough transformation. Chinese tone recognition is converted into classification of the change trend of a line segment in a time frequency distribution diagram so that a new Chinese tone recognition method and technique can be acquired. The method includes the steps that firstly, final voice signals carrying Chinese tones are expressed through the SPWVD time frequency distribution diagram and tone information is shown through a group of similarly-parallel time frequency crest lines in the time frequency diagram; secondly, due to the fact that the main time frequency crest line is a region with larger energy in the diagram, the change trend of different tones is reflected, and in order to reduce the calculated amount, treatment such as binaryzation, thresholding and refining is conducted on the time frequency distribution diagram, and a center line segment of the main time frequency crest line reflecting the change trend of the tones is acquired; thirdly, Hough transformation is conducted on the time frequency distribution diagram containing the center line of the main crest line, so that the intercept and included angle parameters of the center line of the main crest line are acquired; finally, the tone type is judged according to the intercept and the included angle of the line segment and the coordinate values of a start point and an end point of the line segment.

The invention relates to a computer Chinese (consonant-vowel double- click) tone-participative coding quick input method, developed by deep research mainly for the requirements of Ministry Of Labour And Social Security and Ministry of Information Industry for professional skills of Chinese short-hand experts on compute: the primary input 140 Chinese characters per minute, the medium input 180 Chinese characters per minute and the senior input 220 Chinese characters per minute. And the invention overcomes the defect that the traditional phonetic English small letters correspond to on-keyboard English capital letters to input Chinese characters, and adopts a truly original design solution, and proceeds in all cases from raising Chinese character input speed and makes computer Chinese character input reach the limit. And its main principle and features: 1. fully considering English key frequency of the main region of a keyboard, where the middle row is higher than the top row, the top row is higher than the bottom row, and the middle is higher than the four sides; 2. fully considering human hand flexibility, where the right-hand is higher than the left-hand; 3. fully considering use frequencies of initial consonants and vowels and make integral optimized settings from high to low corresponding to the keyboard frequency and flexibility of left and right hands; 4. fully considering rules of daily spoken language and written language and giving punctuations to part of speech classification recognizing function. And it has also features of visual input, strong regularity, low memory quantity, large coding capacity, good word composing effect, low repeated code rate, high input speed, etc.

The invention relates to a Chinese tone dichotic listening testing system. The system comprises a testee information managing module, a testing material selecting module, a testing parameter configuring module, a testee screening and training module, a dichotic listening testing module and a testing result storing module; the testee information managing module is used for inputting, inquiring, modifying and deleting basic information of a testee; the testing material selecting module is used for supplying and selecting a Chinese tone material; the testing parameter configuring module is used for configuring values of the signal-to-noise ratio and the response time which are adopted in testing; the testee screening and training module is used for screening the testee meeting the requirement and completing acquainting and training on testing content, testing processes and testing methods before testing; the dichotic listening testing module is used for simultaneously supplying testing signal pairs composed of same syllables and different tones to the left ear and the right ear of the testee respectively according to the dichotic listening normal form; the testing result storing module is used for storing the testing process and a testing result of the testee in a file.

The input method includes selector key, assertion key and phonetic input keys composed of 26 letters setup on digit key 2 to digit key 9. Initial consonants and finals selected by the spelling input keys are displayed on spelling display place of display screen as well as a group of relevant single Chinese character is displayed on display place of single character. Tone selection keys delete coincident characters. Selector key and assertion key chooses a character. Selector of number of associational words or phonetic input keys selects preferred phrase. The method reduces the number of time of pushing keys and the coincident characters since tone selection keys are introduced. The selector of number of associational words creates condition for choosing preferred phrase quickly.

The invention provides a spoken language evaluation method and device. The spoken language evaluation method comprises the steps: obtaining a to-be-evaluated audio and an evaluation text correspondingto the to-be-evaluated audio; determining an attribute characteristic value of each phoneme in the evaluation text and a posterior probability corresponding to each phoneme based on the to-be-evaluated audio and the evaluation text; extracting a pronunciation characteristic value corresponding to the evaluation text based on the evaluation text and the posterior probability corresponding to eachphoneme; generating a characteristic vector corresponding to each phoneme according to the attribute feature value and the pronunciation feature value of each phoneme; and inputting the characteristicvector corresponding to each phoneme into a spoken language evaluation model to obtain an evaluation result output by the spoken language evaluation model. According to the spoken language evaluationmethod provided by the invention, the pronunciation characteristic value corresponding to each phoneme is introduced, and the potential error of the current pronunciation can be accurately explored.Multi-dimensional characteristic information is provided for a spoken language evaluation model, and the judgment accuracy of initial consonants, final consonants and tones is improved.

The invention provides a spoken language pronunciation evaluation method and system for a minority language and a storage medium. The method comprises the steps of obtaining a target text, a pronunciation dictionary and a reading audio made by a user according to the target text; generating a phoneme decoding result and a phoneme alignment result by using a speech recognition model; performing sound beat analysis on the target text based on the language pronunciation characteristics to obtain a sound beat analysis result; performing pitch analysis on target voice data to obtain a pitch analysis result; obtaining an accuracy score, an intonation score and a tone score of a read audio, taking the intonation score as a second pronunciation evaluation result, and taking the tone score as a third pronunciation evaluation result; and fusing the accuracy score, the intonation score and the tone score to obtain a total score of sentence pronunciation. According to the method, voice is calculated and analyzed from multiple different dimensions such as accuracy, integrity, fluency, sentence segmentation, tone and intonation according to the pronunciation characteristics of the minority language to obtain an evaluation result.

The invention provides a voice interaction matching method, computer equipment and a computer readable storage medium, and the method comprises the following steps: obtaining a voice instruction, anddetermining text information corresponding to the voice instruction; determining pinyin information and tone information corresponding to the text information; and determining word and sentence information corresponding to the voice instruction in a preset word bank according to the pinyin information and the tone information. Through the technical scheme of the invention, the pinyin information and the tone information corresponding to the text information are determined, and the screened vocabularies can be further matched, so that the word and sentence information with higher matching degree with the voice instruction is obtained, and the voice interaction matching accuracy is improved.

The invention relates to Chinese character input method and its dedicated keyboard, it includes: Chinese Pinyin input, shaped input, tone and strokes input, tone input is based on the structure of Chinese characters to select importation tone denoted with a bond , stroke input is strokes of that word denoted by a bond behind in the tone ,this Chinese character input method compared with the existing Chinese character input method, it is the only with coding for whether the font or the pronunciation, and its expansibility, sorting retrieval and compatibility are better than the existing Chinese character input method, the Chinese character input method ia easy to learn, to remember, to promote, and convenient for the inquiry, retrieval, teaching and research;with software designed by the invention input method ,adding voice recognition technology, we can achieve human-machine interaction in Chinese, and even can directe robot in Chinese, a special keyboard is arrived according to operating frequency of using letters and connections among the input letters, it is conducive to touch-type quickly for the operator.

The invention discloses a voice tone recognition method and system based on a random forest, and the method comprises the steps: obtaining a to-be-recognized voice signal, and carrying out the preprocessing of the to-be-recognized voice signal; extracting and selecting characteristic parameters of the preprocessed voice signal to be recognized; and inputting the extracted feature parameters into apre-trained random forest model, and outputting a tone recognition result of the to-be-recognized voice signal. The random forest has the advantages of being easy to implement, high in operation speed, high in anti-noise capacity and the like, can be well applied to tone recognition, and can reduce the operation complexity of the tone classifier to the minimum while ensuring the recognition accuracy.

The invention relates to the technical field of electric data processing, and specifically relates to a Chinese character input method, a voice synthesis method, a mandarin Chinese learning method, aChinese character input system and a keyboard. The Chinese characters are mapped by three-bit codes. The three codes are respectively used for mapping initial consonants, intermediate consonants and final consonants of Chinese characters. The vowel further comprises a children's sound. Spelling and reading of Chinese can be accurately realized. All the initial consonants, vowels and intermediate consonants are represented by only one code. In a simply spelling process, misunderstanding possibly caused by the existence of double finals is reduced, and preferably, input and word segmentation ofChinese tones can be realized while spelling is performed, so that the method can be conveniently applied to other fields such as Chinese learning and speech synthesis, Chinese learners can accuratelymaster pronunciation, tones and word tones of Chinese, and the pronunciation, tones and word tones of Chinese can be accurately displayed.

The invention discloses an evaluation system for a Chinese speech coding strategy of an artificial cochlea. A main hardware system comprises a speech signal acquisition module, a fundamental frequencydetection module, a signal preprocessing module, a frequency channel division module, a harmonic selection module, a frequency shift processing module, a filtering module, a speech synthesis module and a playing module. According to the invention, by adoption of Lin's six tones as a basic speech material and cooperation of four tones, the Lin's six tones are processed by using a to-be-tested Chinese speech coding strategy and played to a subject, so the hearing task of tone recognition is completed, and the correct rate of tone recognition is counted to evaluate the advantages and disadvantages of the to-be-tested Chinese speech coding strategy. Compared with a traditional speech test library, the evaluation system provided by the invention has less test content; and the evaluation systemis short in detection time, high in relative detection efficiency and low in cost, and can improve the treatment experience of the subject, inspect a Chinese speech coding algorithm and train and detect the tone recognition ability of hearing-impaired children.