127 results about "Viseme" patented technology

The disclosure describes methods for synthesis of accurate visible speech using transformations of motion-capture data. Methods are provided for synthesis of visible speech in a three-dimensional face. A sequence of visemes, each associated with one or more phonemes, are mapped onto a three-dimensional target face, and concatentated. The sequence may include divisemes corresponding to pairwise sequences of phonemes, wherein the diviseme is comprised of motion trajectories of a set facial points. The sequence may also include multi-units corresponding to words and sequences of words. Various techniques involving mapping and concatenation are also addressed.

The invention relates to an individualized singing sound synthesis method, including the following steps: building up a module of the coefficient of the line spectrum frequency of the sound and obtaining a relevant decision-making tree module through training; recording the reading sounds of a special subscriber to get the module of the coefficient of the line spectrum frequency of the sound of the subscriber; obtaining the attribute set relevant to the context of the lyric of the numerical notes, and pre-estimating the frequency parameters and the time duration data of initial consonant and vowels corresponding to the lyric according to the decision-making tree module and the module of the coefficient of the individualized line spectrum frequency; building up fundamental frequency data according to the numerical notes and combining the fundamental frequency data with the time duration and frequency parameters to obtain synthesized parameters; inputting the parameters into a parameterized sound synthesis vocoder, so that individualized singing sound can be synthesized. The method of the invention can synthesize synthesis sound with singing style by adjusting a few parameters of the rhythm and can synthesize singing sound by only recording a small reciting style library.

Facial animation values are generated using a sequence of facial image frames and synchronously captured audio data of a speaking actor. In the technique, a plurality of visual-facial-animation values are provided based on tracking of facial features in the sequence of facial image frames of the speaking actor, and a plurality of audio-facial-animation values are provided based on visemes detected using the synchronously captured audio voice data of the speaking actor. The plurality of visual facial animation values and the plurality of audio facial animation values are combined to generate output facial animation values for use in facial animation.

Synthesis of a moving picture of a face (e.g. to accompany synthetic speech) is performed by converting an input phoneme string into a sequence of mouth shapes or visemes. Specifically a shape is generated for each vowel and for each transition involving a consonant.

The method permits the animation of a synthesised model of a human face in relation to an audio signal. The method is not language dependent and provides a very natural animated synthetic model, being based on the simultaneous analysis of voice and facial movements, tracked on real speakers, and on the extraction of suitable visemes. The subsequent animation consists in transforming the sequence of visemes corresponding to the phonemes of the driving text into the sequence of movements applied to the model of the human face.

An enhanced arrangement for a talking head driven by text is achieved by sending FAP information to a rendering arrangement that allows the rendering arrangement to employ the received FAPs in synchronism with the speech that is synthesized. In accordance with one embodiment, FAPs that correspond to visemes which can be developed from phonemes that are generated by a TTS synthesizer in the rendering arrangement are not included in the sent FAPs, to allow the local generation of such FAPs. In a further enhancement, a process is included in the rendering arrangement for creating a smooth transition from one FAP specification to the next FAP specification. This transition can follow any selected function. In accordance with one embodiment, a separate FAP value is evaluated for each of the rendered video frames.

The invention relates to a Pinyin input method and a terminal thereof. The Pinyin input method is applied to a portable complete touch control screen terminal. The Pinyin input method comprises the following steps of: when entering a Pinyin input mode, displaying an initial consonant arrangement table and a plurality of vowel initials which are arranged at the periphery of each initial consonant key of the initial consonant table and can be combined with the initial consonants; selecting the initial consonant from the initial consonant arrangement table displayed by the touch control screen and selecting the needed vowel initial from the vowel initials which are displayed at the periphery of the initial consonants and can be combined with the initial consonants; displaying all Pinyin combinations which begin with the initial consonant and the vowel initial; and selecting the Pinyin combination needing to be input from the displayed all Pinyin combinations which begin with the initial consonant and the vowel initial.

A method for generating multimedia output. The method comprises receiving a text input and receiving an animated character input corresponding to an animated character including at least one movement characteristic. The method includes analyzing the text input to determine at least one text characteristic of the text input. The method includes generating a viseme timeline by applying at least one viseme characteristic to each of the at least one text characteristic. Based on the viseme timeline, the method includes generating a multimedia output coordinating the at least one character movement of the animated character with the at least one viseme characteristic.

The invention provides an image processing method and system wherein an image is conceptually textured onto the surface of a three dimensional shape via a projection thereonto. The shape and/or the image position are then moved relative to each other, preferably by a rotation about one or more axes of the shape, and a second projection taken of the textured surface back to the image position to obtain a second, processed image. The view displayed within the processed image will be seen to have undergone an aspect ratio change as a result of the processing. The invention is of particular use in simulating the small movements of humans when speaking, and in particular of processing viseme images to simulate such small movements when displayed as a sequence.

The invention discloses a cleft palate voice glottal stop automatic identification algorithm and device, relates to the technical field of voice analysis and identification, and aims to provide a glottal stop automatic identification method and device. A computer is adopted for automatically identifying cleft palate voice glottal stops, effective and objective auxiliary diagnosis is provided to patients and voice teachers, and wide popularization of cleft palate voice assessment and voice treatment is facilitated. According to the technical key points of the invention, the method comprises the steps of: 1, collecting voice signals of syllables to be tested; 2, carrying out initial and final division on the voice signals of syllables, and retaining initial voice signals; 3, extracting characteristic values of the initial voice signals; and 4, sending the characteristic values into trained identification models, wherein the identification models judge whether glottal stops exist in the voice signals of syllables according to the characteristic values.

The invention relates to an input method of multi-language general multi-key co-striking type and a keyboard device, particularly suitable for inputting languages, such as Chinese, English, Japanese, Korean, German, Russian, and the like. On a basis of abiding by speech rules of various languages, the invention adopts the input method and the keyboard device, i.e. a multi-language general keyboard or a keyboard main body which is provided with mutually symmetrical fourteen keys or thirteen keys at the left side and the right side and the measure that a plurality of syllables (or necessarily singlehanded input consonants) can be realized once through singlehanded multi-key co-striking so that the keyboard input speed of various languages can catch up with the speech or thinking rhythm, and the aim that what you want and what you speak are what you get is realized. The physiological structures of the fingers are fully considered in the keyboard layout of the consonant/initial keys and vowel/final keys respectively at the left part and the right part so that co-striking is easy and natural without troubling users, the combinations of the consonants/initials and the vowels/finals resemble common voice symbol modes of various languages as far as possible, and the process of grasping the input method is easy and understandable, accords with a rule and can more rapidly and conveniently realize the aim that everyone can rapidly input.

The method includes the following steps: 1) initial consonant, vowel, pronunciation tone and writing stroke of Chinese phonetic transcription are used as coding element separately and the table for them is set up according to dual-spelling of Chinese phonetic transcription; 2) coding index list is defined by using the phonetic transcription as index object; 3) phonetic transcription address index list is defined and 4) the system is firstly to search storing address of Chinese character according to dual-spelling inputted by the user, then all Chinese character with the same tone and stroke as inputted are searched out in relevant offset address and they are displayed on selection region, finally determinant matrix is applied for picking up Chinese character to be inputted.

The invention relates to a four-number Chinese character syllable Chinese character input method. The four-number Chinese character syllable codes comprise initial consonant codes, vowel codes and intonation codes. The numeric keyboard comprises ten numeric keys which are respectively marked with the numbers of 0, 1, 2, 3, 4, 5, 6, 7, 8 and 9 on the surface. Each numeric key is marked with a first group of consonants, a second group of consonants, a single vowel, composite vowels and intonation signs, which are represented by the numbers of 0, 1, 2, 3, 4, 5, 6, 7, 8 and 9. The four-number Chinese character syllable code Chinese character input method employs the number and pictographic alphabet method to input, and has advantages of simple method, no repeated codes, easy learning, remembering and mastering.

The invention relates to the field of biological recognition. Specifically, a pre-trained phoneme model is adopted to realize the voice processing. The invention discloses a voiceprint verification method, an apparatus, a device and a storage medium. The method comprises the steps: carrying out the text conversion of voice information, so as to obtain corresponding text information; according to apreset phoneme model, obtaining a phoneme set corresponding to the text information, wherein the phoneme set comprises initial consonants and final consonants corresponding to each character in the text information; calculating an initial consonant coverage rate of the phoneme set according to an initial consonant table and each initial consonant in the phoneme set; calculating the vowel coveragerate of the phoneme set according to a vowel table and each vowel in the phoneme set; and performing voiceprint verification on the voice information according to the initial consonant coverage rateand the final coverage rate to generate a verification result. Therefore, the voice information with high voice feature integrity of the user is found out. An important reference is provided for voiceprint identity verification.

The phonetic-morphological codes comprise phonetic codes and morphological codes, the phonetic codes are composed of digital codes of initial consonants and final consonants, and the morphological codes are composed of four-corner codes, structure codes and stroke numbers of Chinese characters; the mapping rule of the phonetic and morphological codes and the pronunciation similarity of part of initial consonants/finals are pre-stored, and the method comprises the steps: receiving two character strings to be compared; reading a mapping rule of phonetic and morphological codes, and converting each Chinese character in the two character strings into phonetic and morphological code representation according to the mapping rule; based on the initial consonant/final pronunciation similarity, calculating an editing distance between every two corresponding substrings of the two character strings by adopting the editing distance; and calculating the similarity of the two character strings according to the editing distance. According to the method, the character string is converted into the phonetic and morphological code numeric string for comparison, the Chinese character matching precisionis improved, and on the other hand, the editing distance of the Chinese character is used for replacing the weight of the editing distance, so that the similarity of the character string can be calculated more accurately.

The invention discloses a Chinese phonetic symbol and a Chinese character input method thereof; the Chinese character input method comprises the following steps: basic vowels and consonants of the international phonetic symbol of Chinese characters regularly corresponded to the 26 English letters; the syllable ending ng of Chinese phonetic alphabets is changed into g according to the shape of the international phonetic symbol of Chinese characters, the final sounds including v, ou and ao are respectively changed into y, eu and au; both iong and yong are uniformly changed into yg; both ong and weng are uniformly changed into ug; o acts as an initial consonant as well as a final sound; initial consonants including zh, ch and sh are changed into v, w and o respectively; syllables starting with i, u and y are not changed; codes for a syllable need 4 letters at most. On the basis, final sounds can be further simplified so that a syllable needs 3 letters at most: for example, iau and uai are simplified into io and uy respectively; ieu, uei and uen are simplified into iu, ui and un respectively; an and ag with i, u and y in the front are simplified into m and h; ian, uan and yan are simplified into im, um and ym; and iag and uag are simplified into ih and uh.