Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

1302 results about "Timbre" patented technology

In music, timbre (/ˈtæmbər, ˈtɪm-/ TAM-bər, TIM-, French: [tɛ̃bʁ]), also known as tone color or tone quality (from psychoacoustics), is the perceived sound quality of a musical note, sound or tone. Timbre distinguishes different types of sound production, such as choir voices and musical instruments, such as string instruments, wind instruments, and percussion instruments. It also enables listeners to distinguish different instruments in the same category (e.g., an oboe and a clarinet, both woodwind instruments).

Voice generation method and device based on multi-modal fusion, equipment and medium

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of medical health, financial science and technology, cultural transmission and the like, and discloses a voice generation method based on multi-modal fusion, which comprises the following steps: collecting audio data to extract timbre features, and training a field feature timbre generation model; analyzing text semantic recognition emotion information, adjusting speech synthesis parameters, combining personalized information to construct a parameter mapping table, fusing to generate a synthesis control parameter sequence, aligning the synthesis control parameter sequence with character labels, visual elements and background music data, driving a domain feature timbre generation model, and generating synthesis data of synchronous speech, text, vision and music. Domain timbres are generated through timbre feature training, speech expression is optimized by combining semantic analysis and emotion recognition, user requirements are matched based on personalized information, and time alignment is performed by fusing text, vision and music data, so that the synthesized speech has domain features, emotion adaptability and personalization, and the speech quality is improved. And the voice immersion and the information transmission capability are improved.
Owner:PING AN TECH (SHENZHEN) CO LTD

Automatic dubbing method and system based on generative AI

The invention discloses an automatic dubbing method and system based on generative AI. The method comprises the following steps: separating a human voice audio, a background voice audio and a silent video part from an original video, automatically identifying and translating text content in the audio, and combining a translated text with a corresponding time period to generate a translated subtitle text; segmenting the voice audio into segments, marking character attributes for each segmented segment according to voiceprint features, and evaluating the voice quality at the same time; converting the segmented subtitle text into timbre audios of a target language by using a TTS technology, and connecting and merging the audios according to the starting and ending time of the subtitles; and finally, synthesizing the generated target audio with the background sound audio and the silent video to obtain a complete target video. The above steps efficiently complete dubbing work of multiple languages, multiple roles and multiple scenes, and improve dubbing quality and dubbing efficiency.
Owner:BEIJING EASOU WORLD TECH

Pet voice translation method and system, electronic equipment and storage medium

The invention provides a pet voice translation method and system, electronic equipment and a storage medium, and the method achieves the accurate recognition of the emotion state of a pet through collecting a high-quality pet sound audio sample, extracting acoustic features and constructing a deep learning model. The intention and demand of the pet can be deduced in combination with the variety, age and other information of the pet, and a proper pacifying statement is selected from a statement library. Through a deep neural network technology, synthetic voice similar to pet sound in tone and emotion is generated, and personalized voice interaction is realized. The voice interaction between a person and the pet is realized, and the sound of the pet is converted into the voice, so that an owner of the pet can timely and accurately know the current demand of the pet, and the current demand of the pet can be met more quickly.
Owner:SHENZHEN PENGLIKAI TECH CO LTD

Tone conversion method and device based on cultural semantics, equipment and medium

The invention relates to the technical field of artificial intelligence, can be applied to the field of medical health, and discloses a timbre conversion method, device, equipment and medium based on cultural semanteme, the method comprises the following steps: constructing a cultural semantic timbre library comprising a semantic label and timbre characteristic parameter mapping relationship, the semantic label characterizing emotional semanteme of a target timbre, and the timbre characteristic parameter mapping relationship between the semantic label and the timbre characteristic parameter; the timbre characteristic parameters comprise a pitch range, rhythm rhythm and a harmonic structure; performing feature extraction based on text, image and audio multi-mode information to obtain semantic keywords, visual emotion features and audio acoustic features; performing attention weight fusion on the features through a multi-modal fusion deep learning model, and dynamically adjusting model parameters in combination with a semantic timbre library to generate a target timbre; and finally, intelligent conversion from the multi-mode information to the adaptive tone is realized. Through semantic-driven multi-modal feature collaborative optimization, the defect that timbre conversion machinery is stiff and lacks emotional expression is overcome, and the integrating degree of timbre expression and semantic scenes is improved.
Owner:PING AN TECH (SHENZHEN) CO LTD

Speech synthesis method and device, electronic equipment and storage medium

The invention provides a speech synthesis method and device, electronic equipment and a storage medium, and relates to the field of artificial intelligence, and the method comprises the steps: obtaining a to-be-synthesized text and a tone reference audio; inputting the to-be-synthesized text into a pre-training decoding model to enable the pre-training decoding model to determine voice content and voice style corresponding to the to-be-synthesized text, and obtaining semantic features corresponding to the to-be-synthesized text; wherein the pre-training decoding model is trained by using a training text and a corresponding training semantic feature, the training semantic feature is generated by using a training voice audio corresponding to the training text, and the training voice audio has a preset voice style; inputting the semantic features, the to-be-synthesized text and the timbre reference audio into a pre-trained speech synthesis model for speech synthesis to obtain a synthesized speech audio; according to the invention, speech synthesis can be carried out together with the text to be synthesized and the timbre reference audio by using the semantic features containing the speech content and the speech style, so that the timbre style decoupling is realized.
Owner:SHANGHAI SOULGATE TECH CO LTD

Cross-language voice migration synthesis method and device, equipment and medium

The invention relates to the technical field of voice processing, can be applied to business scenes such as financial science and technology, medical health and the like, and discloses a cross-language voice migration synthesis method, device, equipment and medium. And training an acoustic model by adopting a hierarchical self-adaptive fine tuning strategy, fusing the phoneme sequence for reasoning and the tone mark to generate a representation sequence, and finally synthesizing a target language speech signal. According to the method, a sharing and separation parallel cross-language modeling structure is constructed, the accuracy of phoneme and tone modeling in a low-resource language is effectively improved, the target language acoustic model has higher generalization ability and migration efficiency in combination with a multi-stage self-adaptive fine tuning and training data enhancement strategy, and the method is suitable for being applied to the field of multi-language modeling. And finally, synchronous improvement of the voice naturalness and the tone fidelity is realized.
Owner:PING AN TECH (SHENZHEN) CO LTD

Speech synthesis method, device, equipment and computer medium

The invention provides a speech synthesis method, device and equipment and a computer readable medium, and the method comprises the steps: obtaining input data, the input data comprises a reference audio and a target synthesis text, and then determining a target tone feature and a reference speech content feature sequence according to the reference audio, reference voice content features in the reference voice content feature sequence are used for representing at least one of audio content, intonation, rhythm and speaking habits of the reference voice, and inputting the reference voice content feature sequence and the target synthetic text into a pre-trained voice content feature generation model, according to the method, the target voice content feature sequence is generated, and then the target synthetic audio is generated according to the target timbre feature and the target voice content feature sequence, so that the target synthetic text can be converted into the target synthetic audio conforming to the timbre, the intonation, the rhythm, the speaking habit and the like of the reference audio, and the authenticity of voice synthesis is improved.
Owner:SHANGHAI HODE INFORMATION TECH CO LTD

Video translation method and system based on artificial intelligence

The invention discloses a video translation method and system based on artificial intelligence. The method relates to the technical field of video translation and comprises the following steps of original sound track extraction, target AI speaker adaptation, AI dubbing generation and mouth shape synchronization and video synthesis. According to the method, independent audio and video streams are obtained by adopting an audio and video separation technology, and multiple original sound tracks are extracted through a voice separation model; matching or generating an adaptive target AI speaker module in a preset tone library; converting the original language voice into a text, translating the text into a target language text, and synthesizing an AI dubbing audio track in combination with a target AI speaker module; and finally, the independent video stream and the multi-AI dubbing audio track are input into the mouth shape synchronization model to output a translated video, so that the timbre fitting degree, the voice quality and the voice consistency of the same speaker of AI dubbing are improved, and meanwhile, the resource utilization rate of video translation and the processing efficiency under batch tasks are improved. The problem that in the prior art, video translation is low in quality and efficiency is solved.
Owner:BEIJING DEEP LOGIC INTELLIGENT TECHNOLOGY CO LTD

Speech cloning system and method fusing rhythm characteristics

The invention discloses a voice cloning system and method fusing rhythm characteristics, belongs to the technical field of voice synthesis and natural language, and is applied to the aspect of fine-grained rhythm control in zero-sample voice synthesis. The implementation method comprises the following steps of: 1, extracting rhythm features and audio features of an audio file, and further respectively acquiring pause features, speed features and tone features in the rhythm features by sequentially adopting transcriptional text inverse coding, syllable-level speed registration quantization and pitch sequence feature splicing modes; 2, fusing the features of the audio files in a manner of discarding feature screening without guidance of a classifier; 3, generating a target Mel spectrogram based on conditional flow matching; generating a target audio file from a to-be-cloned audio file through the trained voice cloning model controlled by the fusion rhythm; compared with the prior art, fine-grained rhythm control of tone and rhythm feature decoupling is realized in zero-sample speech synthesis, so that intonation accuracy based on a context scene is improved.
Owner:BEIJING INST OF TECH

Voice conversion method and device based on data enhancement, equipment and storage medium

The invention relates to voice processing, and provides a voice conversion method and device, equipment and a storage medium, and the method comprises the steps: carrying out the data enhancement of a to-be-converted voice, and obtaining a sample voice; inputting the sample voice into a rhythm encoder for processing to obtain phoneme-level rhythm features and spectrum features of the sample voice; inputting the sample voice into a content encoder for processing to obtain content features of the sample voice; inputting the rhythm features and the content features into an attention-based alignment model for alignment processing to obtain aligned rhythm features; inputting the aligned rhythm features, content features, frequency spectrum features and speaker vectors with set timbres into a decoder for synthesis to obtain synthesized voice; and intercepting part of content corresponding to the voice to be converted from the synthesized voice as target voice. The invention also relates to a block chain, and aims to improve the precision and naturalness of voice conversion.
Owner:PING AN TECH (SHENZHEN) CO LTD

Sound cloning system and method, electronic equipment and storage medium

InactiveCN119132320AAchieve instant sound cloningSpeech recognitionDigital dataSound sources
The invention relates to the technical field of electric digital data processing, in particular to a sound cloning system and method, electronic equipment and a storage medium, and the system comprises an audio input module which is used for receiving a reference voice segment of any sound source; a semantic extraction module for identifying a linguistic discrete semantic representation of the reference speech segment based on the reference speech segment; the voiceprint feature extraction module is used for extracting voiceprint features of any sound source based on the reference voice segment; the acoustic synthesis module is used for reconstructing the linguistic discrete semantic representation and the voiceprint feature into a corresponding acoustic spectrum; and the vocoder is used for taking the acoustic spectrum as input so as to output voice with the tone of any sound source by using the reference voice segment. Therefore, the technical problems that in the related technology, a sound cloning model needs target sound source voice of a certain duration, instant cloning cannot be achieved, and the phenomenon of tone leakage exists, so that the synthesized voice still contains part of original sound source features and the like are solved.
Owner:BEIJING INST OF TECH

Method and system for capturing, storing, identifying and distributing an individuals unique collective vocal attributes or singing voice and dynamically generating a vocal performance using artificial intelligence

A system for creating a song using vocal attributes extracted from a singing voice of an individual is provided comprising a computer and application executing thereon that digitally captures a plurality of vocal attributes of a singing voice of an individual. The system also processes, normalizes, identifies, and stores the attributes as a voice model. Based on dynamic outputs and digital audio files associated with the model, the system generates a performance of a new song created with the individual's singing voice. The system provides an identifier code for the voice model for storing and indexing the voice model and metadata or tags for identifying and tracking use of the voice model. The vocal attributes comprise at least range, timbre, flexibility, control, vibrato, resonance, articulation, expressiveness, stamina, tone and power of the singing voice and vocal traits comprising use of at least one of feel, phrasing, pronunciations, language, articulation, dynamics, meter, and rhythm. The attributes are captured from a live session with the individual or a recording of the individual's voice.
Owner:MEAGHER TODD ANDREW

Full-frequency band high quality speaker with a bar and sound tunnels

A full-frequency band high quality speaker with a bar and sound tunnels includes a voice coil, magnet, diaphragm and magnetically conductive structure; the diaphragm is conical, a bridge-style bar is on the surface of at least one side of the diaphragm; the diaphragm includes at least two grooves, each horizontally radial; each groove crosses the bridge-type bar in the horizontal direction and the length direction of the groove is perpendicular to the bridge-type bar; the groove is concave on the surface of the diaphragm to form a sound tunnel. The diaphragm is changed to the current standard vibration mode, and the timbre of treble register is not bright and the timbre of bass register is not sonorous and mellow enough from the perspective of vibration, resonance and phonation. The practice proves that the improved scheme has outstanding substantive characteristics and remarkable technical progress, and has obtained obvious technical results.
Owner:SUZHOU LI YUE MUSICAL INSTR CO LTD

Speech synthesis scheme and device, electronic equipment, storage medium and program product

The invention provides a voice synthesis scheme and device, electronic equipment, a storage medium and a program product, and relates to the technical field of voice processing, and the method comprises the steps: inputting a text content into an LLM semantic understanding module, and obtaining a deep semantic feature and multi-modal context semantic information corresponding to the text content; transmitting the deep semantic features to a neural codec, and outputting compressed acoustic features; inputting the compressed acoustic features into an acoustic modeling module, and outputting high-precision acoustic features; inputting the high-precision acoustic features and the multi-mode context semantic information into an emotion and rhythm control module, and inputting voice parameters with emotion and rhythm marks; and inputting the voice parameters with the emotion and rhythm marks and the reference audio into a tone migration module to obtain a synthetic voice of a tone corresponding to the reference audio.
Owner:SHANDONG INSPUR SCI RES INST CO LTD

System and method for highly accurate voice-based biometric authentication

The present disclosure provides a system and a method for voice based authentication, which involves receiving voice data of a user enunciating a predetermined sequence of speech elements, with the predetermined sequence of speech elements is configured to capture a defined range of voiced sounds produced by the user; extracting voice features from the received voice data; deriving a voice signature for the user based on the extracted voice features, wherein the voice signature is representative of at least one of tonal, timbral, and temporal characteristics of the user's voiced speech; storing the derived voice signature in a database; receiving a verification voice sample of the user enunciating a predetermined sub-set of speech elements; comparing the verification voice sample with the stored voice signature; and authenticating the user based on the comparison.
Owner:TURANT INC

Rhythm migration method and device, electronic equipment and storage medium

The invention relates to the technical field of voice processing, and provides a rhythm migration method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a decoupled rhythm feature based on a source rhythm voice, and a decoupled tone feature based on the voice of a target speaker, the decoupled rhythm feature represents the rhythm of the source rhythm voice, and the decoupled tone feature represents the tone of the target speaker; the decoupled timbre features represent the timbre of the voice of the target speaker; generating a target voice vector sequence based on the text features of the target text, the voice features of the voice of the target speaker, the decoupled rhythm features and the decoupled timbre features; and synthesizing a target audio based on the target voice vector sequence. According to the method and the device, the decoupled rhythm features and the decoupled timbre features are acquired, and the target voice is generated based on the features, so that the problem of feature mixing is effectively relieved, the timbre purity of the target speaker in cross-person rhythm migration is ensured, the expressive force of rhythm migration is improved, and the synthesized audio is more natural and vivid.
Owner:IFLYTEK CO LTD

Song conversion model training method, song timbre conversion method and related products

The invention relates to a song conversion model training method, a song timbre conversion method, computer equipment, a computer readable storage medium and a computer program product, relates to the technical field of song synthesis, and can improve the efficiency of song timbre conversion by a user. The singing conversion model training method comprises the steps of obtaining a sample song and a singer timbre description text paired with the sample song; obtaining tone characteristics of the sample song by an audio coding module in the singing conversion model, and obtaining text characteristics corresponding to the tone description text of the singer by a text coding module in the singing conversion model; according to the difference between the timbre features and the text features, adjusting model parameters of a singing sound conversion model to obtain a trained singing sound conversion model; the trained song conversion model is used for extracting text features corresponding to the input timbre description text through the text coding module, obtaining target timbre features according to the text features corresponding to the timbre description text, and performing song timbre conversion.
Owner:TENCENT MUSIC ENTERTAINMENT TECH (SHENZHEN) CO LTD

Real-time sound duplicating method and system based on end-cloud fusion

The invention provides a real-time sound copying method and system based on end-cloud fusion. The method comprises the following steps: a cloud end carries out real-time tone copying and voice synthesis on a small amount of voice data of a user based on an AI large model; timbre samples are collected when a user registers voice audio data, and user timbre voice data of a preset text are synchronously generated by a large model and are used as fine tuning training data of an end-side voice synthesis model; user tone voice data of a preset text and voice audio data registered by a user are utilized to carry out migration fine tuning training on an end-side voice synthesis model to adapt to the personalized tone of the user, so that high-quality output of the end-side voice synthesis model is ensured, and personalized voice replication is realized; and issuing the trained end-side speech synthesis model to the user equipment, and independently completing speech replication in a network-free or weak network environment. According to the invention, through automatic generation of the user tone data and adaptive fine tuning of the model, the tone of the user is deployed to the end side after fine tuning, and high-quality and high-adaptability sound replication of end-cloud collaboration is realized.
Owner:PACHIRA TIMES (ZHUHAI HENGQIN) INFORMATION TECH CO LTD

Audio adjustment method and device, electronic equipment and storage medium

The invention provides an audio adjustment method and device, electronic equipment and a storage medium, and relates to the technical field of audio processing. The method comprises the following steps: acquiring a historical singing audio of a user and an original singing audio of a to-be-singed track; determining user range information based on the historical singing audio; according to the user range information, determining a to-be-adjusted audio clip which does not meet the timbre characteristics of the user in the original audio; and performing tone modification processing on the to-be-adjusted audio clip, and performing synthesis processing on the audio clip after tone modification processing and the audio clip which is not subjected to tone modification processing in the original audio to obtain an adjusted audio. According to the application, the track selected by the user is matched based on the determined user range information, the to-be-adjusted audio clip exceeding the singing ability of the user in the original audio is determined, and the to-be-adjusted audio clip is adjusted to be within the receivable range of the user, so that the adjusted audio is obtained; therefore, the expected singing effect can be achieved when the user sings based on the adjusted audio.
Owner:NETEASE (HANGZHOU) NETWORK CO LTD

Voice conversion method, device and equipment and readable storage medium

The invention provides a voice conversion method, device and equipment and a readable storage medium, and the method comprises the steps: carrying out the compression quantization of a to-be-converted audio and a reference audio through an audio quantizer, so as to generate a semantic code of the to-be-converted audio and a reference code of the reference audio; aligning the semantic code and the reference code according to the length of the Mel spectrum so as to splice a group of feature vectors, calling an audio large language model to carry out autoregression decoding on the feature vectors so as to generate an output code, inputting the Mel spectrum of the reference audio into a tone style network so as to generate a perception vector, and outputting the perception vector; fusing the output code and the sensing vector to generate a vector code; then, a flow prediction network is called to process the vector codes in combination with a time sequence embedding and prior distribution, so that a Mel spectrum is generated step by step; and finally, restoring the Mel spectrum into a target voice signal through a vocoder, thereby solving the problem that the existing small-scale model is not ideal in fine sound feature restoration effect.
Owner:XIAMEN SHEQU INFORMATION TECH CO LTD

Music generation method and device

The invention discloses a music generation method and device. The method comprises the steps of obtaining tone information in first audio data in response to triggering of a music generation event, and generating at least one tone coding vector based on the tone information; obtaining rhythm information in the second audio data, and generating at least one rhythm coding vector based on the rhythm information; obtaining target lyrics, performing word segmentation processing on the target lyrics, and converting each word segmentation unit in the target lyrics into a corresponding word segmentation unit vector; and inputting the at least one timbre coding vector, the at least one rhythm coding vector and the word segmentation unit vector into a pre-constructed music generation large model, and generating target music according to an output result of the music generation large model. According to the scheme, the decoupling of the timbre and the rhythm can be realized, so that the timbre duplicating of any timbre on any rhythm is realized, and the free generation of music by using the duplicated timbre and any rhythm can be realized.
Owner:SHANGHAI XIYU JIZHI TECH CO LTD

Enhanced wireless communication handover management system

To effectively resolve the issue of inappropriate handovers during communication sessions, methods, systems, and machine-readable mediums which utilize speech features captured by microphones in the original wireless peripheral device and / or the wireless peripheral device to which the communication session is to be handed over to determine if a handover should proceed or should be reversed. Speech features refer to the composite attributes of spoken language that encompass both acoustic and linguistic features. Acoustic features characterize the sound properties of speech and include, but are not limited to, timbre, pitch, intonation, speaking rate, articulation, prosody, melody, spectral features, formant frequencies, and the like. Linguistic features pertain to the actual content conveyed, comprising words, phrases, syntax, and semantics. This includes the analysis of words, phrases, syntax, and semantics to understand the context and continuity of the conversation.
Owner:MICROSOFT TECHNOLOGY LICENSING LLC

Novel empty drum

The utility model relates to a novel empty drum. The novel empty drum comprises a drum body, the drum body comprises an upper drum body and a lower drum body which are fixedly connected, and eight peripheral tongues are arranged around the geometric center of the upper drum body; each peripheral tone tongue is provided with a first sub-tone tongue, a second sub-tone tongue, a third sub-tone tongue, a fourth sub-tone tongue and a fifth sub-tone tongue, and the first sub-tone tongue, the second sub-tone tongue, the third sub-tone tongue and the fourth sub-tone tongue are arranged close to the fifth sub-tone tongue; the geometric center of the lower drum body is provided with a timbre control hole and a rubber plug matched with the timbre control hole. According to the novel empty drum, the structure of the peripheral tongues is improved and designed, so that the tone of the empty drum in the playing process is richer, and the use experience of a user is improved.
Owner:惠州市广利润发科技有限公司

Microphone for resisting AI voice cloning by pseudo tone based on acoustic shielding

The invention belongs to the technical field of audio equipment design, and relates to a microphone for AI voice cloning based on pseudo tone of acoustic shielding, and the microphone comprises an audio collection module which is used for collecting an environment audio signal in real time; the analog-to-digital converter is used for converting the environment audio signal into a digital signal; the feature extraction module is used for performing frequency domain conversion on the digital signals and extracting frequency spectrum features and tone features; the acoustic shielding calculation module is used for calculating a shielding threshold value of the environment audio signal and determining a frequency band which cannot be heard by human ears in the environment audio signal according to the shielding threshold value; the pseudo tone generation module is used for generating pseudo tones based on the extracted tone features; the synthesis module is used for replacing a corresponding frequency band of the environment audio signal with the generated pseudo tone to form a synthesized audio; and the audio output module is used for outputting the synthesized audio. According to the invention, the pseudo tone can be generated in real time in the audio recording process, and it is ensured that a user is always protected during audio recording.
Owner:LANZHOU UNIV

Multi-dimensional scoring auxiliary system and method in piano teaching

The invention relates to the technical field of piano teaching and computers, discloses a multi-dimensional scoring auxiliary system and method in piano teaching, and aims to solve the problems that existing piano teaching is single in evaluation dimension, one-sided in data acquisition and lagged in feedback. According to the method, a five-dimensional scoring model covering rhythm, strength, timbre, posture and fingering is constructed by synchronously collecting a key triggering time sequence, an audio frequency spectrum, limb posture and finger joint tracks, and quantitative scores are output through time alignment, feature extraction and neural network fusion calculation. The system comprises a key sensing module, an audio acquisition module, a posture capture module, a score calculation module and an AR visual feedback module, and supports teaching suggestion generation, historical trend analysis, difficulty self-adaption and multi-person comparison functions. Through multi-modal data closed-loop evaluation and intelligent intervention, the teaching accuracy and individuation level are remarkably improved, and scientific quantification and efficient improvement of the piano playing ability are achieved.
Owner:JILIN NORMAL UNIV

Speech synthesis method and device, readable medium and electronic equipment

The invention relates to a speech synthesis method and device, a readable medium and electronic equipment. The method comprises the following steps: acquiring a target text and a target tone identifier; determining a target emotion identifier of the source voice; the target text, the target timbre identifier and the target emotion identifier are input into a speech synthesis model to obtain a target Mel spectrum feature output by the speech synthesis model, and the speech synthesis model is obtained by training a target neural network model through a mutual information determination model and a plurality of sample sets; and generating a target voice according to the target Mel spectrum feature. Decoupling of the timbre features and the emotional features is realized through the mutual information determination model, so that only the emotional features in the source speech are extracted in the process of determining the target Mel spectrum features according to the speech synthesis model, the timbre information of the source speech is not mixed in the emotional features, the effect of emotional migration is improved, and the efficiency of emotional migration is improved. And the sound quality of the generated target voice is better.
Owner:BEIJING YOUZHUJU NETWORK TECH CO LTD

Intelligent identification and visual playing system for ancient music score

The invention relates to the technical field of ancient music score intelligent processing, and discloses an ancient music score intelligent identification and visual playing system, which comprises an image preprocessing module, a stroke enhancement module, a symbol segmentation module, a symbol identification module, a semantic analysis module, a visualization module, an acoustic synthesis module and the like. Through a specially designed image processing and symbol analysis method, the aging problem of the ancient music score can be accurately repaired, adhered symbols are separated, a complex structure is identified, music semantics are inferred in combination with a knowledge graph, and a multi-modal visualization effect and a high-sampling ancient charm tone are generated. The system supports feedback optimization and automatic workflow, significantly improves the efficiency and accuracy of ancient music score recognition, translation and presentation, and provides technical support for ancient music research and propagation.
Owner:ANHUI UNIV

Voice evaluation method and device, medium and program product

The invention provides a voice evaluation method, a voice evaluation device, a non-transitory storage medium and a computer program product. The voice evaluation method comprises the following steps: extracting a first person voice with a first tone based on a to-be-evaluated voice; converting the voice of the first person into voice with a second tone; and obtaining an evaluation result of the voice of the first person based on the converted voice with the second tone and the standard voice of the one or more accent.
Owner:NEW ORIENTAL EDUCATION & TECH GRP CO LTD

Audio processing method and device, medium, computing equipment and program product

The embodiment of the invention provides an audio processing method and device, a medium, computing equipment and a program product, and relates to the field of audio processing. The audio processing method comprises the following steps: obtaining timbre characteristics of dry sound audio, determining timbre similarity between the dry sound audio and original audio according to the timbre characteristics, and selecting M target audio from N original audio according to the timbre similarity, and applying the sound mixing parameters corresponding to the target audios to the dry sound audios to obtain M wet sound audios, and combining the M wet sound audios based on the timbre similarity to obtain a sound mixing audio. According to the mode, only the N original audios need to be prepared in advance, the audio mixing parameters of each original audio are recorded, then the audio mixing parameters of the original audios with high timbre similarity with the dry audio can be applied to the audio mixing process of the dry audio, repeated audition on the dry audio is not needed to debug the audio mixing parameters, the audio mixing efficiency can be improved, and the audio quality is improved. The sound mixing time is shortened, and more sound mixing requirements are met.
Owner:HANGZHOU NETEASE CLOUD MUSIC TECH CO LTD

Dubbing method and device, electronic equipment and storage medium

The invention relates to a dubbing method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a target dubbing table book of a to-be-dubbed video; wherein the target dubbing table book comprises at least one line and the time and role corresponding to each line; the language corresponding to the target dubbing table book is different from the language corresponding to the video to be dubbed; performing voice synthesis on the target dubbing table book to generate target audio data; wherein the language corresponding to the target audio data is the same as the language corresponding to the target dubbing table book; performing timbre conversion on the target audio data; and performing audio and picture synchronization processing on the audio data after tone conversion and the video to be dubbed to generate a dubbed video. According to the method and the device, the cross-language automatic dubbing of the video is realized through processing such as speech synthesis, tone conversion and audio and picture synchronization.
Owner:YOUKU CULTURE TECH (BEIJING) CO LTD