Accompaniment and human voice extraction method and device and word-by-word lyric generation method and device

A vocal and sound technology, applied in the field of audio processing, can solve the problems of low accuracy of lyrics, poor accompaniment and vocal extraction effect, etc.

Pending Publication Date: 2020-08-14
HANGZHOU NETEASE CLOUD MUSIC TECH CO LTD
View PDF4 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present disclosure is to provide a method and device for extracting accompaniment and human voice, a method and device for generating verbatim lyrics, a storage medium, and an electronic device, thereby at least to a certain extent overcoming the problems of accompaniment and human voice caused by the defects and limitations of related technologies. Issues with poor vocal extraction and low accuracy of verbatim display of lyrics, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Accompaniment and human voice extraction method and device and word-by-word lyric generation method and device
  • Accompaniment and human voice extraction method and device and word-by-word lyric generation method and device
  • Accompaniment and human voice extraction method and device and word-by-word lyric generation method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0148] The principle and spirit of the present disclosure will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are given only to enable those skilled in the art to better understand and implement the present disclosure, rather than to limit the scope of the present disclosure in any way. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

[0149] Those skilled in the art know that the embodiments of the present disclosure may be implemented as a system, device, device, method or computer program product. Therefore, the present disclosure may be embodied in the form of complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.

[0150] The technical terms involved in this disclosure are explained as follows:

[0...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides an accompaniment and human voice extraction method and device, a word-by-word lyric generation method and device, a storage medium and electronic equipment, and relates to the technical field of audio processing. The accompaniment and human voice extraction method comprises the following steps: acquiring mixed audio data in a time domain; encoding the mixedaudio data through an encoding module in an accompaniment voice extraction model to obtain encoded audio features; performing first convolution processing on the encoded audio features through a first decoding module in the accompaniment human voice extraction model to obtain target human voice audio data; enabling the encoding module and the first decoding module to form a first U-net network; performing second convolution processing on the encoded audio features through a second decoding module in the accompaniment voice extraction model to obtain target accompaniment audio data; and enabling the encoding module and the second decoding module to form a second U-net network. According to the invention, the accompaniment and human voice extraction effect can be improved.

Description

technical field [0001] Embodiments of the present disclosure relate to the technical field of audio processing, and more specifically, relate to an accompaniment and vocal extraction method and device, a verbatim lyrics generation method and device, a storage medium, and an electronic device. Background technique [0002] This section is intended to provide a background or context for implementations of the disclosure that are recited in the claims. The descriptions herein are not admitted to be prior art by inclusion in this section. [0003] Music source separation technology is one of the technologies that have been widely studied in recent years. Accompaniment and vocal extraction refers to the extraction of human voice audio and accompaniment audio other than human voice audio in mixed music audio. The accompaniment audio can be used In karaoke systems, music retrieval systems, etc., human voice audio can be used in scenarios such as pitch generation and emotional anal...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L21/0272G10L21/0308G10L15/26G10L25/30G06N3/04G06N3/08G10H1/36
CPCG10L21/0272G10L21/0308G10L25/30G06N3/08G10H2210/005G10H1/361G10H2220/011G06N3/045
Inventor 金强朱一闻曹偲陈梦刘华平郑博吴修坤
Owner HANGZHOU NETEASE CLOUD MUSIC TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap