Method for extracting melody of counterpoint based on GPU

A music and melody technology, applied in the field of acceleration of music melody extraction, can solve the problems of complex programming, long development cycle, slow running time, etc., and achieve the effect of simple programming, high cost performance and high speedup ratio

Active Publication Date: 2013-08-14
上海芷锐电子科技有限公司
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Due to the influence of background sound, the complexity of the melody extraction algorithm is high, the operation is slow, and it cannot be applied in real time, which limits its scope of application.
The slow running time and huge test library also make it difficult to test and improve the algorithm, and the accuracy rate is much lower compared to the melody extraction of MIDI music
[0004]

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for extracting melody of counterpoint based on GPU
  • Method for extracting melody of counterpoint based on GPU
  • Method for extracting melody of counterpoint based on GPU

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] In order to make the object, technical solution and advantages of the present invention more clearly, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0035] The main idea of ​​the present invention is to use GPU to accelerate the melody extraction of multi-part music, so that it can be extended to many real-time applications. This algorithm is not only suitable for multi-part music, but also has higher accuracy for music or voice extraction without background sound.

[0036] The following is an example to illustrate, the sampling rate of the music clip is 44.1kHz, the length is 21s, and the format is wav.

[0037] First read the music file in the CPU space, and analyze the sample rate and data length of the file, and then transfer it to the GPU space to start melody extraction. Before spectral transformation, the data needs to be adjusted to make it suitable for processing on the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a parallelization method for extracting the melody of counterpoint based on GPU (Graphic Processing Unit), and the method comprises the following three steps: firstly, conducting spectrum transform and pitch value saliency computing to the music data on the GPU; secondly, constructing pitch contour by using pitch saliency on the GPU, getting the relevant characteristics of the pitch contour, and conducting voice detection by using the characteristics; thirdly, conducting frequency doubling removing and outliers removing to the remained pitch contour and finally obtaining the melody track of the counterpoint. The method provided by the invention is based on counterpoint, and can be applied to music without background music and speech sounds. According to the method provided by the invention, the melody can be extracted based on GPU, the extracting time is decreased from the second level to the millisecond level, so as to achieve the standard of real time application. Furthermore, the extracting of required hardware resource is greatly reduced, and the developing speed of the algorithmic is greatly improved, so as to provide the method with wide use value and application prospect in the field of commercial application and scientific research.

Description

technical field [0001] The invention provides an acceleration method for extracting music melody, and in particular relates to a parallel method for extracting the melody of multi-part music by using GPU. It belongs to the field of parallel application of computer science. Background technique [0002] Given a polyphonic piece of music, the task of melody extraction is to automatically extract the melody track of the music from it. The most commonly used melody track today is the fundamental frequency (F0) sequence of the music. Most of the current algorithms are based on the saliency value. This type of algorithm constructs the melody trajectory by estimating the saliency value of the pitch. The general structure of the algorithm is: first obtain the spectral representation of the signal, and then use the spectral representation to calculate the time of the saliency value of the pitch. Frequency said. Peaks of significant values ​​are considered as possible F0 candidates...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10H1/00
Inventor 肖利民姚光超郑尧阮利
Owner 上海芷锐电子科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products