Polyphony melody extraction method based on significance

An extraction method and technique of main melody, applied in the field of main melody extraction of polyphonic music, can solve the problems of complex spectral structure of polyphonic music, incorrect main melody output, and difficulty in accurately estimating the pitch of main melody components.

Active Publication Date: 2016-09-21
大连赛听科技有限公司
View PDF3 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, due to the complex spectrum structure of polyphonic music, the fundamental frequency is often buried in the spectrum of bass accompaniment, percussion instruments and other musical accompaniments, and the existing salience-based main melody extraction method is difficult to accurately estimate the pitch of the main melody component. There is a problem that the main melody output is incorrect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Polyphony melody extraction method based on significance
  • Polyphony melody extraction method based on significance
  • Polyphony melody extraction method based on significance

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] Spectrum analysis of polyphonic music:

[0023] First, the polyphonic music signal is divided into frames, and the length of each frame is 46.4ms;

[0024] Polyphonic music can be represented in the time domain as:

[0025]

[0026] In the formula for polyphonic music, is the main melody component, for the accompaniment;

[0027] Time-frequency analysis of polyphonic music audio signal with the help of short-time Fourier transform (STFT), we can get

[0028]

[0029] After performing spectrum analysis on polyphonic music, the sinusoidal components contained in it can be obtained through spectrum peak search. Spectrum peak search is for any time The spectrum of , looking for the magnitude spectrum The local maximum value of the local maximum value, the corresponding frequency is used as the initial estimate of the sinusoidal frequency, and then the accurate sinusoidal frequency correction value corresponding to the local maximum value is obtained accord...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a polyphony melody extraction method based on significance. A corresponding significance function is defined as the product of the amplitude of two spectral peaks, candidate pitches of which the frequency spacing is less than 50 cents in the same frame are merged, and the pitch can be estimated according to the combination of a variety of co-prime harmonic frequencies. Candidate pitches of which the frequency spacing is less than 50 cents in two adjacent frames are connected into a pitch contour line, pitch contours less than 50ms are preliminarily screened out, and a melody is selected according to a set screening criterion and output. The pitch of the melody component can be estimated accurately even if the fundamental frequency of the melody component is absent or buried by accompaniment. The melody contour is tracked according to the set screening criterion, and thus, correct melody output is obtained.

Description

technical field [0001] The invention belongs to the field of music signal processing, in particular to a method for extracting the main melody of polyphonic music based on salience, which can accurately estimate the pitch of the main melody component and obtain the correct main melody output. Background technique [0002] Polyphonic music is the most widely existing music form, and the main theme is the soul of music, reflecting the essential differences of various musical works. The main melody extraction of polyphonic music is an important research content in the field of machine hearing. The purpose is to enable computers to accurately identify the pitch sequence of vocal and instrumental melodies while "listening" to music like humans, ignoring the influence of accompaniment sounds. It can complete tasks such as content-based music analysis, retrieval and recommendation, and can be used as front-end processing for applications such as score transcription, humming retriev...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G10L25/90
CPCG10L25/90G10L2025/906
Inventor 张维维陈喆殷福亮
Owner 大连赛听科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products