Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Dynamic programming based humming melody extracting and matching search method

A technique of dynamic programming and melody, applied in special data processing applications, instruments, electrical digital data processing, etc.

Inactive Publication Date: 2015-11-04
上海京知信息科技有限公司
View PDF0 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, automatic realization of this function is a very challenging work

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Dynamic programming based humming melody extracting and matching search method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0016] This humming melody extraction and matching retrieval method based on dynamic programming includes the following steps:

[0017] 1) A section of song hummed by the user through a microphone is collected in the form of an audio signal;

[0018] 2) Calculate the logarithmic energy curve of the input signal and smooth it, dynamically estimate the energy threshold of the vocal area according to the maximum value and minimum value of the curve, and cut out continuous vocal segments, each segment and a humming corresponding to the note;

[0019] 3) Based on the time-domain autocorrelation method, the fundamental frequency of the humming signal of each frame is obtained, and then converted into semitone units by the following formula;

[0020] 4) Use a rule-based method to calculate the pitch of the audio frame, and then smooth the melody curve to remove the noise segment, and finally obtain an effective humming melody;

[0021] 5) For the three-level pitch contour melody re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a dynamic planning based humming melody extracting and matching search method. The humming melody extracting and matching search method comprises the specific steps of: acquiring a section of a song hummed by a user through a microphone in a form of audio signal; solving a logarithm energy curve of an input signal and smoothing the curve; dynamically estimating an energy threshold value of an audio region according to a maximum value and a minimum value of the curve; cutting off sections with continuous sounds and enabling each section to correspond to each hummed note; solving a base frequency of each frame of hummed signal based on a time domain self-correlated method, and carrying out down type conversion on the base frequency to obtain a half-tone unit; calculating the pitch of an audio frame by adopting a rule based method, and carrying out melody curve smoothing to remove noise sections, so as to finally obtain effective humming melodies; aiming at the representation of three stages of pitch outline line melodies, carrying out melody matching on indexed network audio files based on a recursive calculation method for a minimum editing distance between pitch outline lines; and taking the plurality of network audio files with the highest total point in similarity as a searching result to be returned back to the user.

Description

technical field [0001] The invention relates to a humming melody extraction and matching retrieval method based on dynamic programming Background technique [0002] At present, web crawlers only crawl text, and cannot crawl multimedia files such as music, pictures, and videos. The main reasons are the huge amount of multimedia data; how to download and transmit multimedia files; how to index multimedia files; and then retrieve processed multimedia files. There are a large number of multimedia files on the Internet now, especially with the rise of social networking sites and multimedia sharing, it is necessary to accurately retrieve multimedia files. [0003] In terms of retrieval methods, audio retrieval can be retrieved by submitting query requests in various ways such as humming, beating, performance input, and score entry. Humming retrieval means that the user hums a certain segment of a song as a query to retrieve audio from the database. It is the most convenient and m...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 张军宋惟忠
Owner 上海京知信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products