Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An audio score comparison method with error detection function

An audio and musical score technology, which is applied in the field of computer musical score following systems, can solve the problems of inability to detect the multiple playing, missed playing, and wrong playing of deviation notes, and achieve the effect of saving dynamic planning time, improving accuracy, and improving execution efficiency.

Active Publication Date: 2016-01-20
天津画国人动漫创意有限公司
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, the audio and music score comparison algorithms used by most music scores are relatively random in the time domain. Most of them only have the function of note alignment, and cannot detect deviations such as multiple notes, missing notes, wrong notes, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An audio score comparison method with error detection function
  • An audio score comparison method with error detection function
  • An audio score comparison method with error detection function

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] The present invention will be further described below in conjunction with the accompanying drawings and embodiments. figure 1 For the general flowchart of the present invention, concrete steps are as follows:

[0024] 1. Transcribe MIDI. The start time information in the score is included in the MIDI file, extract the start time information of each note in the MIDI file, and then transcribe the MIDI file into a WAV audio file, with a sampling rate of 22050Hz, 16bit, single channel, which has become a referenced standard Audio, where the audio file contains accurate note endpoint information.

[0025] 2. Endpoint detection: perform endpoint detection on the performance audio P to determine the start time of each single tone or chord.

[0026] Perform short-time Fourier transform on the test piano piece (that is, playing audio P) to obtain the spectrum X=(X(t,k)) of the audio signal t,k , k=1,2...,K, t=1,2...,T, where K is the number of samples per frame, T is the numb...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an audio music-score comparison method with an error detection function. The audio music-score comparison method comprises extracting starting time information of every note in a MIDI file, converting the MIDI file to an audio WAV file, carrying out endpoint detection to performance audio frequency P in order to determine starting time of every single-tone or chord, extracting eigenvalues of music score audio frequency S and the performance audio frequency P to obtain a 12-dimension chrominance vector of every single-tone or chord, calculating Euclidean distance matrices of the characteristic vectors of the performance audio frequency P and the music score audio frequency S, comparing the two matrices of the eigenvalues, utilizing a DTW algorithm and finally realizing an aligning function of the performance audio frequency and the music score audio frequency, so that the comparison method can detect whether conditions of redundant playing, missing playing and wrong playing appear in the performance audio frequency. According to the audio music-score comparison method provided by the invention, on-site music performance can be listened to by a computer, positions of performance notes in music score are finally tracked and determined, aligning time is relatively accurate without affecting by beat change and the audio music-score comparison method with the error detection function can detect whether error notes appear in the performance audio frequency.

Description

technical field [0001] The invention relates to a computer score following system, in particular to a method for automatically tracking performance audio by using a computer and synchronizing the score stored in the computer with the live performance audio. Background technique [0002] Score following first appeared in the form of computer-assisted automatic accompaniment in the 1980s. In 1984, Barry Vercoe and Roger Dannenberg independently proposed the concept of score following for the first time. The score following system has broad application prospects in computer accompaniment, virtual performance rehearsal, and computer-aided musical instrument performance practice. The core technology of score following is audio score comparison, and the essence of comparison is the similarity comparison between audio feature values ​​and score feature values. Among them, the extraction of performance audio feature values ​​is an important part of the comparison system. By extract...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G10L25/51G10H1/36
Inventor 关欣吴康妍李锵
Owner 天津画国人动漫创意有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products