Audio music-score comparison method with error detection function

Abstract

The invention discloses an audio music-score comparison method with an error detection function. The audio music-score comparison method comprises extracting starting time information of every note in a MIDI file, converting the MIDI file to an audio WAV file, carrying out endpoint detection to performance audio frequency P in order to determine starting time of every single-tone or chord, extracting eigenvalues of music score audio frequency S and the performance audio frequency P to obtain a 12-dimension chrominance vector of every single-tone or chord, calculating Euclidean distance matrices of the characteristic vectors of the performance audio frequency P and the music score audio frequency S, comparing the two matrices of the eigenvalues, utilizing a DTW algorithm and finally realizing an aligning function of the performance audio frequency and the music score audio frequency, so that the comparison method can detect whether conditions of redundant playing, missing playing and wrong playing appear in the performance audio frequency. According to the audio music-score comparison method provided by the invention, on-site music performance can be listened to by a computer, positions of performance notes in music score are finally tracked and determined, aligning time is relatively accurate without affecting by beat change and the audio music-score comparison method with the error detection function can detect whether error notes appear in the performance audio frequency.

Description

technical field [0001] The invention relates to a computer score following system, in particular to a method for automatically tracking performance audio by using a computer and synchronizing the score stored in the computer with the live performance audio. Background technique [0002] Score following first appeared in the form of computer-assisted automatic accompaniment in the 1980s. In 1984, Barry Vercoe and Roger Dannenberg independently proposed the concept of score following for the first time. The score following system has broad application prospects in computer accompaniment, virtual performance rehearsal, and computer-aided musical instrument performance practice. The core technology of score following is audio score comparison, and the essence of comparison is the similarity comparison between audio feature values ​​and score feature values. Among them, the extraction of performance audio feature values ​​is an important part of the comparison system. By extract...

AI Technical Summary

Problems solved by technology

[0004] At present, the audio and music score comparison algorithms used by most music scores are relatively random in the time domain. Most of them only have the function of note alignment, and cannot detect deviations such as multiple notes, missing notes, wrong notes, etc.

Images