Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method and system for automatic music notation based on audio and video information

A technology of audio, video and music, applied in the field of automatic music notation, which can solve the problems of low precision and achieve the effect of small calculation and real-time application

Active Publication Date: 2015-10-07
INST OF ACOUSTICS CHINESE ACAD OF SCI +1
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to overcome many defects such as low precision in recording piano music scores in the prior art, thereby providing a method and system for automatic music notation based on audio and video information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for automatic music notation based on audio and video information
  • A method and system for automatic music notation based on audio and video information
  • A method and system for automatic music notation based on audio and video information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The content of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0039] The present invention adopts the multimedia fusion technology, by combining the video tracking of the position information of the hand on the piano keyboard and the method of establishing a characteristic model including frequency spectrum and time series for a specific piano note, greatly improving the accuracy of the piano automatic music notation algorithm, and at the same time Keep the speed of the algorithm, so that the performance of the automatic piano notation algorithm can meet the requirements of the specific application of computer-aided teaching.

[0040] To achieve the above object, the automatic music notation technical method of the present invention comprises the following steps to realize:

[0041] The first step is to collect video and audio data of piano performance for simultaneous processing and analysis.

[0042]In the sec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an automatic music notation recording method and system based on audio and video information. The automatic music notation recording method includes the steps of collecting video data and audio data of piano playing, using the video tracing algorithm to obtain all the position information of the hands on a piano according to the collected video data, determining the played music notes played by a player and the playing time information corresponding to the music notes according to the position information of the hands, namely obtaining a music note alternative range sequence set of piano playing according to the collected video data, being called a video music note alternative range sequence set for short, using the audio automatic music notation recording algorithm to obtain the fundamental frequency information of the played music notes played by the player for the collected audio data, determining the played music notes played by the player and the playing time information corresponding to the played music notes according to the fundamental frequency information, and obtaining the intersection of the synchronized video music note alternative range sequence set and an audio music note alternative range sequence set to determine all the played music notes and the playing time information corresponding to the music notes.

Description

technical field [0001] The present invention relates to an automatic music notation technology applied to piano computer-aided teaching, more specifically, the present invention relates to a piano automatic music notation technology based on the combination of audio and video, that is, the present invention provides an audio and video information based Automatic music notation method and system. Background technique [0002] Automatic music notation refers to the use of computer analysis technology to convert music acoustic signals into symbolic representations, and automatically translate the corresponding score information. It enables the computer to have the ability to "understand" music to a certain extent and complete notation. It plays a very important role in the field of music signal processing and analysis, and it is also a very challenging problem in the world. Usually music notation requires It takes a lot of time and manpower to do it manually by specially train...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G10H1/00
Inventor 周若华颜永红万玉龙
Owner INST OF ACOUSTICS CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com