Intelligent piano training method and system

Abstract

The invention provides an intelligent piano training method. The method comprises the following steps: acquiring audio information and video information of piano playing of a user; extracting user audio data from the audio information, and comparing the user audio data with corresponding reference audio data stored in an audio database to obtain a matching degree between the user audio data and the corresponding reference audio data; intercepting a user hand image corresponding to the user audio data from the video information, identifying user hand data in the user hand image through a hand model, and comparing the user hand data with corresponding correct hand data stored in a hand database; obtaining a matching degree between the user hand data and the corresponding reference hand data; and feeding back a playing result to the user based on the matching degree between the user audio data and the corresponding reference audio data and the matching degree between the user hand data and the corresponding reference hand data.

Description

technical field [0001] The invention relates to the field of deep learning, in particular to a method and system for intelligent piano training. Background technique [0002] Factors such as intonation, rhythm, fingering, and hand shape in piano playing are very critical, and they are basic skills that beginners must practice repeatedly. Therefore, they usually need to be practiced under the supervision and guidance of a professional piano teacher. However, due to the limited time to be tutored by professional teachers, beginners often practice alone, resulting in various mistakes not being fed back and corrected in a timely manner, and the practice effect is not good. [0003] In the prior art, there are many piano training methods for beginners to practice themselves. Some of them judge the accuracy of the music played by the practitioner based on the audio data of the music played. For example, the audio information of the player and the master Comparing the correct soun...

AI Technical Summary

Problems solved by technology

However, in piano playing, the use of wearable devices may affect the dexterity of the arm (or fingers), and movement tracking technology is not very accurate for detecting subtle movements such as moving fingers on the keys or pressing keys, while Manually extracting gesture data requires heavy workload, high professionalism, and unsatisfactory generalization ability and robustness

Images