A system, method, and device for assisting musical instrument learning based on AR augmented reality

Abstract

The invention discloses a musical instrument assisted learning system based on AR augmented reality, which includes a positioning mark and an AR recognition module. The positioning mark is set at a specific position of the musical instrument, and the AR recognition module can obtain the type and model of the musical instrument and the setting position of the positioning mark from the positioning mark, and can generate a contour based on the setting position of the positioning mark. In addition, the AR recognition module can obtain the posture and gestures of the user when playing the musical instrument, and present different colors through the generated outline to show whether the posture and gesture of the user when playing the musical instrument are correct. The setting of the positioning mark is simple, the instrument does not need to be modified, and the cost is low. It can also interact with the instrument itself, making the learning method more intuitive and efficient. Due to the realization of visual augmented reality, the prompt effect and method are flexible and comprehensive, the impact is more profound, and the learning effect is better.

Description

technical field [0001] The present invention relates to the field of AR, in particular, to a system, method and device for aided learning of musical instruments based on AR augmented reality. Background technique [0002] The existing learning and teaching of musical instruments, whether the user is learning by himself or online one-on-one live teaching, lacks learning or teaching content materials to interact with the user's musical instrument itself, such as the score explained by the teacher, the position of the keys, the fingering of chords, etc. It can only be a single demonstration, and it is impossible to determine whether the posture and gesture of playing are correct. [0003] At present, there is a bluetooth lighting method with circuit design on the market that can partially solve this kind of problem. Through the design of the circuit board, the musical instrument is modified, including a simple MCU control unit and a bluetooth transmission device, which can be c...

AI Technical Summary

Problems solved by technology

[0002] Existing musical instrument learning and teaching, whether the user is learning by himself or online one-to-one live teaching, lacks learning or teaching content materials to interact with the user's musical instrument itself, such as the score explained by the teacher, the position of the keys, and the fingering of chords, etc. It can only be a single demonstration, and it is impossible to determine whether the posture and gesture of playing are correct

[0003] At present, there is a bluetooth lighting method with circuit design on the market that can partially solve this kind of problem. Through the circuit board design method, the musical instrument is modified, including a simple MCU control unit and a bluetooth transmission device, which can be connected to the equipment system through bluetooth to control information. Transmission, but the cost is too high, it needs charging and maintenance; and the way of Bluetooth lighting can only indicate whether the playing is correct through simple lighting, and it cannot be connected with the musical instrument, and the information transmission is relatively simple

Images