AR augmented reality-based musical instrument-assisted play and concerto experience system

Abstract

The invention discloses an AR augmented reality-based musical instrument-assisted play and concerto experience system. The system comprises an image acquisition unit, an image analysis unit, a second storage unit, an operation unit, a processing unit and a display unit, wherein the image acquisition unit is used for acquiring a video image of a current user held musical instrument in real time, and the video image comprises holding finger nails; the image analysis unit is used for analyzing an image of the current musical instrument, recognizing a profile and an operation area of the current musical instrument, and recognizing and positioning strings or keys of the musical instrument; the second storage unit is used for storing music scores, finger actions corresponding to syllables and notes, and virtual animation elements of the operation of an auxiliary instrument; and the processing unit is used for displaying the positioned strings, keys or striking areas of the musical instrument on the display unit according to the profile and the operation area of the current musical instrument, setting a display area of the animation elements, and calling the corresponding music scores, corresponding pressing actions and the virtual animation elements of the operation of the auxiliary instrument in the second storage unit to be displayed in the display area of the animation elements.

Description

technical field [0001] The invention relates to an augmented reality-based musical instrument auxiliary performance and concerto experience system. Background technique [0002] It has always required a lot of repetitive practice to master the instrument, which is a very difficult instrument to play. In the learning process, the music teacher needs to supervise the students' practice in real time. At the same time, the students need to start from the basic skills to repeat a lot of continuous training until the formation of muscle memory can be regarded as the real acquisition of musical instrument playing skills. The whole learning process is extremely long And boring, requires great perseverance and habit to complete. This high threshold discourages many music lovers, especially musical instrument lovers, which greatly hinders the popularization of musical instruments and affects the popularization of comprehensive music literacy. [0003] AR enhanced display technology ...

AI Technical Summary

Problems solved by technology

[0004] Since the playing of musical instruments and other musical instruments has a relatively fixed method, mainly two parts are the bowing method and the finger holding the piano pressing the strings, and although different players have certain differences in hand shapes and bowing methods, they are generally consistent. It is necessary to complete the core finger pressing and string running actions, which brings the possibility of standardization of actions. If AR enhanced display technology is used to give prompts corresponding to the score, it is expected to get rid of the traditional learning process of playing and reduce the burden of musical instrument performance. threshold

Images