Augmented reality and performance evaluation-based violin learning experience assisting system

Abstract

The invention discloses an augmented reality and performance evaluation-based violin learning experience assisting system comprising an image collection unit, an image analysis unit, a storage unit, an operation unit, a processing unit and a display unit, wherein the image collection unit is used for collecting video images of a current user holding a violin fingerboard in real time, fingernails of hands holding a violin are also displayed in the video images, the image analysis unit is used for analyzing images of the current violin, a contour and a fingerplate zone of the current violin are identified, four violin strings of the violin are identified and positioned, the storage unit is used for storing music scores as well as virtual animation elements of pressing movements and violin bow movements corresponding to syllables and notes, the operation unit is used for displaying the contour and the fingerplate zone of the current violin and the four positioned violin strings of the violin in the display unit and setting an animation element display area, and the processing unit is used for calling a corresponding music score and virtual animation elements of corresponding pressing movements and violin bow movements and then displaying the same in the animation element display area.

Description

technical field [0001] The invention relates to a violin auxiliary learning experience system based on AR augmented reality and performance evaluation. Background technique [0002] It has always required a lot of repetitive practice to master the violin, a very difficult instrument to play. In the learning process, the music teacher needs to supervise the students' practice in real time. At the same time, the students need to start from the basic skills and repeat a lot of continuous training until they form muscle memory before they can truly acquire the violin playing skills. The whole learning process is extremely long And boring, requires great perseverance and habit to complete. This high threshold discourages many music lovers, especially violin lovers, which greatly hinders the popularization of violin and affects the popularization of comprehensive music literacy. [0003] AR enhanced display technology can obtain the information of surrounding targets through Int...

AI Technical Summary

Problems solved by technology

[0004] Since the performance of violin and other musical instruments has a relatively fixed method, mainly two parts are the method of moving the bow and pressing the strings with the fingers holding the violin. It is necessary to complete the core finger pressing and string running actions, which brings the possibility of standardization of actions. If AR enhanced display technology is used to give corresponding prompts to the score, it is expected to get rid of the traditional learning process of playing and reduce the burden of violin playing. threshold

Images