Piano partner training device based on AI technology

Abstract

The invention discloses a piano partner training device based on an AI technology, which comprises an AI intelligent processing system, the AI intelligent processing system comprises a sound recognition system, a fingering collection system and a dynamic collection system, the sound recognition system is electrically connected with a high-quality microphone mounted on a piano, and the high-quality microphone is electrically connected with the dynamic collection system. The fingering collection system is electrically connected with a plurality of groups of action collection sensors which are mounted on piano keys and respectively correspond to the keys, and the dynamic collection system is electrically connected with a high-resolution dynamic collection camera mounted on the piano; the AI intelligent processing system further comprises a personalized learning module, a diversified practice module, an interactive feedback and guidance module and a cloud updating and learning module. The invention relates to the technical field of musical instrument training, in particular to a piano partner training device based on the AI technology, which can provide powerful computing power and learning algorithms, provide personalized and real-time feedback and guidance for piano learners and further improve the training effect of the piano learners.

Description

Technical Field

[0001] The present invention belongs to the technical field of musical instrument training, and in particular relates to a piano accompaniment training device based on AI technology. Background Art

[0002] The piano is a keyboard instrument originated from Western classical music. It consists of 88 keys, including 52 white keys, 36 black keys, and a metal string soundboard. Because of its excellent and comprehensive performance, the piano is widely used in solo, accompaniment or ensemble performances of various instruments.

[0003] At present, the traditional "apprenticeship system" of "piano teacher tutoring" is mostly adopted in the field of piano accompaniment. The teacher listens to the playing of enthusiasts or beginners on the spot and provides guidance to piano enthusiasts or beginners from an experience perspective. However, as a "piano teacher", it is inevitable to have "personalized" characteristics, which leads to the fact that although its "tutoring" has good guiding significance overall, it also has a certain degree of randomness and arbitrariness. In addition, when students practice at home after class, due to the lack of professional guidance, the practice is basically meaningless and the practice effect is poor, which affects their enthusiasm for practicing the piano.

[0004] Since traditional piano practice often requires a lot of time and energy, and the individualized guidance of piano teachers is difficult to meet the needs of every learner, in response to the existing problems, we propose a piano accompaniment device based on AI technology to improve the practice efficiency and learning effect of piano lovers. Summary of the invention

[0005] In view of the above situation, in order to remedy the above-mentioned existing defects, the present invention provides a piano accompaniment device based on AI technology. This device can provide powerful computing power and learning algorithms to provide piano learners with personalized, real-time feedback and guidance, thereby improving the practice effect of piano learners.

[0006] The present invention proposes a piano accompaniment device based on AI technology, including an AI intelligent processing system, which includes a sound recognition system, a fingering collection system and a dynamic collection system:

[0007] The sound recognition system is electrically connected to a high-quality microphone installed on the piano. The microphone is used to collect audio signals generated by piano learners when playing, and transmit the signals to the sound recognition system. After being processed by the sound recognition system, the data is transmitted to the AI ​​intelligent processing system. The AI ​​intelligent processing system performs algorithmic analysis on the collected and processed audio, so as to be able to analyze and judge the accuracy, rhythm and strength of each note played;

[0008] The fingering collection system is electrically connected to a plurality of groups of motion collection sensors respectively corresponding to the keys installed on the piano keys. The motion collection sensors can capture and collect the fingering motion information of the piano learner during the piano fingering training, and transmit the collected information to the fingering collection system. After being processed by the fingering collection system, the data is transmitted to the AI ​​intelligent processing system. The AI ​​intelligent processing system performs algorithm analysis on the collected and processed fingering motions, so as to analyze and judge the fingering, hand speed and the severity of the piano learner's finger strokes.

[0009] The dynamic collection system is electrically connected to a high-resolution dynamic collection camera installed on the piano. The dynamic collection camera can record and collect the piano learner's movements in real time during piano playing training, and transmit the collected video data to the dynamic collection system. The dynamic collection system performs video decoding optimization processing and then transmits the data to the AI ​​intelligent processing system. The AI ​​intelligent processing system performs algorithm analysis on the processed video information, so as to be able to perform real-time analysis and judgment based on the piano learner's hand movements, playing postures and facial dynamic expressions.

[0010] The AI ​​intelligent processing system also includes a personalized learning module, a diversified practice module, and an interactive feedback and guidance module:

[0011] The personalized learning module can aggregate the audio information data, dynamic video data, and fingering action data processed by the AI ​​intelligent processing system, automatically generate personalized learning plans based on the learner's performance data, adjust the practice content and difficulty, track the learner's progress, and provide targeted improvement suggestions based on actual performance;

[0012] Through diversified practice modes, piano learners can be provided with basic practice modes for basic skills such as scales, chords, finger flexibility, etc. The diversified practice modes have a built-in extensive music library, support music practice of different styles and difficulties, support learners to compose and improvise, recommend suitable practice repertoires according to learners' interests and skill levels, and match suitable practice resources and tutorials according to learners' training levels and needs;

[0013] The interactive feedback and guidance module can provide piano practitioners with instant performance feedback, including scoring, error prompts and improvement suggestions; simulate the role of a piano teacher to train practitioners through voice guidance, video tutorials and interactive questions; provide a virtual orchestra to synchronize accompaniment with the learner's performance to increase the fun and realism of practice; dynamically adjust the difficulty and content of practice according to the learner's performance to help learners gradually improve their skills; generate detailed progress reports based on the learner's performance records, including performance accuracy, common error types, etc.

[0014] Through cloud services and updated learning modules, cloud data synchronization and backup can be supported, allowing learners to access practice records and progress at any time; AI algorithms and music libraries are updated regularly to ensure that the device's functions and content remain up to date; deep learning algorithms are used for note recognition and performance analysis to optimize the model's accuracy and feedback effect.

[0015] The beneficial effects achieved by the present invention using the above structure are as follows: The present invention is a piano accompaniment device based on AI technology, and its advantages are: the present invention combines advanced AI technology with the actual needs of music education to bring users a more personalized, effective and pleasant learning experience, promote the progress and popularization of music education, and solve problems in traditional music education such as low learning efficiency and insufficient personalized guidance, providing learners and educators with new technical support and teaching tools; helping pianists of different levels of professionalism to perform personalized customized technical exercises and performances of works, which can not only improve learners' learning efficiency, but also increase the fun and personalized needs in the learning process, bringing a new experience to piano learners. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0017] Figure 1 A system block diagram of a piano accompaniment device based on AI technology of the present invention;

[0018] Figure 2 The present invention is a block diagram of a piano accompaniment device based on AI technology. DETAILED DESCRIPTION

[0019] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments; based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0020] It should be noted that the words "front", "rear", "left", "right", "up" and "down" used in the following description refer to directions in the drawings, and the words "inside" and "outside" refer to directions toward or away from the geometric center of a specific component, respectively.

[0021] like Figure 1 , Figure 2 As shown in the figure, the technical solution adopted by the present invention is as follows:

[0022] The present invention proposes a piano accompaniment device based on AI technology, including an AI intelligent processing system, which includes a sound recognition system, a fingering collection system and a dynamic collection system;

[0023] The sound recognition system is electrically connected to a high-quality microphone installed on the piano. The microphone is used to collect the audio signals generated by the piano learner when playing, and transmit the signals to the sound recognition system. After being processed by the sound recognition system, the data is transmitted to the AI ​​intelligent processing system. The AI ​​intelligent processing system performs algorithmic analysis on the collected and processed audio, so as to be able to analyze and judge the accuracy, rhythm and strength of each note played;

[0024] The fingering collection system is electrically connected to a plurality of groups of motion collection sensors corresponding to the keys respectively installed on the piano keys. The motion collection sensors can capture and collect the fingering motion information of the piano learner during the piano fingering training, and transmit the collected information to the fingering collection system. After being processed by the fingering collection system, the data is transmitted to the AI ​​intelligent processing system. The AI ​​intelligent processing system performs algorithm analysis on the collected and processed fingering motions, so as to analyze and judge the fingering, hand speed and the severity of the piano learner's finger strokes.

[0025] The dynamic collection system is electrically connected to a high-resolution dynamic collection camera installed on the piano. The dynamic collection camera can record and collect the piano learner's movements in real time during piano playing training, and transmit the collected video data to the dynamic collection system. The dynamic collection system performs video decoding optimization processing and then transmits the data to the AI ​​intelligent processing system. The AI ​​intelligent processing system performs algorithm analysis on the processed video information, so as to make real-time analysis and judgment based on the piano learner's hand movements, playing postures and facial dynamic expressions.

[0026] Among them, the AI ​​intelligent processing system also includes personalized learning module, diversified practice module, interactive feedback and guidance module and cloud update and learning module:

[0027] Personalized learning modules:

[0028] 1. Summarize and analyze the audio information data, dynamic video data, and fingering movement data processed by the AI ​​intelligent processing system.

[0029] 2. Automatically generate personalized learning plans based on learners’ performance data and adjust practice content and difficulty.

[0030] 3. Track learners’ progress and provide targeted improvement suggestions based on actual performance.

[0031] Diverse practice modules:

[0032] 1. Basic exercises: practice mode for basic skills such as scales, chords, finger flexibility, etc.;

[0033] 2. Music performance: Built-in extensive music library, supporting music practice of different styles and difficulties.

[0034] 3. Improvisation: Provide improvisation and accompaniment support to support learners in creation and improvisation.

[0035] 4. Intelligent recommendation of music tracks: Recommend suitable practice tracks based on learners’ interests and skill levels.

[0036] 5. AI resource recommendation: Match appropriate practice resources and tutorials according to learners’ training level and needs.

[0037] Interactive feedback and guidance module:

[0038] 1. Instant feedback: Provide instant performance feedback, including scoring, error prompts and improvement suggestions.

[0039] 2. Virtual teacher: simulates the role of a piano teacher and provides learners with voice guidance, video tutorials and interactive questions.

[0040] 3. Virtual accompaniment: Provide a virtual orchestra to synchronize accompaniment with the learners’ performance, making the practice more interesting and realistic.

[0041] 4. Adaptive practice mode: Dynamically adjust the difficulty and content of practice based on learners’ performance to help learners gradually improve their skills.

[0042] 5. Learning progress tracking: Generate detailed progress reports based on learners’ performance records, including performance accuracy, common error types, etc.

[0043] Cloud update and learning modules:

[0044] 1. Data synchronization: Supports cloud data synchronization and backup, allowing learners to access practice records and progress at any time.

[0045] 2. System Update: Regularly update AI algorithms and music libraries to ensure that the device's functions and content remain up to date.

[0046] 3. Deep learning: Use deep learning algorithms for note recognition and performance analysis to optimize the model’s accuracy and feedback effect.

[0047] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, material or apparatus including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, material or apparatus.

[0048] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A piano training device based on AI technology, characterized in that: The invention comprises an AI intelligent processing system, which comprises a sound recognition system, a fingering collection system and a dynamic collection system: the sound recognition system is electrically connected to a high-quality microphone installed on the piano, the microphone is used to collect the audio signal generated by the piano learner when playing the piano, and transmit the signal to the sound recognition system, and the data is transmitted to the AI ​​intelligent processing system after being processed by the sound recognition system, and the AI ​​intelligent processing system performs algorithmic analysis on the collected and processed audio, so as to be able to analyze and judge the accuracy, rhythm and strength of each note played; the fingering collection system is electrically connected to a plurality of groups of action collection sensors installed on the piano keys and corresponding to the keys respectively, and the action collection sensors can capture and collect the fingering action information of the piano learner during the fingering training of piano playing, and transmit the collected information to the fingering collection system In the system, the data is transmitted to the AI ​​intelligent processing system after being processed by the fingering collection system, and the AI ​​intelligent processing system performs algorithmic analysis on the collected and processed fingering movements, so as to be able to analyze and judge the fingering, hand speed and the severity of the keystrokes of the piano learner's fingers; the dynamic collection system is electrically connected to a high-resolution dynamic collection camera installed on the piano, and the dynamic collection camera can be used to record and collect the real-time movements of the piano learner during piano playing training, and the collected video data is transmitted to the dynamic collection system, and the dynamic collection system performs video decoding optimization processing and then transmits the data to the AI ​​intelligent processing system, and the AI ​​intelligent processing system performs algorithmic analysis on the processed video information, so as to be able to perform real-time analysis and judgment through the piano learner's hand movements, playing postures and facial dynamic expressions.

2. The piano training device based on AI technology according to claim 1, characterized in that: The AI ​​intelligent processing system also includes a personalized learning module, a diversified practice module, an interactive feedback and guidance module, and a cloud update and learning module.

3. The piano training device based on AI technology according to claim 2, characterized in that: The personalized learning module can summarize the audio information data, dynamic video data, and fingering movement data processed by the AI ​​intelligent processing system, automatically generate a personalized learning plan based on the learner's performance data, adjust the practice content and difficulty, and track the learner's progress, and provide targeted improvement suggestions based on actual performance.

4. The piano training device based on AI technology according to claim 2, characterized in that: The diversified practice mode can provide piano practitioners with basic practice modes for basic skills such as scales, chords, finger flexibility, etc. The diversified practice mode has a built-in extensive music library, supports music practice of different styles and difficulties, supports learners in creation and improvisation, recommends suitable practice repertoire according to learners' interests and skill levels, and matches suitable practice resources and tutorials according to learners' training levels and needs.

5. The piano training device based on AI technology according to claim 2, characterized in that: The interactive feedback and guidance module can provide piano practitioners with instant performance feedback, including scoring, error prompts and improvement suggestions; the interactive feedback and guidance module can also simulate the role of a piano teacher, train practitioners through voice guidance, video tutorials and interactive questions, and provide a virtual orchestra to synchronize accompaniment with the learner's performance to increase the fun and realism of the practice, and then dynamically adjust the difficulty and content of the practice according to the learner's performance to help learners gradually improve their skills, and generate a detailed progress report based on the learner's performance record, including performance accuracy and common error types.

6. The piano accompaniment device based on AI technology according to claim 2, characterized in that: The cloud service and updated learning module can support cloud data synchronization and backup, allowing learners to access practice records and progress at any time, regularly update AI algorithms and music libraries to ensure that the device's functions and content remain up to date, use deep learning algorithms for note recognition and performance analysis, and optimize the model's accuracy and feedback effects.

Images