Musical instrument learning system, method and readable storage medium

Abstract

The present invention discloses a musical instrument learning system, method and readable storage medium. The musical instrument learning system (100) includes a training module (110) arranged on a musical instrument and configured to acquire a training signal generated by a learner performing the musical instrument while playing the musical instrument, a storage module (130) arranged to store a reference signal generated by the learner performing the musical instrument, a processing module (120) arranged to generate a correction signal for correcting the performance operation of the learner based on a comparison between the training signal and the reference signal, the correction signal being related to at least one correction operation, and a correction module (140) arranged on the musical instrument and configured to receive the correction signal from the processing module (120) and visually present the correction signal to the learner to assist the learner in performing the corresponding correction operation.

Description

[Technical field]

[0001] [CROSS REFERENCE TO RELATED APPLICATIONS] This application claims priority to a Chinese patent application filed on April 19, 2021, bearing application number 2021104193696 and entitled "Musical Instrument Teaching System, Method and Readable Storage Medium."

[0002] The present invention relates generally to the field of music teaching, and more particularly to a musical instrument teaching system, method and computer readable storage medium. [Background technology]

[0003] In the traditional instrument teaching method, teachers and students often meet face-to-face and teach on-site. With the development of Internet science and technology, online teaching has become an emerging instrument teaching method, and there are mainly three methods for online teaching: 1. A teacher broadcasts live explanations of teaching materials in a video, students practice on their own instruments, and the teacher watches and listens to the students' performance, and remotely guides the students' performance in the form of a video; 2. A teacher plays a pre-recorded video of an explanation of teaching materials, students practice on their own instruments, and the teacher does not watch and / or listen to the students' performance; 3. A teacher plays a video of an explanation of teaching materials, where the video includes instructions on how to play the instrument, and the students play the corresponding positions according to the instructions in the video.

[0004] The above-mentioned conventional musical instrument teaching methods and online teaching methods have many shortcomings. Specifically, the conventional teaching methods require the teacher and the learner to be present at the same time, so it is not easy for the learner to practice independently away from the teacher's on-site instruction. In addition, the online teaching method cannot allow the learner to obtain intuitive teaching information that is directly reflected in the instrument, so it is not possible to actually realize remote interactive teaching, and therefore the improvement of the learner's musical instrument playing ability is very limited. Summary of the Invention [Problem to be solved by the invention]

[0005] In order to solve at least one or more of the problems in the above-mentioned background art, the present invention provides a musical instrument learning system, method and computer-readable storage medium. Through the solution of the present invention, a learner who is training in playing can find out the shortcomings and the points that need to be improved in real time during his / her playing, so that the performance learning result can be greatly improved. Based on this, the present invention provides various solutions in multiple aspects as follows: [Means for solving the problem]

[0006] In one aspect, the present invention discloses a musical instrument learning system, comprising: a training module disposed on the musical instrument and configured to obtain training signals generated by a learner manipulating the musical instrument while playing the musical instrument, a storage module configured to store reference signals generated by the learner manipulating the musical instrument, a processing module configured to generate correction signals for correcting the learner's playing operation based on a comparison between the training signals and the reference signals, the correction signals being associated with at least one correction operation, and a correction module disposed on the musical instrument and configured to receive the correction signals from the processing module and visually present the correction signals to the learner to assist the learner in performing the corresponding correction operation.

[0007] In one embodiment, the correction module includes a light emitting assembly disposed on the instrument and having different light emitting modes to indicate different correction operations to the student.

[0008] In another embodiment, the correction signal comprises a correction signal for correcting one or more of the position, dynamics and rhythm with which a learner plays the instrument.

[0009] In yet another embodiment, the training module is disposed in the instrument strumming or striking area and includes a detection circuit configured to detect the learning player's playing action in the strumming or striking area and generate a corresponding training signal.

[0010] In one embodiment, the detection circuitry includes one or more of a vibration sensor, a micro-electro-mechanical system sensor, a magnetic induction circuit, a capacitive induction circuit, an ultrasonic sensor, and an optical sensor.

[0011] In another embodiment, the training module includes a timer configured to collect rhythmic signals when a learner performs playing operations on the strumming or striking area.

[0012] In yet another embodiment, wherein the correction module has a shape that matches the instrument and is removably connected to the instrument.

[0013] In one embodiment, the musical instrument learning system further includes a display terminal configured to output performance instruction information and / or correction signals to the learner for instructing the learner's performance, and wherein the storage module and / or the processing module are located in a cloud server.

[0014] In another aspect, the present invention further discloses a method for use in musical instrument learning, the method comprising: collecting training signals generated on the musical instrument by a learner performing manipulations of the musical instrument while playing the musical instrument; generating correction signals for correcting the performance manipulations of the learner based on the training signals and a reference signal, the correction signals relating to at least one correction manipulation and the reference signal being a signal generated by performing manipulations of the musical instrument; receiving the correction signals on the musical instrument and visually presenting the correction signals to the learner to assist the learner in performing the corresponding correction manipulations.

[0015] In another aspect, the present invention further discloses a computer readable storage medium including program instructions for use in musical instrument training, the program instructions, when executed by a processor, implementing the method for use in musical instrument training described above. Effect of the Invention

[0016] According to the solutions and embodiments described in the above aspects of the present invention, a learner using the system of the present invention can independently practice playing without the on-site guidance of a teacher. During the training, the learner can accurately understand his / her own playing situation, such as the accuracy of playing, the presence or absence of mistakes, and the cause of mistakes in real time through the correction module of the system of the present invention. Furthermore, the correction module also allows the learner to know how to overcome the above-mentioned mistakes and improve his / her playing level as intended. In addition, the correction mode of the system of the present invention is visually indicated to the learner, so that the learner can easily understand how to correct his / her playing errors and improve his / her playing level. [Brief description of the drawings]

[0017] The above features of the present invention can be better understood, and many of its objects, features and advantages will become apparent to those skilled in the art, by reading the following detailed description in conjunction with the drawings. The drawings in the following description are merely some embodiments of the present invention, and those skilled in the art can obtain other drawings based on these drawings without any creative effort, where [Figure 1] 1 is a schematic block diagram showing the configuration of a musical instrument learning system according to an embodiment of the present invention; [Diagram 2] FIG. 2 is a schematic block diagram showing a configuration of a musical instrument learning system according to another embodiment of the present invention. [Diagram 3] FIG. 2 is an exemplary structural schematic diagram showing key areas of a piano-type instrument according to an embodiment of the present invention. [Figure 4] FIG. 2 is an exemplary structural schematic diagram showing a striking area of ​​a drum-type musical instrument according to an embodiment of the present invention. [Diagram 5] 1 is an exemplary structural diagram illustrating a light emitting assembly according to an embodiment of the present invention. [Figure 6] 2 is a flowchart illustrating a method for learning a musical instrument according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0018] The following clearly and completely describes the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, and not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without any creative effort belong to the protection scope of the present invention.

[0019] With the development of Internet science and technology, online teaching has become an emerging musical instrument teaching method. Compared with traditional teaching methods, the online remote video teaching method does not require teachers and students to carry out teaching activities at the same time and in the same place, but at the same time there is a problem that teachers cannot comprehensively obtain specific operation information during the performance of the student, such as the specific position and dynamics of the playing, and these detailed information cannot be accurately obtained by online remote video, and cannot realize direct instruction to the student on the musical instrument. Based on the above background, the present invention designs a musical instrument teaching system. By improving the musical instrument in the system, for example, by arranging multiple modules for collecting performance signals and correcting the performance in the musical instrument, the system of the present invention can obtain the performance situation of the student during training in real time, and realize intuitive and timely instruction to the student, thereby facilitating the improvement of the performance level.

[0020] The following describes in detail several embodiments of the present invention in conjunction with the drawings.

[0021] FIG. 1 is a schematic block diagram showing a musical instrument learning system 100 according to an embodiment of the present invention.

[0022] As shown in FIG. 1, the musical instrument learning system 100 of the present invention may include a training module 110, a processing module 120, a storage module 130, and a correction module 140. In one embodiment, the training module may be disposed on the musical instrument and is used for collecting in real time a training signal generated by a learner performing a musical instrument operation during playing. The storage module is used for storing a reference signal generated by performing a musical instrument operation. The processing module is used for generating a correction signal for correcting the learner's performance operation by matching the training signal with the reference signal, where the correction signal is related to at least one correction operation, and the correction operation may include, for example, pressing a key, striking a drum surface, or plucking a string. The correction module is disposed on the musical instrument and is used for receiving the correction signal from the processing module and visually presenting the correction signal to the learner, so as to guide the learner to perform the corresponding correction operation.

[0023] FIG. 2 is a schematic block diagram showing a musical instrument learning system 200 according to another embodiment of the present invention.

[0024] As shown in FIG. 2, the musical instrument learning system 200 may include a training module 110, a processing module 120, a storage module 130, and a correction module 140. In one embodiment, the training module 110 may include a detection circuit 110-1, which is used to detect the learner's playing operation in the strumming or striking area of ​​the musical instrument and generate a corresponding training signal. In one embodiment, the detection circuit may include one or more sensors, such as a vibration sensor 110-11, a microelectromechanical system sensor 110-12, a magnetic induction circuit 110-13, and an optical sensor 110-14, to sense or detect the learner's playing operation of the musical instrument. According to different implementation scenarios, the detection circuit may be disposed under the strumming or striking area of ​​the musical instrument, such as under the keys of a piano-type instrument or the drum surface of a drum-type instrument, to obtain information such as the strength, position and time when the key is pressed or the drum surface is struck in real time.

[0025] In one embodiment, the reference signal stored in the storage module 130 may be generated by first obtaining a group of teaching signals. In one realization scenario, a performer with rich playing experience may play a piece of music on the musical instrument on which the training module of the present invention is arranged, and one teaching signal may be generated for each playing action (e.g., each press, strike or touch) that the performer performs on the musical instrument. Thus, each time the piece of music is played, a set of teaching signals for the piece of music is generated, and the set of teaching signals is the group of teaching signals for the piece of music. After multiple plays, multiple sets of teaching signals for the piece of music can be obtained by the training module. Then, a reference signal may be generated based on the aforementioned multiple sets of teaching signals. In one realization, the aforementioned multiple sets of teaching signals may be used as samples, and the teaching signals of each playing action may be processed by a normal distribution method, thereby obtaining a set of reference signals for playing the piece of music, i.e., the reference signals in the context of the present invention.

[0026] As can be understood, since the training module of the present invention is used to collect signals, the above teaching signal group and the reference signal obtained later can be regarded as a set of performance signals generated corresponding to the playing operation of the musical instrument at different times. Furthermore, the reference signal obtained in the above manner can be regarded as a standard or professionally recognized playing operation. In addition, the above manner of obtaining the reference signal is not limiting, but merely exemplary, and can take different manners according to different application scenarios or actual conditions. For example, in order to correct the performance deficiency of the learner, the music piece played by the performance teacher using the training simulation module of the present invention can be directly used as the reference signal.

[0027] In one embodiment, the processing module 120 may be configured by a chip or circuit having the ability of analysis, judgment and calculation, and its specific operation flow may be illustratively performed as follows. First, the training signal collected during the performance of the learner is compared and analyzed with the above-mentioned reference signal. According to different implementation methods, the comparison and analysis here may be related to the playing length of the music piece. Take the learner playing the marimba as an example. When the learner uses the marimba to practice a four-four beat score with a duration of one minute, the duration of each beat is one second, and at each beat, the training module of the present invention records a training signal. After the performance with a duration of one minute is finished, the training signal with a duration of one minute collected by the training module may be compared and analyzed with the above-mentioned reference signal. This comparison and analysis may be performed every second or every beat, that is, the training signal may be compared and analyzed with the reference signal at each beat. If the standard reference signals are 60 in one minute, but the training signals collected by the training module are 50, the processing module will determine through number comparison that the learner has made mistakes in that one minute, and will generate a corresponding correction signal accordingly. The performance time length of the comparison analysis can be adjusted according to the learner's ability. For example, for a beginner learner, the comparison analysis may be performed immediately after each note is played, and the correction signal may be generated. However, for an advanced learner (who has a smaller probability of making mistakes than a beginner learner), the processing module may perform the comparison analysis and generate the correction signal after the entire piece is played. Finally, the processing module may send the generated correction signal to the correction module by comparing it with the reference signal.

[0028] Further, for example, a learner hits a drum to practice playing, if the strength and / or position of the learner's hit on the drum surface is incorrect, the training module of the present invention generates a training signal different from the reference signal. In other words, the training module collects training signals including strength and / or position information of mistakes during hitting. Then, based on a processing module located at the far end, for example, the training signal may be compared in time dimension and / or coordinate dimension with the previously stored reference signal, thereby generating a correction signal of the correct strength and position of hitting on the drum surface.

[0029] As can be seen from the above, in the above exemplary operation flow, the processing module plays a role equivalent to a teacher finding an incorrect operation of a learner by comparing the performance operation of the learner with a standard performance operation, and can further provide correct performance guidance and additional overall evaluation for the incorrect performance operation.

[0030] In one embodiment, the correction module 140 may include a light-emitting assembly 140-1, which can correct the learner's operation in the form of the light-emitting assembly illuminating. For example, when a learner should press a certain key at a certain time, but due to the learner's mistake, the key is not pressed at a certain time, the light-emitting assembly arranged on the top of the key will be lit up to remind the learner that the correct operation is to press the key.

[0031] As can be seen, the visual correction signal transmitted to the learner corresponds to the teaching advice proposed by the teacher for the learner's incorrect operation. In this manner, the learner can still receive intuitive teaching advice in real time that is directly fed back to the instrument when training on his / her own. Since the learner's actual playing operation information is obtained from the instrument and not from other routes, the collected information is more accurate, and the correction signal fed back to the learner is more accurate and effective in correcting the learner's performance deficiencies. Furthermore, since the teaching advice is based on the learner's actual playing operation information, it is more accurate and the effect of training guidance is better.

[0032] According to different implementation scenarios, the musical instrument learning system 200 of the present invention may further include a display terminal 150, which is used to output playing instruction information and / or correction signals for teaching the learner how to play. Optionally, the playing instruction information and / or correction signals may be text signals, audio signals, video signals, or combinations thereof.

[0033] FIG. 3 is a structural schematic diagram showing a key area 300 of a piano-type instrument according to an embodiment of the present invention.

[0034] As shown in Fig. 3, a key area 300 of the piano-type musical instrument according to the embodiment of the present invention may include a key 301, a detection circuit 302, a support panel 303, and a light-emitting assembly 304. Specifically, the detection circuit 302 disposed below the key 301 in Fig. 3 is a vibration sensor. Furthermore, the vibration sensor is disposed on the support panel 303. Moreover, the light-emitting assembly 304 is disposed above the key.

[0035] In one embodiment, when a key is touched, the vibration sensor under the key obtains a corresponding mechanical vibration quantity, and this mechanical vibration energy is received by the mechanical part of the vibration sensor to form another mechanical vibration quantity suitable for conversion. Finally, the mechanical vibration quantity is converted into an electrical signal by the electromechanical conversion part of the vibration sensor. Furthermore, the training module can obtain the position of the touched key through the number of the vibration sensor, and obtain the strength of the touch of the key through the electrical signal output by the vibration sensor, and further output the position signal and the strength signal, and the training signal collected by the detection circuit at this time includes the position signal and the strength signal.

[0036] In different application scenarios, the detection circuit may be one or more of a pressure sensor, a magnetic induction circuit, a capacitive induction circuit, an ultrasonic sensor, and an optical sensor, where the type, number and layout of the detection circuit may be configured according to the type of musical instrument. For example, in the case of a musical instrument that mainly uses plucking strings, such as a guitar or a koto, the detection circuit may be an optical sensor, which senses the position and time when the string is plucked by the change in light near the string. In addition, the detection circuit of a drum-type musical instrument may be a magnetic induction circuit, etc.

[0037] FIG. 4 is a structural schematic diagram showing a striking area 400 of a drum-type musical instrument according to an embodiment of the present invention.

[0038] As shown in FIG. 4, the striking area 400 of the drum-type musical instrument according to the embodiment of the present invention may include a drum surface 401, a detection circuit 402, a support panel, etc., where the detection circuit may be closely positioned below the drum surface to better detect the signal generated by the learner striking the drum surface.

[0039] As shown in FIG. 4, in one embodiment, the detection circuit 402 in FIG. 4 may be a magnetic induction area. In one scenario, each magnetic induction area may include a respective magnetic induction circuit, so that the relevant magnetic induction signal is generated when the magnetic induction area is triggered. The magnetic induction circuit may include a circuit consisting of a magnetic induction coil (the magnetic induction coil is represented in a grid shape in FIG. 4). When the magnetic induction coil is energized, an excitation alternating electromagnetic field is generated in the magnetic induction area based on the electromagnetic induction principle. Furthermore, when the magnetic induction area is triggered, the magnetic flux of the alternating magnetic field changes, and the training module can obtain the position where the magnetic induction area is located by calculating the change in the amount of magnetic flux, and further output a position signal.

[0040] In addition, the training module can also determine the actual operation manner of the learner by calculating the change in the amount of magnetic flux. Different musical instruments have different operation manners, and the operation manner of the drum-type musical instrument in this embodiment may include operations such as striking the drum surface, tracing the drum surface, or hitting the drum surface. In such an operation mode, the training signal collected by the detection circuit may include a position signal and an operation manner signal. In addition, a pressure sensor can be disposed under the drum surface to obtain a strength signal of striking the drum surface.

[0041] In one implementation scenario, the detection circuit may further include a timer to detect whether the operation at each time point during the performance of the learner is correct and whether the overall performance time is acceptable. For example, a certain key should be pressed at the 18th second during the performance, but the timer counts 18 seconds, but the key is not pressed, indicating that the learner's current operation is incorrect, and the training module collects the incorrect operation. For example, if the complete performance time of a piece of music is 3 minutes 20 seconds, but the learner's actual performance time is 3 minutes 18 seconds, it indicates that the learner's performance is unacceptable and there is definitely an incorrect operation at some / some points. At this time, the training module collects the incorrect operation at some / some points, and also collects the overall performance time difference of "2 seconds". In addition, the rhythm signal may be the time point of each performance operation, and if the time point of the learner's actual performance operation does not match the time point in the corresponding reference signal, it indicates that the learner's rhythm is incorrect at this time.

[0042] For the training signal, different kinds of detection circuits used in the present invention can obtain different kinds of training signals, and the training signals obtained thereby have multi-dimensional attributes. Accordingly, the reference signal and the correction signal can be multi-dimensional, and the dimensions here can include position, strength, operation mode and rhythm. The training signal, the reference signal and the correction signal can each include one or more of a position signal, a strength signal, an operation mode signal and a rhythm signal.

[0043] In one embodiment, when the reference signal is a multi-dimensional signal, the process of generating the reference signal is as follows: First, a performer with rich playing experience plays a certain piece of music on an instrument on which a training module is arranged, and a set of training signals is generated each time the piece of music is played. After multiple performances, multiple sets of training signals for the piece of music are generated. Furthermore, the multiple sets of training signals are taken as samples, and at least one dimensional signal included in the training signal of each step of the operation is processed by normal distribution method to obtain a set of multi-dimensional reference signals for the piece of music. Accordingly, the specific operation flow of the processing module is as follows: First, the training signal and the reference signal are compared on at least one dimension, then a training signal different from the reference signal is found, and finally, a correction signal generated by matching the training signal with the reference signal is sent to the correction module.

[0044] As can be seen, the present invention can use different kinds of detection circuits to obtain multiple dimensions of training signals for learners, so as to guide learners more accurately. At the same time, the different kinds of detection circuits can also be adapted to various musical instruments. According to application scenarios, the musical instruments can be one or more of musical instruments such as piano, electric piano, xylophone, vibraphone, marimba, chimes, drum set and Chinese drum.

[0045] FIG. 5 is a structural schematic diagram illustrating a light emitting assembly 500 according to an embodiment of the present invention.

[0046] As shown in FIG. 5, the light-emitting assembly of the present invention may include a first light-emitting assembly 501, a second light-emitting assembly 502, a third light-emitting assembly 503, and a fourth light-emitting assembly 504. According to different implementation scenarios, the number and layout of the above light-emitting assemblies may be configured according to the type of musical instrument. In one embodiment, the first light-emitting assembly, the second light-emitting assembly, and the third light-emitting assembly in FIG. 5 may be arranged under the drum surface, and the three are connected to each other in a circular ring shape, and the drum surface is divided into a drum edge region, a drum central region, and a drum center region. When the first light-emitting assembly is turned on, the correction signal at this time is a position signal, and the learner is reminded that the position where the first light-emitting assembly is located should be hit; similarly, when the second light-emitting assembly or the third light-emitting assembly is turned on, the learner is reminded that the position where the second light-emitting assembly or the third light-emitting assembly is located should be hit.

[0047] In one embodiment, the fourth light-emitting assembly may be disposed on the side of the drum surface, which is a light-emitting assembly that indicates to the learner the strength of striking the drum surface. This light-emitting assembly may be a lamp belt, which may include a number of single lamps connected in sequence. When playing the musical instrument, the single lamps are lit in sequence from one end of the lamp belt, and the more single lamps that are lit, the stronger the strength signal is. When the strength needs to reach the maximum, all the single lamps are lit, and when no strength signal is received, the lamp belt is not lit.

[0048] As can be seen, for the light-emitting assembly, the correction module converts the correction signal into a control signal for controlling the light-emitting assembly, and the light-emitting assembly may be disposed on the musical instrument, which can emit light signals based on the control signal, thereby intuitively and directly guiding the learner's playing. According to different application scenarios, the correction signal may have various types, and the various correction signals may be converted into different control signals, and the light-emitting assembly may emit diversified light signals based on the different control signals, where different light signals represent different presentations. When playing the musical instrument, the state of the light-emitting assembly disposed on the top of the key can remind the learner whether the pressed key is correct. For example, if a certain key is not pressed at a certain time, the light-emitting assembly on the top of the key is lit to remind the learner that the key needs to be pressed at this time. In addition, the light-emitting assembly is turned off within a certain time period after being lit, and the time period may be, for example, 0.5 seconds.

[0049] In different application scenarios, the light-emitting assembly may be a single lamp, a lamp group consisting of multiple single lamps, or a device that can be illuminated by electrical or optical signals, such as a liquid crystal display panel, an optical assembly consisting of optical fibers, etc. Furthermore, the light-emitting assembly can emit one color light or multiple colors of light, and can convey different correction signals to the learner through color conversion. In one embodiment, when the light is orange, it indicates that the striking strength is too large, when the light is red, it indicates that the operation should be performed but has not been performed, when the light is yellow, it indicates that the operation strength is insufficient, and when the light is blue, it indicates that the operation methods are not equal.

[0050] In one embodiment, the shapes of different light-emitting assemblies may also be different. As shown in FIG. 5, the shapes of the first light-emitting assembly, the second light-emitting assembly and the third light-emitting assembly are adapted to the drum surface and are detachably connected to the drum surface. The teaching system of the present invention can flexibly transfer the first light-emitting assembly, the second light-emitting assembly, the third light-emitting assembly and the fourth light-emitting assembly to different drum surfaces according to the actual needs of the user, thereby improving the adaptability and utilization rate of the musical instrument teaching system and facilitating sales or rental.

[0051] As can be seen from the above, the correction signal can be used to correct the operation position, dynamics, operation manner and rhythm of the learner during playing, and the light-emitting assembly can guide the learner to perform different correction operations in different light-emitting modes. The musical instrument teaching system of the present invention can be adapted to various musical instruments through diversified correction signals, thereby accurately teaching the learner's playing from multiple dimensions.

[0052] In another embodiment, the diversified correction signal may be transmitted to the learner in the form of light emitted by the light-emitting assembly, or may be transmitted to the learner by the display terminal. The display terminal may be a television, a computer, a mobile phone, a projector, etc., and may be used to output performance instruction information for instructing the learner to play, or may be used to play a performance video for the learner. The performance video may include, but is not limited to, information such as 1. target score or notes, 2. a model of how to express the target score or notes, and 3. performance progress associated with the target score or notes. Furthermore, the performance instruction information and the correction signal may be an evaluation report in text format.

[0053] When the musical instrument learning system of the present invention is actually applied to a lesson, a real-time feedback system may be used to provide feedback to a beginner by lighting a correction signal from a light-emitting assembly so that the beginner can immediately correct errors that occur during the lesson. Also, for a learner with some experience, feedback may be provided to the learner in the form of an evaluation report after the entire performance is completed, and the learner can correct the errors pointed out in the report and practice.

[0054] In one embodiment, the storage module and the processing module of the teaching system of the present invention may be deployed in a stand-alone system, a server system, or a cloud server system according to actual needs. As can be seen from the description herein, the deployment of the storage module and the processing module of the present invention is very flexible, both of them may be deployed locally (i.e., in one location with the instrument) or remotely (i.e., far away from the instrument), and both of them may be deployed in the same location or separately.

[0055] FIG. 6 is a flow chart illustrating a method 600 for learning a musical instrument according to an embodiment of the present invention.

[0056] As shown in FIG. 6, in one embodiment, a method 600 for use in musical instrument training of the present invention may include the following steps.

[0057] Step S601: Using a detection circuit disposed on the musical instrument, collect training signals generated by the learner performing the musical instrument operation during playing; Step S602: The training module sends the training signal to the processing module; Step S603: The processing module acquires a reference signal from the storage module. As mentioned above, the reference signal here may be a performance operation signal that is performed and correctly collected by a performance teacher in advance; Step S604: The processing module obtains a correction signal for correcting the learner by comparing the reference signal with the training signal (including various necessary analyses and processes as described above in the exemplary manner). In one implementation scenario, the training signal and the reference signal may be compared in the time dimension (i.e., based on the same time point). If the training signal at the same time point is different from the reference signal, the reference signal may be directly used as the correction signal to correct the learner's performance error; Step S605: Send the analyzed correction signal to the correction module as a result, where the analysis result includes a specific type of the reference signal, such as a position signal, a dynamic signal or a rhythm signal, and the analysis result may further include a specific dynamic value of the dynamic signal; Step S606: the correction module receives the correction signal and sends the correction signal to a corresponding light-emitting assembly. For example, if the correction signal is a position signal, the correction signal is sent to the light-emitting assembly for presenting the position, if the correction signal is an intensity signal, the correction signal is sent to the light-emitting assembly for presenting the intensity, and the light-emitting assembly for presenting the intensity performs a corresponding lighting operation according to a specific intensity value included in the correction signal, and the light-emitting assembly emits light according to the instruction of the correction signal, and visually presents the correction signal to the learner, thereby assisting the learner to perform the corresponding correction operation.

[0058] In one implementation scenario, the correction signal obtained in step S604 above may be fed back to the learner in real time, i.e., if the learner performs an incorrect operation, the light-emitting assembly may immediately emit a corresponding light to present it to the learner. In another implementation scenario, the processing module may aggregate the correction signals generated during the performance and align them into an evaluation signal after the performance of the entire piece is completed. In one embodiment, the evaluation signal may include a set of correction signals distributed over different time points. After the performance is completed, the processing module may generate an evaluation report based on the evaluation signals and send the evaluation report to the learner, so as to point out errors and deficiencies in the performance to the learner in the form of the evaluation report.

[0059] The working principle of the musical instrument learning system of the present invention will be further described below by taking the learner's piano playing practice as an example. It should be noted that, for the purpose of simplifying the description, the reference signal is only regarded as the correction signal of the present invention, that is, when there is a difference between the training signal and the reference signal, the reference signal is directly selected as the correction signal for correcting the learner's playing operation. In addition, each key of the piano is provided with an LED lamp for indicating the playing position and an LED lamp belt for indicating the pressing strength. The LED lamp belt includes 10 LED lamps arranged in parallel, and when all the LED lamps of the LED lamp belt are lit, it represents a force of 1 Newton, when 9 lamp belts are lit, it represents a force of 0.9 Newton, and based on this, when one lamp belt is lit, it represents a force of 0.1 Newton. A timer and a pressure sensor are arranged under the key.

[0060] First, a learner plays a piece of music, and the rhythm signal, position signal and dynamic signal generated during the performance are collected by a timer and a pressure sensor in the training module, then the training module sends the rhythm signal, position signal and dynamic signal to the processing module, which retrieves the reference signal of the piece of music from the storage module, which reference signal also includes the rhythm signal, position signal and dynamic signal. After that, the processing module compares and analyzes the rhythm signal, position signal and dynamic signal at each time point during the learner's performance with the rhythm signal, position signal and dynamic signal in the reference signal at the same time point, i.e., compares the rhythm signal of the training signal with the rhythm signal of the reference signal, compares the position signal of the training signal with the position signal of the reference signal, and compares the dynamic signal of the training signal with the dynamic signal of the reference signal.

[0061] As a result of the above comparison and analysis, if the signal of any one dimension (including rhythm, position and dynamics) in the training signal is different from the signal of this dimension in the reference signal at the same time point, the signal of this dimension in the reference signal is the correction signal. For example, at 2 minutes and 5 seconds of the song, the learner should play the low-pitched D key, but the timer and pressure sensor detect that the low-pitched C key is pressed but the low-pitched D key is not pressed at this time point, at this time the position signal of the training signal is different from the position signal of the reference signal. Therefore, the correction signal is the position signal of the reference signal at 2 minutes and 5 seconds. Furthermore, the processing module emits this position signal as a correction signal to the light-emitting assembly for indicating the operation position, i.e., the LED lamp above the low-pitched D key. Finally, the LED lamp above the D key is lit to indicate to the learner that this key should be pressed.

[0062] Furthermore, for example, at the 1 minute 8 second point of the piece, the learner should play the low register A key with a force of 1 Newton, but if the timer and pressure sensor detect that the low register A key is pressed with a force of 0.5 Newton at this point, the dynamic signal of the training signal at this time is different from the dynamic signal of the reference signal. Therefore, the correction signal is the dynamic signal of the reference signal at the 1 minute 8 second point. Furthermore, the processing module emits this dynamic signal (including the dynamic value) as a correction signal to the light-emitting assembly, i.e., the LED lamp belt above the low register A key, which presents the operation dynamic. Finally, all the LED lamp belts above the A key are lit up, indicating to the learner that the learner should press this key with a greater force at the 1 minute 8 second point.

[0063] The method for musical instrument learning proposed by the present invention based on the above solution collects training signals in real time during the learner's playing practice, and feeds back intuitive correction signals to guide the learner. When the learner is training independently, he or she can still receive intuitive guidance in real time that directly responds to the instrument, thereby realizing two-way communication between education and learning, and achieving good teaching effects.

[0064] The present invention further discloses a computer readable storage medium which may include program instructions for use in musical instrument training, and which, when executed by a processor, implements the method for use in musical instrument training described above.

[0065] It should be understood that the terms "first", "second", "third" and "fourth" etc. in the claims, specification and drawings of the present invention are not intended to describe a particular order but to distinguish between different objects. The terms "comprise" and "comprising" as used in the specification and claims of the present invention indicate the presence of stated features, wholes, steps, operations, elements and / or assemblies but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, assemblies and / or groups thereof.

[0066] It should be further understood that the terms used herein in the present specification are used only for the purpose of describing specific embodiments, and are not intended to limit the present invention. As used herein in the present specification and claims, the singular forms "a", "an" and "the" are intended to include the plural forms unless the context clearly dictates otherwise. It should be further understood that the term "and / or" as used herein in the present specification and claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0067] As used herein and in the claims, the term "if" may be interpreted as "when" or "once" or "responsive to determining" or "responsive to detecting," depending on the context. Similarly, the phrase "when determined" or "if [a described condition or event] is detected" may be interpreted as "once determining" or "responsive to determining" or "once [a described condition or event] is detected" or "responsive to detecting [a described condition or event]," depending on the context.

[0068] Although the embodiment of the present invention is as described above, the above content is merely an example adopted to facilitate understanding of the present invention, and is not intended to limit the scope and application scenario of the present invention. Any person skilled in the art of the present invention may make any modifications and changes in the embodiments and details without departing from the spirit and scope of the present invention, but the patent protection scope of the present invention should be in accordance with the scope defined in the appended claims.

Claims

1. A musical instrument teaching system, comprising: a training module disposed on the musical instrument and configured to acquire training signals generated by a learner manipulating the musical instrument during playing; a storage module configured to store a reference signal generated by playing the musical instrument; a processing module configured to generate correction signals for correcting the learner's playing operation based on a comparison between the training signal and a reference signal, the correction signals relating to at least one correction operation, the correction signals including correction signals for correcting one or more of a position, a dynamic and a rhythm with which the learner plays the musical instrument; disposed on the instrument; and receiving the correction signal from the processing module; and a correction module configured to visually present the correction signal to the learner to assist the learner in performing a corresponding correction operation; the correction module includes a light-emitting assembly disposed on the musical instrument and configured to provide different light-emitting modes to indicate different correction operations to the learner; The different light-emitting modes include at least different ways of lighting the light-emitting assembly, displaying different light-emitting states, emitting different colors of light, or changing the color of light; the musical instrument is a drum, the light emitting assembly comprises a first light emitting assembly, a second light emitting assembly, a third light emitting assembly, and a fourth light emitting assembly; the first light-emitting assembly, the second light-emitting assembly and the third light-emitting assembly are disposed under a drum surface and connected to each other in a circular ring shape; The fourth light emitting assembly is disposed on the side of the drum surface and indicates to the learner the strength of hitting the drum surface. A musical instrument learning system comprising:

2. The musical instrument learning system of claim 1 , wherein the training module includes a detection circuit configured to detect the playing action of a learner in a striking area and generate a corresponding training signal.

3. The musical instrument learning system of claim 2 , wherein the detection circuitry includes one or more of a vibration sensor, a micro-electro-mechanical system sensor, a magnetic induction circuit, a capacitive induction circuit, an ultrasonic sensor, and an optical sensor.

4. The musical instrument learning system of claim 2 , wherein the training module includes a timer configured to collect rhythmic signals when a learner performs a playing operation on a striking area.

5. 2. The musical instrument learning system of claim 1, wherein the correction module has a shape that matches the musical instrument and is removably connected to the musical instrument.

6. 2. The musical instrument learning system of claim 1, further comprising a display terminal configured to output to the learner performance instruction information and / or correction signals for instructing the learner's performance, wherein the storage module and / or the processing module are located in a cloud server.

7. 1. A method for use in musical instrument teaching, comprising: collecting training signals generated by a learner operating the instrument while playing the instrument; generating a correction signal for correcting the performance operation of the learner based on the training signal and a reference signal, the correction signal being related to at least one correction operation, the correction signal including a correction signal for correcting one or more of a position, a dynamic and a rhythm in which the learner performs the musical instrument, and the reference signal being a signal generated by performing the musical instrument; receiving the correction signals at the musical instrument and visually presenting the correction signals to the learner to assist the learner in performing the corresponding correction operations; The visually presenting step includes instructing the learner to perform different correction operations using different lighting modes; The different light-emitting modes include at least different ways of lighting the light-emitting assembly, displaying different light-emitting states, emitting different colors of light, or changing the color of light; the musical instrument is a drum, the light emitting assembly comprises a first light emitting assembly, a second light emitting assembly, a third light emitting assembly, and a fourth light emitting assembly; the first light-emitting assembly, the second light-emitting assembly and the third light-emitting assembly are disposed under a drum surface and connected to each other in a circular ring shape; The fourth light emitting assembly is disposed on the side of the drum surface and indicates to the learner the strength of hitting the drum surface.

1. A method for use in musical instrument training.

8. 10. A computer readable storage medium containing program instructions for use in musical instrument instruction, the program instructions implementing the method of claim 7 when executed by a processor.

Images