Apparatus and method for teaching performance

Abstract

To propose improvements for the incorrect musical performance of a user.SOLUTION: A musical performance guidance device 1 comprises: a note identification unit 35 that identifies from musical score data the notes of musical performance data played by a user; a dataset identification unit 36 that identifies, for each musical score, an evaluation sound dataset corresponding to the notes identified by the note identification unit 35, from an evaluation sound database 31 in which an evaluation sound dataset is registered that includes model sound data and incorrect sound data; a sound data identification unit 37 that compares a plurality of sound data included in the identified evaluation sound data with the sound data played by a user, so as to identify one sound data included in the identified evaluation sound dataset; a guidance data identification unit 38 that, when the identified sound data is incorrect sound data, identifies guidance data that is preliminarily registered in association with the incorrect sound data; and a notification unit 39 that notifies identified guidance data to the user.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a musical performance instruction device and a musical performance instruction method. [Background technology]

[0002] For example, Patent Document 1 discloses a performance display device that clearly conveys the difference between a user's performance and a model performance. The performance display device described in Patent Document 1 visually indicates to the user whether the user performer's sound production events are being performed correctly by comparing and displaying a performance display based on the user performer's performance with a performance display based on a model performer's performance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2002-91290 A Summary of the Invention [Problem to be solved by the invention]

[0004] According to the performance display device disclosed in Patent Document 1, the user can check what kind of mistakes he or she made in comparison with the model performance. However, it was not clear how to improve the incorrect performance.

[0005] The present invention has been made in consideration of the above circumstances, and has an object to provide a musical performance instruction device and a musical performance instruction method that are capable of suggesting improvements to a user's incorrect performance. [Means for solving the problem]

[0006] The performance instruction device according to a first aspect of the present invention comprises a score data acquisition unit that acquires score data played by a user, a performance data acquisition unit that acquires performance data including sound data played by the user, a note identification unit that identifies notes corresponding to each sound data that constitutes the performance data based on the score data, a dataset identification unit that identifies, for each note, an evaluation sound dataset corresponding to the note identified by the note identification unit from an evaluation sound database in which evaluation sound datasets including model sound data and incorrect sound data are registered, a sound data identification unit that identifies one of the sound data included in the identified evaluation sound dataset by comparing multiple sound data included in the identified evaluation sound dataset with the sound data played by the user, a teaching data identification unit that, if the identified sound data is incorrect sound data, identifies teaching data that is registered in advance in association with the incorrect sound data, and a notification unit that notifies the user of the identified teaching data.

[0007] A performance instruction method according to a second aspect of the present invention includes the steps of: acquiring sheet music data to be played by a user; acquiring performance data including sound data performed by the user; identifying notes corresponding to each sound data constituting the performance data based on the sheet music data; identifying an evaluation sound data set corresponding to the identified note from an evaluation sound database in which evaluation sound data sets including model sound data and incorrect sound data are registered for each note; identifying one of the sound data included in the identified evaluation sound data set by comparing the multiple sound data included in the identified evaluation sound data set with the sound data played by the user; if the identified sound data is incorrect sound data, identifying instruction data that is registered in advance in association with the incorrect sound data; and notifying the user of the identified instruction data. Effect of the Invention

[0008] According to the present invention, it is possible to provide an advantage in that it is possible to suggest a remedy for a user's incorrect performance. [Brief description of the drawings]

[0009] [Figure 1] 1 is a system configuration diagram showing, in outline, the overall configuration of a musical performance instruction system according to a first embodiment of the present invention. [Diagram 2] 1 is a schematic diagram showing an example of a hardware configuration of a musical performance instruction device according to a first embodiment of the present invention. [Diagram 3] FIG. 2 is a schematic diagram showing an example of a hardware configuration of a student terminal according to the first embodiment of the present invention. [Figure 4] 1 is a functional block diagram showing an example of functions of a musical performance instruction device according to a first embodiment of the present invention. [Diagram 5] 4 is a flowchart showing an example of a processing procedure of a musical performance teaching method according to the first embodiment of the present invention. [Figure 6] FIG. 11 is a functional block diagram showing an example of functions of a musical performance instruction device according to a second embodiment of the present invention. [Figure 7] FIG. 11 is a diagram showing an example of an evaluation sound data set group stored in an evaluation sound database according to a second embodiment of the present invention. [Figure 8] FIG. 11 is a diagram showing an example of data stored in a teaching database according to a second embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, a musical performance instruction device and a musical performance instruction method according to a first embodiment of the present invention will be described with reference to the drawings. Fig. 1 is a system configuration diagram showing an outline of the overall configuration of a musical performance instruction system 100 according to a first embodiment of the present invention. As shown in Fig. 1, the musical performance instruction system 100 includes a musical performance instruction device 1 and a student terminal 2. In the following description, the student terminal 2 is, for example, a device used by a user who wishes to receive musical performance instruction. In FIG. 1, one student terminal 2 is shown, but the number is not limited to this example.

[0011] The student terminal 2 is connected to the performance instruction device 1 via a network 5 so as to be able to communicate with each other and transmit and receive information. An example of the network 5 is the Internet, but it may be another network line.

[0012] Fig. 2 is a schematic diagram showing an example of the hardware configuration of the musical performance teaching device 1 according to the first embodiment of the present invention. As shown in Fig. 2, the musical performance teaching device 1 mainly includes a CPU 11, a main memory 12 that functions as a work area when each program is executed, a storage unit 13 for storing the programs executed by the CPU 11 and data referenced by the programs, and a communication unit 14 for connecting to a network. The musical performance teaching device 1 may further include an input unit 15, a display unit 16, and the like. These units are connected via a bus, for example. Examples of the storage unit 13 include a magnetic disk such as a hard disk drive (HDD), a magneto-optical disk, and a semiconductor memory such as a solid state drive (SSD).

[0013] The student terminal 2 is, for example, an information processing device such as a notebook PC, a desktop PC, a tablet terminal, a smartphone, etc. An example of the hardware configuration of the student terminal 2 is shown in FIG.

[0014] 3, the student terminal 2 includes, for example, a CPU 21, a main memory 22, a storage unit 23, a communication unit 24, an input unit 25, a display unit 26, a microphone (hereinafter referred to as "mic") 27, and a camera 28. These units are connected to each other directly or indirectly via a bus, and cooperate with each other to execute various processes. The various hardware configurations of the student terminal 2 are publicly known, so detailed explanations will be omitted here.

[0015] The user operates the input unit 25 of the student's terminal 2 to connect to the performance instruction device 1 via the network 5 and transmits the music score data to be played and the performance data of the performance that the user has played. Furthermore, when a user wears the glove 30 on his / her hand while performing, the performance is captured by the camera 28 of the student's terminal 2, so that information on the user's finger movements (fingering data) can be obtained.

[0016] 4 is a functional block diagram showing an example of the functions of the musical performance instruction device 1 according to this embodiment. As an example, a series of processes for realizing various functions described below is stored in the storage unit 13 in the form of a program (e.g., a musical performance instruction program), and the CPU 11 reads this program into the main memory 12 and executes information processing and arithmetic processing to realize various functions. Note that the program may be pre-installed in the storage unit 13, provided in a state stored in another computer-readable storage medium, or distributed via wired or wireless communication means. The computer-readable storage medium may be a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like.

[0017] 4, performance instruction device 1 includes, for example, an evaluation sound database 31, an instruction database 32, a musical score data acquisition unit 33, a performance data acquisition unit 34, a note specification unit 35, a data set specification unit 36, a sound data specification unit 37, a specification data specification unit 38, and a notification unit 39. In addition, performance instruction device 1 includes a data storage unit 40 for storing data required for performance instruction.

[0018] In the evaluation sound database 31, for example, an evaluation sound data set including model sound data and incorrect sound data is registered for each note. One or more model sound data may be registered for one note. Moreover, the incorrect sound data is sound data that deviates slightly from the model and is identified as sound data that requires guidance to the user. For example, the incorrect sound data includes sound data with correct fingering but incorrect timbre. For example, in the case of a wind instrument, the sound data with incorrect timbre includes at least one of inverted sound data, sound data with incorrect dynamics, and sound data with a timbre that deviates from the model. Furthermore, the incorrect sound data may include sound data with a different timbre due to incorrect fingering.

[0019] For example, taking the note "Re" one octave higher as an example, the evaluation sound data set for that "Re" would include the note of that "Re", model sound data for that "Re", and sound data for the incorrect timbre of that "Re". In this way, the evaluation sound database 31 has registered therein the above-mentioned respective evaluation sound data sets for all notes that can be produced by the musical instrument, mainly a wind instrument.

[0020] The instruction database 32 has registered therein instruction data associated with the erroneous sound data registered in the evaluation sound database 31. For example, the instruction database 32 has registered therein instruction data associated with identification information uniquely assigned to the erroneous sound data registered in the evaluation sound database 31. The instruction data includes, for example, instruction content for improving the cause of the erroneous sound data. For example, in the case of a wind instrument, even if the fingering is correct, the sound differs depending on the way of exhaling. Therefore, the instruction content may include, as instruction data, blowing techniques for bringing the erroneous sound data closer to the model sound data. Examples include "Exhale a little more," "Exhale a little longer," and the like. The instruction data may also include model fingering data.

[0021] The score data acquisition unit 33 acquires score data to be played by the user. For example, when electronic score data is transmitted from the student terminal 2, the score data is received to acquire the score data. When score identification information for identifying the score data is received from the student terminal 2, a score database (not shown) in which the score data is accumulated may be accessed to acquire the score data identified by the score identification information received from the student terminal 2. In this way, the method of acquiring the score data is not particularly limited. The score data acquired by the score data acquisition unit 33 is stored in the data storage unit 40.

[0022] The performance data acquisition unit 34 acquires performance data including sound data performed by the user. The performance data may include, for example, fingering data in addition to the sound data performed by the user. This fingering data is information acquired, for example, by having the user wear a glove 30 for motion capture while performing, and capturing the performance by the camera 28 of the student terminal 2.

[0023] The note identification unit 35 identifies notes corresponding to each sound data constituting the performance data performed by the user, based on the score data acquired by the score data acquisition unit 33. For example, the note identification unit 35 identifies which note in the score data is being played, based on the occurrence timing of each sound data in the performance data. At this time, the note identification unit 35 may further use scale information written in the score data.

[0024] The data set specifying unit 36 ​​specifies an evaluation sound data set corresponding to the note specified by the note specifying unit 35, from among a plurality of evaluation sound data sets registered in the evaluation sound database 31. For example, when the note specifying unit 35 specifies a note "re" one octave higher, the data set specifying unit 36 ​​specifies an evaluation sound data set associated with the note "re."

[0025] The sound data identification unit 37 identifies one of the sound data by comparing the plurality of sound data included in the identified evaluation sound data set with the sound data played by the user. For example, the sound data identification unit 37 may calculate the similarity between each of the plurality of sound data included in the evaluation sound data set and the sound data played by the user, and identify the sound data with the highest similarity.

[0026] For example, when the data set specification unit 36 ​​specifies an evaluation sound data set associated with the note "Re" one octave higher, the sound data specification unit 37 compares each of the model sound data and the erroneous sound data included in the evaluation sound data set with the sound data of "Re" played by the user. Then, from among the multiple sound data included in the evaluation sound data set of "Re", it specifies the sound data that is most similar to the sound data of "Re" played by the user.

[0027] When the sound data identified by the sound data identification unit 37 is incorrect sound data, the training data identification unit 38 identifies training data registered in advance in association with the incorrect sound data. For example, the training data identification unit 38 identifies training data associated with the identification information of the incorrect sound data from among the multiple training data stored in the training database 32.

[0028] The notification unit 39 notifies the student terminal 2 of the instruction data identified by the instruction data identification unit 38. For example, the notification unit 39 creates musical score data with instruction data by attaching instruction data in association with the note identified as an incorrect note in the musical score data, and transmits the created musical score data with instruction data to the student terminal 2. Note that the notification method is not limited to the above-mentioned embodiment. In other words, the notification method is not particularly limited as long as the user is notified of the part where the user performed incorrectly and how to improve it.

[0029] When the student terminal 2 receives the musical score data with the teaching data, it displays the musical score data on the display unit 26. This displays the musical score data that the user is playing or has played, and further displays the teaching data associated with the notes that the performer played incorrectly.

[0030] Next, a musical performance instruction method using the musical performance instruction system 100 according to this embodiment will be described. Fig. 5 is a flowchart showing an example of the processing procedure of the musical performance instruction method according to this embodiment. For the sake of convenience, the following description will be given taking as an example a case where the user plays a wind instrument (e.g., a saxophone).

[0031] A user, who is a performer, operates the input unit 25 of the student terminal 2 to connect to the performance instruction device 1 via the network 5 and logs in by performing a predetermined operation (e.g., inputting a user ID, password, etc.). This puts the user in a state where he or she can receive performance instruction from the performance instruction device 1. The connection to the performance instruction device 1 can be made, for example, by starting a predetermined application that has been installed in advance. Alternatively, a web browser can be started and the user can connect to the performance instruction device 1 via the browser.

[0032] Next, the user operates the input unit 25 of the student terminal 2 to specify the score data to be performed and performs a transmission operation. This causes the score data to be transmitted to the performance instruction device 1. This score data may be data that the user has previously acquired from a score database in which electronic score data is stored, or may be data that the user has specified from a score database (not shown) provided in the performance instruction device 1.

[0033] The musical performance instruction apparatus 1 acquires (SA1) the musical score data by receiving it from the student terminal 2. The acquired musical score data is stored in the data storage unit 40, for example, in association with the user ID entered at the time of login.

[0034] Next, the user operates the input unit 25 of the student terminal 2 to perform an input operation to start playing, and then starts playing. As a result, for example, the camera 28 and microphone 27 of the student terminal 2 are activated, generating a video of the user's performance. The video of the performance is transmitted to the performance instruction device 1 as performance data. In this embodiment, the performance data is data that includes sound data and image data, but is not limited to this. For example, the performance data only needs to include at least sound data, and the image data can be omitted.

[0035] Furthermore, when a user performs wearing gloves 30 for motion capture, fingering data is acquired from a video captured by the camera 28 of the student terminal 2. In this case, the performance video including the fingering data, in other words, image data including sound data and fingering data, is transmitted to the performance instruction device 1 as performance data.

[0036] The performance data described above is associated with the user ID and transmitted from the student terminal 2 to the performance teaching apparatus 1. The performance data may be transmitted to the performance teaching apparatus 1 in real time as live data, or may be transmitted to the performance teaching apparatus 1 as one or more data files after all performances have been completed.

[0037] When the performance training apparatus 1 receives and acquires the performance data (SA2), it performs an evaluation and training process based on the performance data. For example, the performance teaching device 1 identifies sound data one by one in time sequence from the acquired performance data, and identifies notes corresponding to each identified sound data. Specifically, the performance teaching device 1 acquires the musical score data associated with the user ID stored in the data storage unit 40, and identifies notes corresponding to each sound data constituting the performance data played by the user based on the acquired musical score data (SA3).

[0038] Next, the performance instruction device 1 identifies an evaluation sound data set corresponding to each identified note from the evaluation sound database 31 (SA4). For example, when a note "re" one octave higher is identified as a note corresponding to certain sound data, the performance instruction device 1 identifies an evaluation sound data set corresponding to that note from the evaluation sound database 31.

[0039] Next, the performance instruction device 1 identifies one of the sound data included in the evaluation sound data set by comparing the multiple sound data included in the identified evaluation sound data set with the sound data played by the user (SA5). For example, when an evaluation sound data set corresponding to a note "Re" one octave higher is identified, the model sound data and the incorrect sound data included in the evaluation sound data set are compared with the sound data played by the user as "Re" one octave higher, and the sound data most similar to the user's sound data is identified from the evaluation sound data set.

[0040] Next, if the identified sound data is erroneous sound data, the performance instruction device 1 identifies instruction data associated with the erroneous sound data from among a plurality of instruction data stored in the instruction database 32 (SA6).

[0041] Next, the performance instruction device 1 attaches the instruction data in association with the notes of the musical score data, and creates musical note data with instruction data (SA7). Then, the created musical score data with teaching data is transmitted to the student terminal 2 (SA8).

[0042] When the student terminal 2 receives the score data with the instruction data from the performance instruction device 1, it displays the score data on the display unit 26. This allows the performer to check the instruction data attached to the score data to determine which notes have been played incorrectly and to obtain instruction content for improving the incorrect performance.

[0043] The instruction data may also include information on correct fingering data, which allows the user to check the fingering as well. At this time, the fingering data used by the user when playing may be attached to the instruction data so that the correct fingering can be compared with the fingering used by the user when playing.

[0044] As described above, the performance instruction device 1 and the performance instruction method according to the present embodiment judge whether the user is making the same sound as the model or making an incorrect sound for each sound data constituting the performance data performed by the user, and if it is judged that the user is making an incorrect sound, the user is notified of the incorrect part and is notified of instruction data for improving the incorrect sound so as to make it closer to the model. This allows the user to know the part where he or she made the mistake and how to improve the mistake in performance.

[0045] For example, the tone of a wind instrument (a brass instrument) varies depending on the way the breath is blown, even with correct fingering. According to the performance instruction device 1 and performance instruction method of this embodiment, sound data with a different tone from the model even with the same fingering is included in the evaluation sound data set as incorrect sound data. This makes it possible to suggest appropriate improvement measures even when a user is performing with the same fingering but with a different way of blowing from the model. In other words, it becomes possible to provide instruction not only on differences in sound caused by different fingering (for example, mistakenly playing the note "re" as "mi"), but also on tone with subtle differences in nuance.

[0046] Next, a performance instruction device 1a and a performance instruction method according to a second embodiment of the present invention will be described with reference to the drawings. The performance instruction device 1 and the performance instruction method according to the first embodiment described above provide an improvement method as instruction data when the user makes an incorrect sound. This embodiment differs from the first embodiment described above in that when the user makes an incorrect sound, the cause of the mistake is identified and instruction data for improving the cause of the mistake is provided. In the following, regarding the performance instruction device 1a according to this embodiment, the same components as those in the performance instruction device 1 according to the first embodiment described above will be given the same reference numerals and their explanation will be omitted, and different components will be mainly explained.

[0047] Fig. 6 is a functional block diagram showing an example of functions of a musical performance instruction device 1a according to the second embodiment of the present invention. As shown in Fig. 6, the musical performance instruction device 1a includes, for example, an evaluation sound database 31a, an instruction database 32a, a musical score data acquisition unit 33, a musical performance data acquisition unit 34, a note specification unit 35, a data set specification unit 36a, a sound data specification unit 37a, a specification data specification unit 38a, and a notification unit 39. The musical performance instruction device 1 also includes a data storage unit 40 for storing data required for musical performance instruction.

[0048] In the evaluation sound database 31a, for example, an evaluation sound data set group D is registered for each note. The evaluation sound data set group D includes a plurality of evaluation sound data sets corresponding to a plurality of elements. The plurality of elements includes, for example, at least two of pitch, volume, fingering, and note value (sound length). FIG. 7 is a diagram showing an example of the evaluation sound data set group D stored in the evaluation sound database 31a according to this embodiment. As shown in FIG. 7, in the evaluation sound database 31a, four evaluation sound data sets are registered in association with each note (in FIG. 7, "re" is shown as an example), the four evaluation sound data sets being an interval evaluation sound data set D1 associated with the interval, a volume evaluation sound data set D2 associated with the volume, a fingering evaluation sound data set D3 associated with the fingering, and a note value evaluation sound data set D4 associated with the note value.

[0049] For example, in the pitch evaluation sound dataset D1, for each note, one or more sound data serving as a model of correct pitch and at least one sound data of incorrect pitch are registered. Furthermore, the sound data of incorrect pitch is sound data that is slightly off pitch from the model, and is sound data of a pitch that is identified as requiring instruction to the user. Furthermore, at least one piece of cause data is associated with the sound data of incorrect pitch. For example, the cause data may be "Cause A: incorrect fingering," "Cause B: blowing too hard," "Cause C: blowing too soft," etc.

[0050] Furthermore, in the volume evaluation sound dataset D2, for each note, one or more sound data serving as a model with a correct volume and at least one sound data with an incorrect volume are registered. Furthermore, the sound data with an incorrect volume is sound data whose volume deviates from the model, and is sound data with a volume that is identified as requiring instruction to the user. Furthermore, the sound data with an incorrect volume is associated with at least one cause. For example, examples of cause data include "Cause B: blowing too hard," "Cause C: blowing too soft," etc.

[0051] In addition, the fingering evaluation sound data set D3 stores, for each note, one or more sound data showing a correct fingering example and at least one sound data showing an incorrect fingering. At least one cause data is associated with the sound data showing the incorrect fingering. For example, the cause data may be "Cause A: incorrect fingering".

[0052] In addition, the note-value evaluation note data set D4 stores, for each note, one or more example note data with a correct note value and at least one note data with an incorrect note value. At least one cause data is associated with the incorrect note value note data. For example, the causes include "Cause D: blowing too long" and "Cause E: blowing too short."

[0053] In this way, the evaluation sound database 31a stores the above-mentioned evaluation sound data set group D for each of all notes that can be played by the musical instrument, mainly a wind instrument. Also, the same cause may be registered in multiple evaluation sound data sets associated with the same note, i.e., the pitch evaluation sound data set D1, the volume evaluation sound data set D2, the fingering evaluation sound data set D3, and the note value evaluation sound data set D4.

[0054] In the instruction database 32a, for example, as shown in FIG. 8, each cause data and instruction data are registered in association with each other. For example, in the instruction database 32a, instruction data are registered in association with identification information uniquely assigned to each cause data registered in the evaluation sound database 31a. The instruction data includes instruction contents for improving the cause. For example, "Cause A: fingering mistake" is associated with instruction contents such as "correct fingering", "Cause B: blowing too hard" is associated with instruction contents such as "blow a little less", "Cause C: blowing too weak" is associated with instruction contents such as "blow a little more", "Cause D: blowing too long" is associated with instruction contents such as "exhale a little shorter", and "Cause E: blowing too short" is associated with instruction contents such as "exhale a little longer". The instruction data may also include model fingering data.

[0055] The data set specifying unit 36a specifies, from the evaluation sound database 31a, the evaluation sound data set group D corresponding to the note specified by the note specifying unit 35. For example, when the note "Re" is specified by the note specifying unit 35, the data set specifying unit 36a specifies the pitch evaluation sound data set D1, the volume evaluation sound data set D2, the fingering evaluation sound data set D3, and the note value evaluation sound data set D4 associated with the note "Re."

[0056] The sound data specification unit 37a specifies one of the sound data by comparing the plurality of sound data included in each evaluation sound data set with the sound data played by the user for each specified evaluation sound data set. For example, the sound data specification unit 37a may calculate the similarity between each of the plurality of sound data included in each evaluation sound data set and the sound data played by the user, and specify the sound data with the highest similarity.

[0057] For example, when the data set specifying unit 36a specifies the interval evaluation sound data set D1, the volume evaluation sound data set D2, the fingering evaluation sound data set D3, and the note value evaluation sound data set D4 associated with the note "Re", the sound data specifying unit 37a compares each of the model sound data and the incorrect sound data included in the interval evaluation sound data set D1 with the sound data of "Re" played by the user. Then, it specifies the sound data that is most similar to the sound data of "Re" played by the user from among the multiple sound data included in the interval evaluation sound data set D1 of "Re".

[0058] The sound data specification unit 37a performs similar processing on the volume evaluation sound data set D2, the fingering evaluation sound data set D3, and the note value evaluation sound data set D4, respectively, to specify sound data that is most similar to the sound data of “Re” played by the user for each of the volume evaluation sound data set D2, the fingering evaluation sound data set D3, and the note value evaluation sound data set D4. This results in one piece of sound data being specified for each evaluation sound data set.

[0059] When each sound data identified for each evaluation sound data set is incorrect sound data, the training data identification unit 38a identifies cause data associated with the sound data, and identifies training data registered in advance in association with the identified cause data from the training database 32a. At this time, when a plurality of cause data are associated with the sound data identified by the sound data identification unit 37a, the training data identification unit 38a identifies all cause data associated with the sound data. In addition, when a plurality of cause data are identified, the training data identification unit 38a may identify training data corresponding to all of the identified cause data, or may preferentially identify training data corresponding to the most numerous cause data among them.

[0060] For example, if "Cause A" and "Cause B" are identified in the pitch evaluation sound data set D1, "Cause A" and "Cause C" are identified in the volume evaluation sound data set D2, "Cause A" is identified in the fingering evaluation sound data set D3, and "Cause E" is identified in the note value evaluation sound data set D4, then the number of "Cause A" will be the largest among the multiple cause data. In this case, the training data identification unit 38a may output the training data associated with "Cause A" to the notification unit 39 so that the training data associated with "Cause A" is presented to the user preferentially over the training data associated with other causes.

[0061] The notification unit 39 notifies the student terminal 2 of the instruction data identified by the instruction data identification unit 38a. For example, the notification unit 39 creates musical score data with instruction data by attaching instruction data in association with the note identified as an incorrect note in the musical score data, and transmits the created musical score data with instruction data to the student terminal 2. The score data may also include the cause of the incorrect note. The notification method is not limited to the above-mentioned embodiment. In other words, the notification method is not particularly limited as long as the user is notified of the part where the user performed incorrectly and the method for improving it, and preferably the cause thereof.

[0062] As described above, according to the musical performance training apparatus 1a and the musical performance training method of the present embodiment, the evaluation sound data set includes: Mistake At least one cause data is associated with the sound data that is identified by the sound data identification unit 37a, and when the sound data identified by the sound data identification unit 37a is incorrect sound data, the instruction data identification unit 38a identifies the cause data associated with the incorrect sound data and identifies the instruction data that is associated with the identified cause data and registered in advance. This makes it possible to identify the cause of the mistake. Furthermore, since instruction data for improving the mistake is also provided to the user, more effective instruction can be provided.

[0063] In this embodiment, the evaluation sound database 31a has registered therein a plurality of evaluation sound data sets corresponding to a plurality of elements for each note. Then, by comparing the plurality of sound data included in each evaluation sound data set with the sound data performed by the user, one of the sound data is identified for each evaluation sound data set. Then, when the identified sound data is incorrect sound data, the cause data associated with the incorrect sound data is identified, and the guidance data registered in advance in association with the identified cause data is identified. In this way, the evaluation sound data set is registered for each element, and the cause data is identified from each of the plurality of evaluation sound data sets, so that it is possible to identify the cause of an incorrect performance error by comprehensively considering a plurality of elements.

[0064] Furthermore, the training data specification unit 38a specifies the training data corresponding to the most numerous cause data among the multiple cause data specified in the multiple evaluation sound data sets corresponding to the multiple elements. This makes it possible to specify the cause of a performance error with high accuracy and to provide the user with training data for improving the performance error.

[0065] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. Various modifications or improvements can be made to the above embodiments without departing from the gist of the invention, and the forms in which such modifications or improvements are made are also included in the technical scope of the present invention. In addition, the above embodiments may be combined as appropriate. Furthermore, the processing flow of the performance instruction method described in the above embodiment is just one example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the present invention.

[0066] For example, in each of the above-mentioned embodiments, the musical score data and the performance data are transmitted to the performance teaching device 1 at different times, but this is not limiting. For example, when transmitting the performance data to the performance teaching device 1 after the user has completed a performance, the musical score data may be transmitted together with the performance data.

[0067] Furthermore, the timing of notification of the instruction data, in other words, the timing of notification of the score data with instruction data, is not limited to the example of the above embodiment. For example, in a mode in which performance data is acquired in real time, the score data with instruction data may be generated and notified every time incorrect sound data is identified. In this case, every time a performance error occurs, instruction data is added to the score data displayed on the display unit 26 of the student terminal 2 in response to the incorrectly played note.

[0068] Even when performance data is acquired in real time, the score data with instruction data may be transmitted after the performance is finished. In this case, the score data with the instruction data attached to each of the errors throughout the performance is displayed on the display unit 26 of the student's terminal 2.

[0069] In addition, in each of the above embodiments, the performance instruction apparatus 1 is provided with the evaluation sound database 31 and the instruction database 32, but it is not necessary for these databases to be provided in the performance instruction apparatus 1. For example, the performance instruction apparatus 1 may be connected to these databases via a network, and information may be exchanged via the network.

[0070] In addition, the data is stored separately in the evaluation sound database 31a and the instruction database 32a, but this is not limiting. For example, the evaluation sound database 31a and the instruction database 32a may be integrated, and the evaluation sound data set and the instruction data may be stored in one database.

[0071] In the first embodiment, each evaluation sound data set includes Mistake At least one piece of cause data may be associated with the selected sound data. In this way, not only the instruction data but also the cause of the performance error can be presented to the user. [Explanation of symbols]

[0072] 1, 1a: Performance guidance device 2: Student devices 5: Network 11: CPU 12: Main memory 13: Storage section 14: Communications Department 15: Input section 16: Display section 21: CPU 22: Main memory 23: Storage section 24: Communications Department 25: Input section 26:Display section 27:Mike 28: Camera 30: Gloves 31, 31a: Evaluation sound database 32, 32a: Teaching Database 33: Music score data acquisition section 34: Performance data acquisition section 35: Note identification part 36, 36a: Dataset identification section 37, 37a: Sound data identification unit 38, 38a: Guidance data identification section 39:Notification Department 40: Data storage unit 100: Performance instruction system

Claims

1. A musical score data acquisition unit that acquires musical score data to be played by a user; a performance data acquisition unit that acquires performance data including sound data played by the user; a note identification unit that identifies notes corresponding to each piece of sound data constituting the performance data based on the musical score data; a data set specification unit that specifies an evaluation sound data set corresponding to the note specified by the note specification unit from an evaluation sound database in which evaluation sound data sets including model sound data and erroneous sound data are registered for each note; a sound data specification unit that specifies any one of the sound data included in the specified evaluation sound data set by comparing the plurality of sound data included in the specified evaluation sound data set with sound data played by a user; a training data specification unit that specifies training data that is associated with the erroneous sound data in advance and registered when the specified sound data is erroneous sound data; a notification unit that notifies the user of the identified instruction data; A performance instruction device comprising:

2. 2. The apparatus for teaching performance according to claim 1, wherein the erroneous sound data includes sound data having the same fingering as that in the case of playing the model sound data but different timbre.

3. 3. The musical performance instruction device according to claim 1, wherein the sound data specification section calculates a similarity between each of the plurality of sound data and the sound data performed by the user, and specifies the sound data having the highest similarity.

4. the performance data includes fingering data of the user; 3. The musical performance teaching device according to claim 1, wherein said teaching data includes model fingering data.

5. obtaining sheet music data to be played by a user; acquiring performance data including sound data played by the user; specifying notes corresponding to each piece of sound data constituting the performance data based on the musical score data; Identifying an evaluation sound data set corresponding to the identified note from an evaluation sound database in which evaluation sound data sets including model sound data and erroneous sound data are registered for each note; a step of identifying any one of the sound data included in the identified evaluation sound data set by comparing the plurality of sound data included in the identified evaluation sound data set with sound data played by a user; If the identified sound data is erroneous sound data, identifying instruction data that is associated with the erroneous sound data and registered in advance; notifying the user of the identified instruction data; A playing instruction method implemented by a computer.

6. Each of the evaluation sound data sets is associated with at least one cause data for the erroneous sound data, The performance instruction device of claim 1, wherein when the sound data identified by the sound data identification unit is incorrect sound data, the instruction data identification unit identifies cause data associated with the incorrect sound data and identifies instruction data that is pre-associated with the identified cause data and registered.

7. In the evaluation sound database, a plurality of evaluation sound data sets corresponding to a plurality of elements are registered for each note, and each evaluation sound data set is associated with at least one piece of cause data for erroneous sound data, the data set specification unit specifies a plurality of evaluation sound data sets corresponding to the notes specified by the note specification unit; the sound data specification unit specifies one piece of sound data for each of the identified evaluation sound data sets by comparing a plurality of pieces of sound data included in each of the identified evaluation sound data sets with sound data played by a user; The performance instruction device of claim 1, wherein when each of the sound data identified by the sound data identification unit is incorrect sound data, the instruction data identification unit identifies cause data associated with the incorrect sound data and identifies instruction data that is pre-associated with the identified cause data and registered.

8. The same cause is registered in duplicate in the plurality of evaluation sound data sets associated with the same note, The performance instruction device according to claim 7, wherein, when the identified sound data is incorrect sound data, the instruction data identification unit preferentially identifies instruction data corresponding to the most numerous cause data among the cause data associated with the incorrect sound data.

9. 8. The apparatus according to claim 7, wherein the plurality of elements include at least two of pitch, volume, fingering, and note value.

Images