Program, method, and terminal device

Abstract

To enable a player to easily look back on a training process.SOLUTION: A program of an embodiment causes a computer to execute: evaluating performance content of a player; and causing display means to display a result of a plurality of evaluations in an aspect in which a portion of a music piece evaluated as having been correctly performed is distinguishable from another portion.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] Embodiments relate to a program, a method, and a terminal device.

Background Art

[0002] An electronic musical instrument capable of recording (recording) the performance content of a musical instrument is known. Also, when practicing musical instrument performance, there is known an evaluation function of performance results that determines whether a user has played a piece correctly by comparing it with a model performance and displays the correct parts of the piece on a musical score. A performer (user) can confirm the results of practice by using the recording function and evaluation function of such an electronic musical instrument.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] A performer may take a long time to be able to play a practice piece. In particular, beginners of musical instruments may take an even longer time to be able to play a practice piece, and it may be difficult to maintain the motivation to practice the musical instrument. As a method for a performer to maintain motivation, it is conceivable to look back on the practice process and feel the daily progress. For looking back on the practice process, it is conceivable to use the recording function and evaluation function of an electronic musical instrument.

[0005] However, referring to the recording data recorded by the recording function of an electronic musical instrument places a greater burden on the performer as the number of recording data recorded in time series increases. Also, the evaluation function of an electronic musical instrument did not display the degree of improvement due to daily practice and did not contribute to maintaining and improving the motivation for piece practice.

[0006] Therefore, an object of the present invention is to provide a program, a method, and a terminal device that can provide the user with the progress and results of daily practice in a visible form, enabling the performer to easily review the practice process.

Means for Solving the Problem

[0007] A program according to an embodiment of the present invention causes a computer to evaluate the performance of a performer for a piece of music consisting of a plurality of parts for each of the parts, and when a plurality of performances are performed for the one piece of music, to display the evaluation results for each of the parts for each of the plurality of performances on a display means in a comparable manner. Together with the results of the multiple evaluations, display the most recent result of the evaluation for each defined period and to execute.

Effect of the Invention

[0008] According to the present invention, the progress and results of daily practice are visualized, enabling the user to easily review the practice process, and allowing the user to practice the instrument with motivation.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

BEST MODE FOR CARRYING OUT THE INVENTION

[0010] Hereinafter, embodiments will be described with reference to the drawings. The drawings are schematic or conceptual. Dimensions, ratios, etc. in each drawing are not necessarily the same as those in reality. In the following description, components having substantially the same functions and configurations are denoted by the same reference numerals. The numbers after the characters constituting the reference numerals are referred to by the reference numerals including the same characters, and are used to distinguish between elements having similar configurations. When it is not necessary to distinguish between elements denoted by reference numerals including the same characters, these elements are referred to by reference numerals including only the characters.

[0011] [Embodiment] The electronic musical instrument system 1 according to the embodiment has a function of visualizing a performance result for each predetermined period and enabling easy browsing by a performer. Hereinafter, details of the electronic musical instrument system 1 according to the embodiment will be described.

[0012] [1] Configuration [1-1] Overall Configuration of Electronic Musical Instrument System 1 FIG. 1 is an external view showing an example of the overall configuration of the electronic musical instrument system 1 according to the embodiment. As shown in FIG. 1, the electronic musical instrument system 1 includes an electronic musical instrument 10 and a terminal device 20. The electronic musical instrument 10 is an electronic keyboard instrument such as an electronic piano, a synthesizer, or an electronic organ. The electronic musical instrument 10 supports MIDI (Musical Instrument Digital Interface). The terminal device 20 is an information processing terminal such as a computer, a smartphone, or a tablet PC. The terminal device 20 displays a screen showing a musical score or the practice process of the electronic musical instrument 10. The electronic musical instrument 10 and the terminal device 20 are connected via a MIDI interface. The connection between the electronic musical instrument 10 and the terminal device 20 may be wireless or wired.

[0013] In the case of wireless, for example, it may be wireless communication by MIDI over Bluetooth Low Energy (hereinafter referred to as BLE-MIDI. Bluetooth is a registered trademark). In the case of wired, it may be USB-MIDI communication using a USB cable, or a conventional MIDI connection using a DIN connector.

[0014] In this embodiment, the electronic musical instrument 10 and the terminal device 20 will be described as communicating via BLE-MIDI.

[0015] [1-2] Hardware Configuration of Electronic Musical Instrument System 1 (Hardware Configuration of Electronic Musical Instrument 10) Continuing to refer to FIG. 1, the hardware configuration of the electronic musical instrument 10 will be described. The electronic musical instrument 10 includes a keyboard 11, an input unit 12, an LCD (Liquid Crystal Display) 13, a speaker 14, and a music score stand 15.

[0016] The keyboard 11 includes a plurality of keys K1 to Kn (n is an integer of 2 or more). Each of the keys K1 to Kn is an operator for specifying a pitch. The electronic musical instrument 10 determines the timings for respectively generating and silencing sounds corresponding to the pitches of the operated keys K when the keys K are depressed and released by the performer. Note that the number of keys K included in the keyboard 11 is not limited to the illustrated number (61 keys), and other numbers may be used. The keys K1 to Kn may be used as operators for changing the settings of the electronic musical instrument 10.

[0017] The input unit 12 is a set of operators used for operations such as setting the electronic musical instrument 10. The input unit 12 includes, for example, a power switch, a volume switch used for adjusting the volume, and operation buttons for changing the operation mode of the electronic musical instrument 10. The input unit 12 can be freely arranged on the electronic musical instrument 10 within a range where it does not interfere with the keyboard 11 or the like.

[0018] The LCD 13 is a display used for displaying information such as the settings of the electronic musical instrument 10. The LCD 13 can display the operation mode of the electronic musical instrument 10, messages associated with the operation of the input unit 12, and the like. Note that the LCD 13 has a touch panel function and may be used as an input unit of the electronic musical instrument 10. Other types of displays may be installed in the electronic musical instrument 10, or an external display or projector may be connected wirelessly or by wire.

[0019] The speaker 14 is a device that converts an electrical signal into sound. The electronic musical instrument 10 can cause the speaker 14 to generate sounds corresponding to the operation of the keyboard 11 by the performer and sounds recorded in the electronic musical instrument 10.

[0020] The music stand 15 is a stand for placing sheet music and the like. For example, in the electronic musical instrument system 1, a terminal device 20 is installed on the music stand 15, and the terminal device 20 installed on the music stand 15 is used for displaying sheet music and the like. Note that the music stand 15 may be omitted from the electronic musical instrument 10.

[0021] FIG. 2 is a block diagram showing an example of a more detailed hardware configuration of the electronic musical instrument 10 according to the embodiment. As shown in FIG. 2, the electronic musical instrument 10 further includes a CPU (Central Processing Unit) 101, a timer 102, a ROM (Read Only Memory) 103, a RAM (Random Access Memory) 104, a storage device 105, a key scanner 106, an LCD (Liquid Crystal Display) controller 107, a sound source 108, a DAC (Digital to Analog Convertor) 109, an amplifier 110, a communication module 111, and a bus 112.

[0022] The CPU 101 is a processor that controls the overall operation of the electronic musical instrument 10. For example, the CPU 101 expands (reads) a program stored in the ROM 103 or the storage device 105 into the RAM 104. Then, the CPU 101 realizes various functions of the electronic musical instrument 10 by executing the program expanded in the RAM 104.

[0023] The ROM 102 is a read-only storage device that stores data non-volatilely. The ROM 102 stores a system control program for controlling the electronic musical instrument 10, musical tone waveform data for generating musical tones, and the like.

[0024] The RAM 103 is a storage device used as a work area for the CPU 101. For example, the RAM 103 stores data necessary for executing a program stored in the ROM 102 or the storage device 104. Also, the RAM 103 temporarily stores musical tone waveform data and the like.

[0025] The storage device 104 is a readable and writable storage device that stores data non-volatilely. The storage device 104 stores, for example, recording data. The storage device 104 may be externally connected to the electronic musical instrument 10.

[0026] The key scanner 105 is an IC (Integrated Circuit) capable of detecting the operation state of an operator. The key scanner 105 is connected to the keyboard 11 and the input unit 12. The key scanner 105 constantly monitors the key press / release state (operation state) of the keyboard 11 and the operation state of the input unit 12 respectively. Then, the key scanner 105 notifies the CPU 101 of the respective operation states of the keyboard 11 and the input unit 12.

[0027] The LCD controller 106 is an IC connected to the LCD 13 and controlling the display mode of the LCD 13. The LCD controller 106 displays various information on the LCD 13 according to the control of the CPU 101. The LCD controller 106 can be replaced according to the specifications of the display mounted on the electronic musical instrument 10.

[0028] The sound source 107 is, for example, a GM sound source compliant with the GM (General MIDI) standard. The sound source 107 has, for example, a simultaneous sounding ability of up to 256 voices and can utilize a plurality of timbres. The sound source 107 reads out musical tone waveform data from the RAM 103 based on the control of the CPU 101, for example, and inputs the read musical tone waveform data to the DAC 108.

[0029] The DAC 108 is a circuit that converts a digital signal into an analog signal. The DAC 108 converts the musical tone waveform data (digital signal) input from the sound source 107 into an analog signal and inputs the converted analog signal to the amplifier 109.

[0030] The amplifier 109 is a circuit that amplifies the input signal. The amplifier 109 amplifies the analog signal input from the DAC 108 and inputs the amplified analog signal to the speaker 14. Then, the speaker 14 emits a sound corresponding to the input signal.

[0031] The communication module 110 is a communication device used for connection with the terminal device 20. The communication module 110 includes a BLE-MIDI communication module. The communication module 110 notifies the CPU 101 of the signal received from the terminal device 20, and outputs signals such as those output from the key scanner 105 to the terminal device 20.

[0032] The bus 111 is a data transmission path used for communication among the components of the electronic musical instrument 10. Connected to the bus 111 are the CPU 101, ROM 102, RAM 103, storage device 104, key scanner 105, LCD controller 106, sound source 107, and communication module 110. Various devices such as a foot pedal used for performance may be connected to the bus 111. When an external terminal is connected to the bus 111 wirelessly or by wire, the electronic musical instrument 10 may be operated based on the operation of the external terminal.

[0033] Note that the hardware configuration of the electronic musical instrument 10 is not limited to the configuration described above. For example, the combination of the DAC 108 and the amplifier 109 may be replaced with a digital amplifier that amplifies a digital signal and then converts it into an analog signal. The output signal of the amplifier 109 may be output to an output terminal such as a headphone out. A sound system such as the DAC 108 used for sound production may be externally connected to the electronic musical instrument 10.

[0034] (Hardware Configuration of Terminal Device 20) FIG. 3 is a block diagram showing an example of the hardware configuration of the terminal device 20 according to the embodiment. As shown in FIG. 3, the terminal device 20 includes, for example, a CPU 21, ROM 22, RAM 23, storage device 24, display 25, communication module 26, and bus 27.

[0035] The CPU 21 is a processor that controls the overall operation of the terminal device 20. For example, the CPU 21 expands (reads) a program stored in the ROM 22 or the storage device 24 into the RAM 23. Then, the CPU 21 realizes various functions of the terminal device 20 by executing the program expanded in the RAM 23.

[0036] The ROM 22 is a read-only memory device that stores data non-volatilely. The ROM 22 stores a control program for controlling the terminal device 20.

[0037] The RAM 23 is a memory device used as the working area of the CPU 21. For example, the RAM 23 stores data necessary for the execution of programs stored in the ROM 22 or the storage device 24.

[0038] The storage device 24 is a read-write storage device that stores data non-volatilely. The storage device 24 stores, for example, performance data recorded by a performance recording operation described later. The storage device 24 may be externally connected to the terminal device 20.

[0039] The display 25 is a display used for displaying a GUI (Graphical User Interface) etc. of the terminal device 20. In this example, the display 25 has a touch panel function and is used as an input unit of the terminal device 20. An external display or projector may be connected to the terminal device 20 wirelessly or by wire.

[0040] The communication module 26 is a communication device used for connection with the communication module 111 of the electronic musical instrument 10. The communication module 26 includes a BLE-MIDI communication module. The communication module 26 notifies the CPU 21 of signals received from the electronic musical instrument 10, and transmits audio data etc. stored in the storage device 24 to the electronic musical instrument 10.

[0041] The bus 27 is a data transmission path used for communication between the components of the terminal device 20. The CPU 21, ROM 22, RAM 23, storage device 24, display 25, and communication module 26 are connected to the bus 27. Note that an external terminal may be connected to the bus 27 wirelessly or by wire. The terminal device 20 may be operated based on operations of a wirelessly or wired-connected electronic musical instrument 10, external terminal, etc.

[0042] [1-3]Functional Configuration of Terminal Device 20 FIG. 4 is a block diagram showing an example of the functional configuration of the terminal device 20 according to the embodiment. As shown in FIG. 4, the terminal device 20 includes an input unit 201, a communication unit 202, a music data storage unit 203, an application control unit 204, a display unit 205, a recording unit 206, an evaluation unit 207, and a performance data storage unit 208.

[0043] The input unit 201 corresponds to an input interface such as a touch panel (display 25) of the terminal device 20. The input unit 201 has a switch function that can operate the start and interruption of the performance recording operation. The switch function may be arranged on the electronic musical instrument 10.

[0044] The communication unit 202 corresponds to the communication module 26 of the terminal device 20. The communication unit 202 controls the communication between the application control unit 204 and the electronic musical instrument 10 during the performance recording operation.

[0045] The music data storage unit 203 corresponds to, for example, the storage device 105 of the electronic musical instrument 10 or the storage device 24 of the terminal device 20. The music data storage unit 33 stores at least one piece of music data. The music data may include information such as "piece name information", "MIDI data", "accompaniment data", "evaluation criterion information", and "tempo information". "Piece name information" is used for identifying the music data. "MIDI data" includes information corresponding to the score of the music data. "Accompaniment data" is audio data or MIDI data corresponding to the accompaniment of the music data. "Evaluation criterion information" indicates a comparison criterion between the score and the performance of the performer, and includes information such as a threshold value for evaluating the performance content. "Tempo information" includes information corresponding to the tempo of the music data. Note that the music data only needs to include at least "piece name information" and "MIDI data".

[0046] The application control unit 204 corresponds to the CPU 21 of the terminal device 20. The application control unit 204 controls the overall operation of the performance recording operation. For example, the application control unit 204 reads out the score image of the music data specified based on the operation of the input means 201 from the music data storage means 203 and causes it to be displayed on the display means 205. Further, the application control unit 204 superimposes and displays a performance guide (timing bar) on the score image displayed on the display means 205. The "timing bar" indicates the timing at which the performer should play. The "display of the timing bar" is synchronized between the electronic musical instrument 10 and the terminal device 20 by communication between the electronic musical instrument 10 and the terminal device 20. The application control unit 204 instructs the recording means 206 and the evaluation means 207 to start and end the performance recording operation. The application control unit 204 reads out the accompaniment data of the music data targeted for the performance recording operation from the music data storage means 203 and transmits it to the electronic musical instrument 10 via the communication means 202. The application control unit 204 generates items of performance data based on the information of the music data targeted for the performance recording operation and stores them in the performance data storage means 208.

[0047] The display means 205 corresponds to the display 25 of the terminal device 20. The display means 205 displays score image data and the like.

[0048] The recording means 206 corresponds to the CPU 21 of the terminal device 20. The recording means 206 starts recording based on an instruction from the application control unit 204. The recording means 206 generates recording data based on, for example, MIDI data received via the communication means 202 and the application control unit 204, and stores the generated recording data in the performance data storage means 208.

[0049] The evaluation means 207 corresponds to the CPU 21 of the terminal device 20. The evaluation means 207 executes an evaluation process of the performance content by the performer. In the evaluation process, the evaluation means 207 evaluates the performance content for each performance section based on the MIDI data transferred from the application control unit 204 and the music data to be evaluated, and stores the evaluation result in the performance data storage means 208. The evaluation means 207 evaluates the performance content by comparing the data of the exemplary performance (for example, data based on the score of the music data) with the recorded data.

[0050] For example, when the played pitch is equal to the pitch of the exemplary performance data, the evaluation means 207 counts it as the correct pitch. If the ratio of the number of correct pitches to the total number of notes included in the performance section exceeds the ratio of the number of correct pitches set as the threshold value, the evaluation means 207 evaluates that the performance has been played correctly.

[0051] The evaluation means 207 may evaluate not only the pitch but also the timing of the performance. For example, the evaluation means 207 can set a threshold value such that if the deviation between the timing when a certain note is played and the timing of the performance in the exemplary performance data corresponding to the note is within a time corresponding to 1 / 8 of a quarter note (32nd note), it is evaluated that the performance has been played correctly.

[0052] Furthermore, the evaluation means 207 can also use any performance elements such as the dynamics of the performance and the length of the notes played as evaluation items.

[0053] The evaluation means 207 may evaluate that the performance has been played correctly when all these evaluation items exceed the threshold value, or may evaluate that the performance has been played correctly when some items exceed the threshold value.

[0054] The evaluation items may be set in advance, or may be settable by the performer. The evaluation method described above is an example, and any evaluation method can be adopted. For example, a statistical method for determining the similarity between the performance data and the exemplary data can be adopted.

[0055] "Performance segment" corresponds to, for example, a range obtained by dividing a piece of music at predetermined time intervals. "Performance segment" may be in units of measures, or may be in units of phrases including a plurality of notes or a plurality of measures, and can be set arbitrarily. Also, it may be divided into a left hand part and a right hand part. The evaluation result may be generated by the electronic musical instrument 10 and transmitted to the terminal device 20.

[0056] The performance data storage means 208 corresponds to the storage device 24 of the terminal device 20. The performance data storage means 208 is used for recording performance data. The performance data may include information such as "piece name information", "recording data", "evaluation result", "recording date", etc. "Piece name information" is used for identifying the performance data and is associated with the piece name information of the music data. "Recording data" is data including the sound information of the performance result transferred from the recording means 206. The recording data may be MIDI data or audio data in a format such as WAV. "Evaluation result" includes information on the evaluation result of the performance content generated by the evaluation means 207. "Recording date" is data indicating the date on which the performance data was recorded.

[0057] [2] Operations The electronic musical instrument system 1 can execute a performance recording operation. The performance recording operation is an operation of recording the quality of the performance of the electronic musical instrument 10 by the performer and recording the performance. Below, the details of the performance recording operation of the electronic musical instrument system 1 according to the embodiment will be described.

[0058] [2-1] Flow of the performance recording operation FIG. 5 is a flowchart showing an example of the flow of the performance recording operation of the electronic musical instrument system 1 according to the embodiment. Below, with reference to FIG. 5, the flow of the performance recording operation of the electronic musical instrument system 1 according to the embodiment will be described.

[0059] When the performer operates the input means 201 to select a piece of music to perform, the score of the selected piece of music is displayed on the display means 205. Then, when the performer presses the recording start button to which the start of the performance recording operation is assigned, the application control unit 204 starts the performance recording operation (start).

[0060] When the performance recording operation starts, the recording means 206 starts recording (ST10). When starting recording, the recording means 206 generates recording data based on the MIDI data received from the electronic musical instrument 10 via the communication means 202, and appropriately stores the generated recording data in the performance data storage means 208.

[0061] Next, the application control unit 204 plays back the accompaniment (ST11). Specifically, the application control unit 204 reads out the accompaniment data associated with the selected music data from the music data storage means 203, and transmits it to the electronic musical instrument 10 via the communication means 202. Then, the sound system of the electronic musical instrument 10 plays back the accompaniment data received from the terminal device 20. When the music data does not include accompaniment data, the process of ST11 is omitted.

[0062] Next, the display means 205 displays a timing bar (ST12). Specifically, the application control unit 204 causes the display means 205 to display a score, and superimposes and displays a timing bar on the displayed score. The application control unit 204 moves the display position of the timing bar on the display means 205 based on the progress of the accompaniment, tempo information, etc. The performer performs according to the guidance by the timing bar.

[0063] Next, the evaluation means 207 starts an evaluation process (ST13). Specifically, the evaluation means 207 starts evaluating the performance content for each performance section based on the MIDI data received from the recording means 206.

[0064] Next, the application control unit 204 checks whether the recording interruption button has been pressed (ST14). The recording interruption button is included in the input means 201. The function of the recording interruption button may be assigned to the same location as the recording start button, or may be assigned to a different location.

[0065] In the process of ST14, when it is confirmed that the recording interruption button has not been pressed (ST14: NO), the application control unit 204 proceeds to the process of ST15.

[0066] In the process of ST14, when it is confirmed that the recording interruption button has been pressed (ST14: YES), the application control unit 204 proceeds to the process of ST16.

[0067] In the process of ST15, the application control unit 204 checks whether the accompaniment of the performance piece (the piece selected in the performance recording operation) has been played until the end. When the piece data targeted by the performance recording operation does not include accompaniment data, instead of checking whether the accompaniment of the performance piece has been played until the end in the process of ST15, the application control unit 204 checks, for example, whether the timing bar has reached the end of the piece.

[0068] In the process of ST15, when it is confirmed that the accompaniment of the performance piece has not been played until the end (ST15: NO), the application control unit 204 proceeds to the process of ST14.

[0069] In the process of ST15, when it is confirmed that the accompaniment of the performance piece has been played until the end (ST15: YES), the application control unit 204 proceeds to the process of ST16.

[0070] In the process of ST16, the application control unit 204 executes an end process. The end process includes stopping the recording started in ST10, stopping the accompaniment playback started in ST11, stopping or ending the display of the timing bar started in ST12, and stopping the evaluation process started in ST13. Also, in the end process, the performance data generated by the performance recording operation is stored in the performance data storage means 208. Note that the process of ST16 executed via the process of "ST14: YES" corresponds to the interruption of the performance recording process. The process of ST16 executed via the process of "ST15: YES" corresponds to, for example, the state where the performer has played the piece until the end.

[0071] When the process of ST16 is completed, the display means 205 displays the evaluation result (ST17). This evaluation result corresponds to the result of the evaluation process of ST13. Specific examples of the display method of the evaluation result will be described later.

[0072] When the process of ST17 is completed, the application control unit 204 checks whether performance data of the same performance piece is recorded on the same day (ST18). "The same performance piece" corresponds to a performance piece in which the identifier of the music data recorded in the performance data is the same, such as the "piece name information" being the same.

[0073] In the process of ST18, if it is confirmed that performance data of the same performance piece is recorded on the same day (ST18: YES), the application control unit 204 proceeds to the process of ST19.

[0074] In the process of ST18, if it is confirmed that performance data of the same performance piece is not recorded on the same day (ST18: NO), the application control unit 204 proceeds to the process of ST20.

[0075] In the process of ST19, the application control unit 204 deletes the past performance data of the same performance piece on the same day. When the process of ST19 is completed, the application control unit 204 proceeds to the process of ST20.

[0076] In the process of ST20, the application control unit 204 saves the performance data acquired by the current performance recording operation in association with the date. That is, the performance recording operation saves the current performance data in association with the recording date when there is no performance data (old performance data) that has already been recorded for the same performance piece on the same day. On the other hand, the performance recording operation deletes the old performance data and saves the current performance data in association with the recording date when performance data of the same performance piece exists on the same day. In other words, the performance recording operation overwrites the old performance data with the current performance data and saves the current performance data in association with the recording date when performance data of the same performance piece exists on the same day.

[0077] Here, the electronic musical instrument system 1 may be configured not to overwrite old performance data on the same day. That is, the application control unit 204 may not delete the performance data, and the performance data storage means 208 may store all the performance data. In this case, in the reference example of the recorded performance data described later, the display means 205 can display a list of the transition of the evaluation of the performance in a short period of time. For example, during the practice time of one day, the performer causes the terminal device 20 to record and evaluate the performance each time from the start to the end of the practice. Thereby, the performer can grasp how much improvement has been made from before the start of the practice after the end of the practice from the transition of the evaluation.

[0078] When the process of ST20 is completed, the application control unit 204 ends the series of processes in FIG. 5 (end).

[0079] [2-2] Display example of the display 25 FIG. 6 is a schematic diagram showing a display example of the display 25 before the start of the performance recording operation in the electronic musical instrument system 1 according to the embodiment. As shown in FIG. 6, in this example, a musical score, a title (piece name), a recording start button B1, and a timing bar TB are displayed on the display 25. When the performer touches (operates) the recording start button B1, the recording of the performance (performance recording operation) can be started. Before the start of the performance recording operation, the timing bar TB is displayed, for example, at the start position of the music piece. Note that the display of the timing bar TB may be omitted before the start of the performance recording operation.

[0080] FIG. 7 is a schematic diagram showing an example of the display on the display unit 32 during the execution of the performance recording operation in the electronic musical instrument system 1 according to the embodiment. As shown in FIG. 7, in this example, from the image shown in FIG. 6, the position of the timing bar TB is changed, and the recording start button B1 is changed to the recording pause button B2. During the execution of the performance recording operation, the display of the timing bar TB moves in accordance with the tempo information specified by the accompaniment or the performer. When the performer touches (operates), for example, the recording pause button B2, the recording of the performance is paused (ended). That is, when the performer is unable to play midway, by touching the recording pause button, the performer can record the performance data only for the part where the performance was attempted.

[0081] [2-3] Reference Example of Performance Data The electronic musical instrument system 1 according to the embodiment displays performance data (evaluation results of performance content) based on a user's operation. For example, the application control unit 204 reads out the performance data specified by the operation of the input means 201 from the performance data storage means 208. Then, based on the read performance data, the application control unit 204 causes the display means 205 to display the score corresponding to the performance data and the evaluation result. Also, by the processes of ST18 to ST20 in FIG. 5, the past performance data of the same performance piece on the same day is deleted, and for example, only the latest performance data is saved every day. That is, the display means 205 displays the latest evaluation result for each defined period (for example, the same day) among the results of multiple evaluations for the same musical piece. In addition, the application control unit 204 can also cause the speaker or the like of the terminal device 20 to reproduce the recording data of the performance data specified based on the user's operation.

[0082] FIG. 8 is a schematic diagram showing a reference example of performance data recorded in the electronic musical instrument system 1 according to the embodiment. As shown in FIG. 8, the electronic musical instrument system 1 displays an evaluation result on the display means 205 (for example, the display 25 of the terminal device 20) by coloring the correctly played part of the musical score. Specifically, the display means 205 displays thumbnail images of the evaluation results of each of the plurality of performance data PD1 and PD2. In each thumbnail part, for example, the recording date, the musical score, the marker part CP, and the performance playback button PB ("listen to the performance") are displayed. Note that the method of referring to the performance data may be in other formats. For example, the number of performance data displayed as thumbnails may be other than two. The electronic musical instrument system 1 only needs to be able to display a list of the evaluation results of the plurality of performance data.

[0083] In this example, the recording date of the performance data PD1 is "March 2", and the recording date of the performance data PD2 is "March 3". The marker part CP is added to the part that is evaluated to be correctly played by the evaluation process. The color of the marker part CP may be the same or different for each performance data PD. The marker part CP may be added independently for the right hand part and the left hand part, or may be added integrally for the right hand part and the left hand part. The performance playback buttons PB1 and PB2 are associated with the performance data PD1 and PD2, respectively. When the performance playback button PB1 is touched (operated), the electronic musical instrument system 1 plays back the recording data included in the performance data PD1. On the other hand, when the performance playback button PB2 is touched (operated), the electronic musical instrument system 1 plays back the recording data included in the performance data PD2.

[0084] FIG. 9 is a schematic diagram showing another reference example of performance data recorded in the electronic musical instrument system according to the embodiment. As shown in FIG. 9, the evaluation results of a plurality of dates may be displayed superimposed. FIG. 9 illustrates the case where the evaluation results of the performance data PD1 and PD2 shown in FIG. 8 are displayed superimposed. In this case, the display means 205 displays the recording period, one musical score, and a plurality of marker parts CP1 and CP2.

[0085] The recording period indicates the period for summarizing and displaying the evaluation results. In this example, the recording period is "March 2 - March 3". In the score, an area for displaying the evaluation results is allocated for each performance data PD. In this example, the upper side of the five - line staff corresponds to the evaluation result of the performance data PD1, and the lower side of the five - line staff corresponds to the evaluation result of the performance data PD2. And the evaluation result of the performance data PD1 is indicated by the marker part CP1, and the evaluation result of the performance data PD2 is indicated by a marker part CP2 different from the marker part CP1. Thus, the electronic musical instrument system 1 according to the embodiment can summarize and display the evaluation results for each defined period (for example, each day) on one score.

[0086] Note that, instead of the recording period, information for identifying a plurality of performance data selected by the user may be displayed. The recording dates of the plurality of evaluation results to be displayed may be discontinuous. The display of the marker parts CP1 and CP2 only needs to be distinguishable by at least the performer. Even when the evaluation results of a plurality of performance data PD are displayed on one score, a performance playback button may be provided. In this case, a plurality of performance playback buttons may be provided corresponding to each of the performance data PD included in the recording period. Also, when there is one performance playback button, by touching the performance playback button after specifying the date of the performance data PD to be played back, the recording data corresponding to the desired performance data may be played back.

[0087] [3] Effects of the Embodiment As described above, the electronic musical instrument system 1 according to the embodiment accumulates the results (performance data) of repeatedly practicing the same piece at predetermined intervals. And the electronic musical instrument system 1 can color - code the correctly played parts on the musical score and display the evaluation results of past performances. Also, the electronic musical instrument system 1 can change the color - coding of the evaluation results daily and display the display period and the colored progress in a list. Furthermore, the electronic musical instrument system 1 can also save the recording data associated with the date together with the evaluation results.

[0088] The performer can review the daily practice progress in a list as the progress of practice is visualized like a diary by the electronic musical instrument system 1. Also, the performer can grasp the progress of practice in a coloring book-like manner by referring to the evaluation results colored according to the performance content. Since the recording data is also saved together with the evaluation results, the performer can selectively listen back to the performance based on the information of the visualized evaluation results.

[0089] As described above, the electronic musical instrument system 1 according to the embodiment can reduce the burden on the performer to review the practice process. And the performer using the electronic musical instrument system 1 can easily review the practice process. Also, by confirming the results of past practice, the performer can grasp the daily progress and feel that their skills are improving. As a result, the electronic musical instrument system 1 can maintain the performer's motivation for practice and contribute to the continuation of practice.

[0090] [4]Other modifications and the like The electronic musical instrument system 1 according to the embodiment described above can be variously modified.

[0091] For example, the assignment of each function of the performance recording operation can be appropriately changed. The electronic musical instrument 10 may have all the functions related to the performance recording operation assigned to the terminal device 20 in the embodiment. The terminal device 20 may execute an application that operates as an electronic musical instrument and execute the performance recording operation. Each functional configuration related to the performance recording operation only needs to be assigned to at least one of the electronic musical instrument 10 and the terminal device 20. The electronic musical instrument 10 may perform the playback of accompaniment and the evaluation of the performance content. The speaker or the like provided in the terminal device 20 may play back the accompaniment. The recording start button B1 and the recording stop button B2 may be substituted by other operation parts such as the input unit 12 and the foot pedal.

[0092] The electronic musical instrument 10 is not limited to an electronic keyboard musical instrument, and may be other electronic musical instruments such as single-tone musical instruments like guitars and saxophones. The electronic musical instrument 10 only needs to be able to acquire the performance results of the performer in MIDI data. Although the score of the keyboard musical instrument has been described in the embodiment, the score handled by the electronic musical instrument system 1 can be changed according to the type of the electronic musical instrument 10. The score handled by the electronic musical instrument 10 may be a chord score. When a chord score is used in the music data, evaluation criteria can be set for each chord in the evaluation process. The music data stored in the music data storage unit 33 may be added. For example, the music data may be added by being downloaded from the Internet.

[0093] In the embodiment, the case where the performance recording operation is started in response to the performer touching the recording start button B1 has been exemplified, but it is not limited thereto. For example, the performance recording operation may be started based on the fact that the keys of the keyboard 11 have been pressed, that is, the performer has started playing. Further, after starting the performance recording operation, the electronic musical instrument system 1 may interrupt the performance recording operation based on the fact that the input unit 30 or the electronic musical instrument 10 has not been operated for a predetermined time. In the embodiment, the case where the application control unit 204 causes the performance data storage means 208 to store the latest performance data daily has been exemplified, but it is not limited thereto. The classification of the performance data stored in the performance data storage means 208 may be other than "one day". That is, the application control unit 204 only needs to cause the performance data storage means 208 to store the latest performance data for each period determined by the user. Further, the performance data may be accumulated at the timing desired by the user to record. In this case, the electronic musical instrument system 1 causes the performer to select whether or not to record after the performance ends, and records the performance data in the performance data storage means 208 according to the selection result.

[0094] In the embodiment, although an example was given of the case where in the evaluation process, based on a predetermined threshold value, it is evaluated whether the performance was "explosive (correct performance was achieved)" or "not explosive (correct performance could not be achieved)" and is displayed as an evaluation result, the present invention is not limited to this. For example, the electronic musical instrument system 1 may change the display of the evaluation result according to the score indicating the performance content. For example, the electronic musical instrument system 1 may change the shade or type of color indicating the evaluation result according to the height of the score. Instead of the portions where correct performance was achieved, the electronic musical instrument system 1 may add a marker portion to the portions where correct performance could not be achieved. Also, numbers may be displayed as the evaluation result. The evaluation result does not necessarily have to be displayed superimposed on the staff. For example, if the performer can grasp the evaluation result for each performance segment, the evaluation result may be displayed above or below the staff. The performance recording operation does not necessarily have to be executed for the entire piece of music, and may be executed for a specific portion of the piece of music.

[0095] In the embodiment, the flowchart used to explain the operations is merely an example. Each operation explained using the flowchart may be swapped within the possible range of the processing order, other processing may be added, or some processing may be omitted. For example, the display of the evaluation result in ST17 may be omitted. The evaluation process may be executed after the recording is completed. In the performance recording operation, the electronic musical instrument system 1 may omit the display of the timing bar TB. Instead of the timing bar TB, the electronic musical instrument system 1 may use a figure, an arrow, a color, etc. to indicate the timing at which the performer should play.

[0096] In this specification, the CPUs 101 and 21 may be other circuits. For example, instead of the CPUs 101 and 21, an MPU (Micro Processing Unit), an ASIC (Application Specific Integrated Circuit), or an FPGA (field-programmable gate array) may be used. A DSP (Digital Signal Processor) specialized in processing digital audio signals can also be regarded as a processor. Further, each of the processes described in the embodiments may be realized by dedicated hardware. The processes described in the embodiments may be a mixture of processes executed by software and processes executed by hardware, or may be only one of them.

[0097] Also, the technical scope of the present invention includes various modifications and improvements within the scope in which the object of the present invention is achieved, which is obvious to those skilled in the art from the description of the claims.

[0098] Note that some or all of the above embodiments may be described as in the following supplementary notes, but are not limited thereto.

[0099] [Supplementary Note 1] Causing a computer to evaluate the performance content of a performer, and cause a display means to display, in a distinguishable manner from other parts, the results of the above evaluations performed a plurality of times at different times, for the parts of the piece that are evaluated as being performed correctly; A program for causing the above to be executed.

[0100] [Supplementary Note 2] Causing the above computer to cause the display means to display the most recent evaluation result among the results of the above evaluations performed a plurality of times on the same piece, for each predetermined period; The program according to Supplementary Note 1.

[0101] [Supplementary Note 3] Cause the computer to summarize the results of the above evaluations for each of the above-specified periods on one score sheet and display them on the above display means. The program according to Supplementary Note 2.

[0102] [Supplementary Note 4] Cause the computer to Store the recorded performance data related to the results of the above evaluations in the storage means, Cause the above recorded performance data specified based on a user operation to be reproduced by the sounding means, The program according to any one of Supplementary Notes 1 to 3, which causes the above to be executed.

[0103] [Supplementary Note 5] Evaluate the performance content of the performer, Cause the results of the above evaluations conducted multiple times at different times when the evaluations were performed to be displayed on the display means in a manner that enables the parts of the piece evaluated as being correctly performed to be distinguished from other parts, A method comprising the above.

[0104] [Supplementary Note 6] Evaluation means for evaluating the performance content of the performer, Display means, and Cause the results of the above evaluations conducted multiple times at different times when the evaluations were performed by the above evaluation means to be displayed on the above display means in a manner that enables the parts of the piece evaluated as being correctly performed to be distinguished from other parts. A terminal device.

Explanation of Signs

[0105] 1... Electronic musical instrument system, 10... Electronic musical instrument, 11... Keyboard, 12... Input section, 13... LCD, 14... Speaker, 15... Sheet music stand, 20... Terminal device, 21... CPU, 22... ROM, 23... RAM, 24... Storage device, 25... Display, 26... Communication module, 27... Bus, 101... CPU, 102... ROM, 103... RAM, 104... Storage device, 105... Key scanner, 106... LCD controller, 107... Sound source, 108... DAC, 109... Amplifier, 110... Communication module, 111... Bus, 201... Input means, 202... Communication means, 203... Music data storage means, 204... Application control section, 205... Display means, 206... Recording means, 207... Evaluation means, 208... Performance data storage means, B1... Recording start button, B2... Recording stop button, K1~Kn... Keys.

Claims

1. Cause a computer to evaluate the performance of a performer for one piece of music consisting of multiple parts for each of the parts, when multiple performances are made for the one piece of music, display the evaluation results for each of the parts for each of the multiple performances in a comparable manner on a display means, and display the most recent of the evaluation results for a defined period among the results of the multiple evaluations, A program for causing the above to be executed.

2. Cause the computer to summarize the evaluation results for each defined period on one score and display them on the display means, The program according to claim 1, for causing the above to be executed.

3. Cause the computer to store the recorded performance data related to the evaluation results in a storage means, play back the recorded performance data specified based on a user operation on a sounding means, The program according to claim 1 or claim 2, for causing the above to be executed.

4. Cause the computer to when multiple performances are made for the one piece of music, display the evaluation results for each of the parts for each of the multiple performances on a display means in a manner that allows simultaneous comparison on one screen, The program according to claim 1, for causing the above to be executed.

5. evaluate the performance of a performer for one piece of music consisting of multiple parts for each of the parts, when multiple performances are made for the one piece of music, display the evaluation results for each of the parts for each of the multiple performances in a comparable manner on a display means, and display the most recent of the evaluation results for a defined period among the results of the multiple evaluations, A method comprising the above.

6. Evaluation means for evaluating the performance of a performer for one piece of music consisting of multiple parts for each of the parts, Display control means for, when multiple performances are made for the one piece of music, displaying the evaluation results for each of the parts for each of the multiple performances in a comparable manner on a display means, and displaying the most recent of the evaluation results for a defined period among the results of the multiple evaluations, A terminal device comprising the above.

Images