Program, information processing device, electronic musical instrument and display method

Abstract

To support users in continuing practice so that they can master stable performance.SOLUTION: A processor of an information processing device determines a first type of performance technique related to a first performance operation and a second type of performance technique related to a second performance operation based on performance information input by a performance operation to an operator, and adds points to the evaluation value for the performance, when the determined first type and second type are the same, and then, displays an image corresponding to the evaluation value on a display unit.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to a program, an information processing apparatus, an electronic musical instrument, and a display method.

Background Art

[0002] Conventionally, there has been known a musical sound evaluation apparatus that evaluates the pitch stability, volume stability, timbre stability, etc. of a predetermined section from an input musical sound signal and graphs and displays the evaluation results (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] By the way, in order to improve the performance of a musical instrument, it is desirable to practice so that a stable performance can be continued for a certain period of time. However, such practice is monotonous, it is difficult to tell whether one is improving, and it is difficult for an individual to continue practicing without getting bored.

[0005] The technique described in Patent Document 1 only graphically displays the evaluation results of a performance in a predetermined section, and cannot assist the user in continuing to practice in order to acquire a stable performance.

[0006] The present invention has been made in view of the above circumstances, and an object thereof is to enable assistance so that a user can continue practicing to acquire a stable performance.

Means for Solving the Problems

[0007] A program according to an embodiment of the present invention causes a computer to Based on the performance information input by the performance operation on the operator, determine the first type of performance technique related to the first performance operation and the second type of the performance technique related to the second performance operation. When the determined first type and the second type are the same, add points to the evaluation value for evaluating the performance. Cause an image corresponding to the evaluation value to be displayed on the display unit. Execute the process.

Effect of the Invention

[0008] According to an embodiment of the present invention, it is possible to assist the user to continue practicing in order to acquire a stable performance.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Mode for Carrying Out the Invention

[0010] Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the embodiments described below are subject to various technically preferable limitations for carrying out the present invention. Therefore, the technical scope of the present invention is not limited to the following embodiments and illustrated examples.

[0011] (Configuration of Electronic Musical Instrument System) FIG. 1 is a diagram showing the appearance of an electronic musical instrument system 1 according to an embodiment of the present invention. As shown in FIG. 1, the electronic musical instrument system 1 includes an electronic musical instrument 100 and an information processing device 200, and the electronic musical instrument 100 and the information processing device 200 are connected via a wired line or a wireless line.

[0012] The electronic musical instrument 100 is an electronic keyboard musical instrument, for example, an electronic piano, a synthesizer, or an electronic organ. FIG. 2 is a block diagram showing the configuration of the electronic musical instrument 100. As shown in FIG. 2, the electronic musical instrument 100 includes a processor 110, a keyboard 120, a key scanner 130, an operation unit 140, a sound generation unit 150, and a communication unit 160.

[0013] The processor 110 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The processor 110 reads programs and data stored in the ROM and uses the RAM as a work area to control the electronic musical instrument 100.

[0014] When a user (performer) performs a key-pressing operation (performance operation) on the keys of the keyboard 120, the processor 110 causes the sound generation unit 150 to generate a musical tone of a pitch associated with the key that has been key-pressed, and outputs this musical tone from the speaker 150a. Also, when the user performs a key-release operation, the processor 110 causes the sound generation unit 150 to mute the musical tone that is being generated and that is associated with the key on which the key-release operation has been performed. Here, the performance operation in the present application refers to an operation for generating a sound (in this embodiment, a key-pressing operation).

[0015] The keyboard 120 has a plurality of white keys and black keys as a plurality of operators (performance operators). Each key is associated with a different pitch.

[0016] The key scanner 130 detects key presses, key releases, and key-pressing speeds (velocity values) of the keyboard 120, and outputs performance information including the pitch information and velocity value of the detected key to the processor 110. The velocity value can also be said to be a value indicating the strength of the sound. The pitch information may also be referred to as a key number, key code, MIDI key, or note number.

[0017] The operation unit 140 is composed of, for example, key switches, buttons, touch panels, etc. of a mechanical method, a capacitive non-contact method, a membrane method, etc. The user can, by operating the operation unit 140, for example, set the timbre or adjust the volume.

[0018] The sound generation unit 150 includes a sound source unit, a D / A converter, an amplifier, a speaker 150a, etc., and generates a musical tone of a pitch instructed by the processor 110 or mutes the musical tone of a pitch instructed by the processor 110.

[0019] The communication unit 160 includes wireless and wired units for communicating with external devices. In this embodiment, the communication unit 160 includes an interface compliant with the MIDI (Musical Instrument Digital Interface) standard. The communication unit 160 transmits performance information to the information processing device 200 based on the control of the processor 110. The performance information has, as an example, a data structure compliant with the MIDI standard.

[0020] The information processing device 200 is, for example, a notebook PC (Personal Computer) or a smartphone. The information processing device 200 may be other forms of devices such as a tablet terminal, a portable game machine, a feature phone, a PDA (Personal Digital Assistant), etc.

[0021] FIG. 3 is a block diagram showing the configuration of the information processing device 200. As shown in FIG. 3, the information processing device 200 includes a processor 210, a RAM 220, a ROM 230, an operation unit 240, a communication unit 250, a display unit 260, and an audio output unit 270. The information processing device 200 is placed, for example, on the score stand 170 of the electronic musical instrument 100.

[0022] The processor 210, which is an example of a computer, is, for example, a single processor or a multi-processor and includes at least one processor. When configured to include a plurality of processors, the processor 210 may be packaged as a single device, or may be composed of a plurality of physically separated devices within the information processing device 200. The processor 210 functions as a "control unit". The processor 210 reads the programs and data stored in the ROM 230 into the RAM 220, and uses the RAM 220 as a work area to control the operations of each part of the information processing device 200.

[0023] The RAM 220 temporarily holds data and programs. The RAM 220 holds programs and data read from the ROM 230, as well as other data necessary for communication.

[0024] The ROM 230 is a non-volatile semiconductor memory such as a flash memory, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically Erasable Programmable ROM), and serves as a secondary storage device or an auxiliary storage device. Programs and data used by the processor 210 to perform various processes, including the lesson program 232, are stored in the ROM 230.

[0025] The operation unit 240 is composed of, for example, key switches, buttons, keyboards, mice, touch panels, etc. of a mechanical method, a capacitive non-contact method, a membrane method, etc. When the user operates the operation unit 240, a signal indicating the operation content is output to the processor 210. The processor 210 controls the information processing apparatus 200 based on the input signal. When the operation unit 240 includes a touch panel, the operation unit 240 also serves as the display unit 260.

[0026] The communication unit 250 includes wireless and wired units for communicating with external devices. In this embodiment, the communication unit 250 includes an interface compliant with the MIDI standard. The communication unit 250 receives the input of performance information received from the electronic musical instrument 100 and stores it in the RAM 220.

[0027] The display unit 260 includes a display panel such as an LCD (Liquid Crystal Display) panel, an organic EL (Electro Luminescence) panel, or an LED (Light Emitting Diode) panel and a display controller. The display unit 260 displays an image based on the output from the processor 210.

[0028] The audio output unit 270 includes a speaker and a driver. The audio output unit 270 outputs audio based on the output from the processor 210.

[0029] In this embodiment, the information processing apparatus 200 includes a display unit 260 and an audio output unit 270. However, the configuration of the present invention is not limited to this. At least one of the display unit 260 and the audio output unit 270 may not be provided in the information processing apparatus 200 and may be an external device for the information processing apparatus 200.

[0030] (Operation of the Electronic Musical Instrument System) Next, the operation in the electronic musical instrument system 1 will be described.

[0031] When the processor 210 of the information processing apparatus 200 receives a predetermined operation on the operation unit 240, it transitions the operation mode of the information processing apparatus 200 to the lesson mode. The lesson mode is a mode for practicing to acquire a stable performance. In the lesson mode of the present embodiment, the user will be described as performing finger exercises such as Hanon in unison with the left and right hands. Here, unison means playing the same sound simultaneously in different octaves, that is, playing exactly the same sound simultaneously in different octaves with the left and right hands.

[0032] When transitioning to the lesson mode, the processor 210 causes the display unit 260 to display a lesson screen 261 including the character 30. FIG. 4 is a diagram showing an example of the lesson screen 261 displayed on the display unit 260 when transitioning to the lesson mode. As shown in FIG. 4, in the lesson screen 261, the character 30 (a snowman in FIG. 4) is displayed. When transitioning to the lesson mode, the character 30 is displayed in an unarmed state. In the present embodiment, it is assumed that the character 30 is a snowman, but it is not limited to this. The character 30 includes a person, a creature, an object, an anthropomorphic creature, an anthropomorphic object, a supernatural being (such as a fairy, an angel, a devil, etc.) represented by CG (Computer Graphics).

[0033] After transitioning to the lesson mode, when a predetermined operation for instructing the start of performance is performed by the operation unit 240, the processor 210 starts the lesson process. FIG. 5 is a flowchart showing the flow of lesson processing executed by the processor 210. The lesson processing is executed by the cooperation of the processor 210 and the lesson program 232.

[0034] Here, each time a key-pressing operation is performed on the keyboard 120, the electronic musical instrument 100 outputs performance information (for example, note-on information of MIDI data) corresponding to the key-pressing operation to the information processing apparatus 200 via the communication unit 160. The performance information corresponding to the key-pressing operation includes at least pitch information (such as note number) and a velocity value. Also, each time a key-releasing operation is performed on the keyboard 120, the electronic musical instrument 100 outputs performance information (for example, note-off information of MIDI data) corresponding to the key-releasing operation to the information processing apparatus 200 via the communication unit 160. The performance information corresponding to the key-releasing operation includes at least pitch information. When performance information is input during the lesson processing, the processor 210 stores the input performance information in the RAM 220 in association with the elapsed time since the start of performance.

[0035] Hereinafter, the lesson processing will be described with reference to FIG. 5. In the lesson processing, first, the processor 210 initializes the stability evaluation value SV for evaluating the stability of performance to 0 and the continuous stability evaluation value ConSV to 0 (step S1). The stability of performance as referred to in the present application means that the velocity value of the left hand and the velocity value of the right hand can be performed within a predetermined range from the reference velocity value, and the types of performance techniques of the left hand and the right hand are the same type. Note that the stability of performance is not limited to this, and for example, the fact that performance can be performed at a certain tempo may be considered.

[0036] Next, the processor 210 determines whether a key-pressing operation (the first key-pressing operation) in the electronic musical instrument 100 has been detected (step S2). When performance information corresponding to the key-pressing operation is input from the electronic musical instrument 100 via the communication unit 250, the processor 210 determines that the key-pressing operation has been detected. In the lesson process, since unison is performed with the left and right hands, the key-pressing operations of the left and right hands are performed almost simultaneously.

[0037] If it is determined that no key-pressing operation has been detected (step S2; NO), the processor 210 repeats step S2.

[0038] If it is determined that a key-pressing operation has been detected (step S2; YES), the processor 210 acquires the first right-hand velocity value as the reference velocity value FV (step S3). For example, in step S2, in the user performance in the lesson process mode, the processor 210 determines, among the performance information corresponding to the first input key-pressing operation and the performance information corresponding to the next key-pressing operation input within a predetermined time (about several msec) from the input of the performance information, that the performance information with the lower pitch is the performance information for the first left-hand key-pressing operation in the user performance, and the performance information with the higher pitch is the performance information for the first right-hand key-pressing operation in the user performance. Then, the velocity value included in the performance information for the first right-hand key-pressing operation, that is, the first right-hand velocity value, is stored in the RAM 220 as the reference velocity value FV.

[0039] Here, the reference velocity value FV is a velocity value that serves as a reference for evaluating the stability of the performance. In this embodiment, the velocity value of the right hand (the first right-hand velocity value) that is easy for the user to control is used as the reference velocity value FV, but it is not limited to this. For example, the velocity value of the left hand (the first left-hand velocity value) may be used as the reference velocity value FV, or the first velocity values of the left and right hands may be used as the reference velocity values of the left and right hands respectively. Also, the reference velocity value may be a velocity value pre-registered by the user in advance, or a velocity value randomly specified in the lesson program 232.

[0040] Next, the processor 210 determines whether a key-pressing operation has been detected (step S4). When it is determined that no key operation has been detected (step S4; NO), the processor 210 proceeds to step S10.

[0041] When it is determined that a key operation has been detected (step S4; YES), the processor 210 derives the current left - hand velocity value CVL (second feature amount) and the current right - hand velocity value CVR (first feature amount) (step S5). For example, in step S5, the processor 210 determines, among the performance information corresponding to the input key operation and the performance information corresponding to the next key operation input within a predetermined time (about several msec) from the input of the performance information, that the performance information with the lower pitch is the performance information for the current left - hand key operation (second performance operation), and the performance information with the higher pitch is the performance information for the current right - hand key operation (first performance operation) in the user performance. Then, the velocity value included in the performance information for the current left - hand key operation is set as the current left - hand velocity value CVL, and the velocity value included in the performance information for the current right - hand key operation is set as the current right - hand velocity value CVR and stored in the RAM 220.

[0042] Next, the processor 210 executes performance technique determination processing for each of the right hand and the left hand (step S6).

[0043] FIG. 6 is a flowchart showing the flow of the performance technique determination processing executed in step S6 of FIG. 5. The performance technique determination processing is executed by the cooperation of the processor 210 and the lesson program 232.

[0044] In the performance technique determination processing, first, the processor 210 calculates the sounding duration of the musical tone corresponding to the current key operation based on the performance information stored in the RAM 220 (step S601). The sounding duration of a musical tone can be obtained by calculating the time from the key - down operation of that musical tone to the key - up operation.

[0045] Next, the processor 210 determines whether the calculated pronunciation length is equal to or less than a first threshold Th1 (step S602). If it is determined that the calculated pronunciation length is equal to or less than the first threshold Th1 (step S602; YES), the processor 210 determines that the performance technique (articulation) of the musical sound due to the current key-pressing operation is staccato (step S603), and proceeds to the process of step S7 in FIG. 5.

[0046] On the other hand, if it is determined that the calculated pronunciation length is not equal to or less than the first threshold Th1 (exceeds the first threshold Th1) (step S602; NO), the processor 210 calculates the pronunciation interval between the musical sound corresponding to the previous key-pressing operation and the musical sound corresponding to the current key-pressing operation based on the performance information stored in the RAM 220 (step S604).

[0047] Next, the processor 210 determines whether the calculated pronunciation interval is equal to or less than a second threshold Th2 (step S605). If it is determined that the calculated pronunciation interval is equal to or less than the second threshold Th2 (step S605; YES), the processor 210 determines that the performance technique (articulation) of the musical sound due to the current key-pressing operation is legato (step S606), and proceeds to the process of step S7 in FIG. 5.

[0048] If it is determined that the calculated pronunciation interval is not equal to or less than the second threshold Th2 (exceeds the second threshold Th2) (step S605; NO), the processor 210 determines that the performance technique (articulation) of the musical sound due to the current key-pressing operation is non-legato (step S607), and proceeds to the process of step S7 in FIG. 5.

[0049] In step S7 of FIG. 5, the processor 210 executes a stability evaluation process (step S7).

[0050] FIG. 7 is a flowchart showing the flow of the stability evaluation process executed in step S7 of FIG. 5. The stability evaluation process is executed by the cooperation of the processor 210 and the lesson program 232.

[0051] In the stability evaluation process, first, the processor 210 determines whether the current right - hand velocity value CVR is equal to the reference velocity value FV (step S701). If it is determined that the current right - hand velocity value CVR is equal to the reference velocity value FV (step S701; YES), the processor 210 adds 1 point to the stability evaluation value SV (step S702) and proceeds to the process of step S703. If it is determined that the current right - hand velocity value CVR is not equal to the reference velocity value FV (step S701; NO), the processor 210 proceeds to the process of step S703.

[0052] In step S703, the processor 210 determines whether the current left - hand velocity value CVL is equal to the reference velocity value FV (step S703). If it is determined that the current left - hand velocity value CVL is equal to the reference velocity value FV (step S703; YES), the processor 210 adds 1 point to the stability evaluation value SV (step S704) and proceeds to the process of step S705. If it is determined that the current left - hand velocity value CVL is not equal to the reference velocity value FV (step S703; NO), the processor 210 proceeds to the process of step S705.

[0053] Note that in FIG. 7, it is determined whether the current right - hand velocity value CVR (left - hand velocity value CVL) is equal to the reference velocity value FV (that is, whether the difference between the two is 0), and points are added to the stability evaluation value SV when they are equal, but it is not limited to this example. For example, when the current right - hand velocity value CVR (left - hand velocity value CVL) is within the range of ±M (M is a positive integer, for example, M = 10) of the reference velocity value FV (that is, the difference between the two is ±M or less), points may be added to the stability evaluation value SV.

[0054] In step S705, the processor 210 determines whether the type of right - hand articulation (first type) is the same as the type of left - hand articulation (second type) based on the determination result of the performance technique determination process (step S705). If it is determined that the types of right - hand and left - hand articulations are the same (step S705; YES), the processor 210 adds 1 point to the stability evaluation value SV (step S706) and proceeds to the process of step S707. If it is determined that the types of right - hand and left - hand articulations are not the same (step S705; NO), the processor 210 proceeds to the process of step S707.

[0055] In step S707, the processor 210 obtains the total number of points added to the stability evaluation value SV by the current key - pressing operation (step S707) and determines whether the full score (here, 3 points) has been added (step S708).

[0056] If it is determined that the full score has been added (step S708; YES), the processor 210 adds 1 point to the continuous stability evaluation value ConSV (step S709) and proceeds to the process of step S8 in FIG. 5. If it is determined that the full score has not been added (step S708; NO), the processor 210 resets the continuous stability evaluation value ConSV to 0 (step S710) and proceeds to the process of step S8 in FIG. 5.

[0057] In step S8 of FIG. 5, the processor 210 performs image display processing according to the stability evaluation value SV (step S8).

[0058] FIG. 8 is a flowchart showing the flow of image display processing according to the stability evaluation value SV executed in step S8 of FIG. 5. The image display processing according to the stability evaluation value SV is executed by the cooperation of the processor 210 and the lesson program 232. Note that A1 to A3 used in the image display processing according to the stability evaluation value SV are preset values (positive integers), and A1 < A2 < A3. The values of A1 to A3 may be settable by the user by operating the operation unit 240.

[0059] First, the processor 210 determines whether A1 ≤ stability evaluation value SV < A2 (step S801). If it is determined that A1 ≤ stability evaluation value SV < A2 (step S801; YES), the processor 210 causes an image in which the character 30 (snowman) is wearing gloves to be displayed on the lesson screen 261 of the display unit 260 (step S802), and proceeds to the process of step S9 in FIG. 5.

[0060] If it is determined that A1 ≤ stability evaluation value SV < A2 is not satisfied (step S801; NO), the processor 210 determines whether A2 ≤ stability evaluation value SV < A3 (step S803). If it is determined that A2 ≤ stability evaluation value SV < A3 (step S803; YES), the processor 210 causes an image in which the displayed character 30 (snowman) is further wearing a hat to be displayed on the lesson screen 261 of the display unit 260 (step S804), and proceeds to the process of step S9 in FIG. 5.

[0061] If it is determined that A2 ≤ stability evaluation value SV < A3 is not satisfied (step S803; NO), the processor 210 determines whether A3 ≤ stability evaluation value SV (step S805). If it is determined that A3 ≤ stability evaluation value SV (step S805; YES), the processor 210 causes an image in which the displayed character 30 (snowman) is further wearing a muffler to be displayed on the lesson screen 261 of the display unit 260 (step S806), and proceeds to the process of step S9 in FIG. 5. When it is determined that the stability evaluation value SV is not less than A3 (step S805; NO), the processor 210 proceeds to the process of step S9 in FIG. 5.

[0062] FIG. 9 is a diagram showing changes in the display mode of the character 30 according to the scoring of the stability evaluation value SV during performance. As shown in FIG. 9, when the stability evaluation value SV is less than A1, the character 30 displayed on the display unit 260 has no equipment. When the stability evaluation value SV becomes not less than A1 and less than A2, gloves are added to the character 30. When the stability evaluation value SV becomes not less than A2 and less than A3, a hat is further added to the character 30. When the stability evaluation value SV becomes not less than A3, a muffler is further added to the character 30, and it becomes fully equipped. That is, the larger the stability evaluation value SV, the more luxurious an image with a large number of objects (here, equipment) is displayed on the display unit 260.

[0063] In this way, in the lesson process, during performance, every time a key press operation is detected, based on the performance information corresponding to the key press operation, a velocity value as a feature amount related to the key press operation and an articulation as a performance technique are derived. Then, when the derived velocity value and articulation each satisfy a predetermined condition indicating that the key press operation is stable, the stability evaluation value SV is scored. Examples of the predetermined condition indicating that the key press operation is stable include that the velocity value of the right hand is aligned with the reference velocity value FV, the velocity value of the left hand is aligned with the reference velocity value FV, and the types of articulation of the left and right hands are the same. Then, an image corresponding to the scored stability evaluation value SV is displayed on the lesson screen 261. Specifically, the higher the stability evaluation value SV, the more images of the character 30 with many equipment items are displayed. Therefore, the more stable the user's performance operation is, the more luxurious the equipment of the character 30 will become. As a result, it is possible to enhance the user's motivation to continue practicing to acquire a stable performance, and it is possible to support the user to continue practicing to acquire a stable performance without getting bored.

[0064] In step S9 of FIG. 6, the processor 210 performs image display processing according to the continuous stability evaluation value ConSV (step S9).

[0065] FIG. 10 is a flowchart showing the flow of image display processing according to the continuous stability evaluation value ConSV executed in step S9 of FIG. 5. The image display processing according to the continuous stability evaluation value ConSV is executed by the cooperation of the processor 210 and the lesson program 232.

[0066] First, the processor 210 determines whether the continuous stability evaluation value ConSV is N points (N is a positive integer, for example, N = 10) (step S901). Here, in the stability evaluation process, when both the velocity value and the articulation satisfy all the predetermined conditions indicating stability (when the stability evaluation value SV is given full marks), the continuous stability evaluation value ConSV is incremented by 1 point. If even one of them does not apply, the previous points are reset. That is, the continuous stability evaluation value ConSV indicates the number of consecutive stable key-pressing operations. In step S901, it is determined whether the stability evaluation value SV has been given full marks continuously for N key-pressing operations (whether stable key-pressing operations have been continuously performed N times). The number of N is not particularly limited, but for example, it is the number of musical sounds included in a predetermined period, for example, 2 measures.

[0067] If it is determined that the continuous stability evaluation value ConSV is not N points (step S901; NO), the processor 210 proceeds to the process of step S10 in FIG. 5.

[0068] When it is determined that the continuous stability evaluation value ConSV is N points (step S901; YES), the processor 210 instantaneously displays an effect animation (effect image) 31 around the character 30 on the lesson screen 261 (step S902). The effect animation 31 is an animation that gives a predetermined visual effect. The effect animation 31 is not particularly limited, but here, it is assumed that an effect of a moving heart mark is displayed.

[0069] FIG. 11 is a diagram showing an example of the lesson screen 261 on which the effect animation 31 is displayed. When the continuous stability evaluation value ConSV reaches a predetermined number of points (for example, 10 points), as shown in FIG. 11, the effect animation 31 is additionally displayed on the lesson screen 261 displayed on the display unit 260. That is, when points are continuously added to the stability evaluation value SV for a plurality of key pressing operations for a predetermined number of times or a predetermined period, the effect animation 31 is displayed on the display unit 260. Therefore, the user can intuitively recognize that a stable performance has been continuously performed a predetermined number of times (predetermined period) during the performance. In addition, since the effect animation 31 is displayed when a stable performance can be continuously performed a predetermined number of times (predetermined period), the motivation for the user to practice so as to be able to perform a continuously stable performance can be enhanced.

[0070] In this embodiment, in the stability evaluation process, when both the velocity value and the articulation satisfy a predetermined condition indicating that the key pressing operation is stable (when the stability evaluation value SV is given full marks), the continuous stability evaluation value ConSV is incremented by 1 point. However, the calculation method of the continuous stability evaluation value ConSV is not limited to this. For example, when at least one of the velocity value and the articulation satisfies a predetermined condition indicating that the key pressing operation is stable (when the stability evaluation value SV is given full marks), the continuous stability evaluation value ConSV may be incremented by 1 point.

[0071] Next, the processor 210 resets the continuous stability evaluation value ConSV to 0 (step S903), and proceeds to the process of step S10 in FIG. 5.

[0072] In step S10 of FIG. 5, the processor 210 determines whether the end of performance has been instructed by an operation of the operation unit 240 (step S10). If it is determined that the end of performance has not been instructed (step S10; NO), the processor 210 returns to the process of step S4. If it is determined that the end of performance has been instructed (step S10; YES), the processor 210 performs the final evaluation display process (step S11) and ends the lesson process.

[0073] FIG. 12 is a flowchart showing the flow of the final evaluation display process executed in step S11 of FIG. 5. The final evaluation display process is executed by the cooperation of the processor 210 and the lesson program 232. The stability evaluation value SV at the end of performance becomes the final stability evaluation value SV in this performance. Note that B1 to B5 used in the final evaluation display process are preset values, and B1 < B2 < B3 < B4 < B5. The values of B1 to B5 may be settable by the user by operating the operation unit 240.

[0074] First, the processor 210 determines whether B1 ≤ stability evaluation value SV < B2 (step S1111). If it is determined that B1 ≤ stability evaluation value SV < B2 (step S1111; YES), the processor 210 displays an animation of a confetti effect around the character 30 on the lesson screen 261 (step S1112), and ends the final evaluation display process and the lesson process.

[0075] If it is determined that B1 ≤ stability evaluation value SV < B2 is not satisfied (step S1111; NO), the processor 210 determines whether B2 ≤ stability evaluation value SV < B3 (step S1113). When it is determined that B2 ≤ stability evaluation value SV < B3 (step S1113; YES), the processor 210 causes an animation of a leaf effect to be displayed around the character 30 on the lesson screen 261 (step S1114), and ends the final evaluation display process and the lesson process.

[0076] When it is determined that B2 ≤ stability evaluation value SV < B3 is not satisfied (step S1113; NO), the processor 210 determines whether B3 ≤ stability evaluation value SV < B4 (step S1115). When it is determined that B3 ≤ stability evaluation value SV < B4 (step S1115; YES), the processor 210 causes an animation of a cherry blossom petal effect to be displayed around the character 30 on the lesson screen 261 (step S1116), and ends the final evaluation display process and the lesson process.

[0077] When it is determined that B3 ≤ stability evaluation value SV < B4 is not satisfied (step S1115; NO), the processor 210 determines whether B4 ≤ stability evaluation value SV < B5 (step S1117). When it is determined that B4 ≤ stability evaluation value SV < B5 (step S1117; YES), the processor 210 causes an animation of a fireworks effect to be displayed around the character 30 on the lesson screen 261 (step S1118), and ends the final evaluation display process and the lesson process.

[0078] When it is determined that B4 ≤ stability evaluation value SV < B5 is not satisfied (step S1117; NO), the processor 210 determines whether B5 ≤ stability evaluation value SV (step S1119). When it is determined that B5 ≤ stability evaluation value SV (step S1119; YES), the processor 210 causes an animation of a star effect to be displayed around the character 30 on the lesson screen 261 (step S1120), and ends the final evaluation display process and the lesson process. When it is determined that the stability evaluation value SV is not less than B5 (step S1119; NO), the processor 210 ends the final evaluation display process and the lesson process without displaying the animation of the effect.

[0079] FIG. 13 is a diagram showing the animation of the effect displayed according to the final stability evaluation result. In FIG. 13, only the animation of the effect is shown, and the illustration of the character 30 is omitted. As shown in FIG. 13, when the final stability evaluation result is not less than B1 and less than B2, an animation in which paper snowflakes scatter is displayed on the lesson screen 261. When the final stability evaluation result is not less than B2 and less than B3, an animation in which leaves fall is displayed on the lesson screen 261. When the final stability evaluation result is not less than B3 and less than B4, an animation in which cherry blossoms dance is displayed on the lesson screen 261. When the final stability evaluation result is not less than B4 and less than B5, an animation in which fireworks go off is displayed on the lesson screen 261. When the final stability evaluation result is not less than B5, an animation in which stars fly is displayed on the lesson screen 261. Note that the effects shown in FIG. 13 are merely examples and are not limited thereto. However, in order for the user to intuitively grasp the final stability evaluation result, it is preferable that the higher the final stability evaluation value SV, the more magnificent (the greater the movement) the effect is displayed.

[0080] In this way, in the lesson process, animations of different effects are displayed according to the final stability evaluation value SV at the end of the performance, so that the user can intuitively recognize the final evaluation result of the stability of the current performance.

[0081] As described above, the processor 210 of the information processing apparatus 1 determines the types of articulation for the left hand and the types of articulation for the right hand. When the determined types of articulation for the left hand and the right hand are the same, the processor 210 evaluates the stability evaluation value SV by adding points, and causes the display unit 260 to display an image corresponding to the stability evaluation value SV. When the determined types of articulation for the left hand and the right hand are not the same, the processor 210 does not evaluate the stability evaluation value SV by adding points. Therefore, the more the user plays so that the types of articulation for the left hand and the right hand are the same, the larger the value of the stability evaluation value SV becomes, and an image corresponding to this stability evaluation value SV is displayed on the display unit 260. Thus, it is possible to enhance the motivation of the user to continue practicing to acquire a stable performance, and it is possible to support the user to continue practicing to acquire a stable performance without getting bored.

[0082] Also, for example, the processor 210 derives a left hand velocity value CVL and a right hand velocity value CVR respectively, and evaluates the stability evaluation value SV by adding points when the difference between the derived velocity values (CVL, CVR) and the reference velocity value (FV) is within a predetermined range. Therefore, the more the user plays so that the difference between the velocity values of the left hand and the right hand and the reference velocity value is within a predetermined range, the larger the value of the stability evaluation value SV becomes, and an image corresponding to this stability evaluation value SV is displayed on the display unit 260. Thus, it is possible to enhance the motivation of the user to continue practicing to acquire a stable performance, and it is possible to support the user to continue practicing to acquire a stable performance without getting bored.

[0083] Also, for example, the processor 210 causes the display unit 260 to display an image with a larger number of objects as the stability evaluation value SV increases. Therefore, the more stable the performance operation is, the more luxurious the image displayed on the display unit 260 becomes, with a larger number of objects. This can enhance the user's motivation to continue practicing to acquire a stable performance and support the user to continue practicing without getting bored to acquire a stable performance.

[0084] Also, for example, when points are continuously added to the stability evaluation value SV for a plurality of performance operations, the processor 210 causes the display unit 260 to display an effect image. Therefore, the user can intuitively recognize that they have been able to perform a continuously stable performance during the performance. Also, it can enhance the user's motivation to practice to be able to perform a continuously stable performance.

[0085] Note that the description content in the above embodiment is a preferred example of the program, information processing apparatus, electronic musical instrument, and display method according to the present invention, and is not limited thereto.

[0086] For example, in the above embodiment, the case where finger exercises are performed in unison with both the left and right hands is taken as an example for explanation, but the present invention may also be applied to lessons when performing finger exercises with either the left or right hand.

[0087] Also, in the above embodiment, the feature amount acquired according to the key-pressing operation is assumed to be the velocity value, but it may be other feature amounts such as pitch and tone color filter, for example.

[0088] Also, in the above embodiment, the case where the character 30 is up to a snowman is taken as an example for explanation, but it is not limited thereto. For example, a plurality of types of characters may be prepared in advance so that the user can freely select a character according to their preference.

[0089] In the above-described embodiment, the case where the electronic musical instrument 100 and the information processing apparatus 200 are separate entities has been described as an example. However, the functions of the present invention implemented by the processor 210 of the information processing apparatus 200 may be provided in the electronic musical instrument 100. For example, the processor 110 of the electronic musical instrument 100 may implement the functions of the present invention. Further, in the above-described embodiment, the lesson screen 261 is displayed on the display unit 260 of the information processing apparatus 200. However, when the electronic musical instrument 100 is provided with a display unit, the lesson screen 261 may be displayed on the display unit of the electronic musical instrument 100. Alternatively, the lesson screen 261 may be displayed on a display unit separate from the information processing apparatus and communicatively connected to the information processing apparatus 200.

[0090] Further, for example, in the above-described embodiment, the case where the electronic musical instrument 100 is a keyboard instrument has been described as an example. However, other electronic musical instruments such as an electric guitar and a MIDI violin may also be used.

[0091] In the above-described embodiment, an example in which a semiconductor memory such as a ROM or a hard disk is used as a computer-readable medium for the program according to the present invention has been disclosed. However, the present invention is not limited to this example. As other computer-readable media, portable recording media such as CD-ROMs can be applied. Further, a carrier wave is also applied as a medium for providing the data of the program according to the present invention via a communication line.

[0092] In addition, the detailed configurations and operations of the electronic musical instrument 100 and the information processing apparatus 200 can be appropriately changed within a range not departing from the spirit of the invention.

[0093] Although the embodiments of the present invention have been described above, the technical scope of the present invention is not limited to the above-described embodiments and is defined based on the description in the claims. Further, an equivalent range in which changes not related to the essence of the present invention are made from the description of the claims is also included in the technical scope of the present invention.

Explanation of Reference Numerals

[0094] 1 Electronic musical instrument system 100 Electronic musical instrument 110 Processor 120 Keyboard 130 Key scanner 140 Operation unit 150 Sound generation unit 160 Communication unit 200 Information processing device 210 Processor 220 RAM 232 Lesson program 240 Operation unit 250 Communication unit 260 Display unit 270 Voice output unit

Claims

1. cause a computer to determine a first type of performance technique related to a first performance operation and a second type of the performance technique related to a second performance operation based on performance information input by a performance operation on an operator, when the determined first type and second type are the same, cause an evaluation value for evaluating the performance to be scored, cause an image corresponding to the evaluation value to be displayed on a display unit, A program for executing the processing.

2. The processing does not cause the evaluation value to be scored when the determined first type and second type are not the same, The program according to claim 1.

3. The first type and the second type include at least one of staccato, legato, and non-legato, The program according to claim 1 or 2.

4. The processing derives a first feature amount related to the first performance operation and a second feature amount related to the second performance operation based on the performance information, when a difference between at least one of the derived first feature amount and second feature amount and a reference feature amount serving as a reference for the feature amount is within a predetermined range, causes the evaluation value to be scored, The program according to claim 1.

5. The processing causes an image with a larger number of objects to be displayed on the display unit as the evaluation value is larger, The program according to claim 1 or 4.

6. The processing causes an effect image to be displayed on the display unit when scoring evaluations are continuously performed on the evaluation value for a plurality of the performance operations, The program according to claim 1 or 4.

7. determine a first type of performance technique related to a first performance operation and a second type of the performance technique related to a second performance operation based on performance information input by a performance operation on an operator, when the determined first type and second type are the same, cause an evaluation value for evaluating the performance to be scored, cause an image corresponding to the evaluation value to be displayed on a display unit, An information processing apparatus including a control unit.

8. The information processing apparatus according to claim 7, and an operator for a user to perform a performance operation, An electronic musical instrument comprising the same.

9. A computer determines a first type of performance technique related to a first performance operation and a second type of the performance technique related to a second performance operation based on performance information input by a performance operation on an operator, When it is determined that the first type and the second type are the same, a scoring evaluation is performed on an evaluation value for evaluating performance, and an instruction is given to a display unit to display an image corresponding to the evaluation value, A display method.

Images