Program, information processing device, electrical musical instrument, and display method

Abstract

To provide an electric musical instrument system allowing a user to intuitively grasp whether or not he / she is playing the performance with consistent sound and to practice with consistent sound while having fun.SOLUTION: The processor of an information processing device calculates a velocity value obtained in response to the key press operation of an electric musical instrument keyboard and the difference between a reference velocity value and the obtained velocity value, calculates the statistic value regarding the most recently calculated multiple difference values, determines the display contents on a display based on the calculated statistic value, and reflects the determined content on the display.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to a program, an information processing device, an electronic musical instrument, and a display method. [Background technology]

[0002] 2. Description of the Related Art Conventionally, there is known a musical sound evaluation device that calculates a volume from an input musical sound signal, calculates a volume stability in a predetermined section, and displays the volume stability in a graph (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2016-85309 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology described in Patent Document 1 does not enable a user to intuitively and enjoyably grasp whether or not a performance with consistent sound grains has been achieved while playing.

[0005] The present invention has been made in consideration of the above circumstances, and its purpose is to enable a user to intuitively grasp whether or not they are able to perform with consistent sound particles, and to enable the user to practice aligning sound particles while having fun. [Means for solving the problem]

[0006] A program according to an embodiment of the present invention includes: Computer, each time an operation of a control of the musical instrument is detected, a difference value between a feature amount obtained in response to the operation of the control and a reference feature amount that is a reference for the feature amount is calculated, and a statistical value is calculated regarding a plurality of the most recently calculated difference values; determining the content to be displayed on the display unit based on the calculated statistical value; reflecting the determined content on the display unit; Function as a control unit. Effect of the Invention

[0007] According to one embodiment of the present invention, a user can intuitively grasp whether or not a performance with consistent sound grains has been achieved, and can have fun practicing to achieve consistent sound grains. [Brief description of the drawings]

[0008] [Figure 1] 1 is a diagram showing the external appearance of an electronic musical instrument system according to an embodiment of the present invention; [Diagram 2] 1 is a block diagram showing a configuration of an electronic musical instrument according to an embodiment of the present invention; [Diagram 3] 1 is a block diagram showing a configuration of an information processing device according to an embodiment of the present invention; [Figure 4] 11 is a diagram showing an example of a lesson screen displayed on a display unit when the information processing device is switched to a lesson mode; FIG. [Diagram 5] 4 is a flowchart showing a lesson process executed by a processor of the information processing device of FIG. 3. [Figure 6] FIG. 13 is a diagram showing an example of an animation output on a lesson screen in response to a first key press. [Figure 7] 7 is a flowchart showing the process of determining facial expression based on a velocity difference value, which is executed in step S6 of FIG. 5. [Figure 8] FIG. 13 is a diagram illustrating an example of a facial expression correspondence table. [Figure 9] FIG. 13 is a diagram showing an example of an animation output on a lesson screen in response to a current key pressing operation. [Figure 10] FIG. 6 is a diagram showing an example of a graph displayed in step S10 of FIG. 5. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] An electronic musical instrument system according to an embodiment of the present invention will now be described in detail with reference to the drawings.

[0010] (Electronic Musical Instrument System Configuration) Fig. 1 is a diagram showing the external appearance of an electronic musical instrument system 1 according to an embodiment of the present invention. As shown in Fig. 1, the electronic musical instrument system 1 includes an electronic musical instrument 100 and an information processing device 200, which are connected via a wired or wireless line.

[0011] The electronic musical instrument 100 is an electronic keyboard instrument, such as an electronic piano, a synthesizer, or an electronic organ. Fig. 2 is a block diagram showing the configuration of the electronic musical instrument 100. As shown in Fig. 2, the electronic musical instrument 100 includes a processor 110, a keyboard 120, a key scanner 130, an operation unit 140, a sound generation unit 150, and a communication unit 160.

[0012] The processor 110 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The processor 110 controls the electronic musical instrument 100 by reading out programs and data stored in the ROM and using the RAM as a work area.

[0013] When a user (performer) performs a key depression operation (performance operation), the processor 110 causes the sound generation unit 150 to generate a musical tone of a pitch corresponding to the depressed key, and outputs this musical tone from the speaker 150a. Also, when the user performs a key release operation, the processor 110 causes the sound generation unit 150 to mute the musical tone that is being generated and corresponds to the released key.

[0014] The keyboard 120 has a plurality of white keys and black keys as a plurality of operators (performance operators). Each key is associated with a different pitch.

[0015] The key scanner 130 detects key depression, key release, and key depression speed (velocity value) of the keyboard 120, and outputs performance information including the detected pitch information and velocity value to the processor 110. The velocity value can also be said to be a value indicating the strength of a sound. The pitch information is also called a key number, key number, MIDI key, or note number.

[0016] The operation unit 140 is composed of, for example, a mechanical type, a capacitive non-contact type, a membrane type, or other key switch, a button, a touch panel, etc. By operating the operation unit 140, the user can, for example, set a tone or adjust the volume.

[0017] The sound generation unit 150 includes a sound source unit, a D / A converter, an amplifier, and a speaker 150a, and generates musical tones of a pitch specified by the processor 110, and mutes musical tones of a pitch specified by the processor 110.

[0018] The communication unit 160 includes wireless and wired units for communicating with an external device. In this embodiment, the communication unit 160 includes an interface that complies with the Musical Instrument Digital Interface (MIDI) standard. Under the control of the processor 110, the communication unit 160 transmits performance information including pitch information and velocity values ​​to the information processing device 200, which is an example of an external device. The performance information has, for example, a data structure that complies with the MIDI standard.

[0019] The information processing device 200 is, for example, a notebook PC (Personal Computer) or a smartphone, but may also be other types of devices such as a tablet terminal, a portable game machine, a feature phone, or a PDA (Personal Digital Assistant).

[0020] Fig. 3 is a block diagram showing the configuration of the information processing device 200. As shown in Fig. 3, the information processing device 200 includes a processor 210, a RAM 220, a ROM 230, an operation unit 240, a communication unit 250, a display unit 260, and an audio output unit 270. The information processing device 200 is placed on the music stand 170 of the electronic musical instrument 100, for example.

[0021] The processor 210, which is an example of a computer, is, for example, a single processor or a multiprocessor, and includes at least one processor. When multiple processors are included, the processor 210 may be packaged as a single device, or may be configured as multiple devices physically separated within the information processing device 200. The processor 210 functions as a "control unit." The processor 210 reads out the programs and data stored in the ROM 230 into the RAM 220, and uses the RAM 220 as a work area to control the operation of each unit of the information processing device 200.

[0022] The RAM 220 temporarily stores data and programs. The RAM 220 stores programs and data read from the ROM 230, as well as other data necessary for communication.

[0023] The ROM 230 is a non-volatile semiconductor memory such as a flash memory, an EPROM (Erasable Programmable ROM), or an EEPROM (Electrically Erasable Programmable ROM), and serves as a secondary storage device or an auxiliary storage device. The ROM 230 stores programs and data used by the processor 210 to perform various processes, including a lesson program 232. The ROM 230 also stores a facial expression correspondence table 233 (see FIG. 8), which will be described later.

[0024] The operation unit 240 is composed of, for example, a mechanical type, a capacitive non-contact type, a membrane type, or other key switch, a button, a keyboard, a mouse, a touch panel, and the like. When a user operates the operation unit 240, a signal indicating the operation content is output to the processor 210. The processor 210 controls the information processing device 200 based on the input signal. When the operation unit 240 includes a touch panel, the operation unit 240 also serves as the display unit 260.

[0025] The communication unit 250 includes a wireless and wired unit for communicating with an external device. In this embodiment, the communication unit 250 includes an interface that complies with the MIDI standard. The communication unit 250 receives input of performance information from the electronic musical instrument 100, which is an example of an external device, and stores the information in the RAM 220.

[0026] The display unit 260 includes a display panel, such as an LCD (Liquid Crystal Display) panel, an organic EL (Electro Luminescence) panel, an LED (Light Emitting Diode) panel, or the like, and a display controller. The display unit 260 displays an image based on the output from the processor 210.

[0027] The audio output unit 270 includes a speaker and a driver and outputs audio based on the output from the processor 210.

[0028] In this embodiment, the information processing device 200 includes the display unit 260 and the audio output unit 270, but the configuration of the present invention is not limited to this. At least one of the display unit 260 and the audio output unit 270 may be an external device to the information processing device 200, rather than being included in the information processing device 200.

[0029] (Electronic musical instrument system operation) Next, the operation of the electronic musical instrument system 1 will be described.

[0030] When the processor 210 of the information processing device 200 receives a predetermined operation on the operation unit 240, it transitions the operation mode of the information processing device 200 to a lesson mode. The lesson mode is a mode for practicing to be able to play with consistent sound particles (consistent sound tone). In the lesson mode of this embodiment, the user is assumed to perform finger practice in unison with the left and right hands. Unison here refers to playing the same note at different octaves at the same time, that is, playing the exact same note at different octaves with the left and right hands at the same time.

[0031] When the mode is changed to the lesson mode, the processor 210 causes the display unit 260 to display a lesson screen 261 including the character 30. FIG. 4 is a diagram showing an example of a lesson screen 261 displayed on the display unit 260 when the display unit 260 is switched to the lesson mode. As shown in FIG. 4, the lesson screen 261 displays a character 30 (a snowman in FIG. 4) holding a torch 31L (first object) on the left hand (left hand as seen from the user) and a torch 31R (second object) on the right hand (right hand as seen from the user) of the display unit 260. When the display unit 260 is switched to the lesson mode, the height of the torch 31L and the torch 31R and the facial expression of the character 30 are displayed in a predetermined manner. For example, the torch 31L and the torch 31R are not lit, and the facial expression of the character 30 is displayed as "normal" in the facial expression correspondence table 233 shown in FIG. 8. In this embodiment, the character 30 is a snowman, but is not limited to this. The characters 30 include people, creatures, objects, anthropomorphized creatures, anthropomorphized objects, supernatural beings (fairies, angels, devils, etc.), etc., represented by CG (Computer Graphics).

[0032] After the mode has been switched to the lesson mode, when a predetermined operation is received on operation unit 240 to instruct the start of performance, processor 210 starts lesson processing. 5 is a flowchart showing the flow of lesson processing executed by processor 210. The lesson processing is executed by processor 210 in cooperation with lesson program 232.

[0033] In the information processing device 200, the processor 210 first determines whether or not a key depression operation on the electronic musical instrument 100 has been detected (step S1). Each time a key is pressed on the keyboard 120, the electronic musical instrument 100 outputs performance information (e.g., MIDI data) corresponding to the key press to the information processing device 200 via the communication unit 160. The processor 210 of the information processing device 200 determines that a key press has been detected when performance information corresponding to the key press is input from the electronic musical instrument 100 via the communication unit 250. In the lesson process, the left and right hands play in unison, so the left and right hands press keys almost simultaneously.

[0034] When it is determined that a key depression operation has not been detected (step S1; NO), processor 210 repeats step S1.

[0035] When it is determined that a key depression operation has been detected (step S1; YES), processor 210 acquires the initial left hand velocity value and the initial right hand velocity value as a left hand reference velocity value FVL and a right hand reference velocity value FVR, respectively (step S2). For example, in step S2, processor 210 judges that, in a user performance in the lesson processing mode, between the first input performance information and the next input performance information within a predetermined time (about several msec) from the input of the performance information, the lower pitch performance information is the performance information for the first left hand key press in the user performance, and the higher pitch performance information is the performance information for the first right hand key press in the user performance. Then, processor 210 stores in RAM 220 the velocity value included in the performance information for the first left hand key press, i.e., the first left hand velocity value, as a left hand reference velocity value FVL in association with the elapsed time from the start of performance, and stores in RAM 220 the velocity value included in the performance information for the first right hand key press, i.e., the first right hand velocity value, as a right hand reference velocity value FVR in association with the elapsed time from the start of performance.

[0036] Here, if the user starts playing with a weak sound, that is, if the initial velocity value is low, the weak sound is set as the reference, so that the user can practice aligning the grains with the weak sound. If the user starts playing with a medium sound, that is, if the initial velocity value is medium, the medium sound is set as the reference, so that the user can practice aligning the grains with the medium sound. If the user starts playing with a strong sound, that is, if the initial velocity value is high, the strong sound is set as the reference, so that the user can practice aligning the grains with the strong sound.

[0037] Next, processor 210 outputs an animation according to the left hand reference velocity value FVL and the right hand reference velocity value FVR (step S3). In step S3, processor 210 causes display unit 260 to display an animation of character 30 displayed on display unit 260, in which torch 31L on the left side is burning at a height corresponding to left hand reference velocity value FVL, and torch 31R on the right side is burning at a height corresponding to right hand reference velocity value FVR.

[0038] Fig. 6 is a diagram showing an example of an animation output on the lesson screen 261 in response to the first key press operation. As shown in Fig. 6, the left torch 31L is displayed at a height corresponding to the left hand reference velocity value FVL, and the right torch 31R is displayed at a height corresponding to the right hand reference velocity value FVR. In this way, the torches are displayed at heights corresponding to the reference velocity values ​​of the left and right, respectively, so that the strength of key depression that each side should aim for can be visualized.

[0039] Next, processor 210 determines whether or not a key depression operation is detected (step S4). When it is determined that a key depression operation has not been detected (step S4; NO), processor 210 proceeds to step S8.

[0040] When it is determined that a key depression operation has been detected (step S4; YES), processor 210 obtains the current left hand velocity value CVL and the current right hand velocity value CVR (step S5). For example, in step S5, processor 210 judges that, of the input performance information and the next performance information input within a predetermined time (about several msec) from the input of the performance information, the lower pitched performance information is the performance information for the current left hand key press operation, and the higher pitched performance information is the performance information for the current right hand key press operation in the user's performance. Then, processor 210 stores in RAM 220 the velocity value included in the performance information for the current left hand key press operation, i.e., the current left hand velocity value CVL, and the velocity value included in the performance information for the current right hand key press operation, i.e., the current right hand velocity value CVR, in association with the elapsed time from the start of the performance.

[0041] Next, processor 210 executes a facial expression determination process based on the velocity difference value (step S6).

[0042] Fig. 7 is a flow chart showing the flow of the facial expression determination process based on the velocity difference value executed in step S6 of Fig. 5. The facial expression determination process based on the velocity difference value is executed by the processor 210 and the lesson program 232 in cooperation with each other.

[0043] In the process of determining facial expression based on velocity difference values, processor 210 first calculates a difference value CDVL between left hand reference velocity value FVL and current left hand velocity value CVL, and a difference value CDVR between right hand reference velocity value FVR and current right hand velocity value CVR (step S601).

[0044] Next, the processor 210 stores the calculated difference values ​​(CDVL, CDVR) in the accumulation buffer of the RAM 220 (step S602). Here, the accumulation buffer is a buffer for storing a predetermined number of most recent (e.g., 16) difference values ​​(CDVL, CDVR) for calculating the accumulation. The accumulation buffer stores the difference values ​​(CDVL, CDVR) in such a way that the order of storage can be known, for example, by correlating them with the time of storage.

[0045] Next, the processor 210 determines whether the difference value CDVL and the difference value CDVR stored in the accumulation buffer have each reached a predetermined number (for example, 16) (step S603). When it is determined that the difference values ​​CDVL and CDVR stored in the accumulation buffers have not yet reached the predetermined numbers (for example, 16) (step S603; NO), the processor 210 proceeds to step S7 in FIG.

[0046] If it is determined that the number of difference values ​​CDVL and difference values ​​CDVR stored in the accumulation buffer has each reached a predetermined number (e.g., 16) (step S603; YES), processor 210 calculates a cumulative value CumDVL of the absolute values ​​of the difference values ​​CDVL stored in the accumulation buffer and a cumulative value CumDVR of the absolute values ​​of the difference values ​​CDVR stored in the accumulation buffer (step S604).

[0047] Next, the processor 210 refers to the facial expression correspondence table 233 stored in the ROM 230, and obtains the left facial expression value EXL corresponding to the cumulative total value CumDVL and the right facial expression value EXR corresponding to the cumulative total value CumDVR (step S605).

[0048] Fig. 8 is a diagram showing an example of the facial expression correspondence table 233. As shown in Fig. 8, the facial expression correspondence table 233 stores a facial expression value, a character's facial expression corresponding to that facial expression value, and a range of cumulative values ​​corresponding to that facial expression value, in association with each other. The facial expression value is a value indicating the rank of the uniformity of the sound, with a smaller value indicating a higher rank. As shown in Fig. 8, a cumulative value with a higher rank is associated with positive facial expressions such as "happiness" and "enthusiasm," and a lower rank is associated with negative facial expressions such as "sadness," "surprise," and "anger." 8 is an example, and the expressions and meanings corresponding to each expression value (rank), and the number of expression values ​​are not particularly limited as long as they are easy for the user to understand. In addition, the user may be able to set the expressions for each rank according to a user operation.

[0049] Next, the processor 210 determines whether the left facial expression value EXL and the right facial expression value EXR are equal (step S606). If it is determined that the left facial expression value EXL and the right facial expression value EXR are equal (step S606; YES), processor 210 determines the facial expression of the rank corresponding to the left facial expression value EXL and the right facial expression value EXR as the facial expression to be reflected on character 30, reflects the determined facial expression on character 30 displayed on display unit 260 (step S607), and proceeds to step S611.

[0050] When it is determined that the left facial expression value EXL and the right facial expression value EXR are not equal (step S606; NO), the processor 210 determines whether the difference between the left facial expression value EXL and the right facial expression value EXR is two ranks or more (step S608).

[0051] If it is determined that the difference between the left facial expression value EXL and the right facial expression value EXR is not two ranks or more (step S608; NO), processor 210 determines the facial expression corresponding to the higher-ranked facial expression value as the facial expression to be reflected on character 30, reflects the determined facial expression on character 30 displayed on display unit 260 (step S609), and proceeds to step S611.

[0052] If it is determined that the difference between the left facial expression value EXL and the right facial expression value EXR is two ranks or more (step S608; YES), processor 210 determines the facial expression corresponding to the average of the two ranks as the facial expression to be reflected in character 30, reflects the determined facial expression in character 30 displayed on display unit 260 (step S610), and proceeds to step S611.

[0053] In this way, the facial expression of the character 30 reflects the cumulative total of the difference between the velocity value of the most recent key depression and the reference velocity value, so the user can intuitively understand from the facial expression of the character 30 whether the sound particles of the most recent series of sounds are aligned with those at the start of the performance. This allows the user to recognize whether the performance is acceptable as it is or whether corrections are necessary. In addition, since the facial expression of the character 30 is determined by the user's performance, the user can practice aligning the sound particles while having fun.

[0054] In step S611, the processor 210 deletes the oldest difference values ​​CDVL, CDVR stored in the accumulation buffer (step S611), and proceeds to step S7 in FIG.

[0055] In step S7 of FIG. 5, processor 210 outputs animation corresponding to the current velocity values ​​of the left and right (step S7). In step S8, processor 210 causes display unit 260 to display an animation in which torch 31L on the left side of character 30 displayed on display unit 260 is burning at a height corresponding to the current left hand velocity value CVL, and torch 31R on the right side is burning at a height corresponding to the current right hand velocity value CVR.

[0056] Fig. 9 is a diagram showing an example of an animation output on the lesson screen 261 in response to the current key pressing operation. As shown in Fig. 9, the flame of the left torch 31L is displayed at a height corresponding to the current left hand velocity value CVL, and the flame of the right torch 31R is displayed at a height corresponding to the current right hand velocity value CVR. In Fig. 9, the height of the flame of torch 31L is lower than that of torch 31R, and the two are not aligned. Also, in Fig. 9, the flames of torches 31L and 31R are higher than in the first time (see Fig. 6), and the facial expression of character 30 shows a low rank of "surprise." Therefore, the user can recognize that the strength of the key presses on the left and right are not aligned, that the right key is pressed quite hard, that the difference in velocity value from the first time is large, and that the performance is not aligned with the grain of the sound. In this way, the velocity values ​​of the left and right during performance are visualized as the height of the flames of the torches 31L and 31R held by the character 30, so the user can visually check in real time whether the strength of the notes (fingers) on the left and right are consistent during performance. And, for example, the user can recognize that although they think they are playing with the same strength on the left and right, there is quite a bit of variation.

[0057] Next, processor 210 determines whether or not an instruction to end the performance has been given by operating operation unit 240 (step S8). When it is determined that the end of the performance has not been instructed (step S8; NO), processor 210 returns to step S4.

[0058] When it is determined that an instruction to end the performance has been given (step S8; YES), processor 210 causes display unit 260 to display a graph display switch for instructing a graph display, and determines whether or not the graph display switch has been pressed (step S9). If it is determined that the graph display switch has been pressed (step S9; YES), processor 210 causes display unit 206 to display a graph showing the time changes of velocity values ​​CVL and CVR on display unit 260 (step S10), and ends the lesson processing.

[0059] In step S10, processor 210 plots a left-hand reference velocity value FVL, which is the initial left-hand velocity value, and all left-hand velocity values ​​CVL in a coordinate space with the vertical axis representing velocity and the horizontal axis representing the elapsed time from the start of performance, to display a graph showing the change in left-hand velocity value over time on display unit 260. Processor 210 also plots a right-hand reference velocity value FVR, which is the initial right-hand velocity value, and all right-hand velocity values ​​CVR in the same coordinate space to display a graph showing the change in right-hand velocity value over time on display unit 260.

[0060] Fig. 10 is a diagram showing an example of a graph displayed in step S10 on display unit 260. As shown in Fig. 10, a graph showing the time change of the left hand velocity value and a graph showing the time change of the right hand velocity value are displayed in different colors (different aspects) on the same coordinate plane. In this way, after the performance is finished, the change in the left and right velocity values ​​over time is displayed in a graph, so the user can later confirm which parts of the performance had the same sound intensity and which parts did not. Then, the user can objectively grasp what needs to be corrected.

[0061] In addition, in finger exercises such as Hanon, it is decided which finger should play which note, so by displaying the pitch of the pressed notes on the horizontal axis of a graph, for example, it is possible to understand which fingers are playing well and which fingers are not playing well.

[0062] On the other hand, if it is determined that the graph display switch has not been pressed (step S9; NO), processor 210 ends the lesson processing.

[0063] (Variation 1) The display method of the torches 31L and 32R is not limited to the above. For example, the processor 210 initially displays the left hand reference velocity value FVL at 1 / 2 the maximum height of the torch 31L, and the right hand reference velocity value FVR at 1 / 2 the maximum height of the torch 31R. When a key press operation is started, the processor 210 calculates the difference values ​​(first difference value, second difference value (CDVL, CDVR)) between the left and right velocity values ​​(CVL, CVR) corresponding to the key press operation and the reference velocity values ​​(FVL, FVR), and if the difference value between the velocity value corresponding to the left or right key press operation and the reference velocity value is within ±10, the processor 210 displays the torch 31L or 31R at 1 / 2 the height, and if the difference value is greater than +10, the processor 210 changes the height of the torch 31L or 31R to a higher height (for example, at the maximum height), and if the difference value is +30 or more, further changes the color (for example, from red to purple). Furthermore, if the difference between the velocity value corresponding to the left or right key depression and the reference velocity value is less than -10, the processor 210 lowers the height of the torch 31L or 31R (for example, displays it at the lowest height), and if the difference is -30 or more, further changes the color (for example, from red to blue) for display.

[0064] According to the above display method, if the difference between the sound strength and the standard sound strength for the left and right hands is within the allowable range, the torch is displayed at the standard height (1 / 2 height), if the difference between the sound strength and the standard sound strength exceeds the allowable range, the size of the torch changes, and if the difference between the sound strength and the standard sound strength becomes even larger, the color of the torch changes. Thus, the user can intuitively grasp in real time while playing whether the strength of the sound played by the left and right hands is consistent with the standard sound strength.

[0065] As described above, the processor 210 of the information processing device 200 calculates the difference values ​​(CDVL, CDVR) between the velocity values ​​(CVL, CVR) acquired in response to a key depression operation on the keyboard 120 and the reference velocity values ​​(FVL, FVR), determines a facial expression to be reflected on the character 30 displayed on the display unit 260 based on the calculated difference values, and reflects the determined facial expression on the character 30. For example, the processor 210 calculates the difference values ​​(CDVL, CDVR) between the velocity values ​​(CVL, CVR) and the reference velocity values ​​(FVL, FVR) every time a key depression operation is detected, calculates the cumulative value (CumDVL, CumDVR) of the absolute values ​​of the most recently calculated multiple difference values, and determines the facial expression of the character 30 based on the calculated cumulative value. Therefore, the facial expression of the character 30 reflects the cumulative total of the difference between the velocity value of the key press and the reference velocity value, so the user can intuitively understand whether the performance is consistent in the grain of the sound from the facial expression of the character 30. Also, since the facial expression of the character 30 is determined by the user's performance, the user can have fun practicing to achieve consistency in the grain of the sound.

[0066] In addition, processor 210 displays the height of torch 31L displayed on a first side (e.g., the left side) of display unit 260 as seen by the user at a height corresponding to the difference value CDVL between the left hand velocity value CVL and the left hand reference velocity value FVL, and displays the height of torch 31R displayed on a second side (e.g., the right side) of display unit 260 as seen by the user at a height corresponding to the difference value CDVR between the right hand velocity value CVR and the right hand reference velocity value FVR. Therefore, while the user is playing, he or she can intuitively grasp in real time whether the strength of the notes played with the left and right hands is consistent with the standard strength.

[0067] In addition, processor 210 displays the height of torch 31L displayed on a first side (e.g., the left side) of display unit 260 as seen by the user at a height corresponding to the left hand velocity value CVL, and displays the height of torch 31R displayed on a second side (e.g., the right side) of display unit 260 as seen by the user at a height corresponding to the right hand velocity value CVR. Therefore, the user can visually check in real time while playing whether the strength of the notes (fingers) of his / her left and right hands are consistent.

[0068] In addition, by setting the reference velocity values ​​(FVL, FVR) as the initial velocity values ​​when the user plays, for example, if the user starts playing with a soft sound, he or she can practice aligning the grains with a soft sound, and if the user starts playing with a loud sound, he or she can practice aligning the grains with a loud sound, and so on. It is possible to practice aligning the grains with sounds of various strengths.

[0069] The contents described in the above embodiment are preferred examples of the program, information processing device, electronic musical instrument, and display method according to the present invention, and are not intended to be limiting.

[0070] For example, the reference velocity values ​​(FVL, FVR) in the above embodiment and modification 1 are described as the initial velocity values, but are not limited to this. For example, the reference velocity values ​​may be velocity values ​​registered in advance by the user or velocity values ​​randomly specified by the lesson program 232.

[0071] In the above embodiment and modification 1, the finger practice is performed in unison with the left and right hands, but the present invention may be applied to lessons in which either the left or right finger is practiced. In this case, the reference velocity value, the velocity value (current velocity value) acquired in response to the key pressing operation, the difference value, and the cumulative value thereof are not separate for the left and right but are combined into one, and the facial expression corresponding to the calculated cumulative value is determined as the facial expression to be reflected on the character 30. In addition, either or both of the left and right torches are displayed at the height (flame) of the velocity value acquired in response to the current key pressing operation.

[0072] In the above embodiment and modification 1, the statistical value of the difference between the velocity value acquired in response to the key pressing operation and the reference velocity value, which is calculated every time a predetermined number of key pressing operations are detected, is described as being the cumulative value of the difference value (the cumulative value of the absolute value of the difference value), but the statistical value is not limited to the cumulative value. For example, the statistical value may be another statistical value such as the average value, the median value, or the like.

[0073] In the above embodiment and modification 1, the feature acquired in response to the key press operation is the velocity value, and the facial expression to be reflected on the character 30 is determined based on a statistical value relating to the difference between the acquired velocity value and a reference velocity value, but the facial expression of the character 30 may be determined based on a statistical value relating to the difference between the value of another feature acquired in response to the key press operation and its reference value. Examples of other feature include pitch, tone color filter, etc.

[0074] In the above embodiment and modification 1, the facial expression to be reflected on the character 30 is determined based on a statistical value relating to the difference between the most recent velocity values ​​and the reference velocity value, but each time a key press is detected, a differential value between the velocity value corresponding to the key press and the reference velocity value may be calculated, and the facial expression to be reflected on the character 30 may be determined based on the calculated differential value. Alternatively, even if the predetermined number is not reached (for example, in the case of the first six key presses), a statistical value relating to the difference values ​​currently stored in the accumulation buffer may be calculated, and the facial expression to be reflected on the character 30 may be determined based on the calculated statistical value.

[0075] In the above embodiment and modification 1, the character 30 is a snowman, but the present invention is not limited to this. For example, a plurality of types of characters may be prepared in advance, and the user may freely select a character according to his / her preference.

[0076] In the above embodiment and modification 1, the facial expression of the character 30 is determined based on the difference between the velocity value corresponding to the key pressing operation (playing operation) and the reference velocity value and the statistical value thereof, and the determined facial expression is reflected on the character 30 displayed on the display unit 260. However, the content to be displayed on the display unit 260 (content to be reflected on the display unit 260) determined by the processor 210 based on the difference between the velocity value corresponding to the key pressing operation and the reference velocity value and the statistical value thereof is not limited to this. For example, the processor 210 may determine an action other than the facial expression corresponding to the character 30 based on the difference between the velocity value corresponding to the key pressing operation and the reference velocity value and the statistical value thereof, and reflect the action on the character 30 displayed on the display unit 260. Here, the action corresponding to the character 30 is the movement of the character 30, and includes an expression formed by moving the parts of the character's face.

[0077] Furthermore, in the above embodiment and modification 1, the electronic musical instrument 100 and the information processing device 200 are separate entities, but the functions of the present invention implemented by the processor 210 of the information processing device 200 may be provided in the electronic musical instrument 100. For example, the processor 110 of the electronic musical instrument 100 may realize the functions of the present invention.

[0078] Also, for example, in the above embodiment, the electronic musical instrument 100 is a keyboard instrument, but it may be another electronic musical instrument, such as an electric guitar, a MIDI violin, or the like.

[0079] In the above embodiment and modification 1, an example is disclosed in which a semiconductor memory such as a ROM or a hard disk is used as a computer-readable medium for the program according to the present invention, but the present invention is not limited to this example. As other computer-readable media, a portable recording medium such as a CD-ROM can be applied. Furthermore, a carrier wave can be applied as a medium for providing data of the program according to the present invention via a communication line.

[0080] Furthermore, the detailed configurations and operations of the electronic musical instrument 100 and the information processing device 200 may be modified as appropriate without departing from the spirit and scope of the invention.

[0081] Although the embodiment of the present invention has been described above, the technical scope of the present invention is not limited to the above embodiment, but is defined based on the claims. Furthermore, the technical scope of the present invention also includes equivalent ranges that are made by adding modifications that are not related to the essence of the present invention from the claims. [Explanation of symbols]

[0082] 1. Electronic Musical Instrument System 100 Electronic Instruments 110 Processor 120 keys 130 Key Scanner 140 Operation section 150 Pronunciation section 160 Communications Department 200 Information processing device 210 Processor 220 RAM 232 Lesson Program 233 Facial Expressions Table 240 Operation section 250 Communications Department 260 Display 270 Audio output section

Claims

1. Computer, each time an operation of a control of the musical instrument is detected, a difference value between a feature amount obtained in response to the operation of the control and a reference feature amount that is a reference for the feature amount is calculated, and a statistical value is calculated regarding a plurality of the most recently calculated difference values; determining the content to be displayed on the display unit based on the calculated statistical value; reflecting the determined content on the display unit; A program to function as a control unit.

2. the reference feature amount is the feature amount acquired in response to a first operation of the operator by a user during a performance, or the feature amount registered in advance; The program according to claim 1.

3. The content is an action corresponding to a character displayed on the display unit. The program according to claim 1.

4. The control unit is determining a facial expression of the character displayed on the display unit based on a statistical value relating to the calculated difference value; The program according to claim 3.

5. The control unit is calculating a first difference value which is a difference value between the feature amount acquired in response to an operation of the manipulator with a left hand and the reference feature amount for a left hand, and a second difference value which is a difference value between the feature amount acquired in response to an operation of the manipulator with a right hand and the reference feature amount for a right hand, calculating a first statistical value related to the most recently calculated plurality of first difference values ​​and a second statistical value related to the most recently calculated plurality of second difference values; determining the content based on the calculated first statistical value and the calculated second statistical value; The program according to any one of claims 1 to 4.

6. The control unit is a height of a first object displayed on a first side of the display unit as viewed from the user is displayed at a height corresponding to the first difference value, and a height of a second object displayed on a second side of the display unit as viewed from the user is displayed at a height corresponding to the second difference value; The program according to claim 5.

7. The control unit is a height of a first object displayed on a first side of the display unit as viewed from the user is displayed at a height corresponding to the feature amount acquired in response to an operation of the manipulator with a left hand, and a height of a second object displayed on a second side of the display unit as viewed from the user is displayed at a height corresponding to the feature amount acquired in response to an operation of the manipulator with a right hand; The program according to claim 1.

8. each time an operation of a control of the musical instrument is detected, a difference value between a feature amount obtained in response to the operation of the control and a reference feature amount that is a reference for the feature amount is calculated, and a statistical value is calculated regarding a plurality of the most recently calculated difference values; determining the content to be displayed on the display unit based on the calculated statistical value; reflecting the determined content on the display unit; An information processing device having a control unit.

9. An information processing device according to claim 8 ; An operator for a user to perform a musical performance; An electronic musical instrument comprising:

10. The computer each time an operation of a control of the musical instrument is detected, a difference value between a feature amount obtained in response to the operation of the control and a reference feature amount that is a reference for the feature amount is calculated, and a statistical value is calculated regarding a plurality of the most recently calculated difference values; determining the content to be displayed on the display unit based on the calculated statistical value; reflecting the determined content on the display unit; Display method.

Images