Information processing device, electronic musical instrument, timbre control method and program

Abstract

To allow for performance expression at phrase breaks.SOLUTION: A control unit of an electronic device acquires a performance operation interval based on input performance information and determines a phrase break based on a comparison between the acquired performance operation interval and a first reference time T1 based on length of one beat. Then, a tone of playing sound is changed according to the phrase break and the playing sound is output by an output unit.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an electronic musical instrument, a timbre control method, and a program.

Background Art

[0002] Conventionally, an electronic musical instrument having a keyboard such as a piano keyboard has been known (see, for example, Patent Document 1). For example, various musical instrument timbres are installed on the keyboard, and these timbres can be played using the keyboard.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in playing with the timbres of other musical instruments using a keyboard or the like, since it is a performance using the keyboard, there are cases where performance expressions that were possible with actual musical instruments cannot be achieved. For example, in stringed instruments, a performance expression of controlling the timbre by changing the plucking position at the phrase break is performed, but it has been difficult to achieve a performance expression corresponding to the phrase break with a keyboard.

[0005] The present invention has been made in view of the above problems, and an object thereof is to enable adding performance expressions according to phrase breaks.

Means for Solving the Problems

[0006] To solve the above problems, the information processing apparatus of the present invention includes a processor that controls the output of performance sounds based on a plurality of performance information including at least the timing of key performance operations and the pitch information of the keys, The processor Based on the performance operation timings included in the multiple performance information, the time from the first key press operation to the second key press operation of the key between A certain playback interval is obtained, and the obtained playback interval is set to a baseline value. Larger than In some cases, the timbre of at least a portion of the sound of the performance is changed. height, Based on a comparison between the performance interval and a first reference time, which is one of the reference values ​​and is the sum of the length of one beat and a predetermined percentage of the length of one beat, the timbre of at least some of the sounds included in the performance sound is changed. The greater the difference between the performance operation interval and the first reference time, the greater the difference in shape between the performance sound and the waveform data of the preset timbre, and the waveform data used to control the output of at least a portion of the performance sound. It is characterized by the following: [Effects of the Invention]

[0007] According to the present invention, it becomes possible to add musical expression according to the division of phrases. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows the appearance of an electronic musical instrument according to an embodiment of the present invention. [Figure 2] Figure 1 is a block diagram showing the functional configuration of an electronic musical instrument. [Figure 3] This is a flowchart showing the flow of the tone control processing performed by the control unit in Figure 2. [Figure 4] This diagram illustrates the criteria used to determine phrase separation. [Figure 5] This diagram illustrates the indicator values ​​for judging playing touch. [Modes for carrying out the invention]

[0009] The embodiments for carrying out the present invention will be described below with reference to the drawings. However, the embodiments described below are subject to various technically preferred limitations for carrying out the present invention. Therefore, the technical scope of the present invention is not limited to the embodiments and illustrated examples below.

[0010] [100 Components of Electronic Musical Instruments] Figure 1 shows the external appearance of an electronic musical instrument 100 including an information processing device according to the present invention. Figure 2 is a block diagram showing the functional configuration of the electronic musical instrument 100. The electronic instrument 100 is an electronic keyboard instrument such as a keyboard, and as shown in Figures 1 and 2, it is configured to include a control unit 11, a keyboard 12, a detection unit 13, an output unit 14 including a speaker 14a, an operation unit 15, a communication unit 16, a storage unit 17, and a music stand 18.

[0011] The control unit (processor) 11 is comprised of a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and the like. The CPU of the control unit 11 reads programs and data stored in ROM and uses RAM as a work area to centrally control each part of the electronic musical instrument 100. For example, the control unit 11 controls the output of a performance sound from the output unit 14 in response to the pressing of a key 12a of the keyboard 12, and controls the muting of the performance sound output from the output unit 14 in response to the release of a key 12a of the keyboard 12. The control unit 11 also executes timbre control processing, which will be described later, to control the output of the timbre of the performance sound.

[0012] The keyboard 12 is equipped with multiple keys (operators) 12a for the user (performer) to specify the pitch.

[0013] The detection unit 13 detects when a key 12a is pressed or released, and outputs performance information, including the detected key 12a press / release information and pitch information, to the control unit 11. The detection unit 13 detects when each key 12a is pressed or released, for example, by a switch provided below each key 12a.

[0014] The output unit 14 includes a sound source unit, a D / A converter, an amplifier, a speaker 14a, etc. The output unit 14 reads waveform data pre-stored in the waveform ROM by the sound source unit or generates waveform data, and outputs the performance sound based on the waveform data from the speaker 14a. In this embodiment, the waveform ROM provided in the sound source unit of the output unit 14 stores a plurality of waveform data corresponding to various timbres, including standard timbres of stringed instruments such as guitars and violins.

[0015] The operation unit 15 has operation buttons and a touch panel for the user to perform various settings and the like, and outputs operation information of the operation buttons and the touch panel to the control unit 11.

[0016] The communication unit 16 includes a wireless unit or a wired unit for communicating with an external device. The communication unit 16 includes an interface compliant with the MIDI (Musical Instrument Digital Interface) standard, and based on the control of the control unit 11, can output performance information including key press / release information and pitch information to an external device as MIDI data.

[0017] The storage unit 17 is composed of a non-volatile semiconductor memory, a hard disk, etc., and stores various data. Also, the program for operating the electronic musical instrument 100 may be stored in the storage unit 17.

[0018] [Operation of the Electronic Musical Instrument 100] Next, the operation of the electronic musical instrument 100 will be described. In the performance of a stringed instrument, by changing the position where the string is plucked, sounds from soft to hard can be produced, and rich performance expressions can be created by controlling the timbre according to this plucking position. The control of the timbre according to this plucking position is used for the segmentation of phrases, and it is possible to add performance expressions according to the segmentation of phrases. On the other hand, in a keyboard instrument such as a keyboard, it is not possible to control the position where the string is plucked like a stringed instrument. Therefore, conventionally, it has not been possible to change the timbre according to the segmentation of phrases like a stringed instrument and add performance expressions.

[0019] In stringed instruments, the player's plucking touch changes depending on where they pluck the string. For example, the ends of the string have higher tension, so a strong, firm, and longer pluck is required. The resulting tone is hard. The middle of the string has lower tension, so less force is needed, and a gentle touch is required (a light and short pluck). The resulting tone is soft. On the other hand, with keyboard instruments, playing with strong force tends to result in a longer key press time because the key is pressed firmly. Playing gently tends to result in a shorter key press time.

[0020] Therefore, the electronic instrument 100 detects phrase divisions (phrase changes) based on the input performance information, and changes the timbre of the performance sound according to the performance touch (key press) at that time, thereby adding performance expression according to the phrase divisions.

[0021] Figure 3 is a flowchart showing the flow of the tone control processing performed by the control unit 11. The tone control processing is performed in cooperation with the CPU of the control unit 11 and a program stored in the ROM when, for example, the tone of a stringed instrument (such as a guitar) is set by the operation unit 15, and the pressing of the key 12a is detected by the detection unit 13 and the performance information is input.

[0022] As a prerequisite for executing the tone control processing, when the control unit 11 receives performance information from the detection unit 13, it adds the time the performance information was input (key press / release timing, i.e., the performance operation timing) and a number representing the input order to the input performance information and stores it in RAM. Then, based on the multiple performance information including the input time and the number representing the input order, it executes the tone control processing shown in Figure 3. When the performance of a song is finished, the control unit 11 deletes the performance information from RAM. For example, if a predetermined threshold has elapsed since all keys 12a were released, it is determined that the performance has ended and the performance information is deleted from RAM. Alternatively, the multiple performance information including the input time and the number representing the input order stored in RAM may be saved as performance information for one song (for example, as MIDI data) in the storage unit 17. The performance information in this claim refers to performance information including the input time and the number representing the input order.

[0023] The timbre control process will be explained below with reference to Figure 3. First, the control unit 11 calculates a phrase division indicator value t1 based on the input performance information and stores it in RAM (step S1). Here, at phrase breaks, the time between notes, that is, the time from the previous key press to the current key press (play operation interval), tends to be longer. Therefore, the control unit 11 sets, for example, the length of one beat + α (where α is, for example, 10% of the length of one beat) as the reference time T1 (first reference time), measures the time from the previous key press to the current key press (play operation interval) based on the performance information, calculates the difference value by subtracting the reference time T1 from the measured time, and sets the judgment index value t1. If the difference value is 0 or less, the judgment index value t1 = 0 (see Figure 4). Here, the length of one beat may be a predetermined value, or it may be calculated by averaging the key press intervals when there is no phrase break. Note that while the reference time T1 is given as an example of a case that reflects the length of one beat, it is not limited to this and may be a predetermined time (fixed time). Also, the performance operation interval does not necessarily have to be in units of time, and it may be considered based on the number of beats.

[0024] Next, the control unit 11 determines whether it is a phrase boundary based on the determination index value t1 (step S2). In step S2, when 0 < t1, that is, when the time from the previous key press to the current key press (performance operation interval) is longer than the reference time T1, the control unit 11 determines that it is a phrase boundary. When t1 = 0, it is determined that it is not a phrase boundary.

[0025] When it is determined that it is not a phrase boundary (step S2; NO), the control unit 11 causes the output unit 14 to output a performance sound in a standard timbre (step S5), and ends this process. In step S5, the control unit 11 reads out the waveform data of the standard timbre of the timbre (here, the timbre of a stringed instrument such as a guitar) set by the operation unit 15 and stored in the waveform ROM of the output unit 14, and outputs a performance sound based on the read waveform data.

[0026] When it is determined that it is a phrase boundary (step S2; YES), the control unit 11 calculates a determination index value t2 of the performance touch based on the input performance information, and stores it in the RAM (step S3). In step S3, the control unit 11 measures the time from key press to key release (performance operation time) based on the input performance information, and calculates a determination index value t2 of the key press touch indicating how much longer / shorter the time from key press to key release is than the predetermined reference times T21 to T22 (see FIG. 5). When the time from key press to key release is longer than the reference time T22, a difference value obtained by subtracting the reference time T22 from the time from key press to key release is calculated as t2. At this time, t2 > 0 (t2 is a positive value). When the time from key press to key release is shorter than the reference time T21, a difference value obtained by subtracting the reference time T21 from the time from key press to key release is calculated as t2. At this time, t2 < 0 (t2 is a negative value). When the time from key press to key release is within the range of the reference times T21 to T22, t2 = 0. Furthermore, if the time the key is pressed reaches a predetermined maximum time, even if the key has not been released, the system proceeds to step S4, determines that t2 > 0, and sets t2 to the difference between the maximum time and the reference time T22.

[0027] Next, the control unit 11 determines whether or not the playing touch differs from the standard based on the judgment index value t2 (step S4). In step S4, the control unit 11 determines that the playing touch is different from the standard if t2≠0, that is, if the time from pressing the key to releasing the key is longer than the predetermined reference time T22 or shorter than the reference time T21. If t2=0, that is, if the time from pressing the key to releasing the key is within the predetermined reference time range T21~T22, it determines that the playing touch is standard.

[0028] If the control unit 11 determines that the playing touch is standard (step S4; NO), it causes the output unit 14 to output a playing sound with the standard timbre (step S5), and terminates this process. As described above, in step S5, the control unit 11 reads the waveform data of the standard tone (in this case, the tone of a stringed instrument such as a guitar) set by the operation unit 15, which is stored in the waveform ROM of the output unit 14, and outputs the performance sound based on the read waveform data.

[0029] If it is determined that the playing touch is different from the standard (step S4; YES), the control unit 11 determines whether t2 > 0 (step S6). If it is determined that t2 > 0 (step S6; YES), that is, if the time from pressing the key to releasing the key is longer than the reference time T22, the control unit 11 causes the output unit 14 to output a sound with the tone of "sul ponticello" (plucked near the bridge) (step S7), and proceeds to step S9. If it is determined that t2 < 0 (step S6; NO), that is, if the time from pressing the key to releasing the key is shorter than the reference time T21, the control unit 11 causes the output unit 14 to output a sound with the tone of "sul tasto" (plucked close to the fretboard) (step S8), and proceeds to step S9.

[0030] Here, the tone produced by "sul ponticello" (plucking the strings near the bridge) is the tone produced when plucking the ends of the strings on a stringed instrument, resulting in a hard tone. The tone produced by "sul tasto" (plucking the strings near the fretboard) is the tone produced when plucking the strings closer to the fretboard on a stringed instrument, resulting in a soft tone.

[0031] In steps S7 and S8, the control unit 11 instructs the output unit 14 to change at least a portion of the timbre of the performance sound to "sul ponticello" or "sul tasto" by, for example, changing the shape of a portion of the standard waveform data of the timbre set by the operation unit 15, which is stored in the waveform ROM. When changing the shape of the waveform data, the sound source unit of the output unit 14 may, for example, change a portion of the shape by combining the standard waveform data with other waveform data. Alternatively, waveform data for the "sul ponticello" tone and waveform data for the "sul tasto" tone, which differ from standard waveform data, are also stored in the waveform ROM in advance. The control unit 11 reads out the waveform data for the "sul ponticello" tone or the waveform data for the "sul tasto" tone according to the determination result in step S6, and instructs the output unit 14 to change the tone to "sul ponticello" or "sul tasto" by outputting at least a part of the tone of the played sound based on the read waveform data.

[0032] In steps S7 and S8, the control unit 11 calculates t1 × t2 = a, and may control the system so that the larger the absolute value of a, the more prominent the tonal characteristics due to differences in string plucking position are added, that is, the greater the change in tone from the standard tone. Since a larger absolute value of t1 indicates a clearer transition between phrases, and a larger absolute value of t2 indicates a greater change in playing touch, increasing the degree of change in tone according to the absolute value of a allows the performer's expression to be more clearly reflected in the tone. As a control to increase the change in tone as the absolute value of a increases, for example, the output unit 14 is controlled to change the tone of at least a part of the sound played using waveform data that has a larger difference in shape from the standard tone waveform data preset by the operation unit 15 as the absolute value of a increases. The waveform data of the tone corresponding to the absolute value of a may be stored in the waveform ROM in advance, or it may be generated by the sound source unit of the output unit 14 in response to instructions from the control unit 11.

[0033] In step S9, the control unit 11 determines whether or not there is another key press within the phrase (step S9). In step S9, the control unit 11 determines whether there is a next key press in the phrase based on whether the performance information for the next key press has been input within a predetermined time. If the control unit 11 determines that there is another key press within the phrase (step S9; YES), it returns to step S3 and executes the processing from step S3 onward. If the control unit 11 determines that there are no further key presses within the phrase (step S9; NO), it terminates this process.

[0034] After the tone control processing is completed, when the detection unit 13 detects a key press and inputs the performance information, the control unit 11 executes the tone control processing again. The control unit 11 repeatedly executes the tone control processing until a predetermined threshold has elapsed since all keys 12a were released and the end of performance is determined.

[0035] In the above explanation, the time from pressing a key to releasing it (playing operation time) is measured based on the input performance information, and it is determined whether or not the time from pressing to releasing the key differs from the standard playing touch by comparing it with predetermined reference times T21-T22. However, the determination of whether or not the playing touch differs from the standard playing touch is not limited to this. For example, if velocity information is entered in the performance information, it may be determined whether or not the performance touch differs from the standard based on the velocity information. For example, if the sound being judged is determined to be stronger or weaker than the surrounding sounds, or stronger or weaker than a certain standard value, it may be determined that the performance touch differs from the standard. Alternatively, sensors that directly detect the strength of a touch may be placed on the electronic instrument 100, and it may be determined whether or not the touch differs from the standard playing touch based on the sensor's detection value. In addition, other sensors besides the touch-detecting sensors, such as camera images, may be provided to determine the strength of the touch. Furthermore, the effect of the timbre corresponding to the judged playing touch may not be applied to the sound of the performance information for which the judgment index value t2 was calculated, but rather to the sound of the next performance information for which t2 was calculated. Also, if t2 is calculated and it is determined that it is a special touch (different from the standard playing touch), the surrounding sounds may also be determined to be special touches without calculating t2. Alternatively, the sound may be produced as a standard touch at the moment of pressing, and the waveform of the sound produced may gradually shift to reflect the playing touch as time passes until the key is released. Alternatively, the speed at which the keys are pressed can be used to determine whether the playing touch differs from the standard.

[0036] As explained above, the control unit 11 of the electronic instrument 2 determines the division of a phrase based on the performance information input from the detection unit 13. For example, the control unit 11 acquires the performance operation interval based on the input performance information, and determines the division of a phrase based on a comparison of the acquired performance operation interval with a first reference time T1. Then, according to the division of the phrase, it causes the output unit 14 to output a performance sound with a changed timbre. Therefore, it becomes possible to add musical expression to the phrase divisions.

[0037] Furthermore, the control unit 11 determines whether the performance touch differs from a predetermined standard performance touch based on the input performance information. For example, it measures the performance operation time based on the input performance information and determines whether the performance touch differs from the standard performance touch based on a comparison of the measured performance operation time with a predetermined second reference time T21 or T22. If it determines that the performance touch differs from the standard performance touch, it causes the output unit 14 to output a performance sound with a changed timbre. Therefore, when the playing touch differs from the standard playing touch, it becomes possible to add performance expression that corresponds to the playing touch.

[0038] For example, the control unit 11 controls the output unit 14 such that the greater the difference between the performance operation time acquired based on the input performance information and the second reference time, the greater the change in tone color. Therefore, it becomes possible to reflect the dynamics of the playing touch in the musical expression.

[0039] Furthermore, since the electronic instrument 100 is equipped with an output unit 14, it can output performance sounds based on performance information without connecting an external output unit.

[0040] Furthermore, since the electronic instrument 100 is equipped with a keyboard 12 that has controls, performance information can be input without connecting external controls.

[0041] The descriptions in the above embodiments are merely preferred examples of the information processing device, electronic musical instrument, tone control method, and program according to the present invention, and are not limited thereto. For example, in the above embodiment, the information processing device of the present invention was described as being included in an electronic musical instrument 100, but the invention is not limited thereto. For example, the information processing device of the present invention only needs to include a CPU for executing the above-mentioned tone control processing and a storage unit that stores the program, and the instrument (operator) for inputting performance information and the output unit may be configured to be externally connected via an interface. The performance information may be input via the interface, or the performance information may be received via wireless communication, or the performance information may be stored in the storage unit. Furthermore, the control element does not have to be a keyboard. For example, it could be a push button, piston, touch panel, etc.

[0042] Furthermore, although the above embodiment described an example in which the performance information includes key press / release information, pitch information, and timing information for key press / release, it is not limited to this. For example, the performance information may include performance operation information (note ON / note OFF, etc.) for instruments other than the keyboard, pitch information, and timing information for performance operations. Alternatively, it may be performance information generated by a computer such as a personal computer (MIDI data, etc.). Furthermore, even when performance is being played in real time, the performance information stored in the memory unit 17 includes key press / release information, pitch information, and key press / release timing information, so it is possible to determine whether the performance touch differs from the standard performance touch. Also, if the performance information stored in the memory unit 17 includes velocity information, the difference from the standard performance touch may be determined based on the velocity information. Similarly, even with performance information generated by a computer such as a personal computer and stored in the memory unit 17 (for example, MIDI data), it is possible to determine whether the performance touch differs from the standard performance touch by obtaining the performance operation time from information such as note ON / note OFF. Also, if velocity information is included, the difference from the standard performance touch may be determined based on the velocity information.

[0043] Furthermore, in the above embodiment, the tone control processing described above was performed when the tone of a stringed instrument was set as the tone to be used. However, the tone control processing may be applied when using other tone colors, not just stringed instruments.

[0044] Furthermore, in the above embodiment, the timbre is changed when a phrase boundary is detected and the instrument is played with a playing touch different from the standard touch. However, the timbre may be changed regardless of the playing touch when a phrase boundary is detected. Also, the timbre may be changed when the instrument is played with a playing touch different from the standard touch, regardless of whether or not it is a phrase boundary.

[0045] Furthermore, in the above embodiment, the output unit 14 includes a sound source unit, and the sound source unit reads or generates timbre waveform data from ROM (storage unit) in response to the control unit 11. However, the timbre waveform data may also be read or generated by the CPU of the control unit 11.

[0046] Furthermore, while the above embodiment discloses an example in which ROM is used as the computer-readable medium for the program according to the present invention, the invention is not limited to this example. Other computer-readable media that can be used include hard disks, SSDs, and portable recording media such as CD-ROMs. In addition, carrier waves can also be used as a medium for providing the data of the program according to the present invention via a communication line.

[0047] Furthermore, the detailed configuration and operation of the electronic musical instrument can also be modified as appropriate, without departing from the spirit of the invention.

[0048] Although embodiments of the present invention have been described above, the technical scope of the present invention is not limited to the embodiments described above, but is determined based on the claims. Furthermore, equivalent scopes of the present invention that have been modified from the claims but are not related to the essence of the present invention are also included in the technical scope of the present invention. The invention described in the claims initially attached to the application for this patent is listed below. The claim numbers listed below are the same as those in the claims initially attached to the application for this patent. [Note] <Claim 1> It includes a processor that controls the output of the performance sound based on multiple performance information, including at least performance timing and pitch information. The processor obtains a performance operation interval based on the performance operation timings included in the plurality of performance information, and changes the timbre of at least a portion of the performance sound if the obtained performance operation interval is greater than a reference value. An information processing device characterized by the following: <Claim 2> The information processing apparatus according to claim 1, characterized in that, when the playback operation interval is greater than the reference value, the processor changes the timbre of at least a portion of the playback sound by changing the shape of a portion of the waveform data of a preset timbre for the playback sound. <Claim 3> It has a memory unit that stores multiple waveform data corresponding to multiple different timbres, The information processing apparatus according to claim 1, characterized in that, when the playback operation interval is greater than the reference value, the processor controls the output of at least a portion of the playback sound based on waveform data having a different shape from the waveform data of a tone preset for the playback sound, which is read from the storage unit, thereby changing the tone of at least a portion of the playback sound. <Claim 4> The processor changes the timbre of at least some of the sounds included in the performance sound based on a comparison of the performance interval with a first reference time. The information processing apparatus according to any one of claims 1 to 3. <Claim 5> The processor further determines, based on the performance information, whether the performance touch differs from the standard performance touch, and if it determines that it differs, it changes the timbre of the performance sound. The information processing apparatus according to any one of claims 1 to 4. <Claim 6> The processor measures the performance operation time based on the performance information, and determines whether the performance touch differs from the standard performance touch based on a comparison of the measured performance operation time with a second reference time. The information processing apparatus according to feature 5. <Claim 7> The processor controls the timbre change to increase as the difference between the performance time and the second reference time increases. The information processing apparatus according to feature 6. <Claim 8> The processor controls the output of at least a portion of the performance sound using waveform data that has a larger difference in shape from the waveform data of a preset timbre for the performance sound, as the difference between the performance operation time and the second reference time increases. The information processing apparatus according to feature 7. <Claim 9> An output unit that outputs the performance sound based on the control of the processor, An information processing device according to any one of claims 1 to 8, characterized by comprising: <Claim 10> An information processing device according to any one of claims 1 to 9, A control for inputting the aforementioned performance information, An electronic musical instrument characterized by having the following features. <Claim 11> A computer that controls the output of a performance sound based on multiple performance information, including at least performance timing and pitch information, Based on the performance operation timings included in the multiple performance information, the performance operation interval is obtained, and if the obtained performance operation interval is greater than a reference value, the timbre of at least a portion of the performance sound is changed. A method for controlling tone color, characterized by the following features. <Claim 12> A computer that controls the output of a performance sound based on multiple performance information, including at least performance timing and pitch information, Based on the performance operation timings included in the multiple performance information, the performance operation interval is obtained, and if the obtained performance operation interval is greater than a reference value, the timbre of at least a portion of the performance sound is changed. A program characterized by executing a process. [Explanation of Symbols]

[0049] 100 Electronic Instruments 11 Control Unit 12 keys 12a key 13 Detection unit 14 Output section 15 Control section 16 Communications Department 17 Memory section 18 Music Stands

Claims

1. The system includes a processor that controls the output of a sound based on a plurality of performance information, including at least the timing of key operation and pitch information of the key. The aforementioned processor, Based on the performance operation timings included in the multiple performance information, the performance operation interval, which is the time from the first key press operation to the second key press operation, is obtained, and if the obtained performance operation interval is greater than a reference value, the timbre of at least a part of the performance sound is changed. Based on a comparison between the performance interval and a first reference time, which is one of the reference values ​​and is the sum of the length of one beat and a predetermined proportion of the length of one beat, the timbre of at least some of the sounds included in the performance sound is changed. The greater the difference between the performance operation interval and the first reference time, the greater the difference in shape between the waveform data of the performance sound and the pre-set timbre waveform data, and the control is made so that at least a portion of the performance sound is output. An information processing device characterized by the following:

2. The processor, when the playback interval is greater than the reference value, changes the timbre of at least a portion of the playback sound by changing the shape of a portion of the waveform data of a preset timbre for the playback sound. The information processing apparatus according to feature 1.

3. It has a memory unit that stores multiple waveform data corresponding to multiple different timbres, The processor, when the playback operation interval is greater than the reference value, controls the output of at least a portion of the playback sound based on waveform data with a different shape from the waveform data of the timbre preset for the playback sound, which is read from the storage unit, thereby changing the timbre of at least a portion of the playback sound. The information processing apparatus according to feature 1.

4. A processor that controls the output of a performance sound based on a plurality of performance information, including at least the timing of key operation and pitch information of the key, The aforementioned processor, Based on the performance operation timings included in the multiple performance information, the performance operation interval, which is the time from the first key press operation to the second key press operation, is obtained, and if the obtained performance operation interval is greater than a reference value, the timbre of at least a part of the performance sound is changed. Based on a comparison between the timing of the key release operation after the key press operation, which is the performance operation timing, and a second reference time after the key press operation, it is determined whether the performance touch differs from the standard performance touch, and if it is determined that it differs, the timbre of the performance sound is changed. If the timing of the key release operation is outside the range of the second reference time, the control is made to change the tone. An information processing device characterized by the following:

5. The processor controls the output of at least a portion of the performance sound using waveform data whose shape differs significantly from the waveform data of a preset timbre for the performance sound, as the difference between the timing of the key release operation and the lower or upper limit of the second reference time range increases. The information processing apparatus according to feature 4.

6. A processor that controls the output of a performance sound based on a plurality of performance information, including at least the timing of key operation and pitch information of the key, The aforementioned processor, Based on the performance operation timings included in the multiple performance information, the performance operation interval, which is the time from the first key press operation to the second key press operation, is obtained, and if the obtained performance operation interval is greater than a reference value, the timbre of at least a part of the performance sound is changed. Based on a comparison between the timing of releasing the key after pressing it (which is the performance operation timing) and a second reference time after pressing the key, it is determined whether the performance touch differs from the standard performance touch. If it is determined that it differs, the timbre of the performance sound, which is the timbre of plucking the strings near the bridge of the stringed instrument and the timbre of plucking the strings near the fingerboard of the stringed instrument, is changed by changing the shape of the waveform data of the stringed instrument. If the timing of the key release operation is before the lower limit of the second reference time range, the tone of the stringed instrument is changed to that of a string plucked closer to the fingerboard; if the timing of the key release operation is after the upper limit of the second reference time range, the tone of the stringed instrument is changed to that of a string plucked closer to the bridge. An information processing device characterized by the following:

7. An output unit that outputs the performance sound based on the control of the processor, An information processing device according to any one of claims 1 to 6, characterized by comprising:

8. An information processing device according to any one of claims 1 to 7, A control for inputting the aforementioned performance information, An electronic musical instrument characterized by having the following features.

9. A computer that controls the output of a sound based on multiple pieces of performance information, including at least the timing of key operation and the pitch information of the key, Based on the performance operation timings included in the multiple performance information, the performance operation interval, which is the time from the first key press operation to the second key press operation, is obtained, and if the obtained performance operation interval is greater than a reference value, the timbre of at least a part of the performance sound is changed. Based on a comparison between the performance interval and a first reference time, which is one of the reference values ​​and is the sum of the length of one beat and a predetermined proportion of the length of one beat, the timbre of at least some of the sounds included in the performance sound is changed. The greater the difference between the performance operation interval and the first reference time, the greater the difference in shape between the waveform data of the performance sound and the pre-set timbre waveform data, and at least a portion of the performance sound is output using waveform data. A method for controlling tone color characterized by the following features.

10. A computer that controls the output of a performance sound based on a plurality of performance information, including at least the timing of key operation and pitch information of the key, Based on the performance operation timings included in the multiple performance information, the performance operation interval, which is the time from the first key press operation to the second key press operation, is obtained, and if the obtained performance operation interval is greater than a reference value, the timbre of at least a part of the performance sound is changed. Based on a comparison between the timing of the key release operation after the key press operation, which is the performance operation timing, and a second reference time after the key press operation, it is determined whether the performance touch differs from the standard performance touch, and if it is determined that it differs, the timbre of the performance sound is changed. If the timing of the key release operation is outside the range of the second reference time, the tone is changed. A method for controlling tone color characterized by the following features.

11. A computer that controls the output of a performance sound based on a plurality of performance information, including at least the timing of key operation and pitch information of the key, Based on the performance operation timings included in the multiple performance information, the performance operation interval, which is the time from the first key press operation to the second key press operation, is obtained, and if the obtained performance operation interval is greater than a reference value, the timbre of at least a part of the performance sound is changed. Based on a comparison between the timing of releasing the key after pressing it (which is the performance operation timing) and a second reference time after pressing the key, it is determined whether the performance touch differs from the standard performance touch. If it is determined that it differs, the timbre of the performance sound, which is the timbre of plucking the strings near the bridge of the stringed instrument and the timbre of plucking the strings near the fingerboard of the stringed instrument, is changed by changing the shape of the waveform data of the stringed instrument. If the timing of the key release operation is before the lower limit of the second reference time range, the tone of the stringed instrument is changed to that of a string plucked closer to the fingerboard; if the timing of the key release operation is after the upper limit of the second reference time range, the tone of the stringed instrument is changed to that of a string plucked closer to the bridge. A method for controlling tone color characterized by the following features.

12. A computer that controls the output of a sound based on multiple pieces of performance information, including at least the timing of key operation and the pitch information of the key, Based on the performance operation timings included in the multiple performance information, the performance operation interval, which is the time from the first key press operation to the second key press operation, is obtained, and if the obtained performance operation interval is greater than a reference value, the timbre of at least a part of the performance sound is changed. Based on a comparison between the performance interval and a first reference time, which is one of the reference values ​​and is the sum of the length of one beat and a predetermined proportion of the length of one beat, the timbre of at least some of the sounds included in the performance sound is changed. The greater the difference between the performance operation interval and the first reference time, the greater the difference in shape between the waveform data of the performance sound and the pre-set timbre waveform data, and at least a portion of the performance sound is output using waveform data. A program characterized by executing a process.

13. A computer that controls the output of a performance sound based on a plurality of performance information, including at least the timing of key operation and pitch information of the key, Based on the performance operation timings included in the multiple performance information, the performance operation interval, which is the time from the first key press operation to the second key press operation, is obtained, and if the obtained performance operation interval is greater than a reference value, the timbre of at least a part of the performance sound is changed. Based on a comparison between the timing of the key release operation after the key press operation, which is the performance operation timing, and a second reference time after the key press operation, it is determined whether the performance touch differs from the standard performance touch, and if it is determined that it differs, the timbre of the performance sound is changed. If the timing of the key release operation is outside the range of the second reference time, the tone is changed. A program characterized by executing a process.

14. A computer that controls the output of a performance sound based on a plurality of performance information, including at least the timing of key operation and pitch information of the key, Based on the performance operation timings included in the multiple performance information, the performance operation interval, which is the time from the first key press operation to the second key press operation, is obtained, and if the obtained performance operation interval is greater than a reference value, the timbre of at least a part of the performance sound is changed. Based on a comparison between the timing of releasing the key after pressing it (which is the performance operation timing) and a second reference time after pressing the key, it is determined whether the performance touch differs from the standard performance touch. If it is determined that it differs, the timbre of the performance sound, which is the timbre of plucking the strings near the bridge of the stringed instrument and the timbre of plucking the strings near the fingerboard of the stringed instrument, is changed by changing the shape of the waveform data of the stringed instrument. If the timing of the key release operation is before the lower limit of the second reference time range, the tone of the stringed instrument is changed to that of a string plucked closer to the fingerboard; if the timing of the key release operation is after the upper limit of the second reference time range, the tone of the stringed instrument is changed to that of a string plucked closer to the bridge. A program characterized by executing a process.

Images