Musical sound information output device, musical sound information generating method and program

Abstract

To facilitate an operation for sound generation and an operation for control over effects.SOLUTION: A musical sound information output device includes: a sound generation information generation unit 13 which generates sound generation information E2 for generating a musical sound based upon a first key operation on any of a plurality of keys; and a control information generation unit 14 which generates control information E3 for controlling a mode of the musical sound generated based upon the first key operation based upon a second key operation different from the first key operation. The key includes a first region on a front side viewed from the operator and a second region excluding the first region, the first key operation is a keying operation on the first region of the key, and the second key operation is a pressing operation on the second region of the key.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to, for example, a musical sound information output device, a musical sound information generating method, and a program. [Background technology]

[0002] The following devices have been proposed as devices that generate musical tones using a keyboard and control the effects applied to the musical tones. For example, a technology has been proposed that detects the position of the user's (player's) fingers on the keyboard and controls the musical tones based on the detected position and movement (see Patent Document 1). Another technology has been proposed that changes the pitch of musical tones up or down by operating a wheel or other control provided separately from the keyboard (see Patent Document 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-256413 [Patent Document 2] Japanese Patent Application Publication No. 05-94182 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology described in Patent Document 1 requires the provision of a camera and image processing to detect the position of the user's fingers, resulting in a large-scale configuration for the entire device. Also, with the technology described in Patent Document 2, the position for operating the keys to generate musical tones and the position for operating the controls to control effects are separated, which can make it difficult for the user to distinguish between the operations for generating sounds and the operations for controlling effects. In consideration of the above circumstances, an object of the present disclosure is to provide a technology that makes it easy to control sound production and effects with a simple configuration. [Means for solving the problem]

[0005] In order to achieve the above object, a musical sound information output device according to one embodiment of the present disclosure includes a plurality of keys, a pronunciation information generation unit that generates pronunciation information for generating a musical sound based on a first key operation on any one of the plurality of keys, and a control information generation unit that generates control information for controlling the manner in which the musical sound is generated based on the first key operation based on a second key operation different from the first key operation.

[0006] A musical sound generating device according to one embodiment of the present disclosure includes a plurality of keys, a pronunciation information generating unit that generates pronunciation information for generating a musical sound based on a first key operation on any one of the plurality of keys, a control information generating unit that generates control information that controls the manner of the musical sound generated based on the first key operation based on a second key operation different from the first key operation, and a musical sound generating unit that generates a musical sound based on the pronunciation information and the control information.

[0007] A musical sound information generating method according to one embodiment of the present disclosure generates musical sound pronunciation information based on a first key operation on one of a plurality of keys, and generates control information that controls the manner in which the musical sound is generated based on the first key operation based on a second key operation that is different from the first key operation.

[0008] A program according to one embodiment of the present disclosure causes a computer to function as a pronunciation information generation unit that generates pronunciation information for a musical tone based on a first key operation on any one of a plurality of keys, and as a control information generation unit that generates control information that controls the manner in which the musical tone is generated based on the first key operation based on a second key operation that is different from the first key operation. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram showing the configuration of a musical sound generating device according to a first embodiment. [Figure 2] FIG. 2 is a functional block diagram of a control device in the musical sound generating device. [Figure 3]FIG. 2 is a diagram showing an example of a keyboard displayed on the musical sound generating device. [Figure 4] 10A and 10B are diagrams illustrating an example of key operations in a musical sound generating device. [Figure 5] 10A and 10B are diagrams illustrating an example of key operations in a musical sound generating device. [Figure 6] 10A and 10B are diagrams illustrating an example of key operations in a musical sound generating device. [Figure 7] 3 is a flowchart showing the operation of the musical sound generating device. [Figure 8] 3 is a flowchart showing the operation of the musical sound generating device. [Figure 9] FIG. 10 is a diagram showing a musical sound signal generating section in a musical sound generating device according to a second embodiment. [Figure 10] 3 is a flowchart showing the operation of the musical sound generating device. [Figure 11] 10A and 10B are diagrams illustrating an example of key operations in a musical sound generating device. [Figure 12] 10A and 10B are diagrams illustrating an example of key operations in a musical sound generating device. [Figure 13] 10A and 10B are diagrams illustrating an example of key operations in a musical sound generating device. [Figure 14] FIG. 10 is a diagram illustrating an example of division of detection areas in a key. DETAILED DESCRIPTION OF THE INVENTION

[0010] First Embodiment 1 is a diagram showing an example of a musical sound generating device 1 according to the first embodiment. The musical sound generating device 1 generates musical sounds in response to key operations by a user U, and controls the effects to be imparted to the musical sounds in response to key operations different from the above key operations. The musical sound generating device 1 is realized by a computer system including a control device 102, a storage device 104, a keyboard device 110, an interface (IF) 120, and a sound emitting device 150. The musical sound generating device 1 is, for example, an information terminal such as a smartphone or a tablet-type personal computer. The elements of the musical sound generating device 1 are connected to each other via a single bus or multiple buses.

[0011] The control device 10 is configured by one or more processing circuits such as a CPU (Central Processing Unit), and controls each element in the musical sound generating device 1. The storage device 104 is one or more memories configured with known storage media such as magnetic storage media or semiconductor storage media. The storage device 104 stores programs executed by the control device 10 and various data used by the control device 10. The storage device 104 may be configured with a combination of multiple types of storage media. The storage device 104 may also be a portable storage medium that is detachable from the musical sound generating device 1, or an external storage medium (e.g., online storage) that can communicate with the musical sound generating device 1 via a communication network (not shown).

[0012] The keyboard device 110 is a touch screen that combines a display device 112 and a detection device 114. Specifically, the display device 112 is a liquid crystal display panel or the like, and the detection device 114 is provided on the screen surface of the display device 112, detects the positions of two or more operations by the user U, and outputs position information D1 of the operated positions. In other words, in the musical sound generating device 1, when the user U operates the keys of the keyboard device displayed on the display device 112, musical sounds corresponding to the operation of the keys are generated. The musical sounds generated by the musical sound generating device 1 are not limited to those of keyboard instruments such as piano and organ, but can also produce the tones of various instruments such as guitar and trumpet, and can also be imparted with various effects as will be described later. For this reason, on the display device 112 on which the keyboard device 110 is displayed during performance, various switches and the like are displayed in a setting mode before performance, and the user U can set the tones of the musical sounds, the types of effects to be imparted, and the like.

[0013] An interface (I / F) 120 is used to communicate with external devices, such as MIDI devices, online storages connected via the above-mentioned communication network, and servers. The sound emitting device 150 is a speaker or a headphone that converts the musical sound signal A2 generated by the control device 10 into sound. In practice, the musical sound signal A2 is converted into sound by the sound emitting device 150 after being converted into analog by a D / A converter (not shown) and amplified by an amplifier. The sound emitting device 150 may be provided as a device separate from the musical sound generating device 1.

[0014] 2 is a diagram showing a functional configuration realized by the control device 10 executing a program stored in the storage device 104. The control device 10 includes a display control unit 11, a determination unit 12, a sound generation information generation unit 13, a control information generation unit 14, and a musical sound signal generation unit 15.

[0015] The display control unit 11 controls the display content of the display device 112 . Specifically, the display control unit 11 displays a keyboard on the display device 112 during performance, and when a key on the keyboard is operated, displays it as if the key has been pressed in response to the operation, for example. Furthermore, before performance, the display control unit 11 displays switches for various settings on the display device 112.

[0016] When playing, the judgment unit 12 compares the position of the operation indicated by the position information D1 with the keyboard displayed on the display device 112 by the display control unit 11, determines which part of the displayed keyboard has been operated, and controls the sound generation information generation unit 13 and the control information generation unit 14 according to the judgment result. For convenience, the keyboard displayed on the display device 112 will be described.

[0017] 3 is a diagram showing a portion of the keyboard device 110 displayed on the display device 112. The keyboard device 110 has a plurality of keys. To detect the operation of each key on the keyboard device 110, the detection area is divided into two as follows. In detail, the detection area for the white keys is divided into a first area Wa on the tip side of the key (the side of the user U, the lower side in the figure) and a second area Wb on the base side of the key (the upper side in the figure). Similarly, the detection area for the black keys is divided into a first area Ba on the front side of the key and a second area Bb on the base side of the key.

[0018] Touching the first area Wa as a key operation specifies the sound to be produced by the touched white key. Touching the second area Wb of the white key specifies the application of an effect to the sound, and sliding in the second area Wb specifies the control of the effect. Note that sliding refers to moving the touch position while continuing to touch. Therefore, sliding is an operation that increases or decreases the value of the effect parameter that defines the content of the effect according to the touch position. The same applies to the black keys: touching the first area Ba specifies the sound to be produced for that black key, touching the second area Bb specifies the application of an effect to that sound, and sliding into the second area Bb specifies the control of that effect. In addition, a release as a key operation to release the touch on the first area Wa or Ba for a certain key specifies muting of the sound for that key, and a release from the second area Wb or Bb for a certain key specifies the cessation of applying an effect to the sound produced by that key.

[0019] To explain in more detail the generation of sounds and the application of effects through key operation, in the musical sound generating device 1, for example, as shown in Figure 4, touching the first area Wa of key E on the keyboard device 110 specifies the generation of sounds corresponding to key E. 5, while the first area Wa of a key E is being touched, touching the second area Wb of the key E specifies that the effect set in the setting mode is to be applied to the pronunciation of the key E. In the example shown in the figure, the first area Wa of the key E is touched with the fingers of the left hand, and the second area Wb is touched with the fingers of the right hand, but different fingers on either the left or right hand may touch simultaneously. As shown in FIG. 6, a slide in the second area Wb of the key E specifies an increase or decrease in a parameter depending on the direction of change of the slide and the touch position.

[0020] Although the key operation for the white keys has been described with reference to FIGS. 4 to 6, the key operation for the black keys is similar. Furthermore, since the keys displayed on the display device 112 cannot be physically pressed, the key operation referred to here as the operation of specifying sound generation is performed by touching the keys. However, the keyboard device 110 applied to the musical sound generating device 1 is not limited to display by the display device 112, as will be described later.

[0021] 2, if the determination unit 12 determines that the position of the operation indicated by the position information D1 has occurred in the first area Wa or Ba, it controls the sound information generation unit 13. On the other hand, if the determination unit 12 determines that the position of the operation indicated by the position information D1 has occurred in the second area Wb or Bb, it controls the control information generation unit 14.

[0022] The sound information generating unit 13 outputs sound information E2 required to generate or mute a sound corresponding to the operated key. Note that mute is one mode of sound generation, and is therefore included in sound generation. The sound generation information E2 includes, if sound generation is specified, note-on information indicating that a key is touched to generate a sound, note number information indicating the pitch of the key, and velocity information indicating the volume of the sound. If sound generation is specified, the sound generation information E2 includes note-off information and note number information.

[0023] In a typical keyboard device where the keys physically oscillate, it is possible to output velocity information that reflects the key pressing speed, but since the keys displayed on the display device 112 cannot be physically pressed, the velocity information output is the value set in the setting mode. Note that if the keyboard device is capable of detecting the key pressing speed, it may output velocity information that reflects the detected key pressing speed.

[0024] The control information generating unit 14 outputs control information E3 for imparting an effect according to a touch or a slide, which is a continuation of a touch. For example, if the effect is pitch bend, which changes the pitch after sounding, the control information E3 will be a value that specifies the amount of pitch change. If the effect is mute, which reduces the volume after sounding, the control information E3 will be a value that specifies the change (slope) in the mute direction. If the effect is distortion, which distorts the sound after sounding, the control information E3 will be a value that specifies the amount of distortion. In this way, the control information E3 will be a value that depends on the type of effect. Furthermore, the control information E3 changes over time according to the slide.

[0025] The musical sound signal generating unit 15 generates musical sounds based on the sound generation information E2, and generates a musical sound signal A2 by adding an effect to the musical sound based on the sound generation information E2. The musical sound signal A2 is digital data that specifies the waveform of the musical sound in a time series.

[0026] The sound generation information E2 and the control information E3 may be supplied to an external device via the interface 120, and musical sounds may be generated by the external device. When musical sounds are generated by an external device, the musical sound signal generating unit 15 and the sound emitting device 150 do not need to be provided in the musical sound generating device 1. In this case, the musical sound generating device 1 functions as a musical sound information output device that outputs the sound generation information E2 and the control information E3.

[0027] Next, the operation of the musical sound generating device 1 will be described. 7 is a flowchart showing the processing of an event such as a key press in the musical sound generating device 1. An event such as a key press means that the user U touches any one of the multiple keys on the keyboard device 110. When an event such as a key press occurs, the determination unit 12 determines whether or not the touch related to the event occurred in the first area Wa or Ba (step Sa11). If the touch occurs in the first area Wa or Ba (if the determination result of step Sa11 is "Yes"), the touch indicates a sound generation specification. Therefore, the determination unit 12 controls the sound generation information generation unit 13, and in accordance with this control, the sound generation information generation unit 13 outputs sound generation information E2 necessary for generating sound corresponding to the touched key (step Sa12). As a result, the musical sound signal generation unit 15 generates a musical sound signal A2 based on the sound generation information E2, and sound generation based on the musical sound signal A2 is performed by the sound emitting device 150 (or an external device).

[0028] After step Sa12, or if it is determined that the touch has not occurred in the first area Wa, Ba (if the determination result of step Sa11 is "No"), the determination unit 12 determines whether the touch has occurred or is ongoing in the second area Wb or Bb (step Sa13). Note that sliding is a state in which touching is continuous in time, and is therefore included in the touch here.

[0029] If a touch occurs in the second area Wb or Bb, or if the touch is pending (the determination result of step Sa13 is "Yes"), the touch is a designation for applying an effect or a designation for changing an effect parameter. Therefore, the determination unit 12 controls the control information generation unit 14, and the control information generation unit 14 outputs control information E3 for applying an effect in accordance with the control (step Sa14). Specifically, the control information generation unit 14 outputs, as control information E3, an initial value of the effect parameter if the touch is a first touch, and outputs a value of the effect parameter according to the touch position if the touch is a slide. Note that the "first touch" here refers to the first touch in time, regardless of whether it is a slide. Furthermore, if the touch position has not changed from the position at the previous time step Sa14 was executed, the value of the effect parameter is not changed. As a result, the musical sound signal generating unit 15 imparts an effect based on the control information E3 to the musical sound signal A2. Therefore, an effect according to the touch in the second region Wb or Bb is imparted to the musical sound generated by the sound emitting device 150 (or an external device).

[0030] After step Sa14, the process returns to step Sa13. Therefore, if a touch is still present in the second region Wb or Bb and the position of the touch has moved, the value of the effect parameter is changed according to the touch position after the movement. When the touch on the second area Wb or Bb ends (when the determination result in step Sa13 is "No"), the processing of the event such as a key press ends.

[0031] In this key press event, if a touch occurs in the first area Wa, Ba, a musical tone corresponding to the touched key is generated, if a touch occurs in the second area Wb, Bb, a preset effect is imparted to the musical tone corresponding to the touched key, and if the touch position in the second area Wb, Bb moves (slides), the effect parameter increases or decreases according to the slide by cycling through steps Sa13 and Sa14.

[0032] 8 is a flowchart showing the processing of an event such as a key release in the musical sound generating device 1. An event such as a key release means that the user U releases any of the keys that have been touched on the keyboard device 110. When an event such as a key release occurs, the determination unit 12 determines whether the release associated with the event occurs in the second region Wb or Bb (step Sa31). If the release occurs in the second region Wb or Bb (the determination result in step Sa31 is "Yes"), the release designates the end of effect application. Therefore, the determination unit 12 instructs the control information generation unit 14 to stop outputting the control information E3 (step Sa32). This causes the musical sound signal generation unit 15 to stop applying the effect based on the control information E3.

[0033] After step Sa32, or if it is determined that the release did not occur in the second region Wb or Bb (if the determination result of step Sa31 is "No"), the determination unit 12 determines whether the release occurred in the first region Wa or Ba (step Sa33).

[0034] If the release occurs in the first area Wa or Ba (the determination result in step Sa33 is "Yes"), the release is a specification for muting. Therefore, the determination unit 12 controls the sound generation information generation unit 13, and in accordance with this control, the sound generation information generation unit 13 outputs sound generation information E2 necessary for muting the sound corresponding to the released key (step Sa34). As a result, the musical sound signal generation unit 15 executes muting based on the sound generation information E2, and the musical sound of the key that was touched up until then is muted.

[0035] After step Sa34, or if it is determined that the release has not occurred in the first area Wa, Ba (if the determination result in step Sa33 is "No"), the processing of the event such as key release ends.

[0036] If a release occurs in the second area Wb, Bb due to this key release or other event, the generation of musical tones continues with the application of the effect stopped, and if a release occurs in the first area Wa, Ba, the generation of musical tones corresponding to the key that has been touched up until then stops regardless of the application of the effect.

[0037] According to the musical sound generating device 1 of the first embodiment, the position where the keyboard device 110 is operated to generate sound and the position where the effect applied to the sound are controlled are closer than in a configuration where separate controls are provided for the keyboard device, which makes it easier for the user to control the sound generation and effects. Furthermore, the musical sound generating device 1 according to the first embodiment does not require any element for detecting the position of the fingers of the user U apart from the keyboard device 110, so the entire device does not become complicated.

[0038] Second Embodiment The musical sound generating device 1 according to the first embodiment applies effects to musical sounds generated by touching the first areas Wa and Ba, and changes the musical sounds by touching the second areas Wb and Bb, etc. In short, in the musical sound generating device 1 according to the first embodiment, touching the first areas Wa and Ba comes first in time, and touching the second areas Wb and Bb, etc. comes later in time. In the musical sound generating device 1 according to the second embodiment, the touches on the second areas Wb and Bb come first in time, and the touches on the first areas Wa and Ba come later in time.

[0039] The musical sound generating device 1 according to the second embodiment differs from that of the first embodiment in the musical sound signal generating section 15 constructed in the control device 10. Therefore, in the second embodiment, the musical sound signal generating section 15 will be mainly described.

[0040] In the second embodiment, it is assumed that guitar is selected as the tone color of the musical tones to be generated. In the second embodiment, when the second areas Wb and Bb of a certain key are touched and then the first areas Wa and Ba of the same key are touched, musical tones for hammering are generated at the pitch of the key, while when the first areas Wa and Ba of the same key are touched without touching the second areas Wb and Bb of the same key, musical tones for picking are generated at the pitch of the key. Here, hammering is a technique in which a musical tone is produced by striking the strings with only the force of the fingers without using a pick, and picking (pick) is a technique in which a musical tone is produced by plucking the strings with a pick. There is a clear difference between the musical tones produced by hammering and picking. In the second embodiment, although the guitar sounds have the same tone, the musical tones produced by either of the two techniques can be produced depending on how the keys are operated.

[0041] FIG. 9 is a diagram showing functional blocks of the musical sound signal generating section 15 according to the second embodiment. When the control device 10 executes the program stored in the storage device 104, the musical tone signal generating section 15 is configured with a waveform storage section M1, a readout section M2, and a pitch conversion section M3.

[0042] The waveform storage unit M1 stores waveform data Hmw generated by hammering and waveform data Pcw generated by picking. The waveform data Hmw is, for example, data obtained by sampling at least one cycle of a guitar sound generated by hammering, and the waveform data Pcw is data obtained by sampling at least one cycle of a guitar sound generated by picking. When guitar is selected as the tone color, the waveform data Hmw and Pcw are loaded from the storage device 104, for example.

[0043] The reading unit M2 selects either the waveform data Hmw or Pcw based on the sound generation information E2 and the control information E3, and repeatedly reads out the selected waveform data. The pitch conversion section M3 converts the pitch of either the read waveform data Hmw or Pcw in accordance with the note number information contained in the sound generation information E2, and outputs the converted pitch as a musical tone signal A2.

[0044] FIG. 10 is a flowchart showing the processing of an event such as a key press in the musical sound generating device 1 according to the second embodiment. When an event such as a key press occurs, the judgment unit 12 (see Figure 2) judges whether the touch related to the event occurred in the first area Wa or Ba without the touch continuing in the second area Wb or Bb (step Sb11). If the result of this determination is "Yes," the touch indicates that the sound is to be generated by picking. Therefore, the determination unit 12 controls the control information generation unit 14, which then outputs a notice of the picking technique as control information E3 (step Sb12). As a result, in the musical tone signal generation unit 15, the readout unit M2 determines to read out the waveform data Pcw from the waveform storage unit M1. The process of actually outputting the musical tone signal A2 is executed in step Sb13, which will be described later.

[0045] On the other hand, if the judgment result of step Sb11 is "No", the touch is either a touch only in the second area Wb or Bb, or a touch in the first area Wa or Ba while the touch continues in the second area Wb or Bb. Therefore, the determination unit 12 first determines whether or not the touch related to the event is a touch only in the second region Wb or Bb (step Sb14).

[0046] If the determination result of step Sb14 is "Yes," the touch is a warning of a sound to be generated by hammering. Therefore, the determination unit 12 controls the control information generation unit 14, and in accordance with this control, the control information generation unit 14 outputs the warning of the hammering as control information E3 (step Sb15). As a result, in the musical tone signal generation unit 15, the reading unit M2 determines to read waveform data Pcw from the waveform storage unit M1.

[0047] If the determination result of step Sb14 is "No," the touch is a touch on the first area Wa or Ba while a touch on the second area Wb or Bb is continued, i.e., a sound is generated by hammering. Therefore, the processing procedure skips to step Sb13, which is the sound generation processing. Note that if the determination result of step Sb14 is "No," it has already been determined by the reading unit M2 in step Sb15 of the processing of the previous key press event, that the waveform data Pcw will be read.

[0048] After step Sb12, or if the determination result of step Sb14 is "No," the determination unit 12 controls the sound generation information generation unit 13, and in accordance with this control, the sound generation information generation unit 13 outputs as E2 the sound generation information required for sound generation corresponding to the key touched in the first area Wa, Ba (step Sb13). As a result, in the musical sound signal generation unit 15, the reading unit M2 reads out the determined waveform data, and the pitch conversion unit M3 converts the read waveform data to a pitch corresponding to the note number information included in the sound generation information E2, and outputs it as a musical sound signal A2. Sound generation based on this musical sound signal A2 is performed by the sound emitting device 150 (or an external device).

[0049] After step Sb13 or Sb15, the processing of the key press or other event is completed.

[0050] In the second embodiment, if a touch on a certain key occurs only in the second region Wb or Bb, it is considered to be a notice of a hammer-on technique, and a decision is made to read out waveform data Hmw, and processing of the key press or other event is temporarily terminated.

[0051] On the other hand, when a touch to a certain key occurs in the first area Wa or Ba, if there is no touch to the second area Wb or Bb, a sound is produced by picking (steps Sb12, Sb13). Furthermore, if a key is touched in the first area Wa or Ba while the second area Wb or Bb is still being touched, the sound will be generated using the hammer-on technique determined in the previous execution. That is, steps Sb14 and Sb15 are processed for the first key press event, and steps Sb14 and Sb14 are processed for the second key press event.

[0052] In the second embodiment, detailed description of events such as key release will be omitted, but if the key is released from the first area Wa or Ba, this is an operation that specifies the end of sound production, and the determination unit 12 causes the sound production information generation unit 13 to output note-off information. This ends the sound production in step Sb15. Furthermore, if the key is released from the second area Wb or Bb without touching the first area Wa or Ba, the hammer-on playing style may be switched to a picking style as a notice cancellation, or the hammer-on playing style may be continued without being cancelled.

[0053] According to the second embodiment, it is possible to switch between generating musical tones by picking and generating musical tones by hammering by operating the keys on the keyboard device 110. In the musical sound generating device 1 of the second embodiment, the position where the key is operated to produce sound on the keyboard device 110 and the position where the key is operated to specify switching of musical sounds based on the playing style are closer together compared to a configuration in which separate operators are provided, making it easier for the user to produce sound and switch of musical sounds based on the playing style.

[0054] In the second embodiment, musical tones are generated by switching between two playing styles, but as will be described later, three or more musical tones may be generated by switching between them by dividing the second area into two or more areas. For example, if the number of operations in the second area is "1," first waveform data may be used, if the number of operations is "2," second waveform data may be used, and if the number of operations in the third area is "3," third waveform data may be used.

[0055] Furthermore, although switching of playing styles is determined by whether or not the second area is touched, other methods may also be used. For example, when switching from one pitch to another, a note may be sounded by operating the tip end of the key of the one pitch, and while the first pitch is sounded, the key of the target pitch may be operated to change the pitch. In this case, touching the base end of the key of the target pitch and operating the tip end may change the pitch in stages, while touching the base end of the key of the initial sound and the base end of the key of the target pitch simultaneously and operating the tip end may change the pitch continuously without steps.

[0056] <Modification> The timbres and effects are not limited to those described in the embodiment. Effect control may be selected for each type of instrument, such as a wind instrument or a string instrument, or for each group. Alternatively, effect control may be selected in common for all selectable timbres. In other words, the relationship between timbre and effect control is arbitrary.

[0057] If the detection device 114 can detect, in addition to the touch position, for example, the pressure at the touch position, the value of the effect parameter may be increased or decreased in accordance with the pressure, instead of or in addition to sliding the touch position in the second areas Wb and Bb. For example, as shown in Fig. 11, when the pressure in the second area Wb of key E is small, the effect parameter may be decreased, and when the pressure in the second area Wb of key E is large, as shown in Fig. 12, the effect parameter may be increased. Furthermore, the slide and the pressure amount may be weighted to increase or decrease the value of the effect parameter, or separate effect parameters may be assigned to the slide and the pressure amount to increase or decrease them. In addition, in FIGS. 11 and 12, the magnitude of the pressure is indicated by the size of the black circle.

[0058] Furthermore, if the detection device 114 detects the pressure in addition to the touch position, the operation on the first area Wa, Ba may also be detected as the key press timing, for example, when the pressure exceeds a threshold value, or the pressure threshold value divided by the time from the first touch to the key press timing may be taken as the key press speed and reflected in the velocity information.

[0059] In order to detect the pressure as well as the touch position, various methods can be adopted, such as using an electrostatic type for the touch screen detection device 114, or arranging one or more pressure-sensitive switches in each of the second areas Wb and Bb of the keyboard device where keys can actually be pressed, or providing an electrostatic sensor or pressure sensor whose detection range is the second areas Wb and Bb.

[0060] A keyboard having a so-called pantograph-type lifting structure, in which not only the tip but also the base of the key is pressed, may be used, with pressing the tip side of the key being used to produce sound and pressing the base side being used to control effects, etc. As long as it is possible to distinguish between operations at the tip and base of the keys, various methods can be used for the keyboard device.

[0061] Also, keys that specify sound generation and keys that specify and control effects may be separated into different regions. For example, as shown in Fig. 13, a key region on the lower frequency side may be assigned to sound generation, and a key region on the higher frequency side may be assigned to effect control. The multiple keys on the higher frequency side that are assigned to effect control may be assigned to specify different effects, or may be assigned different degrees of the same effect. In the example shown in the figure, when the low-frequency key E is operated, the sound corresponding to that key E is produced, while when the high-frequency key D is operated, the effect assigned to that key D is applied. Furthermore, when the keys that specify the tone generation and the keys that specify and control the effect are separated into different regions, a key region outside the tone generation band of the instrument that produces the tone may be assigned to the control of the effect generation.

[0062] The second area may be further divided into two or more areas. For example, as shown in Fig. 14, the second area of the white keys may be divided into two areas, Wb on the tip side and Wc on the base side, and the second area of the black keys may be divided into two areas, Bb on the tip side and Bc on the base side. When divided into two, different effects may be assigned to them. For example, pitch bend may be assigned to the second region Wb, Bb on the tip side, and mute may be assigned to the second region Wc, Bc on the base side.

[0063] In the above-described embodiment, an example of controlling the mode of single-note sound generation has been shown, but multiple sounds may also be generated. Specifically, a sound generation channel may be sequentially assigned each time a key is pressed, and a musical tone may be generated, and the assigned sound generation channel may be released each time a key is released.

[0064] It may also be used to control the sounding style of automatic accompaniment. For example, when specifying chords with a single finger, touching the base of a key may switch the playing style to produce accompaniment notes using a special playing technique, or touching the base of a key while an accompaniment is being played may provide a mute effect.

[0065] In the above-described embodiment, the sound generation information generating unit and the control information generating unit operate separately, but different musical tones may be generated (sounds may be overlapped) depending on the area operated. For example, if the tone is a guitar, fred noise may be generated in response to an operation in the first area, and the actual guitar sound may be generated in response to an operation in the second area. Also, if the tone is a flute, jet noise may be generated in response to an operation in the first area, and the actual flute sound may be generated in response to an operation in the second area.

[0066] <Additional Notes> From the above-described embodiments, the following aspects can be understood, for example.

[0067] A musical sound information output device according to an aspect (first aspect) of the present disclosure includes a plurality of keys, a pronunciation information generation unit that generates pronunciation information for generating a musical sound based on a first key operation on any one of the plurality of keys, and a control information generation unit that generates control information for controlling the aspect of the musical sound generated based on the first key operation based on a second key operation different from the first key operation. According to the first aspect, the position of the first key operation for generating a musical tone and the position of the second key operation for controlling the aspect of the generated musical tone are within the range of multiple keys and are closer than in a configuration in which separate operators are provided for controlling the aspect of the musical tone, which makes it easier for the user to perform operations for generating a musical tone and for controlling the aspect of the musical tone. Controlling the aspect of a musical tone typically involves adding effects to the tone, but also includes changing the type of tone, for example, the data required to generate the tone. Controlling the aspect of a generated tone can be done in two ways: changing the tone that has already been generated after the fact, or changing the aspect of a tone that will be generated in response to a second key operation. The second key operation, which is different from the first key operation, can be either an operation on the same key as the first key operation but at a different position, or an operation on a key different from the first key operation. The order in which the first key operation and the second key operation occur does not matter. The operation order of the sound generation unit and the control information generation unit is not important.

[0068] In the example of the first aspect (second aspect), the second key operation is an operation in which the amount of operation on the key changes over time after the first key operation, and the control information generator generates control information in accordance with the change in the amount of operation. According to this aspect, the aspect of the musical sound is controlled in accordance with the operation in which the amount of operation changes over time, making it easy for the user to control the aspect of the musical sound. The amount of operation of a key refers to the relative or absolute operation position of the key, the stroke amount of the key press, the pressing force, and the like.

[0069] In an example of the first aspect (third aspect), the key includes a first area in front of the operator and a second area excluding the first area, the first key operation is a key pressing operation on the first area of the key, and the second key operation is an operation on the second area of the key. According to this aspect, since the second key operation is an operation on the same key as the first key operation, the operation for producing sound and the operation for controlling the aspect of the musical tone may be easier than in the first aspect. Note that the key pressing operation includes not only an operation in which the user actually presses a key, but also an operation in which the user pretends to press a key displayed on a screen.

[0070] In an example of the first aspect (fourth aspect), the second key operation is an operation in which the amount of operation in the second area changes over time, and the control information generation unit generates control information for the aspect of the musical sound based on the first key operation in accordance with the change in the second area. According to this aspect, the second key operation is an operation on the same key as the first key operation, Since the key is in the second region, the operation for producing sound and the operation for controlling the aspect of the musical tone may be easier than in the first aspect.

[0071] In an example of the first aspect (fifth aspect), the key on which the second key operation is performed is different from the key on which the first key operation is performed, and the control information generator generates control information in response to the second key operation. According to this aspect, the key on which the first key operation is performed and the key on which the second key operation is performed are different. Therefore, a user can distinguish between operating a key for generating a musical tone and a key for controlling the aspect of the musical tone.

[0072] A musical sound generation device according to a sixth aspect of the present disclosure includes: a sound generation information generation unit that generates sound generation information for generating a musical sound based on a first key operation on any one of a plurality of keys; a control information generation unit that generates control information for controlling the aspect of the musical sound generated based on the first key operation based on a second key operation different from the first key operation; and a musical sound signal generation unit that generates a musical sound signal based on the sound generation information and the control information. According to the sixth aspect, similar to the first aspect, operations for generating sound and controlling the aspect of the musical sound are easy for the user.

[0073] In an example of the sixth aspect (seventh aspect), when the first key operation is performed after the second key operation, the musical sound signal generating unit generates a musical sound signal based on the first key operation based on first waveform data, and when the first key operation is performed without the second key operation, the musical sound signal generating unit generates a musical sound signal based on the first key operation based on second waveform data different from the first waveform data. According to this aspect, it is possible to make the musical tone signal based on the first key operation and the second key operation different from the musical tone signal based on only the first key operation.

[0074] The musical sound information output device of each of the above-mentioned exemplary embodiments can be realized as a musical sound information output method or a program that causes a computer to execute the musical sound information output device. Similarly, the musical sound generating device can be realized as a musical sound generating method or a program that causes a computer to execute the musical sound generating device. In the method, the temporal precedence of the generation of the pronunciation information and the generation of the control information does not matter, and in the program, the order in which the pronunciation information generation unit and the control information generation unit function does not matter. [Explanation of symbols]

[0075] 1...musical sound generating device, 10...control device, 13...sound generation information generating section, 14...control information generating section, 15...musical sound signal generating section, 104...storage device, 110...keyboard device.

Claims

1. Multiple keys and a sound generation information generating unit that generates sound generation information including note-on information for generating a musical tone based on a first key operation on any one of the plurality of keys; a control information generating unit that generates control information for controlling the manner of the musical tones generated based on the first key operation based on a second key operation different from the first key operation; Including, The key is divided into a first area in front of the operator and a second area excluding the first area, the first key operation is a key press operation on the first area of the key, The second key operation is a pressing operation on the second area of the key. Musical sound information output device.

2. The pressing operation is acquired by an acquisition unit for acquiring a pressing amount of the second region of the key based on a second key operation different from the first key operation.

2. The musical sound information output device according to claim 1.

3. the second key operation is an operation in which the pressing amount changes over time after the first key operation, The control information generating unit generates control information in response to a change in the amount of pressure.

3. The musical sound information output device according to claim 2.

4. The control information generation unit generating control information for controlling the aspect of the musical tone based on the first key operation in accordance with the change; 4. The musical sound information output device according to claim 3.

5. The key on which the second key operation is performed is different from the key on which the first key operation is performed, The control information generation unit generating control information in response to the second key operation; 3. The musical sound information output device according to claim 1.

6. generating sound generation information including note-on information for generating a musical tone based on a first key operation on any one of the plurality of keys; generating control information for controlling the manner of the musical tones generated based on the first key operation based on a second key operation different from the first key operation; The key is divided into a first area in front of the operator and a second area excluding the first area, the first key operation is a key press operation on the first area of the key, The second key operation is a pressing operation on the second area of the key. Musical tone information generation method.

7. Computer, a sound generation information generating unit that generates sound generation information including note-on information for generating a musical tone based on a first key operation on any one of the plurality of keys; a control information generating section that generates control information for controlling the manner of the musical tone generated based on the first key operation based on a second key operation different from the first key operation; It functions as The key is divided into a first area in front of the operator and a second area excluding the first area, the first key operation is a key press operation on the first area of the key, The second key operation is a pressing operation on the second area of the key. program.

Images