Signal generation methods, signal generation systems, electronic musical instruments and programs

Abstract

Through simple processing, a variety of audio signals with different audio characteristics corresponding to the operations performed by the user are generated. The signal generation system (30) includes: a signal generation unit (72) that generates audio signals (V) corresponding to operations on multiple keys including a first key and a second key; and an action control unit (73) that controls the generation of audio signals (V) in accordance with a reference position when the second key is operated during the operation of the first key, the reference position being the position of the first key at the time of the operation of the second key.

Description

Technical Field

[0001] This invention relates to a technique for generating audio signals in response to operations performed by the user. Background Technology

[0002] Various techniques have been proposed for detecting the amount of operation, such as that of keys on keyboard instruments. For example, Patent Document 1 discloses a technique for detecting keys by using a strain gauge sensor that deforms upon key press. Patent Document 2 discloses a technique for detecting key position by utilizing changes in the magnetic field corresponding to key press / release.

[0003] Patent Document 1: Japanese Patent Application Publication No. 2021-56315

[0004] Patent Document 2: Japanese Patent Application Publication No. 2021-81615 Summary of the Invention

[0005] However, conventional techniques require the development of audio signals with diverse acoustic characteristics corresponding to operations performed on keypads or other operational devices. In view of the above, one objective of the present invention is to generate audio signals with diverse acoustic characteristics corresponding to operations performed by the user through simple processing.

[0006] To address the above-mentioned issues, one aspect of the present invention relates to a signal generation method that generates an audio signal corresponding to the operation of a plurality of keys including a first key and a second key. When the second key is operated during the operation of the first key, the generation of the audio signal is controlled in accordance with a reference position, which is the position of the first key at the time of the operation of the second key.

[0007] One aspect of the present invention relates to a signal generation system comprising: a signal generation unit that generates an audio signal corresponding to operation of a plurality of keys including a first key and a second key; and an action control unit that, when the second key is operated during the operation of the first key, controls the generation of the audio signal in accordance with a reference position, the reference position being the position of the first key at the time of the operation of the second key.

[0008] One aspect of the present invention relates to an electronic musical instrument comprising: a plurality of keys, including a first key and a second key; a detection system for detecting operations on each of the plurality of keys; and a signal generation system comprising: a signal generation unit for generating an acoustic signal corresponding to an operation on the plurality of keys; and an action control unit for controlling the generation of the acoustic signal in accordance with a reference position corresponding to the position of the first key at the time of the operation of the second key when the second key is operated.

[0009] One aspect of the present invention relates to a program that causes a computer system to function as follows: a signal generation unit that generates an audio signal corresponding to the operation of a plurality of keys including a first key and a second key; and an action control unit that, when the second key is operated during the operation of the first key, controls the generation of the audio signal in accordance with a reference position, the reference position being the position of the first key at the time of the operation of the second key. Attached Figure Description

[0010] Figure 1 This is a block diagram illustrating the structure of the keyboard musical instrument according to the first embodiment.

[0011] Figure 2 This is a block diagram illustrating the structure of the detection system and the signal generation system.

[0012] Figure 3 This is a circuit diagram illustrating the structure of a magnetic sensor.

[0013] Figure 4 This is a block diagram illustrating the functional structure of a signal generation system.

[0014] Figure 5 This is an explanatory diagram related to the position of each key.

[0015] Figure 6 This is an explanatory diagram of the operation of the signal generation unit during continuous operation.

[0016] Figure 7 This is an explanatory diagram relating to the relationship between the reference position and the time length of the transition interval.

[0017] Figure 8 This is a flowchart illustrating the detailed sequence of control processing.

[0018] Figure 9 This is an explanatory diagram of the waveform signal.

[0019] Figure 10 This is an explanatory diagram of the operation of the signal generation unit in the second embodiment.

[0020] Figure 11 This is an explanatory diagram of the operation of the signal generation unit in the third embodiment.

[0021] Figure 12 This is a flowchart illustrating the detailed sequence of control processes in the third embodiment.

[0022] Figure 13 This is an explanatory diagram of the operation of the signal generation unit in a modified example. Detailed Implementation

[0023] A: Implementation Method 1

[0024] Figure 1 This is a block diagram illustrating the structure of the electronic musical instrument 100 according to the first embodiment. The electronic musical instrument 100 is an instrument that outputs sound in response to playing by a user, and includes a keyboard 10, a detection system 20, a signal generation system 30, and a sound output device 40. Furthermore, the electronic musical instrument 100 can be implemented not only as a single device, but also as multiple devices configured separately from each other.

[0025] Keyboard 10 consists of N keys K[1] corresponding to different pitches P[n] (n=1~N).

[0026] K[N] is the structure (N is a natural number greater than 2). The N keys K[1] to K[N] consist of multiple white keys and multiple black keys, arranged in a predetermined direction. Each key K[n] is an operating element that moves in the plumb line corresponding to the operation performed by the user. The operation performed by the user includes pressing and releasing the keys.

[0027] The detection system 20 detects the user's operations on each key K[n]. The signal generation system 30 generates an audio signal V corresponding to the user's operations on each key K[n]. The audio signal V is a time signal representing the pitch P[n] of the sound corresponding to the key K[n] operated by the user.

[0028] The sound playback device 40 plays the sound represented by the audio signal V. The sound playback device 40 is, for example, a speaker or headphones. The sound playback device 40, which is separate from the electronic musical instrument 100, can be connected to the electronic musical instrument 100 via wired or wireless means. In addition, for convenience, the illustrations of the D / A converter that converts the audio signal V from digital to analog and the amplifier that amplifies the audio signal V are omitted.

[0029] Figure 2This is a block diagram illustrating the structure of the detection system 20 and the signal generation system 30. The detection system 20 has N magnetic sensors 21 corresponding to different keys K[n] and a drive circuit 22 that controls each of the multiple magnetic sensors 21. The magnetic sensor 21 corresponding to any one key K[n] is a sensor that detects the position Z[n] of that key K[n] in the plumb line direction. Each of the N magnetic sensors 21 has a detection circuit 50 and a detected part 60. That is, the set of detection circuit 50 and detected part 60 is provided for each key K[n].

[0030] A detection unit 60 corresponding to each key K[n] is provided at that key K[n]. Therefore, the detection unit 60 moves in the plumb line direction in conjunction with the user's operation on the key K[n]. On the other hand, the detection circuit 50 is provided in the frame of the electronic musical instrument 100. That is, the position of the detection circuit 50 is not linked to the user's operation on the key K[n]. Therefore, the distance between the detection circuit 50 and the detection unit 60 changes in conjunction with the user's operation on the key K[n].

[0031] Figure 3 This is a circuit diagram illustrating the structure of the detection circuit 50 and the detected part 60. The detection circuit 50 is a resonant circuit including an input terminal 51, an output terminal 52, a resistive element 53, a coil 54, a capacitive element 55, and a capacitive element 56. One end of the resistive element 53 is connected to the input terminal 51, and the other end of the resistive element 53 is connected to one end of the capacitive element 55 and one end of the coil 54. The other end of the coil 54 is connected to the output terminal 52 and one end of the capacitive element 56. The other ends of the capacitive elements 55 and 56 are grounded.

[0032] The detection unit 60 is a resonant circuit comprising a coil 61 and a capacitor element 62. Specifically, the two ends of the capacitor element 62 and the two ends of the coil 61 are connected to each other. The resonant frequency of the detection circuit 50 and the resonant frequency of the detection unit 60 are the same. However, the resonant frequency of the detection circuit 50 and the resonant frequency of the detection unit 60 may also be different.

[0033] Coils 54 and 61, corresponding to any one key K[n], are spaced apart from each other in the plumb direction. Therefore, the distance between coils 54 and 61 varies corresponding to the user's operation on each key K[n]. Specifically, the distance between coils 54 and 61 decreases due to the user pressing a key and increases due to the user releasing a key.

[0034] Figure 2The drive circuit 22 supplies a reference signal R to each of the multiple detection circuits 50. Specifically, the drive circuit 22 supplies the reference signal R to each detection circuit 50 in a time-division manner. The reference signal R is a periodic signal whose level changes at a predetermined frequency. The reference signal R is supplied to the input terminal 51 of each detection circuit 50. The frequency of the reference signal R is, for example, set to the resonant frequency of the detection circuit 50 or the detected unit 60.

[0035] According to Figure 3 As understood, a reference signal R is supplied to coil 54 via input terminal 51 and resistor element 53. A magnetic field is generated in coil 54 by the supply of the reference signal R. Due to electromagnetic induction caused by the magnetic field generated in coil 54, an induced current is generated in coil 61 of the detection unit 60. The magnetic field generated in coil 61 varies correspondingly to the distance between coil 54 and coil 61. Therefore, a detection signal d with an amplitude δ corresponding to the distance between coil 54 and coil 61 is output from output terminal 52 of the detection circuit 50. That is, the amplitude δ of the detection signal d varies correspondingly to the position Z[n] of each key K[n] in the plumb direction.

[0036] Figure 2 The drive circuit 22 generates a detection signal D based on the detection signal d output by each detection circuit 50. The detection signal D is a signal that is sequentially set to a level corresponding to the amplitude δ of each detection signal d. As mentioned earlier, the amplitude δ changes in relation to the position Z[n] of each key K[n]. Therefore, the detection signal D is a signal representing the position Z[n] of the plumb line direction associated with each of the N keys K[1] to K[N]. The position Z[n] is, for example, the position of the upper surface of each key K[n] touched by the user's finger.

[0037] like Figure 2 As illustrated, the signal generation system 30 includes a control device 31, a storage device 32, and an A / D converter 33. Furthermore, the signal generation system 30 can be composed of multiple separate devices, in addition to being a single unit. The A / D converter 33 converts the detected signal D from analog to digital.

[0038] The control device 31 consists of one or more processors that control various elements of the electronic musical instrument 100. Specifically, the control device 31 may consist of one or more processors such as a CPU (Central Processing Unit), GPU (Graphics Processing Unit), SPU (Sound Processing Unit), DSP (Digital Signal Processor), FPGA (Field Programmable Gate Array), or ASIC (Application Specific Integrated Circuit). The control device 31 generates an audio signal V in correspondence with the detection signal D converted by the A / D converter 33.

[0039] Storage device 32 is a single or multiple memory devices that store the program executed by control device 31 and the data used by control device 31. For example, known recording media such as semiconductor recording media and magnetic recording media, or a combination of multiple recording media, may be used as storage device 32. In addition, for example, portable recording media that can be detached from electronic musical instrument 100, or recording media that control device 31 can write to or read from via a communication network (e.g., network hard drive) may also be used as storage device 32.

[0040] The storage device 32 of the first embodiment stores multiple waveform signals W[n] corresponding to different keys K[n]. The waveform signal W[n] corresponding to any one key K[n] is a signal representing the sound of the pitch P[n] corresponding to that key K[n]. That is, the waveform signal W[n] is supplied to the playback device 40 as an audio signal V, thereby playing the sound of that pitch P[n]. Furthermore, the data format of the waveform signal W[n] is arbitrary.

[0041] Figure 4 This is a block diagram illustrating the functional structure of the control device 31. The control device 31 executes a program stored in the storage device 32, thereby realizing multiple functions (position determination unit 71, signal generation unit 72, and motion control unit 73) to generate an audio signal V based on the detection signal D.

[0042] The position determination unit 71 analyzes the detection signal D to determine the position Z[n] of each of the N keys K[1] to K[N]. Specifically, the position determination unit 71 determines the position Z[n] in accordance with the level of the part of the detection signal D corresponding to the key K[n].

[0043] Figure 5 This is an explanatory diagram relating to the positions Z[n] of each bond K[n]. For example... Figure 5As illustrated, each key K[n] moves in the vertical direction within the range (hereinafter referred to as the "movement range") Q between the upper position ZH and the lower position ZL, corresponding to the operation performed by the user. The upper position ZH is the position of the key K[n] when the user has not operated on the key K[n]. That is, the upper position ZH is the upper position of the movement range Q. On the other hand, the lower position ZL is the position of the key K[n] when the user has fully pressed the key K[n]. That is, the lower position ZL is the lower position of the movement range Q. The lower position ZL also indicates the position of the key K[n] when the displacement of the key K[n] is the largest. The detection system 20 of the first embodiment can detect the position of each key K[n] across the entire range of the movement range Q. That is, the position Z[n] represented by the detection signal D for each key K[n] is any one location in the entire movement range Q. Furthermore, the upper position ZH is an example of the "first end position", and the lower position ZL is an example of the "second end position".

[0044] Within the movement range Q, an operation position Zon and a release position Zoff are set. The operation position Zon is the position where the user has operated the key K[n]. That is, when position Z[n] reaches the operation position Zon due to the descent of key K[n] caused by pressing the key, it is determined that the key K[n] has been operated. On the other hand, the release position Zoff is the position where the operation on key K[n] has been released. That is, when position Z[n] reaches the release position Zoff due to the descent of key K[n] caused by releasing the key after pressing the key, it is determined that the key K[n] has been released. The operation position Zon is located between the release position Zoff and the lower position ZL. Furthermore, the operation position Zon can coincide with either the upper position ZH or the lower position ZL. Similarly, the release position Zoff can coincide with either the upper position ZH or the lower position ZL. Additionally, the release position Zoff can be located between the operation position Zon and the lower position ZL.

[0045] The key K[n] descends from the upper position ZH by being operated by the user. During its descent, the key K[n] passes through the operation position Zon and finally reaches the lower position ZL. Conversely, the key K[n] rises from the lower position ZL by being released by the user. During its rise, the key K[n] passes through the release position Zoff and finally reaches the upper position ZH.

[0046] Figure 4 The signal generation unit 72 generates an audio signal V corresponding to the user's operation on each of the multiple keys K[n]. Specifically, the signal generation unit 72 generates an audio signal V corresponding to the position Z[n] of each key K[n].

[0047] First, consider the case where any one key K[n] of the keyboard 10 is operated individually. When key K[n] is operated individually, the signal generation unit 72 generates an audio signal V using the waveform signal W[n] corresponding to key K[n] from the N waveform signals W[1] to W[N] stored in the storage device 32. Specifically, when the position Z[n] of key K[n] drops due to the key being pressed and reaches the operation position Zon, the signal generation unit 72 outputs the waveform signal W[n] as the audio signal V to the playback device 40. Therefore, the sound of pitch P[n] is played from the playback device 40. Furthermore, the audio signal V can be generated by performing various audio processing on the waveform signal W[n]. As understood from the above explanation, the signal generation unit 72 is equivalent to a PCM (Pulse Code Modulation) sound source.

[0048] Next, consider the case where key K[n2] is operated during the operation of key K[n1] (hereinafter referred to as "continuous operation"). Key K[n1] (n1 = 1 to N) is any one of the N keys K[1] to K[N]. On the other hand, key K[n2] (n2 = 1 to N, n2 ≠ n1) is one of the N keys K[1] to K[N] other than key K[n1]. Key K[n1] and key K[n2] can be two adjacent keys K[n], or they can be two keys K[n] separated by more than one key K[n]. Key K[n2] corresponds to a pitch P[n2] that is different from the pitch P[n1].

[0049] like Figure 5 As illustrated, the operation period of key K[n1] refers to the time from when key K[n1] passes the operation position Zon during its descent to when it passes the release position Zoff during its subsequent ascent (hereinafter referred to as the "operation period"). In continuous operation, the operation periods of key K[n1] and key K[n2] overlap on the time axis. Specifically, in continuous operation, the portion of the operation period of key K[n1] that includes the end point and the portion of the operation period of key K[n2] that includes the start point overlap.

[0050] During the continuous operation of key K[n2] while key K[n1] is being operated, the signal generation unit 72 generates an audio signal V using the waveform signal W[n1] corresponding to key K[n1] and the waveform signal W[n2] corresponding to key K[n2]. Key K[n1] is an example of "the first key", and key K[n2] is an example of "the second key". Furthermore, waveform signal W[n1] is an example of "the first waveform signal", and waveform signal W[n2] is an example of "the second waveform signal".

[0051] Figure 6 This is an explanatory diagram of the operation of the signal generation unit 72 during continuous operation. Imagine as follows... Figure 6 As illustrated, this occurs when the user operates on key K[n1] as it rises by releasing the key, and the user operates on key K[n2] (i.e., during consecutive operations).

[0052] In the above situation, the signal generation unit 72 generates an audio signal V comprising a first interval X1, a second interval X2, and a transition interval Xt. The first interval X1 is the interval corresponding to the operation of key K[n1]. The second interval X2 is the interval corresponding to the operation of key K[n2]. The second interval X2 is located after the first interval X1 on the time axis. The transition interval Xt is the interval located between the first interval X1 and the second interval X2.

[0053] The starting point tS of the transition interval Xt is the time point ton for the operation of key K[n2]. Specifically, the starting point tS is the time point ton when position Z[n2] reaches the operation position Zon due to the descent of key K[n2] caused by the key being pressed. On the other hand, the ending point tE of the transition interval Xt is the time point after the starting point tS of the transition interval Xt, which is a time length T away. Furthermore, the time length T will be described later. The starting point tS also represents the ending point of the first interval X1, and the ending point tE is also the starting point of the second interval X2.

[0054] The signal generation unit 72 supplies the waveform signal W[n1] corresponding to the key K[n1] to the playback device 40 as the first interval X1 of the audio signal V. Therefore, the sound of pitch P[n1] (hereinafter referred to as "the first tone") is played by the playback device 40. That is, the first interval X1 of the audio signal V represents the first tone of pitch P[n1] corresponding to the key K[n1].

[0055] The signal generation unit 72 supplies the waveform signal W[n2] corresponding to key K[n2] to the playback device 40 as the second interval X2 of the audio signal V. Therefore, the sound with pitch P[n2] (hereinafter referred to as the "second tone") is played by the playback device 40. That is, the second interval X2 of the audio signal V represents the second tone of the pitch P[n2] corresponding to key K[n2]. The pitch P[n1] of the first tone of the first interval X1 and the pitch P[n2] of the second tone of the second interval X2 are different. Furthermore, in Figure 6 In order to conveniently illustrate the case where the pitch P[n2] is greater than the pitch P[n1], we can also imagine the case where the pitch P[n2] is less than the pitch P[n1].

[0056] Furthermore, the signal generation unit 72 generates the transition interval Xt of the audio signal V using waveform signals W[n1] and W[n2]. Specifically, the signal generation unit 72 generates the transition interval Xt of the audio signal V by controlling the crossfade of waveform signals W[n1] and W[n2] and the pitch P[n]. The generation of the transition interval Xt will be described in detail below.

[0057] The signal generation unit 72 decreases the volume of the waveform signal W[n1] over time within the transition interval Xt, from the starting point tS to the ending point tE. The volume of the waveform signal W[n1] decreases continuously within the transition interval Xt. Specifically, the signal generation unit 72 multiplies the waveform signal W[n1] by a coefficient (gain) that decreases over time from a maximum value of 1 to a minimum value of 0 within the transition interval Xt. Conversely, the signal generation unit 72 increases the volume of the waveform signal W[n2] over time within the transition interval Xt, from the starting point tS to the ending point tE. The volume of the waveform signal W[n2] increases continuously within the transition interval Xt. Specifically, the signal generation unit 72 multiplies the waveform signal W[n2] by a coefficient (gain) that increases over time from a minimum value of 0 to a maximum value of 1 within the transition interval Xt.

[0058] Furthermore, the signal generation unit 72 causes the pitch of the waveform signal W[n1] to change over time within the transition interval Xt, from the starting point tS to the ending point tE. Specifically, the signal generation unit 72 causes the pitch of the waveform signal W[n1] to change over time from pitch P[n1] to pitch P[n2] within the range from the starting point tS to the ending point tE. That is, the pitch of the waveform signal W[n1] rises or falls relative to the pitch P[n1] at the starting point tS, reaching pitch P[n2] at the ending point tE. Additionally, the signal generation unit 72 causes the pitch of the waveform signal W[n2] to change over time within the transition interval Xt, from the starting point tS to the ending point tE. Specifically, the signal generation unit 72 causes the pitch of the waveform signal W[n2] to change over time from pitch P[n1] to pitch P[n2] within the range from the starting point tS to the ending point tE. That is, the pitch of the waveform signal W[n2] is the same as that of the aforementioned waveform signal W[n1], rising or falling relative to the pitch P[n1] at the starting point tS, and reaching the pitch P[n2] at the ending point tE.

[0059] The signal generation unit 72 generates the transition interval Xt of the sound signal V by adding the processed waveform signal W[n1] and waveform signal W[n2] as illustrated above. That is, as described above, the transition interval Xt is generated by the cross-gradual entry and exit of the waveform signals W[n1] and W[n2]. The pitch of the transition interval Xt transitions from the pitch P[n1] of the first note to the pitch P[n2] of the second note. As understood from the above explanation, the transition interval Xt is the interval in which the sound represented by the sound signal V transitions from the first note to the second note over time. That is, by operating the key K[n2] during the operation of the key K[n1], the user can impart a musical effect equivalent to legato or portamento to the sound emitted by the sound playback device 40.

[0060] Figure 4 The motion control unit 73 controls the generation of the audio signal V by the signal generation unit 72. In the first embodiment, the motion control unit 73 controls the time length T of the transition interval Xt. Specifically, during continuous operation of keys K[n1] and K[n2], the motion control unit 73 controls the time length T of the transition interval Xt corresponding to the position Z[n1] (hereinafter referred to as "reference position Zref") of key K[n1] at the time point ton of key K[n2] operation. Figure 6 As illustrated, the reference position Zref is the position Z[n1] of key K[n1] at the time point ton when key K[n2] reaches the operation position Zon after being pressed. Alternatively, considering the distance L between the upper position ZH and the reference position Zref, the motion control unit 73 controls the time length T of the transition interval Xt in accordance with the distance L. The distance L also represents the amount of operation performed by the user on key K[n].

[0061] Figure 7 This is an explanatory diagram relating the reference position Zref and the time length T. Figure 7 In this context, positions Z1 and Z2 within the movement range Q are conceived as specific examples of the reference position Zref. Position Z2 is closer to the lower position ZL than position Z1. That is, the distance L2 between position Z2 and the upper position ZH is greater than the distance L1 between position Z1 and the upper position ZH (L2 > L1). Furthermore, position Z1 is an example of the "first position," and position Z2 is an example of the "second position."

[0062] When the reference position Zref is position Z1, the motion control unit 73 sets the transition interval Xt to a time length T1. Conversely, when the reference position Zref is position Z2, the motion control unit 73 sets the transition interval Xt to a time length T2. The time length T2 is longer than the time length T1 (T2 > T1). As understood from the above explanation, the motion control unit 73 controls the time length T of the transition interval Xt in a manner that the closer the reference position Zref is to the lower position ZL, the greater the increase in the time length T. That is, the greater the distance L between the upper position ZH and the reference position Zref, the greater the increase in the time length T of the transition interval Xt.

[0063] Figure 8 This is a flowchart illustrating the detailed sequence of processes (hereinafter referred to as "control processes") performed by the control device 31. For example, repeating at a predetermined cycle. Figure 8 The processing.

[0064] If control processing begins, the control device 31 (position determination unit 71) determines the position Z[n] of each key K[n] by analyzing the detection signal D (Sa1). The control device 31 (signal generation unit 72) determines whether any one of the N keys K[1] to K[N] (key K[n2]) has been operated by referring to the position Z[n] of each key K[n] (Sa2). Specifically, the control device 31 determines whether the position Z[n2] has reached the operating position Zon due to the descent of any key K[n2].

[0065] If it is determined that key K[n2] has been operated (Sa2: YES), the control device 31 (signal generation unit 72) determines whether other keys K[n1] are in operation (Sa3). If other keys K[n1] are not in operation (Sa3: NO), it means that key K[n2] has been operated alone. Therefore, the control device 31 outputs the waveform signal W[n2] as an audio signal V to the playback device 40, thereby causing the playback device 40 to play the second note of pitch P[n2] (Sa4).

[0066] On the other hand, when key K[n2] is operated during the operation of key K[n1] (Sa3: YES), that is, during continuous operation, control device 31 (signal generation unit 72) generates sound signal V (Sa5-Sa7) using waveform signal W[n1] corresponding to key K[n1] and waveform signal W[n2] corresponding to key K[n2].

[0067] First, the control device 31 (action control unit 73) determines the position Z[n1] of key K[n1] at the time point ton for key K[n2] operation, i.e., the reference position Zref (Sa5). Furthermore, the control device 31 (action control unit 73) sets the time length T of the transition interval Xt corresponding to the reference position Zref (Sa6). Specifically, as described above, the control device 31 sets the time length T of the transition interval Xt in such a way that the time length T increases as the reference position Zref approaches the lower position ZL. The control device 31 (signal generation unit 72) generates an audio signal V by performing cross-fade-in and cross-fade-out operations on waveform signals W[n1] and W[n2] within the transition interval Xt of this time length T (Sa7). The control device 31 (signal generation unit 72) outputs the audio signal V generated through the above processing to the playback device 40 (Sa8). The control processing described above is performed periodically and repeatedly.

[0068] As explained above, in the first embodiment, when key K[n2] is operated during the operation of key K[n1], the generation of the audio signal V is controlled corresponding to the position of key K[n1] at the time point ton of the operation of key K[n2], i.e., the reference position Zref. Therefore, by a simple process of determining the position Z[n1] (=Zref) of key K[n1] at the time point ton of the operation of key K[n2], a variety of audio signals V with different audio characteristics corresponding to the operation performed by the user can be generated. Specifically, in the first embodiment, the time length T of the transition interval Xt from the first tone (pitch P[n1]) to the second tone (pitch P[n2]) represented by the audio signal V is controlled corresponding to the reference position Zref. Therefore, a variety of audio signals V with varying time length T of the transition interval Xt can be generated corresponding to the user's operation of key K[n1] and key K[n2].

[0069] However, it is anticipated that, when intending to quickly transition from the first note to the second note, the user will shorten the overlap between the operation periods of key K[n1] and key K[n2], while when intending to gradually transition from the first note to the second note over a corresponding amount of time, the user will ensure sufficient overlap between the operation periods of key K[n1] and key K[n2]. In the first embodiment, when the reference position Zref is position Z2, which is closer to the lower position ZL than position Z1, the transition interval Xt is set to a time length T2 that is longer than the time length T1. Therefore, it has the advantage that the user can easily set the transition interval Xt to the intended time length T through intuitive operation.

[0070] B: Implementation Method 2

[0071] The second embodiment will be described. Furthermore, in the embodiments illustrated below, elements that function the same as in the first embodiment are omitted with appropriate elaboration using the reference numerals used in the description of the first embodiment.

[0072] Figure 9 This is a schematic diagram of each waveform signal W[n]. The waveform signal W[n] includes an articulation portion Wa and a stabilization portion Wb. The articulation portion Wa is the period immediately following the articulation of the sound represented by the waveform signal W[n]. For example, the articulation portion Wa includes an attack period where the volume of the sound represented by the waveform signal W[n] increases, and an attenuation period immediately following that attack period where the volume decreases. On the other hand, the stabilization portion Wb is the period following the articulation portion Wa. Specifically, the stabilization portion Wb immediately follows the articulation portion Wa. For example, the stabilization portion Wb corresponds to the sustain period where the volume of the sound represented by the waveform signal W[n] is stably maintained.

[0073] When key K[n] is operated alone, signal generation unit 72 generates an audio signal V using the entire waveform signal W[n]. That is, signal generation unit 72 supplies the entire waveform signal W[n], including the phonograph part Wa and the stable part Wb, as the audio signal V to playback device 40. Therefore, the sound including both the phonograph part Wa and the stable part Wb is played from playback device 40.

[0074] On the other hand, when key K[n2] is continuously operated during the operation of key K[n1], the signal generation unit 72 selectively utilizes the stable portion Wb in the waveform signal W[n2] to generate an audio signal V. Specifically, as... Figure 10 As illustrated, in the transition interval Xt, the stable portion Wb of the waveform signal W[n2], excluding the vocalized portion Wa, is cross-faded in and out relative to the preceding waveform signal W[n1], thereby generating the acoustic signal V. That is, the vocalized portion Wa of the waveform signal W[n2] is not used in the generation of the acoustic signal V. Furthermore, the structure and operation are the same as in the first embodiment, except that the vocalized portion Wa of the waveform signal W[n2] is not used during continuous operation. Therefore, the second embodiment also achieves the same effect as the first embodiment.

[0075] However, in the structure (first embodiment) that utilizes the pronunciation portion Wa of the waveform signal W[n2] in the generation of the sound signal V during continuous operation, the pronunciation portion Wa of the second tone is clearly perceived audibly within the transition interval Xt. That is, the user clearly perceives that a different second tone begins immediately after the first tone. Therefore, it may be difficult to fully perceive the impression of a continuous transition between the first and second tones. In the second embodiment, the pronunciation portion Wa is not used for the second tone immediately following the first tone. Therefore, it is possible to generate a sound signal V that smoothly connects the first and second tones with an audibly natural impression.

[0076] On the other hand, in the first embodiment, the phonological portion Wa of the waveform signal W[n2] is used for the audio signal V. However, during the cross-fade-in and fade-out within the transition interval Xt, the volume of the waveform signal W[n2] is suppressed. Therefore, it may be difficult to perceive the phonological portion Wa of the second tone audibly due to the waveform of the waveform signal W[n2] within the phonological portion Wa. On the other hand, according to the first embodiment, it is not necessary to exclude the phonological portion Wa of the waveform signal W[n2] each time the audio signal V is generated. Therefore, it has the advantage of reducing the processing load of the control device 31 compared to the second embodiment.

[0077] C: Third Implementation

[0078] Figure 11 This is an explanatory diagram illustrating the operation of the signal generation unit 72 in the third embodiment during continuous operation. Similar to the first embodiment, continuous operation occurs when key K[n2] is operated during the operation of key K[n1]. During continuous operation, the signal generation unit 72 generates an audio signal V comprising the first interval X1, the second interval X2, and the additional interval Xa. Furthermore, as in the first embodiment, when key K[n] is operated alone, the waveform signal W[n] is output as the audio signal V.

[0079] Similar to the first embodiment, in the first interval X1, the signal generation unit 72 supplies the waveform signal W[n1] corresponding to key K[n1] as an audio signal V to the playback device 40. Additionally, in the second interval X2, the signal generation unit 72 supplies the waveform signal W[n2] corresponding to key K[n2] as an audio signal V to the playback device 40. In the third embodiment, the waveform signal W[n2], which includes both the sound-producing part Wa and the stabilizing part Wb, is supplied to the playback device 40 as an audio signal V from the beginning of the second interval X2. That is, the beginning of the sound-producing part Wa of the waveform signal W[n2] is played from the beginning of the second interval X2. However, similar to the second embodiment, the playback of the sound-producing part Wa in the waveform signal W[n2] can also be omitted.

[0080] The signal generation unit 72 supplies the additional signal E as an additional interval Xa of the audio signal V to the playback device 40. The additional signal E is a signal representing an additional tone. An additional tone is an additional effect sound that is different from the first tone or the second tone. Specifically, the sound produced along with the playing of an instrument (for example, a sound other than the original instrument tone) is exemplified as an "additional tone". For example, finger noise (fret noise) produced by the friction between the fingers and the strings when playing a stringed instrument, or the breath (breathing) sound produced when playing a wind instrument or singing is exemplified as an additional tone. As understood from the above description, the playback device 40 plays the additional tone between the first tone and the second tone.

[0081] In the third embodiment, the motion control unit 73 controls the acoustic characteristics of the additional tone within the additional interval Xa in accordance with the reference position Zref. Specifically, the motion control unit 73 controls the volume of the additional tone in accordance with the reference position Zref. For example, the closer the reference position Zref is to the lower position ZL, the greater the volume of the additional tone is caused by the motion control unit 73. Specifically, similar to the first embodiment, if positions Z1 and Z2 are considered as the reference position Zref, the volume of the additional tone is greater when the reference position Zref is position Z2 than when the reference position Zref is position Z1. That is, the longer the distance L between the upper position ZH and the reference position Zref, the greater the volume of the additional tone. Furthermore, contrary to the above example, it is also conceivable that the longer the distance L between the upper position ZH and the reference position Zref, the smaller the volume of the additional tone is.

[0082] Figure 12 This is a flowchart illustrating the detailed sequence of the control processing in the third embodiment. In the third embodiment, steps Sa6 and Sa7 of the control processing in the first embodiment are replaced with the following examples. Figure 12 Steps Sb6 and Sb7. The processing other than steps Sb6 and Sb7 is the same as in the first embodiment.

[0083] If the reference position Zref (Sa5) is determined, the control device 31 (action control unit 73) obtains the additional signal E from the storage device 32 and sets the volume of the additional signal E corresponding to the reference position Zref (Sb6). Then, the control device 31 (signal generation unit 72) adjusts the additional signal E to this volume and generates an audio signal V (Sb7) using the adjusted additional signal E as an additional interval Xa. The control device 31 (signal generation unit 72) outputs the audio signal V to the playback device 40 (Sa8) in the same manner as in the first embodiment. The control process described above is repeated periodically.

[0084] As explained above, in the third embodiment, when key K[n2] is operated during the operation of key K[n1], the generation of the audio signal V is controlled corresponding to the reference position Zref, which is the position of key K[n1] at the time point ton of key K[n2] operation. Therefore, similar to the first embodiment, by simply determining the position Z[n1] (=Zref) of key K[n1] at the time point ton of key K[n2] operation, a variety of audio signals V with different audio characteristics corresponding to the operation performed by the user can be generated. Furthermore, in the third embodiment, a variety of audio signals V can be generated such that an additional tone with an audio characteristic corresponding to the reference position Zref is emitted between the first tone and the second tone.

[0085] In the first and second embodiments, a method is illustrated in which the time length T of the transition interval Xt is controlled in accordance with the reference position Zref. In the third embodiment, a method is illustrated in which the acoustic characteristics of the additional tone of the additional interval Xa are controlled in accordance with the reference position Zref. The first to third embodiments are generally represented as methods in which the motion control unit 73 controls the generation of the acoustic signal V in accordance with the reference position Zref.

[0086] D: Variation Example

[0087] Below are examples of specific variations added to the methods illustrated above. Multiple methods arbitrarily selected from the examples below can be appropriately combined without contradiction.

[0088] (1) In the first and second embodiments, the pitch of the audio signal V changes in the transition interval Xt, but the acoustic characteristics that change in the transition interval Xt are not limited to pitch. For example, it is also conceivable that the volume of the audio signal V changes from the volume of the first tone to the volume of the second tone in the transition interval Xt. The volume of the first tone is set in correspondence with the movement speed of the key K[n1] (i.e., the rate of change of position Z[n1]). The volume of the second tone is set in correspondence with the movement speed of the key K[n2]. In addition, it is also conceivable that the timbre of the audio signal V changes from the timbre of the first tone to the timbre of the second tone in the transition interval Xt. The first tone and the second tone are sounds with different timbres. It can also be expressed that the frequency characteristics are different between the first tone and the second tone. As illustrated above, in the method of setting a transition interval Xt between the first interval X1 and the second interval X2, as illustrated in the first or second embodiment described above, it is envisioned that the time length T of the transition interval Xt be controlled in accordance with the reference position Zref. The transition interval Xt is represented as the interval in which the sound represented by the acoustic signal V transitions from the first tone to the second tone. Furthermore, the first tone and the second tone are collectively represented as sounds with different acoustic characteristics.

[0089] (2) In the third embodiment, the volume of the additional tone in the additional interval Xa is controlled corresponding to the reference position Zref, but the acoustic characteristics of the additional tone controlled corresponding to the reference position Zref are not limited to the volume. For example, the pitch or timbre (frequency characteristics) of the additional tone may also be controlled corresponding to the reference position Zref. Two or more acoustic characteristics of the additional tone may also be controlled corresponding to the reference position Zref.

[0090] Furthermore, it is conceivable that the signal generation unit 72 selectively utilizes any one of the multiple additional signals E representing different additional tones as an additional interval Xa of the audio signal V. The multiple additional signals E are stored, for example, in the storage device 32. Each of the multiple additional signals E represents a different type of additional tone. In the above-described manner, the signal generation unit 72 may also select the additional signal E from the multiple additional signals E that corresponds to the reference position Zref. That is, the additional signal E used as an additional interval Xa of the audio signal V is changed correspondingly to the reference position Zref.

[0091] (3) In the first and second embodiments, a method is illustrated in which the time length T of the transition interval Xt is controlled in accordance with the reference position Zref. In the third embodiment, a method is illustrated in which the acoustic characteristics of the additional tone of the additional interval Xa are controlled in accordance with the reference position Zref. The method of reflecting the reference position Zref when the acoustic signal V is generated by the signal generation unit 72 is not limited to the above examples. For example, in the method where the signal generation unit 72 generates an acoustic signal V with various acoustic effects, the motion control unit 73 controls the variables related to the acoustic effects in accordance with the reference position Zref. As acoustic effects assigned to the acoustic signal V, there are various effects such as reverberation, overdrive, distortion, compression, equalization, or delay. The method described above is also an example of the method in which the motion control unit 73 controls the generation of the acoustic signal V in accordance with the reference position Zref.

[0092] (4) In the aforementioned methods, N waveform signals W[1] to W[N] corresponding to different keys K[n] are selectively used to generate an audio signal V, but the structure and method for generating the audio signal V are not limited to the examples above. For example, it is also conceivable that the signal generation unit 72 generates the audio signal V by modulation processing that modulates the basic signal stored in the storage device 32. The basic signal is a periodic signal whose level varies at a predetermined frequency. According to the modulation processing, the first interval X1 and the second interval X2 of the audio signal V are continuously generated by modulation of the basic signal, so the cross-fade-in and fade-out shown in the first and second embodiments are not required. In the method of using modulation processing, the signal generation unit 72 controls the conditions of the modulation processing for the basic signal, thereby changing the audio characteristics (e.g., volume, pitch, or timbre) of the audio signal V in the transition interval Xt.

[0093] (5) In the aforementioned methods, the volume of waveform signals W[n1] and W[n2] varies with time within the range from the starting point tS to the ending point tE of the transition interval Xt, but the interval for controlling the volume of waveform signals W[n1] and W[n2] can also be a part of the transition interval Xt. For example, as... Figure 13 As illustrated, the signal generation unit 72 decreases the volume of the waveform signal W[n1] over time within the time range from the starting point tS of the transition interval Xt to the end point tE, specifically at time point tE'. Conversely, the signal generation unit 72 increases the volume of the waveform signal W[n2] over time within the time range from the starting point tS of the transition interval Xt to the end point tE. In other words, the waveform signals W[n1] and W[n2] are actually mixed within the interval from time point tS' to time point tE'.

[0094] Furthermore, in the aforementioned methods, the pitch of the acoustic signal V changes linearly within the transition interval Xt, but the conditions for changing the acoustic characteristics of the acoustic signal V are not limited to the examples above. For example, as... Figure 13 As illustrated, the signal generation unit 72 can cause the pitch of the audio signal V to change curvilinearly from pitch P[n1] to pitch P[n2] within the transition interval Xt. Furthermore, it is also conceivable that the acoustic characteristics of the audio signal V change in stages within the transition interval Xt.

[0095] (6) In the aforementioned methods, the position Z[n] of each key K[n] is detected by magnetic sensor 21, but the structure and method for detecting the position Z[n] of each key K[n] are not limited to the examples above. For example, an optical sensor that detects the position Z[n] in correspondence with the amount of reflected light from each key K[n], or a pressure sensor that detects the position Z[n] in correspondence with the change in pressing pressure of each key K[n], can be used for detecting the position Z[n] of each key K[n].

[0096] (7) In the foregoing embodiments, the key K[n] constituting the keyboard 10 is exemplified, but the operation element operated by the user is not limited to the key K[n]. For example, any element that can be operated by the user, such as a pedal operated by the user, a valve of a brass instrument (e.g., a trumpet or trombone), or a key of a woodwind instrument (e.g., a clarinet or saxophone), can be exemplified as an "operation element". As illustrated above, the operation element of the present invention is any element operated by the user. For example, a virtual operation element displayed on a touch panel that can be operated by the user is also included in the concept of "operation element" of the present invention. The operation element moves within a predetermined range of motion in conjunction with the operation performed by the user. Furthermore, the movement of the operation element is not limited to linear movement. For example, a rotary operation element (e.g., an operation button component) that rotates in response to the operation performed by the user can also be conceived as an example of an "operation element". The "position" associated with a rotary operation element refers to the angle of rotation relative to a standard state.

[0097] (8) The function of the signal generation system 30, as described above, is achieved through the coordinated operation of one or more processors constituting the control device 31 and the program stored in the storage device 32. The program can be provided and installed in a computer in the form of a computer-readable recording medium. The recording medium is, for example, a non-transitory recording medium, preferably an optical recording medium (optical disc) such as a CD-ROM, and also includes any known form of recording medium such as semiconductor recording media or magnetic recording media. Furthermore, non-transitory recording media includes any recording medium other than transient (propagating) signals, and may also include volatile recording media. In addition, in a structure where a transmission device transmits a program via a communication network, the storage device storing the program in that transmission device is equivalent to the aforementioned non-transitory recording medium.

[0098] E: Appendix

[0099] Based on the examples above, one can, for instance, grasp the following structure.

[0100] One aspect (Aspect 1) of the present invention relates to a signal generation method that generates an audio signal corresponding to operations performed on a plurality of operating elements, including a first operating element and a second operating element. When the second operating element is operated during the operation of the first operating element, the generation of the audio signal is controlled in accordance with a reference position, which is the position of the first operating element at the time of operation of the second operating element. In this aspect, the generation of the audio signal is controlled in accordance with the position (reference position) of the first operating element at the time of operation of the second operating element. Therefore, by simply determining the position of the first operating element at the time of operation of the second operating element, audio signals with diverse audio characteristics corresponding to operations performed by the user can be generated.

[0101] An "audio signal" is a signal representing sound, generated in response to an operation on a control device. The relationship between the operation on the control device and the audio signal is arbitrary. For example, one can also imagine the manner in which the audio signal representing sound is produced / silenced in conjunction with the operation on the control device, or the manner in which the acoustic characteristics of the audio signal in conjunction with the operation on the control device change. The acoustic characteristics of the audio signal are, for example, arbitrary acoustic characteristics such as volume, pitch, or timbre (i.e., frequency response).

[0102] "The situation where the second operation is performed during the operation of the first operation" is, for example, a situation where the operation periods of the first and second operations overlap on the timeline. Specifically, the period after the end point in the operation period of the first operation overlaps with the period before the start point in the operation period of the second operation. The "operation period" of each operation is the period during which the operation is performed. For example, the period from the time when the operation is determined to be performed to the time when the operation is determined to be released is equivalent to the "operation period". For example, imagine that there is an operation position and a release position within the movement range of the operation. The operation position is the position where the operation is determined to be performed, and the release position is the position where the operation is determined to be released. The operation period is the period from when the operation reaches the operation position to when it reaches the release position. Furthermore, the relationship between the operation position and the release position within the movement range is arbitrary. For example, the operation position and the release position can be different positions within the movement range or they can be common positions.

[0103] The time point at which the operation is performed on the second operating element is determined to be the time point at which the second operating element is operated. For example, in addition to the time point at which the second operating element begins to move from its position in a non-operational state through an operation performed by the user, the time point at which the second operating element reaches a specific location within its movement range through an operation performed by the user is also included in the "time point at which the operation is performed on the second operating element".

[0104] In a mode where the operating element moves in conjunction with an operation performed by the user, the "position of the operating element" refers to the location of the operating element. Additionally, in a mode where the operating element rotates in conjunction with an operation performed by the user, the angle of rotation of the operating element is also included in the "position of the operating element" of this invention. The "position of the operating element" can also be expressed as, for example, the "operation amount" for that operating element. The operation amount is, for example, the distance the operating element moves from a reference position or the angle of rotation as a result of an operation performed by the user.

[0105] In a specific example of Method 1 (Method 2), the audio signal includes: a first interval representing a first tone corresponding to the first operating element; a second interval representing a second tone corresponding to the second operating element; and a transition interval, which is the interval between the first interval and the second interval where the acoustic characteristics transition from the acoustic characteristics of the first tone to the acoustic characteristics of the second tone. When controlling the generation of the audio signal, the duration of the transition interval is controlled in accordance with the reference position. In the above method, the duration of the transition interval representing the transition from the first tone to the second tone is controlled in accordance with the position of the first operating element at the time point of operation of the second operating element. Therefore, a variety of audio signals with varying durations of the transition interval can be generated in accordance with the user's operation of the first and second operating elements.

[0106] "Tone 1" is the sound produced in response to an operation on the first operating element. Similarly, "Tone 2" is the sound produced in response to an operation on the second operating element. The acoustic characteristics of tone 1 and tone 2 differ, for example. Acoustic characteristics, as described above, are any acoustic properties such as volume, pitch, or timbre (i.e., frequency response).

[0107] In a specific example of Method 1 (Method 2), the audio signal includes: a first interval representing a first tone corresponding to the first operating element; a second interval representing a second tone corresponding to the second operating element; and a transition interval, which is a range generated between the first and second intervals by the cross-gradual entry and exit of a first waveform signal representing the first tone and a second waveform signal representing the second tone. When controlling the generation of the audio signal, the duration of the transition interval is controlled in relation to the reference position. In the above method, the duration of the transition interval, where the first waveform signal of the first tone and the second waveform signal of the second tone cross-gradually enter and exit, is controlled in relation to the position of the first operating element at the time of operation of the second operating element. Therefore, a variety of audio signals with varying durations of the transition interval can be generated in relation to the user's operation of the first and second operating elements.

[0108] "Cross-fade-in and cross-fade-out of the first and second waveform signals" is a process that mixes the first and second waveform signals while decreasing the volume of the first waveform signal (first tone) over time and increasing the volume of the second waveform signal (second tone) over time. This cross-fade-in and cross-fade-out is also called "cross-fade-in and cross-fade-out of the first and second tones."

[0109] In a specific example of Method 3 (Method 4), during the generation of the audio signal, when the second operating element is operated independently, the audio signal is generated using a second waveform signal. This second waveform signal includes a vocalizing portion immediately following the start of the second tone and a stable portion following the vocalizing portion. During the cross-in / fade-out, the stable portion of the second waveform signal is utilized. In the above methods, the stable portion of the second waveform signal is used for the cross-in / fade-out. Therefore, an audio signal can smoothly connect the first tone and the second tone with an audibly natural impression.

[0110] In a specific example of methods 2 to 4 (method 5), each of the plurality of operating elements is movable between a first end position in a non-operating state and a second end position separated from the first end position. When controlling the generation of the audio signal, if the reference position is the first position, the transition interval is set to a first time length; if the reference position is a second position closer to the second end position than the first position, the transition interval is set to a second time length longer than the first time length. When intending to quickly transition from the first tone to the second tone, the user tends to shorten the overlap between the operation periods of the first and second operating elements. Conversely, when intending to gradually transition from the first tone to the second tone over a corresponding amount of time, the user tends to sufficiently ensure the overlap between the operation periods of the first and second operating elements. In the aforementioned method, when the reference position is a second position closer to the second end position than the first position, the transition interval is set to a second time length longer than the first time length. For example, the closer the reference position is to the second end position, the longer the transition interval becomes. Therefore, it has the advantage that users can easily set the transition interval to the intended time through intuitive operation.

[0111] "Non-operational state" is the state in which the operating component is not operated by the user, and "first end position" is the position of the operating component in the non-operational state. "Second end position" is the position of the operating component when it is operated by the user. Specifically, the second end position is the position of the operating component when the user has operated it to its maximum extent. "First end position" is the position at one end of the operating component's range of movement, and "second end position" is the position at the other end of that range of movement.

[0112] In a specific example of Method 1 (Method 6), the audio signal includes: a first interval representing a first tone corresponding to the first operating element; a second interval representing a second tone corresponding to the second operating element; and an additional interval representing an additional tone between the first interval and the second interval. When controlling the generation of the audio signal, the acoustic characteristics of the additional tone are controlled corresponding to the reference position. According to the above method, a variety of audio signals can be generated in which an additional tone with acoustic characteristics corresponding to the reference position is emitted between the first tone and the second tone.

[0113] An "additional tone" is an additional effect sound that is different from the first or second note. For example, sounds that accompany the playing of an instrument (such as sounds other than musical notes) are exemplified as "additional tones". For example, finger noise (flute noise) produced by the friction between fingers and strings when playing stringed instruments, or breath sounds (breathing) produced when playing wind instruments or singing are exemplified as "additional tones".

[0114] In a specific example (method 7) of any one of methods 1 to 6, the plurality of operating elements are a plurality of keys constituting a keyboard. According to the above methods, in the performance of a keyboard instrument, it is possible to generate, through simple processing, a variety of acoustic signals corresponding to the operations (i.e., key presses) performed by the user.

[0115] One embodiment (Embodiment 7) of the present invention relates to a signal generation system comprising: a signal generation unit that generates an acoustic signal corresponding to operation of a plurality of operating elements including a first operating element and a second operating element; and an action control unit that, when the second operating element is operated during the operation of the first operating element, controls the generation of the acoustic signal in accordance with a reference position, the reference position being the position of the first operating element at the time of operation of the second operating element. Furthermore, embodiments 2 to 6 described above can also be applied to the signal generation system of embodiment 7.

[0116] One aspect (aspect 8) of the present invention relates to an electronic musical instrument comprising: a plurality of operating elements, including a first operating element and a second operating element; a detection system for detecting operations performed on each of the plurality of operating elements; and a signal generation system comprising: a signal generation unit for generating an acoustic signal corresponding to an operation performed on the plurality of operating elements; and an action control unit for controlling the generation of the acoustic signal in accordance with a reference position corresponding to the position of the first operating element at the time of the operation performed on the second operating element when the second operating element is operated.

[0117] One aspect (Aspect 9) of the present invention relates to a program that causes a computer system to function as follows: a signal generation unit that generates an audio signal corresponding to operation of a plurality of operating elements including a first operating element and a second operating element; and an action control unit that, when the second operating element is operated during the operation of the first operating element, controls the generation of the audio signal in accordance with a reference position, the reference position being the position of the first operating element at the time point of operation of the second operating element.

[0118] Explanation of the label

[0119] 100… Electronic musical instrument, 10… Keyboard, 20… Detection system, 21… Magnetic sensor, 22… Drive circuit, 30… Signal generation system, 31… Control device, 32… Storage device, 33… A / D converter, 40… Sound playback device, 50… Detection circuit, 60… Detected part, 71… Position determination part, 72… Signal generation part, 73… Motion control part.

Claims

1. A signal generation method implemented by a computer system, generating an acoustic signal corresponding to an operation for a plurality of keys including a first key and a second key, controlling the generation of the acoustic signal in correspondence with a distance between an upper end position of a moving range of the first key and a reference position which is a position of the first key at a time point of the operation of the second key when the second key is operated during the operation of the first key, the upper end position of the first key being a position of the first key in a state where the first key is not operated.

2. The signal generation method according to claim 1, wherein the acoustic signal includes: a first interval representing a first sound corresponding to the first key; a second interval representing a second sound corresponding to the second key; and a transition interval which is an interval between the first interval and the second interval in which an acoustic characteristic is transitioned from an acoustic characteristic of the first sound to an acoustic characteristic of the second sound, the length of time of the transition interval is controlled in correspondence with the reference position when the generation of the acoustic signal is controlled.

3. The signal generation method according to claim 1, wherein the acoustic signal includes: a first interval representing a first sound corresponding to the first key; a second interval representing a second sound corresponding to the second key; and a transition interval which is an interval between the first interval and the second interval generated by cross-fade of a first waveform signal representing the first sound and a second waveform signal representing the second sound, the length of time of the transition interval is controlled in correspondence with the reference position when the generation of the acoustic signal is controlled.

4. The signal generation method according to claim 3, wherein in the generation of the acoustic signal, in a case where the second key is operated alone, the acoustic signal is generated using a second waveform signal including a sound production portion located immediately after the second sound starts and a stable portion located behind the sound production portion, in the cross-fade, the stable portion in the second waveform signal is used.

5. The signal generation method according to any one of claims 2 to 4, wherein the plurality of keys are each movable between a first end position in a non-operated state and a second end position separated from the first end position, in the control of the generation of the acoustic signal, in a case where the reference position is a first position, the transition interval is set to a first length of time, in a case where the reference position is a second position closer to the second end position than the first position, the transition interval is set to a second length of time longer than the first length of time.

6. The signal generation method according to claim 1, wherein the acoustic signal includes: a first interval representing a first sound corresponding to the first key; a second interval representing a second sound corresponding to the second key; and an additional interval which is an interval between the first interval and the second interval representing an additional sound, the additional interval is controlled in correspondence with the reference position when the generation of the acoustic signal is controlled. The additional sound is an additional effect sound different from the first sound or the second sound, The sound characteristic of the additional sound is controlled in correspondence with the reference position when the generation of the sound signal is controlled.

7. The signal generation method according to any one of claims 1 to 4, wherein The operation period of the first key and the operation period of the second key overlap each other on a time axis.

8. A signal generation system having: a signal generation section that generates a sound signal corresponding to an operation of a plurality of keys including a first key and a second key; and an operation control section that controls the generation of the sound signal in correspondence with a distance between an upper end position of a movement range of the first key and a reference position of the first key at a time point of the operation of the second key when the second key is operated during the operation of the first key, The upper end position of the first key is a position of the first key in a state where the first key is not operated.

9. The signal generation system according to claim 8, wherein The sound signal includes: a first interval that represents a first sound corresponding to the first key; a second interval that represents a second sound corresponding to the second key; and a transition interval that is an interval in which a sound characteristic is transitioned from a sound characteristic of the first sound to a sound characteristic of the second sound between the first interval and the second interval, The time length of the transition interval is controlled in correspondence with the reference position when the generation of the sound signal is controlled.

10. The signal generation system according to claim 8, wherein The sound signal includes: a first interval that represents a first sound corresponding to the first key; a second interval that represents a second sound corresponding to the second key; and a transition interval that is an interval generated by cross-fade between a first waveform signal representing the first sound and a second waveform signal representing the second sound between the first interval and the second interval, The operation control section controls the time length of the transition interval in correspondence with the reference position.

11. The signal generation system according to claim 10, wherein The signal generation section, generates the sound signal using a second waveform signal including a sound production portion immediately after the start of the second sound and a stable portion behind the sound production portion when the second key is operated alone, uses the stable portion in the second waveform signal in the cross-fade.

12. The signal generation system according to any one of claims 9 to 11, wherein The plurality of keys are each movable between a first end position in a non-operation state and a second end position separate from the first end position, The operation control section, sets the transition interval to a first time length when the reference position is a first position, sets the transition interval to a second time length longer than the first time length when the reference position is a second position closer to the second end position than the first position.

13. The signal generation system according to claim 8, wherein the sound signal includes: a first section representing a first sound corresponding to the first key; a second section representing a second sound corresponding to the second key; and an additional section representing an additional sound between the first section and the second section, the additional sound is an additional effect sound different from the first sound or the second sound, the action control section controls a sound characteristic of the additional sound in correspondence with the reference position.

14. The signal generation system according to any one of claims 8 to 11, wherein the operation period of the first key and the operation period of the second key overlap each other on a time axis.

15. An electronic musical instrument having: a plurality of keys including a first key and a second key; a detection system that detects operation of each of the plurality of keys; and a signal generation system, the signal generation system includes: a signal generation section that generates a sound signal corresponding to the operation of the plurality of keys; and an action control section that controls generation of the sound signal in correspondence with a distance between an upper end position of a movement range of the first key and a reference position of the first key when the second key is operated during operation of the first key, the reference position being a position of the first key at a time point of the operation of the second key, the upper end position of the first key being a position of the first key in a state where the first key is not operated.

16. A storage medium storing a program that causes a computer system to function as: a signal generation section that generates a sound signal corresponding to operation of a plurality of keys including a first key and a second key; and an action control section that controls generation of the sound signal in correspondence with a distance between an upper end position of a movement range of the first key and a reference position of the first key when the second key is operated during operation of the first key, the reference position being a position of the first key at a time point of the operation of the second key, the upper end position of the first key being a position of the first key in a state where the first key is not operated.

Images