Keyboard device, sound generation method, and program

WO2025052910A1PCT designated stage expired Publication Date: 2025-03-13YAMAHA CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/029441
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-09-04
Filing Date
2024-08-20
Publication Date
2025-03-13

Smart Images

  • Figure JP2024029441_13032025_PF_FP_ABST
    Figure JP2024029441_13032025_PF_FP_ABST
Patent Text Reader

Abstract

A keyboard device according to one embodiment of the present invention includes: a plurality of keys; an acquisition unit that acquires information for specifying a pressed key among the plurality of keys, and a pressing amount of the pressed key; and a sound signal generation unit that generates, if two or more keys are pressed and the pressing amounts of the two or more pressed keys each exceed a reference pressing amount, a sound signal on the basis of a relative relationship between the pressing amounts of the two or more keys, information for specifying the pressed keys, and the pressing amounts of the pressed keys.
Need to check novelty before this filing date? Find Prior Art

Description

Keyboard device, sound generation method, and program

[0001] The present invention relates to sound generation technology.

[0002] Various techniques have been devised for reproducing sounds in electronic musical instruments. For example, Patent Document 1 discloses a keyboard instrument that identifies the position of a control and reproduces a sound corresponding to a playing style that corresponds to the identified position.

[0003] International Publication No. 2021 / 100742

[0004] When a musical instrument is played, various playing styles of the instrument produce sounds with a wide variety of expressions. Similarly, sound generating devices such as electronic musical instruments are required to reproduce a wide variety of sounds corresponding to various playing styles, but selecting a desired playing style requires complicated operations by the user.

[0005] One object of the present invention is to reproduce sounds corresponding to a variety of playing styles by a user simply operating a control.

[0006] According to one embodiment of the present invention, there is provided a keyboard device including a plurality of keys, an acquisition unit that acquires information identifying pressed keys among the plurality of keys and the depression amounts of the pressed keys, and, if the number of pressed keys is two or more and the depression amounts of two or more pressed keys each exceed a reference depression amount, a sound signal generation unit that generates a sound signal based on the relative relationship between the depression amounts of the two or more keys, the information identifying the pressed keys, and the depression amounts of the pressed keys.

[0007] According to one embodiment of the present invention, there is provided a keyboard device including: a plurality of keys; an acquisition unit that acquires information identifying which of the plurality of keys has been pressed and the amount of depression of the pressed key; a control signal generation unit that, if the number of pressed keys is two or more and the amount of depression of each of the two or more pressed keys exceeds a reference amount, generates a control signal in accordance with the relative relationship between the amount of depression of the two or more keys; and a sound signal generation unit that generates a sound signal based on the information identifying the pressed key, the amount of depression of the pressed key, and the control signal.

[0008] According to one embodiment of the present invention, there is provided a sound generation method including: acquiring information identifying one of a plurality of operators and a pressing amount of the identified operator; and, if the number of the identified operators is two or more and the pressing amounts of two or more of the operators each exceed a reference pressing amount, generating a sound signal based on the relative relationship between the pressing amounts of the two or more operators, the information identifying the operators, and the pressing amounts of the identified operators.

[0009] According to one embodiment of the present invention, there is provided a sound generation method including: acquiring information identifying one of a plurality of operators and a pressing amount of the identified operator; generating a sound signal based on the information identifying the operator and the pressing amount of the identified operator; and, if the number of the identified operators is two or more and the pressing amounts of two or more of the operators each exceed a reference pressing amount, generating a control signal in accordance with the relative relationship between the pressing amounts of the two or more operators.

[0010] According to one embodiment of the present invention, there is provided a program for causing a computer to execute any of the above sound generation methods.

[0011] According to the present invention, sounds corresponding to a variety of playing styles can be reproduced by the user simply operating the controls.

[0012] 1 is a diagram showing the configuration of a keyboard device according to one embodiment of the present invention; FIG. 2 is a block diagram showing the functional configuration of the keyboard device; FIG. 3 is a graph showing an example of the relationship between key depression amount and position; FIG. 4 is a diagram showing a key assembly that interlocks with a key of a keyboard device according to one embodiment of the present invention; FIG. 5 is a diagram showing a key assembly that interlocks with a key of a keyboard device according to one embodiment of the present invention; FIG. 6 is a block diagram showing an example of the functional configuration of a sound source in a keyboard device; FIG. 7 is a block diagram showing an example of the functional configuration of an adjustment section in the sound source; FIG. 8 is a flow diagram showing an example of sound signal generation processing in the sound source; FIG. 9 is a block diagram showing a sound source according to one modified example; FIG. 10 is a block diagram showing a sound source according to one modified example;

[0013] An embodiment of the present invention will be described in detail below with reference to the drawings. The embodiments described below are merely examples, and the present invention should not be construed as being limited to these embodiments. In the drawings referred to in this embodiment, identical parts or parts having similar functions are designated with the same or similar symbols (symbols consisting of a number followed by A, B, etc.), and repeated explanations may be omitted. For clarity of explanation, the drawings may be illustrated schematically, with dimensional ratios different from actual ratios and some components omitted from the drawings.

[0014] [Configuration of Keyboard Device] FIG. 1 is a diagram showing the configuration of a keyboard device 1 according to one embodiment of the present invention. The keyboard device 1 is an electronic keyboard instrument such as a synthesizer. FIG. 2 is a block diagram showing the functional configuration of the keyboard device 1. The keyboard device 1 has a plurality of keys 10 as performance controls. When a user operates the keys 10, sound is output from a speaker 13. The user can change the type of sound (tone) by operating the operation unit 15. For example, the user can set or change the tone of the sound output from the speaker 13 by selecting a desired instrument via the operation unit 15. Each component of the keyboard device 1 will be described with reference to FIGS. 1 and 2.

[0015] The keyboard device 1 includes a plurality of keys 10 (operators) mounted on a housing 17. The plurality of keys 10 are arranged in a single direction. Here, the direction in which the plurality of keys 10 are arranged is perpendicular to the single direction in which the keys 10 are arranged, and the direction in which the keys 10 are pressed is referred to as the downward direction. The downward direction roughly corresponds to the vertical direction.

[0016] The multiple keys 10 are rotatably supported relative to a housing 17. A speaker 13 is provided in the housing 17. A control unit 111, a memory unit 113, a sound source 115, and a first detection unit 117 are provided inside the housing 17. The components provided inside the housing 17 are connected via a bus 119.

[0017] The keyboard device 1 further includes a separate pedal device 20. The pedal device 20 includes a damper pedal 21 and a second detection unit 25. The pedal device 20 also includes a shift pedal 23, but this may be omitted. When the damper pedal 21 is operated, the second detection unit 25 detects the pedal operation amount (depression amount) of the damper pedal 21 and outputs the detected amount to the sound source 115.

[0018] The keyboard device 1 has an interface 118 for inputting and outputting signals to and from external devices. The interface 118 may be, for example, a terminal for outputting sound signals, a cable connection terminal for transmitting and receiving MIDI data, etc. In this example, by connecting the pedal device 20 to the interface 118, the second detection unit 25 is connected to the components arranged inside the housing 17 via the bus 119, and signals are exchanged between the pedal device 20 and the keyboard device 1.

[0019] The control unit 111 includes a processing circuit such as a CPU, and storage devices such as a RAM and a ROM. The control unit 111 executes a control program stored in the storage unit 113 using the CPU, thereby realizing various functions in the keyboard device 1.

[0020] The operation unit 15 is a device such as an operation button, a touch sensor, and a slider, and outputs a signal according to an input operation to the control unit 111. The display unit 19 displays a screen based on the control by the control unit 111.

[0021] The storage unit 113 is a storage device such as a non-volatile memory. The storage unit 113 stores a control program executed by the control unit 111. The storage unit 113 may also store parameters, waveform data, and the like used in the sound source 115.

[0022] The sound source 115 is a signal processing circuit that generates sound signals in response to playing operations on the keys 10. Specifically, the sound source 115 generates sound signals based on information output from a first detection unit 117 (described later), and outputs the generated sound signals to the speaker 13.

[0023] The speaker 13 amplifies and outputs the sound signal output from the sound source 115, thereby outputting a sound corresponding to the sound signal. Although Fig. 1 shows a case where two speakers 13 are provided in the keyboard device 1, the number of speakers 13 is not limited to two. Furthermore, if an external speaker is used, the speaker 13 can be omitted.

[0024] The first detection unit 117 includes a magnetic induction sensor disposed for each of the multiple keys 10. The sensor corresponding to each key 10 continuously detects the amount of depression of the key 10 within its rotation range. The amount of depression of the key 10 changes in response to the user's performance. The first detection unit 117 outputs to the sound source 115 key information identifying a pressed key 10 among the multiple keys 10 and depression amount information corresponding to the amount of depression of the identified key 10, in association with each other. The key information is, for example, a key number, or in other words, indicates the pitch corresponding to the pressed key 10. The depression amount information may indicate the actual value of the depression amount of the key 10, or a value calculated from the depression amount, such as velocity calculated from changes in the depression amount, or may be a combination of these.

[0025] The rotation range of the key 10 includes a first rotation range and a second rotation range. The first rotation range and the second rotation range do not overlap. The first rotation range extends from the rest position (starting position) of the key 10 to the end position (ending position). The second rotation range extends downward from the end position. FIG. 3 is a graph showing an example of the relationship between the depression amount and position of the key 10. As shown in FIG. 3, the depression amount of the key 10 at the rest position is set to 0, and the depression amount corresponding to the end position is set to the reference depression amount. In this case, the rotation range of the key 10 corresponding to a depression amount greater than 0 and less than the reference depression amount is the first rotation range. The rotation range of the key 10 corresponding to a depression amount exceeding the reference depression amount is the second rotation range. Note that the rotation range of the key 10 is not limited to the relationship between the depression amount and position of the key 10 shown in FIG. 3. For example, the second rotation range may be a rotation range of the key 10 corresponding to a pressing amount that exceeds the reference pressing amount by a predetermined amount or more. The rest position and the end position will be described in detail later.

[0026] 4 and 5 are diagrams showing the mechanical structure (key assembly) that works in conjunction with the keys 10 of the keyboard device 1 according to this embodiment. These diagrams show a schematic cross section of the keyboard device 1 cut along a plane perpendicular to one direction in which multiple keys 10 are arranged side by side.

[0027] Fig. 4 is a diagram illustrating the key 10 in the rest position. The rest position refers to the position in which the key 10 is not pressed. Fig. 5 is a diagram illustrating the key 10 in the end position. Figs. 4 and 5 show the configuration of the key 10 corresponding to the white key 10w. As the configuration corresponding to the black key 10b is the same as the configuration corresponding to the white key 10w, only the position of the black key 10b is shown, and the other configurations are omitted.

[0028] The frame 200 is fixed to the housing 17 and supports a plurality of keys 10 arranged in the left-right direction D1. In this embodiment, a first circuit board 700 is disposed on the upper surface of the frame 200 facing the keys 10. A second circuit board 750 is held on the lower surface of the key 10 facing the upper surface of the frame 200.

[0029] The first circuit board 700 and the second circuit board 750 are elements that make up a magnetic induction sensor and are included in the first detection unit 117. The specific configuration of a magnetic induction sensor is disclosed, for example, in Japanese Patent No. 7306477. The second circuit board 750 is provided for each key 10. In this example, the first circuit board 700 is provided for multiple keys 10, but it may also be provided for each key 10.

[0030] The load units 30 are arranged corresponding to the respective keys 10. The load units 30 and keys 10 are connected to each other and thus work together. The load units 30 include a weight unit 305. When the key 10 is not pressed, the weight unit 305 rests on a lower stopper 351, holding the key 10 in a rest position (corresponding to when the key is released). The lower stopper 351 and upper stopper 353 are supported by the frame 20. Note that the keyboard device 1 does not necessarily need to be provided with a load unit 30. In this case, a structure for restricting the depression range of the key 10 may be provided.

[0031] As shown in FIG. 4 , when the key 10 is in the rest position, the depression amount is 0 (zero), and the depression amount information output by the first detection unit 117 is a value indicating a depression amount of "0 (zero)." The value of the depression amount information indicating a depression amount of "0 (zero)" is preset. When the key 10 is depressed in the state shown in FIG. 4 , as shown in FIG. 5 , the load unit 30 rotates in conjunction with the rotation of the key 10, causing the weight unit 305 to move upward and collide with the upper stopper 353, restricting further movement of the weight unit 305. The end position indicates the position of the key 10 where the key 10 collides with the upper stopper 353 and restricts further movement of the weight unit 305. At this time, the first circuit board 700 and the second circuit board 750 approach each other, as shown in FIG. 5 . The pressing amount information output by the first detection unit 117 described above is information corresponding to the distance between the first circuit board 700 and the second circuit board 750 (i.e., the relative positional relationship between the first circuit board 700 and the second circuit board 750).

[0032] As shown in Fig. 5, when the key 10 is in the end position, the depression amount information output by the first detection unit 117 indicates a reference depression amount. As described above, the reference depression amount is the depression amount when the key 10 is in the end position as shown in Fig. 5, and the value of the depression amount information corresponding to the reference depression amount is set in advance. When the key 10 is between the rest position and the end position, the depression amount information output by the first detection unit 117 indicates a depression amount between "0 (zero)" and the reference depression amount.

[0033] When the key 10 is further pressed down from the state shown in Fig. 5, the key 10, frame 200, upper stopper 353, etc., elastically deform, causing the key 10 to move further downward from its end position. As a result, the first circuit board 700 and the second circuit board 750 become closer to each other than in the state shown in Fig. 5. At this time, the pressing amount information output by the first detection unit 117 indicates a pressing amount that exceeds the reference pressing amount.

[0034] 6 is a block diagram showing an example of the functional configuration of the sound source 115 in the keyboard device 1. The sound source 115 generates a sound signal based on information input from the first detection unit 117 and the second detection unit 25, and outputs the sound signal to the speaker 103. The sound signal generated by the sound source 115 is obtained for each operation on the key 101. Then, multiple sound signals obtained by multiple key presses are synthesized and output from the sound source 115. The sound source 115 includes a press amount determination unit 501, an acquisition unit 505, a sound signal generation unit 507, a waveform data storage unit 508, and an output unit 509.

[0035] The depression amount determination unit 501 acquires key information and depression amount information corresponding to the pressed key 10 from the first detection unit 117. Based on the acquired depression amount information, the depression amount determination unit 501 determines whether the position of the pressed key 10 is within the first rotation range or the second rotation range.

[0036] The pressing amount determination unit 501 determines whether the value of the acquired pressing amount information is within a predetermined range of values ​​indicating a pressing amount within the first rotation range or within a predetermined range of values ​​indicating a pressing amount within the second rotation range. Specifically, the pressing amount determination unit 501 determines whether the value of the acquired pressing amount information is equal to or less than a reference pressing amount or exceeds the reference pressing amount. If the value of the acquired pressing amount information is equal to or less than the reference pressing amount, the pressing amount determination unit 501 determines that the value of the acquired pressing amount information indicates a pressing amount within the first rotation range. On the other hand, if the value of the acquired pressing amount information is a value exceeding the reference pressing amount, the pressing amount determination unit 501 determines that the value of the acquired pressing amount information indicates a pressing amount within the second rotation range. In other words, the pressing amount determination unit 501 determines whether the position of the pressed key 10 is within the first rotation range or the second rotation range. The depression amount determination unit 501 outputs the key information and depression amount information corresponding to the pressed key 10 together with the determination result to the acquisition unit 505 .

[0037] The acquisition unit 505 acquires the determination result and key information and depression amount information corresponding to the pressed key 10 from the depression amount determination unit 501. Based on the determination result, the acquisition unit 505 outputs the key information and depression amount information acquired from the depression amount determination unit 501 to the sound signal generation unit 507. The sound signal generation unit 507 includes a signal processing unit 511 and an adjustment unit 513. If the acquisition unit 505 determines that the value of the depression amount information indicates a depression amount within the first rotation range, it outputs the key information and depression amount information corresponding to the pressed key 10 to the signal processing unit 511. If the acquisition unit 505 determines that the value of the depression amount information indicates a depression amount within the second rotation range, it outputs the key information and depression amount information corresponding to the pressed key 10 to the adjustment unit 513.

[0038] If it is determined that the value of the depression amount information indicates a depression amount within the first rotation range, the signal processing unit 511 acquires key information and depression amount information corresponding to the pressed key 10 from the acquisition unit 505. Based on the acquired key information and depression amount information, the signal processing unit 511 generates a sound generation control signal that specifies the sound generation content. Here, the sound generation control signal is MIDI-format data and includes a note number (Note), a note-on signal (Non), a note-off signal (Noff), and a velocity (Vel). The signal processing unit 511 also sets a volume designation value based on the velocity (Vel). Alternatively, the signal processing unit 511 may calculate the key depression velocity of the pressed key 10 using a predetermined calculation based on the depression amount information, instead of the velocity (Vel), and set the volume designation value based on the calculated key depression velocity.

[0039] The signal processing unit 511 reads and acquires sound waveform data corresponding to the pressed key 10 from the waveform data storage unit 508 based on the note number (Note) and the note-on signal (Non). The waveform data storage unit 508 stores sound waveform data corresponding to the pitch of each key 10. The waveform data storage unit 508 stores sound waveform data corresponding to multiple timbres for each pitch. For example, the waveform data storage unit 508 may include sound waveform data corresponding to the timbres of various musical instruments for each pitch. The signal processing unit 511 acquires sound waveform data corresponding to the type of musical instrument specified by the user via the operation unit 15 from the waveform data storage unit 508. The signal processing unit 511 starts reading sound waveform data when the note-on signal (Non) corresponding to the pressed key 10 is output, and continues reading sound waveform data until the note-off signal (Noff) is output. In other words, the signal processing unit 511 controls the tone generation period of the pressed key 10 based on key information and depression amount information for the pressed key 10 within the first rotation range. The sounding period includes the sounding timing.

[0040] The signal processing unit 511 may acquire the pedal operation amount output from the second detection unit 25. In this case, the signal processing unit 511 sets parameters for controlling the envelope of the sound signal generated by the sound signal generation unit 507 based on the acquired pedal operation amount, and generates envelope waveform data based on the set parameters. Note that when the pedal operation amount is not output from the second detection unit 25, that is, when the damper pedal 21 is not operated, the signal processing unit 511 generates predetermined envelope waveform data.

[0041] The signal processing unit 511 multiplies the sound waveform data by the envelope waveform data, and further amplifies the waveform data obtained by multiplying the sound waveform data by the envelope waveform data using an amplifier (not shown) at an amplification factor determined based on the volume specification value, thereby generating a sound signal corresponding to the pressed key 10. The signal processing unit 511 outputs the generated sound signal to the output unit 509. Although not shown, the signal processing unit 511 also includes various filters and additional components for processing the sound signal.

[0042] If it is determined that the value of the depression amount information indicates a depression amount within the second rotation range, the adjustment unit 513 acquires key information and depression amount information corresponding to the pressed key 10 from the acquisition unit 505. Fig. 7 is a block diagram showing an example of the functional configuration of the adjustment unit 513. The adjustment unit 513 includes a determination unit 601, a comparison unit 603, and a control signal generation unit 605.

[0043] The determination unit 601 acquires the key information and depression amount information output from the acquisition unit 505. Based on the acquired key information and depression amount information, the determination unit 601 determines whether two or more keys 10 are located in the second rotation range during the same period, in other words, whether two or more keys 10 are located below the end position during the same period. If two or more keys 10 are located in the second rotation range during the same period, the determination unit 601 outputs the key information and depression amount information corresponding to the two or more keys 10 to the comparison unit 603.

[0044] The comparison unit 603 determines the relative relationship between the press amounts of two or more keys 10 based on the key information and press amount information corresponding to each of the two or more keys 10. Here, the relative relationship between the press amounts of two or more keys 10 includes the relative magnitude relationship between the press amounts of the two or more keys 10 and the difference between the press amounts of two or more predetermined keys 10. For example, the comparison unit 603 can determine the relative magnitude relationship between the press amounts of two or more keys 10 based on the values ​​of the press amount information corresponding to each key 10 (press amounts indicated by the press amount information). Alternatively, the comparison unit 603 can determine the relative magnitude relationship between the press amounts of two or more keys 10 based on the difference between the press amounts indicated by the press amount information corresponding to each key 10 and a reference press amount. In other words, the comparison unit 603 determines the relative positional relationship between two or more keys 10 based on the press amount information of the two or more keys 10 positioned within the second rotation range during the same period.

[0045] Furthermore, the comparison unit 603 may calculate the difference between the press-down amount information corresponding to two or more keys 10. For example, if there are two keys 10 positioned within the second rotation range during the same period, the comparison unit 603 may calculate the difference between the absolute values ​​of the press-down amounts indicated by the press-down amount information corresponding to the two keys 10. Alternatively, if there are three or more keys positioned within the second rotation range during the same period, the comparison unit 603 may calculate the difference between the absolute values ​​of the press-down amount indicated by the press-down amount information of two specified keys 10 among the three or more keys 10, with the largest absolute value and the smallest absolute value of the press-down amount indicated by the press-down amount information.

[0046] The comparison unit 603 outputs the comparison result to the control signal generation unit 605. The comparison result includes key information corresponding to two or more keys 10, depression amount information, and information indicating the relative relationship between the depression amounts of the two or more keys 10.

[0047] The control signal generating unit 605 generates a control signal based on the comparison result obtained from the comparing unit 603. The control signal is a signal for performing predetermined signal processing on the sound signal generated by the signal processing unit 511. The types of signal processing are set in advance, and the control signal generating unit 605 generates a control signal for controlling the sound signal in accordance with the comparison result. Here, controlling the sound signal means performing predetermined processing on the sound signal. The control signal generating unit 605 determines the type of signal processing to be applied to the sound signal based on the comparison result, and generates a control signal for performing the determined signal processing.

[0048] The following describes a case where two keys 10 are located within the second rotation range during the same period. In this case, the comparison result includes key information corresponding to the two keys 10, key press amount information, and the relative relationship between the key press amounts of the two keys 10. Here, the relative relationship between the key press amounts includes at least one of the relative magnitude relationship between the key press amounts of the two keys 10 and the difference in absolute values ​​of the key press amounts of the two keys 10. Based on this information, the control signal generator 605 determines the signal processing to be applied to the sound signal.

[0049] The control signal generating unit 605 may determine a first control (first signal processing) based on the key information corresponding to the two keys 10 and the relative magnitude of the depression amounts of the two keys 10. For example, if the depression amount of the key 10 with a higher pitch is greater than the other key 10, the control signal generating unit 605 may determine to perform signal processing to gradually change the volume. In this case, the control signal generating unit 605 may determine a second control (second signal processing) different from the first control based on the magnitude of the depression amount indicated by the depression amount information of one of the two keys 10 or the difference in absolute values ​​of the depression amounts indicated by the depression amount information of the two keys 10. For example, if the depression amount indicated by the depression amount information of the key 10 with a higher pitch is equal to or greater than a predetermined value, the control signal generating unit 605 may determine to perform signal processing to gradually increase the volume in the signal processing to gradually change the volume. Conversely, if the depression amount indicated by the depression amount information for the key 10 with a lower pitch is equal to or greater than a predetermined value, the signal processing unit 605 may determine to perform signal processing to gradually decrease the volume in the signal processing that gradually changes the volume. Alternatively, if the difference in the absolute values ​​of the depression amounts indicated by the depression amount information for the two keys 10 is equal to or greater than a predetermined value, the control signal generation unit 605 may determine to perform signal processing to increase the amount of change in volume, or conversely, if the difference in the absolute values ​​of the depression amounts indicated by the depression amount information for the two keys 10 is less than the predetermined value, determine to perform signal processing to decrease the amount of change in volume.

[0050] The control signal generation unit 605 generates a control signal for performing the determined signal processing and outputs the generated control signal to the signal processing unit 511. The signal processing unit 511 controls the sound signal based on the control signal acquired from the control signal generation unit 605. Specifically, the signal processing unit 511 sets and applies parameters of each component for signal processing in the signal processing unit 511 based on the control signal. For example, if the control signal instructs to perform control to gradually increase the volume, the signal processing unit 511 sets an amplification factor based on the control signal and applies the amplification factor to the amplifier. Furthermore, for example, if the control signal instructs to perform control to change the frequency, the signal processing unit 511 sets parameters for removing a desired frequency and applies the parameters to a filter.

[0051] The signal processing based on the control signal may be applied to the sound signal, to waveform data obtained by multiplying sound waveform data by envelope waveform data, or to the sound waveform data. In this way, when the positions of two or more keys 10 are within the second rotation range, i.e., have exceeded their end positions, the signal processing unit 511 generates a sound signal in response to the control signal generated based on the key information and depression amount information of the two or more keys 10 during the same period.

[0052] If the determination unit 601 determines that two or more keys 10 are not located within the second rotation range during the same period, the determination unit 601 outputs the determination result to the control signal generation unit 605. In this case, the control signal generation unit 605 generates a control signal indicating that no processing is to be applied to the sound signal generated based on the key information and depression amount information, and outputs the control signal to the signal processing unit 511.

[0053] The output unit 509 outputs the generated sound signal to the speaker 13. The speaker 13 generates sound based on the input sound signal.

[0054] As described above, if the pressing amount determination unit 501 determines that the value of the pressing amount information indicates a pressing amount within the first rotation range, the acquisition unit 505 outputs the key information and pressing amount information corresponding to the pressed key 10 based on the determination result to the signal processing unit 511, and the signal processing unit 511 generates a sound signal based on the acquired key information and pressing amount information. In this case, the acquisition unit 505 may also output the key information and pressing amount information corresponding to the pressed key 10 to the adjustment unit 513. If the value of the pressing amount information is determined to indicate a pressing amount within the first rotation range, the control signal generation unit 605 may generate a control signal indicating that no processing is to be applied to the sound signal generated based on the key information and pressing amount information based on the determination result, and output the control signal to the signal processing unit 511.

[0055] 8 is a flow diagram showing an example of a sound signal generation process in the sound source 115. First, the pressing amount determination unit 501 acquires key information and pressing amount information corresponding to the pressed key 10 from the first detection unit 117 (S701), and determines whether the pressed key 10 is in the first rotation range based on the acquired pressing amount information (S702). In other words, the pressing amount determination unit 501 determines whether the pressed key 10 is in the first rotation range or the second rotation range. The pressing amount determination unit 501 outputs the determination result to the acquisition unit 505 together with the key information and pressing amount information corresponding to the pressed key 10.

[0056] If it is determined that the pressed key 10 is within the first rotation range (S702: Yes), the acquisition unit 505 outputs the key information and depression amount information corresponding to the pressed key 10 to the signal processing unit 511. The signal processing unit 511 generates a sound signal based on the acquired key information and depression amount information (S703), and the process returns to S701. On the other hand, if it is determined that the pressed key 10 is not within the first rotation range (S702: No), the acquisition unit 505 outputs the key information and depression amount information of the pressed key 10 to the determination unit 601 of the adjustment unit 513.

[0057] Based on the acquired key information and depression amount information of the keys 10, the determination unit 601 determines whether two or more keys 10 have been pressed during the same period (S704). If it is determined that two or more keys 10 have not been pressed during the same period (S704: No), the determination unit 601 outputs the determination result to the control signal generation unit 605. Based on the determination result, the control signal generation unit 605 generates a control signal indicating that no processing is to be applied to the sound signal generated based on the key information and depression amount information (S705), and proceeds to the processing of S711.

[0058] On the other hand, if it is determined that two or more keys 10 are pressed simultaneously (S704; Yes), the comparison unit 603 determines the relative relationship between the press amounts of the two or more keys 10 based on the press amount information (S706). The relative relationship between the press amounts of the two or more keys 10 includes the relative magnitude relationship between the press amounts of the two or more keys 10, the difference between the press amounts of two or more predetermined keys 10, etc.

[0059] The control signal generating unit 605 generates a control signal for performing predetermined control on the sound signal based on the key information of two or more keys, the depression amount information, and the comparison result generated in the process of S706 (S707). The control signal generating unit 605 outputs the generated control signal to the signal processing unit 511, and the signal processing unit 511 generates a sound signal controlled based on the control signal (S708), and the process returns to the process of S701.

[0060] In this way, during a performance operation, the user can apply the desired processing to the sound simply by pressing the keys 10, without performing any additional operations on the operation unit 15. Therefore, the keyboard device 1 can reproduce sounds corresponding to a variety of playing styles by simply operating the keys 10 by the user.

[0061] [Modifications] Modifications of the embodiments of the present invention will be described below.

[0062] [Variation 1] The control based on the pressing amount information exceeding the reference pressing amount, which is output when the key 10 is pressed downward from the end position, includes various controls, such as a control that gradually changes the volume, a control that changes the playing style such as adding vibrato, tremolo, or harmonics, a control that changes the frequency of the sound, a control that adds noise such as strum noise, a control that controls the duration of a predetermined control, the amount of change in pitch when adding vibrato, the amount of change in volume when adding tremolo, and a control related to the accompaniment sound that is output along with the sound reproduced by the keyboard device 1.

[0063] [Variation 2] In the above embodiment, it has been explained that the control (type of signal processing) for the sound signal is determined based on the comparison result, based on the key information corresponding to the pressed keys 10, the relative magnitude of the depression amounts of the pressed keys 10, the magnitude of the values ​​of the depression amount information for any of the pressed keys 10, and the difference in the absolute values ​​of the depression amount information. However, the control for the sound signal is determined based on at least one of the key information corresponding to the pressed keys 10, the relative magnitude of the depression amounts of the pressed keys 10, the magnitude of the values ​​of the depression amount for the pressed keys 10, and the difference in the absolute values ​​of the depression amounts.

[0064] For example, when two or more keys 10 are simultaneously pressed downward from the end position, the control of the sound signal may be determined based on a combination of key information corresponding to the pressed keys 10 and the magnitude relationship of the pressed amounts of the pressed keys 10. Alternatively, the control of the sound signal may be determined based on a combination of key information corresponding to the pressed keys 10 and the magnitude of the pressed amounts of the pressed keys 10. Alternatively, the control of the sound signal may be determined based on a combination of key information corresponding to the pressed keys 10, the magnitude relationship of the pressed amounts of the pressed keys 10, and the difference in the absolute values ​​of the pressed amounts of the pressed keys 10. Alternatively, the control of the sound signal may be determined based on a combination of key information corresponding to the pressed keys 10, the magnitude relationship of the pressed amounts of the pressed keys 10, the magnitude of the pressed amounts of the pressed keys 10, and the difference in the absolute values ​​of the pressed amounts of the pressed keys 10.

[0065] For example, a control signal may be generated that instructs the application of vibrato to a sound signal (first control) based on key information corresponding to the pressed keys 10 and the relative magnitude of the depression amounts of the pressed keys 10. Furthermore, in addition to the application of vibrato (first control), a control signal may be generated that specifies the amount of pitch change of the vibrato to be applied (second control) based on the depression amount of any of the pressed keys 10. Alternatively, a note to which vibrato is to be applied may be specified based on the depression amount of any of the pressed keys 10. Furthermore, in addition to the application of vibrato (first control), the specification of the amount of pitch change of the vibrato, or the specification of the note to which vibrato is to be applied (second control), a control signal may be generated that specifies the period over which the vibrato is to be applied based on the difference in absolute values ​​of the depression amounts of the pressed keys 10.

[0066] The type of control determined based on the key information and depression amount information corresponding to the pressed key 10 is set in advance. For example, a table that associates each control imparted to a sound signal with the corresponding key information and the numerical value of each piece of information based on the depression amount information may be stored in the keyboard device 1 or an external device that can communicate with the keyboard device 1. The control signal generation unit 605 of the sound source 115 may refer to this table to determine the control corresponding to the comparison result obtained from the comparison unit 603.

[0067] [Variation 3] In the above embodiment, the control signal generated by the control signal generating unit 605 is output to the signal processing unit 511. However, the control signal may be output to an external device that can communicate with the keyboard apparatus 1. For example, a conceivable embodiment is one in which the control determined based on information based on key information corresponding to the pressed key 10 and depression amount information is control related to accompaniment sounds, and the accompaniment sounds are generated in an external device. In this case, the control signal generated by the control signal generating unit 605 is output to the external device. Note that when the accompaniment sounds are generated in the keyboard apparatus 1, the control signal is output to the signal processing unit 511 or a configuration for generating accompaniment sounds, as in the above embodiment.

[0068] FIG. 9 is a block diagram showing a sound source 115A according to this modification. When the control determined based on the key information and depression amount information of the pressed key 10 is related to accompaniment sounds, the adjustment unit 513A outputs the determined control signal to an accompaniment sound generation unit 903, which generates accompaniment sounds. The accompaniment sound generation unit 903 may be included in an external device 9 capable of communicating with the keyboard apparatus 1. The accompaniment sound generation unit 903 reads song data designated by the user from a song data storage unit 901, which stores various song data. The accompaniment sound generation unit 903 processes the song data based on the control signal obtained from the adjustment unit 513A and outputs the processed song data as an accompaniment sound signal to the output unit 509. Here, the song data storage unit 901 may be included in an external storage device capable of communicating with the external device 9. Furthermore, when accompaniment sounds are generated by the keyboard apparatus 1, the accompaniment sound signal generation unit 903 may be included in the sound source 115A.

[0069] [Variation 4] In the above embodiment, the first detection unit 117 includes a magnetic induction sensor provided for each of the multiple keys 10. However, the sensors included in the first detection unit 117 are not limited to magnetic induction sensors. For example, the first detection unit 117 may include a switch sensor and a pressure sensor. In this case, the amount of depression of the key 10 in the first rotation range may be detected by two or more switch sensors provided for each key 10, and the amount of depression of the key 10 in the second rotation range may be measured by a pressure sensor provided for each key 10.

[0070] 10 is a block diagram showing a sound source 115B according to this modification. In this modification, the first detection unit 117B includes a switch sensor 117-1 and a pressure sensor 117-2. The switch sensor 117-1 includes two or more switch sensors. The first detection unit 117B outputs key information and depression amount information corresponding to the pressed key 10. The key information and depression amount information output from the first detection unit 117B includes the key information and depression amount information output from the switch sensor 117-1 and the key information and depression amount information output from the pressure sensor 117-2. The depression amount determination unit 501B acquires the key information and depression amount information corresponding to the pressed key 10 from the first detection unit 117B. The press-down amount determination unit 501B determines whether the acquired key information and press-down amount information have been output from the switch sensor 117-1 or the pressure-sensitive sensor 117-2, and outputs the acquired key information and press-down amount information together with the determination result to the acquisition unit 505B. The acquisition unit 505B outputs the acquired key information and press-down amount information to the signal processing unit 511 or the adjustment unit 513 based on the determination result. Specifically, if the key information and press-down amount information have been output from the switch sensor 117-1, the acquisition unit 505B outputs the key information and press-down amount information to the signal processing unit 511. Furthermore, if the key information and press-down amount information have been output from the pressure-sensitive sensor 117-2, the acquisition unit 505B outputs the key information and press-down amount information to the adjustment unit 513. The processing in the signal processing unit 511 and the adjustment unit 513 is the same as in the above-described embodiment.

[0071] The sensor included in the first detection unit 117 may be an optical sensor that can continuously detect the amount of depression of the key 10 (the position of the key 10). In this case, the first detection unit 117 may include an optical sensor provided for each key 10.

[0072] [Variation 5] In the above embodiment, when three or more keys are simultaneously pressed below the end position, the comparison unit 603 may calculate the difference in absolute value between the largest and smallest absolute pressing amounts among the three or more keys 10 based on the pressing amount information. However, this is not limited to this. For example, two keys 10 may be selected based on the pitches corresponding to the pressed keys 10, and the pressing amounts of the selected two keys 10 may be compared. In this case, the two keys 10 selected based on the pitch may be the lowest and highest keys, or the A-th key from the highest and the B-th key from the lowest (A and B are both natural numbers), based on the key information. Alternatively, the two keys 10 may be selected based on the magnitude of the pressing amounts. In this case, the two keys 10 selected based on the amount of depression may be the key 10 corresponding to the amount of depression with the largest absolute value and the key 10 corresponding to the amount of depression with the smallest absolute value, as in the above-described embodiment, or may be the key 10 whose absolute value of the amount of depression is the Ath key from the maximum and the key 10 whose absolute value of the amount of depression is the Bth key from the minimum (A and B are both natural numbers).

[0073] Furthermore, if the number of keys pressed downward from the end position during the same period is three or more, the determination of the control to be applied to the sound may be made more complex based on the key information and pressing amount information of the three or more pressed keys 10.

[0074] 1: keyboard device, 9: external device, 10: key, 13: speaker, 15: operation unit, 17: housing, 19: display unit, 20: pedal device, 21: damper pedal, 25: second detection unit, 30: load unit, 111: control unit, 113: memory unit, 115, 115A, 115B: sound source, 117, 117B: first detection unit, 117-1: switch sensor, 117-2: pressure sensor, 305: weight unit, 351: lower switch Topper, 353: upper stopper, 501, 501B: pressing amount determination unit, 505, 505B: acquisition unit, 507: sound signal generation unit, 508: waveform data storage unit, 509: output unit, 511: signal processing unit, 513, 513A: adjustment unit, 601: determination unit, 603: comparison unit, 605: control signal generation unit, 700: first circuit board, 750: second circuit board, 901: song data storage unit, 903: accompaniment sound generation unit

Claims

1. A keyboard device comprising: a plurality of keys; an acquisition unit that acquires information identifying which of the plurality of keys has been pressed and the amount of depression of the pressed keys; and, when the number of pressed keys is two or more and the amount of depression of two or more pressed keys each exceeds a reference amount of depression, a sound signal generation unit that generates a sound signal based on the relative relationship between the amounts of depression of the two or more keys, the information identifying the pressed keys, and the amount of depression of the pressed keys.

2. The keyboard device according to claim 1, wherein the sound signal generating section determines the timing of sound generation for the sound corresponding to the pressed key based on the amount of pressing of the pressed key before the reference amount of pressing is reached.

3. The keyboard device according to claim 1, wherein the relative relationship is a relative magnitude relationship between the amounts of depression of the two or more keys.

4. The keyboard device according to claim 1, wherein the relative relationship is a difference between absolute values ​​of the amounts of depression of the two or more keys.

5. A keyboard device comprising: a plurality of keys; an acquisition unit that acquires information identifying which keys among the plurality of keys have been pressed and the amount of depression of the pressed keys; a control signal generation unit that generates a control signal in accordance with the relative relationship between the amounts of depression of the two or more keys if the number of pressed keys is two or more and the amounts of depression of two or more keys exceed a reference amount; and a sound signal generation unit that generates a sound signal based on the information identifying the pressed keys and the amount of depression of the pressed keys.

6. The keyboard device according to claim 5, wherein the sound signal generating section determines the timing of sound generation for the sound corresponding to the pressed key based on the amount of pressing of the pressed key before the reference amount of pressing is reached.

7. A keyboard device as described in claim 5, wherein the relative relationship is a relative magnitude relationship between the amounts of depression of the two or more keys, and the control signal generating unit generates the control signal for instructing a first control based on the relative magnitude relationship.

8. A keyboard device as described in claim 7, wherein the control signal generating unit generates the control signal for instructing a second control different from the first control based on the amount of depression of a key that is depressed relatively larger than the amount of depression of the two or more keys.

9. A sound generation method comprising: acquiring information identifying one of a plurality of operators and an amount of pressing of the identified operator; and, if the number of the identified operators is two or more and the amounts of pressing of two or more of the operators exceed a reference amount of pressing, generating a sound signal based on the relative relationship between the amounts of pressing of the two or more operators, the information identifying the operator, and the amounts of pressing of the identified operator.

10. A sound generation method comprising: acquiring information identifying one of a plurality of operators and an amount of depression of the identified operator; generating a sound signal based on the information identifying the operator and the amount of depression of the identified operator; and, if the number of the identified operators is two or more and the amounts of depression of two or more of the operators each exceed a reference amount of depression, generating a control signal in accordance with the relative relationship between the amounts of depression of the two or more operators.

11. A program for causing a computer to execute the sound generation method according to claim 9 or 10.

Citation Information

Patent Citations

  • Audio signal generating device, keyboard instrument, and program

    WO2020054070A1

  • Performance operation device

    WO2021100475A1