Sound system and electronic musical instrument
By binaural processing and trans-ear processing of the echo signal, the second echo signal is generated and the dipole-type speakers are radiated, the problem of difference in direct sound and echo delay in the sound image positioning process is solved, and the perception of the sound system is improved Effect.
Patent Information
- Application Number
- CN202280093870.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-03-22
- Filing Date
- 2022-06-16
- Publication Date
- 2024-11-01
AI Technical Summary
When performing the audio-image positioning process, the difference in radiation delay between direct sound and echo sound is easily perceived by the listener, resulting in perceived unnatural phenomena.
The signal processing unit uses binaural processing and trans-ear processing technology to process the echo signal, generate a second echo signal, and radiate through dipole speakers to suppress the delay of direct sound, while fully sensing the sense of depth or expansion. Echo sound.
It effectively suppresses the delay of direct sound, enhances the sense of depth or expansion of the echo sound, improves the audio experience, and avoids the problem of echo sound delay caused by signal processing.
Smart Images

Figure CN118891670A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a technology for emitting sound corresponding to an acoustic signal. Background Art
[0002] Various techniques for controlling the sound image perceived by a listener have been proposed in the past. For example, Patent Document 1 discloses a technique for controlling the position of a sound image by reproducing an acoustic signal generated by sound image localization processing using a stereo dipole speaker.
[0003] Prior art literature
[0004] Patent Literature
[0005] Patent Document 1: Japanese Patent Application Publication No. 2000-333297 Summary of the invention
[0006] Problems to be solved by the invention
[0007] Consider the case where direct sound that reaches a listener directly from a sound source and the reverberation (reverberation) sound corresponding to the direct sound are reproduced. When sound image localization processing is performed on an audio signal that includes both direct sound and reverberation sound, the radiation of the direct sound and the reverberation sound is delayed due to the sound image localization processing. There is a problem that the delay of the direct sound is more easily perceived by the listener than the delay of the reverberation sound. Considering the above situation, one purpose of the present invention is to suppress the delay of the direct sound while radiating reverberation sound that allows a sufficient sense of depth or expansion.
[0008] Means for solving problems
[0009] In order to solve the above problems, an audio system involved in one embodiment of the present invention comprises: a signal acquisition unit, which acquires an audio signal and a first echo signal representing a waveform of an echo sound corresponding to the audio signal; a signal processing unit, which generates a second echo signal by performing binaural processing and trans-aural processing on the first echo signal; a first speaker, which radiates a sound corresponding to the audio signal; and a dipole-type second speaker, which radiates an echo sound corresponding to the second echo signal.
[0010] An electronic musical instrument involved in one embodiment of the present disclosure includes: an operation acceptance unit that accepts a performance operation performed by a user; a signal generation unit that generates an acoustic signal corresponding to the operation on the operation acceptance unit; an echo generation unit that generates a first echo signal representing a waveform of an echo sound corresponding to the acoustic signal; a signal processing unit that generates a second echo signal by performing binaural processing and transaural processing on the first echo signal; a first speaker that radiates a sound corresponding to the acoustic signal; and a dipole-type second speaker that radiates an echo sound corresponding to the second echo signal. BRIEF DESCRIPTION OF THE DRAWINGS
[0011] Figure 1 It is a front view of the electronic musical instrument.
[0012] Figure 2 This is a block diagram illustrating the electrical structure of an electronic musical instrument.
[0013] Figure 3 This is a block diagram illustrating the functional structure of an electronic musical instrument.
[0014] Figure 4 This is an illustration of binaural processing.
[0015] Figure 5 This is an illustration of the cross-ear treatment.
[0016] Figure 6 This is a flowchart of the processing executed by the control device.
[0017] Figure 7 It is a front view of the electronic musical instrument in the second embodiment.
[0018] Figure 8 It is a front view of the electronic musical instrument in the third embodiment.
[0019] Fig. 9 It is a front view of the electronic musical instrument in the fourth embodiment. DETAILED DESCRIPTION
[0020] A: First Implementation
[0021] Figure 1 1 is a front view of the electronic musical instrument 100 according to the first embodiment. The electronic musical instrument 100 is a keyboard musical instrument including a keyboard 11 and a housing 12. The electronic musical instrument 100 is an example of a "sound system".
[0022] The keyboard 11 is composed of a plurality of keys 13 (white keys and black keys) corresponding to different pitches. The plurality of keys 13 are arranged along the X-axis. The user plays a desired piece of music by sequentially operating each of the plurality of keys 13. That is, the keyboard 11 is an operation receiving unit that receives a performance operation performed by the user. The direction of the X-axis is the long side direction of the keyboard 11, which is equivalent to the left and right direction of the user playing the electronic musical instrument 100.
[0023] The frame 12 is a structure that supports the keyboard 11. Specifically, the frame 12 includes: a right arm 121, a left arm 122, a shelf 123 (key slip), an upper front plate 124, a lower front plate 125, and a top plate 126 (top of the piano). The shelf 123 is a plate-shaped component that supports the keyboard 11 from below in the vertical direction. The keyboard 11 and the shelf 123 are arranged between the right arm 121 and the left arm 122. The upper front plate 124 and the lower front plate 125 are flat plate materials that constitute the front of the frame 12 and are arranged parallel to the vertical direction. The upper front plate 124 is located above the keyboard 11, and the lower front plate 125 is located below the keyboard 11. The top plate 126 is a flat plate material that constitutes the top surface of the frame 12. A gap along the X-axis is formed between the upper front plate 124 and the top plate 126.
[0024] In the following description, a reference plane C is assumed. The reference plane C is a symmetric plane of the electronic musical instrument 100. That is, the reference plane C is a virtual plane perpendicular to the X-axis and passes through the midpoint of the keyboard 11 in the direction of the X-axis.
[0025] Figure 2 1 is a block diagram illustrating an electrical structure of an electronic musical instrument 100. The electronic musical instrument 100 includes a control device 21, a storage device 22, a detection device 23, and a reproduction device 24. The control device 21 and the storage device 22 constitute a control system 20 for controlling the operation of the electronic musical instrument 100. In the first embodiment, the control system 20 is illustrated as being mounted on the electronic musical instrument 100, but the control system 20 may be configured separately from the electronic musical instrument 100. For example, the control system 20 may also be implemented by an information device such as a smartphone or a tablet terminal.
[0026] The control device 21 is a single or multiple processors that control the operation of the electronic musical instrument 100. Specifically, the control device 21 is composed of one or more processors such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an SPU (Sound Processing Unit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), or an ASIC (Application Specific Integrated Circuit).
[0027] The storage device 22 is a single memory or multiple memories that store programs executed by the control device 21 and various data used by the control device 21. For example, a well-known recording medium such as a semiconductor recording medium and a magnetic recording medium, or a combination of multiple recording media can be used as the storage device 22. In addition, for example, a portable recording medium that can be attached to and detached from the electronic musical instrument 100, or a recording medium that can be accessed by the control device 21 via a communication network (such as a cloud storage) can also be used as the storage device 22.
[0028] The detection device 23 is a sensor unit that detects an operation from a user on the keyboard 11. Specifically, the detection device 23 outputs performance information E that specifies a key 13 operated by a user among a plurality of keys 13 constituting the keyboard 11. The performance information E is, for example, MIDI (Musical Instrument Digital Interface) event data that specifies the number corresponding to the key 13 operated by the user.
[0029] The playback device 24 emits sounds corresponding to the user's operations on the keyboard 11 . Figure 3 1 is a block diagram illustrating a functional configuration of the electronic musical instrument 100. The reproduction device 24 includes a first speaker 31, a second speaker 32, and a headphone 33. The first speaker 31 and the second speaker 32 are provided in the housing 12. The headphone 33 is connected to the electronic musical instrument 100 by wire or wirelessly.
[0030] The first speaker 31 is a stereo speaker including a first left channel speaker 31L and a first right channel speaker 31R. Figure 1As shown in the example, the first speaker 31 is provided on the lower front plate 125 of the housing 12. Specifically, the first left channel speaker 31L and the first right channel speaker 31R are provided on the lower front plate 125 with a gap D1 in the direction of the X axis. Specifically, when viewed from the front of the electronic musical instrument 100, the first left channel speaker 31L is located on the left side of the reference plane C, and the first right channel speaker 31R is located on the right side of the reference plane C. The gap D1 is the distance between the central axis of the diaphragm of the first left channel speaker 31L and the central axis of the diaphragm of the first right channel speaker 31R. A virtual plane that exists at an equal distance from the central axis of the diaphragm of the first left channel speaker 31L and the central axis of the diaphragm of the first right channel speaker 31R can also be understood as the reference plane C.
[0031] Figure 3 The second speaker 32 is a dipole-type stereo speaker (i.e., stereo dipole speaker) including a second left channel speaker 32L and a second right channel speaker 32R. That is, the second left channel speaker 32L and the second right channel speaker 32R are disposed adjacent to each other, so that the user can perceive a stereo sound field. The second left channel speaker 32L and the second right channel speaker 32R have smaller diameters than the first left channel speaker 31L and the first right channel speaker 31R.
[0032] like Figure 1 As shown in the example, the second speaker 32 is provided along the upper edge in the vertical direction of the upper front plate 124. Specifically, the second speaker 32 is provided in the gap between the upper front plate 124 and the top plate 126 of the frame 12. The second left channel speaker 32L and the second right channel speaker 32R are provided with a gap D2 in the direction of the X axis. That is, when viewed from the front of the electronic musical instrument 100, the second left channel speaker 32L is located on the left side of the reference plane C, and the second right channel speaker 32R is located on the right side of the reference plane C. The gap D2 is the distance between the center axis of the diaphragm of the second left channel speaker 32L and the center axis of the diaphragm of the second right channel speaker 32R. As understood from the above description, the first speaker 31 and the second speaker 32 are located on opposite sides with the keyboard 11 sandwiched therebetween. In addition, a virtual plane existing at an equal distance from the center axis of the diaphragm of the second left channel speaker 32L and the center axis of the diaphragm of the second right channel speaker 32R can also be understood as the reference plane C.
[0033] As from Figure 1 As can be understood, the interval D1 between the first left channel speaker 31L and the first right channel speaker 31R is wider than the interval D2 between the second left channel speaker 32L and the second right channel speaker 32R (D1>D2).
[0034] The headphone 33 is a stereo headphone including a left ear speaker 33L and a right ear speaker 33R, and is worn on the user's head. The left ear speaker 33L and the right ear speaker 33R are connected to each other via a headband 331. The left ear speaker 33L is worn on the user's left ear, and the right ear speaker 33R is worn on the user's right ear.
[0035] like Figure 3 As shown in the example, the control device 21 functions as the sound processing unit 200 by executing the program stored in the storage device 22. The sound processing unit 200 generates a sound signal S (SL, SR), an echo (reverberation) signal Z (ZL, ZR), and a reproduction signal W (WL, WR). Specifically, the sound processing unit 200 includes a signal acquisition unit 40, a signal processing unit 50, and a reproduction processing unit 60.
[0036] The sound signal S is a stereo signal of left and right channels composed of a left channel sound signal SL and a right channel sound signal SR. The sound signal S is supplied to the first speaker 31. Specifically, the left channel sound signal SL is supplied to the first left channel speaker 31L, and the right channel sound signal SR is supplied to the first right channel speaker 31R. In addition, the D / A converter that converts the sound signal S from digital to analog and the amplifier that amplifies the sound signal S are omitted for convenience.
[0037] The reverberation signal Z is a stereo signal of left and right channels composed of a reverberation signal ZL for the left channel and a reverberation signal ZR for the right channel. The reverberation signal Z is supplied to the second speaker 32. Specifically, the reverberation signal ZL for the left channel is supplied to the second left channel speaker 32L, and the reverberation signal ZR for the right channel is supplied to the second right channel speaker 32R. In addition, the D / A converter that converts the reverberation signal Z from digital to analog and the amplifier that amplifies the reverberation signal Z are omitted for convenience. The reverberation signal Z is an example of a "second reverberation signal".
[0038] The reproduction signal W is a stereo signal of left and right channels composed of a reproduction signal WL of a left channel and a reproduction signal WR of a right channel. The reproduction signal W is supplied to the headphone 33. Specifically, the reproduction signal WL of the left channel is supplied to the left ear speaker 33L, and the reproduction signal WR of the right channel is supplied to the right ear speaker 33R. In addition, the D / A converter that converts the reproduction signal W from digital to analog and the amplifier that amplifies the reproduction signal W are omitted for convenience.
[0039] The signal acquisition unit 40 acquires the acoustic signal S (SL, SR) and the reverberation signal X (XL, XR). The reverberation signal X is a stereo signal of two left and right channels composed of a reverberation signal XL for the left channel and a reverberation signal XR for the right channel.
[0040] The signal acquisition unit 40 of the first embodiment includes a sound source unit 41 and an echo generation unit 42 (42L, 42R). The sound source unit 41 generates an acoustic signal S (SL, SR) corresponding to the user's operation on the keyboard 11. Specifically, the sound source unit 41 is a MIDI sound source that generates an acoustic signal S corresponding to the performance information E output by the detection device 23. That is, the acoustic signal S is a signal representing the waveform of a sound of a pitch corresponding to one or more keys 13 operated by the user. The sound source unit 41 is, for example, a software sound source implemented by the control device 21 executing a sound source program, or a hardware sound source implemented by an electronic circuit dedicated to the generation of the acoustic signal S. The acoustic signal S represents the waveform of a direct sound (dry sound) that does not include an echo sound. The sound source unit 41 is an example of a "signal generation unit".
[0041] The sound signal S generated by the sound source unit 41 is supplied to the first speaker 31. The first speaker 31 emits direct sound according to the sound signal S. Specifically, the first left channel speaker 31L emits direct sound according to the sound signal SL, and the first right channel speaker 31R emits direct sound according to the sound signal SR.
[0042] The reverberation generating unit 42L and the reverberation generating unit 42R generate a reverberation signal X (XL, XR) representing a waveform of a reverberation sound corresponding to the acoustic signal S. Specifically, the reverberation generating unit 42L generates the reverberation signal XL by performing reverberation processing on the acoustic signal SL. The reverberation generating unit 42R generates the reverberation signal XR by performing reverberation processing on the acoustic signal SR. The reverberation processing is a computational processing that simulates the sound reflection in a virtual acoustic space. The reverberation signal X (XL, XR) represents a waveform of a reverberation sound (wet sound) that does not contain a direct sound. The reverberation signal X is an example of a "first reverberation signal".
[0043] The signal processing unit 50 generates the reverberation signal Z (ZL, ZR) by performing signal processing on the reverberation signal X (XL, XR). The signal processing unit 50 of the first embodiment includes a first processing unit 51 and a second processing unit 52 .
[0044] The first processing unit 51 generates an intermediate signal Y (YL, YR) by performing binaural processing on the reverberation signal X. The intermediate signal Y is a stereo signal of two left and right channels composed of an intermediate signal YL for a left channel and an intermediate signal YR for a right channel.
[0045] Binaural processing is a signal processing for localizing a sound image at a specific position by assigning a head transfer characteristic F (F11, F12, F21, F22) to the reverberation signal X. Specifically, the first processing unit 51 is composed of four characteristic assigning units 511 (511a, 511b, 511c, 511d) and two adding units 512 (512L, 512R). Each characteristic assigning unit 511 performs a convolution operation for assigning the head transfer characteristic F to the reverberation signal X.
[0046] Figure 4 1 is an explanatory diagram of binaural processing. Binaural processing is a signal processing that simulates the behavior of the sound radiated from the virtual left channel speaker 38L and the right channel speaker 38R being transmitted to the two ears of the listener U. The head transfer characteristic F11 is a transfer characteristic from the left channel speaker 38L to the ear hole of the left ear of the listener U (i.e., the player of the electronic musical instrument 100). The head transfer characteristic F12 is a transfer characteristic from the left channel speaker 38L to the ear hole of the right ear of the listener U. The head transfer characteristic F21 is a transfer characteristic from the right channel speaker 38R to the ear hole of the left ear of the listener U. The head transfer characteristic F22 is a transfer characteristic from the right channel speaker 38R to the ear hole of the right ear of the listener U.
[0047] Figure 3 The characteristic imparting unit 511a generates a signal y11 by imparting the head transfer characteristic F11 to the echo signal XL. The characteristic imparting unit 511b generates a signal y12 by imparting the head transfer characteristic F12 to the echo signal XL. The characteristic imparting unit 511c generates a signal y21 by imparting the head transfer characteristic F21 to the echo signal XR. The characteristic imparting unit 511d generates a signal y22 by imparting the head transfer characteristic F22 to the echo signal XR.
[0048] The adding unit 512L generates the intermediate signal YL by adding the signal y11 and the signal y21. That is, the propagation of the sound from the left channel speaker 38L and the right channel speaker 38R to the left ear of the listener U is simulated. The adding unit 512R generates the intermediate signal YR by adding the signal y12 and the signal y22. That is, the propagation of the sound from the left channel speaker 38L and the right channel speaker 38R to the right ear of the listener U is simulated.
[0049] The head transfer characteristics F (F11, F12, F21, F22) are set so that when the intermediate signal Y is reproduced through the headphone 33, a virtual speaker (hereinafter referred to as a "virtual speaker") that radiates the reverberant sound represented by the intermediate signal Y exists at a position separated from the electronic musical instrument 100. Specifically, Figure 1As illustrated, the head transfer characteristic F is set so that the virtual speakers (first virtual speaker ML, second virtual speaker MR) of the reverberant sound perceived by the user are located at the upper left and upper right of the electronic musical instrument 100. The first virtual speaker ML and the second virtual speaker MR are located on opposite sides of each other with the reference plane C sandwiched therebetween. The distance Dv between the first virtual speaker ML and the second virtual speaker MR exceeds the distance D2 between the second left channel speaker 32L and the second right channel speaker 32R. Furthermore, the distance Dv between the first virtual speaker ML and the second virtual speaker MR exceeds the distance D1 between the first left channel speaker 31L and the first right channel speaker 31R.
[0050] Figure 3 The second processing unit 52 generates an echo signal Z (ZL, ZR) by performing cross-aural processing on the intermediate signal Y (YL, YR). Cross-aural processing is a signal processing used for crosstalk cancel. Specifically, cross-aural processing is a process of adjusting the intermediate signal Y so that the sound corresponding to the intermediate signal YL does not reach the user's right ear (i.e., it only reaches the left ear), and the sound corresponding to the intermediate signal YR does not reach the user's left ear (i.e., it only reaches the right ear). Cross-aural processing can also be expressed as a process of adjusting the echo sound represented by the intermediate signal Y so that the characteristics of the echo sound reaching the user from the second speaker 32 are close to the characteristics of the echo sound reproduced by the headphone 33. Specifically, the second processing unit 52 is composed of four characteristic imparting units 521 (521a, 521b, 521c, 521d) and two adding units 522 (522L, 522R). Each characteristic imparting section 521 performs a convolution operation for imparting a transfer characteristic H ( H11 , H12 , H21 , H22 ) to the intermediate signal Y.
[0051] Figure 5 : is an explanatory diagram of cross-ear processing. The characteristic imparting section 521a generates a signal z11 by imparting a transfer characteristic H11 to the intermediate signal YL. The characteristic imparting section 521b generates a signal z12 by imparting a transfer characteristic H12 to the intermediate signal YL. The characteristic imparting section 521c generates a signal z21 by imparting a transfer characteristic H21 to the intermediate signal YR. The characteristic imparting section 521d generates a signal z22 by imparting a transfer characteristic H22 to the intermediate signal YR. The adding section 522L generates an echo signal ZL by adding the signal z11 and the signal z21. The adding section 522R generates an echo signal ZR by adding the signal z12 and the signal z22. As understood from the above description, the processing of generating the echo signal Z by the second processing section 52 is expressed by the following mathematical formula (1).
[0052] [Number 1]
[0053]
[0054] Figure 5 The transfer characteristics G (G11, G12, G21, G22) are shown in the figure. The transfer characteristic G11 is the transfer characteristic from the second left channel speaker 32L to the left ear of the listener U, and the transfer characteristic G12 is the transfer characteristic from the second left channel speaker 32L to the right ear of the listener U. In addition, the transfer characteristic G21 is the transfer characteristic from the second right channel speaker 32R to the left ear of the listener U, and the transfer characteristic G22 is the transfer characteristic from the second right channel speaker 32R to the right ear of the listener U. Therefore, the sound component QL reaching the left ear of the listener U from the second speaker 32 and the sound component QR reaching the right ear of the listener U from the second speaker 32 are expressed by the following mathematical formula (2). The sound reaching the right ear of the listener U from the second left channel speaker 32L and the sound reaching the left ear of the listener U from the second right channel speaker 32R are crosstalk.
[0055] [Number 2]
[0056]
[0057] The following equation (3) is derived from equation (1) and equation (2).
[0058] [Number 3]
[0059]
[0060] On the other hand, assuming that the crosstalk is removed by convolution of the transfer characteristic H, the following equation (4) is derived. In the equation (4), the symbol e –jωt It refers to the delay of the sound component Q (QL, QR) of the intermediate signal Y.
[0061] [Number 4]
[0062]
[0063] The following equation (5) expressing the condition of the transfer characteristic H is derived from equation (3) and equation (4).
[0064] [Number 5]
[0065]
[0066] As can be understood from the mathematical formula (5), the transfer characteristic H (H11, H12, H21, H22) used for generating the reverberation signal Z (ZL, ZR) corresponds to the inverse characteristic of the transfer characteristic G from the second speaker 32 to the user's ears. Specifically, it is assumed that the transfer characteristic G from the second speaker 32 to the user's sound field is experimentally or experimentally determined, and the inverse characteristic of the transfer characteristic G, that is, the transfer characteristic H is set. The second processing unit 52 generates the reverberation signal Z by applying the trans-aural processing of the transfer characteristic H described above.
[0067] As described above, the signal processing unit 50 generates the reverberation signal Z by performing binaural processing and transaural processing on the reverberation signal X. Therefore, the reverberation signal Z is delayed relative to the acoustic signal S by the time required for the binaural processing and transaural processing.
[0068] like Figure 3 As illustrated, the reverberation signal Z generated by the signal processing unit 50 (second processing unit 52) is provided to the second speaker 32. The second speaker 32 radiates reverberation sound corresponding to the reverberation signal Z. Specifically, the second left channel speaker 32L radiates reverberation sound corresponding to the reverberation signal ZL, and the second right channel speaker 32R radiates reverberation sound corresponding to the reverberation signal ZR. As described above, the direct sound represented by the acoustic signal S is radiated from the first speaker 31, and the reverberation sound corresponding to the acoustic signal S is radiated from the dipole-type second speaker 32. As described above, the signal processing unit 50 performs transaural processing in addition to binaural processing, so the transfer characteristic G from the second speaker 32 to the user is reduced. Therefore, the user can clearly perceive the first virtual speaker ML and the second virtual speaker MR based on binaural processing.
[0069] As described above, according to the first embodiment, direct sound corresponding to the acoustic signal S is radiated from the first speaker 31. On the other hand, an echo signal Z is generated by performing binaural processing and transaural processing on an echo signal X representing a waveform of an echo sound corresponding to the acoustic signal S. The echo sound corresponding to the echo signal Z is radiated from the dipole-type second speaker 32. Therefore, compared with a structure in which binaural processing and transaural processing are performed on a signal containing both direct sound and echo sound, it is possible to radiate an echo sound that allows the user to fully perceive a sense of depth or extension while suppressing the delay of the direct sound. In addition, since the delay of the echo sound is difficult to perceive, the delay of the echo sound caused by the signal processing of the signal processing unit 50 does not become a particular problem.
[0070] In the first embodiment, musical sounds corresponding to the operation of the keyboard 11 by the user are radiated as direct sounds from the first speaker 31. In a structure in which the delay of the direct sound is large, the generation of the musical sound is delayed relative to the operation of the keyboard 11 by the user, so there is a possibility that the user's smooth and natural performance is hindered. Considering the above situation, the present disclosure that can suppress the delay of the direct sound is particularly suitable for adoption in the electronic musical instrument 100 as exemplified in the first embodiment.
[0071] In addition, in a method of performing binaural processing and transaural processing on a signal containing both direct sound and reverberant sound, there is a case where the timbre of the direct sound changes before and after the processing. In the first embodiment, binaural processing and transaural processing are performed on the reverberant signal X representing the waveform of the reverberant sound corresponding to the acoustic signal S. Therefore, in the direct sound radiated from the first speaker 31, no change in the timbre due to the binaural processing or transaural processing occurs. In addition, the change in the timbre of the reverberant sound is difficult to perceive. Therefore, the change in the timbre of the reverberant sound due to the signal processing of the signal processing unit 50 does not become a particular problem.
[0072] As described above, the signal processing unit 50 performs binaural processing and transaural processing so that the virtual speaker of the reverberant sound corresponding to the reverberant signal Z exists at a position separated from the sound system. That is, as described above, binaural processing and transaural processing are performed so that the first virtual speaker ML and the second virtual speaker MR of the reverberant sound corresponding to the reverberant signal Z are located on opposite sides of the reference plane C. Therefore, for the reverberant sound emitted by the second speaker 32, the user can fully perceive the sense of depth or expansion. In addition, in the first embodiment, the interval D1 between the first left channel speaker 31L and the first right channel speaker 31R is wider than the interval D2 between the second left channel speaker 32L and the second right channel speaker 32R. Therefore, for the direct sound corresponding to the sound signal S, the user can also fully perceive the sense of depth or expansion.
[0073] Furthermore, in the first embodiment, the first left channel speaker 31L and the second left channel speaker 32L are located on the left side of the reference plane C, and the first right channel speaker 31R and the second right channel speaker 32R are located on the right side of the reference plane C. Therefore, for both the direct sound corresponding to the acoustic signal S and the reverberant sound corresponding to the reverberant signal Z, the user can fully perceive a sense of depth or a sense of extension.
[0074] In addition, the positions of the first virtual speaker ML and the second virtual speaker MR are not limited to the above examples. For example, the virtual speakers (first virtual speaker ML, second virtual speaker MR) may also be located at the lower left and lower right of the electronic musical instrument 100. According to the structure in which the virtual speakers are located at the lower left and lower right of the electronic musical instrument 100, even if the electronic musical instrument 100 is set in an environment with a high sound-absorbing floor surface such as a carpet, the user can perceive the depth or expansion of the reverberant sound.
[0075] Figure 3 The reproduction processing unit 60 generates a reproduction signal W (WL, WR) to be provided to the headphone 33. The radiated sound from the headphone 33 directly reaches the ears of the user, so the transfer characteristic G is not given to the radiated sound reaching the ears of the user. Therefore, when generating the reproduction signal W, cross-ear processing is not required. Therefore, the reproduction processing unit 60 generates the reproduction signal W based on the sound signal S and the intermediate signal Y. As mentioned above, the intermediate signal Y is a signal before the cross-ear processing is performed. The reproduction processing unit 60 of the first embodiment includes a delay unit 61 and an adder 62.
[0076] The delay unit 61 delays the intermediate signal Y. Specifically, the delay unit 61 generates the intermediate signal wL by delaying the intermediate signal YL by the delay amount D, and generates the intermediate signal wR by delaying the intermediate signal YR by the delay amount D. The delay amount D corresponds to the processing time required for the trans-aural processing of the second processing unit 52 .
[0077] The adding unit 62 generates a reproduction signal W by adding the delayed intermediate signal w (wL, wR) and the acoustic signal S (SL, SR). Specifically, the adding unit 62 generates a reproduction signal WL for the left channel by adding the delayed intermediate signal wL and the acoustic signal SL, and generates a reproduction signal WR for the right channel by adding the delayed intermediate signal wR and the acoustic signal SR. Therefore, the reproduction signal W is a signal representing the waveform of a mixed sound of the direct sound and the reverberant sound.
[0078] The adder 62 outputs the reproduced signal W to the headphone 33. The headphone 33 radiates the direct sound and the reverberant sound corresponding to the reproduced signal W. Specifically, the left ear speaker 33L radiates the direct sound and the reverberant sound corresponding to the reproduced signal WL, and the right ear speaker 33R radiates the direct sound and the reverberant sound corresponding to the reproduced signal WR. Therefore, the user can perceive the virtual speaker of the reverberant sound based on binaural processing through the headphone 33. Specifically, the user of the headphone 33 listens to the direct sound represented by the sound signal S, while perceiving the first virtual speaker ML and the second virtual speaker MR of the reverberant sound corresponding to the reverberant signal Z on opposite sides of the reference plane C. Therefore, the user can fully perceive the depth or expansion of the reverberant sound.
[0079] In the first embodiment, the reproduction signal W is generated by adding the delayed intermediate signal w and the acoustic signal S by the delay unit 61. Therefore, the delay of the reverberant sound with respect to the direct sound can be made close to each other between the sound radiated by the first and second speakers 31 and 32 and the sound radiated by the headphone 33.
[0080] Figure 6 is a flowchart of the processing executed by the control device 21. For example Figure 6 The processing is started when the user operates the keyboard 11.
[0081] When the process starts, the control device 21 (sound source unit 41) generates an acoustic signal S (P1) corresponding to the user's operation on the keyboard 11. The control device 21 provides the acoustic signal S to the first speaker 31 (P2). The control device 21 (reverberation generating unit 42) generates a reverberation signal X (P3) representing the waveform of the reverberation sound corresponding to the acoustic signal S.
[0082] The control device 21 (signal processing unit 50) generates an echo signal Z (P4, P5) by performing binaural processing and transaural processing on the echo signal X. Specifically, the control device 21 (first processing unit 51) generates an intermediate signal Y (P4) by performing binaural processing on the echo signal X. In addition, the control device 21 (second processing unit 52) generates an echo signal Z (P5) by performing transaural processing on the intermediate signal Y. The control device 21 provides the echo signal Z to the second speaker 32 (P6). The control device 21 (reproduction processing unit 60) generates a reproduction signal W (P7) based on the sound signal S and the intermediate signal Y. The control device 21 provides the reproduction signal W to the headphone 33 (P8).
[0083] B: Second Implementation
[0084] In the following exemplary embodiments, elements having the same functions as those in the first embodiment are denoted by the same reference numerals as those in the first embodiment, and detailed descriptions thereof are appropriately omitted.
[0085] Figure 7 1 is a front view of the electronic musical instrument 100 according to the second embodiment. In the second embodiment, the position of the second speaker 32 is different from that in the first embodiment. The second embodiment is the same as the first embodiment except for the position of the second speaker 32. Therefore, the second embodiment also achieves the same effect as the first embodiment.
[0086] The second speaker 32 in the second embodiment is provided on the top plate 126 of the housing 12. Specifically, the second left channel speaker 32L and the second right channel speaker 32R are provided on the top plate 126 at a distance D2 in the X-axis direction. The position of the first speaker 31 is the same as that in the first embodiment.
[0087] C: Third embodiment
[0088] Figure 8 1 is a front view of the electronic musical instrument 100 according to the third embodiment. In the third embodiment, the position of the second speaker 32 is different from that in the first embodiment. The third embodiment is the same as the first embodiment except for the position of the second speaker 32. Therefore, the third embodiment also achieves the same effect as the first embodiment.
[0089] The second speaker 32 in the third embodiment is disposed in front of the shelf 123 in the frame 12. That is, the second speaker 32 is disposed below the keyboard 11 when viewed from the front of the electronic musical instrument 100. Specifically, the second left channel speaker 32L and the second right channel speaker 32R are disposed in front of the shelf 123 (door lock) with a gap D2 in the direction of the X axis. The position of the first speaker 31 is the same as that of the first embodiment.
[0090] D: Fourth embodiment
[0091] Fig. 9 1 is a front view of the electronic musical instrument 100 according to the fourth embodiment. In the fourth embodiment, the positions of the first speaker 31 and the second speaker 32 are different from those in the first embodiment. The fourth embodiment is the same as the first embodiment except for the positions of the first speaker 31 and the second speaker 32. Therefore, the fourth embodiment also achieves the same effect as the first embodiment.
[0092] The frame 12 of the fourth embodiment is a structure in which the upper front plate 124 of the first embodiment is sufficiently low. That is, the upper front plate 124 is a long flat plate material along the X axis. A top plate 126 is provided above the upper front plate 124, and a music stand 127 is provided above the top plate 126. The music stand 127 is located in front of or obliquely below the head of the user playing the electronic musical instrument 100.
[0093] The second speaker 32 is provided on the upper front plate 124. Specifically, the second speaker 32 is provided between the music stand 127 and the keyboard 11 when viewed from the front of the electronic musical instrument 100. The second speaker 32 is provided at the center of the upper front plate 124 in the direction of the X axis. On the other hand, the first speaker 31 is also provided on the upper front plate 124. Specifically, the first left channel speaker 31L is located on the left side of the second speaker 32, and the first right channel speaker 31R is located on the right side of the second speaker 32. That is, the second speaker 32 is located between the first left channel speaker 31L and the first right channel speaker 31R.
[0094] E: Deformation
[0095] The above-described embodiment and a plurality of embodiments arbitrarily selected from the following modified examples may be appropriately combined within the scope of not contradicting each other.
[0096] (1) The positions of the first speaker 31 and the second speaker 32 are not limited to the positions exemplified in the aforementioned embodiments. For example, in the fourth embodiment, a mode in which both the first speaker 31 and the second speaker 32 are located above the keyboard 11 is exemplified. Similarly, in the first embodiment to the third embodiment, both the first speaker 31 and the second speaker 32 may be disposed above the keyboard 11. In addition, the first speaker 31 that is separate from the frame 12 may be connected to the control system 20 by wire or wirelessly. Similarly, the second speaker 32 that is separate from the frame 12 may be connected to the control system 20 by wire or wirelessly.
[0097] (2) In each of the aforementioned methods, the signal acquisition unit 40 generates an acoustic signal S and an echo signal X, but the method by which the signal acquisition unit 40 acquires the acoustic signal S and the echo signal X is not limited to the above examples. For example, the signal acquisition unit 40 may receive one or both of the acoustic signal S and the echo signal X from an external device via wire or wirelessly. Therefore, the sound source unit 41 and the echo generation unit 42 (42L, 42R) may also be omitted from the signal acquisition unit 40. As understood from the above description, the signal acquisition unit 40 is generally represented as an element that acquires the acoustic signal S and the echo signal X. The "acquisition" based on the signal acquisition unit 40 includes the action of generating a signal by itself and the action of receiving a signal from an external device.
[0098] (3) In each of the above-mentioned methods, a method is illustrated in which a common acoustic signal S (SL, SR) is used for the emission of sound based on the first speaker 31 and the emission of sound based on the headphone 33. However, the sound source unit 41 may separately generate an acoustic signal S for speaker reproduction and an acoustic signal S for headphone reproduction. The acoustic signal S for speaker reproduction is a signal adjusted to be suitable for the sound quality of reproduction based on the first speaker 31. The reverberation generating unit 42 (42L, 42R) generates a reverberation signal X (XL, XR) from the acoustic signal S for speaker reproduction. On the other hand, the acoustic signal S for headphone reproduction is a signal adjusted to be suitable for the sound quality of reproduction based on the headphone 33. In addition, the above-exemplified method is also expressed as a method in which the sound source unit 41 includes a first sound source unit that generates the acoustic signal S for speaker reproduction and a second sound source unit that generates the acoustic signal S for headphone reproduction.
[0099] (4) In the above-mentioned embodiments, the reproduction signal W is provided to the headphones 33, but earphones without a headband 331 to be worn on the user's head may be used instead of the headphones 33. In addition, it may be interpreted that one of the headphones 33 and the earphones includes the other. In addition, the reproduction processing unit 60 may be omitted.
[0100] (5) In each of the above-mentioned embodiments, an embodiment is illustrated in which the first speaker 31 includes a first left channel speaker 31L, but the first left channel speaker 31L may be composed of a plurality of speakers. For example, the first left channel speaker 31L may be composed of a plurality of speakers having different reproduction bands. The position of each speaker is arbitrary. Similarly, the first right channel speaker 31R may be composed of a plurality of speakers. For example, the first right channel speaker 31R may be composed of a plurality of speakers having different reproduction bands. The position of each speaker is arbitrary.
[0101] (6) In each of the above-mentioned embodiments, a keyboard instrument is exemplified as the electronic musical instrument 100, but the present disclosure is also applicable to electronic musical instruments 100 other than keyboard instruments. In addition, the electronic musical instrument 100 is an example of a sound system, and the present disclosure is also applicable to sound systems other than the electronic musical instrument 100. For example, the present disclosure is applicable to any sound system having a function of radiating sound, such as a PA (Public Address) device, an AV (Audio Visual) device, a karaoke device, or a car stereo.
[0102] (7) The functions of the electronic musical instrument 100 (control system 20) involved in each of the aforementioned methods are realized as described above by the cooperation of a single or multiple processings constituting the control device 21 and the program stored in the storage device 22. The program exemplified above is provided in the form of a computer-readable recording medium and can be installed in a computer. The recording medium is preferably a non-transitory recording medium, an optical recording medium (optical disc) such as a CD-ROM, but also includes any known form of recording medium such as a semiconductor recording medium or a magnetic recording medium. In addition, a non-transitory recording medium refers to any recording medium other than a temporary propagating signal (transitory, propagating signal), and volatile recording media are not excluded. In addition, in a structure in which a publishing device publishes a program via a communication network, the recording medium storing the program in the publishing device is equivalent to the aforementioned non-transitory recording medium.
[0103] F: Notes
[0104] From the above-exemplified manner, for example, the following structures are understood.
[0105] An audio system according to one embodiment of the present invention (embodiment 1) comprises: a signal acquisition unit that acquires an audio signal and a first echo signal representing a waveform of an echo sound corresponding to the audio signal; a signal processing unit that generates a second echo signal by performing binaural processing and transaural processing on the first echo signal; a first speaker that radiates a sound corresponding to the audio signal; and a dipole-type second speaker that radiates an echo sound corresponding to the second echo signal.
[0106] According to the above method, direct sound (dry sound) corresponding to the sound signal is radiated from the first speaker. On the other hand, a second echo signal is generated by performing binaural processing and transaural processing on the first echo signal representing the waveform of the echo sound corresponding to the sound signal. The echo sound corresponding to the second echo signal is radiated from the dipole-type second speaker. Therefore, compared with a structure in which binaural processing and transaural processing are performed on a signal containing both direct sound and echo sound, it is possible to suppress the delay of the direct sound while radiating the echo sound that allows the user to fully perceive the sense of depth or expansion.
[0107] In addition, the delay of the reverberant sound is difficult to perceive, so the delay of the reverberant sound caused by the signal processing of the signal processing unit does not become a particular problem. In addition, in the binaural processing and cross-aural processing methods for performing binaural processing and cross-aural processing on a signal containing both direct sound and reverberant sound, there is a situation where the timbre of the direct sound changes before and after the processing. In the structure of the present disclosure, binaural processing and cross-aural processing are performed on the first reverberant signal representing the waveform of the reverberant sound corresponding to the acoustic signal. Therefore, in the direct sound radiated from the first speaker, no change in timbre due to binaural processing or cross-aural processing occurs.
[0108] "Binaural processing" is a signal processing that localizes the sound image (virtual speaker) at a position separated from the listening position when listening through headphones. Specifically, "binaural processing" is achieved by giving the first sound signal a head transfer characteristic (convolution) from the position of the virtual speaker to the position of the listener's ears. In other words, "binaural processing" is a signal processing that processes the first reverberation signal through a filter of the head transfer function. For example, binaural processing is performed so that the sound image (virtual speaker) is localized at a position separated from the sound system.
[0109] "Cross-aural processing" is a signal processing that reduces the component corresponding to the transfer characteristic from the position of the second speaker to the position of the listener's ears, so that the listener's ears hear the same signal as the signal after binaural processing. Specifically, "cross-aural processing" is achieved by giving the reverberation signal generated from the first reverberation signal by binaural processing the inverse characteristic of the transfer characteristic of the reproduced sound field (convolution). In other words, "cross-aural processing" is a signal processing that processes the reverberation signal generated by binaural processing through a filter of its inverse characteristic.
[0110] A "dipole-type" speaker is a speaker that allows a listener to perceive a three-dimensional sound field through two speakers arranged close to each other.
[0111] The "sound system" is any system that has a signal processing function and a playback function. For example, various electronic musical instruments that emit sound are exemplified as "sound systems". In addition, various audio equipment, karaoke equipment, car audio, PA equipment and other systems are included in the "sound system".
[0112] In a specific example of method 1 (method 2), the signal processing unit performs the binaural processing and the transaural processing so that a virtual speaker of the reverberant sound corresponding to the second reverberant signal exists at a position separated from the sound system. According to the above method, the reverberant sound emitted by the second speaker can allow the listener to fully perceive the sense of depth or extension.
[0113] In a specific example of the method 1 or the method 2 (method 3), the signal processing unit includes: a first processing unit that generates an intermediate signal by performing the binaural processing on the first reverberation signal; and a second processing unit that generates the second reverberation signal by performing the trans-aural processing on the intermediate signal, and the sound system further includes an adding unit that generates a reproduction signal by adding the intermediate signal and the sound signal, and outputs the reproduction signal to a headphone or an earphone. According to the above method, the listener can perceive the virtual speaker based on the binaural processing through the headphone or the earphone.
[0114] In a specific example of method 3 (method 4), it is further provided with: a delay unit that delays the intermediate signal, and the adding unit adds the delayed signal based on the delay unit and the sound signal. According to the above method, a reproduced signal is generated by adding the intermediate signal delayed by the delay unit and the sound signal. Therefore, the delay of the reverberation sound relative to the direct sound can be made close to each other between the radiated sound based on the first speaker and the second speaker and the radiated sound based on the headphone or the earphone. In addition, the delay amount given to the intermediate signal by the delay unit is arbitrary, but is set to, for example, a delay amount that is similar to or consistent with the processing delay based on trans-aural processing.
[0115] In any specific example (method 5) of the method 1 to the method 4, the sound signal includes a sound signal of a left channel and a sound signal of a right channel, the first speaker includes: a first left channel speaker emitting a sound corresponding to the sound signal of the left channel; and a first right channel speaker emitting a sound corresponding to the sound signal of the right channel, the second echo signal includes a second echo signal of the left channel and a second echo signal of the right channel, the second speaker includes: a second left channel speaker emitting a sound corresponding to the second echo signal of the left channel; and a second right channel speaker emitting a sound corresponding to the second echo signal of the right channel, and the interval between the first left channel speaker and the first right channel speaker is wider than the interval between the second left channel speaker and the second right channel speaker. According to the above method, the interval between the first left channel speaker and the first right channel speaker constituting the first speaker is wider than the interval between the second left channel speaker and the second right channel speaker constituting the second speaker. Therefore, even for the direct sound corresponding to the sound signal, the listener can fully perceive the sense of depth or expansion.
[0116] The first left channel speaker may be composed of one speaker or a plurality of speakers radiating sounds in different frequency bands. The first right channel speaker may also be composed of one or more speakers.
[0117] In a specific example of method 5 (method 6), the signal processing unit performs the binaural processing and the transaural processing so that the first virtual speaker and the second virtual speaker of the reverberant sound corresponding to the second reverberant signal are located on opposite sides with a reference plane sandwiched therebetween, and the reference plane is located between the first right channel speaker and the first left channel speaker. According to the above method, the first virtual speaker and the second virtual speaker of the reverberant sound are located on opposite sides with a reference plane sandwiched therebetween, so that the listener can fully perceive a sense of depth or a sense of extension for the reverberant sound radiated by the second speaker.
[0118] The reference plane is, for example, a plane that is equidistant from the center axis of the first right channel speaker and the center axis of the first left channel speaker. Alternatively, a plane that is equidistant from the center axis of the second right channel speaker and the center axis of the second left channel speaker may be used as the reference plane.
[0119] An electronic musical instrument involved in one method (method 7) of the present disclosure comprises: an operation acceptance unit for accepting a performance operation performed by a user; a signal generating unit for generating an acoustic signal corresponding to the operation on the operation acceptance unit; an echo generating unit for generating a first echo signal representing a waveform of an echo sound corresponding to the acoustic signal; a signal processing unit for generating a second echo signal by performing binaural processing and transaural processing on the first echo signal; a first speaker for radiating a sound corresponding to the acoustic signal; and a dipole-type second speaker for radiating an echo sound corresponding to the second echo signal.
[0120] In a specific example of mode 7 (mode 8), the sound signal includes a sound signal of a left channel and a sound signal of a right channel, the first speaker includes: a first left channel speaker emitting a sound corresponding to the sound signal of the left channel; and a first right channel speaker emitting a sound corresponding to the sound signal of the right channel, the second reverberation signal includes a second reverberation signal of the left channel and a second reverberation signal of the right channel, the second speaker includes: a second left channel speaker emitting a sound corresponding to the reverberation signal of the left channel; and a second right channel speaker emitting a sound corresponding to the reverberation signal of the right channel, the operation receiving unit is a keyboard on which a plurality of keys are arranged, the first left channel speaker and the second left channel speaker are located on the left side, and the first right channel speaker and the second right channel speaker are located on the right side, with a reference plane perpendicular to the direction in which the plurality of keys are arranged and passing through the midpoint of the keyboard in the direction. According to the above mode, the first left channel speaker and the second left channel speaker are located on the left side of the reference plane, and the first right channel speaker and the second right channel speaker are located on the right side of the reference plane. Therefore, the listener can fully perceive a sense of depth or a sense of extension for both the sound corresponding to the acoustic signal and the reverberant sound corresponding to the second reverberant signal.
[0121] In a specific example (method 9) of method 7 or method 8, a frame is provided, the first speaker and the second speaker are provided, and the signal processing unit performs the binaural processing and the trans-aural processing so that a virtual speaker of the reverberant sound corresponding to the second reverberant signal exists at a position separated from the frame to the outside. According to the above method, the reverberant sound radiated by the second speaker can allow the listener to fully perceive a sense of depth or a sense of extension.
[0122] Description of Reference Numerals
[0123] 100…electronic musical instrument, 11…keyboard, 12…frame, 121…right arm wood, 122…left arm wood, 123…shelf board, 124…upper front board, 125…lower front board, 126…top board, 127…music stand, 13…keys, 20…control system, 21…control device, 22…storage device, 23…detection device, 24…reproduction device, 31…first speaker, 31L…first left channel speaker, 31R…first right channel speaker, 32…second speaker, 32L…second left channel speaker, 32R…second right channel speaker, 33…headphones, 33L…left ear speaker, 33R… Right ear speaker, 331…headband, 200…audio processing unit, 40…signal acquisition unit, 41…sound source unit, 42 (42L, 42R)…echo generation unit, 50…signal processing unit, 51…first processing unit, 511 (511a, 511b, 511c, 511d)…characteristic imparting unit, 512 (512L, 512R)…addition unit, 52…second processing unit, 521 (521a, 521b, 521c, 521d)…characteristic imparting unit, 522 (522L, 522R)…addition unit, 60…reproduction processing unit, 61…delay unit, 62…addition unit.
Claims
1. A sound system comprising: a signal acquisition unit that acquires an acoustic signal and a first reverberation signal representing a waveform of a reverberation sound corresponding to the acoustic signal; a signal processing unit, which generates a second echo signal by performing binaural processing and transaural processing on the first echo signal; a first speaker emitting sound corresponding to the acoustic signal; and The second dipole-type speaker radiates reverberation sound corresponding to the second reverberation signal.
2. The sound system according to claim 1, wherein: The signal processing unit performs the binaural processing and the transaural processing so that a virtual speaker of the reverberant sound corresponding to the second reverberant signal exists at a position separated from the sound system.
3. The sound system according to claim 1 or claim 2, wherein: The signal processing unit comprises: a first processing unit that generates an intermediate signal by performing the binaural processing on the first reverberation signal; and a second processing unit, generating the second reverberation signal by performing the trans-aural processing on the intermediate signal; The acoustic system further includes an adding unit that generates a reproduction signal by adding the intermediate signal and the acoustic signal, and outputs the reproduction signal to a headphone or an earphone.
4. The sound system according to claim 3, further comprising: a delay unit, delaying the intermediate signal, The adding unit adds the delayed signal by the delaying unit and the acoustic signal.
5. The sound system according to any one of claims 1 to 4, wherein: The audio signal includes an audio signal of a left channel and an audio signal of a right channel. The first speaker comprises: a first left channel speaker radiating sound corresponding to the sound signal of the left channel; and The first right channel speaker radiates sound corresponding to the sound signal of the right channel, The second echo signal includes a second echo signal of a left channel and a second echo signal of a right channel, The second speaker comprises: A second left channel speaker radiates sound corresponding to the second reverberation signal of the left channel; as well as A second right channel speaker radiates sound corresponding to the second reverberation signal of the right channel, A distance between the first left channel speaker and the first right channel speaker is wider than a distance between the second left channel speaker and the second right channel speaker.
6. The sound system according to claim 5, wherein: The signal processing unit performs the binaural processing and the trans-aural processing so that the first virtual speaker and the second virtual speaker of the reverberation sound corresponding to the second reverberation signal are located on opposite sides of a reference plane, and the reference plane is located between the first right channel speaker and the first left channel speaker.
7. An electronic musical instrument having: An operation receiving unit for receiving a performance operation performed by a user; a signal generating unit that generates an acoustic signal corresponding to an operation on the operation receiving unit; a reverberation generating unit for generating a first reverberation signal representing a waveform of a reverberation sound corresponding to the acoustic signal; a signal processing unit, which generates a second echo signal by performing binaural processing and transaural processing on the first echo signal; a first speaker emitting sound corresponding to the acoustic signal; and The second dipole-type speaker radiates reverberation sound corresponding to the second reverberation signal.
8. The electronic musical instrument according to claim 7, wherein: The audio signal includes an audio signal of a left channel and an audio signal of a right channel. The first speaker comprises: a first left channel speaker radiating sound corresponding to the sound signal of the left channel; and The first right channel speaker radiates sound corresponding to the sound signal of the right channel, The second echo signal includes a second echo signal of a left channel and a second echo signal of a right channel, The second speaker comprises: a second left channel speaker, radiating a sound corresponding to the reverberation signal of the left channel; and The second right channel speaker radiates sound corresponding to the reverberation signal of the right channel, The operation receiving unit is a keyboard having a plurality of keys arranged therein. The first left channel speaker and the second left channel speaker are located on the left side, and the first right channel speaker and the second right channel speaker are located on the right side, sandwiching a reference plane that is orthogonal to the direction in which the multiple keys are arranged and passes through the midpoint of the keyboard in this direction.
9. The electronic musical instrument according to claim 7 or claim 8, wherein: The device comprises: a frame on which the first speaker and the second speaker are provided, The signal processing unit performs the binaural processing and the transaural processing so that a virtual speaker of the reverberant sound corresponding to the second reverberant signal exists at a position separated to the outside from the housing.
