Headphones

Abstract

The present invention provides a headset capable of controlling the position of localizing the sound image of a mixed object's musical sound. A headset includes left and right ear-mounted parts and a connecting part connecting the left and right ear-mounted parts, and includes: a control part that changes the position of localizing the sound image according to the orientation of the user's head for at least one of a first musical sound and a second musical sound different from the first musical sound respectively input into the headset; and speakers that are respectively provided in the left and right ear-mounted parts and connect the signal of the mixed sound of the first musical sound and the second musical sound when the position of localizing the sound image of at least one of the first musical sound and the second musical sound is changed by the control part.

Description

Technical Field

[0001] The present invention relates to a head phone. Background Art

[0002] Previously, there was a headset that receives a signal of a reproduced sound from a smartphone and a signal of a guitar playing sound through wireless communication, thereby enabling listening to their synthesized sound (e.g., Patent Document 1). In addition, there is a known technology that determines a head-related transfer function of a path corresponding to a user's posture based on the sound emission position of a musical instrument, and uses the head-related transfer function to localize the musical sound output from the headset (e.g., Patent Document 2). In addition, there is a headset that updates the signal processing content in a signal processing device based on the rotation angle of the listener's head, and localizes the sound image outside the head (e.g., Patent Document 2). In addition, as a prior art related to the invention of the present application, there is Patent Document 4.

[0003] [Prior art literature]

[0004] [Patent Document]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 2017-175256

[0006] [Patent Document 2] Japanese Patent Application Publication No. 2018-160714

[0007] [Patent Document 3] Japanese Patent Application Laid-Open No. 8-009489

[0008] [Patent Document 4] Japanese Patent Application Laid-Open No. 1-121000 Summary of the invention

[0009] [Problems to be solved by the invention]

[0010] An object of the present invention is to provide a headphone capable of controlling the position of the sound image of a musical sound to be mixed.

[0011] [Technical means to solve the problem]

[0012] One aspect of the present invention is a headphone, comprising left and right ear-mounting parts and a connecting part connecting the left and right ear-mounting parts, and comprising:

[0013] a control unit that changes a position where a sound image is localized according to a direction of a user's head with respect to at least one of a first musical sound and a second musical sound different from the first musical sound respectively input to the headphone; and

[0014] The speakers are provided at the left and right earpieces, respectively, and are connected to a signal of a mixed sound of the first musical sound and the second musical sound when a position for localizing a sound image of at least one of the first musical sound and the second musical sound is changed by the control unit. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 It is a diagram showing the appearance structure of the headphones according to the embodiment.

[0016] Figure 2 An example of a circuit structure of a headset and a terminal is shown.

[0017] Figure 3 This is a diagram illustrating the operation of the headphones.

[0018] Figure 4A and Figure 4B Shows an example of a user interface of a terminal.

[0019] Figure 5 This figure shows a configuration example in which an effect is applied to a guitar performance sound and the sound is output from a guitar amplifier.

[0020] Figure 6 This diagram illustrates the characteristics of the reverberation of a guitar amplifier.

[0021] Figure 7 Indicated by Figure 3 The processing performed by the effect processing unit shown.

[0022] FIG. 8A to FIG. 8C This is a diagram for explaining sound field processing.

[0023] Fig. 9 This is a diagram for explaining sound field processing.

[0024] Fig.10 This is a circuit diagram showing the sound field processing in stage mode.

[0025] Fig.11 This is a circuit diagram showing sound field processing in static mode.

[0026] Fig.12 This is a circuit diagram showing the sound field processing in the surround mode.

[0027] Fig.13A is a table showing the initial values ​​of X and Y in each mode. Fig. 13B is a table showing the initial value of Z.

[0028] Fig.14 This is a table showing the transfer function adopted according to each position.

[0029] Fig.15 A specific example of the adopted transfer function is shown.

[0030] Fig.16 This is a table showing transfer functions adopted according to the installation positions of the amplifiers.

[0031] Fig.17 This is a table showing setting instructions based on the terminal (application) and values ​​sent to the headset.

[0032] Fig.18 is a flowchart representing an example of sound field processing.

[0033] Fig.19 is a flowchart representing an example of sound field processing.

[0034] Fig. 20 is a flowchart showing an example of interrupt processing.

[0035] Fig.21A and Fig.21B This is a diagram showing the relationship between a cabinet and a listener.

[0036] Fig.22A and Fig. 22B Yes Description Fig.21A and Fig.21B Table of the status shown.

[0037] Fig.23 It is a diagram for explaining the function of the implementation method.

[0038] Fig.24 It is a diagram for explaining the function of the implementation method.

[0039] [Explanation of Symbols]

[0040] 2: Guitar

[0041] 3: Terminal

[0042] 10. Headphones

[0043] 201: Processor

[0044] 202: Storage device DETAILED DESCRIPTION

[0045] A headphone according to an embodiment includes left and right ear mounting parts and a connecting part connecting the left and right ear mounting parts, and includes the following.

[0046] (1) A control unit changes a position where a sound image is localized for at least one of a first musical sound and a second musical sound different from the first musical sound respectively input to a headphone, according to the orientation of the user's head.

[0047] (2) Speakers are provided on the left and right earpieces, respectively, and are connected to a signal of a mixed sound of the first musical sound and the second musical sound when a position for localizing a sound image of at least one of the first musical sound and the second musical sound is changed by the control unit.

[0048] According to the headset, the user can change the location of at least one of the first musical sound and the second musical sound by displacement of the head, so that the user can listen to the mixed sound of the first musical sound and the second musical sound respectively located at the desired location. The control is, for example, a processor, and the processor can also be composed of an integrated circuit or a combination of integrated circuits such as a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), and a field programmable gate array (FPGA). The orientation of the head can be detected using a gyroscope sensor, for example.

[0049] In the headphones, the control unit may be configured to give the first musical sound an effect simulating a cabinet speaker output from the front toward the user, regardless of the position where the sound image of the first musical sound is localized. In this way, the simulated sound of the cabinet speaker output from the front toward the user can be heard regardless of the positioning of the first musical sound. That is, the high-quality first musical sound can be heard regardless of the displacement of the head. In the above case, the user may be facing the cabinet speaker or not.

[0050] In the headset, the orientation of the head includes the rotation angle of the head in the horizontal direction, and the position of the sound source is changed using the head-related transfer function from the sound source outside the head to the left and right ears of the user corresponding to the rotation angle. In this way, the positioning can be changed according to the orientation of the user's head. ※The displacement of the head can include not only the rotation angle in the horizontal direction, but also the height or the tilt in the vertical direction (pitch: tilt angle).

[0051] In the headset, the following structure can be adopted: the first musical sound is a musical sound generated by the user in real time. The sound generated in real time can be a performance sound of an electronic musical instrument or a smartphone application, or a user's voice (singing sound) or simulated musical instrument sound collected by a microphone. The second musical sound can be a reproduced sound from a smartphone, or a performance sound of a smartphone application.

[0052] In the headset, the following structure can be adopted: the first musical sound is input to the headset through the first wireless communication, and the second musical sound is input to the headset through the second wireless communication. The first musical sound and the second musical sound are input wirelessly, so that the processing of the physical signal line is not complicated. In addition, when the first musical sound and the second musical sound are generated in real time by playing a performance, etc., it is possible to avoid the physical signal line hindering the smooth generation. The wireless communication standards applied to the first wireless communication and the second wireless communication can be the same or different from each other. By making them different, crosstalk, interference, misrecognition, etc. can be avoided.

[0053] In the headphones, the configuration may be such that, for the first and second musical sounds for which the change of the sound image localization position is set to be off by the control unit, the sound emitted from the predetermined reference localization position is used to generate the mixed sound. The reference localization position, guitar effect, and sound field processing on / off may be set using an application of the terminal, and the setting information may be stored in a storage device (flash memory, etc.).

[0054] Hereinafter, a musical sound generating method and a musical sound generating device according to an embodiment will be described with reference to the drawings. The configuration of the embodiment is an example and is not limited to the configuration described above.

[0055] <External structure of headphones>

[0056] Figure 1 2 is a diagram showing the appearance of a headset according to an embodiment of the present invention. Figure 1 In the embodiment, the headphone 10 has a structure in which a right ear portion 12R and a left ear portion 12L are connected via a U-shaped connecting portion 11. The ear portion 12R and the ear portion 12L are both called ear pads, and the connecting portion 11 is called a headband or a headrest.

[0057] The ear portion 12R is attached to the right ear cup of the user, while the ear portion 12L is attached to the left ear cup, and the connecting portion 11 is supported on the top of the head, whereby the headphone 10 is worn on the head of the user. The ear portion 12R and the ear portion 12L are provided with speakers respectively.

[0058] A wireless communication device called a transmitter 20 that performs wireless communication with the headphone 10 is connected to the guitar 2. The ear-mounted portion 12R of the headphone 10 has a receiver 23, and wireless communication is performed between the transmitter 20 and the receiver 23. The guitar 2 is an example of an electronic musical instrument, and may be an electronic musical instrument other than an electronic guitar. Electronic musical instruments also include electric guitars. In addition, musical sounds are not limited to musical instrument sounds, but also include sounds such as human singing sounds.

[0059] The transmitter 20 has, for example, a jack pin, and is attached to the guitar 2 by inserting the jack pin into a jack hole formed in the guitar 2. Signals based on the performance sound of the user's own guitar 2 and other people's guitar 2 are input to the headphone 10 through wireless communication using the transmitter 20. The performance sound signal is connected to the left and right speakers to emit sound. Thus, the user can listen to the performance sound of the guitar 2. The performance sound of the guitar 2 is an example of the "first musical sound".

[0060] The ear-mounted portion 12R of the headset 10 also includes a BT (Bluetooth (registered trademark)) communicator 21. The BT communicator 21 can perform BT communication with the terminal 3, and receive signals of musical sounds (for example, one or more musical instrument sounds such as drum sounds, bass sounds, and back band sounds) reproduced by the terminal 3. Thus, the user can listen to the musical sounds from the terminal 3. The reproduced sound of the terminal 3 is an example of a "second musical sound". However, the second musical sound includes not only the reproduced sound, but also sounds based on musical sound data in the data stream transferred by the terminal 3, musical sounds collected by the terminal 3 using a microphone, and musical sounds generated by the operation of a performance application executed by the terminal 3.

[0061] As described above, the headphone 10 is provided with a plurality of input systems (two systems in the present embodiment) for supplying musical sound signals by wireless communication. The system for inputting the playing sound of the guitar 2 is referred to as the first system, and the system for inputting the musical sound from the terminal 3 is referred to as the second system. The communication using the transmitter 20 is an independent wireless communication standard different from the BT communication. The wireless communication standards applied to the respective systems may be the same, but are preferably different from each other in terms of avoiding crosstalk, interference, or misrecognition.

[0062] Furthermore, when receiving the musical sound and the reproduced sound in parallel, the sound synthesized or mixed by the musical sound and the reproduced sound may be connected to each speaker through a circuit built into the headphone 10, so that the mixed sound can be listened to.

[0063] The terminal 3 can be any terminal or device that transmits a musical sound signal to the headset 10 by wireless communication. For example, it is a smartphone, but it can also be a terminal other than a smartphone. The terminal 3 can be a portable terminal or a fixed terminal. The terminal 3 can be used as an operation terminal for implementing various settings on the headset 10.

[0064] <Hardware Structure>

[0065] Figure 2 FIG. 2 shows an example of a circuit configuration of the headset 10 and the terminal 3. Figure 2In the example, the terminal 3 includes a central processing unit (CPU) 31, a storage device 32, a communication interface (communication IF (communication interface)) 33, an input device 34, an output device 35, a BT communicator 36, and a sound source 37, which are interconnected via a bus B. A digital analog converter (DAC) 38 is connected to the sound source 37, and the DAC 38 is connected to an amplifier 39, and the amplifier 39 is connected to a speaker 40.

[0066] The storage device 32 includes a main storage device and an auxiliary storage device. The main storage device can be used as a storage area for programs or data, an operating area for the CPU 31, etc. The main storage device is formed by, for example, a random access memory (RAM) or a combination of a RAM and a read-only memory (ROM). The auxiliary storage device can be used as a storage area for programs or data, a waveform memory for storing waveform data, etc. The auxiliary storage device is, for example, a flash memory, a hard disk, a solid state drive (SSD), an electrically erasable programmable read-only memory (EEPROM), etc.

[0067] The communication IF 33 is a device connected to a network such as a wired local area network (LAN) or a wireless LAN, and is, for example, a LAN card. The input device 34 includes keys, buttons, a touch panel, etc. The input device 34 is used to input various information or data to the terminal 3. The information or data includes data for implementing various settings for the headset 10.

[0068] The output device 35 is, for example, a display. The CPU 31 performs various processes by executing a program (application) stored in the storage device 32. For example, the CPU 31 can input the reproduction / stop of the musical sound supplied to the headphones 10, the setting of the effect of the performance sound of the guitar 2, or the setting of the sound field of each input system of the musical sound, and supply it to the headphones 10 by executing an application program (application) for the headphones 10.

[0069] When a musical sound reproduction instruction is input using the input device 34, the CPU 31 reads the musical sound data corresponding to the reproduction instruction from the storage device 32 and supplies it to the sound source 37, which generates a signal of the musical sound (reproduced sound) corresponding to the musical sound data. The signal of the reproduced sound is sent to the BT communicator 36, and converted into a wireless signal and radiated. The radiated wireless signal is received by the BT communicator 21 of the headphone 10. Furthermore, the signal of the musical sound generated by the sound source 37 can also be supplied to the DAC 38 and converted into an analog signal, and amplified by the amplifier 39, and the sound is emitted from the speaker 40. However, when the signal of the reproduced sound is supplied to the headphone, the signal of the musical sound sent to the DAC 38 is muted.

[0070] In this embodiment, the ear-mounting part 12L of the headphone 10 includes a battery 25 for supplying power to each part of the headphone 10 and a left speaker 24L. Power from the battery 25 is supplied to each part of the ear-mounting part 12R through the wiring provided along the connecting part 11. The battery 25 may be located in the ear-mounting part 12R.

[0071] The ear mount 12R includes a BT communicator 21 for wirelessly communicating with the BT communicator 36 , a receiver 23 , and a speaker 24R. The ear mount 12R also includes a processor 201 , a storage device 202 , a gyro sensor 203 , an input device 204 , and a headphone (HP) amplifier 206 .

[0072] The receiver 23 receives the signal (including the signal related to the performance sound of the guitar 2 ) from the transmitter 20 and performs wireless processing (down conversion, etc.) on the signal. The receiver 23 inputs the signal after the wireless processing to the processor 201 .

[0073] The gyro sensor 203 is, for example, a 9-axis gyro sensor that can detect the upward and downward, forward and backward, left and right movement, tilt, and rotation of the user's head. The output signal of the gyro sensor 203 is input to the processor 201. Among the output signals of the gyro sensor 20, at least the signal indicating the rotation angle of the head in the horizontal direction (the orientation of the head of the user wearing the headset 10) is used for sound field processing. However, other signals can also be used for sound field processing.

[0074] The input device 204 is used to input instructions such as on / off of effect processing for the performance sound (first musical sound) of guitar 2, on / off of sound field processing related to the performance sound and the reproduced sound (first musical sound and second musical sound) from terminal 3, and resetting of the sound field.

[0075] The processor 201 is, for example, a system-on-a-chip (SoC), and includes a DSP that processes the signals of the first musical sound and the second musical sound, and a CPU that performs control related to setting and management of various parameters for signal processing, etc. Programs and data used by the processor 201 are stored in the storage device 202. The processor 201 is an example of a control unit.

[0076] The processor 201 processes the signal of the first musical sound input from the receiver 23 (for example, effect processing) and the signal of the second musical sound input from the BT communicator 21 (for example, sound field processing), and connects the processed signals (right signal and left signal) to the HP amplifier 206. The HP amplifier 206 is an amplifier built in the DAC, performs DA conversion and amplification on the right signal and the left signal, and is connected to the speaker 24R and the speaker 24L (an example of a speaker).

[0077] <Mode Description>

[0078] In the headphones 10 of this embodiment, when listening to the mixed sound of the first and second musical sounds, the user can listen to the mixed sound of the first and second musical sounds by selecting a mode from "surround mode", "static mode" and "stage mode".

[0079] Regarding the first musical sound and the second musical sound, the user can use the input device 34 and the output device 35 (touch panel 34A: Figure 3 ) to set the initial position outside the user's head that localizes the sound image.

[0080] For example, using Figure 3 To explain, the CPU 31 of the terminal 3 executes the application for the headset 10, and the input device 34 and the output device 35 of the terminal 3 operate as a user interface. The CPU 31 operates as a sound reproduction unit 37A, an effect processing instruction unit 31A, and a sound field processing instruction unit 31B. The BT communicator 36 operates as a BT transceiver 36A.

[0081] As a user interface, a control is provided to the user that allows at least setting or inputting an instruction to reproduce / stop the second musical sound, an instruction to whether to give an effect to the first musical sound, and the relative positions of the sound sources of the first and second musical sounds and the user.

[0082] Figure 4A and Figure 4B This shows an example of a user interface. Figure 4A An operation screen 41 showing the direction of the chassis, etc., Figure 4BThe operation screen 42 shows the position of the performance sound of the guitar 2 (guitar (GUITAR): first musical sound) and the audio (audio (AUDIO): second musical sound such as the accompaniment band) output from the guitar amplifier.

[0083] The operation screen 41 includes a circular control indicating the direction of the guitar amplifier relative to the user. By drawing an arc, the angle of the cabinet relative to the user can be set. The guitar amplifier is an example of a box speaker, and the box speaker is simply referred to as a "cabinet" below. The front of the cabinet is 0° from the direction facing the user. In addition, the type (TYPE), gain, and level of the guitar amplifier can be set using the operation screen 41.

[0084] The operation screen 42 includes a control for selecting a mode (surround mode, static mode, stage mode, or OFF). The operation screen 42 also includes circular controls for setting the angles of the guitar amplifier (GUITAR) and the audio (AUDIO) with respect to the user wearing the headphone 10, and the angles can be set by tracing an arc with a finger. The operation screen 42 also includes a control for selecting the type of space (stage, studio) in which the user is located and a control for setting the level.

[0085] The CPU 31 operating as the sound reproduction unit 37A turns on / off the reproduction of the second musical sound according to the reproduction / stop instruction. The CPU 31 operating as the effect processing instruction unit 31A generates whether to apply an effect and parameters (parameters indicating amplifier frequency characteristics, speaker frequency characteristics, chassis reverberation characteristics, etc.) when applying the effect, and includes them in the transmission object of the BT transceiver unit 36A.

[0086] The CPU 31 operating as the sound field processing instruction unit 31B receives information indicating the position (initial position) at which the sound field of the first musical sound and the second musical sound is localized with the position of the user as the center, which is the relative position of the sound source of the first musical sound and the second musical sound and the user. For example, it is assumed that the first musical sound (the sound of the guitar 2) is output (sound is emitted) from a guitar amplifier arranged in front of the user. Then, the position (relative angle with the user) of the guitar amplifier (sound source) when the user is the center in the horizontal direction is set.

[0087] For example, when the user is facing a certain direction, 0° is set to set the angle at which the sound source (guitar amplifier) ​​is located. The same is true for the audio whose sound source is the second musical sound. The position of the sound source of the first musical sound and the position of the sound source of the second musical sound may be different or the same.

[0088] In surround mode, even if the user wearing the headphone 10 changes the horizontal orientation (rotation angle) of the head, the sound fields of the first musical sound and the second musical sound remain fixed at the initial position. In static mode, the position of the sound image localization of the first musical sound (guitar amplifier) ​​is changed according to the change in the orientation of the user's head, while the sound field of the second musical sound (audio) remains fixed at the initial position. In other words, in static mode, if the user holding the guitar changes the orientation of the head, the position of the sound source of the first musical sound (guitar amplifier) ​​is changed, but the sound field of the second musical sound (audio) does not change. In stage mode, the positions of the sound sources of both the first musical sound and the second musical sound (guitar amplifier and audio) are changed according to the change in the orientation of the head.

[0089] The sound field processing instruction unit 31B includes information specifying the current mode and information indicating the initial positions of the sound sources of the first and second musical sounds in the transmission object of the BT transceiver unit 36A. The BT transceiver unit 36A transmits data indicating the second musical sound when being reproduced, information supplied from the effect processing instruction unit 31A, and information supplied from the sound field processing instruction unit 31B through wireless communication using BT. The BT communicator 21 of the ear-mounted unit 12R receives the data and information transmitted from the BT transceiver unit 36A.

[0090] <Effect processing>

[0091] The receiver 23 receives a signal of a first musical sound, which is a performance sound of the guitar 2, received via the transmitter 20. With respect to the first musical sound received by the receiver 23, the processor 201 operates as an effect processing instruction unit 201A and an effect processing unit 201B.

[0092] The effect processing instruction unit 201A provides the effect processing unit 201B with instructions on whether effect application (effect processing) is necessary and based on parameters for applying the effect, which are received from the BT transceiver unit 21A, input from the input device 204, or read from the storage device 202.

[0093] If effect processing is not necessary, the effect processing unit 201B does not apply (skips) the effect to the first musical sound signal. On the other hand, if effect processing is necessary, the effect processing unit 201B applies the effect according to the parameter received from the effect processing instruction unit 201A to the first musical sound.

[0094] Here, the effect processing for the first musical sound executed by the headphone 10 will be described. Figure 5The figure shows a configuration example in which effects are applied to the playing sound of the guitar 2 and the sound is output from the guitar amplifier 53. An effector 51 and an amplifier 52 are inserted into the signal line connecting the guitar 2 and the guitar amplifier 53. The guitar amplifier 53 includes a case 54 and a speaker 55 accommodated in the case 54.

[0095] Regarding the characteristics of the effector 51, various characteristics are applied depending on the type of effect selected by the user. For example, when an equalizer is selected as the effector 51, a frequency characteristic with a different amplification level for each frequency band is obtained. The type (type) of the effect may be other than an equalizer. The frequency characteristics of the amplifier 52 and the frequency characteristics of the speaker 55 are obtained by measuring the output waveform when a swept frequency sound is input to the guitar amplifier 53 to be modeled. Furthermore, the method of obtaining the frequency characteristics can also be applied to a guitar amplifier of the type in which the amplifier 52 is built into a chassis.

[0096] It is known that the chassis reverberation characteristic is the reverberation characteristic of the space within the chassis 54 and is obtained by measuring the impulse response, etc. Figure 6 As shown in FIG. 1 , the characteristics of the reverberation of the guitar amplifier 53 are mainly determined by the speaker 55 and the cabinet 54. The output sound of the guitar amplifier 53 is characterized not only by the direct sound heard from the speaker 55 but also by the reverberation in the cabinet 54. The reverberation is transmitted to the user's ears as the sound emitted from the bass reflex port provided on the front surface of the guitar amplifier 53 or as the vibration sound of the speaker 55 or the cabinet 54 as a whole.

[0097] There is known a signal processing technique for simulating the reverberation of the space in the cabinet 54 based on the impulse response. In the present embodiment, a finite impulse response (FIR) filter with a reduced order is used while approximating the reverberation characteristics of the space obtained based on the measured impulse response.

[0098] As a method for measuring the impulse response, the following procedure can be adopted.

[0099] (1) The guitar amplifier 53 and the microphone 56 are installed in the anechoic chamber at a distance B. At this time, the guitar amplifier 53 and the microphone 56 are installed so as to face the front of each other at an angle of 0°.

[0100] (2) A pulse waveform is input to the guitar amplifier 53, and the guitar amplifier 53 generates sound.

[0101] (3) The filter characteristics of the FIR filter are determined based on the impulse response waveform obtained by collecting and recording the utterance using the microphone 56.

[0102] Figure 6The size A shown indicates the size of the cabinet of the guitar amplifier 53, and the angle C indicates the angle between the cabinet 54 and the microphone 56 (0° when the front of the cabinet 54 faces the microphone 56). The distance B may be set to a preferred value according to the auditory condition of the reverberation of the cabinet 54. Generally, when the distance B is shortened, it is called an open microphone setting, and when the distance B is extended, it is called a closed microphone setting. That is, the distance B has nothing to do with the sound field processing described later. The sound collected by the microphone 56 becomes a monaural sound collected at one point of the microphone 56, but the reverberation element of the cabinet 54 is included in the monaural sound.

[0103] Figure 7 Indicated by Figure 3 The effect processing unit 201B shown in FIG. 201A performs processing by the effect processing unit 201B. The effect of the type and characteristics indicated by the effect processing instruction unit 201A is applied to the performance sound of the guitar 2 input from the receiver 23. In addition, as guitar amplifier characteristic processing, the input signal is subjected to changes corresponding to the amplifier frequency characteristics, speaker frequency characteristics, and cabinet reverberation characteristics obtained by actual measurement, thereby giving a predetermined effect (for example, volume adjustment based on an equalizer), and the performance sound of the guitar 2 simulating the situation where the sound is emitted from the guitar amplifier 53 (an example of a box-type speaker) of the simulation object is output.

[0104] <Sound field processing>

[0105] The processor 201 executes the program to operate as a sound field processing instruction unit 201D and a sound field processing unit 201E. The first musical sound from the effect processing unit 201B and the second musical sound from the BT transceiver 21A are input to the sound field processing unit 201E.

[0106] In the sound field processing indication unit 201D, an indication is output to the sound field processing unit 201E based on the information related to the sound field processing from the BT transceiver unit 21A (the type of mode, the setting value of the orientation of the chassis, the initial position (setting value) of the guitar amplifier and audio, etc.), the horizontal orientation of the head detected by the gyro sensor 203 (the rotation angle of the head), and the information input by the input device of the headset 10.

[0107] Regarding sound field processing, such as Fig. 8A As shown in the figure, when sound pressure O is generated from the sound source G, the transfer function to the left ear of the listener M is H L Let the transfer function from the sound source G to the right ear of the listener M be H R When the input sound pressure E of the left ear is 1L and the input sound pressure E for the right ear 1R As described in the following formula.

[0108] E 1L=O·H L

[0109] E 1R =O·H R

[0110] Regarding the positional relationship between the listener M and the sound source G, consider the following situation: Fig. 8A Rather Fig. 9 In a space shielded by a reflective wall W, the state of localizing a sound image based on the positional relationship between the listener M and the sound source G is simulated. As the sound field processing, the following method can be used with attention paid to the head-related transfer function.

[0111] That is, when a sound pressure O is generated from a sound source G in a space, the following transfer function is defined.

[0112] The transfer function H from the sound pressure O of the point sound source signal directly to the left ear of the listener M is F-L(1)

[0113] The transfer function H from the sound pressure O of the point sound source signal reflected by the left front wall to the left ear of the listener M is F-L (2)

[0114] The transfer function H from the point sound source signal's sound pressure O to the right rear wall, then to the head and input to the left ear of the listener M is: R-L

[0115] The transfer function H from the sound pressure O of the point sound source signal to the head and input to the right ear of the listener M is: F-R(1)

[0116] The transfer function H from the sound pressure O of the point sound source signal reflected to the left front wall, then transmitted through the head and input to the right ear of the listener M is: F-R(2)

[0117] The transfer function H from the sound pressure O of the point sound source signal reflected by the right rear wall to the right ear of the listener M is R-R

[0118] like Figure 8B Generally, when the left sound signal P L With right sound signal P R The transfer function from the sound pressure of the audio signal input to the headphone to the left and right ears is H H When the input sound pressure E of the left ear is LH and the input sound pressure E for the right ear RH It is represented by the following.

[0119] E LH =P L ·HH

[0120] E RH =P R ·H H

[0121] To use headphones to position the sound image in a certain Fig. 9 The position of the general sound source G is set as follows.

[0122] E LH =E 2L

[0123] E RH =E 2R

[0124] Therefore, regarding the left and right sound signals P input to the headphone L , P R , when transformed, becomes the following.

[0125] P L =O·H L / H H

[0126] P R =O·H R / H H

[0127] For the left ear, the input sound pressure E 2L and the input sound pressure E for the right ear 2R Become the following formula.

[0128] E 2L =O·H F-L(1) +O·H F-L(2) +O·H R-L =O·(H F-L(1) +H F-L(2) +H R-L )

[0129] E 2R =O·H F-R(1) +O·H F-R(2) +O·H R-R =O·(H F-R(1) +H F-R(2) +H R-R )

[0130] Therefore, regarding the left and right sound signals P input to the headphone L , P R (Refer to Figure 8B ), when transformed, becomes the following.

[0131] P L =O·(HF-L(1) +H F-L(2) +H R-L ) / H H

[0132] P R =O·(H F-R(1) +H F-R(2) +H R-R ) / H H

[0133] Here, the transfer function may be set as follows using the distance X from the sound source, the angle Y with the sound source, and the size Z of the space as independent variables. As an example, the distance X from the sound source is set to three stages: large, medium, and small. The set values ​​set by the terminal 3 are used for the distance X, the angle Y, and the size Z.

[0134] H L (X, Y, Z) = H F-L(1) (X, Y, Z)+H F-L(2) (X, Y, Z)+H R-L (X, Y, Z)

[0135] H R (X, Y, Z) = H F-R(1) (X, Y, Z)+H F-R(2) (X, Y, Z)+H R-R (X, Y, Z)

[0136] As described above, the transfer function can be obtained by using an FIR filter or the like that forms an impulse waveform emitted from a sound source placed at an arbitrary position in the space based on an impulse response waveform observed by a sound absorbing device such as a microphone placed at the listener's position. As a specific embodiment, the transfer function for each displacement of X, Y, and Z based on the resolution required by the device specifications is calculated in advance and stored, and can be read out according to the user's spatial position and used for sound processing.

[0137] Figure 8C 201E, that is, a circuit example for outputting a left audio signal P from an input audio signal. L And right sound signal P R Circuit 301 has a circuit for finding H L / H H The circuit 201Ea and the calculated H R / H H Circuit 201Eb, circuit 201Ea multiplies the input sound signal by H R / H H The output is equivalent to the left ear signal P L Circuit 201Eb multiplies the input sound signal by H R / H H The output is equivalent to the right ear signal P R signal.

[0138] Fig.10 FIG. 2 shows the circuit structure of the sound field processing unit 201E in the stage mode. The sound field processing unit 201E includes a circuit 301 (301A) that receives the first musical sound as an input signal (O) and a circuit 301 (301B) that receives the second musical sound as an input signal (O). The circuits 301A and 301B are structured as shown in FIG. Figure 8C As shown, the transfer function H of circuit 301A L (X, Y, Z) and transfer function H R (X, Y, Z) uses the values ​​of X, Y, Z associated with the guitar amplifier applied (X, Y, Z) G The transfer function of circuit 301B is L (X, Y, Z) and transfer function H R (X, Y, Z) uses the values ​​of X, Y, Z associated with the audio. A The circuit 301A and the circuit 301B output signals P respectively. L , signal P R Adder 302 performs P L The addition of each other, P R Each output is connected to the amplifier 206.

[0139] exist Fig.11 FIG. 2 shows the circuit structure of the sound field processing unit 201E in the static mode. The sound field processing unit 201E includes the circuit 301A and the circuit 301B. The structures of the circuit 301A and the circuit 301B are as follows: Figure 8C As shown in Figure 3, the transfer function H of circuit 301A is L (X, Y, Z) and transfer function H R (X, Y, Z) uses the values ​​of X, Y, Z associated with the guitar amplifier applied (X, Y, Z) G The transfer function of circuit 301B is L (X, Y, Z) and transfer function H R A transfer function using a set value P(Y) of Y related to audio is used in (X, Y, Z). Circuit 301A and circuit 301B each output a signal P L , signal P R Adder 302 performs P L The addition of each other, P R Each output is connected to the amplifier 206.

[0140] exist Fig.12 FIG. 2 shows a circuit structure of the sound field processing unit 201E in the surround mode. The sound field processing unit 201E includes the circuit 301A and the circuit 301B. The circuit 301A and the circuit 301B are structured as shown in FIG. Figure 8C As shown in Figure 3, the transfer function H of circuit 301A is L (X, Y, Z) and transfer function H R (X, Y, Z), using a transfer function to which a setting value P(Y) of Y related to a guitar amplifier is applied. In addition, in the transfer function H of the circuit 301B L (X, Y, Z) and transfer function H R A transfer function using a set value P(Y) of Y related to audio is used in (X, Y, Z). Circuit 301A and circuit 301B each output a signal P L , signal P R Adder 302 performs P L The addition of each other, P R Each output is connected to the amplifier 206.

[0141] <Specific examples>

[0142] A specific example of the headphone 10 will be described below. Fig.13A This is an example of the initial values ​​of X and Y. Fig. 13B An example of representing the value of Z. Fig.13A As shown, initial values ​​of X and Y related to the guitar amplifier and audio are set for each of the stage, static, and surround modes. When the stage mode is selected, the values ​​of X and Y of the guitar amplifier and audio can be updated using the user interface of the terminal 3 and sent to the headphone 10 as setting values. The value of Z indicating the size of the space is two-stage and is treated as a fixed value. The selected value of Z is also sent to the headphone 10 as a setting value.

[0143] Fig.14 It represents the value of X, Y, Z and the transfer function H L And the transfer function H R Using this table, you can Fig.15 The transfer function H G (X, Y, Z) and transfer function H A The transfer function H corresponding to (X, Y, Z) L And the transfer function H R The records of are stored in advance in the storage device 202 in a specified number. Fig.15 In the example of , the specified number is 5, but it can be more than 5 or less than 5. Furthermore, the transfer function H L And the transfer function H RIt may also be obtained from a device other than the storage device 202 .

[0144] Fig.16 Indicates the setting positions (A, B, C) of the guitar amplifier (chassis). Fig.17 A value indicating that a setting instruction based on the application of the terminal 3 is sent to the headphones 10. A, B, and C are respectively as follows.

[0145] A: Indicates the size of the guitar amplifier case. However, in the specific example, two types are used: large (ID: 2) or small (ID: 1).

[0146] B: indicates the distance between the guitar amplifier and the microphone from which the impulse response is obtained. In the specific example, two types of microphone distances are used: a long distance (microphone ID: 2 is closed) and a short distance (microphone ID: 1 is open).

[0147] C: represents the angle between the guitar amplifier and the microphone used to obtain the impulse response. In the specific example, 0, 3, 6, ... 357 (initial value 0) is used.

[0148] Fig.17 The table (table) is stored in the storage device 32 of the terminal 3. In the terminal 3, when the type (TYPE) of the amplifier (AMP) is selected using the operation screen 41, Fig.17 A and B (ID) in the table shown in FIG. 4 are sent to the headset 10. For example, when the type "T1" is selected, A=2 and B=1 are sent to the headset 10. In addition, the value of C set in the operation screen 41 is sent to the headset 10. The storage device 202 of the headset 10 stores Fig.16 The table shown in FIG. 14 shows a transfer function that corresponds to the values ​​of A, B, and C.

[0149] Fig.18 and Fig.19 The following is a processing example of the processor 201 operating as the sound field processing unit 201E. In step S01, the processor 201 acquires first coordinate setting values ​​(A, B, C). In step S02, the processor 201 acquires second coordinate setting values ​​(X, Y, Z).

[0150] In step S03, processor 201 waits for the detection time of gyro sensor 203, and in step S04, processor 201 determines whether to use gyro sensor 203. If it is determined that gyro sensor 203 is used, the process proceeds to step S05, and if it is determined that gyro sensor 203 is not used, the process proceeds to step S10.

[0151] In step S05, processor 201 obtains angular displacement Δω from the previous output and the output acquired this time of gyro sensor 203, and advances the process to step S06. In step S10, processor 201 sets the value of angular displacement Δω to 0, and advances the process to step S06.

[0152] In step S06, it is determined whether the reset button is pressed. If it is determined that the reset button is pressed, the process proceeds to step S11, and if it is determined that the reset button is not pressed, the process proceeds to step S07. Here, when the user wants to reset the position of the sound field, the user presses the reset button.

[0153] In step S07, the processor 201 determines whether the second coordinate setting value has been changed. Here, it is determined whether the values ​​of X, Y, and Z have been changed with the reset. The determination of step S07 is made based on whether the flag indicating the change of the second coordinate setting value (received from the terminal 3) is on. If it is determined that the value has been changed (the flag is on), the process proceeds to step S11, and if it is determined that the value has not been changed, the process proceeds to step S08.

[0154] In step S11, the value of ω is set to 0, and the process proceeds to step S14. In step S08, the processor 201 sets the value of angle ω, which is the cumulative value of Δω, to the value obtained by adding Δω to the current value of ω, and the process proceeds to step S09.

[0155] In step S09, the processor 201 determines whether the value of ω exceeds 360°. If it is determined that ω exceeds 360°, the process proceeds to step S12, and if it is determined that ω does not exceed 360°, the process proceeds to step S13. In step S12, the value of ω is set to the value obtained by subtracting 360° from ω, and the process returns to step S09.

[0156] In step S13, the processor 201 determines whether the value of ω is less than 0. If ω is less than 0, the value of ω is set to the value obtained by adding 360° to the current value of ω (step S18), and the process returns to step S13. If it is determined that ω is greater than 0, the process proceeds to step S14.

[0157] In step S14, the processor 201 sets the value of Y to the value obtained by adding ω to the value of the setting value Y0, and advances the process to step S15. In step S15, it is determined whether the value of Y is greater than 360°. If it is determined that the value of Y is greater than 360°, the value of Y is set to the value obtained by subtracting 360° from the current value of Y (step S19), and the process returns to step S15. If it is determined that the value of Y is less than 360°, the process advances to step S16.

[0158] In step S16, the processor 201 converts the transfer function H corresponding to the values ​​of A, B, and C into C (A, B, C) are set in an enclosure simulator that simulates the type of enclosure (guitar amp) selected by the user.

[0159] In step S17, the processor 201 obtains the transfer function H corresponding to the values ​​of X, Y, and Z. L And the transfer function H R , and perform sound field processing. When step S17 ends, the process returns to step S03.

[0160] Fig. 20 4 is a flowchart showing the interrupt processing when the second coordinate setting value (angle, etc.) is changed using the terminal 3. When the setting value of Y of at least one of the guitar amplifier and the audio is changed by operation using the operation screen 42, the CPU 31 sets the changed value Y0 as the setting value (step S001). At this time, the CPU 31 turns on a flag indicating that the second coordinate setting value has been changed. The second coordinate setting value updated to the on flag is sent to the headphone 10 and used for processing in step S07 and the like.

[0161] Fig.21A and Fig.21B Indicates the position of the guitar amplifier (GUITAR POSITION: Y) using the operation screen 41 and the operation screen 42. G ) is an example of a case where operation is performed at an angle C (cabinet direction) with the cabinet. Fig.21A Indicates that no matter Y G The case where the angle C is always fixed to 0 regardless of the value of Fig.22A ). In the above case, the audibility is as follows: the guitar amplifier is always facing the front for the listener (user). As described above, the processor 201 gives the first musical sound an effect simulating the output of a box speaker facing the user from the front, regardless of the position where the sound image of the first musical sound is localized.

[0162] Fig.21B Indicates that the angle C and Y are implemented G In this case, the audibility is such that the guitar amplifier is always facing the rear of the user, and the guitar amplifier is always facing the front for the band members behind the user.

[0163] Fig.21B The setting can be set as: After updating the angle C and angle Y GWhen one of the angles C and Y is updated, the CPU 31 processes the other angle so that the other angle is also updated to the same value, and updates the updated angle C and angle Y to G Sent to headset 10.

[0164] Fig.23 This is a diagram illustrating the operation of the stage mode implementation method. Fig.23 The left side shows the guitar amplifier G and the audio A and the user's angle Y G , angle Y A In the example, Y G and Y A All are 180° and are located directly behind the user. Furthermore, the three concentric circles represent the distance from the user (small, medium, and large).

[0165] like Fig.23 As shown in the middle of FIG. 4 , the user can use the operation screen 42 to set the angle Y G , angle Y A In the example described, the angle Y G Set it to 135° and change the Angle Y A Set to 225°.

[0166] Afterwards, if Fig.23 As shown on the right side of the figure, when the user is facing directly behind, in stage mode, the angle Y G Change to 315° and change the angle Y A Change to 45 degrees. That is, the audibility becomes the case when the guitar amplifier and audio are not moving and the user is facing straight back.

[0167] Here, it is assumed that the user performs a reset action such as pressing a reset button of the headset 10. At this time, the processor 201 may also adjust the angle Y G , angle Y A The value of is restored to the value of the initial state and is set to the state on the left. The value of the initial state is notified in advance from the terminal 3 or is preset in the headset 10. Alternatively, the processor 201 can eliminate the angle displacement Δω and restore to the state exactly in the middle.

[0168] Fig.24 2 is a diagram for explaining the operation of the embodiment. In static mode, the processor 201 adjusts the knob (PAN) (left and right volume) according to the change in the orientation of the user's head. In addition, in static mode, the angle Y of the guitar amplifier is G Varies based on the orientation of the user's head. Fig.24 In the example, the user faces backwards and the angle Y GThe sound from the guitar amplifier is changed by 180 degrees, so that the audibility reaches from the back. According to the embodiment, a headphone 10 capable of controlling the position of the sound image localization of the first musical sound and the second musical sound to be mixed can be provided. The structures shown in the embodiment can be appropriately combined within the scope of the purpose.

Claims

1. A headset, comprising left and right ear-mounting parts, a speaker included in each of the left and right ear-mounting parts, and a connecting part connecting the left and right ear-mounting parts, wherein the headset comprises: The control unit changes the localization position of the sound image according to the orientation of the user's head, using a head-related transfer function, with respect to at least one of the localization position of a first musical sound and the localization position of a second musical sound different from the first musical sound respectively input to the headphone, wherein the control unit is configured to provide the following three modes, each of which is selectable, and the control unit provides a mixed signal of the first musical sound and the second musical sound to the left and right ear-mounted parts in one of the selected modes, The three modes include: The surround mode means that when the user wears the headset, regardless of the horizontal orientation of the user's head, the localized sound images of the first musical sound and the second musical sound are maintained at the user's initial position, The static mode means that when the user wears the headset, the position where the sound image of the first musical sound is located is changed according to the change of the orientation of the user's head, and the sound image of the second musical sound is maintained and fixed at the initial position of the user regardless of the orientation of the user's head. The stage mode means that when the user wears the headphones, the positions of the sound images where the first musical sound and the second musical sound are localized are changed according to the change of the orientation of the user's head.

2. The headset according to claim 1, wherein: The control unit gives the first musical sound an effect simulating a box speaker output from the front toward the user, regardless of the position where the sound image of the first musical sound is localized.

3. The headset according to claim 1, wherein: The horizontal orientation of the head includes the rotation angle of the head in the horizontal direction. The position of the sound source is changed using a head related transfer function from the sound source located outside the head to the left and right ears of the user corresponding to the rotation angle.

4. The headset according to claim 2, wherein: The horizontal orientation of the head includes the rotation angle of the head in the horizontal direction. The position of the sound source is changed using a head related transfer function from the sound source located outside the head to the left and right ears of the user corresponding to the rotation angle.

5. The headset according to any one of claims 1 to 3, wherein: The first musical sound is a musical sound generated by the user in real time.

6. The headset according to any one of claims 1 to 3, wherein: The first musical sound is input into the headset via a first wireless communication, The second musical sound is input to the headphone through second wireless communication.

7. The headset according to any one of claims 1 to 3, wherein: For the first musical sound and the second musical sound for which the change of the position of the sound image localization is set to be off by the control unit, the sound emitted from the position of the predetermined reference localization is used to generate the mixed sound.

8. The headset according to any one of claims 1 to 3, comprising: A Bluetooth transceiver unit receives the signal of the first musical sound by using the Bluetooth communication standard and inputs the signal to the control unit; as well as The receiver receives the signal of the first musical sound and performs wireless processing on it, and inputs the signal after the wireless processing to the control unit.

9. The headset according to claim 8, wherein: The wireless communication standard of the receiver is different from the Bluetooth communication standard.

10. A headset with a user interface, comprising: The headset as claimed in claim 1; as well as as a terminal device for the user interface, and The terminal device includes a terminal input / output unit, a terminal control unit and a terminal Bluetooth transceiver unit. The terminal input / output unit provides a control capable of setting or even inputting at least an instruction to reproduce / stop the second musical sound, an instruction to whether to give an effect to the first musical sound, and a relative position of the sound source of the first musical sound and the second musical sound and the user. The terminal control unit is supplied with instructions and settings from the terminal input / output unit, The terminal Bluetooth transceiver receives instructions and settings from the terminal control unit and sends them to the control unit of the headset.

Images