Control device, speaker device and sound output method

Abstract

A control device according to an embodiment of the present technology is provided with a tactile control part and a sound control part. Based on a tactile signal for tactile presentation, the tactile control part generates a tactile control signal for driving a tactile presentation unit. Based on a first sound signal and a second sound signal generated according to the tactile signal and including a sound component in an opposite phase to the sound generated by the tactile presentation unit, the sound control part generates a sound control signal for driving a sound output unit.

Description

Technical Field

[0001] The present technology relates to a control device, a speaker device and an audio output method for controlling an audio output device with a tactile presentation function. Background Art

[0002] In recent years, applications that stimulate the sense of touch through human skin or the like by means of a tactile reproduction device have been used in various scenes.

[0003] As a tactile reproduction device thereof, an eccentric rotating mass (ERM), a linear resonant actuator (LRA), and the like are currently widely used, and devices having a resonant frequency that is a frequency that provides good sensitivity to human tactile sense (approximately several hundred Hz) have been widely used for this purpose (for example, see Patent Document 1).

[0004] Since the frequency band that provides high sensitivity to human tactile sense is several hundred Hz, vibration reproduction devices that handle this frequency band of several hundred Hz have become mainstream.

[0005] As other tactile reproduction devices, electrostatic tactile displays and surface acoustic wave tactile displays have been proposed for the purpose of controlling the friction coefficient of the touch portion and achieving a desired tactile sensation (for example, refer to Patent Document 2). In addition, airborne ultrasonic tactile displays that utilize the acoustic radiation pressure of converged ultrasonic waves and electric tactile displays that electrically stimulate nerves and muscles connected to tactile receptors have been proposed.

[0006] For applications utilizing these devices (particularly for listening to music), a vibration reproducing device is built into the headphone housing to reproduce vibrations while reproducing music, thereby emphasizing the bass.

[0007] In addition, wearable speakers that are not in the form of headphones and are hung around the neck for use have been proposed. Wearable speakers include such wearable speakers that transmit vibrations to the user together with the sound output from the speaker by utilizing their contact with the user's body (for example, see Patent Document 3) and such wearable speakers that transmit vibrations to the user by utilizing the resonance of the back pressure of the speaker vibration (for example, see Patent Document 4).

[0008] Citation List

[0009] Patent Literature

[0010] Patent Document 1: Japanese Patent Application Publication No. 2016-202486

[0011] Patent Document 2: Japanese Patent Application Publication No. 2001-255993

[0012] Patent Document 3: Japanese Patent Application Publication No. HEI 10-200977

[0013] Patent Document 4: Japanese Patent Application No. 2017-43602 Summary of the invention

[0014] Technical issues

[0015] Headphones and wearable (neck) speakers that perform tactile presentation can interfere with music listening because noise associated with the vibration of a vibrator or other tactile presentation device provided for tactile presentation reaches the user's ears. Although the noise reaching the ears can be reduced to some extent by the wearable speaker structure, noise with frequencies that provide higher sensitivity to the human ear may be generated, such as when the vibration has higher frequency components to express various tactile sensations.

[0016] In view of the above circumstances, the present technology is directed to providing a control device, a speaker apparatus, and an audio output method that can help reduce noise from a tactile presentation device.

[0017] Problem Solution

[0018] A control device according to an embodiment of the present technology includes a haptic control section and an audio control section.

[0019] The haptic control part generates a haptic control signal for driving the haptic presentation unit based on the haptic signal of the haptic presentation.

[0020] The audio control part generates an audio control signal for driving the audio output unit based on the first audio signal and the second audio signal including a sound component in an opposite phase to a sound generated based on the haptic signal and generated from the haptic presentation unit.

[0021] The audio control portion may generate the audio control signal by adding the second audio signal to the first audio signal.

[0022] The control device may further include a cancellation signal generating section which generates a second audio signal based on the haptic signal.

[0023] The audio control part may generate a first signal for driving a first audio output unit reproducing a first audio signal, and the cancellation signal generation part may generate a second signal for driving a second audio output unit reproducing a second audio signal.

[0024] The cancellation signal generating part may generate the second audio signal based on a frequency response characteristic of the audio output unit, a frequency response characteristic of the tactile presentation unit, and a conversion function from vibration generated at the tactile presentation unit to sound.

[0025] A speaker device according to an embodiment of the present technology includes a tactile presentation unit, an audio output unit, a tactile control section, and an audio control section.

[0026] The haptic control part generates a haptic control signal for driving the haptic presentation unit based on the haptic signal of the haptic presentation.

[0027] The audio control part generates an audio control signal for driving the audio output unit based on the first audio signal and the second audio signal including a sound component in an opposite phase to a sound generated based on the haptic signal and generated from the haptic presentation unit.

[0028] The speaker apparatus may further include a storage part storing the haptic signal and the first audio signal.

[0029] The speaker device may further include a communication portion capable of communicating with a server storing the haptic signal and the first audio signal.

[0030] The audio output unit may include a common speaker unit that reproduces the first audio signal and the second audio signal.

[0031] The audio output unit may include a first speaker unit reproducing the first audio signal and a second speaker unit reproducing the second audio signal.

[0032] The audio output unit may include a right speaker and a left speaker, and

[0033] The speaker device may further include a coupler for hanging around the neck, the coupler coupling the right speaker with the left speaker.

[0034] The tactile presentation unit may include a vibration device.

[0035] Optionally, the tactile presentation unit may include an ultrasonic generator, an electrical muscle stimulator or an air flow generator.

[0036] An audio output method according to an embodiment of the present technology obtains a tactile signal for tactile presentation and a first audio signal. The tactile signal for tactile presentation and the first audio signal are obtained. A tactile control signal for driving a tactile presentation unit is generated based on the tactile signal. A second audio signal is generated, the second audio signal including a sound component that is inversely phased with a sound generated from the tactile presentation unit based on the tactile signal. An audio control signal for driving an audio output unit is generated based on the first audio signal and the second audio signal. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] [ Figure 1 ]A perspective view of a speaker device in a first embodiment of the present technology.

[0038] [ Figure 2 ]A perspective view showing a state in which the speaker device is installed on a user.

[0039] [ Figure 3]A schematic cross-sectional view of the main parts of the speaker device.

[0040] [ Figure 4 ]A block diagram showing a configuration example of a speaker device.

[0041] [ Figure 5 ]The process by which audio signals and vibration signals are transmitted to the user's ears and skin as sound and vibration.

[0042] [ Figure 6 ] Illustration of the operation of the speaker device.

[0043] [ Figure 7 ] Image diagram showing the basic principle of noise removal.

[0044] [ Figure 8 ]Flow of a processing procedure for generating a cancellation signal from a vibration signal for tactile presentation.

[0045] [ Fig. 9 ] shows a block diagram of a speaker device in a second embodiment of the present technology.

[0046] [ Fig.10 ] is a schematic diagram showing a state of generating noise from a vibration signal for tactile presentation.

[0047] [ Fig.11 ] shows a block diagram of a speaker device in a third embodiment of the present technology. DETAILED DESCRIPTION

[0048] Hereinafter, each embodiment according to the present technology will be described with reference to the drawings.

[0049] <First Embodiment>

[0050] (Basic configuration of speaker equipment)

[0051] Figure 1 1 is a perspective view showing a configuration example of a speaker device in an embodiment of the present technology. This speaker device (audio output device) 100 has a function of actively presenting a tactile sensation (vibration, etc.) to the user U simultaneously with sound. Figure 2 As shown, the speaker device 100 is, for example, a wearable speaker mounted on the shoulders of a user U.

[0052] The speaker device 100 includes a right speaker 100R, a left speaker 100L, and a coupler 100C coupling the right speaker 100R and the left speaker 100L. The coupler 100C is formed in any shape that can be hung around the neck of the user U, and the right speaker 100R and the left speaker 100L are located on the upper part of the shoulders or chest of the user U.

[0053] Figure 3 yes Figure 1 and Figure 2 Schematic cross-sectional view of the main parts of the right speaker 100R and the left speaker 100L of the speaker device 100 in FIG. The right speaker 100R and the left speaker 100L generally have a left-right symmetrical structure. It should be noted that Figure 3 This is just a schematic diagram and is not equivalent to Figure 1 and Figure 2 The speaker dimensions are shown as ratio.

[0054] The right speaker 100R and the left speaker 100L include, for example, an audio output unit 250, a tactile presentation unit 251, and a housing 254 that accommodates them. The right speaker 100R and the left speaker 100L generally reproduce audio signals by a stereo method. The reproduced sound is not particularly limited as long as it is a reproducible sound or voice that is typically a piece of music, a dialogue, a sound effect, etc.

[0055] The audio output unit 250 is an electroacoustic conversion type dynamic speaker. The audio output unit 250 includes a diaphragm 250a, a voice coil 250b wound around the central portion of the diaphragm 250a, a fixing ring 250c that holds the diaphragm 250a to the housing 254, and a magnet assembly 250d arranged facing the diaphragm 250a. The voice coil 250b is arranged perpendicular to the direction of the magnetic flux generated in the magnet assembly 250d. When an audio signal (alternating current) is provided to the voice coil 250b, the diaphragm 250a vibrates due to the electromagnetic force acting on the voice coil 250b. The diaphragm 250a vibrates according to the signal waveform of the audio signal, generating a reproduced sound wave.

[0056] The tactile presentation unit 251 includes a vibration device (vibrator) capable of generating tactile vibrations, such as an eccentric rotating mass (ERM), a linear resonant actuator (LRA) and a piezoelectric element. When a tactile signal prepared for tactile presentation in addition to the reproduced signal is input, the tactile presentation unit 251 is driven. The amplitude and frequency of the vibration are also not particularly limited. The tactile presentation unit 251 is not limited to the case where it is composed of a single vibration device, and the tactile presentation unit 251 can be composed of a plurality of vibration devices. In this case, a plurality of vibration devices can be driven simultaneously or can be driven individually.

[0057] The housing 254 has an opening portion (sound input port) 254a for transmitting the audio output (reproduced sound) to the outside in a surface opposite to the diaphragm 250a of the audio output unit 250. Figure 1 As shown, the opening portion 254a is formed in a straight line shape consistent with the longitudinal direction of the housing 254, but is not limited thereto. The opening portion 254a may be composed of a plurality of through holes or the like.

[0058] The tactile presentation unit 251 is, for example, arranged on the inner surface of the side opposite to the opening portion 254a of the housing 254. The tactile presentation unit 251 presents tactile vibration to the user through the housing 254. In order to improve the transmission rate of the tactile vibration, the housing 254 may be partially composed of a relatively low-rigidity material. The shape of the housing 254 is not limited to the shape shown, and may adopt an appropriate shape such as a disc shape and a rectangular parallelepiped shape.

[0059] Next, a control system of the speaker device 100 will be described. Figure 4 : is a block diagram showing a configuration example of a speaker device applied in this embodiment.

[0060] The speaker device 100 includes a control device 1 that controls driving of an audio output unit 250 and a tactile presentation unit 251 of the right speaker 100R and the left speaker 100L. The control device 1 and other elements to be described later are built into a housing 254 of the right speaker 100R or the left speaker 100L. Alternatively, the control device 1 may be configured as an external device connected to the right speaker 100R and the left speaker 100L by wire or wirelessly.

[0061] like Figure 3 As shown, the control device 1 includes an audio control section 13 , a haptic control section 14 , and a cancellation signal generation section 17 .

[0062] The control device 1 can be implemented by hardware elements used in a computer, such as a central processing unit (CPU), a random access memory (RAM), and a read-only memory (ROM), and necessary software. As an alternative or in addition to the CPU, a programmable logic device (PLD) such as a field programmable gate array (FPGA) or a digital signal processor (DSP) or other application-specific integrated circuits (ASICs) can be used. The control device 1 executes a predetermined program so that the audio control part 13, the tactile control part 14, and the elimination signal generation part 17 are configured as functional blocks.

[0063] The speaker device 100 includes a memory (storage section) 11 , a decoding section 12 , an audio output section 15 , a tactile output section 16 , and a communication section 18 as other hardware.

[0064] Based on the tactile signal for tactile presentation, the tactile control section 14 generates a tactile control signal for driving the tactile output section 16. The tactile signal, as will be described later, is data for tactile presentation (tactile data) stored in the memory 11 or an external server device 50 such as a cloud server. The tactile output section 16 includes Figure 3 The tactile presentation unit 251 is shown.

[0065] Based on the first audio signal and the second audio signal, the audio control section 13 generates an audio control signal for driving the audio output section 15. In this embodiment, the audio control section 13 generates the audio control signal by adding the second audio signal to the first audio signal.

[0066] Here, the first audio signal is an audio signal of a piece of music, etc. The second audio signal is an audio signal generated based on the tactile signal, and includes a sound component that is in reverse phase with the sound generated from the tactile output portion 16. The first audio signal is data (audio data) for audio reproduction stored in the memory 11 or the server device 50. In addition, the second audio signal is equivalent to a cancellation signal for canceling the sound generated when the tactile output portion 16 is driven, and is generated by the cancellation signal generation portion 17.

[0067] The cancellation signal generation part 17 is configured to be able to generate a second audio signal based on the tactile signal. The tactile signal is data (vibration data) for tactile presentation stored in the memory 11 or the server device 50. In this embodiment, the second audio signal is configured to be generated in the cancellation signal generation part 17, but is not limited thereto. The second audio signal may be stored in the memory 11 or the server device 50 together with the first audio signal and the tactile signal.

[0068] The memory 11 is a storage device capable of storing the first audio signal and the haptic signal, such as a non-volatile semiconductor memory. In this embodiment, the first audio signal and the haptic signal are stored in the memory 11 as appropriately encoded digital data.

[0069] The decoding part 12 decodes the first audio signal and the haptic signal stored in the memory 11. The decoding part 12 may be configured as a functional block forming a part of the control device 1.

[0070] The communication part 18 is constituted by a communication module capable of wired or wireless connection to the network 10. The communication part 18 is configured to be able to communicate with the server device 50 via the network 10, and to be able to acquire the first audio signal and the haptic signal stored in the server device 50.

[0071] For example, the audio output section 15 includes Figure 3 The audio output unit 250 is shown as a right speaker 100R and a left speaker 100L.

[0072] The tactile output portion 16 includes, for example, Figure 3 The tactile presentation unit 251 is shown.

[0073] (Operation of speaker equipment)

[0074] Next, a typical operation of the speaker device 100 configured in the above-described manner will be described.

[0075] The control device 1 acquires digital signals (first audio signal and tactile signal) for outputting sound and tactile sense by receiving digital signals from the server device 50 or reading digital signals from the memory 11 .

[0076] Next, the decoding part 12 performs appropriate decoding processing on the acquired data to thereby extract audio data (first audio signal) and tactile data (tactile signal), and inputs the audio data (first audio signal) and tactile data (tactile signal) into the audio control part 13 and the tactile control part 14 respectively.

[0077] The audio control part 13 and the tactile control part 14 perform various types of processing on the input data. The output (audio control signal) of the audio control part 13 is input into the audio output part 15, and the output (tactile control signal) of the tactile control part 14 is input into the tactile output part 16. The audio output part 15 and the tactile output part 16 each include a D / A converter, a signal amplifier and a reproduction device (equivalent to the audio output unit 250 and the tactile presentation unit 251). The D / A converter and the signal amplifier may be included in the audio control part 13 and the tactile control part 14. The signal amplifier may include a volume control part controlled by the user U.

[0078] The tactile control part 14 transmits the tactile data to the elimination signal generation part 17. The elimination signal generation part 17 generates an elimination signal (second audio signal) for eliminating the noise output from the tactile output part 16 and transmits the elimination signal to the audio control part 13. The elimination signal includes a sound component generated based on the tactile data and in an antiphase with the sound (noise) generated by the tactile output part 16. The method of generating the elimination signal will be described in detail later.

[0079] Based on the input tactile data, the tactile control portion 14 generates a tactile control signal for driving the tactile output portion 16. Based on the input audio data and the cancellation signal, the audio control portion 13 generates an audio control signal for driving the audio output portion 15. Therefore, the audio output portion 15 outputs a reproduced sound containing a sound component for canceling the sound (noise) generated from the tactile output portion 16.

[0080] (Sound cancellation principle)

[0081] Next, description will be given of the elimination signal generated in the elimination signal generating section 17. Here, description will be given of a case where a content including an audio signal and a vibration signal for presenting a sense of touch is reproduced by a vibration speaker equipped with a vibrator for presenting a sense of touch (the vibration speaker can be actively driven), and a piece of music with vibration is listened to.

[0082] The vibration transmitted from the vibration speaker to the user's body (skin) is the vibration output from the vibrator driven according to the vibration signal. On the other hand, the sound transmitted from the vibration speaker to the user's ear is not only the sound emitted by the speaker driven according to the audio signal, but also the sound converted from the vibration of the vibrator driven according to the vibration signal, that is, the sum of the two. Those components of the sound converted from the vibration added to the sound emitted by the speaker will usually interfere with the user's music experience as noise.

[0083] Figure 5 1 is an explanatory diagram of the operation of a speaker device without a noise cancellation function. Here, the flow in which an audio signal and a vibration signal are converted into sound and vibration and transmitted to the user's ears and skin is shown.

[0084] like Figure 5 As shown, for example, for Fourier transform F1 of the audio signal f1, the sound Y output from the speaker portion 20 is a signal multiplied by the frequency response characteristic H1 of the speaker portion 20 (hereinafter, unless otherwise specifically stated, it is assumed that the signal is a signal subjected to Fourier transform).

[0085] On the other hand, with respect to the Fourier transform F2 of the vibration signal f2, the vibration Z output from the vibrator 21 is a signal multiplied by the frequency response characteristic H2 of the vibrator 21, and it is transmitted to the skin as the vibration Z. In addition, the sound subjected to the transformation (transformation function H3) from the vibration to the sound is generated from the vibrator 21 and transmitted to the ear of the user.

[0086] Therefore, the sound Y reaching the ear of user U is as follows:

[0087] [Expression 1] Y=H1 F1+H3 H2 F2.

[0088] The frequency response characteristic H1 of the speaker section 20 is, for example, a frequency response characteristic of the speaker section 20 itself or a characteristic obtained by multiplying the frequency response characteristic by a gain or the like of a signal amplifier provided at a preceding stage of the speaker section 20 .

[0089] The frequency response characteristic H2 of the vibrator 21 is also defined similarly to the frequency response characteristic H1 of the speaker section 20. For example, a conversion function H3 from vibration to sound is defined as a function (characteristic) based on the mechanical structure and arrangement of the vibrator 21.

[0090] on the other hand, Figure 6 1 is an explanatory diagram of the operation of the speaker device 100 with a noise canceling function of this embodiment. Figure 6As shown, the vibration signal f2 output from the tactile control section 14 is sent to the elimination signal generating section 17, and the elimination signal F3 is generated at the elimination signal generating section 17 and sent to the audio control section 13. The elimination signal F3 is generated using the above-mentioned corresponding characteristics H1, H2 and H3. Here, the corresponding characteristics H1, H2 and H3 may be known values ​​as long as they are well-known characteristics. Alternatively, the corresponding characteristics H1, H2 and H3 may be values ​​determined in a previous measurement of each speaker device 100 as a pre-shipment test.

[0091] The audio control portion 13 that receives the cancellation signal F3 adds the cancellation signal F3 to the audio signal f1, sends it to the speaker portion 20 (audio output portion 15), and outputs the sound at the speaker portion 20. The cancellation signal F3 is generated to cancel only the sound generated from the vibrator 21 that reaches the ear of the user U. As a result, the user U can perceive the vibration Z output from the vibrator 21 (tactile output portion 16) as it is, and listen to the sound with the noise generated from the vibrator 21 eliminated.

[0092] exist Figure 7 In the following, the basic principle of noise cancellation using a cancellation signal will be described. For the noise 40 that is not desired to be perceived by the user U, a cancellation signal 41 is generated so that a signal 42 obtained by adding the noise 40 and the cancellation signal 41 is the lowest. Such a cancellation signal 41 is generally a signal that generates a sound having the same amplitude and an opposite phase as the waveform of the noise 40. For example, the cancellation signal 41 is set in dB.

[0093] (Specific example of noise cancellation)

[0094] Hereinafter, the process for removing acoustic noise will be described in detail.

[0095] When the canceling signal F3 is output from the speaker section 20, the canceling signal F3 is preferably a sound having an anti-phase with respect to the acoustic noise from the vibrator 21.

[0096] Therefore, in order to generate the elimination signal F3 from the vibration signal f2, it is sufficient to estimate the sound (H3 H2 F2) generated from the vibrator 21 taking into account the frequency response characteristics H2 of the vibrator 21 itself and the conversion function H3 from the vibration of the vibrator 21 to the sound, and then overcome the frequency response characteristics H1 of the speaker part 20.

[0097] Therefore, the generated cancellation signal F3 is expressed by the formula G1 H3 H2 F2. Here, G1 is a frequency response characteristic having an inverse characteristic of the characteristic that can overcome the frequency response characteristic H1 of the speaker section 20.

[0098] Information on the respective characteristics H1, H2, and H3 is essential for calculating this cancellation signal F3, and therefore needs to be measured in advance. A known method represented by a method of identifying the characteristics of an acoustic device or the like is used for this measurement method.

[0099] Furthermore, assuming that the user U wears the speaker device 100 , it is desirable to measure the conversion function H3 from vibration to sound in a state where a human model, an object, or the like wears the speaker device 100 .

[0100] For example, the calculation process of this elimination signal F3 can be realized by multiplying the corresponding frequency response characteristics G1, H3, H2 and F2 after Fourier transformation. Alternatively, the calculation process of this elimination signal F3 can be realized by Fourier inverse transformation of the vibration signal f2 and the frequency response characteristics G1, H3, H2 (that is, convolution of the impulse response g1, h3, h2 of each system). Alternatively, the calculation process of this elimination signal F3 can also be realized by using a filter with characteristics (-G1 H3 H2) in the elimination signal generation part 17 as hardware.

[0101] A technique (ANC: active noise control) is also known, in which a vibration speaker equipped with a microphone senses the sound from a vibrator through the microphone and uses the sensed signal as a cancellation signal. However, in this embodiment, a high-precision noise cancellation function can be achieved by utilizing the feedforward control of the vibration signal input into the tactile output portion 16 without the need for such a microphone. Because a structural device that prevents the noise from the tactile output portion 16 from reaching the ear of the user U can be manufactured in the speaker device 100, it is predictable that the sound noise from the tactile output portion 16 measured in advance is different from the ambient noise to some extent, including random noise that is desired to be eliminated, etc.

[0102] Therefore, according to the speaker device 100 of this embodiment, since a microphone for noise sensing is not required, the device configuration can be simplified or size reduction can be achieved. In addition, by utilizing the vibration signal buffered before output from the network 10 or the memory 11, as a feedforward control, noise can be eliminated without delay.

[0103] Since the tactile output portion 16 is configured as a unit separated from the audio output portion 15 in the speaker device 100 of this embodiment, the degree of freedom in design of the tactile output portion 16 is increased, and various tactile vibrations can be presented to the user. In addition, since the elimination signal F3 is reproduced in synchronization with the driving of the tactile output portion 16, the noise associated with the driving of the tactile output portion 16 can be effectively removed. In addition, it is also possible to reproduce the content of presenting the tactile sense at a time different from the time of the output sound from the audio output portion 15 or in a frequency band wider than the frequency band of the sound.

[0104] For sensitivity control in the speaker device 100, the audio output portion 15 may be provided with a single limiter that sets the maximum value of the cancellation signal or a plurality of limiters that set weak / medium / strong of the cancellation signal in dB, for example. Thus, the user U himself or herself can select the noise cancellation level.

[0105] Figure 8 The processing flow of the elimination signal generating section 17 is shown, which generates the elimination signal from the vibration signal f2 using the known frequency response characteristic H2 of the vibrator 21, the known conversion function H3 from vibration to sound, and the known frequency response characteristic H1 of the speaker section 20 and the audio control section 13. Here, as an example, the elimination signal is generated by digital signal processing using a filter having a frequency response characteristic (-G1 H3 H2).

[0106] like Figure 8 As shown, first, in step S101, the elimination signal generation part 17 obtains the vibration signal f2 to be reproduced from the tactile control part 14. Subsequently, in step S102, the elimination signal generation part 17 applies a digital filter having a frequency response characteristic (-G1 H3 H2) of coefficients measured and recorded in advance for the vibration signal f2. Thus, the elimination signal F3 (second audio signal) is generated.

[0107] The audio control section 13 adds this elimination signal F3 to the audio signal f1 (first audio signal), thereby generating an audio control signal for driving the audio output section 15. At this time, the amplification ratio applied to each of the audio signal f1 and the vibration signal f2 when reproducing can be considered. For example, in the case where the audio signal f1 is amplified by a1 times, the vibration signal f2 is amplified by a2 times, and they are output to the speaker section 20 and the vibrator 21, respectively, in step S103, the elimination signal generation section 17 receives information about these amplification ratios from the audio control section 13 and the tactile control section 14, and multiplies the elimination signal F3 by their amplification ratios (a2 / a1).

[0108] Then, in step S104, the audio control section 13 generates the cancellation signal (f 3× (a2 / a1)) is added to the sound signal f1 to generate the audio control signal. Therefore, the sound Y whose noise is not perceived by the user U is output from the audio output portion 15.

[0109] In the above description, the vibrator 21 has been exemplified as the tactile presentation device (tactile presentation unit 251) in the tactile output portion 16. The vibrator 21 can be similarly applied to a tactile presentation device other than a vibrator (e.g., an air ultrasonic generator, an electric muscle stimulator, an air flow generator, etc.).

[0110] <Second Embodiment>

[0111] Next, a second embodiment of the present technology will be described.

[0112] In the above-mentioned first embodiment, the audio output section 15 (audio output unit 250) is configured so that the audio signal (first audio signal) and the cancellation signal (second audio signal) are reproduced through the common speaker unit (speaker section 20). In this regard, in this embodiment, the audio signal (first audio signal) and the cancellation signal (second audio signal) are configured to be reproduced through separate speakers, respectively.

[0113] Fig. 9 1 is an explanatory diagram of the operation of the speaker device 200 in the second embodiment of the present technology. In addition to the speaker section 20 (first audio output unit, first speaker) that reproduces the audio signal f1 as the first signal, the speaker device 200 of this embodiment also includes a speaker section 22 (second audio output unit, second speaker) that reproduces the elimination signal F3 as the second signal.

[0114] In this embodiment, the elimination signal generating section 27 outputs a control signal for reproducing the elimination signal F3 from the speaker section 22 to the speaker section 22. Assuming that a frequency response characteristic having an inverse characteristic that can overcome the frequency response characteristic H4 of the speaker section 22 is represented by G4, the elimination signal F3 is represented by an expression (-G4 H3 H2 F2). Therefore, a synthesized sound of the reproduced sound of the audio signal f1 output from the speaker section 20 and the reproduced sound of the elimination signal F3 output from the speaker section 22 is presented to the user U. As a result, the sound from the vibrator 21 can be eliminated.

[0115] In this embodiment as well, similar actions and effects as those of the first embodiment can be obtained. Specifically, according to this embodiment, since the speaker section 22 that reproduces the elimination signal F3 can be configured with specifications different from those of the speaker section 20 that reproduces the audio signal f1, the degree of freedom in design of each speaker section 20, 22 can be increased.

[0116] <Third Embodiment>

[0117] A description has been given illustrating the case where the tactile output portion 16 is a vibration device (vibrator 21) in each of the above-mentioned embodiments, but a case where the tactile output portion 16 is a tactile presentation device other than a vibration device will be described in this embodiment.

[0118] Examples of tactile presentation devices other than the vibration device may include a tactile presentation device (airflow generator) that sends an airflow to the user U through the driving of a diaphragm, a tactile presentation device (ultrasonic wave generator) that provides acoustic radiation pressure with an ultrasonic wave array focused on the body of the user U, and a tactile presentation device (electric muscle stimulator) that directly stimulates the tactile receptors or muscles of the user U through electrical stimulation. In other words, the tactile presentation device may be other devices that are not intended to directly vibrate the skin with vibration.

[0119] In addition, in these tactile presentation devices, noise is often generated along with the driving of the tactile presentation device, which sometimes interferes with the listening of music. In view of this situation, the noise sound is eliminated by generating a cancellation signal having characteristics of each device and outputting the cancellation signal from the speaker. Regarding the conversion function from the driving of the tactile presentation device to the sound, as shown in FIG. Fig.10 As shown, the case where the function is a function H5 having a specific frequency response characteristic similar to that of a vibration device can be illustrated as an example, and the case where the function is a nonlinear function H6 that continuously outputs a signal with a fixed amplitude and frequency in a driving interval (cycle) can be illustrated as another example. In the case where the conversion function is H5, the vibration signal f2 is generated Fig.10 The acoustic noise 70 on the mode shown in the upper part of the figure, and in the case where the transform coefficient is H6, is generated from the signal f2 Fig.10 The acoustic noise 71 is shown in the lower part of the figure. Although the behavior of the acoustic noise may be very different, the flow and principle of the noise cancellation process are the same. Figure 6 and Figure 7 similar.

[0120] Fig.11 3 is an explanatory diagram of the operation of the speaker device 300 in this embodiment. Figure 6 ) parts corresponding to the parts will be represented by the same figure marks, and detailed description will be omitted.

[0121] exist Fig.11 In the embodiment, the tactile presentation device 80 includes a tactile presentation device other than a vibration device. Here, assuming that the conversion function from the drive of the tactile presentation device 80 to the sound is represented by H6 and the frequency response characteristic of the tactile presentation device is represented by H7, the elimination signal generation section 17 generates an elimination signal F3 having a characteristic represented by the expression (-G1 H6 H7 F2). Therefore, the sound Y whose noise is not perceived by the user U is output from the speaker section 20 (audio output section 15).

[0122] <Modification example>

[0123] For example, in each of the above-mentioned embodiments, a wearable speaker device that is hung around the user's neck for use has been described as an example of a speaker device, but is not limited thereto. The present technology can also be applied to headphones or earphones mounted on the user's head. In this case, the tactile presentation unit can be configured as a device different from the speaker device. In this case, the tactile presentation unit can be placed at any position, and thus the sense of touch can be presented to a desired position of the user's body.

[0124] It should be noted that the present technology can also adopt the following configurations.

[0125] (1) A control device comprising:

[0126] a tactile control section that generates a tactile control signal for driving the tactile presentation unit based on the tactile signal presented by the tactile sense; and

[0127] The audio control section generates an audio control signal for driving the audio output unit based on the first audio signal and the second audio signal including a sound component in an opposite phase to the sound generated based on the tactile signal and generated from the tactile presentation unit.

[0128] (2) The control device according to (1), wherein

[0129] The audio control section generates an audio control signal by adding the second audio signal to the first audio signal.

[0130] (3) The control device according to (1) or (2), further comprising:

[0131] The signal generating section is eliminated, and the second audio signal is generated based on the haptic signal.

[0132] (4) The control device according to (3), wherein

[0133] The audio control section generates a first signal for driving a first audio output unit that reproduces a first audio signal, and

[0134] The cancellation signal generating part generates a second signal for driving a second audio output unit that reproduces a second audio signal.

[0135] (5) The control device according to (3) or (4), wherein

[0136] The cancellation signal generating section generates a second audio signal based on a frequency response characteristic of the audio output unit, a frequency response characteristic of the tactile presentation unit, and a conversion function from vibration generated at the tactile presentation unit to sound.

[0137] (6) A loudspeaker device comprising:

[0138] a tactile presentation unit;

[0139] Audio output unit;

[0140] a tactile control section that generates a tactile control signal for driving the tactile presentation unit based on the tactile signal presented by the tactile sense; and

[0141] The audio control section generates an audio control signal for driving the audio output unit based on the first audio signal and the second audio signal including a sound component in an opposite phase to the sound generated based on the tactile signal and generated from the tactile presentation unit.

[0142] (7) The speaker device according to (6), further comprising

[0143] The storage part stores the tactile signal and the first audio signal.

[0144] (8) The speaker device according to (6) or (7), further comprising:

[0145] The communication part is capable of communicating with a server storing the tactile signal and the first audio signal.

[0146] (9) The speaker device according to any one of (6) to (8), wherein

[0147] The audio output unit includes a common speaker unit that reproduces the first audio signal and the second audio signal.

[0148] (10) The speaker device according to any one of (6) to (8), wherein

[0149] The audio output unit includes a first speaker unit that reproduces a first audio signal and a second speaker unit that reproduces a second audio signal.

[0150] (11) The speaker device according to any one of (6) to (10), wherein

[0151] The audio output unit includes a right speaker and a left speaker, and

[0152] The speaker device also includes a coupler for hanging around the neck, the coupler coupling the right speaker with the left speaker.

[0153] (12) The speaker device according to any one of (6) to (11), wherein

[0154] The tactile presentation unit includes a vibration device.

[0155] (13) The speaker device according to any one of (6) to (11), wherein

[0156] Tactile presentation units include ultrasound, electromyography or air flow.

[0157] (14) An audio output method, comprising:

[0158] Acquire a tactile signal for tactile presentation and a first audio signal;

[0159] generating a tactile control signal for driving a tactile presentation unit based on the tactile signal;

[0160] generating a second audio signal including a sound component in antiphase with respect to a sound generated from a tactile presentation unit based on the tactile signal; and

[0161] An audio control signal for driving the audio output unit is generated based on the first audio signal and the second audio signal.

[0162] Reference numerals list

[0163] 1 Control device

[0164] 10 External Network

[0165] 11 Storage Devices

[0166] 12 Decoding part

[0167] 13 Audio Control Section

[0168] 14. Touch Control Section

[0169] 15 Audio output section

[0170] 16. Tactile output part

[0171] 17, 27 Eliminate signal generation part

[0172] 20, 22 Speaker section

[0173] 21 Vibrator

[0174] 80 Tactile presentation device

[0175] 100, 200, 300 speaker devices

[0176] 100C Coupler

[0177] 100L Left speaker

[0178] 100R Right speaker.

Claims

1. A control device, comprising: a tactile control part, which generates a tactile control signal for driving a tactile presentation unit based on the tactile signal presented by the tactile sense; an audio control section that generates an audio control signal for driving an audio output unit based on a first audio signal and a second audio signal, the second audio signal including a sound component in an opposite phase to a sound generated based on the tactile signal and generated from the tactile presentation unit; as well as The elimination signal generating part generates the second audio signal based on the tactile signal; wherein, The cancellation signal generating section generates the second audio signal based on a frequency response characteristic of the audio output unit, a frequency response characteristic of the tactile sense presentation unit, and a conversion function from vibration generated at the tactile sense presentation unit to sound.

2. The control device according to claim 1, wherein: The audio control section generates the audio control signal by adding the second audio signal to the first audio signal.

3. The control device according to claim 1, wherein: The audio control section generates a first signal for driving a first audio output unit that reproduces the first audio signal, and The cancellation signal generating portion generates a second signal for driving a second audio output unit that reproduces the second audio signal.

4. A speaker device, comprising: a tactile presentation unit; Audio output unit; a tactile control part, which generates a tactile control signal for driving the tactile presentation unit based on the tactile signal presented by the tactile sense; an audio control section that generates an audio control signal for driving the audio output unit based on a first audio signal and a second audio signal, the second audio signal including a sound component that is in an opposite phase to a sound generated based on the tactile signal and generated from the tactile presentation unit; as well as The elimination signal generating part generates the second audio signal based on the tactile signal; wherein, The cancellation signal generating section generates the second audio signal based on a frequency response characteristic of the audio output unit, a frequency response characteristic of the tactile sense presentation unit, and a conversion function from vibration generated at the tactile sense presentation unit to sound.

5. The speaker device according to claim 4, further comprising A storage part stores the tactile signal and the first audio signal.

6. The speaker device according to claim 4, further comprising The communication part is capable of communicating with a server storing the tactile signal and the first audio signal.

7. The speaker device according to claim 4, wherein The audio output unit includes a common speaker unit that reproduces the first audio signal and the second audio signal.

8. The speaker device according to claim 4, wherein The audio output unit includes a first speaker unit that reproduces the first audio signal and a second speaker unit that reproduces the second audio signal.

9. The speaker device according to claim 4, wherein The audio output unit includes a right speaker and a left speaker, and The speaker device also includes a coupler for hanging around a neck, the coupler coupling the right speaker with the left speaker.

10. The speaker device according to claim 4, wherein The tactile presentation unit includes a vibration device.

11. The speaker device according to claim 4, wherein The tactile presentation unit includes an ultrasonic generator, an electrical muscle stimulator or an airflow generator.

12. An audio output method, comprising: Acquire a tactile signal presented by tactile sense and a first audio signal; generating a tactile control signal for driving a tactile presentation unit based on the tactile signal; generating a second audio signal including a sound component in antiphase with respect to a sound generated from the tactile presentation unit based on the tactile signal; generating an audio control signal for driving an audio output unit based on the first audio signal and the second audio signal; generating the second audio signal based on the tactile signal; as well as The second audio signal is generated based on a frequency response characteristic of the audio output unit, a frequency response characteristic of the tactile presentation unit, and a transformation function from vibration generated at the tactile presentation unit to sound.

Images