Earphone device and electronic system

Abstract

To provide an earphone device and an electronic system, allowing a user to obtain more presences when the user listens to sounds.SOLUTION: There is provided, for example, an earphone device 100 including a processor 103 which functions as means to emit, from a speaker 105, sounds based on sound signals that are input via near-field wireless communication. The earphone device includes: a vibrator 102 to transmit vibrations through a tactile sense to a user's head; and the processor 103 to vibrate the vibrator 102 at a vibration level / pattern based on predetermined input information, for example, the level of ambient sounds picked up by a microphone 140.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to earphone devices and electronic systems. [Background technology]

[0002] Conventionally, there is known a wearable device that transmits sound collected by a microphone to a user via bone conduction using a vibrator that transmits vibrations to the user's bones (for example, Patent Document 1). This device enables humans to perceive sound through bone conduction. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2023-133138 Summary of the Invention [Problem to be solved by the invention]

[0004] When listening to music at a concert venue or hearing the surrounding environmental sounds, humans experience the atmosphere of the venue not only through hearing but also through touch. However, when listening to concert music or surrounding environmental sounds using conventional bone conduction devices or general earphone devices, humans can only sense the atmosphere of the concert venue or surrounding environment through their hearing via the earphone device's speaker or bone conduction device, making it difficult to enhance the experience as if they were actually there.

[0005] An object of the present invention is to provide a more realistic sound experience when listening to sound. [Means for solving the problem]

[0006] An example of an earphone device includes a sound emitting means for emitting sound from a speaker based on an input acoustic signal, a vibrator for transmitting vibrations to a user, and a control unit for vibrating the vibrator at a vibration level or vibration pattern based on predetermined input information. [Effects of the Invention]

[0007] According to the present invention, it is possible to obtain a greater sense of realism when listening to sound. [Brief explanation of the drawings]

[0008] [Figure 1] 1A and 1B are diagrams showing an example of the appearance of a first embodiment or a second embodiment of an earphone device, and a configuration example of an embodiment of an electronic system including the first and second embodiments of the earphone device. [Figure 2] FIG. 2 is a diagram illustrating an example of the internal configuration of an earphone device. [Figure 3] FIG. 2 is a block diagram illustrating an example of a hardware configuration of a processor. [Figure 4] 10 is a flowchart illustrating an example of a main process of vibrator control in the embodiment. [Figure 5] 10 is a flowchart showing a detailed example of a transducer level / pattern calculation process in the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. First, first and second embodiments of an earphone device will be described. The earphone device 100 in the first and second embodiments is a music playback earphone worn in each of the left and right ears, and each ear has the same shape. As shown in FIG. 1(a), the appearance of the single-ear earphone device 100 includes an earphone device main body 101, a protrusion 110, and an ear tip portion 109. The ear tip portion 109 is an earmuff cover, and the user inserts this ear tip portion 109 into the ear canal of each ear.

[0010] Each of the earphone devices 100 in the first and second embodiments, each having the configuration shown in Fig. 1(a) and worn on the left and right ears, performs a pairing operation for near-field wireless communication with an external device 120 such as a smartphone, tablet terminal, or smartwatch (Fig. 1(b) shows an example of a smartphone), as shown in Fig. 1(b). As a result, the two earphone devices 100, which are wireless earphones, are connected to the external device 120 via near-field communication 130, and the two earphone devices 100 and the external device 120 operate as an electronic system. Note that each earphone device 100 may also be connected to the external device 120 by wire rather than wirelessly.

[0011] 2(a) is a side cross-sectional view showing the internal configuration of the earphone device 100 according to the first and second embodiments. The earphone device 100 includes electronic components in an earphone device body 101, such as a vibrator 102, a processor 103, a short-range wireless communication antenna (abbreviated as "antenna" in FIG. 2(a)) 104, a speaker unit 105, and a lithium-ion rechargeable battery 106. Only the earphone device 100 according to the second embodiment includes a microphone (abbreviated as "mic" in FIG. 2(a)) 140 in the protrusion 110.

[0012] In the first and second embodiments, the vibrator 102 is an element that vibrates to transmit vibrations to the user's head via the earphone device main body 101, and can be, for example, a vibration element such as a small vibration motor, a quartz oscillator, or an ultrasonic vibrator.

[0013] In the first and second embodiments, the processor 103 is a small computer or DSP (digital signal processor) having a configuration in which integrated circuits and other electronic circuit components are arranged on a printed circuit board. The processor 103 is powered by a lithium-ion rechargeable battery 106. The lithium-ion rechargeable battery 106 can be charged by an external charging device (not shown). The processor 103 is connected to a short-range wireless communication antenna 104 and communicates with the external device 120 shown in FIG. 1(b) using a short-range wireless communication method, such as Bluetooth (a registered trademark of Bluetooth SIG). The processor 103 receives coded and modulated acoustic data from the external device 120 via short-range wireless communication, demodulates and decodes the data to obtain digital acoustic data, converts the digital acoustic data into an analog acoustic signal, amplifies the signal, and then emits the sound from the speaker unit 105. The emitted acoustic signal is emitted from the sound emission tube 107, through the mesh portion 111, and into the user's ear canal through the opening 108. The processor 103 also operates as a vibrator control unit, and vibrates the vibrator 102 at a vibration level or with a vibration pattern based on predetermined input information.

[0014] In the second embodiment shown in FIG. 2(a) that includes a microphone 140, the processor 103 causes the microphone 140 to collect environmental sounds around the user, acquires the level of the environmental sounds as the above-mentioned predetermined input information, and vibrates the vibrator 102 at a vibration level or vibration pattern based on the predetermined input information.

[0015] As will be described later with reference to the flowchart of FIG. 5 , the vibrator 102 vibrates at a corresponding amplitude level or vibration pattern, for example, based on the level of audio reproduced based on digital audio data input from the external device 120 as predetermined input information, or in the second embodiment, based on the level of environmental audio collected by the microphone 140 as predetermined input information, or based on the level of audio or video content of the external environment input from the external device 120 shown in FIG. 1B as predetermined input information, or based on the result of the external environment assessment by the external device 120 as predetermined input information. The vibration level and vibration pattern can be differentiated based on the sense of realism or danger indicated by the audio data or the external environment. For example, if the audio data is a live concert sound source, the vibration level of the vibrator 102 can be increased when the cheers of the audience at the concert venue become louder or when the external audio collected by the microphone 140 or the external device 120 becomes louder. Conversely, the vibrator 102 can be prevented from vibrating when the level of the cheers or the external audio is below a predetermined level. Furthermore, for example, when the external device 120 detects external environmental sounds such as a human shout or the sound of automobile braking, it can alert the user of the earphone device 100 to danger by a vibration pattern that intermittently vibrates the vibrator 102. The vibration level or vibration pattern based on predetermined input information may be calculated by the earphone device 100 or the external device 120. Unlike a bone conduction device that transmits sound to bones, the vibrator 102 can stimulate the human sense of touch rather than the sense of hearing by presenting a vibration level intensity or vibration pattern without interfering with the sound emitted from the speaker unit 105.

[0016] Next, a third embodiment will be described. The earphone device 200 in the third embodiment is an example of a hearing aid. FIG. 2(b) is a side cross-sectional view showing the internal structure of the earphone device 200 in the third embodiment. The earphone device 200 has a curved structure that can be hooked onto one ear, and the user uses it by inserting the ear tip portion 209 into the ear canal of the other ear. An earphone device main body 201 includes electronic components such as a vibrator 202, a processor 203, a short-range wireless communication antenna 204, a speaker unit 205, a button battery 206, a microphone 210, and an operation switch group 211.

[0017] The vibrator 202 is an element that vibrates to transmit vibrations to the user's head via the earphone device main body 201, similar to the vibrator 102 of the earphone device 100 of FIG. 2(a) in the first or second embodiment, and may be a vibrating element such as a small vibration motor, a quartz oscillator, or an ultrasonic oscillator.

[0018] The processor 203, like the processor 103 of the earphone device 100 of FIG. 2(a) in the first embodiment, has a configuration in which integrated circuits and other electronic circuit components are arranged on a printed circuit board, and is a small computer or DSP. The processor 203 is powered by a button battery 206. The processor 203 obtains digital acoustic data of the environmental sound around the user collected by a microphone 210, converts the digital acoustic data into an analog acoustic signal, amplifies the signal, and then emits the signal from a speaker unit 205. The emitted acoustic signal is emitted into the user's ear canal from an opening 208 via a sound emission tube 207. The processor 203 also operates as a vibrator driver, vibrating the vibrator 202 at a vibration level or vibration pattern based on predetermined input information.

[0019] As in the second embodiment having microphone 140 in FIG. 2(a), processor 203 causes microphone 210 to collect environmental sounds around the user, acquires the level of the environmental sounds as predetermined input information, and vibrates vibrator 102 at a vibration level or vibration pattern based on the predetermined input information.

[0020] The hardware of the processor 103 of FIG. 2(a) in the first or second embodiment, or the processor 203 of FIG. 2(b) in the third embodiment, has the configuration of a general-purpose computer 300 shown in FIG. 3, for example. This computer 300 includes a CPU (Central Processing Unit) 301, a ROM (Read Only Memory) 302, a RAM (Random Access Memory) 303, a near-field communication interface (abbreviated as "near-field communication interface" in FIG. 3) 306, a microphone interface 307, and a switch interface 308, all interconnected by a system bus 309, and also includes a power supply circuit 310 that supplies power to each of the circuits 301 to 308. Note that the processor 103 of the earphone device 100 of the first embodiment, which does not include the microphone 140 in FIG. 2(a), may not include the microphone interface 307. Furthermore, if the earphone device 100 of the first or second embodiment, which has the configuration of FIG. 2(a) and does not include switches, the processor 103 may not include the switch interface 308. Furthermore, the processor 203 of the earphone device 200 of the third embodiment shown in FIG. 2(b) does not need to include the near field communication interface 306.

[0021] The CPU 301 performs various processes by loading a control program stored in the ROM 302 into the RAM 303 and executing it. In the case of the processor 103 of the earphone device 100 of FIG. 2(a) in the first or second embodiment, which are embodiments of music playback earphones, the CPU 301 performs the following acoustic signal processing. The CPU 301 receives coded and modulated acoustic data from the external device 120 of FIG. 1(b) via the short-range wireless communication interface 306 of FIG. 3, demodulates and decodes the data to obtain digital acoustic data, converts the digital acoustic data into an analog acoustic signal, amplifies the analog acoustic signal by the audio amplifier 305 of FIG. 3, and then emits sound from the speaker unit 105 of FIG. 2(a). On the other hand, in the case of the processor 203 of the earphone device 200 of FIG. 2(b) in the third embodiment, which is an embodiment of a hearing aid, the CPU 301 performs the following acoustic signal processing. The CPU 301 obtains digital acoustic data of the environmental sounds around the user collected by the microphone 210 in FIG. 2(b), converts the digital acoustic data into an analog acoustic signal, amplifies the analog acoustic signal by the audio amplifier 305 in FIG. 3, and then emits the signal from the speaker unit 205 in FIG. 2(b).

[0022] Next, the processing of the vibrator 102 (FIG. 2(a)) or the vibrator 202 (FIG. 2(b)) will be described below using the flowcharts of FIGS. 4 and 5. FIG. 4 is a flowchart showing an example of main processing of vibrator control executed by the CPU 301 of FIG. 3. This processing is processing in which the CPU 301 of FIG. 3 reads a vibrator control processing program stored in the ROM 302 into the RAM 303 and executes it.

[0023] In the vibrator control process of Fig. 4, after the earphone device 100 (Fig. 2(a)) or the earphone device 200 (Fig. 2(b)) is powered on, the CPU 301 executes a process of calculating a vibrator level or a vibrator pattern (step S401), sets the calculated vibrator level or vibrator pattern in the vibrator amplifier 304 of Fig. 3, and causes the vibrator 102 (Fig. 2(a)) or the vibrator 202 (Fig. 2(b)) to vibrate (step S402), repeatedly executing this process. In this specification, the terms "vibrator level" and "vibrator pattern" refer to the vibration level and vibration pattern, respectively, when vibrating the vibrator.

[0024] FIG. 5(a) is a flowchart showing a detailed example of the vibrator level / pattern calculation process in step S401 of FIG. 4 in the case of the earphone device 100 according to the first embodiment.

[0025] 5(a), the CPU 301 first acquires the level of the reproduced audio of the digital audio data acquired from the external device 120 of FIG. 1(b) via the short-range wireless communication interface 306 of FIG. 3 (step S511 of FIG. 5(a)). More specifically, the CPU 301 calculates, for example, the average amplitude level of the reproduced audio every certain time period (tens to hundreds of milliseconds).

[0026] Next, the CPU 301 calculates a vibrator level or a vibrator pattern according to the level of the reproduced sound acquired (calculated) in step S511 (step S512 in FIG. 5(a)). This process may be performed using a specified conversion table or the like stored in the ROM 302 or the like. Thereafter, the CPU 301 ends the process of step S401 in FIG. 4 shown in the flowchart in FIG. 5(a).

[0027] FIG. 5(b) is a flowchart showing a detailed example of the vibrator level / pattern calculation process in step S401 of FIG. 4 in the case of the earphone device 100 according to the second embodiment or the earphone device 200 according to the third embodiment.

[0028] 5(b), CPU 301 first acquires the level of the environmental sound collected by microphone 140 (FIG. 2(a)) or microphone 210 (FIG. 2(b)) (step S521 in FIG. 5(b)). More specifically, CPU 301 calculates, for example, the average amplitude level of the environmental sound every certain time period (tens of milliseconds to hundreds of milliseconds).

[0029] Next, the CPU 301 calculates a vibrator level or a vibrator pattern according to the level of the environmental sound acquired (calculated) in step S521 (step S522 in FIG. 5(b)). This process may be performed using a specified conversion table or the like stored in the ROM 302 or the like. Thereafter, the CPU 301 ends the process of step S401 in FIG. 4 shown in the flowchart in FIG. 5(b).

[0030] FIG. 5(c) is a flowchart showing a detailed example of the vibrator level / pattern calculation process of step S401 in FIG. 4 in the case of the earphone device 100 according to the first or second embodiment under the electronic system configuration of FIG. 1(b).

[0031] In FIG. 5(c), the external device 120 in FIG. 1(b) collects the level of external environmental sound. The external environmental sound is, for example, the level of environmental sound around the external device 120 held by a user, which is collected by a microphone (not shown) built into the external device 120 and calculated at regular intervals as described above. Alternatively, the external environmental sound may be, for example, the level of environmental sound related to music being played on the external device 120, such as the cheers of an audience recorded at a concert venue. The external device 120 transmits information about the level of the external environmental sound collected in this manner to the earphone device 100 via the short-range communication 130 (FIG. 1(b)). In response, the CPU 301 of the processor 103 of the earphone device 100 acquires the level of the external environmental sound from the external device 120 via the short-range wireless communication interface 306 (step S531 in FIG. 5(c)).

[0032] Next, the CPU 301 calculates a vibrator level or a vibrator pattern according to the level of the external environmental sound acquired in step S531 (step S532 in FIG. 5(c)). This process may be performed using a specified conversion table or the like stored in the ROM 302 or the like. Thereafter, the CPU 301 ends the process of step S401 in FIG. 4 shown in the flowchart in FIG. 5(c). In addition, in FIG. 5(c), instead of the external device 120 notifying the level of the environmental sound, the external device 120 may calculate the vibration level or vibration pattern based on the acquired level of the environmental sound and notify the earphone device 100 of the calculation result.

[0033] FIG. 5(d) is a flowchart showing another detailed example of the vibrator level / pattern calculation process of step S401 in FIG. 4 in the case of the earphone device 100 of the first or second embodiment under the electronic system configuration of FIG. 1(b).

[0034] In FIG. 5(d), the external device 120 in FIG. 1(b) determines the content of the external environment. The external device 120 determines the content of the external environment, for example, around the external device 120 held by a user, using, for example, AI (artificial intelligence). The content of the external environment may be, for example, a specific foreign language being spoken in the vicinity, specific content, a name being called, a shout warning of danger, the sound of an approaching car, or a photograph of an approaching car. The external device 120 transmits information about the content of the external environment thus determined to the earphone device 100 via the short-range communication 130 (FIG. 1(b)). In response, the CPU 301 of the processor 103 of the earphone device 100 acquires the content of the external environment from the external device 120 via the short-range wireless communication interface 306 (step S541 in FIG. 5(d)).

[0035] Next, the CPU 301 calculates a vibrator level or vibrator pattern according to the content of the external environment acquired in step S541 (step S542 in FIG. 5(d)). This process may be performed using a specified conversion table or the like stored in the ROM 302 or the like. Thereafter, the CPU 301 ends the process of step S401 in FIG. 4 shown in the flowchart in FIG. 5(d). 5(d), instead of the external device 120 notifying the content of the external environment, the external device 120 may calculate a vibration level or a vibration pattern based on the acquired content of the external environment and notify the calculation result to the earphone device 100. Also, the external device 120 may determine the content of the acoustic signal to be reproduced by the earphone device 100, rather than the content of the external environment.

[0036] FIG. 5(e) is a flowchart showing yet another detailed example of the vibrator level / pattern calculation process of step S401 in FIG. 4 in the case of the earphone device 100 according to the first or second embodiment under the electronic system configuration of FIG. 1(b).

[0037] In Fig. 5(e), the external device 120 in Fig. 1(b) determines the state of the external environment. The external device 120 determines, for example, whether a call has been received or whether an email or various messages have been received at the external device 120. The external device 120 transmits information about the determination result of the external environment to the earphone device 100 by short-range communication 130 (Fig. 1(b)). In response, the CPU 301 of the processor 103 of the earphone device 100 acquires the determination result of the external environment from the external device 120 via the short-range wireless communication interface 306 (step S551 in Fig. 5(e)).

[0038] Next, the CPU 301 calculates a vibrator level or vibrator pattern according to the determination result of the external environment acquired in step S551 (step S552 in FIG. 5(e)). This process may be performed using a specified conversion table or the like stored in the ROM 302 or the like. Thereafter, the CPU 301 ends the process of step S401 in FIG. 4 shown in the flowchart in FIG. 5(e). In addition, in FIG. 5(e), instead of the external device 120 notifying information on the determination result of the external environment, the external device 120 may calculate the vibration level or vibration pattern based on the determination result of the external environment and notify the earphone device 100 of the calculation result.

[0039] In this way, with the earphone device, the user can feel not only the sound emitted from the speaker but also the vibrations according to the music playback level, the level or content of the surrounding environmental sounds (sounds warning of danger, etc.), and the results of the external environment assessment (an incoming call, email, or message, an alarm sounding, etc. in the external device 120) through the level and pattern of the vibrations. A more realistic sense of presence can be achieved when playing music. [Explanation of symbols]

[0040] 100, 200 earphone device, 102, 202 vibrator, 103, 203 processor, 104 near-field communication antenna, 120 external device, 140, 210 microphone, 301 CPU, 304 vibrator amplifier

Claims

1. a sound emitting means for emitting sound from a speaker based on an input sound signal; a vibrator that transmits vibrations to a user; a control unit that vibrates the vibrator at a vibration level or vibration pattern based on predetermined input information; An earphone device comprising:

2. The vibration caused by the vibrator is a vibration that conveys a presentation based on the acoustic signal and / or environmental sound around the user to the user through a tactile sensation. The earphone device of claim 1 .

3. The earphone device according to claim 1 , wherein the control unit acquires the input acoustic signal as the predetermined input information.

4. Further provided is a microphone that collects environmental sounds around the user, The earphone device according to claim 1 , wherein the control unit acquires the environmental sound collected by the microphone as the predetermined input information.

5. The earphone device according to claim 4 , wherein the control unit detects the content of the environmental sound and determines the vibration level or the vibration pattern.

6. 3. An electronic system in which the earphone device according to claim 1 or 2 and an external device are connected by short-range wireless communication, The external device transmits the predetermined input information to the earphone device. Electronic systems.

7. The external device detects an environmental sound around the user, The electronic system of claim 6 , wherein the earphone device vibrates the vibrator with the vibration level or the vibration pattern based on the detected environmental sound.

8. the external device detects either an acoustic signal or the contents of the user's surrounding environment; The electronic system of claim 6 , wherein the earphone device vibrates the vibrator with the vibration level or the vibration pattern based on the detected content.

9. The external device determines the user's external environment; The electronic system of claim 6 , wherein the earphone device vibrates the vibrator at the vibration level or the vibration pattern based on a result of the determination.

Images