Sound output device, sound output method, and program

Abstract

To provide a sound output device, sound output method, and program that have improved functions and / or usability.SOLUTION: A sound output device includes: a first output section that outputs sound to one of user's ears; a second output section that outputs sound to the other of the user's ears; a first detection section that detects approach of an object in the vicinity of the first output section; and a control section that causes the first output section to output a first sound that includes at least one of a predetermined playback sound and a predetermined speech sound based on the detection of the approach of an object by the first detection section, and causes the second output section to output a second sound that includes a predetermined masking sound.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present disclosure relates to a sound output device, a sound output method, and a program. [Background technology]

[0002] Various technologies related to devices that output sound from earphones or the like (for example, wearable devices or hearable devices) have been proposed. For example, Non-Patent Document 1 proposes a technology related to an earphone-type device that can distinguish a user's gestures, such as covering their ears with their hands. This technology proposes distinguishing between a number of gestures, such as a user covering their ears with their hands, based on the results of a microphone capturing the leakage of sound output from the earphones. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Sora Amesaka and 3 others, "Study on hand shape recognition method for hearable devices using sound leakage signals", [online], December 8, 2022, WISS 2022: 30th Workshop on Interactive Systems and Software, [Retrieved May 24, 2023], Internet<URL: https: / / www.wiss.org / WISS2022Proceedings / data / 12.pdf> Summary of the Invention [Problem to be solved by the invention]

[0004] It would be desirable to provide further improvements to devices that output sounds as described above (hereinafter also referred to as "sound output devices") to improve the functionality and / or usability of such devices.

[0005] An object of the present disclosure is to provide a sound output device, a sound output method, and a program with improved functionality and / or usability. [Means for solving the problem]

[0006] A sound output device according to an embodiment includes: A first output unit that outputs sound to one ear of a user; A second output unit that outputs sound to the other ear of the user; a first detection unit that detects the approach of an object in the vicinity of the first output unit; a control unit that causes the first output unit to output a first sound including at least one of a predetermined playback sound and a predetermined call voice, and causes the second output unit to output a second sound including a predetermined masking sound, based on detection of the approach of the object by the first detection unit; Equipped with.

[0007] A sound output device according to an embodiment includes: A first output unit that outputs sound to one ear of a user; A second output unit that outputs sound to the other ear of the user; a first sound collection unit that collects a first external sound around the first output unit; a control unit that causes the first output unit to output a first sound including at least one of a predetermined playback sound and a predetermined call voice, and causes the second output unit to output a second sound including a predetermined masking sound, based on a predetermined change in the first external sound collected by the first sound collection unit; Equipped with.

[0008] A sound output method according to an embodiment includes: detecting an approach of an object by a first detection unit in the vicinity of the first output unit; a step of outputting a first sound including at least one of a predetermined playback sound and a predetermined call voice from the first output unit and outputting a second sound including a predetermined masking sound from the second output unit based on detection of the approach of the object by the first detection unit; Includes.

[0009] A program according to an embodiment includes: For electronic devices, detecting an approach of an object by a first detection unit in the vicinity of the first output unit; a step of outputting a first sound including at least one of a predetermined playback sound and a predetermined call voice from the first output unit and outputting a second sound including a predetermined masking sound from the second output unit based on detection of the approach of the object by the first detection unit; A program to execute. Effect of the Invention

[0010] According to one embodiment, it is possible to provide a sound output device, a sound output method, and a program with improved functionality and / or usability. [Brief description of the drawings]

[0011] [Figure 1] 1A and 1B are diagrams illustrating examples of usage of a sound output device according to an embodiment. [Diagram 2] 1A and 1B are diagrams illustrating examples of usage of a sound output device according to an embodiment. [Diagram 3] 1A and 1B are diagrams illustrating examples of usage of a sound output device according to an embodiment. [Figure 4] FIG. 1 is a diagram illustrating an example of a usage mode of a system including a sound output device according to an embodiment. [Diagram 5] 1 is a block diagram showing a schematic functional configuration of a sound output device according to an embodiment; [Figure 6] 1A and 1B are diagrams illustrating examples of usage of a sound output device according to an embodiment. [Figure 7] 10 is a flowchart illustrating an example of an operation of a sound output device according to an embodiment. [Figure 8] 10 is a flowchart illustrating an example of an operation of a sound output device according to an embodiment. [Figure 9] 10 is a flowchart illustrating an example of an operation of a sound output device according to an embodiment. [Figure 10A] 6A and 6B are diagrams illustrating an example of detection by a detection unit of a sound output device according to an embodiment. [Figure 10B]6A and 6B are diagrams illustrating an example of detection by a detection unit of a sound output device according to an embodiment. [Figure 11] 1 is a block diagram showing a schematic functional configuration of a sound output device according to an embodiment; [Figure 12] 1A and 1B are diagrams illustrating examples of usage of a sound output device according to an embodiment. [Figure 13] 1 is a block diagram showing a schematic functional configuration of a sound output device according to an embodiment; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0013] In the present disclosure, a "sound output device" may be an electronic device that outputs sound. Here, an "electronic device" may be a device that is driven by electricity. Also, in the present disclosure, a "user" may be a person (typically a human) who uses a sound output device according to an embodiment and / or a system that includes the sound output device. Also, a "system" may include a device that is driven by electricity.

[0014] The sound output device according to the embodiment described below can record sounds in the surrounding environment at all times and output the sounds in the surrounding environment so that the user can hear them. The sound output device according to the embodiment can output the sound of a voice call so that the user can hear it, for example, as in a wearable device (or a hearable device) used together with a mobile phone or a smartphone. When the sound output device according to the embodiment detects a predetermined gesture of the user's hand or the like, it operates so that the reproduced sound or the voice call output from the sound output device is easily audible to the user.

[0015] A sound output device according to an embodiment can be implemented in various aspects. Figures 1 to 4 are diagrams showing examples of some embodiments of the sound output device. Hereinafter, the sound output device according to some embodiments will be described with reference to Figures 1 to 4.

[0016] The sound output device 1A according to the embodiment shown in FIG. 1 can be configured as a headphone-type electronic device. The sound output device 1B according to the embodiment shown in FIG. 2 can be configured as an electronic device such as an inner-ear type earphone or a canal type earphone. The sound output device 1C according to the embodiment shown in FIG. 3 can be configured as an electronic device such as a bone conduction earphone. The sound output device 1D according to the embodiment shown in FIG. 4 can configure a system that cooperates with other electronic devices (e.g., a smartphone 100) while including at least a partially similar configuration to the sound output device 1B according to the embodiment shown in FIG. 2.

[0017] The sound output device 1A shown in FIG. 1 includes, for example, a left housing 11, a right housing 12, and a headband 13. The left housing 11 and the right housing 12 are connected via the headband 13. That is, the left housing 11 and the right housing 12 are connected to both ends of the headband 13. When a user wears the sound output device 1A, the left housing 11 is placed in contact with the left ear E1 of the user U. The left housing 11 is used to output a sound to be heard by the left ear E1 of the user U. When a user wears the sound output device 1A, the right housing 12 is placed in contact with the right ear E2 of the user U. The right housing 12 is used to output a sound to be heard by the right ear E2 of the user U.

[0018] In the sound output device 1A shown in Fig. 1, the headband 13 is arranged from near the top of the user U along the left and right ears. However, instead of the headband 13, for example, a band arranged near the back of the head or the forehead of the user U may be used, or for example, a neckband located near the neck of the user U may be used. The sound output device 1A may have a configuration similar to or identical to headphones such as over-ear type, on-ear type, or open-air type. Furthermore, the sound output device 1A may have a configuration similar to or identical to, for example, a headset.

[0019] As shown in FIG. 1, the left housing 11 of the sound output device 1A includes a first output section 21 and a first detection section 31.

[0020] The first output unit 21 is disposed facing the left ear E1 of the user U so that sound is output toward the left ear E1 of the user U. The first output unit 21 may be configured to include a dynamic speaker such as any speaker (loudspeaker).

[0021] The first detection unit 31 is disposed near the first output unit 21. The first detection unit 31 may be disposed near the left ear E1 of a user U wearing the sound output device 1A. The first detection unit 31 may be configured to include, for example, a microphone that picks up sounds in the surrounding environment of the left housing 11. The first detection unit 31 may be an acoustic device that receives sounds as air vibrations using a diaphragm or the like and converts the sounds into electrical signals.

[0022] As shown in FIG. 1, the right housing 12 of the sound output device 1A includes a second output section 22 and a second detection section 32. As shown in FIG.

[0023] The second output unit 22 is disposed facing the right ear E2 of the user U so that sound is output toward the right ear E2 of the user U. The second output unit 22 may be configured to include a dynamic speaker such as any speaker (loudspeaker).

[0024] The second detection unit 32 is disposed near the second output unit 22. The second detection unit 32 may be disposed near the right ear E2 of the user U wearing the sound output device 1A. The second detection unit 32 may be configured to include, for example, a microphone that picks up sounds in the surrounding environment of the right housing 12. The second detection unit 32 may be an acoustic device that receives sounds as air vibrations using a diaphragm or the like and converts the sounds into electrical signals.

[0025] The sound output device 1B shown in FIG. 2 includes, for example, a left housing 11 and a right housing 12. Unlike the sound output device 1A shown in FIG. 1, the sound output device 1B shown in FIG. 2 does not include a headband 13. In the sound output device 1B, the left housing 11 and the right housing 12 may be connected by at least one of wired and wireless connection. When a user wears the sound output device 1B, the left housing 11 is placed on the left ear E1 of the user U. The left housing 11 is used to output a sound to be heard by the left ear E1 of the user U. When a user wears the sound output device 1B, the right housing 12 is placed on the right ear E2 of the user U. The right housing 12 is used to output a sound to be heard by the right ear E2 of the user U. In the sound output device 1B shown in FIG. 2, the sound output device 1 may have a configuration similar to or similar to an ear-hook type earphone, an inner-ear type earphone, or a canal type earphone. Furthermore, the sound output device 1B may have a configuration the same as or similar to that of an earset, for example.

[0026] 2, the left housing 11 of the sound output device 1B includes a first output unit 21 and a first detection unit 31. Also, as shown in Fig. 1, the right housing 12 of the sound output device 1A includes a second output unit 22 and a second detection unit 32. These functional units may be based on the same concept as in the case of the sound output device 1A shown in Fig. 1.

[0027] The sound output device 1C shown in FIG. 3 includes, for example, a left housing 11, a right housing 12, and a headband 13. The left housing 11 and the right housing 12 are connected via the headband 13. That is, the left housing 11 and the right housing 12 are connected to both ends of the headband 13. When a user wears the sound output device 1C, the left housing 11 may be disposed at a position relatively close to the left ear E1 of the user U. The left housing 11 is used to output a sound to be heard by the left ear E1 of the user U. When a user wears the sound output device 1C, the right housing 12 may be disposed at a position relatively close to the right ear E2 of the user U. The right housing 12 is used to output a sound to be heard by the right ear E2 of the user U. As shown in FIG. 3, in the sound output device 1C, the left housing 11 and / or the right housing 12 may not be disposed so as to cover the ears of the user U (or may not be disposed on the ears of the user U).

[0028] 3, the headband 13 is disposed from near the back of the head along the left and right ears of the user U. However, the headband 13 may be a band disposed near the top of the head or the forehead of the user U, for example.

[0029] 3, the left housing 11 of the sound output device 1C includes a first output unit 21 and a first detection unit 31. The right housing 12 of the sound output device 1C includes a second output unit 22 and a second detection unit 32.

[0030] In the sound output device 1C, the first output unit 21 and the second output unit 22 may each be a bone conduction earphone (bone conduction speaker). In this case, the first output unit 21 and the second output unit 22 do not need to be disposed on or immediately adjacent to the left ear E1 and the right ear E2 of the user U, respectively. In addition, the first output unit 21 and the second output unit 22 do not need to be inserted into the ear canal or ear canal of the user U, respectively.

[0031] In the sound output device 1C, the first detection section 31 and the second detection section 32 may be based on the same concept as in the case of the sound output device 1A shown in FIG.

[0032] The above-mentioned sound output device 1A, sound output device 1B, and sound output device 1C have been described as operating or functioning independently. However, part of the functions of each of the sound output device 1A, sound output device 1B, and sound output device 1C may be performed by another electronic device.

[0033] The sound output device 1D shown in FIG. 4 may include at least a partially similar configuration to the sound output device 1B shown in FIG. 2. The sound output device 1D may be connected to another electronic device such as a smartphone 100 by at least one of wired and wireless connection. For example, the sound output device 1D can cooperate with the smartphone 100 by wirelessly pairing with the smartphone 100. For example, the sound output device 1D can cause the user to auditorily perceive sounds such as music and / or voice reproduced by the smartphone 100. The sound output device 1D can also cause the user to auditorily perceive sounds such as voice of a call made by the smartphone 100.

[0034] The above-described sound output device 1A, sound output device 1B, sound output device 1C, and sound output device 1D may be collectively referred to as "sound output device 1" as appropriate.

[0035] FIG. 5 is a block diagram showing a schematic functional configuration of the above-described sound output device 1. As shown in FIG.

[0036] As shown in Fig. 5, the sound output device 1 may include a first output unit 21, a second output unit 22, a first detection unit 31, a second detection unit 32, a control unit 40, a storage unit 50, a communication unit 60, and a power supply unit 70. As shown in Fig. 5, in the sound output device 1, the first output unit 21, the second output unit 22, the first detection unit 31, the second detection unit 32, the storage unit 50, the communication unit 60, and the power supply unit 70 may each be connected to the control unit 40. In one embodiment, the sound output device 1 may not include some of the functional units shown in Fig. 5, or may include functions other than the functional units shown in Fig. 5.

[0037] The first output unit 21 and the second output unit 22 output auditorily perceptible information such as a sound to the user U. The first output unit 21 and / or the second output unit 22 may be configured to include any speaker as described above. Also, the first output unit 21 and / or the second output unit 22 may be configured to include any bone conduction earphone as described above. The first output unit 21 and the second output unit 22 may be any functional unit that outputs auditorily perceptible information to the user U as air conduction sound and / or bone conduction sound, etc. In this way, the first output unit 21 outputs a sound to be perceived by one ear (e.g., the left ear E1) of the user U. Also, the second output unit 22 outputs a sound to be perceived by the other ear (e.g., the right ear E2) of the user U.

[0038] The first detection unit 31 and the second detection unit 32 may be any functional unit capable of detecting the approach of an object such as a user's hand (palm or fingers) in the vicinity of the first output unit 21 and the second output unit 22, respectively. For example, the first detection unit 31 and the second detection unit 32 may be configured to include a microphone (microphone) that picks up sounds in the surrounding environment of the left housing 11 and the right housing 12, respectively, as described above. A manner of detecting the approach of an object such as a user's hand when the first detection unit 31 and / or the second detection unit 32 are configured with a microphone will be described further below.

[0039] The first detection unit 31 and / or the second detection unit 32 may be configured to include, for example, any proximity sensor instead of a microphone. The first detection unit 31 and / or the second detection unit 32 may be configured to further include, for example, any proximity sensor together with a microphone. Such a configuration will also be described in more detail below.

[0040] The control unit 40 controls and / or manages the entire sound output device 1, including each functional unit constituting the sound output device 1. The control unit 40 can be configured to include, for example, a CPU (Central Processing Unit) or a DSP (Digital Signal Processor). In one embodiment, the control unit 40 may be configured to include, for example, a CPU (hardware) and a program (software) executed by the CPU. The control unit 40 may include a storage unit (memory) necessary for the operation of the control unit 40 as appropriate.

[0041] The controller 40 may include at least one processor to provide control and processing power for performing various functions. According to various embodiments, the at least one processor may be implemented as a single integrated circuit (IC) or as multiple communicatively connected integrated circuits and / or discrete circuits. The at least one processor may be implemented according to various known techniques.

[0042] In one embodiment, a processor includes one or more circuits or units configured to perform one or more data computation procedures or processes. For example, a processor may include one or more processors, controllers, microprocessors, microcontrollers, application specific integrated circuits (ASICs), digital signal processors, programmable logic devices, field programmable gate arrays, or any combination of these devices or configurations, or other known devices or configurations, to perform the functions described below.

[0043] The storage unit 50 stores information acquired from the control unit 40 and / or the communication unit 60. The storage unit 50 also stores programs executed by the control unit 40. In addition, the storage unit 50 also stores various data such as the results of calculations performed by the control unit 40. The storage unit 50 may also include a work memory for the control unit 40 to operate. In one embodiment, the storage unit 50 may be configured to include an arbitrary buffer such as a ring buffer. The storage unit 50 may be configured, for example, by a semiconductor memory or a magnetic disk, but is not limited to these, and may be any storage device. For example, the storage unit 50 may be an optical storage device such as an optical disk, or may be a magneto-optical disk. For example, the storage unit 50 may be a storage medium such as a memory card inserted into the sound output device 1 according to this embodiment. The storage unit 50 may also be an internal memory of the CPU used as the control unit 40.

[0044] In one embodiment, the storage unit 50 may store, as data, the sound detected by the first detection unit 31 and / or the second detection unit 32. In addition, in one embodiment, the sound stored as data in the storage unit 50 may be output from the first output unit 21 and / or the second output unit 22 in response to a user operation or the like.

[0045] The communication unit 60 can realize various functions including wireless communication. The communication unit 60 may realize communication by various communication methods such as LTE (Long Term Evolution). The communication unit 60 may include a modem whose communication method is standardized by ITU-T (International Telecommunication Union Telecommunication Standardization Sector). The communication unit 60 may wirelessly communicate with an external device such as an external server or a cloud server via a network, for example, via an antenna. In one embodiment, the communication unit 60 may receive various information from an external database such as an external server or a cloud server. The various information received by the communication unit 60 in this manner may be stored in the storage unit 50. In one embodiment, the communication unit 60 may receive data of the sound and / or the call voice output from the sound output device 1 from another electronic device.

[0046] The communication unit 60 is not limited to a functional unit that performs wireless communication. For example, the communication unit 60 may be configured as an interface for connecting to an external device such as another electronic device via a cable or the like.

[0047] The power supply unit 70 includes, for example, a lithium ion battery and a control circuit for charging and discharging the battery, and supplies power to the entire sound output device 1. The power supply unit 70 is not limited to a secondary battery such as a lithium ion battery, and may be, for example, a primary battery such as a button battery. Furthermore, the power supply unit 70 may not be a primary or secondary battery, but may be, for example, a functional unit for receiving power from outside the sound output device 1.

[0048] As described above, in a system such as that shown in FIG. 4, for example, at least some of the functions of the control unit 40, the storage unit 50, and the communication unit 60 among the functional units of the sound output device 1D may be at least partially performed.

[0049] Next, the operation of the sound output device 1 according to an embodiment will be described.

[0050] A typical use of the sound output device 1 according to an embodiment may be to also function as a general headphone or earphone, for example.

[0051] For example, the control unit 40 may output sounds such as music and / or voice stored as data in the storage unit 50 from the first output unit 21 and / or the second output unit 22. Furthermore, the sound output device 1 may output sounds such as music and / or voice received as data via the communication unit 60 from the first output unit 21 and / or the second output unit 22. Furthermore, the sound output device 1 may output sounds such as telephone call voice received as data via the communication unit 60 from the first output unit 21 and / or the second output unit 22.

[0052] In this case, the control unit 40 may output a sound having a waveform in opposite phase to the waveform of the sound of the surrounding environment acquired by the first detection unit 31 and / or the second detection unit 32 functioning as a microphone from the first output unit 21 and / or the second output unit 22 (noise canceling). The control unit 40 may output a sound having a waveform in opposite phase to the waveform of the sound of the surrounding environment superimposed on music and / or voice, or may output the sound without superimposing on music and / or voice (as an effect of noise canceling only). In addition, the control unit 40 may output a sound (ambient sound) obtained by directly or appropriately processing the sound of the surrounding environment acquired by the first detection unit 31 and / or the second detection unit 32 functioning as a microphone from the first output unit 21 and / or the second output unit 22.

[0053] Hereinafter, a situation will be considered in which a broadcast that the user should pay attention to is played while the user is using the sound output device 1, for example, at an airport or a train station. For example, if the user is waiting to board an airplane in an airport lobby or the like while using (wearing) the sound output device 1, a boarding announcement broadcast for the airplane the user is scheduled to board may be played. Also, for example, if the user is waiting to board a train on a station platform or in a waiting room while using (wearing) the sound output device 1, a broadcast within the station for the train the user is scheduled to board may be played.

[0054] Here, the sound output device 1 used by the user may output, for example, music or broadcasting, may output a telephone call voice, may exhibit a noise canceling effect, etc. Also, the sound output device 1 used by the user may output, for example, a sound of the surrounding environment (ambient sound) that has been taken in from the outside, or may not output any sound.

[0055] In such a situation, if the user uses the sound output device 1, it is expected that the user will miss information that should be noted. This is thought to be because, for example, when the sound output device 1 outputs music or voice, the sound drowns out the sounds of the surrounding environment, so that the sounds of the surrounding environment do not reach the user's ears. In addition, even if the sound output device 1 is not outputting music or voice, for example, if the user is engrossed in other work, it is thought that there is a possibility that the user will miss information that should be noted. Furthermore, even if the sounds of the surrounding environment reach the user's ears, it is quite likely that the user will miss the information that should be noted because he or she is not paying attention (consciousness) to the sounds at that time.

[0056] By storing the sounds of the surrounding environment acquired by the first detection unit 31 and / or the second detection unit 32 in the storage unit 50, in the above-mentioned situation, the user of the sound output device 1 according to one embodiment can listen back to the sounds of the surrounding environment that he / she may have missed by a simple operation. Specifically, when the user feels that he / she has missed noteworthy information, the sound output device 1 may be configured to be able to operate the sound output device 1 to listen back to the sounds from several seconds ago. Alternatively, when noteworthy information is registered in the sound output device 1 in advance, the control unit 40 may be configured to automatically play back the sound of that location. Therefore, according to the sound output device 1 according to one embodiment, it is possible to improve the functionality and / or usability.

[0057] In general, when a person feels that a sound he or she is hearing is bothersome, he or she naturally tends to make a gesture of covering or blocking the ear with a hand or finger. For example, as shown in FIG. 6, a situation is assumed in which a user U wears and uses a sound output device 1B. In this situation, the sound output device 1B outputs a sound such as music or voice from the first output unit 21. The sound output from the first output unit 21 is audibly recognized by the left ear E1 of the user U. In such a situation, when the user U feels that the sound coming from the left ear E1 is bothersome, the user U makes a gesture of covering or blocking the bothersome ear (the left ear E1 in this case) with a hand or finger. In addition, the user U may be informed in advance to make such a gesture in such a situation.

[0058] Also, for example, a situation may be assumed in which the sound output device 1B is not outputting sound such as music or voice from the first output unit 21. In such a case, when the user U feels that he / she may have missed a noteworthy sound in the surrounding environment, the user U may be informed in advance to make a gesture such as covering or blocking the ear (e.g., ear E1) that he / she wants to hear the sound with a hand or finger.

[0059] 6 is a diagram showing a state in which the user U makes a gesture of covering or blocking the left ear E1 with the left hand LH. In this case, the first detection unit 31 of the left housing 11 of the sound output device 1 is covered by the left hand LH of the user U. Therefore, as described later, the first detection unit 31 can detect the approach of the hand of the user U. When the left ear E1 is covered by the left hand LH of the user U as shown in FIG. 6, sounds from the surrounding environment are less likely to enter the left ear E1 of the user U.

[0060] Therefore, using such a gesture by the user U as a trigger, the control unit 40 plays the sounds of the surrounding environment that have been acquired up to that point by the first detection unit 31 and / or the second detection unit 32, and outputs them as sounds from the first output unit 21.

[0061] The control unit 40 may use a gesture of the user U as a trigger to play sounds of the surrounding environment from, for example, 5 seconds ago. How far back in time the sounds of the surrounding environment are to be played back using a gesture of the user U as a trigger may be set appropriately depending on the application or purpose of use of the sound output device 1. In addition, in order to play sounds of the surrounding environment from a short time ago, the control unit 40 may constantly store audio data acquired by the first detection unit 31 and / or the second detection unit 32 in the storage unit 50.

[0062] It is also assumed that the user U makes a gesture such as covering the left ear E1 with the left hand LH when, for example, the user U is on a phone call using the sound output device 1. In such a case, instead of playing back sound based on the data acquired by the first detection unit 31 and / or the second detection unit 32 and stored in the storage unit 50, the control unit 40 may output the sound of the voice call from the first output unit 21 as is or after slightly amplifying it.

[0063] Hereinafter, the sound including at least one of the predetermined playback sound and the predetermined call voice as described above will also be referred to as a "first sound" for the sake of convenience.

[0064] In addition, in the operation described in FIG. 6, the user U does not make a gesture of covering the other ear (right ear E2) with a hand or the like. For this reason, it is assumed that the sound of the surrounding environment enters the right ear E2 of the user U. For example, when the right housing 12 of the sound output device 1B shown in FIG. 6 includes the second output unit 22 of a canal type, the second output unit 22 is inserted so as to be in close contact with the ear canal of the right ear E2 of the user U. However, even in such a case, it is considered that the sound of the surrounding environment may enter the right ear E2 of the user U, albeit slightly. In addition, when the sound of the surrounding environment acquired by the second detection unit 32 is output by the second output unit, it is considered that the user U feels the sound of the surrounding environment as an annoyance. In addition, when the right housing 12 of the sound output device 1B shown in FIG. 6 includes the second output unit 22 of an inner ear type or an ear hook type, a gap is generated between the second output unit 22 and the right ear E2 of the user U. Therefore, in such a case, the right ear E2 of the user U may receive a corresponding amount of ambient sound.

[0065] Therefore, the control unit 40 may output a sound including a predetermined masking sound from the second output unit 22 on the right ear E2 side while the user U is making a gesture to cover the left ear E1. Hereinafter, the sound including the predetermined masking sound is also referred to as the "second sound" for convenience. Hereinafter, the predetermined masking sound may be any sound that makes it difficult to perceive the sound of the surrounding environment entering the right ear E2 of the user U. Making it difficult to perceive the sound of the surrounding environment may include the sound of the surrounding environment being felt as being reduced for the right ear E2 of the user U. For example, the predetermined masking sound may be at least one of white noise, brown noise, and pink noise. In addition, the predetermined masking sound may include, for example, a sound corresponding to the frequency characteristics of the sound of the surrounding environment of the second output unit 22. In addition, the predetermined masking sound may include, for example, a sound having a frequency characteristic corresponding to the frequency characteristics of the sound of the surrounding environment of the second output unit 22. For example, the control unit 40 may analyze the frequency characteristics of sounds in the surrounding environment detected by the second detection unit 32, and output from the second output unit 22 a sound that masks the sounds with the frequency characteristics.

[0066] Furthermore, the specified masking sound may be, for example, a sound that is quieter than at least one of the sound output from the first output unit 21 (i.e., the first sound) and the sound of the surrounding environment of the second output unit 22 (acquired by the second detection unit 32) in order to reduce the degree to which the sound is noticeable.

[0067] Fig. 7 is a flowchart for explaining an example of the operation of the sound output device 1 according to an embodiment. Hereinafter, the operation of the sound output device 1 according to an embodiment will be further explained with reference to Fig. 7. The following control may be control (operation) executed by the control unit 40 of the sound output device 1.

[0068] 7 starts, as described above, the sound output device 1 may be outputting a predetermined sound or may not be outputting any sound. Therefore, at the time when the operation shown in Fig. 7 starts, the control unit 40 may perform control related to the presence or absence of a predetermined sound being output from the first output unit 21 and / or the second output unit 22.

[0069] When the operation shown in FIG. 7 starts, the first detection unit 31 and / or the second detection unit 32 detects sounds in the surrounding environment of the sound output device 1 (step S11).

[0070] Next, the control unit 40 stores the sounds of the surrounding environment detected by the first detection unit 31 and / or the second detection unit 32 as data in the storage unit 50 (step S12).

[0071] Next, it is determined whether or not the first detection unit 31 detects the approach of an object such as the hand of the user U (step S13). If the approach of an object such as the hand of the user U is not detected, the control unit 40 returns to step S11 and continues the process.

[0072] On the other hand, if the approach of an object such as the hand of the user U is detected in step S13, the control unit 40 starts outputting (playing) a sound (first sound) (of the surrounding environment) based on the data stored in the storage unit 50 from the first output unit 21 (step S14). Here, the control unit 40 may play the sound (of the surrounding environment) based on the data stored in the storage unit 50 in succession, dividing the sound into time intervals of, for example, every 3 seconds or every 5 seconds. As described above, the first sound may be a sound including at least one of a predetermined playback sound and a predetermined call voice.

[0073] The control unit 40 also controls the second output unit 22 to output a second sound while the first sound is being output from the first output unit 21 (step S15). The second sound may be a sound including a predetermined masking sound. After step S15, the control unit 10 may start the operation shown in FIG. 7 again.

[0074] Thus, in the sound output device 1 according to one embodiment, the control unit 40 controls the first output unit 21 to output the first sound and the second output unit 22 to output the second sound based on detection of, for example, the approach of a user's hand by the first detection unit 31. Furthermore, the control unit 40 may output a sound including a sound of the surrounding environment of the sound output device 1 stored in the storage unit 50 as the first sound.

[0075] Furthermore, in one embodiment, the control unit 40 may start output of the second sound by the second output unit 22 based on the start of output of the first sound by the first output unit 21. In this case, the control unit 40 may end output of the second sound by the second output unit 22 based on the end of output of the first sound by the first output unit 21.

[0076] As shown in FIG. 6, when the user U feels that the sound output by the first output unit 21 is bothersome or when he / she wants to pay attention to the sound of the surrounding environment, he / she may make a gesture such as covering the ear from which the first output unit 21 is outputting sound with a hand or the like. In this case, the sound of the surrounding environment is played back from a little while ago from the first output unit 21 on the side covered by the hand. Also, a masking sound is output from the second output unit 22 on the side not covered by the hand. Therefore, according to the sound output device 1, the user can pay attention (direct his / her consciousness) to the sound of the surrounding environment that he / she may have missed by making a gesture of covering, for example, the left ear E1.

[0077] 6, a case where the user U makes a gesture to cover the left ear E1 has been described. Next, a case where the user U makes a gesture to cover the right ear E2 will be described.

[0078] Fig. 8 is a flowchart for explaining an example of an operation performed by the sound output device 1 according to an embodiment when the user U makes a gesture of covering the left ear E1. Hereinafter, an operation different from the operation explained in Fig. 7 will be explained. Explanations of operations that are the same as or similar to the operation already explained in Fig. 7 will be appropriately simplified or omitted.

[0079] When the operation shown in FIG. 8 starts, steps S21 and S22 may be similar to steps S11 and S12 described with reference to FIG.

[0080] Next, it is determined whether or not the second detection unit 32 detects the approach of an object such as the hand of the user U (step S23). If the approach of an object such as the hand of the user U is not detected, the control unit 40 returns to step S21 and continues the process.

[0081] On the other hand, if the approach of an object such as the hand of the user U is detected in step S23, the control unit 40 starts outputting (playing) the sound (first sound) (of the surrounding environment) based on the data stored in the storage unit 50 from the second output unit 22 (step S24). Here, the control unit 40 may play the sound (of the surrounding environment) based on the data stored in the storage unit 50 in succession, dividing the sound into time intervals of, for example, every 3 seconds or every 5 seconds.

[0082] The control unit 40 also controls the first output unit 21 to output a second sound while the second output unit 21 is outputting the first sound (step S25). The second sound may be a sound including a predetermined masking sound. After step S25, the control unit 10 may start the operation shown in FIG. 7 again.

[0083] In this way, in the sound output device 1 of one embodiment, the control unit 40 may control the second output unit 22 to output the first sound and the first output unit 21 to output the second sound based on detection by the second detection unit 32 of, for example, the approach of a user's hand.

[0084] According to the sound output device 1 according to an embodiment, the user U can obtain the same effect as in the above-described embodiment by making a gesture of covering the right ear E2 with the right hand, for example.

[0085] Next, an operation when a telephone call is made using the sound output device 1 will be described.

[0086] Fig. 9 is a flowchart for explaining an example of an operation performed by the sound output device 1 according to an embodiment when a telephone call is made using the sound output device 1. Below, operations different from the operations explained in Fig. 7 or Fig. 8 will be explained. Explanations of operations that are the same as or similar to the operations already explained in Fig. 7 or Fig. 8 will be appropriately simplified or omitted.

[0087] When the operation shown in FIG. 9 starts, the communication unit 60 receives voice call data transmitted from, for example, another electronic device (step S31).

[0088] Next, the control unit 40 outputs the sound of the voice call based on the data received in step S31 from the first output unit 21 and the second output unit 22 (step S32).

[0089] Next, it is determined whether or not the first detection unit 31 detects the approach of an object such as the hand of the user U (step S33). If the approach of an object such as the hand of the user U is not detected, the control unit 40 returns to step S31 and continues the process.

[0090] On the other hand, if the approach of an object such as the hand of the user U is detected in step S33, the control unit 40 increases the volume of the first sound output from the first output unit 21 (step S34).

[0091] Furthermore, the control unit 40 controls the second output unit 22 to output the second sound while the first sound is being output from the first output unit 21 (step S35). After step S35, the control unit 10 may start the operation shown in FIG. 9 again.

[0092] In the sound output device 1 according to an embodiment, the control unit 40 may output, as the first sound, a sound that includes, for example, a sound received from another electronic device.

[0093] Next, gesture detection by the first detection section 31 and the second detection section 32 of the sound output device 1 according to an embodiment will be further described.

[0094] First, a case will be described in which the first detection unit 31 and the second detection unit 32 are configured to include a microphone (microphone) that picks up sounds in the surrounding environments of the left housing 11 and the right housing 12, respectively.

[0095] The applicant has confirmed that the characteristics of the sound detected by the first detection unit 31 change depending on whether the user U is not covering the left ear E1 with a hand or the like, as shown in Figure 2, or whether the user U is covering the left ear E1 with the left hand LH or the like, as shown in Figure 6.

[0096] Figures 10A and 10B are diagrams showing changes over time in the frequency of a sound (in the surrounding environment) detected by the first detection unit 31. In Figures 10A and 10B, the horizontal axis indicates elapsed time, and the vertical axis indicates the frequency of the sound. In Figures 10A and 10B, light-colored (close to white) parts indicate that a sound of that frequency has been detected, and dark-colored (close to black) parts indicate that a sound of that frequency has not been detected.

[0097] Fig. 10A is a diagram showing the frequency of sound (in the surrounding environment) detected by the first detection unit 31 when the user U does not cover, for example, the left ear E1 with a hand or the like. Meanwhile, Fig. 10B is a diagram showing the frequency of sound (in the surrounding environment) detected by the first detection unit 31 when the user U covers, for example, the left ear E1 with a hand or the like. Fig. 10B shows that the user U covered the left ear E1 with a hand or the like from time t1 to time t2. That is, until time t1 and after time t2, the left ear E1 of the user U is not covered with a hand or the like.

[0098] As can be seen from a comparison of Figures 10A and 10B, there is a characteristic difference between the two graphs. That is, it can be seen that a detectable change occurs in the frequency of the sound detected by the first detection unit 31 when the user U covers, for example, the left ear E1 with a hand or the like. In Figure 10B, during the period from time t1 to time t2, sounds with relatively low frequencies of 8000 Hz or less do not change much. On the other hand, in Figure 10B, during the period from time t1 to time t2, sounds with relatively high frequencies of 8000 Hz or more are cut.

[0099] From the above results, it can be seen that when the user U covers, for example, the left ear E1 with a hand or the like, the relatively high-frequency sound detected by the first detection unit 31 is cut. Therefore, based on the relatively high-frequency components of the sound detected by the first detection unit 31, it is possible to determine whether or not the user U's left ear E1, for example, is covered with a hand or the like.

[0100] Thus, in one embodiment, the control unit 40 may control the first output unit 21 to output the first sound and the second output unit 22 to output the second sound based on the first detection unit 31 detecting that at least a part of the first output unit 21 is covered by an object such as the user's hand. Also, in one embodiment, the first detection unit 31 may be configured as a first sound collection unit that collects a first external sound around the first output unit 21. In this case, the control unit 40 may control the first output unit 21 to output the first sound and the second output unit 22 to output the second sound based on a predetermined change (e.g., frequency) of the first external sound collected by the first sound collection unit.

[0101] In the embodiment described above, the first detection unit 31 detects that at least a part of the first output unit 21 is covered by the hand of the user U, but is not limited to this. More specifically, the first detection unit 31 may detect that at least a part of the first output unit 21 is covered by various objects such as paper, a board, a cloth, or a bowl.

[0102] Next, a case will be described in which the first detection unit 31 and the second detection unit 32 are configured to include a proximity sensor capable of detecting an object approaching the left housing 11 and the right housing 12, respectively. When the first detection unit 31 and the second detection unit 32 include a proximity sensor, these first detection unit 31 and second detection unit 32 can directly detect that a user's hand or the like has approached the first detection unit 31 or the second detection unit 32, respectively.

[0103] (Other embodiments) Other embodiments according to the present disclosure will be described below.

[0104] FIG. 11 is a block diagram illustrating a schematic functional configuration of a sound output device according to another embodiment.

[0105] In the sound output device 1 described in FIG. 5, the first detection unit 31 and the second detection unit 32 are assumed to be configured by either a microphone or a proximity sensor. However, when detecting a gesture of the user U waving his / her hand using a microphone, for example, it is necessary to make a determination based on a time change in sound. Therefore, it takes some time to detect the gesture of the user U waving his / her hand. Therefore, as in the sound output device 2 shown in FIG. 11, in addition to the first detection unit 31 and the second detection unit 32 configured as microphones, a first proximity sensor 81 and a second proximity sensor 82 may be further provided. In this way, it is possible to improve the accuracy of detecting whether the user U has made a gesture of waving his / her hand.

[0106] FIG. 12 is a diagram showing an example of a usage mode of a sound output device according to another embodiment.

[0107] The sound output device 3 shown in FIG. 12 differs from the sound output device 1C shown in FIG. 3 in that it may include a third output unit 23 at a position slightly away from the first detection unit 31. In FIG. 12, the third output unit 23 is disposed on the headband 13 at a position slightly away from the first detection unit 31. However, the third output unit 23 may be disposed on a member other than the headband 13. Although not shown in FIG. 12, the fourth output unit 24 may also be disposed on the right side at a position slightly away from the second detection unit 32.

[0108] The third output unit 23 and the fourth output unit 24 may output a predetermined sound such as noise that can be detected by the first detection unit 31 and the second detection unit 32 (microphone), respectively. For example, when the user U does not make a gesture of holding a hand over the left ear E1, the predetermined sound such as noise output from the third output unit 23 is detected prominently by the first detection unit 31. On the other hand, when the user U makes a gesture of holding a hand over the left ear E1, the predetermined sound such as noise output from the third output unit 23 is detected relatively weakly by the first detection unit 31, even if it is detected by the first detection unit 31. Therefore, it may be determined whether the user U makes a gesture of holding a hand over the left ear E1 based on the level at which the predetermined sound such as noise output from the third output unit 23 is detected by the first detection unit 31.

[0109] FIG. 13 is a block diagram showing a schematic functional configuration of a sound output device according to another embodiment. The sound output device 3 shown in FIG. 13 may include a third output unit 23 and a fourth output unit 24, which are different from the sound output device 1 shown in FIG. 5. The third output unit 23 and the fourth output unit 24 may have the same configuration as the first output unit 21 and the second output unit 22, respectively. The control unit 40 may perform control so that a sound such as a predetermined noise is output from the third output unit 23 and the fourth output unit 24. Furthermore, the sound output device 3 shown in FIG. 13 may further include a proximity sensor such as a first proximity sensor 81 and / or a second proximity sensor 82, as in the sound output device 2 shown in FIG. 11.

[0110] Although the present disclosure has been described based on the drawings and examples, it should be noted that a person skilled in the art can easily make various modifications or corrections based on the present disclosure. Therefore, it should be noted that these modifications or corrections are included in the scope of the present disclosure. For example, the functions, etc. included in each functional unit can be rearranged so as not to be logically inconsistent. Multiple functional units, etc. may be combined into one or divided. Each embodiment according to the present disclosure described above is not limited to being implemented faithfully to each of the embodiments described respectively, and may be implemented by combining each feature as appropriate or omitting a part. In other words, the contents of the present disclosure can be modified and corrected in various ways by a person skilled in the art based on the present disclosure. Therefore, these modifications and corrections are included in the scope of the present disclosure. For example, in each embodiment, each functional unit, each means, each step, etc. can be added to other embodiments so as not to be logically inconsistent, or replaced with each functional unit, each means, each step, etc. of other embodiments. In addition, in each embodiment, multiple functional units, each means, each step, etc. can be combined into one or divided. Furthermore, each of the above-described embodiments of the present disclosure is not limited to being implemented faithfully according to each of the described embodiments, but may be implemented by combining each feature or omitting some features as appropriate.

[0111] For example, an embodiment is also possible in which a general-purpose computer functions as the sound output device 1 according to the above-described embodiment. Specifically, a program describing the processing contents for realizing each function of the sound output device 1 according to the above-described embodiment is stored in the memory of the general-purpose computer, and the program is read and executed by a processor. Therefore, the present disclosure can also be realized as a program executable by a processor, or a non-transitory computer-readable medium that stores the program.

[0112] [Appendix 1] A first output unit that outputs sound to one ear of a user; A second output unit that outputs sound to the other ear of the user; a first detection unit that detects the approach of an object in the vicinity of the first output unit; a control unit that causes the first output unit to output a first sound including at least one of a predetermined playback sound and a predetermined call voice, and causes the second output unit to output a second sound including a predetermined masking sound, based on detection of the approach of the object by the first detection unit; A sound output device comprising: [Appendix 2] a second detection unit that detects the approach of an object in the vicinity of the second output unit; The control unit causes the second output unit to output the first sound and the first output unit to output the second sound based on the detection of the approach of the object by the second detection unit. 2. The sound output device according to claim 1. [Appendix 3] the control unit causes the first output unit to output the first sound and the second output unit to output the second sound based on the first detection unit detecting that at least a portion of the first output unit is covered by the object. 2. The sound output device according to claim 1. [Appendix 4] the control unit starts output of the second sound by the second output unit based on start of output of the first sound by the first output unit, and ends output of the second sound by the second output unit based on end of output of the first sound by the first output unit. 4. The sound output device according to claim 1 . [Appendix 5] The control unit outputs the second sound as a sound that is quieter than at least one of the first sound and a sound in the surrounding environment of the second output unit. 5. The sound output device according to claim 1 . [Appendix 6] The control unit outputs the second sound as a sound according to frequency characteristics of sounds in the surrounding environment of the second output unit. 6. A sound output device according to any one of claims 1 to 5. [Appendix 7] The control unit outputs the second sound as a sound having frequency characteristics according to frequency characteristics of sounds in a surrounding environment of the second output unit. 7. The sound output device according to claim 6. [Appendix 8] A storage unit that stores a sound of the surrounding environment of the first output unit, The control unit outputs, as the first sound, a sound including a sound of the surrounding environment stored in the storage unit. 8. A sound output device according to any one of claims 1 to 7. [Appendix 9] A communication unit for communicating with other electronic devices, The control unit outputs, as the first sound, a sound including a sound received from the other electronic device. 9. A sound output device according to any one of claims 1 to 8. [Appendix 10] A first output unit that outputs sound to one ear of a user; A second output unit that outputs sound to the other ear of the user; a first sound collection unit that collects a first external sound around the first output unit; a control unit that causes the first output unit to output a first sound including at least one of a predetermined playback sound and a predetermined call voice, and causes the second output unit to output a second sound including a predetermined masking sound, based on a predetermined change in the first external sound collected by the first sound collection unit; A sound output device comprising: [Appendix 11] detecting an approach of an object by a first detection unit in the vicinity of the first output unit; a step of outputting a first sound including at least one of a predetermined playback sound and a predetermined call voice from the first output unit and outputting a second sound including a predetermined masking sound from the second output unit based on detection of the approach of the object by the first detection unit; A sound output method comprising: [Appendix 12] For electronic devices, detecting an approach of an object by a first detection unit in the vicinity of the first output unit; a step of outputting a first sound including at least one of a predetermined playback sound and a predetermined call voice from the first output unit and outputting a second sound including a predetermined masking sound from the second output unit based on detection of the approach of the object by the first detection unit; A program to execute. [Explanation of symbols]

[0113] 1, 1A, 1B, 1C, 1D Sound output device 11 Case (left side) 12 Case (right side) 13 Headband 21 First output section 22 Second output section 23 Third output section 24 4th output section 31 First detection unit 32 Second detection section 40 Control section 50 Storage section 60 Communications Department 70 Power supply section 81 First proximity sensor 82 Second proximity sensor

Claims

1. A first output unit that outputs sound to one ear of a user; A second output unit that outputs sound to the other ear of the user; a first detection unit configured to detect an approach of an object in the vicinity of the first output unit; a control unit that causes the first output unit to output a first sound including at least one of a predetermined playback sound and a predetermined call voice, and causes the second output unit to output a second sound including a predetermined masking sound, based on detection of the approach of the object by the first detection unit; A sound output device comprising:

2. a second detection unit configured to detect the approach of an object in the vicinity of the second output unit; The control unit causes the second output unit to output the first sound and the first output unit to output the second sound based on the detection of the approach of the object by the second detection unit. The sound output device according to claim 1 .

3. The control unit causes the first output unit to output the first sound and the second output unit to output the second sound based on the first detection unit detecting that at least a portion of the first output unit is covered by the object. The sound output device according to claim 1 .

4. The control unit starts output of the second sound by the second output unit based on a start of output of the first sound by the first output unit, and ends output of the second sound by the second output unit based on an end of output of the first sound by the first output unit. The sound output device according to claim 1 .

5. The control unit outputs the second sound as a sound that is quieter than at least one of the first sound and a sound in the surrounding environment of the second output unit. The sound output device according to claim 1 .

6. The control unit outputs the second sound as a sound corresponding to a frequency characteristic of a sound in a surrounding environment of the second output unit. The sound output device according to claim 1 .

7. The control unit outputs the second sound as a sound having frequency characteristics according to frequency characteristics of sounds in a surrounding environment of the second output unit. The sound output device according to claim 6.

8. A storage unit that stores a sound of an environment surrounding the first output unit, The control unit outputs, as the first sound, a sound including a sound of the surrounding environment stored in the storage unit. The sound output device according to claim 1 .

9. A communication unit for communicating with other electronic devices, The control unit outputs, as the first sound, a sound including a sound received from the other electronic device. The sound output device according to claim 1 .

10. A first output unit that outputs sound to one ear of a user; A second output unit that outputs sound to the other ear of the user; a first sound collection unit that collects a first external sound around the first output unit; a control unit that outputs a first sound including at least one of a predetermined playback sound and a predetermined call voice from the first output unit based on a predetermined change in the first external sound collected by the first sound collection unit, and outputs a second sound including a predetermined masking sound from the second output unit; A sound output device comprising:

11. detecting an approach of an object by a first detection unit in the vicinity of the first output unit; a step of outputting a first sound including at least one of a predetermined playback sound and a predetermined call voice from the first output unit and outputting a second sound including a predetermined masking sound from the second output unit based on detection of the approach of the object by the first detection unit; A sound output method comprising:

12. For electronic devices, detecting an approach of an object by a first detection unit in the vicinity of the first output unit; a step of outputting a first sound including at least one of a predetermined playback sound and a predetermined call voice from the first output unit and outputting a second sound including a predetermined masking sound from the second output unit based on detection of the approach of the object by the first detection unit; A program to execute.

Images