Hearing aid, control method, and program
The information processing system addresses the issue of inadequate ventilation control in hearing aids by using processing circuitry to detect and respond to the use state of the device, thereby enhancing user convenience and performance.
Patent Information
- Application Number
- PCT/JP2024/044284
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-15
- Filing Date
- 2024-12-13
- Publication Date
- 2025-06-19
AI Technical Summary
Existing hearing aids lack sufficient disclosure and control over ventilation passage adjustments, leading to reduced convenience for users.
An information processing system that includes processing circuitry to detect the use state of a sound production device and control the device to set a ventilation state based on the detected use state, improving convenience by dynamically adjusting ventilation.
Enhances user convenience by allowing for precise control of ventilation in hearing aids, adapting to various use states and environmental conditions, thereby improving the overall performance and comfort of the device.
Smart Images

Figure JP2024044284_19062025_PF_FP_ABST
Abstract
Description
HEARING AID, CONTROL METHOD, AND PROGRAM
[0001] The present disclosure relates to a hearing aid, a control method, and a program.
[0002] There has been proposed a hearing aid (hearing device) including a ventilation passage for ventilation of an ear canal in an ear piece constituting the hearing aid and including a mechanism of adjusting the ventilation of the ventilation passage (refer to PTL 1, for example). This adjustment of ventilation is performed in accordance with external sound.
[0003] International Publication Pamphlet No. WO 2023 / 210452
[0004] However, the above-described known technology has a problem of insufficient disclosure of control of ventilation of the ventilation passage, causing low convenience.
[0005] In view of this, the present disclosure proposes a hearing aid with improved convenience.
[0006] An information processing system includes processing circuitry configured to detect a use state of a sound production device and control the sound production device to set a ventilation state based upon the use state of the sound production device.
[0007] Fig. 1 is a diagram illustrating a schematic configuration of a hearing aid system according to an embodiment of the present disclosure.Fig. 2 is a block diagram for describing functional blocks of a hearing aid and a charger according to the embodiment of the present disclosure.Fig. 3 is a block diagram for describing functional blocks of an information processing terminal according to the embodiment of the present disclosure.Fig. 4 is a diagram illustrating a configuration example of a hearing aid according to a first embodiment of the present disclosure.Fig. 5 is a diagram illustrating a configuration example of a main body according to the embodiment of the present disclosure.Fig. 6A is a diagram illustrating a configuration example of a ventilation adjustment unit according to the embodiment of the present disclosure.Fig. 6B is a diagram illustrating a configuration example of a ventilation adjustment unit according to the embodiment of the present disclosure.Fig. 7 is a diagram illustrating an example of a use form of a hearing aid according to an embodiment of the present disclosure.Fig. 8 is a diagram illustrating another configuration example of the hearing aid according to the embodiment of the present disclosure.Fig. 9 is a diagram illustrating an example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 10 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 11 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 12 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 13 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 14 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 15 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 16 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 17 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 18 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 19 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 20 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 21 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 22 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 23 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 24 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 25 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 26 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 27 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure.Fig. 28 is a diagram illustrating a configuration example of an imaging device according to a second embodiment of the present disclosure.Fig. 29 is a diagram illustrating an example of a processing procedure used in the processing in a hearing aid according to the second embodiment of the present disclosure.Fig. 30 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the second embodiment of the present disclosure.Fig. 31 is a diagram illustrating an example of a processing procedure used in the processing in a hearing aid according to the third embodiment of the present disclosure.Fig. 32 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the third embodiment of the present disclosure.Fig. 33 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the third embodiment of the present disclosure.Fig. 34 is a diagram illustrating an example of data utilization.Fig. 35 is a diagram illustrating an example of data.Fig. 36 is a diagram illustrating an example of cooperation with other devices.Fig. 37 is a diagram illustrating an example of application transition.
[0008] Embodiments of the present disclosure will be described below in detail with reference to the drawings. The description will be given in the following order. Note that, in each of the following embodiments, the same parts are denoted by the same reference symbols, and a redundant description will be omitted. 1. Outline of Hearing Aid System 2. First Embodiment 3. Second Embodiment 4. Third Embodiment 5. Example of Data Utilization 6. Example of Cooperation with Other Devices 7. Example of Application Transition
[0009] <<1. Outline of Hearing Aid System>> First, an outline of a hearing aid system 1 according to an embodiment of the present disclosure will be described with reference to Figs. 1 to 3. Fig. 1 is a diagram illustrating a schematic configuration of the hearing aid system 1 according to an embodiment of the present disclosure, and Fig. 2 is a block diagram for describing functional blocks of a hearing aid 2 and a charger 3 according to the embodiment of the present disclosure. Fig. 3 is a block diagram for describing functional blocks of an information processing terminal 40 according to the embodiment of the present disclosure.
[0010] As illustrated in Fig. 1, the hearing aid system 1 according to the embodiment of the present disclosure includes a pair of left and right pieces of the hearing aid 2, the charger 3 (charging case) that houses the hearing aid 2 and electrically charges the hearing aid 2, and the information processing terminal 40 such as a smartphone capable of communicating with at least one of the hearing aid 2 and the charger 3. Hereinafter, each device included in the hearing aid system 1 according to the embodiment of the present disclosure will be described in sequence. In the following description, it is assumed that the hearing aid 2 is constituted by a pair of pieces. However, the embodiment of the present disclosure is not limited thereto, and may be a monaural type of which the hearing aid 2 is attached to one of left and right ears.
[0011] First, a functional configuration of the hearing aid 2 will be described. In the embodiment of the present disclosure, at least a part of the hearing aid 2 can be configured to be attached to a part of the ear canal of the user, for example. The appearance of the hearing aid 2 according to the embodiment of the present disclosure will be described later. As illustrated in Fig. 2, the hearing aid 2 mainly includes a sound collection unit 20 (20b and 20f), a signal processing unit 21, an output unit 22, a battery 25, a connection unit 26, communication units 27 and 30, a storage unit 28, and a control unit 29.
[0012] The sound collection unit 20 includes an outer (feedforward) sound collection unit 20f that collects sounds in the outer region of the ear canal and an inner (feedback) sound collection unit 20b that collects sounds in the inner region of the ear canal. The hearing aid 2 according to the embodiment of the present disclosure may be provided with at least the outer sound collection unit 20f that collects sounds in the outer region of the ear canal. Each sound collection unit 20 includes a microphone (hereinafter, also called mic) 201 and an analog / digital (A / D) conversion unit 202. The mic 201 collects sounds, generates an analog sound signal (acoustic signal), and outputs the analog sound signal to the A / D conversion unit 202. The A / D conversion unit 202 performs digital conversion processing on the analog sound signal input from the mic 201, and outputs the digitized sound signal to the signal processing unit 21. The outer sound collection unit 20f includes a microphone 201f and an analog / digital conversion unit 202f. The inner sound collection unit 20b includes a microphone 201b and an analog / digital conversion unit 202b.
[0013] Under the control of the control unit 29 described later, the signal processing unit 21 performs predetermined signal processing on the digital sound signal input from the sound collection unit 20, and outputs the digital sound signal to the output unit 22. Examples of the predetermined signal processing include a filtering process of separating a sound signal into each predetermined frequency band, an amplification process of amplifying the sound signal by a predetermined amount of amplification in each predetermined frequency band in which the filtering process has been performed, a noise reduction process, a howling cancellation process, and the like. The signal processing unit 21 can include a memory and a processor having hardware such as a digital signal processor (DSP), for example.
[0014] The output unit 22 includes a digital / analog (D / A) conversion unit 221 and a receiver 222. The D / A conversion unit 221 performs analog conversion processing on the digital sound signal input from the signal processing unit 21 and outputs the digital sound signal to the receiver 222. The receiver 222 outputs an output sound (sound) corresponding to the analog sound signal input from the D / A conversion unit 221. The receiver 222 can be constituted by a speaker or the like, for example.
[0015] The battery 25 supplies power to each unit constituting the hearing aid 2. The battery 25 can be constituted by a rechargeable secondary battery such as a lithium ion battery, for example. The battery 25 can be charged by power supplied from the charger 3 via the connection unit 26.
[0016] For example, when the hearing aid 2 is housed in the charger 3, the connection unit 26 is connected to the connection unit of the charger 3 to receive power and various types of information from the charger 3 and output various types of information to the charger 3. The connection unit 26 can be constituted by one or a plurality of pins, for example.
[0017] The communication unit 27 can communicate with the charger 3 or the information processing terminal 40 according to a predetermined communication standard via a communication network under the control of the control unit 29. The predetermined communication standard here is assumed to be Wi-Fi (registered trademark), Bluetooth (registered trademark), or the like, for example. The communication unit 27 can be constituted by a communication module or the like, for example. The communication unit 30 can communicate with the other piece of the hearing aid 2 by short-range communication such as near field magnetic induction (NFMI) under the control of the control unit 29.
[0018] The storage unit 28 stores various types of information on the hearing aid 2. The storage unit 28 can be constituted by a random access memory (RAM), a read only memory (ROM), a memory card, and the like, for example. The storage unit 28 can store a program 281 to be executed by the hearing aid 2 and various types of data 282 to be used by the hearing aid 2. Examples of the data 282 include the age of the user, the presence or absence of experience in using the hearing aid 2 by the user, the gender of the user, and the like. Further examples of the data include the time of the user’s using the hearing aid 2 that is measured by a time measurement unit (not illustrated). The time measurement unit is provided inside the hearing aid 2, and can measure date and time and output a time measurement result to the control unit 29 and the like. The time measurement unit can be constituted by a timing generator, a timer having a time measurement function, or the like, for example.
[0019] The control unit 29 controls each unit constituting the hearing aid 2. The control unit 29 can be constituted by a memory and a processor having hardware such as a central processing unit (CPU) or a digital signal processor (DSP), for example. The control unit 29 reads and executes the stored program 281 in the work area of the memory, and controls each component and the like through execution of the program by the processor.
[0020] Although not illustrated in Fig. 2, the hearing aid 2 may have an operation unit. The operation unit can receive an input of an activation signal (trigger signal) for activating the hearing aid 2 and output the received activation signal to the control unit 29. The operation unit can be constituted by a push switch, a button, a touch panel, or the like, for example.
[0021] The hearing aid 2 may also be equipped with a biological information sensor (not illustrated) which is a non-invasive sensor device capable of acquiring various kinds of biological information (sensing data) of the user. Examples of the biological information sensor include a blood flow sensor that detects the pulse, heart rate, blood flow, blood oxygen, and the like of the user.
[0022] The hearing aid 2 may further be equipped with an inertial measurement unit (IMU) (not illustrated) capable of acquiring information on the posture and motion of the user. Specifically, the IMU includes an acceleration sensor that is an inertial sensor acquiring acceleration, a gyro sensor (angular velocity sensor) that is an inertial sensor acquiring an angular velocity, and the like. The hearing aid 2 may have a vibration sensor (not illustrated) instead of the IMU or together with the IMU.
[0023] The hearing aid 2 may include a positioning sensor (not illustrated) capable of acquiring information on the location of the user. The positioning sensor is a sensor that detects the location of the target user wearing the hearing aid 2, and can be specifically a global navigation satellite system (GNSS) receiver or the like. In this case, the positioning sensor can generate sensing data indicating the latitude and longitude of the current location of the target user based on a signal from a GNSS satellite. The hearing aid 2 may be equipped with such a communication device as the positioning sensor since it is possible to detect the relative positional relationship among users from radio frequency identification (RFID), information on an access point of Wi-Fi, information on a radio base station, or the like, for example.
[0024] Next, a functional configuration of the charger 3 will be described. As illustrated in Fig. 2, the charger 3 mainly includes a display unit 31, a battery 32, a housing unit 33, a communication unit 34, a storage unit 35, and a control unit 36.
[0025] The display unit 31 displays various states of the hearing aid 2 under the control of the control unit 36. For example, the display unit 31 can display information indicating that the hearing aid 2 is being charged and information indicating that the hearing aid 2 is receiving various types of information from the information processing terminal 40. The display unit 31 can be constituted by a light emitting diode (LED) or the like, for example.
[0026] The battery 32 supplies power to each unit constituting the hearing aid 2 and the charger 3 housed in the housing unit 33 via a connection unit 331 provided in the housing unit 33. The battery 32 can be constituted by a secondary battery such as a lithium ion battery, for example.
[0027] If the hearing aid 2 has two left and right channels, the housing unit 33 individually houses the two pieces of the hearing aid 2. The hearing aid 2 may be a monaural type. The housing unit 33 is provided with a connection unit 331 connectable to the connection unit 26 of the hearing aid 2. When the hearing aid 2 is housed in the housing unit 33, the connection unit 331 is connected to the connection unit 26 of the hearing aid 2 to transmit power from the battery 32 and various types of information from the control unit 36, receive various types of information from the hearing aid 2, and output the information to the control unit 36. The connection unit 331 can be constituted by one or a plurality of pins, for example.
[0028] The communication unit 34 communicates with the information processing terminal 40 according to a predetermined communication standard via a communication network under the control of the control unit 36. The communication unit 34 can be constituted by a communication module, for example.
[0029] The storage unit 35 stores various programs 351 to be executed by the charger 3. The storage unit 35 can be constituted by a RAM, a ROM, a flash memory, a memory card, and the like, for example.
[0030] The control unit 36 controls each unit constituting the charger 3. For example, when the hearing aid 2 is housed in the housing unit 33, the control unit 36 causes the hearing aid 2 to be supplied power from the battery 32 via the connection unit 331. The control unit 36 can be constituted by a memory and a processor having hardware such as a CPU or a DSP, for example. The control unit 36 reads and executes the programs 351 in the work area of the memory, and controls the components and the like through execution of the programs by the processor.
[0031] Next, a functional configuration of the information processing terminal 40 will be described. As illustrated in Fig. 3, the information processing terminal 40 mainly includes an input unit 41, a communication unit 42, an output unit 43, a display unit 44, a storage unit 45, and a control unit 46.
[0032] The input unit 41 receives inputs of various operations from the user, and outputs signals corresponding to the received operations to the control unit 46. The input unit 41 can be constituted by a switch, a touch panel, and the like, for example.
[0033] The communication unit 42 communicates with the charger 3 or the hearing aid 2 via a communication network under the control of the control unit 46. The communication unit 42 can be constituted by a communication module, for example.
[0034] The output unit 43 outputs sounds at a predetermined sound pressure level for each predetermined frequency band under the control of the control unit 46. The output unit 43 can be constituted by a speaker or the like, for example.
[0035] The display unit 44 displays various types of information on the information processing terminal 40 and information on the hearing aid 2 under the control of the control unit 46. The display unit 44 can be constituted by a liquid crystal display, an organic electroluminescent display (EL display), or the like, for example.
[0036] The storage unit 45 stores various types of information on the information processing terminal 40. The storage unit 45 stores various programs 451 and the like to be executed by the information processing terminal 40. The storage unit 45 can be constituted by a recording medium such as a RAM, a ROM, a flash memory, or a memory card, for example.
[0037] The control unit 46 controls each unit constituting the information processing terminal 40. The control unit 46 can be constituted by a memory and a processor having hardware such as a CPU, for example. The control unit 46 reads and executes the programs stored in the storage unit 45 in the work area of the memory, and controls the components and the like through execution of the programs by the processor.
[0038] The information processing terminal 40 may include a positioning sensor (not illustrated). The positioning sensor is a sensor that detects the location of the user carrying the information processing terminal 40, and can be specifically a GNSS receiver or the like. In this case, the positioning sensor can generate sensing data indicating the latitude and longitude of the current location of the user based on a signal from a GNSS satellite. The information processing terminal 40 may be equipped with such a communication device as the positioning sensor since it is possible to detect the relative positional relationship among users from RFID, information on an access point of Wi-Fi, information on a radio base station, or the like, for example.
[0039] The information processing terminal 40 may also be equipped with an imaging device (not illustrated). Specifically, the imaging device can include an imaging element (not illustrated) such as a complementary MOS (CMOS) image sensor, and a signal processing circuit (not illustrated) that performs imaging signal processing on a signal photoelectrically converted by the imaging element. The imaging device can further include an optical system mechanism (not illustrated) including an imaging lens, a diaphragm mechanism, a zoom lens, a focus lens, and the like, and a drive system mechanism (not illustrated) that controls the operation of the optical system mechanism. The information processing terminal 40 may further be equipped with an IMU (not illustrated) capable of acquiring information on the posture and motion of the user. The information processing terminal 40 may include a vibration sensor (not illustrated) instead of the IMU or together with the IMU.
[0040] In the embodiment of the present disclosure, the functional configurations of the hearing aid system 1 and each device included in the hearing aid system 1 are not limited to the forms illustrated in Figs. 1 to 3. For example, the hearing aid system 1 may include a server or the like as described later.
[0041] In the embodiment of the present disclosure described below, the present disclosure is applied to the hearing aid system 1 as an example. However, the embodiment of the present disclosure is not limited to the application to the hearing aid system 1, and can also be applied to a system including another auditory device (for example, earphones, headphones, or the like).
[0042] <<2. First Embodiment>> <Configuration of Hearing Aid> Fig. 4 is a diagram illustrating a configuration example of a hearing aid according to a first embodiment of the present disclosure. The drawing is a block diagram illustrating a configuration example of a hearing aid 2 according to the first embodiment of the present disclosure. The hearing aid 2 in the drawing includes an outer sound collection unit 20f, a signal processing unit 21 an output unit 22, a sensor 23, a communication unit 27, a control unit 29, a drive unit 130, a ventilation passage 140, and a ventilation adjustment unit 150. Note that portions common to those of the hearing aid 2 in Fig. 1 are denoted by the same reference numerals. In addition, the figure further illustrates a smartphone 50 and the information processing terminal 40 described with Fig. 3.
[0043] The hearing aid 2 in the drawing is disposed in a main body 10 as described later. The main body 10 includes the ventilation passage 140. The ventilation passage 140 ventilates through the ear canal of the user and external air. A dotted line in the drawing represents the ventilation passage 140.
[0044] The ventilation adjustment unit 150 adjusts ventilation of the ventilation passage 140. Details of the configuration of the ventilation adjustment unit 150 will be described later.
[0045] The drive unit 130 drives the ventilation adjustment unit 150 under the control of the ventilation control unit 120 described later.
[0046] Applicable examples of the sensor 23 include the above-described inertial measurement unit and a biometric information sensor that detects the heart rate, the blood pressure, and the sleep of the user. Other applicable examples of the sensor 23 include a sensor that detects the state of the external air, for example, a temperature sensor, a humidity sensor, and an atmospheric pressure sensor. The sensor 23 outputs a measurement result and the like to the control unit 29.
[0047] The control unit 29 includes a use state detection unit 110 and a ventilation control unit 120.
[0048] The use state detection unit 110 detects the use state of the user. Examples of the use state include a user's operation, a user's motion, a user's voice, a voice other than the voice of the user, a user's head orientation, a user's environmental sound, a sound reproduced by a streaming device used by the user, an external air condition, a user's heart rate, and a user's blood pressure. Oher examples of the use situation include a specific sound toward the user, an incoming call to the user's communication device, and user's sleep. The external air state corresponds to, for example, temperature, humidity, and atmospheric pressure. The use state detection unit 110 outputs a detection result to the ventilation control unit 120.
[0049] The ventilation control unit 120 controls the ventilation adjustment unit 150 based on the detection result of the use state detection unit 110. The ventilation control unit 120 controls the ventilation adjustment unit 150 via the drive unit 130.
[0050] <Configuration of Main Body> Fig. 5 is a diagram illustrating a configuration example of a main body according to the embodiment of the present disclosure. The drawing is a diagram illustrating a configuration example of the main body 10 of the hearing aid 2. The hearing aid 2 in the drawing is disposed in the main body 10. The main body 10 has a shape to be inserted into the ear hole of the user. The main body 10 includes the mic 201f and the receiver 222 described with Fig. 2, as well as a signal processing substrate 12, the ventilation passage 140, and the ventilation adjustment unit 150. The main body 10 is provided with an ear sleeve 19. The main body 10 on the side to which the ear sleeve 19 is attached is inserted into the ear hole.
[0051] The signal processing substrate 12 is a substrate on which the control unit 29 and the like described with Fig. 4 are disposed. The mic 201f is disposed in the main body 10 on the opposite side of the side where the ear sleeve 19 is attached, and detects an external sound. The receiver 222 is disposed facing an opening 11 of the main body 10.
[0052] The ventilation passage 140 is a passage connecting the ear canal side and the external air side of the main body 10, and can be configured, for example, to have a tubular shape penetrating the side of the main body 10 facing the ear canal and the side of the main body 10 facing the external air. The ventilation passage 140 in the drawing is an example formed between the opening 11 and a side surface of the main body 10. The ventilation passage 140 including the ventilation adjustment unit 150 functions as a vent that ventilates through the ear canal of the user and the outside. The ventilation adjustment unit 150 in the drawing is an example of a case being disposed in a part of the ventilation passage 140. In this way, the ventilation adjustment unit 150 can be disposed at any position of the ventilation passage 140. In the drawing, illustration of the drive unit 130 is omitted.
[0053] <Configuration of Ventilation Adjustment Unit]> Figs. 6A and 6B are diagrams illustrating a configuration example of the ventilation adjustment unit according to the embodiment of the present disclosure. Fig. 6A is a diagram illustrating a schematic configuration of the ventilation adjustment unit 150. The ventilation adjustment unit 150 is constituted with a main body 151 having flexibility and a plate-like shape, and has, in its central portion, an air vent 152. The main body 151 can be constituted with soft silicon, for example. The one-dot chain line in the drawing represents a cross section of the ventilation passage 140.
[0054] Fig. 6B is a diagram illustrating a detailed configuration of the ventilation adjustment unit 150. The diagram on the left of Fig. 6B represents a state in which the air vent 152 is open. The diagram on the right of Fig. 6B represents a state in which the air vent 152 is closed. There are provided soft actuators 153 and 154 above, below, or to the left and right of the air vent 152. The soft actuators 153 and 154 are constituted by using a conducting polymer actuator that can expand / contract according to a voltage or a current. For example, the conducting polymer actuator is formed by using polyaniline, polypyrrole, or the like. The soft actuators 153 and 154 shrink (contract) when power (positive voltage) is supplied, and extend (expand) when the power supply is stopped. Expansion of the soft actuators 153 and 154 opens the air vent 152, while contraction of the soft actuators 153 and 154 closes the air vent 152. Power that drives the soft actuators 153 and 154 is supplied by the drive unit 130 (not illustrated). The opening of the air vent 152 can be adjusted by adjusting the power supplied to the soft actuators 153 and 154. In this way, the ventilation adjustment unit 150 can adjust the amount of ventilation through the ear canal of the user and the outside when the hearing aid 2 is worn on the ear of the user.
[0055] The configuration of the ventilation adjustment unit 150 is not limited to this example. For example, it is also possible to use the ventilation adjustment unit 150 configured to control ventilation by disposing a valve in the ventilation passage 140 and performing open / close drive of the valve by a piezo actuator.
[0056] <Configuration of Ventilation Adjustment Unit> Fig. 7 is a diagram illustrating an example of a use form of a hearing aid according to an embodiment of the present disclosure. The drawing is a diagram illustrating an example of a use form of the hearing aid 2. The hearing aid 2 is used by being inserted into the user's ear hole. The opening 11 faces the ear canal 9. The ventilation passage 140 is formed between the opening 11 and the side surface of the main body 10.
[0057] <Another Configuration of Hearing Aid> Fig. 8 is a diagram illustrating another configuration example of the hearing aid according to the embodiment of the present disclosure. The drawing is a diagram illustrating another configuration example of the hearing aid 2. The hearing aid 2 in the drawing represents an example of a behind-the-ear hearing aid. The hearing aid 2 in the drawing is disposed in a housing 8. The housing 8 has a tube 18 and an earplugs 17 attached to itself. The earplug 17 is inserted into the ear hole. The tube 18 has a shape that covers the opening 11 of the housing 8. The hearing aid 2 in the drawing also includes the ventilation passage 140 and the ventilation adjustment unit 150. In the hearing aid 2 in the drawing, the housing 8, the tube 18, and the earplug 17 constitute a main body.
[0058] <Processing of Hearing Aid> Fig. 9 is a diagram illustrating an example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating an example of a processing procedure used in the processing in the hearing aid 2. The processing in the drawing illustrates an example of a case of adjusting ventilation of the ventilation adjustment unit 150 based on the user's operation that is input via the information processing terminal 40. First, the use state detection unit 110 acquires an input from the information processing terminal 40 via the communication unit 27 (step S101). Next, the use state detection unit 110 determines whether the acquired input is made by user's operation (step S102). As a result, in a case where the acquired input is made by user's operation (step S102, Yes), the ventilation control unit 120 adjusts ventilation of the ventilation adjustment unit 150 based on the user's operation (step S103). Specifically, when the user's operation is an operation of closing the air vent 152, the ventilation control unit 120 controls to close the air vent 152 of the ventilation adjustment unit 150. In a case where the user's operation is an operation of opening the air vent 152, the ventilation control unit 120 controls to open the air vent 152 of the ventilation adjustment unit 150. In contrast, in a case where the acquired input is not the operation of the user in steps S102 (step S102, No), the use state detection unit 110 proceeds to the processing of step S101.
[0059] Step S102 is an example of the "use state detection procedure" of the present disclosure. Step S103 is an example of the "ventilation control procedure" and the "ventilation adjustment procedure" of the present disclosure. The processing of step S102 is an example of "detecting a use state" of the present disclosure. The processing of step S103 is an example of "controlling adjustment of ventilation" and "adjusting ventilation" of the present disclosure.
[0060] When opening the air vent 152, the opening degree may be set to fully open (100% opening) or set to a preset opening degree. The similar applies to the subsequent processing.
[0061] Fig. 10 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing illustrates an example of a case of adjusting ventilation of the ventilation adjustment unit 150 based on a signal of the sensor 23 constituting the motion sensor. First, the use state detection unit 110 acquires a signal from the sensor 23 (step S111). Next, the use state detection unit 110 determines whether a predetermined motion of the user has been detected based on the acquired signal (step S112). Here, the predetermined movement corresponds to a gesture such as the user facing upward, for example. As a result, in a case where the predetermined movement of the user is detected (step S112, Yes), the ventilation control unit 120 adjusts the ventilation of the ventilation adjustment unit 150 based on the predetermined motion of the user (step S113). Specifically, when the user faces upward, an operation of closing the air vent 152 can be performed. In contrast, in a case where the predetermined motion of the user is not detected in step S112 (step S112, No), the use state detection unit 110 proceeds to the processing of step S111.
[0062] Fig. 11 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing represents an example of ventilation control processing (S120) based on the own voice, being a control of adjusting ventilation of the ventilation adjustment unit 150 based on an own voice being the voice of the user. First, the ventilation control unit 120 controls the ventilation adjustment unit 150 to close the air vent 152 (step S121). Next, the use state detection unit 110 acquires a sound signal from the mic 201f (step S122). Next, the use state detection unit 110 performs processing of detecting the own voice from the acquired sound signal (step S123). As a result, in the case where the voice is the user's voice (step S124, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S125), and proceeds to the processing of step S122. In contrast, in a case where the user's voice is not detected in step S124 (step S124, No), the use state detection unit 110 proceeds to the processing of step S121.
[0063] Fig. 12 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing represents an example of ventilation control processing (S130) based on an utterer, being a control of adjusting ventilation of the ventilation adjustment unit 150 based on a voice other than the voice of the user. First, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S131). Next, the use state detection unit 110 acquires a sound signal from the mic 201f (step S132). Next, the use state detection unit 110 performs processing of detecting a voice from the acquired sound signal (step S133). As a result, in the case of a voice other than the voice of the user, that is, in the case where there is an utterer (step S134, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S135), and the proceeds to the processing of step S132. In contrast, in a case where the voice other than the user's voice is not detected in step S134 (step S134, No), the use state detection unit 110 proceeds to the processing of step S131.
[0064] Fig. 13 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. Similarly to Fig. 12, the drawing is a flowchart illustrating another example of the processing procedure of the processing of the hearing aid 2. The processing in the drawing illustrates an example of a case of adjusting ventilation of the ventilation adjustment unit 150 further based on the orientation of the user. First, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S141). Next, the use state detection unit 110 acquires a sound signal from the mic 201f (step S142). Next, the use state detection unit 110 performs processing of detecting sound direction from the acquired sound signal (step S143). Next, the use state detection unit 110 acquires a signal from the sensor 23 constituting the motion sensor (step S144). Next, the use state detection unit 110 performs processing of detecting the direction of the head of the user (step S145).
[0065] As a result, in a case where the sound direction and the direction of the user's head match (step S146, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S147). Thereafter, the use state detection unit 110 proceeds to the processing of step S142. In contrast, when the sound direction and the direction of the user's head do not match in step S146 (step S146, No), the use state detection unit 110 proceeds to the processing of step S141.
[0066] Fig. 14 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing represents an example of ventilation control processing (S150) based on user's environmental sound, being a control of adjusting ventilation of the ventilation adjustment unit 150 based on a user's environmental sound. Here, the environmental sound is, for example, noisy sound or other undesired sounds. First, the use state detection unit 110 acquires a sound signal from the mic 201f (step S151). Next, the use state detection unit 110 performs processing of detecting an environmental sound from the acquired sound signal (step S152). Next, the use state detection unit 110 determines whether the environmental sound is loud (step S153). For example, when the detected environmental sound exceeds a predetermined threshold, the environmental sound can be determined to be loud. As a result, when the environmental sound is loud (step S153, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S155), and proceeds to the processing of step S151. In contrast, when the environmental sound is not loud in step S153 (step S153, No), the use state detection unit 110 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S154), and proceeds to the processing of step S151.
[0067] Fig. 15 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing illustrates an example of a case of adjusting ventilation of the ventilation adjustment unit 150 based on a sound reproduced by a streaming device used by the user. Here, the streaming device corresponds to the smartphone 50, for example. First, the use state detection unit 110 determines whether the sound is streaming audio reproduction (step S161). As a result, in the case of streaming audio reproduction (step S161, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S162), and the proceeds to the processing of step S161. In contrast, when the sound is not streaming audio reproduction in step S161 (step S161, No), the use state detection unit 110 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S163), and proceeds to the processing of step S161.
[0068] Fig. 16 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. Similarly to Fig. 15, the drawing is a flowchart illustrating another example of the processing procedure of the processing of the hearing aid 2. The processing in the drawing illustrates an example of a case of adjusting ventilation of the ventilation adjustment unit 150 further based on a direction of the streaming device used by the user. First, the use state detection unit 110 determines whether the sound is streaming audio reproduction (step S171). As a result, in a case where the sound is not streaming audio reproduction (step S171, No), the ventilation control unit 120 proceeds to the processing of step S178.
[0069] In contrast, in a case where the sound is streaming audio reproduction in step S171 (step S171, Yes), the use state detection unit 110 acquires the direction of the streaming device (step S173). This can be performed, for example, by acquiring Bluetooth (registered trademark) direction information in a case where the smartphone 50, which is a streaming device, is connected by Bluetooth (registered trademark). Next, the use state detection unit 110 acquires a signal of the sensor 23 constituting the motion sensor (step S174). Next, the use state detection unit 110 performs processing of detecting the direction of the head of the user (step S175). As a result, in a case where the direction of the streaming device and the direction of the head of the user do not match (step S176, No), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S177), and proceeds to the processing of step S171.
[0070] In contrast, in step S176, in a case where the direction of the streaming device and the direction of the head of the user match (step S176, Yes), the ventilation control unit 120 proceeds to the processing of step S178.
[0071] In step S178, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S178), and the proceeds to the processing of step S171.
[0072] Fig. 17 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing illustrates an example of a case of selecting the ventilation control processing. In the present embodiment, the control unit 29 can select the ventilation control processing. Here, the control unit 29 selects the ventilation control processing based on own voice (step S120) or the ventilation control processing based on an utterer (step S130). The ventilation adjustment unit 150 controls the ventilation adjustment unit 150 based on the detection result of the use state corresponding to the ventilation control processing selected by the control unit 29. In addition, the processing in the drawing illustrates an example of a case of performing the processing based on ventilation setting. Here, the ventilation setting represents preset ventilation (a state of the air vent). The use state detection unit 110 detects the use state based on the ventilation setting.
[0073] First, the control unit 29 acquires ventilation setting (step S181). Next, the control unit 29 determines whether the ventilation setting indicates setting to open the air vent (step S182). As a result, when the ventilation setting is setting to open the air vent (step S182, Yes), the control unit 29 proceeds to the processing of the ventilation control processing step based on the utterer (S130). In contrast, when the ventilation setting is not the setting to open the air vent (step S182, No), the control unit 29 proceeds to the ventilation control processing step (S120) based on the own voice.
[0074] Fig. 18 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing illustrates an example of a case of controlling the ventilation adjustment unit 150 based on the ventilation setting when the use state has not been detected by the use state detection unit 110. The ventilation setting can be held in the storage unit 28.
[0075] First, the control unit 29 acquires ventilation setting (step S191). Next, the ventilation control unit 120 adjusts the air vent 152 based on the ventilation setting acquired by the control unit 29 (step S192). Next, the use state detection unit 110 acquires a sound signal from the mic 201f (step S193). Next, the use state detection unit 110 performs processing of detecting the own voice from the acquired sound signal (step S194). As a result, in the case where the sound is the user's voice (step S195, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S196), and proceeds to the processing of step S193.
[0076] In contrast, in a case where the user's voice is not detected in step S195 (step S195, No), the use state detection unit 110 proceeds to the processing of step S197. In step S197, the use state detection unit 110 acquires the sound signal from the mic 201f (step S197). Next, the use state detection unit 110 performs processing of detecting a voice from the acquired sound signal (step S198). As a result, in the case of a voice other than the user, that is, in the case where there is an utterer (step S199, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S200), and the proceeds to the processing of step S193. In contrast, when there is no utterer in step S199 (step S199, No), the ventilation control unit 120 proceeds to the processing of step S191.
[0077] Fig. 19 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing represents an example of a case of selecting processing based on priority setting. The control unit 29 selects the ventilation control processing based on preset priority setting. The data of the priority setting is held in the storage unit 28.
[0078] First, the control unit 29 acquires priority setting (step S211). Next, the control unit 29 determines whether to prioritize improvement of hearing (step S212). As a result, in a case of prioritizing improvement of hearing (step S212, Yes), the control unit 29 proceeds to the ventilation control processing based on the own voice (S120).
[0079] In contrast, in a case of not prioritizing improvement of hearing in step S212 (step S212, No), the control unit 29 determines whether to prioritize improvement of comfort (step S213). As a result, in a case of prioritizing improvement of comfort (step S213, Yes), the control unit 29 proceeds to ventilation control processing based on the utterer (S130).
[0080] In contrast, in a case of not prioritizing improvement of comfort in step S213 (step S213, No), the control unit 29 proceeds to the ventilation control processing based on the environmental sound (S150).
[0081] Fig. 20 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing illustrates an example of a case of adjusting ventilation of the ventilation adjustment unit 150 based on temperature. First, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S221). Next, a signal from the sensor 23 constituting the temperature sensor is acquired (step S222). Next, the use state detection unit 110 determines whether the temperature has increased (step S223). The temperature can be determined to have increased when the temperature exceeds a predetermined threshold, for example. As a result, in a case where the temperature has increased (step S223, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S224), and proceeds to the processing of step S222. In contrast, when the temperature has not increased in step S223 (step S223, No), the use state detection unit 110 proceeds to the processing of step S221.
[0082] Fig. 21 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing illustrates an example of a case of adjusting ventilation of the ventilation adjustment unit 150 based on humidity. First, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S231). Next, a signal from the sensor 23 constituting the humidity sensor is acquired (step S232). Next, the use state detection unit 110 determines whether the humidity has increased (step S233). The humidity can be determined to have increased when the humidity exceeds a predetermined threshold, for example. As a result, in a case where the humidity has increased (step S233, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S234), and proceeds to the processing of step S232. In contrast, when the humidity has not increased in step S233 (step S233, No), the use state detection unit 110 proceeds to the processing of step S231.
[0083] Fig. 22 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing illustrates an example of a case of adjusting ventilation of the ventilation adjustment unit 150 based on atmospheric pressure. First, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S241). Next, a signal from the sensor 23 constituting the atmospheric pressure sensor is acquired (step S242). Next, the use state detection unit 110 determines whether the atmospheric pressure has increased (step S243). The atmospheric pressure can be determined to have increased when the atmospheric pressure exceeds a predetermined threshold, for example. As a result, in a case where the atmospheric pressure has increased (step S243, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S244), and proceeds to the processing of step S242. In contrast, when the atmospheric pressure has not increased in step S243 (step S243, No), the use state detection unit 110 proceeds to the processing of step S241.
[0084] Fig. 23 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing illustrates an example of a case of adjusting ventilation of the ventilation adjustment unit 150 based on the heart rate of the user. First, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S251). Next, a signal from the sensor 23 constituting the heart rate sensor is acquired (step S252). Next, the use state detection unit 110 determines whether the heart rate has increased (step S253). The heart rate can be determined to have increased when the heart rate exceeds a predetermined threshold, for example. As a result, in a case where the heart rate has increased (step S253, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S254), and proceeds to the processing of step S252. In contrast, when the heart rate has not increased in step S253 (step S253, No), the use state detection unit 110 proceeds to the processing of step S251.
[0085] Fig. 24 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing illustrates an example of a case of adjusting ventilation of the ventilation adjustment unit 150 based on the blood pressure of the user. First, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S261). Next, a signal from the sensor 23 constituting the blood pressure sensor is acquired (step S262). Next, the use state detection unit 110 determines whether the blood pressure has increased (step S263). The blood pressure can be determined to have increased when the blood pressure exceeds a predetermined threshold, for example. As a result, in a case where the blood pressure has increased (step S263, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S264), and proceeds to the processing of step S262. In contrast, when the blood pressure has not increased in step S263 (step S263, No), the use state detection unit 110 proceeds to the processing of step S261.
[0086] Fig. 25 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing illustrates an example of a case of adjusting ventilation of the ventilation adjustment unit 150 based on a specific sound toward the user. Here, the specific sound corresponds to an intercom sound or an alarm sound. First, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S271). Next, the use state detection unit 110 acquires a sound signal from the mic 201f (step S272). Next, the use state detection unit 110 performs processing of detecting a specific sound from the acquired sound signal (step S273). Next, the use state detection unit 110 determines whether the specific sound has been detected (step S274). As a result, when a specific sound has been detected (step S274, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S275), and proceeds to the processing of step S272. In contrast, when a specific sound has not been detected in step S274 (step S274, No), the use state detection unit 110 proceeds to the processing of step S271.
[0087] Fig. 26 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing illustrates an example of a case of adjusting ventilation of the ventilation adjustment unit 150 based on an incoming call to the user's communication device. Here, the communication device of the user corresponds to the smartphone 50, for example. First, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S281). Next, the use state detection unit 110 acquires an input from the smartphone 50 via the communication unit 27 (step S282). Next, the use state detection unit 110 determines whether an incoming call is received based on the acquired input from the smartphone 50 (step S283). As a result, in the case of an incoming call (step S283, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S284), and proceeds to the processing of step S282. In contrast, when no incoming call is received in step S283 (step S283, No), the use state detection unit 110 proceeds to the processing of step S281.
[0088] Fig. 27 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the first embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. The processing in the drawing illustrates an example of a case of adjusting ventilation of the ventilation adjustment unit 150 based on the sleep of the user. First, the use state detection unit 110 acquires a signal from the sensor 23 constituting the sleep sensor (step S291). Next, the use state detection unit 110 determines the sleep of the user based on the acquired signal from the sensor 23 (step S292). As a result, in the case of the sleep of the user (step S292, Yes), the ventilation control unit 120 adjusts the ventilation according to user setting (step S293), and proceeds to the processing of step S291. In contrast, in step S292, in a case of no sleep of the user (step S292, No), the use state detection unit 110 proceeds to the processing of step S291.
[0089] In this way, in the hearing aid 2 according to the first embodiment of the present disclosure, the use state detection unit 110 detects the use state of the user and controls ventilation. This enable control of ventilation according to various states, making it possible to improve the convenience of the hearing aid 2.
[0090] <<3. Second Embodiment>> The hearing aid 2 of the first embodiment described above controls ventilation based on the use state of the user. In contrast, a hearing aid 2 according to a second embodiment of the present disclosure is different from the first embodiment described above in that noise reduction processing is also used.
[0091] <Configuration of Hearing Aid> Fig. 28 is a diagram illustrating a configuration example of an imaging device according to the second embodiment of the present disclosure. Similarly to Fig. 4, the drawing is a block diagram illustrating a configuration example of the hearing aid 2. The hearing aid 2 in the drawing is different from the hearing aid 2 in Fig. 4 in that a noise reduction unit 160 is disposed in the signal processing unit 21 and that an inner sound collection unit 20b is further provided. Note that the outer sound collection unit 20f may be disposed in plurality.
[0092] The noise reduction unit 160 performs processing of reducing noise of a sound signal. The noise reduction unit 160 can reduce noise by noise reduction processing, for example.
[0093] <Processing of Hearing Aid> Fig. 29 is a diagram illustrating an example of a processing procedure used in the processing in the hearing aid according to the second embodiment of the present disclosure. The drawing is a flowchart illustrating an example of a processing procedure used in the processing in the hearing aid 2. First, the use state detection unit 110 acquires a sound signal from the mic 201f of the outer sound collection unit 20f (step S301). Next, the use state detection unit 110 performs processing of detecting an environmental sound from the acquired sound signal (step S302). Next, the use state detection unit 110 determines whether the detected environmental sound is loud (step S303). As a result, when the environmental sound is not loud (step S303, No), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S304), and proceeds to the processing of step S301.
[0094] In contrast, when the environmental sound is loud in step S303 (step S303, Yes), the use state detection unit 110 determines whether the ratio of the low frequency component of the environmental sound is low (step S305). As a result, when the ratio of the low frequency component is low (step S305, Yes), that is, when the ratio of the middle and high frequency components is high, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S306). This makes it possible to prevent leakage of air from the ventilation passage 140 to improve the degree of sealing, ensuring the low frequency range sound pressure. Thereafter, the use state detection unit 110 proceeds to the processing of step S301.
[0095] In contrast, when the ratio of the low frequency component of the environmental sound is not low in step S305 (step S305, No), the use state detection unit 110 determines whether the ratio of the middle and high frequency components of the environmental sound is low (step S307). As a result, when the ratio of the middle and high frequency components is low (step S307, Yes), that is, when the ratio of the low frequency component is high, the use state detection unit 110 causes the noise reduction unit 160 to perform noise reduction processing (step S308). Thereafter, the use state detection unit 110 proceeds to the processing of step S301.
[0096] In contrast, in step S307, when the ratio of the middle and high frequency components of the environmental sound is not low (step S307, No), the environmental sound is estimated to have a high signal level in the entire region from the low frequency to the high frequency. In this case, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S309), and the use state detection unit 110 causes the noise reduction unit 160 to perform noise reduction processing (step S310). Thereafter, the use state detection unit 110 proceeds to the processing of step S301. The noise reduction processing can also be used after the air vent 152 is closed.
[0097] In the processing in the drawing, at least one of the closing of the air vent 152 and the noise reduction processing is used according to the type of environmental sound. Specifically, in a case where the environmental sound is ambient utterance alone, closing of the air vent 152 is to be performed. In contrast, in a case where an environmental sound is loud such as the case of inside of a train or an automobile, closing of the air vent 152 and noise reduction processing are to be performed. This leads to improvement in the convenience.
[0098] Fig. 30 is a diagram illustrating another example of a processing procedure used in the processing in the hearing aid according to the second embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. First, the use state detection unit 110 acquires a sound signal from the mic 201f which is an external mic (step S321). Next, the use state detection unit 110 performs processing of detecting an environmental sound from the acquired sound signal (step S322). Next, the use state detection unit 110 determines whether the detected environmental sound is loud (step S323). As a result, when the environmental sound is not loud (step S323, No), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S324), and proceeds to the processing of step S321.
[0099] In contrast, in step S323, when the environmental sound is loud (step S323, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S325), and proceeds to the processing of step S326. In step S326, the use state detection unit 110 acquires a sound signal from the mic 201b which is an internal mic (step S326). Next, the use state detection unit 110 performs processing of detecting an environmental sound from the acquired sound signal (step S327). Next, the use state detection unit 110 determines whether noise reduction processing is necessary (step S328). This can be determined based on the frequency component of the environmental sound. As a result, in a case where the noise reduction processing is necessary (step S328, Yes), the use state detection unit 110 causes the noise reduction unit 160 to start noise reduction processing (step S329). Thereafter, the use state detection unit 110 proceeds to the processing of step S321.
[0100] In contrast, in step S328, in a case where noise reduction processing is not necessary (step S328, No), the use state detection unit 110 stops the noise reduction processing of the noise reduction unit 160 (step S330). Thereafter, the use state detection unit 110 proceeds to the processing of step S321.
[0101] In this way, in the processing of the drawing, the use state detection unit 110 acquires the input of the external mic (mic 201f) and determines the level of the environmental sound. The ventilation is adjusted based on the result. At this time, when closing the air vent 152, the use state detection unit 110 acquires an input of the internal mic (mic 201b) and determines the necessity of noise reduction processing based on the frequency component of the environmental sound. Since compared with the processing of Fig. 29, the necessity of noise reduction processing is determind after the air vent 152 is closed, it possible to more accurately determine. Incidentally, the opening / closing of the air vent 152 can be determined after the noise reduction processing is started.
[0102] The effect in the case of performing noise reduction processing together with the closing of the air vent 152 is similar to the processing of Fig. 29. Still, the processing of Fig. 30 makes the determination again after one of the closing of the air vent 152 and the noise reduction processing is performed, making it possible to accurately determine the necessity. This also reduce power consumption, enabling the hearing aid 2 to be used for a long time.
[0103] The configuration of the hearing aid system other than the above is similar to the configuration of the hearing aid system according to the first embodiment of the present disclosure, and thus the description thereof will be omitted.
[0104] In this way, the hearing aid 2 according to the second embodiment of the present disclosure can further improve convenience by using the noise reduction processing in combination.
[0105] <<4. Third Embodiment>> In the hearing aid 2 of the second embodiment described above, the control of the air vent 152 is performed by using noise reduction processing in combination. In A third embodiment of the present disclosure, variations will be described.
[0106] <Processing of Hearing Aid> Fig. 31 is a diagram illustrating an example of processing procedure used in processing in a hearing aid according to the third embodiment of the present disclosure. The drawing is a flowchart illustrating an example of processing procedure used in processing in a hearing aid 2. First, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S341). Next, use state detection unit 110 acquires a sound signal from the microphone 201f of the outer sound collection unit 20f (step S342). Next, the use state detection unit 110 performs processing of detecting an environmental sound from the acquired sound signal (step S343). Next, the use state detection unit 110 determines whether the detected environmental sound is loud (step S344). As a result, when the environmental sound is loud (step S344, Yes), the use state detection unit 110 causes the noise reduction unit 160 to perform noise reduction processing (step S345). Thereafter, the use state detection unit 110 proceeds to the processing of step S342.
[0107] In contrast, when the environmental sound is not loud in step S344 (step S344, No), the use state detection unit 110 proceeds to the processing of step S341.
[0108] In the processing described above, the noise reduction processing is automatically started when the environmental sound is loud.
[0109] Fig. 32 is a diagram illustrating another example of processing procedure used in processing in the hearing aid according to the third embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. First, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S351). Next, the use state detection unit 110 acquires a sound signal from the microphone 201f of the outer sound collection unit 20f (step S352). Next, the use state detection unit 110 performs processing of detecting an environmental sound from the acquired sound signal (step S353). Next, the use state detection unit 110 determines whether the detected environmental sound is loud (step S354). As a result, when the environmental sound is loud (step S354, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S355). Next, the use state detection unit 110 causes the noise reduction unit 160 to perform noise reduction processing (step S356). Thereafter, the use state detection unit 110 proceeds to the processing of step S352.
[0110] In contrast, when the environmental sound is not loud in step S354 (step S354, No), the use state detection unit 110 proceeds to the processing of step S351.
[0111] When the environmental sound is loud, the processing in the drawing automatically closes the air vent 152 and starts noise reduction processing to improve hearing situations. In contrast, when the environmental sound is not loud, the processing opens the air vent 152 to provide a comfortable use state.
[0112] Fig. 33 is a diagram illustrating another example of processing procedure used in processing in the hearing aid according to the third embodiment of the present disclosure. The drawing is a flowchart illustrating another example of the processing procedure used in the processing in the hearing aid 2. First, the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of opening the air vent 152 (step S361). Next, the use state detection unit 110 acquires a sound signal from the microphone 201f of the outer sound collection unit 20f (step S362). Next, the use state detection unit 110 performs processing of detecting an environmental sound from the acquired sound signal (step S363). Next, the use state detection unit 110 determines whether the detected environmental sound is loud (step S364). As a result, when the environmental sound is not loud (step S364, No), the use state detection unit 110 proceeds to the processing of step S362.
[0113] In contrast, when the environmental sound is loud in step S364 (step S364, Yes), the ventilation control unit 120 controls the ventilation adjustment unit 150 to perform an operation of closing the air vent 152 (step S365). Next, the use state detection unit 110 determines whether noise reduction processing is necessary (step S366). As a result, in a case where the noise reduction processing is necessary (step S366, Yes), the use state detection unit 110 causes the noise reduction unit 160 to start noise reduction processing (step S367). Thereafter, the use state detection unit 110 proceeds to the processing of step S362.
[0114] In contrast, in step S366, in a case where noise reduction processing is not necessary (step S366, No), the use state detection unit 110 stops the noise reduction processing of the noise reduction unit 160 (step S368). Thereafter, the use state detection unit 110 proceeds to the processing of step S362.
[0115] The processing in the drawing automatically closes the air vent 152 when the environmental sound is loud, making it possible to improve hearing situations. In this case, noise reduction processing is not performed, making it possible to decrease power consumption. Incidentally, when the hearing condition is not satisfactory, it is also possible to adopt a configuration to start noise reduction processing in response to user’s operation.
[0116] The configuration of the hearing aid system other than the above description is similar to the configuration of the hearing aid system according to the second embodiment of the present disclosure, and thus the description thereof will be omitted.
[0117] <<5. Example of Data Utilization>> The data obtained in connection with use of the hearing aid 2 according to the embodiments of the present disclosure may be used in various ways. An example of data utilization will be described with reference to Fig. 34.
[0118] Fig. 34 is a diagram illustrating an example of data utilization. In the illustrated system, there are an edge region 1000, a cloud region 2000, and a business operator region 3000. Examples of elements in the edge region 1000 include a sound production device 1100, a peripheral device 1200, and a vehicle 1300. A server device 2100 is exemplified as an element in the cloud region 2000. Examples of elements in the business operator region 3000 include a business operator 3100 and a server device 3200.
[0119] The sound production device 1100 in the edge region 1000 is worn by the user or arranged near the user for use so as to emit sounds toward the user. Specific examples of the sound production device 1100 include earphones, a headset (headphone), and a hearing aid. More specifically, the sound production device 1100 can be the hearing aid 2.
[0120] The peripheral device 1200 and the vehicle 1300 in the edge region 1000 are devices used together with the sound production device 1100, and transmit signals of content viewing sounds, call sounds, and warning sounds to the sound production device 1100, for example. The sound production device 1100 outputs sounds corresponding to signals from the peripheral device 1200 or the vehicle 1300 to the user. A specific example of the peripheral device 1200 is a smartphone or the like. For example, the information processing terminal 40 described above with reference to Fig. 1 may be used as the peripheral device 1200.
[0121] In the edge region 1000, various data on utilization of the sound production device 1100 may be obtained. A description will be given with reference to Fig. 35.
[0122] Fig. 35 is a diagram illustrating an example of data. Examples of data that can be acquired in the edge region 1000 include device data, use history data, personalized data, biometric data, emotional data, application data, fitting data, and preference data. The data may be understood as information, and they may be replaced as appropriate without a contradiction. Various known methods may be used to acquire the exemplified data.
[0123] The device data is data related to the sound production device 1100, and includes data on the type of the sound production device 1100, specifically, data indicating that the sound production device 1100 is earphones, headphones, a True Wireless Stereo (TWS), a hearing aid (CIC, ITE, RIC, or the like), or the like, for example.
[0124] The use history data is use history data of the sound production device 1100, and includes data on the music exposure amount, the continuous use time of the hearing aid, and the content listening history (the listening time and the like) and the like, for example. The use history data can be used for safe listening, hearing aid adaptation of TWS, replacement notification of an earwax intrusion preventive filter (not illustrated) provided in the hearing aid 2, and the like.
[0125] The personalized data is data related to the user of the sound production device 1100, and includes a head related transfer function (HRTF), ear canal characteristic, type of earwax, and the like of the user, for example. Data on hearing and the like may also be included in the personalized data.
[0126] The biometric data is biometric data of the user of the sound production device 1100, and includes data on perspiration, blood pressure, blood flow, heart rate, pulse, body temperature, electroencephalogram, respiration, myoelectric potential, and the like, for example.
[0127] The emotion data is data indicating the emotion of the user of the sound production device 1100, and includes data indicating comfort, discomfort, or the like, for example.
[0128] The application data is data used in various applications, and includes user attribute information data such as the position of the user of the sound production device 1100 (or the position of the sound production device 1100), schedule, age, gender, and the like, and further includes data on weather, atmospheric pressure, temperature, and the like, for example. For example, the position data can be used to search for the lost sound production device 1100 or to determine a timing for predicting clogging of the above-described earwax intrusion preventive filter.
[0129] The fitting data can include adjustment parameters for the hearing aid 2 used by the user, a hearing aid gain in each frequency band set based on a measurement result (audiogram) of hearing of the user, and the like, for example.
[0130] The preference data is data related to the preference of the user, and includes data on the preference for music to listen during driving, for example
[0131] Data on a communication status, data on a charging status of the sound production device 1100, and the like may also be acquired. A part of processing in the edge region 1000 may be executed in the cloud region 2000 according to the band, the communication status, the charging status, and the like. Sharing the processing reduces the processing load in the edge region 1000.
[0132] Returning to Fig. 34, data as described above, for example, is acquired in the edge region 1000 and transmitted from the sound production device 1100, the peripheral device 1200, or the vehicle 1300 to the server device 2100 in the cloud region 2000. The server device 2100 stores (saves, accumulates, or the like) the received data.
[0133] The business operator 3100 in the business operator region 3000 uses the server device 3200 to acquire data from the server device 2100 in the cloud region 2000. The data become capable of being used by the business operator 3100.
[0134] There may be various business operators 3100. Specific examples of the business operator 3100 are a hearing aid store, a hearing aid manufacturer, a content production company, a distribution business operator providing a music streaming service, and the like, which are referred to and illustrated as a business operator 3100-A, a business operator 3100-B, and a business operator 3100-C for distinctions among them. The corresponding server devices 3200 are referred to and illustrated as a server device 3200-A, a server device 3200-B, and a server device 3200-C. Various types of data are provided to such various business operators 3100 to promote utilization of the data. The data provision to the business operators 3100 may be data provision by subscription, recurring, or the like, for example.
[0135] Data can also be provided from the cloud region 2000 to the edge region 1000. For example, if machine learning is required to implement processing in the edge region 1000, data for feedback, revision, and the like of learning data is prepared by an administrator or the like of the server device 2100 in the cloud region 2000. The prepared data is transmitted from the server device 2100 to the sound production device 1100, the peripheral device 1200, or the vehicle 1300 in the edge region 1000.
[0136] If a specific condition is satisfied in the edge region 1000, some incentive (benefit such as premium service) may be provided to the user. An example of the condition is a condition that at least some of the sound production device 1100, the peripheral device 1200, and the vehicle 1300 are devices provided by the same business operator. In the case of an incentive that can be electronically supplied (electronic coupon or the like), the incentive may be transmitted from the server device 2100 to the sound production device 1100, the peripheral device 1200, or the vehicle 1300.
[0137] <<6. Example of Cooperation with Other Devices>> In the edge region 1000, the sound production device 1100 may cooperate with other devices using the peripheral device 1200 such as a smartphone as a hub, for example. An example will be described with reference to Fig. 36.
[0138] Fig. 36 is a diagram illustrating an example of cooperation with other devices. The edge region 1000, the cloud region 2000, and the business operator region 3000 are connected by a network 4000 and a network 5000. A smartphone is exemplified as the peripheral device 1200 in the edge region 1000, and other devices 1400 are exemplified as elements in the edge region 1000. Illustration of the vehicle 1300 (Fig. 34) is omitted.
[0139] The peripheral device 1200 is communicable with the sound production device 1100 and the other devices 1400. Although the communication method is not particularly limited, Bluetooth LDAC, Bluetooth LE Audio described above, or the like may be used, for example. Communication between the peripheral device 1200 and the other devices 1400 may be multicast communication. An example of the multicast communication is Auracast (registered trademark) or the like.
[0140] The other devices 1400 are used in cooperation with the sound production device 1100 via the peripheral device 1200. Specific examples of the other devices 1400 include a television (hereinafter, called TV), a personal computer (PC), a head mounted display (HMD), a robot, a smart speaker, a gaming device, and the like.
[0141] Also if the sound production device 1100, the peripheral device 1200, and the other devices 1400 satisfy a specific condition (for example, a condition that at least some thereof are provided by the same business operator), an incentive may be provided to the user.
[0142] The sound production device 1100 and the other devices 1400 can cooperate with the peripheral device 1200 as a hub. The cooperation may be made using various types of data stored in the server device 2100 in the cloud region 2000. For example, information such as fitting data, listening time, and hearing of the user is shared between the sound production device 1100 and the other devices 1400, whereby volume adjustment and the like of the devices are performed in cooperation. When the hearing aid 2 (HA) or a personal sound amplification products (PSAP) is worn, setting for the hearing aid 2 or the PSAP can be automatically performed on a TV, a PC, or the like. For example, when the user of the hearing aid 2 uses another device such as a TV or a PC, the settings of the other device may be automatically changed so as to be suitable for the user of the hearing aid, although the settings are usually made for normal-hearing persons. Whether the user is using the hearing aid 2 may be determined by automatically sending information indicating that the user has worn the hearing aid 2 (for example, wearing detection information) to a device such as a TV, a PC, or the like as a pairing destination of the hearing aid 2 when the user wears the hearing aid 2, or may be detected by using, as a trigger, approach of the user of the hearing aid to another target device such as a TV, a PC, or the like. It may be determined that the user is a hearing aid user by imaging the face of the user with a camera or the like provided in another device such as a TV, a PC, or the like, or by a method other than the above method. For example, the hearing aid 2 can function as earphones by establishing cooperation between a hearing aid 800, which is the sound production device 1100, and the other devices 1400. If the other devices 1400 include a microphone that collects surrounding sounds, earphones that are the sound production device 1100 can function like the hearing aid 2. In this case, the function of the hearing aid can be used in a style (appearance or the like) as if listening to music. The earphones / headphones and the hearing aid have many technically overlapping parts, and it is assumed that the demarcation between the earphones / headphones and the hearing aid will disappear in the future, and one device will have functions of both the earphones and the hearing aid. When the user’s hearing is normal, the normal-hearing user can use the device as earphones / headphones to enjoy content listening experience, and when the user’s hearing is lowered due to aging or the like, the device can function as a hearing aid by turning on the hearing aid function. Since the device as earphones can also be used as a hearing aid, continuous and long-term use of the device by the user can be expected from the viewpoint of appearance and design.
[0143] Data of the user's listening history may be shared. Prolonged listening can be a risk for future hearing loss. Notification or the like may be provided to the user so that the listening time does not become too long. For example, when the listening time exceeds a predetermined threshold, such a notification is provided (safe listening). The notification may be provided by any device in the edge region 1000.
[0144] At least some of the devices used in the edge region 1000 may be provided by different business operators. Information on device settings and the like of each business operator may be transmitted from the server device 3200 in the business operator region 3000 to the server device 2100 in the cloud region 2000 and stored in the server device 2100. Using such information enables cooperation between devices provided by different business operators.
[0145] <<7. Example of Application Transition>> The application of the sound production device 1100 may transition according to various situations including the user’s fitting data, listening time, hearing, and the like as described above. An example will be described with reference to Fig. 37.
[0146] Fig. 37 is a diagram illustrating an example of application transition. When the user has normal hearing, for example, while the user is a child and for a while after becoming an adult, the sound production device 1100 is used as headphones or earphones (headphones / TWS). In addition to the safe listening described above, adjustment of the equalizer, processing according to the user's behavior characteristics, current location, and external environment (for example, switching takes place between an optimal noise canceling mode in a scene in which the user is at a restaurant and an optimal noise canceling mode in a scene in which the user is on a vehicle), collection of listening music logs, and the like are performed. Communication between devices using Auracast is also utilized.
[0147] As the user's hearing declines, the hearing aid function of the sound production device 1100 begins to be utilized. For example, while the user is with mild to moderate hearing impairment, the sound production device 1100 is used as an over the counter hearing aid (OTC hearing aid). When the user has a high degree of hearing impairment, the sound production device 1100 is used as a hearing aid. The OTC hearing aid is a hearing aid that is sold at shops without expert intervention, and is easy to purchase without going through a hearing test or an expert such as an audiologist. A specific operation of the hearing aid such as fitting may be performed by the user himself / herself. While the sound production device 1100 is used as an OCT hearing aid or a hearing aid, hearing measurement is performed or the hearing aid function is turned on. For example, the function of transmission of an utterance flag in the above-described embodiment can also be used. Various types of information on hearing (hearing big data) are collected, fitting, sound environment adaptation, remote support, and the like are performed, and a transcription is performed.
[0148] The program may be stored in a disk device included in a server device on a network such as the Internet so as to be able to be downloaded, etc. to the hearing aid 2. Furthermore, the functions described above may be realized by using operating system (OS) and application software in cooperation. In this case, the portions other than the OS may be stored in a medium for distribution, or the portions other than the OS may be stored in a server device so as to be downloaded to a computer, for example.
[0149] Furthermore, among individual processing described in the above embodiments, all or a part of the processing described as being performed automatically may be manually performed, or the processing described as being performed manually can be performed automatically by known methods. In addition, the processing procedures, specific names, and information including various data and parameters illustrated in the above Literatures or drawings can be arbitrarily altered unless otherwise specified. For example, a variety of information illustrated in each of the drawings are not limited to the information illustrated.
[0150] In addition, each of components of each device is provided as a functional and conceptional illustration and thus does not necessarily need to be physically configured as illustrated. That is, the specific form of distribution / integration of each of the devices is not limited to those illustrated in the drawings, and all or a part thereof may be functionally or physically distributed or integrated into arbitrary units according to various loads and use situations. This configuration by distribution and integration may be performed dynamically.
[0151] Furthermore, the above-described embodiments can be appropriately combined within a range implementable without contradiction of processing. Furthermore, the order of individual steps illustrated in the flowcharts of the above-described embodiment can be changed as appropriate.
[0152] Furthermore, for example, the present embodiment can be implemented as any configuration constituting a device or a system, for example, a processor as a large scale integration (LSI) or the like, a module using a plurality of processors or the like, a unit using a plurality of modules or the like, and a set obtained by further adding other functions to the unit, or the like (that is, a configuration of a part of the device).
[0153] In the present embodiment, a system represents a set of a plurality of components (devices, modules (parts), or the like), and whether all the components are in the same housing would not be a big issue. Therefore, a plurality of devices housed in separate housings and connected via a network, and one device in which a plurality of modules are housed in one housing, are both systems.
[0154] Furthermore, for example, the present embodiment can adopt a configuration of cloud computing in which one function is cooperatively shared and processed by a plurality of devices via a network.
[0155] The embodiments of the present disclosure have been described above. However, the technical scope of the present disclosure is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the present disclosure. Moreover, it is allowable to combine the components across different embodiments and modifications as appropriate.
[0156] Note that the series of processing to be executed by individual devices described in the present specification may be implemented by using any of software, hardware, or a combination of software and hardware. The program constituting the software is stored in advance in, for example, a storage medium (non-transitory medium (or media)) provided inside or outside of each of devices. Then, each of programs is read into the RAM at the time of execution by the computer, for example, and is executed by a processor such as a CPU.
[0157] Furthermore, the processes described using the flowchart and the sequence diagram in the present specification do not necessarily have to be executed in the illustrated order. Some processing steps may be performed in parallel. In addition, additional processing steps may be employed, and some processing steps may be omitted.
[0158] The effects described in the present specification are merely examples, and thus, there may be other effects, not limited to the exemplified effects.
[0159] The present technology can also have the following configurations. (1) An information processing system, comprising processing circuitry configured to detect a use state of a sound production device and control the sound production device to set a ventilation state based upon the use state of the sound production device. (2) The information processing system according to (1), wherein the use state of the sound production device includes at least one of an operation of a user, a motion of the user, a voice of the user, a voice other than the voice of the user, an orientation of the user, a sound of an environment of the user, a type of sound reproduction, an external air condition, or biological information of the user. (3) The information processing system according to (1)-(2), wherein the processing circuity is configured to control the sound production device to set the ventilation state based upon a priority setting. (4) The information processing system according to (1)-(3), wherein the priority setting includes prioritization of one of hearing and comfort. (5) The information processing system according to (1)-(4), wherein the processing circuity is configured to select a ventilation control processing for setting the ventilation state based upon the priority setting. (6) The information processing system according to (1)-(5), wherein the use state of the sound production device includes a temperature, and the processing circuitry is configured to control the sound production device to set the ventilation state based upon the temperature. (7) The information processing system according to (1)-(6), wherein the use state of the sound production device includes a humidity, and the processing circuitry is configured to control the sound production device to set the ventilation state based upon the humidity. (8) The information processing system according to (1)-(7), wherein the processing circuity is configured to control the sound production device to set the ventilation state based upon a stored ventilation setting. (9) The information processing system according to (1)-(8), wherein the processing circuity is configured to acquire the stored ventilation setting when the use state of the sound production device has not been detected. (10) The information processing system according to (1)-(9), wherein the processing circuity is configured to control the sound production device to set the ventilation state based upon a preset ventilation setting. (11) The information processing system according to (1)-(10), wherein the sound production device includes a main body and an air vent disposed within the main body, and the processing circuitry is configured to control a state of the air vent based upon the use state of the sound production device. (12) The information processing system according to (1)-(11), wherein the main body has a flexible plate-like shape. (13) The information processing system according to (1)-(12), wherein the main body is constituted with soft silicon. (14) The information processing system according to (1)-(13), wherein the state of the air vent includes an opening degree of the air vent, and the processing circuitry is configured to control the opening degree of the air vent based upon the use state of the sound production device. (15) The information processing system according to (1)-(14), wherein the opening degree is 100% or a preset opening degree. (16) The information processing system according to (1)-(15), wherein the processing circuitry is configured to perform noise reduction processing of a sound to be produced by the sound production device. (17) The information processing system according to (1)-(16), wherein the processing circuitry is configured to perform the noise reduction processing in consideration of the ventilation state. (18) The information processing system according to (1)-(17), wherein the sound production device includes one or more hearing aid, one or more earphone, or one or more headphone. (19) A method comprising detecting a use state of a sound production device and controlling the sound production device to set a ventilation state based upon the use state of the sound production device. (20) A non-transitory computer readable medium storing instructions which when execute by a computer cause the computer to perform a method comprising detecting a use state of a sound production device and controlling the sound production device to set a ventilation state based upon the use state of the sound production device. (21) A hearing aid comprising: a ventilation passage disposed in a main body and configured to ventilate through external air and an ear canal of a user, at least a part of the main body being configured to be inserted into the ear canal; a ventilation adjustment unit configured to adjust ventilation of the ventilation passage; a use state detection unit configured to detect a use state of the user; and a ventilation control unit configured to control the ventilation adjustment unit based on a detection result of the use state detection unit. (22) The hearing aid according to the above (21), further comprising a control unit configured to select ventilation control processing, wherein the ventilation control unit controls the ventilation adjustment unit based on a detection result of the use state corresponding to the selected ventilation control processing. (23) The hearing aid according to the above (21), wherein the use state detection unit detects a motion of the user as the use state, and the ventilation control unit performs control to cause the ventilation adjustment unit to adjust the ventilation in a case where the detected motion of the user is a predetermined motion. (24) The hearing aid according to the above (21), wherein the use state detection unit detects a voice of the user as the use state, and the ventilation control unit performs control to cause the ventilation adjustment unit to adjust the ventilation in a case where the voice of the user is detected. (25) The hearing aid according to the above (21), wherein the use state detection unit detects a voice other than the voice of the user as the use state, and the ventilation control unit performs control to cause the ventilation adjustment unit to adjust the ventilation in a case where the voice other than the voice of the user is detected. (26) The hearing aid according to the above (25), wherein the use state detection unit further detects a direction of a head of the user as the use state, and the ventilation control unit performs control to cause the ventilation adjustment unit to adjust the ventilation in a case where a direction of the voice other than the voice of the user and a direction of the head of the user match. (27) The hearing aid according to the above (21), wherein the use state detection unit detects an environmental sound of the user as the use state, and the ventilation control unit controls the ventilation adjustment unit to adjust ventilation according to the detected environmental sound of the user. (28) The hearing aid according to the above (21), wherein the use state detection unit detects a sound reproduced by a streaming device used by the user as the use state, and the ventilation control unit performs control to cause the ventilation adjustment unit to adjust the ventilation in a case where the sound reproduced by the streaming device used by the user is detected. (29) The hearing aid according to the above (28), wherein the use state detection unit further detects a direction of a head of the user as the use state, and the ventilation control unit performs control to cause the ventilation adjustment unit to adjust the ventilation in a case where a direction of the sound reproduced by the streaming device used by the user and the direction of the head of the user match. (30) The hearing aid according to the above (21), wherein the use state detection unit detects a state of external air as the use state, and the ventilation control unit controls the ventilation adjustment unit to adjust ventilation according to the detected state of external air. (31) The hearing aid according to the above (21), wherein the use state detection unit detects a heart rate or a blood pressure of the user as the use state, and the ventilation control unit controls the ventilation adjustment unit to adjust ventilation according to the detected heart rate or blood pressure of the user. (32) The hearing aid according to the above (21), wherein the use state detection unit detects a specific sound toward the user as the use state, and the ventilation control unit performs control to cause the ventilation adjustment unit to adjust the ventilation in a case where the specific sound toward the user is detected. (33) The hearing aid according to the above (21), wherein the use state detection unit detects an incoming call to a communication device of the user as the use state, and the ventilation control unit performs control to cause the ventilation adjustment unit to adjust the ventilation in a case where the incoming call to the communication device of the user is detected. (34) The hearing aid according to the above (21), wherein the use state detection unit detects sleep of the user as the use state, and the ventilation control unit performs control to cause the ventilation adjustment unit to adjust the ventilation in a case where the sleep of the user is detected. (35) The hearing aid according to any of the above (21) to (34), further comprising a noise reduction unit configured to reduce noise of the external sound signal, wherein the use state detection unit further performs control of the noise reduction unit. (36) The hearing aid according to the above (21), wherein, in a case where the use state is not detected by the use state detection unit, the ventilation control unit controls the ventilation adjustment unit based on a ventilation setting. (37) The hearing aid according to the above (22), wherein the control unit selects the ventilation control processing based on a priority setting. (38) The hearing aid according to the above (37), wherein the control unit selects, in accordance with the priority setting, at least one ventilation control processing of ventilation control processing based on own voice, ventilation control processing based on an utterer, and ventilation control processing based on an environmental sound. (39) A control method comprising: adjusting ventilation of a ventilation passage disposed in an ear piece inserted into an ear canal of a user, the ventilation passage being configured to ventilate through external air and the ear canal; detecting a use state of the user; and controlling the adjustment of the ventilation based on the detected use state. (40) A program comprising: a ventilation adjustment procedure of adjusting ventilation of a ventilation passage disposed in an ear piece inserted into an ear canal of a user, the ventilation passage being configured to ventilate through external air and the ear canal; a use state detection procedure of detecting a use state of the user; and a ventilation control procedure of controlling the adjustment of the ventilation based on the detected use state.
[0160] 2 Hearing aid 10 Main body 20 Sound collection unit 20b Inner sound collection unit 20f Outer sound collection unit 22 Output unit 40 Information processing terminal 50 Smartphone 110 Use state detection unit 120 Ventilation control unit 140 Ventilation passage 150 Ventilation adjustment unit 152 Air vent 160 Noise reduction unit 201, 201f, 201b Mic 222 Receiver
Claims
1. An information processing system, comprising: processing circuitry configured to: detect a use state of a sound production device; and control the sound production device to set a ventilation state based upon the use state of the sound production device.
2. The information processing system according to claim 1, wherein the use state of the sound production device includes at least one of an operation of a user, a motion of the user, a voice of the user, a voice other than the voice of the user, an orientation of the user, a sound of an environment of the user, a type of sound reproduction, an external air condition, or biological information of the user.
3. The information processing system according to claim 1, wherein the processing circuity is configured to control the sound production device to set the ventilation state based upon a priority setting.
4. The information processing system according to claim 3, wherein the priority setting includes prioritization of one of hearing and comfort.
5. The information processing system according to claim 3, wherein the processing circuity is configured to select a ventilation control processing for setting the ventilation state based upon the priority setting.
6. The information processing system according to claim 1, wherein the use state of the sound production device includes a temperature, and the processing circuitry is configured to control the sound production device to set the ventilation state based upon the temperature.
7. The information processing system according to claim 1, wherein the use state of the sound production device includes a humidity, and the processing circuitry is configured to control the sound production device to set the ventilation state based upon the humidity.
8. The information processing system according to claim 1, wherein the processing circuity is configured to control the sound production device to set the ventilation state based upon a stored ventilation setting.
9. The information processing system according to claim 8, wherein the processing circuity is configured to acquire the stored ventilation setting when the use state of the sound production device has not been detected.
10. The information processing system according to claim 1, wherein the processing circuity is configured to control the sound production device to set the ventilation state based upon a preset ventilation setting.
11. The information processing system according to claim 1, wherein the sound production device includes a main body and an air vent disposed within the main body, and the processing circuitry is configured to control a state of the air vent based upon the use state of the sound production device.
12. The information processing system according to claim 11, wherein the main body has a flexible plate-like shape.
13. The information processing system according to claim 12, wherein the main body is constituted with soft silicon.
14. The information processing system according to claim 11, wherein the state of the air vent includes an opening degree of the air vent, and the processing circuitry is configured to control the opening degree of the air vent based upon the use state of the sound production device.
15. The information processing system according to claim 14, wherein the opening degree is 100% or a preset opening degree.
16. The information processing system according to claim 1, wherein the processing circuitry is configured to perform noise reduction processing of a sound to be produced by the sound production device.
17. The information processing system according to claim 16, wherein the processing circuitry is configured to perform the noise reduction processing in consideration of the ventilation state.
18. The information processing system according to claim 1, wherein the sound production device includes one or more hearing aid, one or more earphone, or one or more headphone.
19. A method comprising: detecting a use state of a sound production device; and controlling the sound production device to set a ventilation state based upon the use state of the sound production device.
20. A non-transitory computer readable medium storing instructions which when execute by a computer cause the computer to perform a method, the method comprising: detecting a use state of a sound production device; and controlling the sound production device to set a ventilation state based upon the use state of the sound production device.
Citation Information
Patent Citations
Method of operating a hearing device and hearing device comprising an active vent
EP3627848A1
Hearing device comprising an adjustable vent
US20200260197A1
Ear piece with active vent control
US20210044910A1
Hearing device, ear piece, program, and control method
WO2023210452A1