Electronic devices, systems, methods, and programs

Abstract

To reduce power consumption. [Solution] The electronic device includes a processing unit. The processing unit intermittently performs a detection process to detect the level of an incoming external sound. When an external sound of a first level or higher is detected in n consecutive (n is a natural number greater than or equal to 2) of the intermittently performed detection processes, it performs an output process to adjust and output the incoming external sound.

Description

Technical Field

[0001] The present disclosure relates to an electronic device, a system, a method, and a program.

Background Art

[0002] For wearable electronic devices such as hearing aids, it is required to suppress power consumption so that they can operate for a long time with a single charge. Hearing aids include, for example, cochlear implants, sound collectors, and hearing aids. For example, the hearing aid described in Patent Document 1 constantly detects the level of the input sound and suppresses power consumption by turning off the hearing function when no sound above a certain level is input.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the hearing aid described in Patent Document 1, it is necessary to constantly drive the microphone and the level detection circuit. Therefore, it is difficult to sufficiently suppress power consumption.

[0005] In view of the above circumstances, an embodiment of the present disclosure aims to provide an electronic device, a system, a method, and a program capable of suppressing power consumption.

Means for Solving the Problems

[0006] An electronic device according to an embodiment of the present disclosure includes a processing unit. The processing unit intermittently executes a detection process for detecting the level of an input external sound, and when an external sound of a first level or higher is detected in n (n is a natural number of 2 or more) consecutive detection processes intermittently executed, the processing unit executes an output process for adjusting and outputting the input external sound.

Effects of the Invention

[0007] According to one embodiment of the present disclosure, electronic devices, systems, methods, and programs are provided that can reduce power consumption. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram showing the configuration of a hearing assistance device according to one embodiment of the present disclosure. [Figure 2] This diagram illustrates the general operation of the hearing assistance device according to Embodiment 1 of this disclosure. [Figure 3] This diagram illustrates the general operation of the hearing assistance device according to Embodiment 1 of this disclosure. [Figure 4] This diagram illustrates the general operation of the hearing assistance device according to Embodiment 1 of this disclosure. [Figure 5] This is a flowchart showing the process performed by the hearing assistance device in Example 1 of this disclosure. [Figure 6] This is a flowchart showing the process performed by the hearing assistance device in Example 2 of this disclosure. [Figure 7] This is a sequence diagram showing the process performed in a system comprising a hearing assistance device and an external device in Embodiment 3 of this disclosure. [Modes for carrying out the invention]

[0009] The following description relates to electronic devices, systems, methods, and programs according to one embodiment of the present disclosure. Common or corresponding elements are denoted by the same or similar reference numerals, and redundant descriptions are omitted or simplified as appropriate.

[0010] The hearing aid 1 shown in Figure 1 is an example of an electronic device. The hearing aid 1 is, for example, a hearing aid. The user uses the hearing aid 1 by wearing it on, for example, the right or left ear that has been diagnosed with hearing loss. If the user has been diagnosed with hearing loss in both ears, they use a pair of hearing aids 1, one on each ear. The hearing aid 1 may also be a sound amplifier or a hearing assist device.

[0011] Hearing assistance device 1 is an example of a computer. As shown in Figure 1, hearing assistance device 1 comprises a processing unit 10, a microphone 20, a preamplifier 22, a speaker amplifier 24, a speaker 26, a battery 30, and a power supply circuit 32. The power supply circuit 32 supplies power from the battery 30 to each part of hearing assistance device 1. This allows hearing assistance device 1 to operate. Note that Figure 1 is merely an example of the configuration of hearing assistance device 1. Hearing assistance device 1 may include other elements not shown in Figure 1. Hearing assistance device 1 may also have a configuration that does not include some of the elements shown in Figure 1. For example, the microphone 20, preamplifier 22, and the sound input unit 13 (described later) may be replaced with a digital microphone that outputs a PDM (Pulse Density Modulation) signal. The digital microphone may be mounted on the processing unit 10, or it may be an external type connected to the processing unit 10. The speaker amplifier 24 and the sound output section 14, described later, may be replaced with a Class D amplifier that outputs a PWM (Pulse Width Modulation) signal. The Class D amplifier may be mounted in the processing unit 10, or it may be an external type connected to the processing unit 10.

[0012] The processing unit 10 is, for example, a System on a Chip (SoC) that includes a CPU (Central Processing Unit), a Digital Signal Processor (DSP), memory, a communication interface, etc. The processing unit 10 may also be composed of other forms of circuitry, such as a System in Package (Sip). The processing unit 10 includes, as functional blocks, a control unit 11, a storage unit 12, an audio input unit 13, an audio output unit 14, and a communication unit 15.

[0013] The control unit 11 is composed of at least one processor, such as a CPU or DSP. The control unit 11 reads various programs and data stored in the storage unit 12 and comprehensively controls the hearing assistance device 1.

[0014] The storage unit 12 includes non-volatile semiconductor memory such as flash memory, EPROM (Erasable Programmable ROM), and EEPROM (Electrically Erasable Programmable ROM) as storage devices. The storage unit 12 stores various programs and various data. For example, various processes according to one embodiment of this disclosure are executed by the control unit 11 executing the power control program 12A stored in the storage unit 12.

[0015] The audio input section 13 includes, for example, an A / D (Analog / Digital) converter. The audio input section 13 converts the analog audio signal input via the microphone 20 and preamplifier 22 into a digital audio signal. Alternatively, the audio input section 13 may acquire the voltage value generated at the microphone 20 moment by moment, rather than the AD-converted value (AD value) of the external sound information.

[0016] The control unit 11 performs sound adjustment processing (such as amplification processing according to the frequency gain) on the digital audio signal acquired by the sound input unit 13 based on set values ​​(such as gain for each frequency). The set values ​​are pre-set, for example, based on fitting work by the user themselves or an audiologist, and stored in the memory unit 12.

[0017] The control unit 11 outputs a digital audio signal after adjustment processing. Specifically, the sound output unit 14 includes a D / A (Digital / Analog) converter. The sound output unit 14 converts the digital audio signal adjusted by the control unit 11 into an analog audio signal and outputs it to the speaker amplifier 24. The analog audio signal amplified by the speaker amplifier 24 is output as sound from the speaker 26.

[0018] The communication unit 15 includes a communication interface for communicating with an external device 2. The communication unit 15 connects the hearing aid device 1 and the external device 2 so that they can communicate with each other according to wireless communication standards such as Wi-Fi, Bluetooth (registered trademark), and IR (infrared) communication. The external device 2 connected to the hearing aid device 1 is, for example, a smartphone, a tablet terminal, or a PC (Personal Computer). The external device 2 may also be a server placed on a network. The communication unit 15 receives, for example, set values obtained in a fitting operation using the external device 2. The control unit 11 stores the received set values in the storage unit 12.

[0019] The hearing aid device 1 is, for example, an open-type hearing aid for mild hearing loss or moderate hearing loss. Unlike a closed-type hearing aid, an open-type hearing aid does not block the ear canal (external auditory canal). Therefore, with an open-type hearing aid, external sound reaches the user's ear directly without being physically blocked. Therefore, with an open-type hearing aid, the user can more easily grasp the direction of external sound compared to when wearing a closed-type hearing aid, and can also hear external sound to some extent even when the hearing aid function is turned off.

[0020] The hearing aid described in Patent Document 1 is presumed to be a closed-type hearing aid. As shown in Patent Document 1, in this type of hearing aid, in order to avoid a silent state, it is necessary to constantly supply driving power to the input-side circuit such as a microphone. Therefore, in Patent Document 1, the power consumption is large. On the other hand, since the hearing assistance device 1 according to the present embodiment is an open-type hearing aid, external sounds are not physically blocked. Therefore, it is possible to avoid a silent state without constantly driving the input-side circuit such as a microphone. However, the distance between the open-type hearing aid and the eardrum is farther than that of the closed-type hearing aid. Therefore, in an open-type hearing aid, in order to transmit sound to the user at the same sound pressure as in a closed-type hearing aid, it is necessary to increase the gain. When the gain is increased, the power consumption increases, so the operating time per charge becomes shorter. Therefore, in an open-type hearing aid, it is difficult to use it throughout the day without charging unless the battery capacity is increased compared to a closed-type hearing aid. Since the hearing aid is worn on the user's ear, there are significant restrictions on size and weight. It is not preferable to install a large battery to increase the battery capacity.

[0021] Also, in the case of a hearing aid having a TWS (True Wireless Stereo) earphone function capable of playing music, generally, a TWS-compatible SoC for music is installed. This type of SoC is not specifically set for hearing aids. Therefore, this type of SoC has a higher power consumption than a hearing aid dedicated SoC. It is difficult to use a hearing aid with a TWS earphone function throughout the day without charging.

[0022] Therefore, the hearing assistance device 1 according to this embodiment is configured to dynamically switch between a power-saving mode and a normal operating mode depending on the user's surrounding environment. In the normal operating mode, the hearing assistance function is turned on. In contrast, in the power-saving mode, the hearing assistance function is turned off. As described above, in open-type hearing aids, external sounds reach the user's ears directly without being physically blocked. Therefore, for example, if the user's surrounding environment does not require hearing assistance, it is practically acceptable to switch from the normal operating mode to the power-saving mode and turn off the hearing assistance function. Because the hearing assistance device 1 switches between the normal operating mode and the power-saving mode as appropriate, the operating time on a single charge of the battery 30 is longer compared to when it operates continuously in the normal operating mode.

[0023] Figures 2 to 4 illustrate the general operation of the hearing aid device 1 according to Embodiment 1 of this disclosure. Figures 2, 3, and 4 show operation example A, operation example B, and operation example C, respectively. In each of Figures 2 to 4, the "External Sound" column shows the period during which external sounds with a sound pressure level of 1 or higher are audible (the period during which external sounds of a certain volume or higher are generated around the hearing aid device 1) using rectangular blocks. In other words, assuming the microphone 20, preamplifier 22, and processing unit 10 are operating, this is the period during which external sounds with a sound pressure level of 1 or higher can be detected. The use of rectangular blocks is for visual clarity, and the boundaries of the rectangular blocks do not mean silence. The "Detection Process" column shows the periodically executed external sound detection process. The symbols (such as T1) appended to this column indicate the timing at which the detection process is executed. The "Hearing Function" column shows the on and off periods of the hearing function of the hearing aid device 1. The "Average Current" column shows the average value (in mA) of the current consumed by hearing aid device 1. The values ​​shown in Figures 2 to 4 are just examples. These values ​​will vary depending on the specifications of hearing aid device 1.

[0024] Furthermore, any reference to elements using designations such as “First,” “Second,” etc., as used in this disclosure does not generally limit the quantity or order of those elements. These designations are used for convenience to distinguish between two or more elements. Therefore, references to the First and Second elements do not imply, for example, that only two elements are adopted, or that the First element must precede the Second element.

[0025] In this embodiment 1, the hearing aid device 1 performs detection processing at a 500ms cycle in both power-saving mode and normal operation mode. During detection processing, the hearing aid device 1 operates the microphone 20, preamplifier 22, and processing unit 10 to measure the sound pressure level of external sounds at a sampling frequency of 24kHz for 5 samples. The time required to measure 5 samples is, for example, 0.113ms. The detection processing time is set to 0.5ms, which is sufficiently longer than 0.113ms, taking overhead into consideration.

[0026] In power-saving mode, for example, the system of the hearing aid device 1 is stopped and enters an interrupt standby state, thereby reducing power consumption. In the interrupt standby state, the operation of each part of the hearing aid device 1 is almost completely stopped. Specifically, in power-saving mode, the processing unit 10 operates only with a low-power clock function in order to wait for a timer interrupt, as described later. In power-saving mode, the microphone 20, preamplifier 22, speaker amplifier 24, speaker 26, and power supply circuit 32 enter a sleep state. These may enter a standby state instead of a sleep state, or a power-off state in which the power supply is completely cut off. The average current consumption in the interrupt standby state is, for example, 0.3mA. However, even in power-saving mode, power for operation is supplied to the microphone 20, preamplifier 22, and processing unit 10 during the detection process that is executed every 500ms (for a period of 0.5ms). Therefore, during the detection process, the microphone 20, preamplifier 22, and processing unit 10 temporarily wake up from sleep mode (or standby mode or power off mode) and begin operation. At this time, the sound output unit 14 remains in sleep mode (or standby mode or power off mode), and the speaker amplifier 24 and speaker 26 are also in sleep mode (or standby mode or power off mode). As a result, the average current consumption during the detection process performed in power-saving mode is 5mA, which is higher than 0.3mA. However, the execution time for one detection process, which is performed with a 500ms cycle, is only 0.5ms. Therefore, it is practically acceptable to consider the average current consumption for the entire power-saving mode, including the detection process, as 0.3mA.

[0027] At the start of operation examples A and B, the hearing aid device 1 is operating in power-saving mode. Therefore, when the hearing aid device 1 detects an external sound with a sound pressure level above the first threshold, it transitions from power-saving mode to normal operation mode and turns on the hearing aid function. However, if the hearing aid function is unnecessarily turned on by noise, not only will the power-saving effect be reduced, but the noise may be amplified, potentially causing discomfort to the user. Therefore, in this embodiment 1, when an external sound with a sound pressure level above the first threshold is detected consecutively n times (n is a natural number of 2 or more, and in this embodiment 1, it is 3 times), the hearing aid device 1 transitions from power-saving mode to normal operation mode.

[0028] In operation example A, external sounds with a sound pressure level above the first threshold were detected only twice, at timings T1 and T2. Therefore, the hearing aid 1 continues to operate in power-saving mode without transitioning to normal operation mode. The capacity of the battery 30 is, for example, 70mAh. When operating continuously in power-saving mode, the average current consumption is 0.3mA, so the hearing aid 1 can operate for approximately 233 hours on a full charge. In other words, the hearing aid 1 can operate for well over a day without charging.

[0029] In operation example B, external sounds with a sound pressure level above the first threshold are detected in three detection processes at timings T1 to T3. Therefore, the hearing aid device 1 transitions from power-saving mode to normal operation mode and turns on the hearing function. The user can hear external sounds clearly with the hearing function.

[0030] According to the National Institute for Japanese Language and Linguistics' project report, "Survey Report on Daily Conversational Behavior" (URL: https: / / www2.ninjal.ac.jp / conversation / report / report01.pdf), the average daily conversation time is 6 hours. According to the 2021 Media Survey by the Public Opinion Survey Department of the NHK Broadcasting Culture Research Institute (https: / / www.nhk.or.jp / bunken / yoron-jikan / column / media-2021-05.html?v=56fb752b0c7b7ab00b5a693d1e540949), the average daily (weekday) television viewing time is 3 hours. From this, one rough estimate is that the amount of time during the day when hearing assistance is needed is around 9 hours. For example, even if the hearing aid function is turned off during the time between waking up and going to sleep, excluding conversation time and television viewing time, people with mild or moderate hearing loss who wear open-type hearing aids will still have virtually no problem understanding their surroundings.

[0031] The average current consumption during normal operation is, for example, 7.0mA. If the hearing aid 1 operates in normal operation mode for 9 hours a day (total of conversation time and TV viewing time), the average current consumption over 24 hours will be 2.8mA. In this case, the hearing aid 1 will operate for approximately 25 hours on a full charge. In other words, the hearing aid 1 can operate for more than a day without charging, with the hearing function turned on when a person starts speaking, when a conversation begins, or when hearing assistance is needed, such as when watching TV. From another perspective, the hearing aid 1 can operate for more than a day without charging because the hearing function is turned off and power is reduced when the need for hearing assistance is low, such as when the surrounding environment is quiet. From yet another perspective, because power consumption is reduced, a smaller capacity battery 30 can be installed. This makes it possible to achieve miniaturization and weight reduction of the hearing aid 1.

[0032] The execution cycle of the detection process is not limited to 500ms. To improve the accuracy of the transition timing from power-saving mode to normal operation mode, the hearing aid 1 may perform the detection process at shorter intervals. For example, consider the case where the hearing aid 1 performs the detection process at 5ms intervals. In this case, the average current consumption during power-saving mode is, for example, 0.77mA. If power-saving mode is maintained throughout, the hearing aid 1 will operate for approximately 90 hours from a full charge. If the hearing aid 1 operates in normal operation mode for 9 hours a day (total of conversation time and TV viewing time), the average current consumption over 24 hours will be 3.1mA. In this case, the hearing aid 1 will operate for approximately 22.6 hours from a full charge. For example, if you wake up at 6am and go to bed at 12am, your daily activity time is 18 hours. That is, the hearing aid 1 can operate beyond the daily activity time without charging.

[0033] To prevent users from missing important information, it is desirable that the transition from power-saving mode to normal operation mode be performed quickly. On the other hand, if the hearing aid function switches frequently on and off with mode transitions, the volume of external sounds reaching the user will fluctuate frequently, causing auditory discomfort. Therefore, in this embodiment 1, in order to prevent the hearing aid function from switching frequently on and off and to prevent users from missing important information, the conditions for transitioning from normal operation mode to power-saving mode (i.e., the conditions for turning off the hearing aid function) are set more strictly than the conditions for transitioning from power-saving mode to normal operation mode (i.e., the conditions for turning on the hearing aid function).

[0034] Specifically, as shown in Operation Example C, when an external sound with a sound pressure level below the first threshold is detected m times (where m is a natural number greater than n, and in this embodiment 1 it is 10 times) more than n times in a detection process, the hearing assistance device 1 transitions from normal operation mode to power-saving mode. This prevents the hearing function from being frequently switched on and off with each mode transition. Instead of increasing the number of detection processes, or in addition to increasing the threshold value at the time of determination, the conditions for transitioning from normal operation mode to power-saving mode (i.e., the conditions for turning off the hearing function) may be made stricter than the conditions for transitioning from power-saving mode to normal operation mode (i.e., the conditions for turning on the hearing function).

[0035] Using Figure 5, the processing performed by the processing unit 10 of the hearing assistance device 1 in this embodiment 1 will be explained. For example, when the power of the hearing assistance device 1 is turned on and operation in normal mode begins, the processing shown in Figure 5 begins. For example, when the power of the hearing assistance device 1 is turned off, the processing shown in Figure 5 ends.

[0036] The steps in the flowcharts and sequences shown in the embodiments of this disclosure may be rearranged in order, provided that this is not inconsistent. For example, while the embodiments of this disclosure present the processing of various steps using an exemplary order, the embodiments are not limited to this presented order. Furthermore, the steps in the flowcharts and sequences shown in the embodiments of this disclosure may be executed in parallel or concurrently, provided that this is not inconsistent.

[0037] As shown in Figure 5, the processing unit 10 determines whether the surrounding environment is quiet or not (step S101). Specifically, the processing unit 10 supplies power to the microphone 20 and the preamplifier 22 to operate them. The sound input unit 13 detects, for example, the voltage value that is generated moment by moment in the microphone 20 via the preamplifier 22 (i.e., the sound pressure level of the external sound).

[0038] The processing unit 10 determines that the surrounding environment is quiet if a sound pressure level below the first threshold is detected in the sound input unit 13 for a predetermined period of time (step S101: YES). In this case, the processing unit 10 transitions from normal operation mode to power saving mode and turns off the hearing aid function (step S102). The processing unit 10 does not transition to power saving mode unless a sound pressure level below the first threshold is detected in the sound input unit 13 for a predetermined period of time.

[0039] Furthermore, when the processing unit 10 transitions from normal operation mode to power-saving mode, it fades out the sound output from speaker 26 to prevent a sudden change in the volume of external sounds audible to the user. In other words, when the processing unit 10 transitions from normal operation mode (an example of a second state in which output processing is performed to adjust and output the input external sound) to power-saving mode (an example of a first state in which output processing is not performed to adjust and output the input external sound) it fades out the adjusted external sound.

[0040] The processing unit 10 includes, for example, a low-power clock function such as an RTC (Real Time Clock). During power saving mode, the processing unit 10 operates using, for example, only the low-power clock function. This reduces the average current consumption during power saving mode to approximately 0.3mA. The processing unit 10 sets a timer for the low-power clock (step S103). Illustratively, the processing unit 10 sets the count value to a predetermined value (for example, a value equivalent to 500ms), starts a down count, and enters a timer interrupt standby state (step S104).

[0041] The processing unit 10 determines whether or not a timer interrupt has occurred (step S105). For example, the processing unit 10 detects the occurrence of a timer interrupt when the down-counted value becomes zero (step S105: YES). In this case, the processing unit 10 executes the detection process (step S106). Specifically, the processing unit 10 measures the sound pressure level of the external sound for 5 samples at a sampling frequency of 24 kHz. If a sound pressure level above the first threshold is not detected at this time (step S107: NO), the processing unit 10 resets the timer and returns to the timer interrupt waiting state (steps S103-S104). In this way, the processing unit 10 executes the detection process (step S106) at 500 ms intervals.

[0042] If a sound pressure level above the first threshold is detected (step S107: YES), the processing unit 10 determines whether an external sound with a sound pressure level above the first threshold has been detected consecutively for n times (for example, 3 times) (step S108). If an external sound with a sound pressure level above the first threshold has been detected consecutively for one or two times (step S108: NO), the processing unit 10 resets the timer and returns to the timer interrupt standby state (steps S103-S104). If an external sound with a sound pressure level above the first threshold has been detected consecutively for three times (step S108: YES), it is highly likely that this is the time when a person is about to start talking, when a conversation is about to begin, or when hearing assistance is needed, such as when watching television. Therefore, the processing unit 10 transitions from power-saving mode to normal operation mode and turns on the hearing assistance function (step S109). The user can then hear external sounds clearly with the hearing assistance function.

[0043] In this manner, the processing unit 10 intermittently (for example, at a 500ms cycle) performs a detection process to detect the sound pressure level of the incoming external sound. If an external sound above a first threshold (an example of a first level) is detected in all n consecutive detection processes (where n is a natural number greater than or equal to 2), the processing unit 10 performs an output process to adjust the incoming external sound and output it.

[0044] Furthermore, when the processing unit 10 transitions from power-saving mode to normal operation mode, it fades in the sound output from speaker 26 to prevent a sudden change in the volume of external sounds audible to the user. In other words, when the processing unit 10 transitions from power-saving mode (an example of a first state in which output processing that adjusts and outputs the input external sound is not performed) to normal operation mode (an example of a second state in which output processing that adjusts and outputs the input external sound is performed), it fades in the adjusted external sound.

[0045] The processing unit 10 may monitor timer interrupts using an external RTC device connected to the processing unit 10 instead of the built-in RTC. Generally, external RTC devices operate at low power. Therefore, even in this case, power saving of the hearing assistance device 1 is ensured.

[0046] The processing unit 10 resets the timer and enters a timer interrupt standby state (steps S110-S111). When the processing unit 10 detects the occurrence of a timer interrupt (step S112: YES), it executes the detection process (step S113). At this time, if a sound pressure level exceeding the second threshold (an example of the second level) is detected (step S114: NO), the processing unit 10 resets the timer and returns to the timer interrupt standby state (steps S110-S111). In other words, even during normal operation mode, the processing unit 10 executes the detection process (step S113) at 500ms intervals.

[0047] If a sound pressure level below the second threshold is detected (step S114: YES), the processing unit 10 determines whether the sound pressure level below the second threshold has been detected consecutively for m times (for example, 10 times) (step S115). If the sound pressure level below the second threshold has been detected consecutively for 1 to 9 times (step S115: NO), the processing unit 10 resets the timer and returns to the timer interrupt waiting state (steps S110 to S111).

[0048] If a sound pressure level below the second threshold is detected consecutively in 10 detection processes (step S114: YES), the processing unit 10 likely determines that the need for hearing assistance is low, such as when the surrounding environment is quiet. Therefore, the processing unit 10 transitions from normal operation mode to power-saving mode and turns off the hearing assistance function (step S102). This reduces the power consumption of the hearing assistance device 1 and extends its continuous operating time. The second threshold is the same as the first threshold. To prevent frequent switching between the on and off of the hearing assistance function with mode transitions, the second threshold may be higher than the first threshold.

[0049] Thus, the processing unit 10 continues to perform output processing, adjusting and outputting the input external sound, until an external sound with a sound pressure level below the second threshold (an example of the second level) is detected in the detection process. The processing unit 10 stops executing output processing when an external sound with a sound pressure level below the second threshold is detected in all m (m is a natural number greater than n) consecutive detection processes.

[0050] Using Figure 6, the processing performed by the processing unit 10 of the hearing assistance device 1 in this embodiment 2 will be explained. For example, when the power of the hearing assistance device 1 is turned on and operation in normal mode begins, the processing shown in Figure 6 begins. For example, when the power of the hearing assistance device 1 is turned off, the processing shown in Figure 6 ends.

[0051] The processing unit 10 determines whether the surrounding environment is quiet or not (step S201). If the processing unit 10 determines that the surrounding environment is quiet (step S201: YES), it transitions from normal operation mode to power saving mode and turns off the hearing aid function (step S202). For example, the memory unit 12 has a third threshold and a fourth threshold stored in advance. The processing unit 10 sets the third threshold stored in the sound input unit 13 as the threshold for the AD value acquired by the sound input unit 13 (step S203) and enters an interrupt standby state (step S204). The third threshold set here is, for example, a value equivalent to the sound pressure level of the first threshold in Embodiment 1.

[0052] The processing unit 10 monitors the AD value to determine whether an interrupt has occurred (step S205). For example, when the processing unit 10 receives an AD value equal to or greater than the third threshold (i.e., a value equivalent to the sound pressure level of the first threshold), it detects the occurrence of an interrupt (step S205: YES), transitions from power-saving mode to normal operation mode, and turns on the hearing aid function (step S206). The user can then hear external sounds clearly using the hearing aid function. Alternatively, the processing unit 10 may monitor the input level of the microphone 20 using a comparator circuit instead of the AD value.

[0053] The processing unit 10 sets the fourth threshold value held in the sound input unit 13 as the threshold value for the AD value acquired by the sound input unit 13 (step S207), and enters an interrupt standby state (step S208). The processing unit 10 monitors the AD value and determines whether or not an interrupt has occurred (step S209). For example, when an AD value less than or equal to the fourth threshold value set in step S207 is input, the processing unit 10 detects the occurrence of an interrupt (step S209: YES), transitions from normal operation mode to power saving mode, and turns off the hearing aid function (step S202). As a result, the power consumption of the hearing aid device 1 is reduced, and the continuous operating time of the hearing aid device 1 is extended.

[0054] To prevent the hearing aid function from frequently switching on and off with mode transitions, in step S207, the processing unit 10 sets the fourth threshold to a value lower than the third threshold set in step S203. To more reliably prevent frequent switching of the hearing aid function on and off, the processing unit 10 may detect the occurrence of an interrupt and transition from normal operation mode to power-saving mode and turn off the hearing aid function only if an AD value of less than or equal to the fourth threshold is input continuously for a certain period of time.

[0055] Using Figure 7, the processes performed in this embodiment 3, which includes a hearing assistance device 1 and an external device 2, will be explained. In this embodiment 3, the hearing assistance device 1 attempts to establish a BLE (Bluetooth Low Energy) connection with the external device 2. In power-saving mode, the hearing assistance device 1 periodically attempts to establish a BLE connection with the external device 2 at longer intervals than in normal operation mode in order to conserve power.

[0056] When hearing assistance device 1 establishes a BLE connection with external device 2 (step S301), it issues a request to external device 2 (step S302). Hearing assistance device 1 maintains the BLE connection with external device 2 in all modes. In power-saving mode, hearing assistance device 1 may intermittently disconnect the BLE connection with external device 2 to conserve power. In this case, hearing assistance device 1 periodically reconnects with external device 2 by generating an interrupt using, for example, a low-power clock function such as an RTC.

[0057] External device 2 is, for example, a smartphone and incorporates various sensors such as a GPS (Global Positioning System) sensor, an accelerometer, and a gyroscope. External device 2 periodically acquires various information such as the user's current location, speed, and direction of movement using these sensors. External device 2 has a dedicated application app (see Figure 1) for hearing assistance device 1 installed.

[0058] External device 2 executes application App in response to a request from hearing assistance device 1. Application App works in conjunction with various apps installed on hearing assistance device 1 to obtain the user's status (step S303). For example, application App works with a map app. In response to an inquiry from application App, the map app obtains the user's current location, speed, and direction of movement calculated based on sensor outputs such as an accelerometer and gyroscope, as well as the results of positioning processing using a GPS sensor, to obtain a status such as "on the move" (e.g., on a train) or "on duty" (e.g., inside the company) and returns it to application App. As an example, the map app determines whether two conditions are met (Condition 1: The user is moving continuously near train tracks (e.g., within 10m of train tracks) for several seconds, Condition 2: The speed of movement is several tens of km / h or more) from the user's current location obtained using a GPS sensor, etc. If the map app determines that these two conditions are met, it obtains the status "on the train" and returns it to application App. Application App also works with a calendar app. The calendar app, in response to a query from the application app, retrieves the user's status based on registered appointments (such as lunch, meetings, and going out) and the current time, and returns it to the application app.

[0059] The application app instructs the hearing aid 1 to operate in a mode based on the status obtained in step S303 (step S304). For example, let's consider the case where the status obtained is "on a train". There is usually little conversation with people on a train. Therefore, the application app instructs the hearing aid 1 to operate in power-saving mode. This instruction is periodically sent from the external device 2 to the hearing aid 1 while on the train. As a result, the hearing aid 1, having received the instruction, operates in power-saving mode while on the train (step S305). Even if the hearing function is turned off while on the train, people with mild or moderate hearing loss wearing open-type hearing aids will have virtually no problem understanding their surroundings.

[0060] On a train, for example, an announcement is made when approaching the next station. To prevent users from missing such announcements, the application app may instruct the hearing aid device 1 to operate in normal mode when approaching a station. Because the hearing aid device 1 transitions from power-saving mode to normal mode and the hearing function is turned on, the user can hear the announcements clearly. The application app can also detect when approaching a station through a process that coordinates with a map app. For example, if the map app determines that the user is approaching the next station based on the user's current location obtained using a GPS sensor, etc., and that in addition to conditions 1 and 2 above, condition 3 (for example, the distance between the user and the next station is within a few kilometers) is met, it will notify the application app that it is approaching the next station.

[0061] For example, let's consider the case where the status "walking" is acquired. To enable the user to walk safely by hearing sounds such as cars and bicycles, the application App instructs hearing aid 1 to operate in normal mode. While walking, the hearing function is turned on, allowing the user to walk while clearly hearing surrounding sounds.

[0062] For example, let's consider the case where the status "inside the company" is acquired. Various situations can occur within the company. Therefore, the application App instructs the hearing aid 1 to dynamically switch its operating mode between power-saving mode and normal operating mode according to the user's surrounding environment. Upon receiving the instruction, the hearing aid 1 executes the process shown in Figure 4, etc., and dynamically switches its operating mode between power-saving mode and normal operating mode according to the user's surrounding environment (step S305).

[0063] For example, let's consider the case where the time for an appointment (e.g., a meeting) registered in the calendar app is reached and the status "In a meeting" is obtained. In this case, the application App instructs the hearing aid 1 to operate in normal operating mode. The hearing aid 1, having received the instruction, operates in normal operating mode during the meeting (step S305). This prevents the user from missing important information during the meeting. In other words, the hearing aid 1 (processing unit 10) receives instructions from the external device 2 based on an appointment (such as a meeting) set for the user, and in accordance with the received instructions, continues to execute output processing (i.e., continues to operate in normal operating mode) for the duration of the scheduled appointment (e.g., during a meeting).

[0064] Furthermore, if the battery capacity of the 30 is low, there is a risk of running out of charge in situations where continuous operation in normal operating mode, such as during a meeting, is recommended. In this case, the application app may notify the user to charge the hearing aid 1 at times such as before or during a meeting. The charging recommendation notification may be displayed as a message on the application app, or it may be played as an audio message. Alternatively, the hearing aid 1 may receive instructions from the application app and, in accordance with these instructions, play an audio message recommending that the hearing aid 1 be charged. Charging the hearing aid 1 before or during a meeting may be registered as an event in the calendar app.

[0065] The application app may estimate whether the battery will run out during a meeting based on the remaining capacity of the battery 30 (in other words, the operating time in normal operating mode) and the total duration of meetings registered in the calendar app. If it is estimated that the battery will run out, the application app may notify the user to charge the hearing aid 1 at a time such as before the meeting or in between meetings. This notification may be made by the hearing aid 1 playing an audio message. In this way, the hearing aid 1 (processing unit 10) may, in accordance with instructions received from the external device 2, notify the hearing aid 1 to charge if the total duration of scheduled events (such as meetings) exceeds a threshold (for example, the operating time in normal operating mode estimated from the remaining capacity of the battery 30).

[0066] Note that "battery depleted (i.e., battery 30's remaining capacity is 0%)" can be rephrased as "battery running low (for example, battery 30's remaining capacity falls below a threshold (e.g., 10%))." For example, if it is estimated that battery 30's remaining capacity will fall below a threshold during a meeting, the application App or hearing aid 1 may notify the user immediately after the meeting (or in between meetings if they are consecutive) to recommend charging hearing aid 1. The application App may also register charging hearing aid 1 immediately after the meeting (or in between meetings if they are consecutive) as an event in the calendar app.

[0067] In this way, external device 2 obtains the user status of hearing aid device 1 (an example of an electronic device) and outputs instructions to hearing aid device 1 based on the obtained status. Hearing aid device 1 performs output processing to adjust and output external sounds according to the input instructions, or stops the execution of output processing. By coordinating with external device 2, hearing aid device 1 can turn on the hearing aid function when there is a high need for hearing assistance, and can turn off the hearing aid function when there is a low need for hearing assistance, allowing it to operate in a power-saving manner.

[0068] The above is a description of exemplary embodiments of the present disclosure. Embodiments of the present disclosure are not limited to those described above, and various modifications are possible within the scope of the technical idea of ​​the present disclosure. For example, embodiments of the present application include combinations of embodiments explicitly shown in the specification or obvious embodiments as appropriate.

[0069] If the hearing aid function is unnecessarily turned on by noise or other sounds, not only will the power saving effect be reduced, but there is also a risk that the noise or other sounds will be amplified, causing discomfort to the user. Therefore, for example, in the above embodiment, the condition for transitioning from the normal operating mode to the power saving mode may be added as "the external sound being a human voice that is above the first threshold."

[0070] In this case, the processing unit 10 performs a discrimination process on external sounds that are above a first threshold detected in the detection process. In the discrimination process, the processing unit 10, for example, analyzes the frequency of the external sound to identify a human voice or uses speech recognition to determine if it is a human voice. The processing unit 10 switches from power-saving mode to normal operation mode and turns on the hearing aid function only when it determines that the external sound is a human voice. By preventing the hearing aid function from being turned on unnecessarily, the effect of power saving is improved, and noise and other sounds that are amplified and cause discomfort to the user are avoided.

[0071] The processing unit 10 may perform all of the discrimination process, or it may delegate part of the discrimination process to another device. For example, the processing unit 10 may perform only the process of extracting external sound features necessary for speech recognition, and delegate the remaining discrimination process to a partner device (e.g., external device 2). In this case, the processing load of the processing unit 10 can be reduced, achieving even greater power savings. Furthermore, by having the remaining discrimination process (e.g., speech recognition processing based on features) performed by external device 2, which has higher specifications than hearing assistance device 1, the discrimination accuracy can be improved.

[0072] The processing unit 10 may transition from power-saving mode to normal operation mode and turn on the hearing aid function using the voice wake-up function. A keyword for voice wake-up (for example, "I can't hear") may be pre-registered in the hearing aid device 1, or it may be registered by the user operating the external device 2. The keyword is stored, for example, in the memory unit 12. When the processing unit 10 detects a voice input of the keyword, it transitions from power-saving mode to normal operation mode and turns on the hearing aid function.

[0073] Additionally, a keyword for transitioning from normal operation mode to power-saving mode and turning off the hearing aid function may be registered in the hearing aid device 1. When the processing unit 10 detects the voice input of this keyword, it transitions from normal operation mode to power-saving mode and turns off the hearing aid function.

[0074] External device 2 may perform a voice wake-up. In this case, when the user whispers a keyword for voice wake-up, external device 2 sends a command to hearing aid device 1. Upon receiving this command, hearing aid device 1 transitions from power-saving mode to normal operation mode and turns on the hearing aid function. [Explanation of Symbols]

[0075] 1: Hearing assistance device, 10: Processing unit, 12A: Power control program, 30: Battery

Claims

1. Equipped with a processing unit, The aforementioned processing unit, The system intermittently performs a detection process to detect the level of incoming external sound. If the external sound at a level equal to or higher than the first level is detected in n consecutive (n is a natural number greater than or equal to 2) detection processes performed intermittently, an output process is executed to adjust the input external sound and output it. electronic equipment.

2. The aforementioned processing unit, The output process is continued until the detection process detects an external sound at or below the second level. The electronic device according to claim 1.

3. The aforementioned processing unit, If the external sound at or below the second level is detected during m consecutive detection processes (where m is a natural number greater than n), the execution of the output process is stopped. The electronic device according to claim 1.

4. The aforementioned processing unit, When transitioning from the first state, where the output processing is not performed, to the second state, where the output processing is performed, the adjusted external sound is faded in. When transitioning from the second state to the first state, the adjusted external sound is faded out. The electronic device according to claim 1.

5. The aforementioned processing unit, Instructions based on a schedule set for the user of the aforementioned electronic device are obtained from an external device. In accordance with the instructions obtained, the output processing is continued during the scheduled time. The electronic device according to claim 1.

6. The aforementioned processing unit, If the total scheduled time exceeds a threshold, a notification recommending charging the electronic device is issued in accordance with instructions received from the external device. The electronic device according to claim 5.

7. An electronic device according to any one of claims 1 to 6, The electronic device comprises an external device that is communicatively connected to the aforementioned electronic device, The aforementioned external device is Obtain the user status of the aforementioned electronic device, Based on the acquired status, an instruction is output to the electronic device. The electronic device executes or stops the output process in accordance with the input instructions. system.

8. On the computer, The system intermittently executes a detection process to detect the level of incoming external sound. If the external sound at a level equal to or higher than the first level is detected in n consecutive (n is a natural number greater than or equal to 2) detection processes performed intermittently, an output process is executed to adjust the input external sound and output it. method.

9. On the computer, The system intermittently executes a detection process to detect the level of incoming external sound. If the external sound at a level equal to or higher than the first level is detected in n consecutive (n is a natural number greater than or equal to 2) detection processes performed intermittently, an output process is executed to adjust the input external sound and output it. program.

Images