Method for operating a hearing aid
The method adjusts tap detection thresholds based on contextual notifications and user response time to enhance the reliability of tap controls in hearing devices, reducing errors and improving user interaction.
Patent Information
- Authority / Receiving Office
- EP · EP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2024-01-31
- Publication Date
- 2026-03-04
AI Technical Summary
Existing tap control methods for hearing devices are prone to false-positive and false-negative detection errors due to user variability and unfamiliarity, particularly affecting older users and those with motor impairments.
A method that adjusts the tap detection threshold based on contextual notifications and user response time, using a wireless connection between a hearing aid and an electronic device to reduce the likelihood of false positives and negatives by temporarily lowering the detection threshold after a user movement is detected within a predefined time frame.
Enhances the reliability of tap control by minimizing false-positive and false-negative detections, improving user interaction with hearing devices by reducing errors in recognizing intentional taps.
Smart Images

Figure IMGF0001 
Figure IMGF0002 
Figure IMGF0003
Abstract
Description
[0001] The invention relates to a method for operating a hearing device, comprising a hearing aid and an electronic device coupled thereto via a signal transmission system, wherein the hearing aid has a tap detection feature for detecting a tapping movement of a hearing aid user on a hearing aid housing. The invention further relates to a hearing device for carrying out the method.
[0002] A hearing aid is generally defined as an electronic device that supports the hearing ability of a person wearing the hearing aid (hereinafter referred to as the "wearer" or "(hearing aid) user"). In particular, the invention relates to a hearing aid designed to fully or partially compensate for the hearing loss of a hearing-impaired user. Such a hearing aid is also referred to as a "hearing aid." In addition, there are hearing aids that protect or improve the hearing ability of users with normal hearing, for example, by enabling improved speech understanding in complex listening situations. Such devices are also referred to as "Personal Sound Amplification Products" (PSAPs). Finally, the term "hearing aid," as used here, also includes headphones worn on or in the ear (wired or wireless, and with or without active noise cancellation), headsets, etc.
[0003] Hearing aids in general, and hearing assistance devices in particular, are usually designed to be worn on the head, specifically in or on one of the user's ears, particularly as behind-the-ear (BTE) or in-the-ear (ITE) devices. With regard to their internal structure, hearing aids typically have at least one output transducer that converts an input audio signal into a signal perceptible to the user as sound, and then outputs this signal to the user.
[0004] In most cases, the output transducer is an electro-acoustic transducer that converts the (electrical) output audio signal into sound waves, which are then delivered into the user's ear canal. In a behind-the-ear (BTE) hearing aid, the output transducer, also known as the receiver, is usually integrated outside the ear within the hearing aid housing. In this case, the sound emitted by the output transducer is guided into the user's ear canal via a sound tube. Alternatively, the output transducer can also be located within the ear canal, and thus outside the BTE housing. Such hearing aids are also known as RIC devices (Receiver-In-Channel).Hearing aids worn in the ear, which are so small that they do not protrude beyond the ear canal, are also called CIC devices (after the English term "Completely in Canal").
[0005] In other designs, the output transducer can also be an electromechanical transducer that converts the output audio signal into structure-borne sound (vibrations), which is then transmitted, for example, into the user's skull bone. Furthermore, there are implantable hearing aids, particularly cochlear implants, and hearing aids whose output transducers directly stimulate the user's auditory nerve.
[0006] In addition to the output transducer, a hearing aid often has at least one (acousto-electrical) input transducer. During operation, the input transducer(s) pick up sound waves from the surrounding environment and convert these into an input audio signal (i.e., an electrical signal that carries information about the ambient sound). This input audio signal—also referred to as the "received sound signal"—is typically output to the user in its original or processed form, for example, to implement a transparency mode in headphones, for active noise cancellation, or—in the case of a hearing aid—to enhance the user's perception of sound.
[0007] Furthermore, a hearing aid often includes a signal processing unit (signal processor). In the signal processing unit, the input audio signal(s) are processed (i.e., modified with respect to their sound information). The signal processing unit then outputs a correspondingly processed audio signal (also referred to as the "output audio signal" or "modified sound signal") to the output converter and / or to an external device.
[0008] The term "hearing device" or "hearing system" refers to a single device or a group of devices and, if applicable, non-physical functional units that together provide functions for the user. In its simplest form, a hearing device can consist of a single hearing aid. Alternatively, it can comprise two working hearing aids to provide sound to both of the user's ears. In this case, it is referred to as a "binaural hearing system" or "binaural hearing aid."
[0009] Additionally or alternatively, the hearing device may include at least one other electronic peripheral device, such as a remote control, a charger, or a programmer for the hearing aid(s). Modern hearing systems often use a control program, particularly in the form of an app (hereinafter referred to as the "operating app"), instead of a remote control or a dedicated programmer. This control program is designed for implementation on an external computer, especially a smartphone or tablet. The external computer is not typically part of the hearing aid itself, as it is usually provided independently of the hearing aid and not by the hearing aid manufacturer.
[0010] To simplify the operation of such a hearing aid, it is sometimes provided that the user can control one or more functions of the hearing aid or an external functional unit (i.e., a peripheral device or a control app) by interacting with the hearing aid. Typical examples of such functions are accepting and ending a telephone call received on the external functional unit.
[0011] Among other things, US patent 10,959,008 B2 discloses a method for operating a hearing aid worn in or on the ear of a user and a hearing device with such a hearing aid, in which the user can trigger functions of the hearing aid or a connected smartphone, such as changing the volume of the output signal, switching between hearing programs of the hearing device, or answering and ending telephone calls, by means of a tap control, namely by a single or multiple tap of the finger on the hearing aid, the ear, or the head. An accelerometer detects the acceleration acting on the hearing aid. A tap event is recognized when the detected acceleration meets certain predefined criteria.
[0012] In practice, however, the use of such gesture or tap controls often proves to be prone to errors. This is partly because many users find it difficult to adapt to this control method, which is largely unfamiliar in their daily lives; this applies particularly to older users, users with motor impairments, and users with little or no experience using the input devices of modern electronic devices (computer mouse, touchscreen, etc.). Furthermore, it has been shown that the intuitive tapping behavior of different users varies considerably. A highly complex problem in implementing conventional tap controls is therefore distinguishing between genuine tap events, which are consciously initiated by the user to trigger a function, and interfering events such as involuntary touches and other vibrations.Negative detection errors, where a deliberate typing event is not recognized by the typing control system, and positive detection errors, where a disruptive event is incorrectly identified as a typing event, are in an unfavorable relationship. The more unspecific the criteria for detecting a typing event, the more reliably genuine typing events are detected, but the greater the probability of positive detection errors. Conversely, the probability of negative detection errors increases the more specific the criteria for detecting a typing event are.
[0013] A technical problem with tap control for hearing devices is therefore the reliable recognition of a tapping or tapping gesture and the correct assignment of meaning (e.g. whether the user wants to accept an incoming telephone call or is just scratching their head).
[0014] US Patent 2020 / 314521 A1 describes a hearing aid configured to adjust the sensitivity of its touch detection based on context. A context for the hearing aid can be determined based on the sound received by the hearing aid (e.g., a noisy environment) or a wireless communication signal received by the hearing aid from an external device (e.g., receiving a notification that a call is coming in), and the hearing aid's sensitivity threshold is adjusted accordingly. A tap on the hearing aid is detected based on the adjusted sensitivity threshold, and a setting of the hearing aid is changed (e.g., the volume is decreased based on a tap), or instructions are sent to the external device based on the tap detection.
[0015] US Patent 2010 / 040239 A1 discloses a method for changing at least two parameter settings of a device. According to the method, an abnormal change in an external feedback path and an input signal generated by an abnormal pressure wave are detected, and subsequently a pressure wave detection switch and an abnormal feedback path detection switch are activated to change at least one parameter setting in the device.
[0016] The invention is based on the objective of providing a particularly suitable method for operating a hearing device. In particular, a highly reliable tap control is to be implemented, which minimizes the probability of false-positive as well as false-negative results as much as possible. The invention is further based on the objective of providing a particularly suitable hearing device.
[0017] With regard to the method, the problem is solved according to the invention by the features of claim 1, and with regard to the hearing device by the features of claim 9. Advantageous embodiments and further developments are the subject of the dependent claims. The advantages and embodiments mentioned with regard to the method are also transferable to the hearing device and vice versa.
[0018] If the following process steps are described, advantageous designs for the hearing device result in particular from the fact that it is designed to perform one or more of these process steps.
[0019] The invention relates to an operating method for a hearing device or hearing system that can be exposed to contexts that are not directly triggered by the user (e.g., an incoming telephone call, a reminder of a planned task).
[0020] The hearing device includes at least a hearing aid and an electronic device, in particular a peripheral device, that is coupled to it via a signal.
[0021] The hearing aid is, for example, a hearing aid device, such as a back-to-ear (BTE) hearing aid, which is worn on one ear of the user. The hearing aid has a housing that contains, for example, an input transducer, a signal processing unit, and an output transducer. The hearing aid also features tap detection, i.e., a device for detecting or recording a tap movement or gesture by the user, which is specifically linked to the signal processing unit. Tap detection can also be implemented as part of the signal processing or as software that processes suitable sensor signals and generates corresponding control signals.
[0022] The signal connection between the hearing aid and the electronic device is preferably wireless. A wireless communication link, such as a radio link, in particular a Wi-Fi, RFID, or Bluetooth connection, is established between the devices. For this purpose, the hearing aid and the electronic device have corresponding transceivers for data and signal exchange.
[0023] The electronic device is, for example, a mobile operating and display device, in particular a mobile computer, preferably a smartphone or a tablet (computer). The electronic device has a number of different functions that can be triggered by touch detection. This means that corresponding control commands for triggering or operating the device functions are transmitted via the transceivers or the signal coupling when the touch detection system detects a touch movement. The device functions can be activated by embedded application software (operating software), which implements the transmitted control commands. The application software is preferably installed on the electronic device as a so-called app or mobile app (smartphone app).
[0024] The hearing aid's tap detection has a predefined detection threshold. This threshold represents a sensitivity, also known as a function activation sensitivity, which establishes a certain minimum level of subtlety to distinguish a tap from other movements or touches of the hearing aid. The detection threshold thus serves primarily to differentiate an intentional tap by the user from other touches of the device housing with a sufficient probability. The specific probability considered sufficient and its precise magnitude are initially irrelevant. This can be determined, for example, from past usage data or from relevant trials and tests.Different detection thresholds may be defined for different users, operating and environmental conditions, or application scenarios. A touch of the device housing is thus recognized as a tapping motion when the detection threshold is reached or exceeded.
[0025] If an event occurs with the electronic device that is not directly attributable to an action by the hearing aid user (e.g., an incoming call, a device alarm / wake-up call, a calendar notification, etc.), the electronic device will, as per the procedure, transmit a notification about the event to the hearing aid user. The detection threshold will then be reduced if the user's body movement is detected within a predefined response time after the notification. This provides a particularly suitable method for operating a hearing aid.
[0026] The method according to the invention is therefore particularly designed as a user interface method for the hearing device.
[0027] When an event occurs on the electronic device, its current context is determined (e.g., an incoming phone call). Determining or assigning the event to a device function linked by touch recognition (e.g., answering the incoming phone call) corresponds to determining the context. The user is then informed about the event or its context. The notification used can be visual (e.g., a display on the device's screen), audible (e.g., a notification / ringtone), and / or haptic (e.g., vibration). The conjunction "and / or" here and in the following text is to be understood as meaning that the features linked by this conjunction can be either combined or alternative to each other. A first point in time for the transmission of the notification is recorded according to the procedure.
[0028] As part of the procedure, a second time point is also recorded at the beginning of a body movement by the user. A body movement in this context is understood to mean a movement of a part of the user's body, in particular a movement of an arm or hand towards the hearing aid or ear.
[0029] The recorded times described above are used to determine, for example, whether the user raised their hand before or after receiving notification of the device event (e.g., an incoming call). This information is used to infer whether the intention to tap is considered likely or unlikely. In the case of a likely tap, the detection threshold is set to a lower value than in the case of an unlikely tap. The probability measure used is, in particular, the time between the first time point (notification) and the second time point (start of body movement), also referred to as the reaction time. This simplifies triggering or activating the device function (e.g., answering an incoming phone call) using tap detection.In particular, this reliably reduces the probability of a false-negative tip detection, i.e., a tip movement that is incorrectly not detected.
[0030] In the following, an "event of the electronic device" or "context" is understood to mean any event or situation that fulfills the following conditions. Firstly, the event is not triggered directly or immediately by the user; this means that, for example, the user feels as if the request is coming from the hearing aid. Secondly, the event requires user interaction (or a response), or the user interaction is at least optional (e.g., an incoming call can be answered, but does not necessarily have to be). Furthermore, there is preferably a sufficiently intuitive logical connection between the nature of the context and the user interaction / action (e.g., a tap gesture means answering a call). What constitutes a sufficient logical connection and how strong the connection actually is are initially irrelevant.This can be determined, for example, from past usage data or from relevant trials or tests. Different relationships may be defined for different users, operating and environmental conditions, or events. Additionally, at least one characteristic of the context or event should be transmittable to the user as a notification. For example, the notification can be communicated to the user via a speaker in the hearing device (e.g., a speech-synthesized message "incoming call from" or a ringtone).
[0031] The following are examples, not exhaustive, of an electronic device event in the form of a current context and a related device function that can be triggered by tap recognition: an incoming phone call and answering the call, an ongoing phone call and ending the call, a scheduled reminder from a calendar app that is confirmed and muted by a tap gesture, an offer for a health exercise (e.g., a breathing exercise) that initiates the suggested exercise, or a notification about a current physiological parameter and muting the notification.
[0032] A tap or tap gesture is understood to mean, in particular, a touching or at least an approach to the hearing aid housing with a hand of the user, for example, a swipe across the surface of the device housing, a predefined hand gesture near the hearing aid, or a generic tapping gesture on the device housing with a finger, which can be a single tap or multiple taps. How the tap movement is detected by the hearing aid or the tap detection system is not essential to the invention. Various tap detection systems from the prior art are familiar to those skilled in the art. The tap movement can, for example, be detected by a motion or acceleration sensor integrated into the hearing aid, i.e., an IMU-based sensor (IMU: Inertial Measurement Unit), where the detection threshold is a motion or acceleration threshold.Alternatively, tap detection can also be microphone-based. For this, the hearing aid has at least one acousto-electrical input transducer (microphone), whereby the recorded input signal is analyzed for tapping sounds (e.g., using a classifier), and the detection threshold is, for example, a tapping sound level / volume. A capacitive touch button on the device housing, which capacitively detects the tapping motion and compares it with a corresponding threshold, is also conceivable.
[0033] Additionally, a measure of the probability of a registered tap can be derived from at least one characteristic of the tap. Examples of these tap characteristics include the pressure of the tap, the time difference between taps in a multi-tap gesture, and the duration of the gesture. This probability can then be taken into account during the threshold comparison.
[0034] In a preferred embodiment, the detection threshold is only temporarily reduced, i.e., for a specific duration, if a user movement is detected within the reaction time. This duration is subsequently referred to as the execution time. This ensures that the threshold for detecting a tap movement is not permanently reduced, thus avoiding the probability of false positives, where an unwanted detection occurs. According to this embodiment, the sensitivity of the tap detection is therefore only increased for a certain time window.
[0035] The execution time begins at the second point in time (start of body movement) and ends at a third point in time. The third point in time is determined either by touching or tapping the device housing, or (if no touch occurs) by a predefined third point in time.
[0036] At the first point in time, the user receives a notification about the current context. This can be the start or end of the notification, or any point in between. At the second point in time, the start of a body movement by the user is registered (e.g., the user raises their arm). At the third point in time, the tap gesture is specifically registered.
[0037] In a suitable configuration, the reaction time, i.e., the time between notification and the start of body movement, is set between 100 ms (milliseconds) and 1000 ms. This means that if the start of body movement is detected within a time window of 100 ms to 1000 ms after notification, the detection threshold for the execution time is reduced.
[0038] A suitable execution time between 200 ms and 2000 ms is used. In other words, the detection threshold is reduced for a maximum of 1800 ms starting 200 ms after the body movement begins. If no contact with the device housing occurs or no tap is detected by the tap detection system within 2000 ms after the start of the body movement, the detection threshold is reset to its initial value or raised. If a tap is detected as a third event within the time window between 200 ms and 2000 ms after the start of the body movement, the detection threshold can then be raised back to its initial value.
[0039] This means that the default value for the sensitivity threshold of a function activation is preferably defined for a case in which the first time point is 100 ms to 1000 ms before the second time point, and the third time point is 200 ms to 2000 ms after the second time point.
[0040] Based on these standard values or this standard scenario, a case distinction can be made so that several different detection thresholds can be set for the user interface method according to the invention, depending on the case. This allows the probability of false positives as well as false negatives to be minimized. In a suitable further development, three different detection thresholds are defined for this purpose. In other words, a high, a medium, and a low detection threshold are defined. At a high detection threshold, the sensitivity of the tap detection is temporarily reduced, thus reducing the probability of false positive tap detections. Correspondingly, at the low detection threshold, the sensitivity is increased in order to reduce, in particular, the probability of false negative tap detections.The average detection threshold corresponds to a standard sensitivity. These thresholds or sensitivity levels are determined, for example, from past wear data or from relevant trials or tests.
[0041] If a body movement of the hearing aid user is detected within the reaction time, the low detection threshold is set according to procedure.
[0042] The mean detection threshold is appropriately set when body movement is detected before the reaction time and / or when contact with the hearing aid housing is detected before the execution time. In other words, the function activation sensitivity threshold is set to the mean value when the second time point is earlier than the first compared to the standard scenario, and / or when the third time point is earlier than the second compared to the standard scenario. Since the mean sensitivity threshold is specifically the default value, this means that in these cases the sensitivity threshold is not changed (increased / decreased).
[0043] The high detection threshold is preferably set when an intentional tap or tap trigger is unlikely. This is measured, for example, by detecting body movement before the notification is sent and / or touching the device casing before detecting body movement. In other words, the sensitivity threshold for a function activation is set to the highest value if the second time point precedes the first time point and / or if the third time point precedes the second time point. Consequently, a tap gesture will not trigger a function activation in response to a current context if the user's appendage began moving before the user received a notification about that context.
[0044] An additional aspect here is the ability to define and store an ideal response time and an ideal execution time. These ideal times can be determined specifically for a given user, for example, through test measurements. Alternatively, the ideal times can be determined from statistical measurements. The closer the determined times (first, second, third time) are to the ideal response time or the ideal execution time, the lower the sensitivity threshold for function activation is set, as the probability of a desired or intended tap trigger is higher. In other words, depending on the ideal times or deviations from them, a smooth transition between the different detection thresholds can be implemented.
[0045] A user's body movement is understood to mean, in particular, an arm or hand movement towards the ear or the hearing aid. Various methods for determining or detecting the initiation of such a movement are familiar to those skilled in the art. For example, the initiation of such a body movement can be detected using EEG (electroencephalography), by placing electrodes on the surface of the hearing aid housing to detect the intention, planning, or execution of an arm movement based on corresponding characteristic currents. Sound-based motion detection using the hearing aid's input transducers or microphones is also conceivable, where sounds emanating from the user's joints or clothing indicate movement.Such acoustic motion detection methods are known, for example, from CN 112656403 A, US 10062373 B2, JP 5495415 B2, CN 112806981 B, US 9610042 B1, AT 513434 B1, KR 101160227 B1, US 11417307 B2, or US 20150038850 A1. Alternatively, EMG-based motion detection is also possible, for example, using an electromyography sensor attached to the user's body.
[0046] Furthermore, IMU-based tracking is also possible using a motion sensor (accelerometer, gyroscope) in the hearing aid, or an inertial measurement unit worn on or attached to the body or clothing (e.g., a wristband or IMU sensors that detect head rotation to the contralateral side to ensure the correct side of the head faces the ipsilateral hand). Optical or video-based motion detection is also conceivable, for example, using a camera on the electronic device or an external camera.
[0047] In a preferred embodiment, the user's body movement, in particular the beginning of the body movement, is detected by a feedback canceller of the hearing aid.
[0048] Feedback, in this context, refers to an amplified sound from the hearing aid, which is picked up by the hearing aid's microphone and then passed back through the hearing aid. If the amplification is high enough, the signal passing through the feedback loop becomes increasingly louder, eventually resulting in the high-pitched whistling sound.
[0049] A feedback reducer is a component of the hearing aid that reduces or minimizes this feedback effect. For example, an adaptive filter is used to model the feedback path. The output signal of the adaptive filter is subtracted from the microphone signal to cancel out the acoustic and mechanical feedback picked up by the microphone, thus allowing more amplification in the hearing aid.
[0050] A hand moved towards the hearing aid acts as a sound reflection surface and, upon approach or contact, alters the feedback path in the hearing aid or hearing aid housing.
[0051] The use of the feedback reducer for body movement detection enables particularly reliable detection of relevant body movements. Specifically, this means that essentially only body movements in the immediate vicinity of the hearing aid are detected, thereby improving the accuracy of the method according to the invention. The feedback reducer can also be used analogously as a touch sensor or tap sensor to detect tapping movements or gestures.
[0052] The hearing device according to the invention comprises a hearing aid and an electronic device coupled to it via a signal connection. The electronic device, designed, for example, as a smartphone, has a number of different device functions which can be triggered by a tap detection of the hearing aid.
[0053] The hearing aid is primarily intended to provide hearing assistance to a user with hearing loss. The hearing aid is designed to receive sound signals from the environment and output them to the user. For this purpose, the hearing aid has at least one acousto-electrical input transducer, in particular a microphone, and at least one electro-acoustic output transducer, for example, a receiver. During operation, the input transducer receives sound signals (noises, tones, speech, etc.) from the environment and converts them into an electrical input signal (acoustic data). An electrical output signal is generated from the electrical input signal by modifying it in a signal processing unit. This signal processing unit is, for example, a component of the hearing aid.The signal processing unit includes, for example, an (output) amplifier for (selectively) amplifying the input signal or for adjusting the signal level of the output signal. The output converter generates an acoustic sound signal from the output signal. The input converter and the output converter, as well as the signal processing unit if applicable, are housed in a hearing aid casing. The casing is designed so that it can be worn by the user on the head and near the ear, e.g., in the ear, on the ear, or behind the ear. Preferably, the hearing aid is designed as a back-to-the-ear (BTE) hearing aid, an in-the-ear (ITO) hearing aid, or a receiver-in-canal (RIC) hearing aid.
[0054] The hearing aid or signal processing system features tap detection to recognize a user's tapping motion on the hearing aid housing, and a motion sensor to detect the user's body movement. The hearing aid also includes a controller (i.e., a control unit) to carry out the procedure described above.
[0055] The controller is generally configured – programmatically and / or circuit-wise – to carry out the method described above according to the invention. Specifically, the controller is configured to detect and / or monitor a first time for notification, a second time for the start of a body movement, and, for example, a third time for the detection of a tap. Furthermore, the controller is configured to change a tap detection threshold depending on these times.
[0056] In a preferred embodiment, the controller is formed, at least in its core, by a microcontroller comprising a processor and a data memory. The functionality for carrying out the method according to the invention is implemented programmatically in the form of operating software (firmware), so that the method is executed automatically in the microcontroller when the operating software is run—optionally in interaction with the user. Alternatively, within the scope of the invention, the controller can also be formed by a non-programmable electronic component, such as an application-specific integrated circuit (ASIC) or an FPGA (field-programmable gate array), in which the functionality for carrying out the method according to the invention is implemented by circuitry.
[0057] In a preferred embodiment, the motion sensor of the hearing aid is designed as a feedback reducer.
[0058] Exemplary embodiments of the invention are explained in more detail below with reference to a drawing. The drawing shows, in schematic and simplified representations: Fig. 1 a hearing device with a hearing aid and with an electronic device, Fig. 2 a flowchart of a method according to the invention, and Fig. 3 a process sequence in successive representations.
[0059] Corresponding parts and sizes are always marked with the same reference symbols in all figures.
[0060] The Figure 1 Figure 2 shows a simplified and schematic representation of the basic structure of a hearing device.
[0061] The hearing device 2 is specifically designed as a hearing aid device in the form of a hearing system comprising a hearing aid 4 and an external electronic (additional) device 6 in the form of a display and control unit. The hearing aid 4 is, for example, designed as a behind-the-ear (BTE) hearing aid. The hearing aid 4 and the device 6 are interconnected by means of a wireless communication link 8. The communication link 8 is preferably a radio link, for example, a Bluetooth or RFID link.
[0062] The hearing aid 4 includes, as described in the Figure 1 The schematic representation shows a (listening) device housing 10 into which one or more microphones 12, also referred to as acousto-electrical (input) transducers, are installed. The microphones 22 pick up sound or acoustic signals in the environment and convert them into an electrical audio signal.
[0063] The audio signal is processed by a signal processing unit 14, which is also located in the device housing 10. Based on the audio signal, the signal processing unit 14 generates an output signal, which is transmitted to a loudspeaker or receiver 16. The receiver 16 is designed as an electro-acoustic (output) transducer, which converts the electrical output signal into an acoustic signal and outputs it. In the case of the behind-the-ear (BTE) hearing aid 4, the acoustic signal is transmitted to the eardrum of the hearing aid user, possibly via a sound tube (not shown) or an external receiver with an earmold that sits in the ear canal. However, an electromechanical transducer is also conceivable as the receiver 16, as is the case, for example, with a bone conduction receiver.
[0064] The hearing aid 4 and in particular the signal processing unit 14 is powered by a battery 18 housed in the device housing 10.
[0065] The signal processing unit 14 is coupled to a motion sensor 20 of the hearing aid 4. The motion sensor 20 is specifically designed and configured to detect body movements of the (hearing aid) user. The motion sensor 20 is designed and configured to detect the approach of a body part 21, in particular a hand or finger, to the hearing aid 4, as well as any contact with the hearing aid 4 or the device housing 10.
[0066] The motion sensor 30 is configured, for example, as an accelerometer and / or as a gyroscope, i.e., as a gyroscopic (position) sensor. Alternatively, the motion sensor 30 can also be a light sensor for detecting light signals in the vicinity of the hearing aid 16, or a pulse or blood pressure sensor for detecting changes in the pulse or blood pressure of the hearing aid user 10. A motion sensor 30 that combines an accelerometer and / or gyroscope and / or pulse sensor and / or blood pressure sensor and / or light sensor is also possible. The motion sensor 20 is preferably configured as a feedback reducer, which, during signal processing, also suppresses or reduces acoustic feedback between the receiver 16 and the microphones 22.
[0067] The signal processing unit 14 is connected to a transceiver 22 of the hearing aid 4. The transceiver 22 serves to send and receive wireless signals via the communication link 8. The transceiver 22 can, for example, be designed as an induction coil.
[0068] In the exemplary embodiment of the Figure 1 A separate, mobile, electronic device 6 is connected to the hearing aid 4 via a communication link 8. The device 6, shown schematically, is in particular a smartphone. The smartphone 6 has a touch-sensitive display unit (screen, display) 24, which is also referred to as a touchscreen. The smartphone 6 also has at least one speaker 26 for emitting acoustic signals.
[0069] The signal coupling between the smartphone 6 and the transceiver 22 of the hearing aid 4 is carried out via a corresponding - not further specified - integrated transceiver, for example a radio or radio antenna, of the smartphone 6.
[0070] The smartphone 6 has an integrated controller, which essentially consists of a microcontroller with implemented application software. The application software is preferably a mobile app or a smartphone app stored in the controller's data memory. During operation, the controller displays the application software on the touchscreen 24, and the application software can be operated by a hearing aid user via the touch-sensitive surface of the touchscreen 24.
[0071] The device 6 or its application software has several integrated device functions which can be triggered or activated by means of the communication link 8 through a tap recognition 28 of the hearing aid 6.
[0072] In this embodiment, for example, the tap detection 28 is part of the signal processing unit 14, which processes the sensor signals of the motion sensor 20 with regard to the detection or recording of a tap movement or tap gesture of the user and generates corresponding control signals, which are transmitted via the transceiver 22 and the communication link 8 to the smartphone 6 to trigger the desired device function.
[0073] The tap detection 28 has a stored detection threshold. A sensor signal from the motion sensor 20 is recognized as a tap movement or tap gesture when the detection threshold is reached or exceeded.
[0074] The following describes a user interface method according to the invention for the hearing device 2 based on the Figure 2 and 3 explained in more detail. Fig. 3 This shows a diagram for an exemplary process flow with three consecutive representations. A time t is plotted along the horizontal direction.
[0075] If an event 30 of the electronic device 6 occurs, which is not directly attributable to an action of the hearing aid user, the procedure is started in a process step 32. In the following, event 30 is, in particular, an incoming telephone call.
[0076] In process step 34, a notification 36 for event 30 is first generated by the smartphone 6 or its app. The notification 36 is displayed, for example, as an icon on the touchscreen 24 and / or emitted audibly as a notification or ringtone via the speaker 26 and / or generated haptically, for example, by means of a vibration alarm. In process step 34, it is further checked whether event 30 is associated with a device function that can be triggered by the touch detection 28. In this example, the answering of the telephone call is specifically intended as a device function.
[0077] Notification 36 is sent or transmitted at an initial time point T1. This can be the time of the start or end of Notification 36, or any time in between.
[0078] Following process step 34, process step 38 monitors whether the start of a user's body movement is detected within a reaction time RT. The start of a body movement, or the start of a body part 21 approaching the hearing aid 4, is characterized by a second time point T2. The reaction time RT begins, for example, 100 ms after time point T1 and ends after 1000 ms. In other words, process step 34 checks whether time point T2 falls within the reaction time RT.
[0079] In the event of a positive comparison result, where the time is within the reaction time RT, i.e., when the beginning of a body movement is detected within the reaction time RT, the recognition threshold of the tap recognition for an execution time AT is set to a reduced value in a process step 40.
[0080] Following process step 40, process step 42 monitors whether a tap movement or tap gesture is detected within the execution time AT. Detection or registration is characterized by a third time point T3. The execution time AT begins, for example, 200 ms after time point T2 and ends after 2000 ms. In other words, process step 42 checks whether time point T3 falls within the execution time AT.
[0081] In the event of a negative comparison result, where no tap movement is detected by the tap recognition 28 within the execution time AT, the recognition threshold is reset to the initial value or raised in a procedure step 44.
[0082] If the comparison result is positive, and time T3 occurs within the execution duration AT, the associated device function (accept call) is triggered or activated in process step 46. Subsequently, in process step 48, the detection threshold is reset to or raised to its initial value.
[0083] Process steps 32, 34, and 46 are performed in particular by the smartphone 6 or the app, while process steps 38, 40, 42, 44, and 48 are performed in particular by an unspecified controller of the hearing aid 4. The controller is, for example, part of the signal processing unit 14.
[0084] The claimed invention is not limited to the embodiments described above. Rather, other variants of the invention can also be derived by a person skilled in the art within the scope of the disclosed claims, without departing from the subject matter of the claimed invention.
[0085] For example, it is conceivable to use case differentiation to switch between several different recognition thresholds depending on the situation, in order to minimize the probability of false-positive or false-negative guess detections. For example, three different recognition thresholds (low, medium, high) are defined.
[0086] If a body movement of the hearing aid user is detected within the reaction time RT, the low detection threshold is set according to the procedure.
[0087] The average detection threshold is set, for example, if body movement is detected before the reaction time (RT) and / or if touching the hearing aid housing is detected before the execution time (AT). In other words, the function activation sensitivity threshold is set to the average value if the second time point (T2) is detected more than 100 ms earlier than the first time point (T1), and / or if the third time point (T3) is detected more than 200 ms earlier than the second time point (T2).
[0088] The high detection threshold is preferably set when body movement is detected before notification 36 is transmitted and / or when the device housing 10 is touched before body movement is detected. In other words, the sensitivity threshold for function activation is set to the highest value when the second time point T2 is before the first time point T1 and / or when the third time point T3 is before the second time point T2. Reference symbol list
[0089] 2 Hearing device 4 Hearing aid 6 Device / Smartphone 8 Communication link 10 Hearing aid housing 12 Microphone 14 Signal processing unit 16 Receiver 18 Battery 20 Motion sensor 21 Body part 22 Transceiver 24 Display unit 26 Speaker 28 Tip detection 30 Event 32 Procedure step 34 Procedure step 36 Notification 38 Procedure step 40 Procedure step 42 Procedure step 44 Procedure step tTime T1, T2, T3Time RTReaction time ATExecution time
Claims
1. Method for operating a hearing device (2) comprising a hearing aid (4) and an electronic device (6) coupled thereto for signal transmission, - wherein the hearing aid (4) has tap detection (28) for detecting a tapping movement of a hearing aid user on a hearing aid housing (10), - wherein the tap detection (28) has a stored detection threshold, and contact with the hearing aid housing (10) is detected as a tapping movement if the detection threshold is reached or exceeded, - wherein the electronic device (6) has a number of different device functions, which can be triggered by the tap detection (28), - wherein, when an event (30) of the electronic device (6) occurs, which does not directly result from an action of the hearing aid user: a) a notification (36) of the event is transmitted from the electronic device (6) to the hearing aid user, and b) the detection threshold is reduced if a bodily movement of the hearing aid user is detected within a stored response time (RT) since the notification (36).
2. Method according to Claim 1, characterized in that the detection threshold is reduced for an execution time (AT) if a bodily movement of the hearing aid user is detected within the response time (RT).
3. Method according to Claim 2, characterized in that the response time (RT) is a time period between 100 ms to 1000 ms.
4. Method according to Claim 2 or 3, characterized in that the execution time (AT) is a time period between 200 ms to 2000 ms.
5. Method according to any of Claims 1 to 4, characterized in that a high detection threshold, a medium detection threshold, and a low detection threshold are stored for the tap detection (28), wherein the low detection threshold is set if a bodily movement of the hearing aid user is detected within the response time (RT).
6. Method according to Claim 5, characterized in that the high detection threshold is set if a bodily movement is detected before the notification (36) is sent and / or if contact with the hearing aid housing (10) occurs before the detection of a bodily movement.
7. Method according to Claim 5 or 6, characterized in that the medium detection threshold is set if a bodily movement is detected in a time period prior to the response time (RT) and / or if contact with the hearing aid housing (10) is detected before the execution time (AT).
8. Method according to any of Claims 1 to 7, characterized in that the bodily movement is detected with a feedback canceller of the hearing aid (4).
9. Hearing device (2), comprising a hearing aid (4) and an electronic device (6) coupled thereto for signal transmission, - wherein the hearing aid has tap detection (28) for detecting a tapping movement of a hearing aid user on a hearing aid housing (10), and a movement sensor (20) for detecting a bodily movement of the hearing aid user, - wherein the electronic device (6) has a number of different device functions, which can be triggered by the tap detection (28), and - wherein the hearing aid (4) has a controller designed to carry out a method according to any of Claims 1 to 8.
10. Hearing device (2) according to Claim 9, characterized in that the movement sensor (20) is a feedback canceller.
Citation Information
Patent Citations
Diagnostic device and procedure for assessing joints
AT513434B1
Detection device and detection method for bone joint damage information
CN112656403A
A type of knee joint health management fitness pants
CN112806981B
Sheet cover receiver for truck
JP1979095415A
The apparatus for diagnosing non-invasive articular pathology using joint sound analysis and method therefor
KR101160227B1