Method for operating a binaural hearing aid system and binaural hearing aid system
The binaural hearing device system improves music reproduction by determining music source location and stereo characteristics in the front half-space, reducing misinterpretation and enhancing the listening experience by accurately adapting signal processing for conscious music listening scenarios.
Patent Information
- Application Number
- EP2023154327
- Authority / Receiving Office
- EP · EP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-02-18
- Filing Date
- 2023-01-31
- Publication Date
- 2024-11-27
- Estimated Expiration
- 2043-01-31
AI Technical Summary
Binaural hearing devices often misinterpret music presence, leading to incorrect signal processing that can impair language understanding by mistakenly switching to music settings even when the user is not consciously listening.
A method for a binaural hearing device system that determines the presence of music sources in the front half-space and assesses their stereo characteristics to increase the probability of conscious music listening, thereby adapting signal processing for more accurate music reproduction while minimizing interference with speech understanding.
This approach reduces the risk of incorrect signal processing and enhances the natural reproduction of music, ensuring that signal processing is more reliable and less prone to errors, thereby improving the overall listening experience.
Smart Images

Figure IMGF0001 
Figure IMGF0002
Abstract
Description
[0001] The invention relates to a method for operating a binaural hearing aid system. Furthermore, the invention relates to such a binaural hearing aid system.
[0002] Hearing aids typically serve to output an audio signal to the hearing of the wearer. The output is transmitted via an output transducer, usually acoustically via airborne sound using a loudspeaker (also referred to as a "receiver" or "earpiece"). Such hearing aids are often used as so-called hearing aids (also referred to as hearing aids for short). For this purpose, the hearing aids typically comprise an acoustic input transducer (in particular a microphone) and a signal processor configured to process the input signal (also called a microphone signal) generated by the input transducer from the ambient sound using at least one signal processing algorithm, usually stored for the specific user, in such a way that any hearing loss of the hearing aid wearer is at least partially compensated.Particularly in the case of a hearing aid, the output transducer can be a loudspeaker, a bone conduction hearing aid, or a cochlear implant, which are designed to mechanically or electrically couple the audio signal into the wearer's ear. The term "hearing aid" also includes devices such as tinnitus maskers, headsets, headphones, and the like.
[0003] Typical designs of hearing aids, especially hearing aids, are behind-the-ear ("BTE") and in-the-ear ("ITE" or "ITE") hearing aids. These terms refer to the intended wearing position. Behind-the-ear hearing aids have a (main) housing that is worn behind the ear. A distinction can be made between models with a speaker located within this housing. Sound is usually delivered to the ear via a sound tube worn in the ear canal, and models with an external speaker placed in the ear canal. In-the-ear hearing aids, on the other hand, have a housing that is worn in the ear canal or even completely within the ear canal.
[0004] Depending on the hearing loss, either a monaural or binaural hearing aid may be appropriate. The former is usually the case when only one ear has a hearing loss, while the latter is usually the case when both ears have a hearing loss. With a binaural hearing aid, data is exchanged between the two hearing aids assigned to the user's ears to provide more acoustic information and thus make the hearing experience even more pleasant, and preferably more realistic, for the user.
[0005] In addition, a so-called classifier is often used, which is designed to recognize specific listening situations – e.g., a conversation in quiet, a conversation with background noise, music, quiet, driving, and the like – usually using pattern recognition, artificial intelligence, and the like. Based on these listening situations, the signal processing can be adapted to improve the listening experience for the respective listening situation. For example, for conversations with background noise, a comparatively narrow directivity can be specified and noise suppression can be applied. However, this is less useful for music, as the widest possible directivity or omnidirectionality, as well as low or deactivated noise suppression, are advantageous in order to "lose" as little acoustic information as possible.
[0006] However, especially in the case of music, a misinterpretation of the classifier - namely, if music is present but the user is not listening to it or does not want to listen to it - can have a negative impact on speech comprehension and the like.
[0007] While traditional hearing aids were referred to as "hearing programs" that have relatively fixed sets of parameters, modern hearing aids usually use a step-by-step adjustment of the individual parameters to enable intermediate stages between two listening situations, a smooth transition between different settings, or the like.
[0008] For example, EP 3 684 075 A1 describes a hearing aid that, in addition to a microphone and a processor, also includes an acceleration sensor. The microphone records an audio signal. The acceleration sensor outputs acceleration data that is connected to the hearing aid. The processor is configured to identify a musical feature of the audio signal that indicates that the audio signal contains musical content, identify a motion feature of the acceleration sensor data that represents a movement of the user while the microphone is capturing the audio signal, determine a similarity measure between the musical feature and the motion feature, and, based on the similarity measure, perform an operation with respect to a sound processing program executable by the processor.
[0009] US 2004 / 175008 A1 describes how a hearing aid evaluates acoustic signals from the acoustic environment and determines their arrival direction. A histogram is created from the signals indicating such an arrival direction. The behavior of such a histogram is classified according to various aspects or criteria, and depending on the classification results, the hearing aid, and thus in particular its signal transmission characteristics from acoustic input signals to mechanical output signals, is controlled or adjusted.
[0010] EP 1 858 291 A1 describes a method for operating a hearing system comprising an input unit, an output unit, and a transmission unit that functionally connects the input unit and the output unit. The transmission unit implements a transfer function that describes how audio signals generated by the input unit are processed to derive audio signals that are fed to the output unit and can be adjusted by one or more transfer function parameters.The method comprises obtaining, by means of the input unit and having a first directional characteristic, first audio signals from incoming acoustic sound; deriving a first set of sound-characterizing data from the first audio signals; and deriving a value for each of the one or more transfer function parameters depending on the first directional information, which is data containing information about the first directional characteristic, and on the first set of sound-characterizing data. This enables insight into the acoustic environment and better automatic adjustment of the transfer function.
[0011] WO 2021 / 023667 A1 describes a system and a corresponding method for supporting selective hearing. The system comprises a detector for detecting an audio source signal component from one or more audio sources using at least two received microphone signals from a listening environment. Furthermore, the system comprises a position determiner for assigning position information to each of the one or more audio sources. Furthermore, the system comprises an audio type classifier for assigning an audio signal type to the audio source signal component of each of the one or more audio sources.The system further comprises a signal component modifier for changing the audio source signal component of at least one of the one or more audio sources depending on the audio signal type of the audio source signal component of the at least one audio source, in order to obtain a modified audio signal component of the at least one audio source. The system further comprises a signal generator for generating a plurality of binaural room impulse responses for each audio source of the one or more audio sources depending on the position information of this audio source and an orientation of a user's head, and for generating at least two loudspeaker signals depending on the plurality of binaural room impulse responses and depending on the modified audio signal component of the at least one audio source. Furthermore, a device and a corresponding method for determining one or more room acoustic parameters are provided.The device is configured to receive microphone data comprising one or more microphone signals. Furthermore, the device is configured to receive tracking data relating to a user's position and / or orientation. Furthermore, the device is configured to determine the one or more room acoustic parameters based on the microphone data and the tracking data.
[0012] The invention is based on the object of further improving the comfort of use of a hearing aid system.
[0013] This object is achieved according to the invention by a method having the features of claim 1. Furthermore, this object is achieved according to the invention by a hearing device system having the features of claim 11. Advantageous and partly inventive embodiments and further developments of the invention are set out in the subclaims and the following description.
[0014] The method according to the invention serves to operate a binaural hearing aid system. The latter has a hearing aid assigned or to be assigned to a left ear and a right ear of a user (during intended operation). Each of the hearing aids in turn has at least one microphone. Within the scope of the method (i.e. in particular during intended operation), acoustic information is collected by means of the two hearing aids and the acoustic information (in particular in the form of ambient noise, preferably in the form of electronic signals representing the ambient noise) is evaluated to determine whether it contains music. In addition, it is determined whether two (in particular spatially separate) sources can be detected for the music (i.e. if the presence of music is detected).Furthermore, a spatial angle range is determined in relation to the user's line of sight, in which the respective music source is positioned. If the respective spatial angle range of the two music sources lies in a front half-space with respect to the line of sight, a probability (specifically, a probability value) is increased that a situation of conscious music listening by the user exists. If a predefined probability threshold is exceeded (i.e., in the case of conscious music listening), signal processing for both hearing aids is adjusted to ensure the most natural reproduction of the music possible.
[0015] The user's "gaze direction" refers here and below in particular to the direction in which the user's head is directed, regardless of the actual gaze direction of the eyes. In relation to the medical understanding of body directions, the "gaze direction" here below therefore refers in particular to a (head) direction also referred to as "rostral" (or possibly also "nasal"). This designation is based on the fact that, during intended use (within the scope of anatomical possibilities), the two hearing aids of the binaural hearing aid system are worn approximately symmetrically on the head, with the gaze direction usually corresponding to a direction used for signal processing as the 0-degree direction of the hearing aid system.
[0016] Here and in the following, "solid angle range" is understood to mean, in particular, a comparatively small-angle range, preferably conically open and extending from the user's face and / or the respective hearing aid. This "range" takes into account the fact that the spatial localization of a source is usually associated with comparatively high tolerances, so that an exact position specification is usually not possible. Nevertheless, the term "solid angle range" also covers a vector pointing to the localized source.
[0017] The above-mentioned "anterior hemisphere" is understood here and below in particular as the space spanned rostrally by a frontal plane of the head, preferably positioned at the user's ears. Thus, the anterior hemisphere is the space into which the user "looks."
[0018] Here and below, adjusting signal processing refers in particular to changing parameters that influence the reproduction of captured audio signals (in particular, the microphone signals captured by the respective microphone or signals derived from them). These parameters include, for example, (particularly frequency-dependent) gain factors, settings for so-called compression, filter settings (which serve, for example, for noise suppression), and the like.
[0019] In particular, the information that two sources for the music have been "located"—i.e., recognized—in the front half-space leads to the conclusion, or at least increases the probability, that a stereo presentation of the music is present. Since the "music sources" are located in the front half-space, the user is facing these stereo sources and is thus consciously listening to the music. Thus, the classification result that music is present can advantageously be "refined" to the extent that the user is also consciously listening to the music (at least with a sufficiently high probability). Under these conditions, adjusting the signal processing to improve the reproduction of the music is thus less error-prone and therefore more reliable than simply recognizing that music is present in the ambient noise.In particular, the risk of signal processing mistakenly switching to a music setting even though the user isn't consciously listening to the music can be reduced. Furthermore, this creates the possibility of adjusting the signal processing comparatively strongly (or even to varying degrees or "aggressively" depending on the situation) for music playback. This has been avoided to date due to the potential for misinterpretation, for example, in order not to overly restrict the user's speech comprehension if, despite the classification as music, there is no situation of conscious music listening. The "localization" of music sources in the frontal hemisphere described above thus represents a criterion for increasing the likelihood of conscious music listening and, if necessary, adjusting the signal processing for better music playback.
[0020] Optionally, the probability threshold is specified in such a way that the arrangement of the music sources in the front half-space is sufficient to exceed the probability threshold.
[0021] In a suitable variant of the method, it is determined (preferably additionally) whether the acoustic signals emanating from the two music sources are dissimilar to one another within a framework typical for music, in particular for a stereo presentation of the music, i.e. in particular within predetermined limits. Thus, a stereo presentation of a piece of music regularly contains comparatively similar signal components on both stereo channels, but also comparatively dissimilar ones, in order to convey the stereo impression. If such a difference between the two music sources is detected, a particularly high probability of the presence of a true stereo presentation and, in particular, of conscious listening to this stereo presentation is assumed in this optional variant of the method (in other words, the probability value described above is further increased).In this case, the signal processing can be adapted to the (most natural) reproduction of music in a more "aggressive" manner, i.e., with comparatively stronger negative effects on speech intelligibility or the like, than with the mere presence of two music sources in the front half-space. In an optional further development, the signal processing is only adapted for better (i.e., as natural as possible) reproduction of the music if, as above, a situation with a true stereo presentation is assumed. This determination of whether a true stereo presentation is present therefore preferably represents a refined criterion for adapting the signal processing.
[0022] For example, for the detection of true stereo performance described above, a correlation (in particular a so-called "stereo correlation coefficient") is determined between the acoustic signals assigned to the two music sources, preferably a frequency-dependent correlation (i.e., one carried out separately on different frequency bands). For this (in particular the respective frequency-dependent) stereo correlation coefficient, limits are preferably specified within which this stereo correlation coefficient must lie in order to infer a dissimilarity typical of stereo.
[0023] The aforementioned limits (especially the upper and lower limits) for the stereo correlation coefficient (especially the respective frequency-dependent one) are preferably chosen such that they are below the values typical for a mono presentation and above those for uncorrelated (or only slightly correlated) sounds. On the one hand, a mono presentation could theoretically be assumed to be 100 percent, but in a typical listening environment, lower values of the correlation coefficient for a mono presentation are regularly achieved (e.g., "only" 90 percent) due to, for example, tolerances of the microphones used, ambient noise, etc.On the other hand, correlation values of completely uncorrelated signals are usually above "zero" percent, since this value can only be assumed for white noise, but ambient noise (and thus also music from a single source or "mono music" from multiple sources) is regularly recorded equally by all microphones used. For example, the aforementioned limits are therefore specified to limit the range between 40 and 90 percent, further, for example, between 50 and 80, or even just 70 percent (the latter to allow sufficient distance from a mono performance).
[0024] In a suitable variant of the method (particularly within the framework of a further refined criterion that is additional or alternative to the detection of true stereo presentation), the user's situation of conscious music listening is inferred (or at least the probability that such a situation exists is further increased) if the respective spatial angle range of the music sources lies within an angular range of up to approximately + / - 60 degrees, preferably up to approximately + / - 45 degrees, to the line of sight. Such a situation indicates with a comparatively high degree of probability conscious listening to a stereo presentation, since, particularly in private rooms, stereo loudspeakers are usually located within such an angular range with respect to the listener's position due to the limited spatial boundaries.When consciously listening to stereo, a listener will usually also have his or her line of sight, at least the associated sagittal plane (or especially the median plane), directed at least roughly between the stereo loudspeakers.
[0025] In another advantageous method variant, each hearing aid has two microphones. In this case, the respective solid angle range of the two music sources is determined, in particular, based on a time delay of a signal associated with the music, expediently between the two microphones of a hearing aid. In this case, a "direction of arrival" or "direction of arrival" is determined. For example, reference is made to WO 2019 086 435 A1 and WO 2019 086 439 A1, the contents of which are hereby incorporated in their entirety.
[0026] For example, the recognition or detection of music sources described above is carried out using so-called (particularly "blind") source separation. The recognition of the music sources, in particular the two "stereo sources," optionally occurs before determining the associated solid angle range. Alternatively, the solid angle range in which a signal source lies can be determined first, and only then can it be determined whether this signal source represents a music source. In the latter case, for example, a solid angle range is assigned to different (particularly separable) sound sources. The source separation described above, e.g., based on frequency bands to which a source type (e.g., music, speech, natural sounds) is assigned, optionally also occurs in parallel. In a subsequent step, the information about the location of the individual sources and the source type is then combined.If the sources are located based on an elevated level in a specific segment, the source type can be assigned, for example, by determining whether the frequencies of the source assigned to this level value sufficiently match the frequencies detected for music, or whether the level value detected for the music frequency band sufficiently matches the level value assigned to the source. If the levels and / or frequencies match, a probability value is increased that the identified source type can be assigned to this specific source (and thus also to the solid angle range determined for it). If the probability value is sufficiently high (e.g., based on a threshold comparison), the source type (specifically, the "music" source type) is assigned to the located source.
[0027] In an alternative, but optionally also additional, method variant, in which each hearing device preferably also has two microphones, the respective solid angle range of the two sources is determined by a type of sampling using a directional sensitivity, which is generated in particular by two microphones of a hearing device. Optionally, the directional sensitivity is generated by a binaural combination of both hearing devices. In the latter case, this is also referred to as binaural directional microphony. In this case, each hearing device can, in principle, also have only one microphone. Preferably, in the present method variant, the front half-space is scanned. In particular, in this case, the space around the head of the hearing device user, preferably the front half-space, is divided into sectors. A type of directional lobe or a "sensitivity range" of the resulting directional microphone is directed into each of these sectors.The acoustic intensities (also called "levels") recorded for the respective sectors are compared with each other, and higher intensity or level values compared to other sectors are used as an indicator that a signal source is located in this sector. Interpolation between two sectors can also detect a signal source located at the edge of a sector or between two sectors, and specifically, assign it a solid angle range in which it is located.
[0028] In another practical variant of the method, only sources with a relatively directional radiation pattern—as is the case with loudspeakers, for example—are detected. For example, only radiation angles of approximately 90 degrees are detected for a source.
[0029] Additionally or alternatively, only sources up to a specified distance from the user, e.g. up to 8 or even up to 5 meters, are recognized as (music) sources.
[0030] In another advantageous variant of the method—as already mentioned in the previous variant—binaural processing and evaluation of the information acquired by both hearing aids regarding the presence of music and the spatial angle range of the respective source is carried out. In particular, data is exchanged between both hearing aids. Within the scope of such binaural signal processing, the acoustic information from both hearing aids is further processed together, for example, in the context of binaural directional microphones, to increase the spatial information content and, if necessary, to bring the sound experience even closer to the real listening situation and / or (particularly by utilizing the increased information content) to improve speech intelligibility, noise suppression, and the like.As part of the evaluation, the situation classification (in particular whether music is present at all) as well as the recognition and localization of individual music sources are carried out - also using the increased information content.
[0031] In an advantageous method variant, it is monitored to ensure that the two music sources (i.e., in particular, the stereo sources for the music) move relative to each other only within a predetermined, permissible (spatial) angular range. In particular, the two music sources are each "tracked." This means that a change in the position of the respective source, in particular the spatial angular range in which it was located, is detected and "tracked" (e.g., by directing a directional effect toward it). A movement of the sources relative to the line of sight can occur, for example, if the user of the hearing aid turns their head and / or changes their (body) position in space relative to the music sources. If the music sources are loudspeakers, the two music sources remain constant relative to each other or move only within a comparatively narrow spatial angular range.In the case of a simple head rotation, it can be assumed that the angle between the two vectors (originating from the user) pointing to the two music sources remains constant. If the user bends forward from a chair, for example, to get something to drink, eat, or something similar, the angle between the two vectors will change, but usually only relatively slightly (e.g., by a maximum of 20 degrees). If the two music sources remain within this permissible angular range (e.g., up to 10 or 20 degrees), it is still assumed that the situation is one of conscious music listening. If there is a greater movement of the music sources relative to each other, e.g.Because the user of the hearing aids abandons their position in the room or even leaves the room, it is assumed that the situation of conscious music listening no longer exists and, in particular, the signal processing is reset to the previous settings or a new classification of the listening situation is carried out. Optionally, in particular as long as the two music sources are still present (e.g. because the user has only gone to another area of the room), a waiting period is started and it is waited to see whether the user returns to their previous position relative to the two music sources. This can be useful, for example, if the user only leaves the same room for a short time, e.g. just to get something (e.g. to drink), but basically wants to continue listening to the music.
[0032] In another advantageous variant of the method, the presence of a situation of conscious music listening is excluded if movement is detected for only one of the two music sources. In particular, such movement is recorded as described above. The fact that only one source is moving can be recognized, in particular, by the fact that the solid angle range detected for the other source remains constant, but changes for the "first" source. Such a case is particularly incompatible with a stereo presentation and rather indicates a different situation, for example, two independent and possibly different music sources.
[0033] In another useful variant of the method, spectral differences are determined between the music detected by the respective hearing device and / or for the respective source. Based on these differences, a conclusion is then drawn about a type of music. For classical music, especially orchestral music, a comparatively large spectral difference between the two stereo channels and thus the sound emitted by the two (stereo) music sources is to be expected due to the typically used classical orchestra setup. A comparatively larger spectral difference is also to be expected for recordings of jazz bands. For pop, rock or electronic music, on the other hand, a comparatively smaller spectral difference is to be expected. In order to further differentiate between the respective sub-genres of music, e.g. pop and rock music, a further spectral (e.g.(e.g., with regard to an "emphasis" of certain frequencies) and / or a harmonic evaluation. This design is based on the realization that every hearing aid primarily detects, i.e., particularly at a higher level, the acoustic signals from the associated front quarter space. The acoustic signals from the other quarter space (i.e., those associated with the other half of the face), on the other hand, are usually not detected or only detected to a lesser extent due to shadowing effects.
[0034] Preferably, the signal processing is then adapted, especially further refined, to the type of music. For example, the parameters mentioned above are adapted to the type of music in a conventional manner (compare, for example, equalizer presets in audio systems). For example, in classical music, the "treble," or high frequencies, are emphasized ("emphasized") over the other frequencies; for jazz, a setting that is as balanced as possible is chosen; while in hip-hop or pop, for example, the bass is emphasized.
[0035] In a practical variant of the method, the signal processing is smoothly adapted to music reproduction for cases in which several of the criteria described above are considered, for example, whether the music sources are located in the front half-space, within a spatial angle range smaller than 180 degrees, and / or whether a true stereo presentation is present. In other words, the signal processing is modified less "aggressively" (i.e., with a comparatively small negative impact on other aspects of hearing (particularly speech understanding)) when the two music sources are only located in the front half-space. With a further increasing probability (i.e., cumulative fulfillment of several criteria) for the situation of conscious music listening, e.g., when the spatial angle range is reduced, the signal processing is adapted increasingly more aggressively towards music reproduction, e.g.,by reducing noise reduction and / or directivity and the like.
[0036] The binaural hearing aid system according to the invention, as described above, comprises hearing aids assigned or to be assigned to the left ear and hearing aids assigned to the right ear of the user. These hearing aids each have at least one microphone. Furthermore, the hearing aid system comprises a controller configured to carry out the method described above automatically or in interaction with the user.
[0037] Thus, the hearing aid system has the physical features described above in the respective method variants in corresponding embodiments. The controller is also configured accordingly to carry out the measures described in the context of the above method variants in associated embodiments.
[0038] The controller is embodied, for example, in one of the two hearing aids or in a control unit assigned to them but separate from them. In particular, however, each of the two hearing aids has its own controller (also referred to as a signal processor), which communicate with each other during binaural operation and, preferably under a master-slave arrangement, jointly form the controller of the hearing aid system.
[0039] In a preferred embodiment, the (or the respective) controller is formed, at least in its core, by a microcontroller with a processor and a data memory, in which the functionality for carrying out the method according to the invention is implemented in the form of operating software (firmware), so that the method - possibly in interaction with the user - is carried out automatically when the operating software is executed in the microcontroller. Alternatively, the or the respective controller is formed by a non- or not completely freely programmable electronic component, e.g., an ASIC, in which the functionality for carrying out the method according to the invention is implemented using circuitry.
[0040] The hearing aid system described above, as well as the method described above, also advantageously function in sound systems with more than two sound sources, e.g., 5.1 systems or similar. As described above, the presence of two music sources in the front half-space is used as the fundamental criterion for determining whether a situation of conscious music listening exists. If more than these two music sources are present, especially in the rear half-space, these are either not detected or disregarded as irrelevant for assessing the current (music) listening situation.
[0041] The conjunction "and / or" is to be understood here and in the following in particular in such a way that the features linked by this conjunction can be formed both together and as alternatives to one another.
[0042] In the following, exemplary embodiments of the invention are explained in more detail with reference to a drawing. In the drawings: Fig. 1 in a schematic representation of a binaural hearing aid system, Fig. 2 in a schematic view from above a head of a user of the hearing aid with the hearing aid system in operation, Fig. 3 in view according to Fig. 2 the hearing aid system in an alternative embodiment of operation, and Fig. 4 shows the operating method carried out by both hearing aids using a schematic block diagram.
[0043] Corresponding parts and sizes are always provided with the same reference symbols in all figures.
[0044] In Fig. 1 A binaural hearing aid system 1 is shown schematically. This has two hearing aids 2 and 4. The hearing aid 2 is in its intended use - shown schematically in Fig. 2 or 3- assigned to a left ear 6 of a user 8. The hearing device 4 is correspondingly assigned to the right ear 10 of the user 8. Each hearing device 2, 4 has a front microphone 12 and a rear microphone 14. Furthermore, both hearing devices 2 and 4 have a signal processor 16, a loudspeaker 18, a communication device 20, and a power source 22.
[0045] The signal processor 16 is configured to process ambient sound, which has been captured by the microphones 12 and 14 and converted into microphone signals MS, depending on the hearing loss of the user 8, specifically to filter and amplify it frequency-dependently, and output it as an output signal AS to the loudspeaker 18. The loudspeaker, in turn, converts the output signal AS into sound for output to the hearing of the user 8.
[0046] In binaural operation of the hearing aid system 1, both hearing aids 2 and 4 communicate with each other. Specifically, both signal processors 16 transmit data to each other via the respective communication devices 20 (indicated by a double arrow 24). One of the signal processors 16 forms a "master," the other a "slave." Together, the two signal processors 16 thus also form a controller of the hearing aid system 1. The controller (usually the signal processor 16 acting as the master) processes, among other things, the microphone signals MS of both hearing aids 2 and 4 into a binaural directional microphone signal. Furthermore, the controller is configured to classify different listening situations based on the information contained in the microphone signals MS and, depending on the classification, to modify the signal processing of the microphone signals MS, i.e., to adapt the signal processing parameters.In addition, the signal processors 16, specifically the controller, are configured to carry out an operating procedure described in more detail below.
[0047] The controller determines whether music is present in the ambient noise. However, to avoid the signal processing being incorrectly set to music when music is only coincidentally present in the ambient noise, the controller determines whether multiple sound sources for the music, indicated here by two loudspeaker boxes 26, are present in the environment of the user 8. Specifically, the controller determines whether the two loudspeaker boxes 26 are located in a front half-space 28. The front half-space 28 represents the area in the viewing direction 30 (see Fig. 2 ) represents a spatial area lying in front of a frontal plane 32 intersecting the two ears 6 and 10.
[0048] According to a study based on Fig. 2 and 4In the embodiment described, both signal processors 16 use a "detection stage 34" (see Fig. 4 ), which, by means of the two microphones 12 and 14, determines in a known manner a so-called direction of arrival for the sound emanating from the two loudspeaker boxes 26. The respective direction of arrival is used as a solid angle range 36 (in particular in the form of a vector) (relative to the viewing direction 30 as a zero-degree direction) in which the respective loudspeaker box 26 is arranged. In parallel, the current listening situation is classified in a classification stage 38. Here, it is determined whether music is present. If this is the case and two different sound sources, each arranged in a solid angle range 36, are detected, a check is carried out in a fusion stage 40, in which the information from the classification stage 38 and the detection stage 34 is combined, to determine whether both sound sources are emitting the same music.For both hearing aids 2 and 4, a sound source is determined for the music recognized in classification level 38 within a solid angle range 36 arranged in the front half-space 28 - which is determined based on the communication between both hearing aids 2 and 4 (cf. . Fig. 4 ) - the controller in the fusion stage 40 assumes that a situation with a stereo presentation of the music exists. The controller takes this as an indication to increase the probability value that a situation of conscious music listening exists. If the probability is sufficiently high (which is the case if it is only verified that the two sound sources are arranged in the front half-space 28), the controller adjusts parameters for the music signal processing for a downstream processing stage 42. For example, the controller sets a so-called compression to a linear level and reduces noise suppression.
[0049] In an optional variant, a stereo detection stage 44 is connected upstream of the fusion stage 40. This stage determines whether both sound sources emit sufficiently similar but not exactly identical sound signals. This is the case with a stereo presentation using a stereo system with two loudspeakers 26, provided the output is not set to "mono." In this variant, the probability value is further increased compared to the previously described variant if such a stereo presentation is detected. Only with this "additional" increase does the probability value reach a threshold value, beyond which the parameters for the music signal processing are changed.
[0050] Additionally or alternatively, in an optional further variant, the probability value is also increased if the two sound sources are not only in the front half-space 28, but also in a narrow spatial area of 60 degrees on both sides of the viewing direction 30.
[0051] Further optionally, the controller does not switch the signal processing between two parameter sets when the probability limit is reached, but changes the parameters increasingly with increasing probability, so that a situation-dependent increasing change in the signal processing is realized.
[0052] In Fig. 3 An alternative embodiment is shown. Instead of detecting the direction of arrival, the directional sensitivity of a binaural directional microphone is set in the detection stage 34 such that several sectors 46 with increased sensitivity compared to the other spatial regions are distributed in a fan-like manner in the front half-space 28. For each sector 46, a level value is recorded and compared with those of the other sectors 46. An increased level value indicates a sound source in the area of the sector 46. For more precise localization, an interpolation between the sectors 46 is carried out in an optional variant, so that a sound source arranged between two sectors 46 (in Fig. 3 indicated by the loudspeaker box 26 shown on the left) is detected, specifically its solid angle range 36 can be narrowed down.
[0053] The further procedure corresponds to the previous embodiment and, if applicable, its variants.
[0054] The decision as to whether two sound sources for the music are present and the resulting measures, in particular the decision regarding the change in the signal processing parameters, is made in a variant of the embodiments described above by the signal processor 16 acting as master and transmitted to the signal processor 16 acting as slave.
[0055] Due to the procedure described above, the signal processing is only changed by the controller when two sound sources for the music, in this case the two loudspeakers 26, are detected. Misinterpretation and adjustment of the signal processing for music in cases where only one sound source is present, for example, with an advertising loudspeaker in a pedestrian zone or the like, is thus effectively avoided.
[0056] The subject matter of the invention is not limited to the exemplary embodiments described above. Rather, further embodiments of the invention can be derived by those skilled in the art from the above description. In particular, the individual features of the invention and their design variants described with reference to the various exemplary embodiments can also be combined with one another in other ways. List of reference symbols
[0057] 1 Hearing aid system 2 Hearing aid 4 Hearing aid 6 Ear 8 User 10 Ear 12 Microphone 14 Microphone 16 Signal processor 18 Loudspeaker 20 Communication device 22 Energy source 24 Double arrow 26 Loudspeaker box 28 Half-space 30 Direction of view 32 Frontal plane 34 Detection stage 36 Solid angle range 38 Classification stage 40 Fusion stage 42 Processing stage 44 Stereo detection stage 46 Sector ASOutput signal MSMicrophone signal
Claims
1. Method for operating a binaural hearing apparatus system (1) which has one hearing apparatus (2, 4) assigned, or to be assigned, to a left ear (6) and one to a right ear (10) of a user (8), each having at least one microphone (12, 14), wherein according to the method, - acoustic information is gathered by means of the respective microphones of the two hearing apparatuses (2, 4), - the acoustic information is analysed to ascertain whether it contains music. - it is determined whether for the music, two sources (26) can be detected, - a spatial angle range (36) in which the respective sources (26) of the music are positioned is determined with respect to a viewing direction (30) of the user (8), and - for the case that the respective spatial angle ranges (36) of the two sources (26) of the music each lie in a front half-space (28) with respect to the viewing direction (30), a probability that a situation of intentional music-listening by the user (8) exists is increased, and on a defined probability limit value being exceeded, signal processing for both hearing apparatuses (2, 4) is adapted with regard to reproducing the music as naturally as possible.
2. Method according to Claim 1, wherein it is determined whether the acoustic signals emanating from the two sources (26) are dissimilar to each other within a frame typical of music, and wherein the probability that the situation of intentional music-listening exists is increased further if such a dissimilarity is identified.
3. Method according to Claim 1 or 2, wherein the probability that the situation of intentional music-listening exists is increased further if the respective spatial angle ranges (36) of the sources (26) of the music each lie in an angle range of up to approximately + / - 60 degrees, preferably up to approximately + / - 45 degrees, with respect to the viewing direction (30).
4. Method according to one of Claims 1 to 3, wherein each hearing apparatus (2, 4) has two microphones (12, 14), and wherein the respective spatial angle ranges (36) of the two sources (26) are each determined from a time delay of a signal associated with the music.
5. Method according to one of Claims 1 to 4, wherein the respective spatial angle ranges (36) of the two sources (26) are each determined by a sort of scanning, in particular of the front half-space (28), by means of a directional sensitivity.
6. Method according to one of Claims 1 to 5, wherein binaural processing and analysis of the information captured by both hearing apparatuses (2, 4) is carried out with regard to the presence of music and the spatial angle range (36) of the respective sources (26) .
7. Method according to one of Claims 1 to 6, wherein it is monitored whether the two sources (26) move relative to each other only within a specified permitted angle range.
8. Method according to one of Claims 1 to 7, wherein the existence of the situation of intentional music-listening is ruled out if a movement is identified only for one of the two sources (26).
9. Method according to one of Claims 1 to 8, wherein spectral differences are determined between the music captured by the respective hearing apparatuses (2, 4) and / or for the respective sources (26), and a type of music is inferred therefrom.
10. Method according to Claim 9, wherein the signal processing is adapted to the type of music.
11. Binaural hearing apparatus system (1) which has one hearing apparatus (2, 4) assigned, or to be assigned, to a left ear (6) and one to a right ear (10) of a user (8), each having at least one microphone (12, 14), and has a controller, which is configured to carry out a method according to one of Claims 1 to 10.
Citation Information
Patent Citations
Method of operating a hearing aid system and a hearing aid system
WO2019086435A1
Method of operating a hearing aid system and a hearing aid system
WO2019086439A1
Hearing system and method for deriving information on an acoustic scene
EP1858291A1
Systems and methods for accelerometer-based optimization of processing performed by a hearing device
EP3684075A1
Method for producing control signals, method of controlling signal and a hearing device
US20040175008A1
