Media system and method for adapting hearing loss

Abstract

The invention relates to a media system and a method for adapting to hearing loss. A media system and a method for adapting to hearing loss of a user using the media system are described. The method includes selecting a personal level and frequency dependent audio filter corresponding to a hearing loss profile of a user. The personal level and frequency dependent audio filter may be one of several level and frequency dependent audio filters having a respective average gain level and a respective gain profile. The adaptive audio output signal may be generated by applying a personal level and frequency dependent audio filter to the audio input signal to enhance the audio input signal based on an input level and an input frequency of the audio input signal. An audio output signal may be played by an audio output device to deliver a user clearly perceived voice or music despite hearing loss of the user. Other aspects are also described and claimed to be protected.

Description

[0001] This divisional application is a divisional application of the Chinese patent application with application number 202210104034.X, application date June 1, 2020, and invention name “Media system and method adapting to hearing loss”. The Chinese patent application with application number 202210104034.X is a divisional application of the Chinese patent application with application number 202010482726.9, application date June 1, 2020, and invention name “Media system and method adapting to hearing loss”. Technical Field

[0002] The present invention discloses aspects related to a media system with audio capabilities. More specifically, aspects related to a media system for playing audio content to a user are disclosed. Background Art

[0003] An audio-enabled device (such as a laptop, tablet, or other mobile device) can deliver audio content to a user. For example, a user can listen to audio content using an audio-enabled device. The audio content can be pre-stored audio content such as music files, podcasts, virtual assistant messages, etc., played to the user by a speaker. Alternatively, the reproduced audio content can be real-time audio content, such as audio content from a phone call, video conference, etc.

[0004] Noise exposure, aging, or other factors may cause an individual to experience hearing loss. An individual's hearing loss profile may vary widely and may even be attributed to a person who has not been diagnosed with hearing loss. That is, each individual may have a certain frequency-related loudness perception that is different from normal. Such differences may vary widely across the population and may correspond to a spectrum of hearing loss profiles for the population. Given that each individual hears differently, each individual may have a different experience of audio content that is reproduced in the same way to several people. For example, a person with substantial hearing loss at a particular frequency may experience that the playback of audio content containing a substantial component at that frequency is muted. In contrast, a person without hearing loss at a particular frequency may experience that the playback of the same audio content is clear.

[0005] An individual may adjust an audio-enabled device to modify the playback of audio content in order to enhance the user's experience. For example, a person with substantial hearing loss at a particular frequency may adjust the overall level of the audio signal volume to increase the loudness of the reproduced audio. Such adjustments may be made with the hope that the modified playback will compensate for the person's hearing loss. Summary of the invention

[0006] Volume adjustments that modify playback as described above may not compensate for hearing loss in a personalized manner. For example, increasing the overall level of an audio signal may increase loudness, but increase loudness across the audible frequency range, regardless of whether the user experiences hearing loss across the entire range. The result of such large-scale level adjustments may be an uncomfortably loud and disturbing listening experience for the user.

[0007] A media system and a method of using the media system to adapt to a user's hearing loss are described. In one aspect, the media system performs the method by: selecting an audio filter (e.g., a level and frequency dependent audio filter) from a number of audio filters (e.g., a number of level and frequency dependent audio filters); and applying the audio filter to an audio input signal to generate an audio output signal that can be played back to the user. The audio filter can be a personal audio filter, such as a personal level and frequency dependent audio filter corresponding to the user's hearing loss profile.

[0008] The personal level- and frequency-dependent audio filter may be selected by the media system from among the level- and frequency-dependent audio filters corresponding to the corresponding preset hearing loss curve. Since the level- and frequency-dependent audio filter has a corresponding average gain level and a corresponding gain profile corresponding to the average loss level and the loss profile of the hearing loss curve, the level- and frequency-dependent audio filter compensates for the preset hearing loss curve. The personal level- and frequency-dependent audio filter may amplify the audio input signal based on the input level and the input frequency of the audio input signal, and thus, the user may experience the sound from the reproduced audio output signal normally (rather than muted as would be the case if an uncorrected audio input signal were played).

[0009] The selection of personal level and frequency-dependent audio filters can be performed through a brief and straightforward registration process. In one aspect, a first audio signal is output during a first stage of the registration process using one or more predetermined gain levels or using a first group of level and frequency-dependent audio filters with different average gain levels. The first audio signal can be played back to a user who experiences audio content (e.g., speech) at different loudnesses. The user can select an audible or preferred loudness. More specifically, the media system receives a selection of a personal average gain level in response to outputting the first audio signal using one or more predetermined gain levels or a first group of one or more level and frequency-dependent audio filters. The selection of the personal average gain level may indicate that the first audio signal (e.g., speech signal) is output at a level audible to the user. The selection of the personal average gain level may indicate that the first audio signal is output at a preferred loudness. The media system may select the personal level and frequency-dependent audio filter based in part on the personal level and frequency-dependent audio filter having the personal average gain level. For example, the corresponding average gain level of the personal level and frequency-dependent audio filter may be equal to the personal average gain level.

[0010] In one aspect, a second audio signal is output during a second stage of the registration process using a second set of level and frequency-dependent audio filters having different gain profiles. The second set of level and frequency-dependent audio filters may be selected for exploration based on user selections made during the first stage of the registration process. For example, each level and frequency-dependent audio filter in the second set may have a personal average gain level corresponding to the audibility selection made during the first stage. The second audio signal may be played back to a user who experiences audio content (e.g., music) with different timbre or pitch settings and selects a preferred timbre or pitch setting. More specifically, the media system receives a selection of a personal gain profile in response to outputting the second audio signal. The media system may select the personal level and frequency-dependent audio filter based in part on the personal level and frequency-dependent audio filter having the personal gain profile. For example, the corresponding gain profile of the personal level and frequency-dependent audio filter may be equal to the personal gain profile.

[0011] In one aspect, the registration process may modify the first audio signal and the second audio signal for playback using level- and frequency-dependent audio filters corresponding to preset hearing loss curves. For example, audio filters corresponding to the most common hearing loss curves in a population may be used. The audio filters may alternatively correspond to a hearing loss curve from a population that is closely related to the user's audiogram. For example, the media system may receive a personal audiogram of the user, and based on the personal audiogram, determine several preset hearing loss curves that cover the user's hearing loss curve represented by the audiogram. The media system may then determine level- and frequency-dependent audio filters corresponding to the determined hearing loss curves, and may use those audio filters during the presentation of audio in the first or second stage of the registration process.

[0012] The media system may select a personal level and frequency-dependent audio filter directly based on the user's audiogram without utilizing a registration process. For example, the media system may receive a personal audiogram of the user, and based on the personal audiogram, may select a preset personal hearing loss curve that most closely matches the user's hearing loss curve represented by the audiogram. For example, the personal audiogram may indicate that the user has an average hearing loss level and loss curve, and the media system may select a preset hearing loss curve that fits the audiogram. The media system may then determine a level and frequency-dependent audio filter corresponding to the personal hearing loss curve. For example, the media system may determine a level and frequency-dependent audio filter having an average gain level corresponding to the average hearing loss level of the audiogram and / or having a gain profile corresponding to the loss profile. The media system may use the audio filter as a personal level and frequency-dependent audio filter to enhance the audio input signal and compensate for the user's hearing loss when playing back audio content.

[0013] The above summary does not include an exhaustive list of all aspects of the invention. It is contemplated that the invention includes all systems and methods that can be practiced from all appropriate combinations of the various aspects summarized above and disclosed in the following detailed description and specifically pointed out in the claims filed with this patent application. Such combinations have specific advantages not specifically recited in the above summary. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 is an illustration of a media system according to an aspect.

[0015] Figure 2 is a graph of a loudness curve for an individual with sensorineural hearing loss according to an aspect.

[0016] Figure 3 is a graph of the amplification required to normalize the loudness perceived by individuals with different hearing loss profiles according to an aspect.

[0017] Figure 4 is a diagram of a frequency-dependent audio filter applied to an audio input signal to adapt to a user's personal level of hearing loss according to an aspect.

[0018] Figure 5 is a diagram of an audiogram of a user according to an aspect.

[0019] Figures 6 to 8 is a diagram of a hearing loss curve according to an aspect.

[0020] Fig. 9 is a diagram of a multi-band compression gain table of a frequency-dependent audio filter corresponding to a level of a hearing loss curve according to an aspect.

[0021] Fig.10 is a flow chart of a method of enhancing an audio input signal to accommodate hearing loss according to one aspect.

[0022] Fig.11 is a diagram of a user interface for controlling output of a first audio signal according to an aspect.

[0023] Fig.12 is a diagram of selection of level and frequency dependent audio filter banks for exploration in a second stage of an enrollment procedure according to an aspect.

[0024] Fig.13 is a diagram of a user interface for controlling output of a second audio signal according to an aspect.

[0025] FIG. 14A to FIG. 14B is a diagram of selection of level and frequency dependent audio filters having different gain profiles according to an aspect.

[0026] Fig.15 is a flow chart of a method of selecting a personal level and frequency dependent audio filter having a personal average gain level and a personal gain profile according to an aspect.

[0027] Fig.16 is a diagram of a user interface for controlling output of a first audio signal according to an aspect.

[0028] FIG. 17A to FIG. 17B is a diagram of selection of horizontal and frequency dependent audio filters having different average gain levels according to an aspect.

[0029] Fig.18 is a diagram of a user interface for controlling output of a second audio signal according to an aspect.

[0030] FIG. 19A to FIG. 19Bis a diagram of selection of level and frequency dependent audio filters having different gain profiles according to an aspect.

[0031] Fig. 20 is a flow chart of a method of selecting a personal level and frequency dependent audio filter having a personal average gain level and a personal gain profile according to an aspect.

[0032] FIG. 21A to FIG. 21B A flow chart and a diagram, respectively, of a method for determining several hearing loss curves based on a personal audiogram according to an aspect.

[0033] FIG. 22A to FIG. 22B A flow chart and a diagram, respectively, of a method for determining a personal hearing loss curve based on a personal audiogram according to an aspect.

[0034] Fig.23 is a block diagram of a media system according to an aspect. DETAILED DESCRIPTION

[0035] This application claims the benefit of priority to U.S. Provisional Patent Application No. 62 / 855,951 filed on June 1, 2019, and this application incorporates that provisional patent application herein by reference.

[0036] Various aspects describe a media system and a method of using the media system to accommodate a user's hearing loss. The media system may include a mobile device (such as a smart phone) and an audio output device (such as a handset). However, the mobile device may be another device for presenting audio to the user, such as a desktop computer, laptop computer, tablet computer, smart watch, etc., and the audio output device may include other types of devices, such as earphones, headphones, computer speakers, etc., to name just a few possible applications.

[0037] In various aspects, description is made with reference to the accompanying drawings. However, certain aspects may be practiced without one or more of these specific details or without being combined with other known methods and configurations. In the following description, multiple specific details such as specific configurations, dimensions and processes are set forth to provide a thorough understanding of the aspects. In other examples, well-known processes and manufacturing techniques are not particularly described in detail so as not to unnecessarily obscure the description. References to "an aspect", "aspects" and the like throughout this specification mean that the specific features, structures, configurations or characteristics described are included in at least one aspect. Therefore, phrases "an aspect", "aspects" and the like appearing in various places throughout this specification do not necessarily refer to the same aspects. Also, specific features, structures, configurations or characteristics may be combined in one or more aspects in any suitable manner.

[0038] Relative terms are used throughout the description to refer to relative positions or directions. For example, "in front of" may indicate a first direction away from a reference point. Similarly, "behind" may indicate a position in a second direction away from the reference point and opposite to the first direction. However, such terms are provided to establish a relative frame of reference, and such terms are not intended to limit the use or orientation of the media system to the specific configurations described in the following aspects.

[0039] On the one hand, the media system is used to adapt to the hearing loss of the user. The media system can compensate for the user's mild or moderate hearing loss curve. In addition, the compensation can be personalized, which means that it adjusts the audio input signal in a level-related and frequency-related manner based on the individual's unique hearing preferences, rather than just adjusting the balance or overall level of the audio input signal. The media system can personalize audio tuning based on the selection made during a brief and direct registration process. During the registration process, the user can experience the sound from several audio signals filtered in different ways, and the user can make a binary choice to select personal audio settings based on a subjective evaluation or comparison of the experience. The personal audio settings include the average gain level and gain profile of the preferred audio filter. When the user has selected the personal audio settings, the media system can generate an audio output signal by applying a personal level and frequency-related audio filter with the personal audio settings to amplify the audio input signal based on the input level and input frequency of the audio input signal. The playback of the audio output signal can deliver speech or music to the user, and the speech or music is clear to the user despite the user's hearing loss curve.

[0040] refer to Figure 1, according to one aspect, a diagram of a media system is shown. A media system 100 can be used to deliver audio to a user. The media system 100 may include an audio signal device 102 that outputs and / or transmits an audio output signal and an audio output device 104 that converts the audio output signal (or a signal derived from the audio output signal) into sound. On the one hand, the audio signal device 102 is a smart phone. However, the audio signal device 102 may include other types of audio-supported devices, such as laptop computers, tablet computers, smart watches, televisions, etc. On the one hand, the audio output device 104 is a handset (wired or wireless). However, the audio output device 104 may include other types of devices, including audio speakers such as headphones. The audio output device 104 may also be an internal or external speaker of the audio signal device 102, such as a speaker of a smart phone, laptop computer, tablet computer, smart watch, television, etc. In any case, the media system 100 may include hardware such as one or more processors, memory, etc., which enables the media system 100 to perform a method for enhancing an audio input signal to adapt to the user's hearing loss. More specifically, the media system 100 may provide personalized media enhancement by applying a user's personalized audio filter to an audio input signal to enable playback of audio content adapted to the user's hearing preferences and or hearing abilities.

[0041] refer to Figure 2 , shows a graph of a loudness curve for an individual with sensorineural hearing loss according to one aspect. Sensorineural hearing loss is the primary type of hearing loss, however, other types of hearing loss also exist, such as conductive hearing loss. An individual with sensorineural hearing loss has a higher audibility threshold than a normal listener, but may also experience uncomfortably loud levels. The loudness curve for an individual with conductive hearing loss may be different. More specifically, an individual with conductive hearing loss may have a higher audibility threshold and uncomfortably loud levels than their normal hearing counterparts. The loudness level curve 200 is used by way of example.

[0042] The user's hearing preferences and / or hearing abilities are frequency-dependent and level-dependent. A higher sound pressure level is required in the ear of an individual with hearing loss to achieve the same perceived loudness as an individual with less hearing loss. The graph shows a loudness level curve 200 that describes the perceived loudness (PHON) as a function of the sound pressure level (SPL) of several individuals at a specific frequency (e.g., 1kHz). Curve 202 has a slope of 1:1 and an origin of zero because a loudness unit (e.g., 50PHON) is defined as the loudness of a 1kHz tone of a corresponding SPL (e.g., 50dB SPL) perceived by a listener with normal hearing. In contrast, an individual with impaired hearing 204 does not perceive loudness until the sound pressure level reaches a threshold level. For example, when an individual has a 60dB hearing loss, the individual will not perceive loudness until the sound pressure level reaches 60dB.

[0043] refer to Figure 3 , shows a graph of the amplification required to normalize the loudness perceived by individuals with different hearing loss profiles according to one aspect. To compensate for the hearing loss of an individual, a gain may be applied to the input signal to raise the sound pressure level in the ear of the individual with the hearing loss. The graph shows a gain curve 302 that describes the gain of an individual with a hearing loss. Figure 2 The loudness level curve of FIG. 20 shows the gain required to match normal hearing loudness as a function of sound pressure level for an individual. Obviously, at certain frequencies, the individual 202 with normal hearing does not need amplification, because it is clear that the individual already has normal hearing loudness at all sound pressure levels. In contrast, the individual with impaired hearing 204 requires substantial amplification at low sound pressure levels in order to perceive the applied sound pressure level below 204. Figure 2 The threshold level (e.g., below 60dB) of the sound.

[0044] The amount of amplification required to compensate for an individual's hearing loss decreases as the sound pressure level increases. More specifically, the amount of amplification required to compensate for hearing loss depends on both the frequency and the input signal level. That is, when the input signal level of the audio input signal produces a higher sound pressure level for a given frequency, less amplification is required to compensate for the hearing loss at that frequency. Similarly, the hearing loss of an individual is frequency-dependent, so the loudness level curve and the gain curve may be different at another frequency (e.g., 2kHz). By way of example, if the gain curve of an individual with impaired hearing is shifted upward (more hearing loss at 2kHz than at 1kHz), greater amplification is required to normally perceive the sound at that frequency. Therefore, when the input signal level of the audio input signal has a component at a specific frequency (2kHz), greater amplification is required to compensate for the hearing loss at that frequency. The method of adjusting the audio input signal to amplify the audio input signal based on the input level and input frequency of the audio input signal may be referred to as multi-band upward compression in this article.

[0045] Multi-band upward compression can achieve the desired enhancement of audio content by bringing sounds that are not perceived or are perceived as too quiet into the audible range without adjusting sounds that are already perceived as sufficiently or generally loud. In other words, multi-band upward compression can enhance the audio input signal in a level-dependent and frequency-dependent manner so that the sound is normally perceived by the hearing-impaired individual. Normalization of the loudness level curve for the hearing-impaired individual can avoid over-amplification or under-amplification at certain levels or frequencies, which avoids the problems associated with simply turning up the volume and amplifying the audio input signal across the entire audible frequency range.

[0046] refer to Figure 4, a diagram of a personal level and frequency dependent audio filter applied to an audio input signal to accommodate a user's hearing loss according to one aspect. In view of the above discussion, it should be understood that the media system 100 can accommodate an individual's hearing loss by applying a personal level and frequency dependent audio filter 402 to an audio input signal 404. The personal level and frequency dependent audio filter 402 can convert the audio input signal 404 into an audio output signal 406 that will typically be perceived by the individual. By way of example, the audio input signal 404 can represent speech in a phone call, music in a soundtrack, speech from a virtual assistant, or other audio content. As indicated by the dashed and dotted lines, when reproduced without multi-band upward compression, sounds of certain frequencies may be perceived normally (indicated by solid lines), while sounds of other frequencies may be perceived quietly (voiced or muted) or not perceived at all (indicated by dashed and dotted lines of varying density). In contrast, after applying the personal level and frequency-dependent audio filter 402 to the audio input signal 404, the generated audio output signal 406 may contain sounds of a specific frequency that are normally perceived (indicated by the solid lead line). Thus, the personal level and frequency-dependent audio filter 402 may restore details of speech, music, and other audio content to enhance the sound played back to the user by the audio output device 104.

[0047] refer to Figure 5 , shows a diagram of an audiogram of a user according to one aspect. In order to understand how a personal level and frequency-dependent audio filter 402 may be selected or determined for enhancing an audio input signal 404, it may be helpful to understand how a user's hearing loss curve may be identified and mapped to a multi-band compression filter specific to the user. In one aspect, a user's personal audiogram 500 may include one or more audiogram curves representing audible thresholds as a function of frequency. For example, a first audiogram curve 502a may represent an audible threshold for a user's right ear, and a second audiogram curve 502b may represent an audible threshold for a user's left ear. The personal audiogram 500 may be determined using known techniques. In one aspect, an average hearing loss 504 may be determined from one or both of the audiogram curves 502a, 502B. For example, in the illustrated example, the average hearing loss 504 of the two curves may be 30 dB. Thus, the personal audiogram 500 indicates both the user's average hearing loss and frequency-dependent hearing loss across the primary audible range of humans (e.g., between 500 Hz and 8000 kHz). It should be noted that the primary audible range referred to herein may be smaller than the human audible range (known as 20 Hz to 20 kHz).

[0048] Figures 6 to 8A graph of hearing loss curves for a population of people is included. As described below, each hearing loss curve can have a combination of a level parameter and a profile parameter. The level parameter of a hearing loss curve can indicate the average hearing loss as determined by pure tone audiometry. The profile parameter can indicate the variation in hearing loss within the audible frequency range, for example, whether the hearing loss is more pronounced at certain frequencies. Figures 6 to 8 The hearing loss curves shown can be grouped according to level parameters and contour parameters. In one aspect, the hearing loss curves are the most common curves of hearing loss that exist in a population based on analysis of real audiograms. More specifically, each hearing loss curve can represent a common audiogram in a three-dimensional space of audiograms with unique level and contour parameters.

[0049] Figure 6 A first group 602 of hearing loss curves is shown. The hearing loss curves in the first group 602 may have level parameters corresponding to listeners with mild hearing loss. For example, the average hearing loss 604 of the first group 602 curves may be 20 dB. More specifically, each of the hearing loss curves included in the first group 602 may have the same average hearing loss 604. However, the hearing loss curves may differ in shape.

[0050] In one aspect, the first group 602 may include hearing loss curves with different profile parameters. The profile parameters may include a flat loss profile 606, a notch loss profile 608, and a sloped loss profile 610. Different shapes may have significant hearing loss at corresponding frequencies. For example, the flat loss profile 606 may have more hearing loss at low band frequencies (e.g., at 500 Hz) compared to the notch loss profile 608 or the sloped loss profile 610. In contrast, the notch loss profile 608 may have more hearing loss at mid-band frequencies (e.g., at 4 kHz) compared to the flat loss profile 606 or the sloped loss profile 610. The sloped loss profile 610 may have more hearing loss at high band frequencies (e.g., at 8 kHz) compared to the flat loss profile 606 or the notch loss profile 608.

[0051] The hearing loss curve shapes may have other general differences. For example, the flat loss profile 606 may have the least hearing loss variation compared to the notched loss profile 608 and the sloped loss profile 610. That is, the flat loss profile 606 exhibits a more consistent hearing loss at each frequency. Additionally, for the same curve, the notched loss profile 608 may have more hearing loss at mid-band frequencies than at other frequencies.

[0052] Figure 7 A diagram of a second set 702 of hearing loss curves is shown. The average hearing loss of each of the sets of hearing loss curves can be obtained from Figures 6 to 8More specifically, the hearing loss curves in the second group 702 may have level parameters corresponding to listeners with mild to moderate hearing loss. For example, the average hearing loss 704 of the second group 702 may be 35 dB. However, the hearing loss curves of the second group 702 may have different profile parameters, such as a flat loss profile 706, a notched loss profile 708, and a sloped loss profile 710. Due to the regularity of hearing loss across populations, the shape of each level group may be related by shape. More specifically, the shapes of the loss profiles 706-710 may share the general differences described above with respect to the loss profiles 606-610, but the shapes may not be scaled to the same proportions. For example, compared to Figure 7 Compared to other loss profiles of FIG. 704 , the notch loss profile 708 may have the highest loss at a mid-band frequency, but the maximum loss of the notch loss profile 708 may be at a high-band frequency (compared to FIG. 704 ). Figure 6 ). Therefore, Figure 7 The hearing loss curve of may represent the most common hearing loss curve for people in the population with mild to moderate hearing loss.

[0053] Figure 8 A graph of a third group 802 of hearing loss curves is shown. The average hearing loss 804 of the third group 802 may be higher than the average hearing loss 704 of the second group 702. The average hearing loss of the third group 802 may represent a person with moderate hearing loss. For example, the average hearing loss 804 may be 50 dB. As with the other groups, the hearing loss curves of the third group 802 may differ in shape and may include a flat loss profile 806, a notched loss profile 808, and a sloped loss profile 810. The shapes of the loss profiles 806-810 may share the general differences described above with respect to the loss profiles 606-610 or 706-710. Thus, Figure 8 The hearing loss curve may represent the most common hearing loss curve for people with moderate hearing loss in the population.

[0054] Figures 6 to 8 The hearing loss curves shown represent nine presets for hearing loss curves stored by the media system 100. More specifically, the media system 100 may store any number of hearing loss curve presets derived from the 3D space of the audiogram described above. Each preset may have a combination of level and profile parameters that may be compared to the personal audiogram 500. One of the nine presets of groups 602, 702, and 802 may be similar to the personal audiogram 500. For example, by visual inspection, it is apparent that Figure 5The personal audiogram 500 of the user having the personal audiogram 500 has an average hearing loss level (30 dB, compared to 35 dB) that is closest to the hearing loss curve of the second group 702, and exhibits a shape that is closely related to the flat loss profile 706. Therefore, the flat loss profile 706 can be identified as the personal hearing loss profile of the user having the personal audiogram 500.

[0055] The comparison between the audiogram and the hearing loss curve as described above is introduced by way of example and will be referenced again below with respect to FIGS. 21-22 . At this level, the example illustrates the concept that each individual may have an actual hearing loss (as represented by the audiogram) that closely matches a common hearing loss curve (as determined from a population and stored as a preset within the media system 100 ). To compensate for the actual hearing loss, the media system 100 may apply a personal level and frequency dependent audio filter 402 that corresponds to and compensates for the closely matching hearing loss curve.

[0056] refer to Fig. 9 , shows a diagram of a multi-band compression gain table representing level- and frequency-dependent audio filters corresponding to hearing loss curves according to an aspect. Each hearing loss curve can be mapped to a corresponding level- and frequency-dependent audio filter. For example, whichever of the hearing loss curves of the group 602-802 that most closely matches the personal audiogram 500 can be mapped to the level- and frequency-dependent audio filter as the personal level- and frequency-dependent audio filter 402. Thus, the media system 100 can store, for example, in a memory, several preset hearing loss curves and several level- and frequency-dependent audio filters corresponding to the hearing loss curves.

[0057] In one aspect, the personal level and frequency dependent audio filter 402 may be a multi-band compression gain table. The multi-band compression gain table may be a user-specific prescription to compensate for an individual's hearing loss, thereby providing personalized media enhancement. In one aspect, the personal level and frequency dependent audio filter 402 is used to amplify an audio input signal 404 based on an input level 902 and an input frequency 904. The input level 902 of the audio input signal 404 may be determined within a range spanning from a low sound pressure level to a high sound pressure level. By way of example, the audio input signal 404 may have a sound pressure level shown on the left side of the gain table, which may be, for example, 20 dB. The input frequency 904 of the audio input signal 404 may be determined within an audible frequency range. By way of example, the audio input signal 404 may have a frequency at the top of the gain table, which may be, for example, 8 kHz. Based on the input level 902 and the input frequency 904 of the audio input signal 404, the media system 100 may determine that a particular gain level (eg, 30 dB) is to be applied to the audio input signal 404 to generate the audio output signal 406. It should be appreciated that this example is not intended to be confused with the example of FIG. Figures 2 to 3The hearing loss curve is consistent with the gain curve.

[0058] Fig. 9 The gain table exemplifies that for each hearing loss profile of a user, a corresponding level and frequency-dependent audio filter may be determined or selected to compensate for the user's hearing loss. The level and frequency-dependent audio filter may define a gain level at each input frequency that inversely corresponds to the individual's hearing loss at those frequencies. By way of example, a user having a personal audiogram 500 that matches a flat loss profile 706 within the second set 702 may have a personal level and frequency-dependent audio filter 402 that amplifies the audio input signal 404 more at 8 kHz than at 500 Hz. The gains applied across audible frequencies by the gain table may negate the hearing loss represented by the loss profile.

[0059] refer to Fig.10 , a flow chart of a method for enhancing an audio input signal to accommodate hearing loss according to one aspect is shown. The media system 100 may perform the method to provide personalized enhancement of audio content. At operation 1002, one or more processors of the media system 100 may select a personal level and frequency-dependent audio filter 402 from a number of level and frequency-dependent audio filters corresponding to a corresponding hearing loss curve. The selection process may be performed in various ways. For example, as mentioned above and as further discussed below with respect to FIG. 22, the selection may include matching a user's personal audiogram with a preset hearing loss curve. However, it is contemplated that some users of the media system 100 may not have an existing audiogram available for matching. In addition, even when such an audiogram is available, there may be supra-threshold differences in loudness perception for different users. For example, two users with similar audiograms may still subjectively experience sound pressure levels at a given frequency in different ways, for example, the first user may feel comfortable with the sound pressure level, while the second user may feel uncomfortable with the sound pressure level. Therefore, it may be beneficial to personalize the audio filter selection to the user rather than relying solely on audiogram data. More specifically, a user may have preferences that are not fully captured by the audiogram data, and therefore, it may be beneficial to allow the user to select from different level and frequency related audio filters that do not necessarily exactly match the personal audiogram.

[0060] In one aspect, a convenient and noise-robust enrollment procedure may be used to drive the selection of personal level and frequency-dependent audio filters that accommodate a user's hearing preferences. The enrollment procedure may playback one or more audio signals altered by one or more predetermined gain levels and / or one or more level and frequency-dependent audio filters that correspond to the most common hearing loss profiles for predetermined demographic persons. The user may make selections during the enrollment procedure, for example, to select one or more of the level and frequency-dependent audio filters, and through the user selections, the media system 100 may determine and / or select appropriate personal level and frequency-dependent audio filters to apply to the user's audio input signals. Several implementations of the enrollment procedure are described below. The enrollment procedure may incorporate several stages, and one or more stages of the implementation may differ. For example, Figures 11 to 15 describes a registration procedure including a first stage in which a user's selection indicates whether a played back audio signal is audible, and Figures 16 to 20 A registration procedure is described that includes a first stage in which a user's selection indicates a preferred audio filter from a set of audio filters having different average gain levels.

[0061] refer to Fig.11 , shows a diagram of a user interface for controlling the output of a first audio signal according to one aspect. During the registration process, the media system 100 may output the first audio signal using one or more predetermined gain levels. The predetermined gain levels may be scalar gain levels (wideband or frequency independent gains) that are applied to allow the audio signal to be played back at different loudnesses for the user to listen to. For example, the media system may generate a first audio signal for a speaker to play back to the user. The first audio signal may represent speech (e.g., a voice file) that contains recorded greetings spoken in languages ​​from around the world. Speech has a good contrast between gain levels (compared to music), and therefore may facilitate the selection of an appropriate average gain level during the first stage of the registration process.

[0062] During the first stage, the audio input signal 404 may be reproduced for the user at a first predetermined gain level. For example, the speech signal may be output at a low level (e.g., 40 dB or less). The first predetermined gain level may correspond to one of different average hearing loss levels (e.g., levels 604, 704, or 804). For example, a demographic person having an average hearing loss level 604 and possibly not having hearing loss levels 704 and 804 may be expected to hear at a level of 40 dB or less.

[0063] During playback of the first audio signal at the first amplification level, the user may select an audibility selection element 1102 or an inaudibility selection element 1104 of a graphical user interface displayed on the audio signal device 102 of the media system 100. More specifically, after listening to the first setting, the user may make a selection indicating whether the output audio signal has a loudness that is audible to the user. The user may select the audibility selection element 1102 to indicate that the output level is audible. In contrast, the user may select the inaudibility selection element 1104 to indicate that the output level is inaudible.

[0064] After selecting the audibility selection element 1102 or the inaudibility selection element 1104, the user may select the selection element 1106 to provide the system with a selection. When the system receives the selection of the audibility selection element 1102, the system may determine the user's personal average gain level based on the selection indicating whether the output audio signal is audible to the user. For example, when the system receives the selection of the audibility selection element 1102 during the first stage of the first level, the system may determine that the user's personal average gain level corresponds to the average hearing loss level 604 of the mild hearing loss curve group. The hearing loss curve group can be used as a basis for further exploring level and frequency-dependent audio filters in the second stage of the registration procedure. In contrast, the selection of the inaudibility selection element 1104 during the first stage can cause the registration procedure to proceed to the second stage of the first stage of the registration procedure.

[0065] In the second stage of the first stage, the first audio signal may be played at a second amplification level. For example, the speech signal may be output at a higher level (e.g., 55 dB). After listening to the second setting, the user may select the audibility selection element 1102 or the inaudibility selection element 1104 to indicate whether the speech signal is audible.

[0066] After selecting the audibility selection element 1102 or the inaudibility selection element 1104, the user may select the selection element 1106 to provide the system with a selection. The system may determine the personal average gain level based on the selection indicating whether the output audio signal is audible to the user. For example, when the system receives the selection of the audibility selection element 1102 during the second stage of the first level, the system may determine that the user's personal average gain level corresponds to the average hearing loss level 704 of the mild to moderate hearing loss curve group. The hearing loss curve group can be used as a basis for further exploring level and frequency-dependent audio filters in the second stage of the registration procedure. In contrast, when the system receives the selection of the inaudibility selection element 1104 during the second stage, the system may determine that the user's personal average gain level corresponds to the average hearing loss level 804 of the moderate hearing loss curve group. The hearing loss curve group can be used as a basis for further exploring level and frequency-dependent audio filters in the second stage of the registration procedure.

[0067] One or more predetermined gain levels can be used during the first stage to generate and / or output the first audio signal in the order of gain increase. For example, as described above, as the user proceeds through the first stage of the registration program, the first audio signal can be output at 40dB during the first stage, and then at 55dB during the second stage. The voice signal can be played back with the increased predetermined gain level until the individual average gain level is determined. The individual average gain level can be determined by selecting the audibility selection element 1102 or selecting the inaudibility selection element 1104. For example, if the user selects the audibility selection element 1102 when the voice signal is output at 55dB, the individual average gain level corresponding to the mild to moderate hearing loss curve is determined. In contrast, if the user selects the inaudibility selection element 1104 after the voice signal is output at 55dB, the individual average gain level corresponding to the moderate hearing loss curve is determined.

[0068] The first audio signal may be set at a calibration level, and thus volume adjustment during the first stage of the registration process may not be permitted. More specifically, one or more processors of the media system 100 may disable volume adjustment of the media system 100 during output of the first audio signal. By locking the volume control of the media system 100 during the first stage of the registration process, the gain level that compensates for the hearing loss may be set to a predetermined gain level that corresponds to a common hearing loss curve being tested. Thus, these levels may be explored using speech stimuli at predetermined levels that are fixed during the assessment.

[0069] refer to Fig.12 , shows a diagram of the selection of level and frequency dependent audio filter banks for exploration in the second stage of the enrollment procedure according to one aspect. The selection during the first stage of the enrollment procedure drives the level and frequency dependent audio filter banks that can be used for exploration during the second stage of the enrollment procedure.

[0070] When a speech signal is presented at a first level (e.g., 40 dB) during a first stage of a first level of a registration procedure, a user makes a selection to indicate whether the output audio signal is audible. The selection of the audibility selection element 1102 indicates that the first level is audible, and may be referred to as a first stage audibility selection 1200. The system may determine, based on the first stage audibility selection 1200, that a zero gain audio filter and / or a first set of level and frequency dependent audio filters (1F, 1N, and 1S) have a corresponding average gain level equal to the user's personal average gain level. More specifically, the system may determine, in response to the first stage audibility selection 1200, that the user's personal average gain level is one of the average gain levels of the zero gain audio filter or the first set of level and frequency dependent audio filters (1F, 1N, and 1S). For example, the zero gain audio filter may have an average gain level of zero, and the first set of filters may have an average gain level corresponding to the first set 602 of hearing loss curves. One or more of the audio filters may be explored during a second stage of the registration procedure to further narrow the determination, as described below.

[0071] When the speech signal is presented at a second level (e.g., 55 dB) during the second stage of the first level of the registration procedure, the user makes a selection to indicate whether the output audio signal is audible. The selection of the audibility selection element 1102 indicates that the second level is audible, and may be referred to as a second stage audibility selection 1204. The system may determine that the second group of level and frequency-dependent audio filters (2F, 2N, and 2S) have an average gain level equal to the user's personal average gain level based on the second stage audibility selection 1204. More specifically, the user's personal average gain level may be determined as the average gain level of the second group. For example, the second group of filters may have an average gain level corresponding to the second group 702 hearing loss curve. One or more of the audio filters of the second group may be explored during the second stage of the registration procedure, as described below.

[0072] The selection of the inaudibility selection 1104 during the presentation of the speech signal at the second level indicates that the second level is inaudible and may be referred to as a second stage inaudibility selection 1206. The system may determine, based on the second stage inaudibility selection 1206, that a third set of level- and frequency-dependent audio filters (3F, 3N, and 3S) has an average gain level equal to the user's personal average gain level. More specifically, the user's personal average gain level may be determined as the average gain level of the third set. For example, the third set of filters may have an average gain level corresponding to the third set 802 hearing loss curve. One or more of the audio filters of the third set may be explored during the second stage of the enrollment procedure, as described below.

[0073] In the second stage of the registration process, the user may explore the determined set of level and frequency dependent audio filters to select a personal gain profile. The personal gain profile may correspond to a user preferred gain profile (flat profile, notched profile or tilted profile) that adjusts the tonal characteristics of the audio input signal according to the user's preferences.

[0074] refer to Fig.13 , shows a diagram of a user interface for controlling output of a second audio signal according to an aspect. During the registration process, the media system 100 can output the second audio signal using a set of level and frequency dependent audio filters. The second audio signal can represent music, such as a music file containing recorded music. Music provides good contrast between timbre (compared to speech), and therefore can facilitate selecting an appropriate gain profile during the second stage of the registration process. More specifically, playing music rather than speech during the second stage allows the user's timbre or pitch preference to be accurately determined.

[0075] During the second stage, the audio input signal 404 may be sequentially reproduced with different tone enhancement settings for the user. More specifically, the second audio signal is output using a level and frequency-dependent audio filter group determined in response to the first stage audibility selection 1200, the second stage audibility selection 1204, or the second stage inaudibility selection 1206. Each member in the group may have a different gain profile. For example, each group (except the zero gain audio filter) may include a flat audio filter corresponding to a flat loss profile of a common hearing loss curve, a notch audio filter corresponding to a notch loss profile of a common hearing loss curve, and a tilted audio filter corresponding to a tilted loss profile of a common hearing loss curve. It should be understood that with reference to the above loss profiles and the inverse relationship between the loss profiles and the corresponding gain profiles, the gain profile of the flat audio filter has the highest gain in the low frequency band, the gain profile of the notch audio filter has the highest gain in the mid-frequency band, and the gain profile of the tilted audio filter has the highest gain in the high frequency band. The audio filter is applied to the second audio signal to play back the audio signal so that different frequencies corresponding to different hearing loss profiles are apparent.

[0076] The user may select the current tuning element 1304 to play the second audio signal using the first playback setting. Fig.12When the first stage audibility selection 1200 is made in the present embodiment, the second audio signal can be played back without audio filtering (zero gain filter) as the current tuning. The user can select the modified tuning element 1306 to play the second audio signal using a second audio filter with a corresponding gain profile, which is different from the gain profile of the first setting. For example, the modified tuning can play the second audio signal using a (1F) audio filter. When the user has identified a preferred setting (e.g., a tuning that allows the user to better listen to the music of the second audio signal), the user can select the selection element 1106. Alternatively, the user can make the selection through a physical switch, such as by tapping a button on the audio signal device 102 or the audio output device 104.

[0077] refer to Fig.14A , a diagram showing selection of level and frequency-dependent audio filters with different gain profiles according to an aspect. During the second stage of the registration process, different enhancement settings are presented to the user and the user is asked to select a preferred setting. The enhancement settings include a set of level and frequency-dependent audio filters applied to a second audio signal based on the selection made during the first stage of the registration process. The audio filters in the set may correspond to hearing loss curves with different loss profiles.

[0078] In the illustrated example, Fig.12 The system may then select a second set of level and frequency dependent audio filters to explore. The selection of the current tuning element 1304 uses the filter corresponding to Figure 7 The second audio signal is played back using a flat gain profile (2F) audio filter with a flat loss profile 706. In contrast, the selection of the modified tuning element 1306 uses a filter corresponding to Figure 7 The second audio signal is played back using a notch gain profile (2N) audio filter with a notch loss profile 708. The user may select a preferred setting and then select a selection element 1106 to proceed to the next operation in the second stage. For example, the user may (as shown) select a current tuning element 1304 to select a filter corresponding to a flat loss profile and proceed to the next operation.

[0079] The second level of the registration process may require Fig.14A More specifically, even when the user selects a current tuning (e.g., a (2F) audio filter) during the second stage, the registration process can provide an additional comparison between the current tuning and subsequent tunings. Fig.14A Subsequent tuning that may be applied to the second audio signal is shown in the columns of the grid of More specifically, the additional modified tuning may correspond to a tilted loss profile for each of the possible average gain level settings.

[0080] refer to Fig. 14B , shows a diagram of selection of level and frequency dependent audio filters with different gain profiles according to an aspect. At the next operation in the second stage of registration, the second audio signal may be modified by (2F) level and frequency dependent audio filters corresponding to the previously selected gain profile setting and the next gain profile setting (2S). In an aspect, all tunings applied to the second audio signal during the second stage of registration have the same average gain level. More specifically, the flat gain profile (2F), notch gain profile (2N), and tilted gain profile (2S) applied to the second audio signal for comparison of pitch adjustments may all have a personal average gain level determined during the first stage of registration. The personal average gain level may correspond to, for example, the average gain loss 704 of the mild to moderate hearing loss group curve. When the user has listened to the second audio signal modified by all filters, the user may select a preferred tuning (e.g., the modified tuning 1306). The media system 100 may receive a selection selected by the user as a personal gain profile 1402. For example, the personal gain profile 1402 may be a tilted gain profile (2S).

[0081] Compared to the first stage of the registration process, volume adjustment of the media system 100 may be enabled during the output of the second audio signal. Allowing volume adjustment may help distinguish the tonal characteristics of different audio signal adjustments. More specifically, allowing the user to use the volume control 1302 ( Fig.13 ) Adjusting the volume of the media system 100 allows the user to hear the difference between each tonal setting. Thus, the second stage of the registration process allows the user to explore the gain profile using a musical stimulus that stimulates all frequencies in the audible frequency range, and encourages volume changes to allow the user to distinguish the tonal characteristics of the altered musical stimulus.

[0082] The sequence of presentations of the filtered audio signal allows the user to step through the registration process to first determine a personal average gain level and then a personal gain profile. More specifically, the user may first select a personal average gain level by selecting a setting at which the first audio signal is audible, and then select a personal gain profile 1402 by stepping through the grid in the vertical direction along the shape axis. Each square of the grid represents a level and frequency-dependent audio filter having a corresponding average gain level and gain profile, and thus, the illustrated example (3×3 grid) assumes that the personal level and frequency-dependent audio filter 402 generated by the registration process will be one of 9 level and frequency-dependent audio filters corresponding to 9 common hearing loss profiles. This level of granularity (e.g., three level groups and three profile groups) has been shown to consistently guide the user to select a preset that the user consistently prefers, regardless of whether the selected preset exactly matches their hearing loss profile. However, it should be understood that the number of presets used in the registration process may vary. For example, the first stage of the registration process may allow the user to step through four or more predetermined gain levels to drive the selection of an audio filter group having a personal average gain level. Similarly, more or fewer gain contours may be represented across the shape axes of the grid to allow the user to evaluate different tonal enhancements.

[0083] refer to Fig.15 , a flow chart of a method for selecting a personal level and frequency-dependent audio filter having a personal average gain level and a personal gain profile according to an aspect is shown. The flow chart shows a registration process stage for selecting a level and frequency-dependent audio filter from an audio filter grid having columns and rows.

[0084] As described above, the registration process allows the user to first explore the level to determine the correct column within the audio filter grid to further explore the profile. At operation 1502, in the first stage of the registration process, the user listens to an audio signal at a predetermined level (e.g., 40dB level). The predetermined level is a presentation level generated by a predetermined gain level applied to a voice audio signal. At operation 1504, the media system 100 determines whether the user can listen to the current presentation level. For example, if the user can listen to a 40dB level generated by a predetermined gain level audio filter, the user selects the audibility selection element 1102 to identify the current level as corresponding to the personal average gain level. In this case, the system determines that the personal average gain level is the average gain level of a zero gain filter or (1F, 1N, 1S) audio filter bank. However, if the user selects the inaudibility selection element 1104, then at operation 1506, the first decision sequence iterates to the next predetermined level (e.g., 55dB level). The next predetermined level is a presentation level generated by the next predetermined gain level applied to the voice audio signal. The audio signal can be presented at the next predetermined level at operation 1502. At operation 1504, the media system 100 determines whether the user can listen to the current level. If the user can listen to the current level, the user selects the audibility selection element 1102 to identify the current level as corresponding to the personal average gain level. In this case, the system determines that the personal average gain level is the average gain level of the (2F, 2N, 2S) audio filter bank. However, if the user selects the inaudibility selection element 1104, the system determines that the personal average gain level is the average gain level of the (3F, 3N, 3S) audio filter bank. Which level the user selects as audible during iteration can be used to drive the determination of the personal average gain level. When the user selects an audible level, the system can determine the audio filter bank for further exploration with an average gain level corresponding to the selected predetermined gain level. More specifically, the personal average gain level can be determined according to the audibility selection, and the registration process can continue to the second level.

[0085] As described above, the registration process allows the user to explore the gain contours within the selected audio filter bank to determine the correct row within the audio filter grid, and thus arrive at the square within the grid that represents the personal level and frequency-dependent audio filter 402. At operation 1508, in the second stage of the registration process, the user compares several shape audio signals.

[0086] In a special case, the user makes a first stage audibility selection 1200, and the system determines that a zero gain audio filter or a (1F, 1N, 1S) audio filter bank corresponds to the user's personal average gain level. In this case, the music file is played at decision sequence 1508. At decision sequence 1508, a comparison may be made between a zero gain audio filter (or no filter) applied to the music audio signal and a low gain flat audio filter (1F) applied to the music audio signal. If, for example, a zero gain audio filter is selected again via the current tuning element 1304, the process may iterate to compare the zero gain audio filter to the low gain notch audio filter (1N). If, for example, a zero gain audio filter is selected again via the current tuning element 1304, the registration process may end and no audio filter is applied to the audio input signal 404. More specifically, as the flowchart advances through a sequence in which the user selects a zero gain audio filter on several levels corresponding to the hearing loss curve and the associated audio filter, the media system 100 determines that the user has normal hearing and does not make adjustments to the default audio settings of the system. It can also be constructed as a personal level and frequency dependent audio filter with a personal average gain level of zero and a personal gain profile that is non-adjusted.

[0087] However, in the event that the user selects a non-zero personal average gain level, e.g., by selecting the second stage audibility selection 1204 or the second stage inaudibility selection 1206 during the first stage, or by selecting the (1F) or (1N) audio filter at the initial operation 1508 of the second stage, the shape audio signal comparison at operation 1508 is performed between the non-zero gain audio filters applied to the music audio signal. For example, if the second stage audibility selection 1204 drives the selection of the (2F, 2N, 2S) audio filter bank for further exploration, then at operation 1508, the (2F) audio filter may be applied to the music audio signal as the current tuning, and the low level notch audio filter (2N) may be applied to the music audio signal as the altered tuning. The filtered audio signal may be presented to the user as the corresponding shape audio signal. At operation 1510, the media system 100 determines whether the user has selected the personal gain profile 1402. The personal gain profile 1402 is selected after the user has listened to all the shape audio signals and selected the preferred shape audio signal. For example, if the user selects the (2F) audio filter instead of the (2N) audio filter at operation 1508, the (2F) audio filter is a candidate for the personal gain profile 1402. At operation 1512, the second stage iterates to the next shape audio signal comparison. For example, the (2F) audio filter selected during the previous iteration can be applied to the music audio signal, and the low level shelving audio filter (2S) can be applied to the music audio signal. At operation 1508, the filtered audio signal can be presented to the user as a corresponding shape audio signal, and the user can select a preferred shape audio signal. At operation 1510, the media system 100 determines whether the user has selected the personal gain profile 1402. For example, if the user selects the (2S) audio filter, the media system 100 identifies the selection as the personal gain profile 1402, as long as the user selects the audio filter and all shape audio signals have been presented to the user for selection.

[0088] After exploring the level and profile settings, at operation 1002, the media system selects a personal level and frequency-dependent audio filter 402. More specifically, the user identifies a particular square in the grid, for example, based in part on a personal level and frequency-dependent audio filter 402 having a personal average gain level determined from the first stage, and in part on a personal level and frequency-dependent audio filter 402 having a personal gain profile 1402 determined from the second stage. The process may use the selected filter having the personal average gain level and the personal gain profile 1402 in a verification operation. In the verification operation, the personal level and frequency-dependent audio filter 402 identified during the registration process may be used by the media system 100 to output and playback an audio signal (e.g., a music audio signal). The verification operation allows the user to adjust between the selected preset playback and normal playback (no adjustment), so that the user can confirm that the adjustment is actually an improvement. When the user agrees that the personal level and frequency-dependent audio filter improves the listening experience, the user may select an element (e.g., "Done") to complete the registration process.

[0089] At the end of the registration process, the personal level and frequency dependent audio filter 402 is identified as the audio filter having the user's preferred personal average gain and / or personal gain profile 1402. Thus, at operation 1002, the media system 100 may select the personal level and frequency dependent audio filter 402 based in part on the personal level and frequency dependent audio filter 402 having the personal average gain level and in part on the personal level and frequency dependent audio filter 402 having the personal gain profile 1402, as determined by the registration process.

[0090] In alternative embodiments, the registration procedure may differ from the above with respect to Figures 11 to 15 The following is relative to the process described. Figures 16 to 20 Describes alternative embodiments. Fig.11 and Fig.15 Similar to the implementation scheme, Figures 16 to 20The embodiment of the invention allows the user to select one or more of the level and frequency-dependent audio filters, and through the user selection, the media system 100 can determine and / or select the appropriate personal level and frequency-dependent audio filter to apply to the user's audio input signal. Referring to 16, a diagram of a user interface for controlling the output of a first audio signal according to an aspect is shown. During the registration process, the media system 100 can output the first audio signal using a first set of level and frequency-dependent audio filters. For example, the first audio signal can represent speech (e.g., a voice file) containing recorded greetings spoken in languages ​​from all over the world. Speech has a good contrast between gain levels (compared to music), and thus can facilitate the selection of an appropriate average gain level during the first stage of the registration process. During the first stage, the audio input signal 404 can be reproduced sequentially with different enhancement settings for the user. More specifically, level and frequency-dependent audio filters with different average gain levels can be applied to the first audio signal to play back the audio signal at different average gain levels corresponding to different average hearing loss levels (e.g., levels 604, 704, or 804).

[0091] The user may select the current tuning element 1602 of the graphical user interface displayed on the audio signal device 102 of the media system 100 to play the first audio signal at a first amplification level. After listening to the first setting, the user may select the modified tuning element 1604 of the graphical user interface to play the first audio signal at a second amplification level higher than the first amplification level. When the user has identified a preferred setting (e.g., a tuning that allows the user to better hear the voice of the first audio signal), the user may select the selection element 1606 of the graphical user interface. Alternatively, the user may make a selection through a physical switch, such as by tapping a button on the audio signal device 102 or the audio output device 104. If the user selects the selection element 1606 when the current tuning element 1602 is enabled, the selection may be the personal average gain level 1702. More specifically, when the user decides to continue the registration process using the current tuning, the personal average gain level 1702 may be the average gain level applied to the first audio signal. Alternatively, the user may choose to continue the registration with the modified tuning element 1604 enabled. In this case, the selection advances the registration process to the next operation in the first stage. In the next operation, the first audio signal may be reproduced by another pair of level- and frequency-dependent audio filters.

[0092] refer to Fig.17A, a diagram showing selection of level and frequency dependent audio filters with different average gain levels according to one aspect. During a first stage of the enrollment process, different enhancement settings are presented to a listener, and the listener is asked to select a preferred setting. The enhancement settings include a first set of level and frequency dependent audio filters applied to a first audio signal, and these filters may correspond to hearing loss curves with different average gain levels. For example, the current tuning may initially be a zero average gain level (no gain level applied to the input signal, or "off"). The modified tuning may correspond to Figure 6 The level and frequency dependent audio filter (1F) of one of the loss profiles in the first group 602 (first level, flat profile). It should be understood that in Fig.17A The top row of the grid of shows the subsequent tunings that can be applied to the first audio signal. More specifically, the additional modified tunings (2F) and (3F) correspond to Figure 7 The loss profile of the second group 702 (second level, flat profile) and Figure 8 The loss profile of the third group 802 (third level, flat profile). Fig.17A At the first level shown, the user may listen to the first audio signal with the current tuning and the modified tuning applied, and select the modified tuning, thereby indicating the user's preference to apply more gain to the first audio signal. Fig. 17B , shows a diagram of selection of level and frequency dependent audio filters with different average gain levels according to one aspect. At the next operation in the first stage of registration, the first audio signal can be modified by the (1F) level and frequency dependent audio filter as the current tuning. The first audio signal can also be modified by the (2F) level and frequency dependent audio filter as the modified tuning. In one aspect, all tunings applied to the first audio signal during the first stage of registration have the same gain profile. For example, the tuning can correspond to Figures 6 to 8 The filters shown have a flat loss profile, and therefore can all have a flat gain profile (which is negatively correlated with the flat loss profile). Fig. 17B The current tuning in may have a value corresponding to Figure 6 The average loss level 604 of the average gain level, and the modified tuning may have a value corresponding to Figure 7 The media system 100 may receive the user's selection as a selection of the personal average gain level 1702 (eg, 20 dB).

[0093] It should be understood that if the user prefers Fig. 17BIf the modified tuning is selected in the first level, the selection of the modified tuning will cause the registration process to proceed to the next operation in the first level. In the next operation, the corresponding Figure 7 and Figure 8 The first audio signal is reproduced by using the level and frequency dependent audio filters (2F) and (3F) according to the loss profile in. For the sake of simplicity, the description of such operation is omitted here.

[0094] In one aspect, the first audio signal is output to a user using a first set of level and frequency dependent audio filters in order of increasing average gain level. Fig.17A , presents the current tuning with zero gain and corresponds to Figure 6 The first audio signal is tuned (1F) with an average hearing loss 604 (eg, an average gain level of 20 dB). Fig. 17B In the example, the Figure 6 and Figure 7 The first audio signal of tuning (1F) and (2F) for average hearing losses (e.g., average gain levels of 20 dB and 35 dB) may be presented for each of the following examples. Thus, the audio signal changes may be presented in order of increasing gain. It should be appreciated that, as described above, presenting the audio signal level comparisons in increasing order may speed up the registration process. More specifically, since it is uncommon for a user to want the third gain level more than the first gain level, but not the second gain level more than the first gain level, it does not make sense to present the third gain level if the user has already selected the first gain level instead of the second gain level. Eliminating the additional comparison (comparing the third gain level to the first gain level) may shorten the registration process.

[0095] On the one hand, the first audio signal may be embedded with some noise to provide a sense of realism for the listening experience. By way of example, the first audio signal may include a speech signal representing speech and a noise signal representing noise. The speech signal and the noise signal may be embedded in a specific ratio so that an increase in the level of the first audio signal causes an increase in the level of both the speech and noise audio content in the voice file. For example, the ratio of the speech signal to the noise signal may be in the range of 10dB to 30dB (e.g., 15dB). The ratio may be high enough so that the noise does not overpower the speech. However, with each increase in the average gain level, the progressive amplification of the noise may prevent the user from selecting a level and frequency-dependent audio filter that unnecessarily increases the volume of the audio signal. More specifically, the embedded noise provides a sense of realism to help the user select an amplification level that compensates but does not overcompensate for the user's hearing loss.

[0096] The first audio signal may be set at a calibrated level, and thus volume adjustment during the first stage of the registration process may not be permitted. More specifically, one or more processors of the media system 100 may disable volume adjustment of the media system 100 during output of the first audio signal. By locking the volume control of the media system 100 during the first stage of the registration process, the gain level that compensates for the hearing loss may be set to an average gain level of the audio filter that corresponds to the level and frequency dependence of the common hearing loss curve being tested. Thus, a fixed level of speech stimulation may be used to explore the level.

[0097] In addition to allowing selection of a personal average gain level during the first stage 1702, the registration process may also include a second stage to select a personal gain profile. The personal gain profile may correspond to a user-preferred gain profile (flat profile, notched profile, or sloped profile) that adjusts the tonal characteristics of the audio input signal according to the user's preferences.

[0098] Referring to 18, a diagram of a user interface for controlling the output of a second audio signal according to an aspect is shown. During the registration process, the media system 100 can output the second audio signal using a second set of level and frequency dependent audio filters. The second audio signal can represent music, such as a music file containing recorded music. Music provides good contrast between timbre (compared to speech), and therefore can facilitate selecting an appropriate gain profile during the second stage of the registration process. More specifically, playing music rather than speech during the second stage allows the user's timbre or pitch preference to be accurately determined.

[0099] During the second stage, the audio input signal 404 may be sequentially reproduced with different pitch enhancement settings for the user. More specifically, the second set of level- and frequency-dependent audio filters for outputting the second audio signal may have different gain profiles. The second set may include a flat audio filter corresponding to a flat loss profile of a common hearing loss curve, a notch audio filter corresponding to a notch loss profile of a common hearing loss curve, and a tilted audio filter corresponding to a tilted loss profile of a common hearing loss curve. It should be understood that with reference to the above loss profiles and the inverse relationship between the loss profiles and the corresponding gain profiles, the gain profile of the flat audio filter has the highest gain in the low frequency band, the gain profile of the notch audio filter has the highest gain in the mid-frequency band, and the gain profile of the tilted audio filter has the highest gain in the high frequency band. The audio filters are applied to the second audio signal to play back the audio signal so that different frequencies corresponding to different hearing loss profiles are apparent.

[0100] The user may select the current tuning element 1602 to play the second audio signal using the first audio filter having a corresponding gain profile. After listening to the first setting, the user may select the modified tuning element 1604 to play the second audio signal using the second audio filter having a corresponding gain profile that is different from the gain profile of the first audio filter. When the user has identified a preferred setting (e.g., a tuning that allows the user to better listen to the music of the second audio signal), the user may select the selection element 1606. Alternatively, the user may make a selection via a physical switch, such as by tapping a button on the audio signal device 102 or the audio output device 104.

[0101] refer to Fig.19A , shows a diagram of selection of level and frequency-dependent audio filters with different gain profiles according to an aspect. During a second stage of the enrollment process, different enhancement settings are presented to the listener and the listener is asked to select a preferred setting. The enhancement settings include a second set of level and frequency-dependent audio filters applied to a second audio signal, and these filters may correspond to hearing loss curves with different loss profiles. For example, the current tuning may initially correspond to Figure 6 The modified tuning may correspond to Figure 6 The (1N) level and frequency dependent audio filter of the notch loss profile 608. The user may prefer a filter corresponding to a flat loss profile and may select selection element 1606 to proceed to the next operation in the second stage.

[0102] The first stage of the registration process does not need to present all average gain level settings (such as in the cross Fig.17A The second level of the registration process may require Fig.19A More specifically, the registration process can provide additional comparisons between the current tuning and subsequent tunings even when the user selects the current tuning during the second stage. Fig.19A Subsequent tuning that may be applied to the second audio signal is shown in the columns of the grid of More specifically, the additional modified tuning may correspond to a tilted loss profile for each of the possible average gain level settings.

[0103] refer to Fig. 14B, shows a diagram of selection of level and frequency-dependent audio filters with different gain profiles according to an aspect. At the next operation in the second stage of registration, the second audio signal may be modified by (1F) level and frequency-dependent audio filters corresponding to the previously selected gain profile setting and the next gain profile setting (1S). In an aspect, all tunings applied to the second audio signal during the second stage of registration have the same average gain level. More specifically, the flat gain profile (1F), notch gain profile (1N), and tilted gain profile (1S) applied to the second audio signal for comparison of pitch adjustments may all have the personal average gain level 1702 selected during the first stage of registration. When the user has listened to the second audio signal modified by all filters, the user may select a preferred tuning (e.g., a modified tuning). The media system 100 may receive a selection selected by the user as a personal gain profile 1902. For example, the personal gain profile 1902 may be a tilted gain profile (1S).

[0104] Compared to the first stage of the registration process, volume adjustment of the media system 100 may be enabled during the output of the second audio signal. Allowing volume adjustment may help distinguish the tonal characteristics of different audio signal adjustments. More specifically, allowing the user to use the volume control 2302 ( Fig.18 ) Adjusting the volume of the media system 100 allows the user to hear the difference between each tonal setting. Thus, the second stage of the registration process allows the user to explore the gain profile using a musical stimulus that stimulates all frequencies in the audible frequency range, and encourages volume changes to allow the user to distinguish the tonal characteristics of the altered musical stimulus.

[0105] The sequence of presentation of the filtered audio signal allows the user to step through the grid in the horizontal direction during the first stage, and in the vertical direction during the second stage. More specifically, the user may first select a personal average gain level 1702 by stepping through the grid in the horizontal direction along the horizontal axis, and then select a personal gain profile 1902 by stepping through the grid in the vertical direction along the shape axis. Each square of the grid represents a level- and frequency-dependent audio filter having a corresponding average gain level and gain profile, and thus, the illustrated example (3×3 grid) assumes that the personal level- and frequency-dependent audio filter 402 generated by the registration process will be one of 9 level- and frequency-dependent audio filters corresponding to 9 common hearing loss profiles. This level of granularity (e.g., three level groups and three profile groups) has been shown to consistently guide the user to select a preset that the user consistently prefers, regardless of whether the selected preset exactly matches their hearing loss profile. However, it should be understood that the number of presets used in the registration process may vary. For example, the first stage of the registration process may allow the user to step through four or more average gain levels across a grid with more columns. Similarly, more or fewer gain contours may be represented across the shape axes of the grid to allow the user to evaluate different tonal enhancements.

[0106] refer to Fig. 20 , a flow chart of a method for selecting a personal level and frequency-dependent audio filter having a personal average gain level and a personal gain profile according to an aspect is shown. The flow chart shows a registration process stage for selecting a level and frequency-dependent audio filter from an audio filter grid having columns and rows.

[0107] As described above, the registration process allows the user to first explore the level to determine the correct column within the audio filter grid. At operation 2002, in the first stage of the registration process, the user compares several horizontal audio signals, such as the current gain level and the next gain level. For example, a zero gain audio filter (no gain or "off") can be applied to the voice audio signal as the current gain level, and a low gain flat audio filter (1F) can be applied to the voice audio signal as the next gain level. The filtered audio signal can be presented to the user as a corresponding horizontal audio signal. At operation 2004, the media system 100 determines whether the user is satisfied with the current level. For example, if the user is satisfied with the zero gain audio filter, the user selects the zero gain audio filter as the personal gain level 1702. However, if the user selects the next audio level (e.g., (1F) level and frequency-dependent audio filter) at operation 2006, the first decision sequence iterates to the next horizontal audio signal comparison. For example, a (1F) filter can be applied to the voice audio signal as the current gain level, and a medium gain flat audio filter (2F) can be applied to the voice audio signal as the next gain level. The filtered audio signal may be presented to the user as a corresponding level audio signal at operation 2002, and the user may select a preferred level audio signal. At operation 2004, the media system 100 determines whether the user is satisfied with the current level. If the user is satisfied with the current level, the user selects the current level, and the system determines the current level as the personal gain level 1702. If the user is more satisfied with the next level, the user selects the next gain level, and the system iterates to allow the next set of level audio signals to be compared. For example, the sequence advances to allow the user to also compare a medium gain flat audio filter (2F) and a high gain flat audio filter (3F). Whichever of the current levels the user selects during the iteration may be determined as the personal average gain level 1702. More specifically, when the user selects a zero gain audio filter, a (1F) filter, a (2F) filter, or a (3F) filter at a point in the process when the selected filter is the current audio filter (compared to the next audio filter), it may be determined that the selected audio filter has a personal gain profile 1702 and the registration process may continue to the second stage.

[0108] As described above, the registration process allows the user to explore the gain profile within the selected gain level to determine the correct row within the audio filter grid, and thus arrive at the square within the grid that represents the personal level and frequency-dependent audio filter 402. At operation 2008, in the second stage of the registration process, the user compares several shape audio signals.

[0109] In a special case, the user selects a zero gain audio filter as the personal gain level during the first stage. In this case, the voice file is played at decision sequence 2008. Similar to decision sequence 2002, at decision sequence 2008, a comparison may be made between the zero gain audio filter applied to the voice audio signal and the low gain notch audio filter (1N) applied to the voice audio signal. If the zero gain audio filter is selected again, the process may iterate to compare the zero gain audio filter with the high gain shelving audio filter (1S). If the zero gain audio filter is selected again, the registration process may end and the audio filter is not applied to the audio input signal 404. More specifically, when the flowchart advances through a sequence in which the user selects a zero gain audio filter on several levels corresponding to the hearing loss curve and the associated audio filter, the media system 100 determines that the user has normal hearing and does not adjust the default audio settings of the system.

[0110] In the event that the user selects a non-zero personal gain level during the first stage, the shape audio signal comparison at operation 2008 is performed between the non-zero gain audio filters applied to the music audio signal. For example, if the (1F) audio filter is selected as the personal gain level at operation 2004, then at operation 2008, the (1F) audio filter may be applied to the music audio signal and the low level notch audio filter (1N) may be applied to the music audio signal. The filtered audio signal may be presented to the user as a corresponding shape audio signal. At operation 2010, the media system 100 determines whether the user has selected a personal gain profile 1902. After the user has listened to all shape audio signals and selected a preferred shape audio signal, the personal gain profile 1902 is selected. For example, if the user selects the (1F) audio filter instead of the (1N) audio filter at operation 2008, then the (1F) audio filter is a candidate for the personal gain profile 1902. At operation 2012, the second stage iterates to the next shape audio signal comparison. For example, the (1F) audio filter selected during the previous iteration may be applied to the music audio signal, and the low level shelving audio filter (1S) may be applied to the music audio signal. The filtered audio signals may be presented to the user as corresponding shaped audio signals at operation 2008, and the user may select a preferred shaped audio signal. At operation 2010, the media system 100 determines whether the user has selected a personal gain profile 1902. For example, if the user selects the (1S) audio filter, the media system 100 identifies the selection as a personal gain profile 1902, as long as the user has selected an audio filter and all shaped audio signals have been presented to the user for selection.

[0111] After exploring the level and profile settings, at operation 1002, the media system selects a personal level and frequency-dependent audio filter 402. More specifically, the user identifies a particular square in the grid, for example, based in part on the personal level and frequency-dependent audio filter 402 having the personal average gain level 1702, and in part on the personal level and frequency-dependent audio filter 402 having the personal gain profile 1902. The process may use the selected filter having the personal gain level 1702 and the personal gain profile 1902 in a verification operation. In the verification operation, the personal level and frequency-dependent audio filter 402 identified during the registration process may be used by the media system 100 to output and playback an audio signal (e.g., a music audio signal). The verification operation allows the user to adjust between the selected preset playback and normal playback (no adjustment), so that the user can confirm that the adjustment is actually an improvement. When the user agrees that the personal level and frequency-dependent audio filter improves the listening experience, the user may select an element (e.g., "Done") to complete the registration process.

[0112] At the end of the registration process, the personal level and frequency dependent audio filter 402 is identified as the audio filter having the user's preferred personal average gain level 1702 and personal gain profile 1902. Thus, at operation 1002, the media system 100 may select the personal level and frequency dependent audio filter 402 based in part on the personal level and frequency dependent audio filter 402 having the personal average gain level 1702 and in part on the personal level and frequency dependent audio filter 402 having the personal gain profile 1902, as determined by the registration process.

[0113] The above registration process drives the media system 100 to select personal level and frequency dependent audio filters 402 based on the assumption that the user's actual hearing loss will be similar to the common hearing loss curve presets stored by the system. It is not necessary to know the user's personal audiogram 500 to complete the registration process. However, when the personal audiogram 500 is available, it can lead to results that are as good or better than the above selection process.

[0114] refer to FIG. 21A to FIG. 21B , respectively show a flow chart and a diagram of a method for determining a plurality of hearing loss curves based on a personal audiogram according to one aspect.

[0115] In contrast to storing general presets for the above-described registration process, the personal audiogram 500 can be used to determine user-specific presets. For example, if the personal audiogram 500 is known, the media system 100 can select a hearing loss curve preset that encompasses the known audiogram and the corresponding level- and frequency-dependent audio filters. The determination of user-specific presets can constrain the range of level- and frequency-dependent audio filters that can be selected during the registration process, which can allow the user to have greater granularity in the selection of personal presets.

[0116] In one aspect, using the personal audiogram 500 to drive the presets available for selection during the registration process may be particularly helpful for users with uncommon hearing loss curves. The media system 100 may receive the personal audiogram 500 at operation 2102. At operation 2104, the media system 100 may determine several hearing loss curves 2110 based on the personal audiogram 500. Similarly, at operation 2106, the media system 100 may determine the level and frequency-dependent audio filters corresponding to the user-specific hearing loss curve presets. The determined hearing loss curves and / or level and frequency-dependent audio filters may be user-specific presets personalized for the user to ensure a good listening experience. For example, the user's average hearing loss 504 may be determined from the personal audiogram 500, and the determined several user-specific presets may include hearing loss curves that each have an average hearing loss value similar to the average hearing loss value of the personal audiogram 500. In one aspect, the average hearing loss value of each of the user-specific presets is within a predetermined variance (eg, + / - 10 dB hearing loss) of the average hearing loss value of the personal audiogram 500. Fig. 21B As shown, each of the user-specific presets may have a different hearing loss profile, even if the average loss levels of the presets are similar. For example, one of the hearing loss curves may have a flat loss profile 2112 that tapers as the frequency increases, one of the hearing loss curves may have a flat loss profile 2114 with an upward inflection point at approximately 4 kHz, and one of the hearing loss curves may have a flat loss profile 2116 with a downward inflection point at approximately 2 kHz. Such loss profiles may be uncommon among the population, but the media system 100 may use audio filters corresponding to uncommon profiles during the registration process.

[0117] In one aspect, the determined level and frequency-dependent audio filters corresponding to user-specific presets are applied to the speech and / or music audio signals. More specifically, the decision tree may be such as with respect to Fig. 20Using the registration process, the user may identify one of the audio filters as the personal level and frequency-dependent audio filter 402 for compensating for the user's hearing loss. Thus, at operation 2108, the personal level and frequency-dependent audio filter 402 is selected from the number of level and frequency-dependent audio filters 2110 for use in operation 1004 ( Fig.10 ) for use.

[0118] refer to FIG. 22A to FIG. 22B , respectively, show a flow chart and a diagram of a method for determining a personal hearing loss curve based on a personal audiogram according to an aspect. The personal audiogram 500 can be used to select a specific hearing loss curve and a corresponding level- and frequency-dependent audio filter from a range of presets stored and / or available at the audio signal device 102. More specifically, the personal audiogram 500 can be used to determine the preset that most closely corresponds to the known audiogram.

[0119] In one aspect, at operation 2202, the media system 100 may receive a personal audiogram 500. At operation 2204, the media system 100 may determine and / or select a personal hearing loss curve 2205 based on the personal audiogram 500. For example, the personal hearing loss curve 2205 may be selected from a number of hearing loss curves stored or available to the media system 100. The selection of the personal hearing loss curve 2205 may be driven by an algorithm for fitting the personal audiogram 500 to a known hearing loss curve. More specifically, the media system 100 may select a personal hearing loss curve 2205 having the same average hearing loss and hearing loss curve as the personal audiogram 500. When the closest match is found, the media system 100 may select the personal hearing loss curve 2205 and determine the level and frequency-dependent audio filters corresponding to the personal hearing loss curve 2205. More specifically, at operation 2206 , the media system 100 may select or determine a personal level and frequency-dependent audio filter 402 corresponding to the personal hearing loss curve 2205 , which may be used to compensate for the user's hearing loss.

[0120] In operation 1004 ( Fig.10 ), the personal level and frequency dependent audio filter 402 selected using one of the above selection processes is applied to the audio input signal 404. Applying the personal level and frequency dependent audio filter 402 to the audio input signal 404 may generate an audio output signal 406. More specifically, the personal level and frequency dependent audio filter 402 may amplify the audio input signal 404 based on the input level 902 and the input frequency 904 of the audio input signal 404. Amplification may enhance the audio input signal 404 in a manner that allows the user to perceive the audio input signal 404 normally.

[0121] In operation 1006 ( Fig.10 ), an audio output signal 406 is output by one or more processors of the media system 100. The audio output signal 406 can be output for playback by an output device. For example, the audio signal device 102 can transmit the audio output signal 406 to the audio output device 104 via a wired or wireless connection. The audio output device 104 can receive the audio output signal 406 and play the audio content to the user. The reproduced audio can be audio from a phone call, music played by a personal media device, the voice of a virtual assistant, or any other audio content delivered to the audio output device 104 by the audio signal device 102.

[0122] refer to Fig.23, a block diagram of a media system according to one aspect is shown. The audio signal device 102 may be any of several types of portable devices or apparatuses having circuits suitable for a particular function. Therefore, the illustrated circuits are provided as embodiments and not limitations. The audio signal device 102 may include one or more device processors 2302 to execute instructions to perform the different functions and capabilities described above. The instructions executed by the device processor 2302 of the audio signal device 102 may be retrieved from the device memory 2304, which may include a non-transitory machine-readable medium or a non-transitory computer-readable medium. The instructions may be in the form of an operating system program with a device driver and / or an accessibility engine, which is used to perform a registration process according to the above method and tune the audio input signal 404 based on the personal level and frequency-dependent audio filter 402. The device processor 2302 may also retrieve audio data 2306 from the device memory 2304, including an audiogram or audio signal associated with the phone and / or a music playback function controlled by a phone or music application running on top of the operating system. To perform such functions, the device processor 2302 may directly or indirectly implement a control loop and receive input signals from other electronic components and / or provide output signals to other electronic components. For example, the audio signal device 102 may receive input signals from a microphone, a menu button, or a physical switch. The audio signal device 102 may generate an audio output signal 406 and output it to a device speaker (which may be an internal audio output device 104) of the audio signal device 102 and / or to an external audio output device 104. For example, the audio output device 104 may be a wired or wireless handset to receive the audio output signal 406 via a wired or wireless communication link. More specifically, the processors of the audio signal device 102 and the audio output device 104 may be connected to corresponding RF circuits to receive and process audio signals. For example, a communication link may be established by a wireless connection using the Bluetooth standard, and the device processor 2302 may wirelessly transmit the audio output signal 406 to the audio output device 104 via the communication link. The wireless output device may receive and process the audio output signal 406 to play audio content as sound, such as a phone call, a podcast, music, etc. More specifically, the audio output device 104 may receive and play back the audio output signal 406 to play the sound from the earpiece speaker.

[0123] The audio output device 104 may include an earpiece processor 2320 and an earpiece memory 2322. The earpiece processor 2320 and the earpiece memory 2322 may perform the functions performed by the device processor 2302 and the device memory 2304 described above. For example, the audio signal device 102 may transmit one or more of an audio input signal 404, a hearing loss curve, or a level and frequency dependent audio filter to the earpiece processor 2320, and the audio output device 104 may use the input signal during a registration process and / or an audio reproduction process to generate an audio output signal 406 using the personal level and frequency dependent audio filter 402. More specifically, the earpiece processor 2320 may be configured to generate the audio output signal 406 and present the signal via the earpiece speaker for audio playback. The media system 100 may include several earpiece components, but in some embodiments, the earpiece processor 2320 may be configured to generate the audio output signal 406 and present the signal via the earpiece speaker for audio playback. Fig.23 Only a single earpiece is shown in FIG. Thus, the first audio output device 104 may be configured to present a left channel audio output, and the second audio output device 104 may be configured to present a right channel audio output.

[0124] As described above, one aspect of the present technology is to collect and use data from various sources to perform personalized media enhancement. The present disclosure contemplates that, in some instances, these collected data may include personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data may include demographic data, location-based data, phone numbers, email addresses, TWITTER IDs, home addresses, data or records related to the user's health or fitness level (e.g., audiograms, vital sign measurements, medication information, exercise information), date of birth, or any other identifying information or personal information.

[0125] The present disclosure recognizes that the use of such personal information data in the present technology can be used to benefit users. For example, personal information data can be used to perform personalized media enhancement. Accordingly, the use of such personal information data enables users to have an improved audio listening experience. In addition, the present disclosure also anticipates other uses of personal information data that benefit users. For example, health and fitness data can be used to provide insights into the user's overall health, or can be used as positive feedback to individuals who use technology to pursue health goals.

[0126] This disclosure envisions that entities responsible for collecting, analyzing, disclosing, transmitting, storing or otherwise using such personal information data will comply with established privacy policies and / or privacy practices. Specifically, such entities should implement and adhere to privacy policies and practices that are recognized as meeting or exceeding industry or government requirements for maintaining the privacy and security of personal information data. Such policies should be easily accessible to users and should be updated as the collection and / or use of data changes. Personal information from users should be collected for legitimate and reasonable purposes of the entity and not shared or sold outside of these legitimate uses. In addition, such collection / sharing should be performed after receiving informed consent from the user. In addition, such entities should consider taking any necessary steps to defend and secure access to such personal information data and ensure that others who have access to personal information data comply with their privacy policies and processes. In addition, such entities may subject themselves to third-party assessments to demonstrate their compliance with widely accepted privacy policies and practices. In addition, policies and practices should be adjusted to specific types of personal information data collected and / or accessed, and to applicable laws and standards including specific considerations of jurisdiction. For example, in the United States, the collection or access of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA), while health data in other countries may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy practices should be maintained in each country for different types of personal data.

[0127] Regardless of the foregoing, the present disclosure also contemplates that users selectively block various aspects of the use or access to personal information data. That is, the present disclosure contemplates that hardware elements and / or software elements may be provided to prevent or block access to such personal information data. For example, with respect to personalized media enhancement, the technology of the present invention may be configured to allow users to choose to "opt in" or "opt out" to participate in the collection of personal information data at any time during or after registration for the service. In addition to providing "opt-in" and "opt-out" options, the present disclosure contemplates providing notifications related to access or use of personal information. For example, a user may be notified that their personal information data will be accessed when downloading an application, and then be reminded again just before the personal information data is accessed by the application.

[0128] Furthermore, it is an object of the present disclosure that personal information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use. Risks can be minimized by limiting data collection and deleting data once it is no longer needed. Additionally, and when applicable, including in certain health-related applications, data de-identification can be used to protect the privacy of users. De-identification can be facilitated by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of stored data (e.g., collecting location data at a city level rather than an address level), controlling how data is stored (e.g., aggregating data across users), and / or other methods, where appropriate.

[0129] Thus, while the present disclosure broadly covers the use of personal information data to implement one or more of the various disclosed aspects, the present disclosure also contemplates that various aspects may also be implemented without access to such personal information data. That is, various aspects of the present technology will not fail to function properly due to the lack of all or a portion of such personal information data. For example, the registration process may be determined based on non-personal information data or an absolute minimum amount of personal information (such as the approximate age of the user, other non-personal information available to the device processor, or publicly available information).

[0130] To assist the Patent Office and any reader of any patent issuing from this application in interpreting the appended claims, applicants wish to note that they do not intend for any of the appended claims or claim elements to invoke 35 USC 112(f) unless the words “means for” or “step for” are expressly used in a particular claim.

[0131] In the foregoing description, the invention has been described with reference to specific exemplary aspects thereof. It will be apparent that various modifications may be made to the specific exemplary aspects without departing from the broader spirit and scope of the invention as set forth in the following claims. Accordingly, the description and drawings are to be regarded in an illustrative rather than a restrictive sense.

Claims

1. A method for enhancing an audio input signal, the method comprising: receiving, by the one or more processors, a selection of an audibility selection element indicative of a user's personal gain level in response to playback of the one or more level audio signals by the speakers; receiving, by the one or more processors, in response to playback of a plurality of shaped audio signals, a selection of a tuning element indicative of a personal gain profile of the user; as well as The personal audio filter of the user is determined, by the one or more processors, based in part on a personal audio filter having the personal gain level and the personal gain profile, wherein the personal audio filter is configured to amplify the audio input signal based on an input level and an input frequency of the audio input signal.

2. The method according to claim 1, wherein the playback of the one or more horizontal audio signals comprises outputting the one or more horizontal audio signals using corresponding predetermined gain levels so that the one or more horizontal audio signals are played back by the speaker at corresponding loudness. 3 . The method of claim 2 , wherein the playback of the one or more horizontal audio signals comprises playing back a plurality of horizontal audio signals in order of increasing loudness. The method of claim 1 , wherein the one or more horizontal audio signals contain speech.

5. The method according to claim 1, further comprising: Volume adjustment of the media system is disabled by the one or more processors during playback of the one or more horizontal audio signals. 6 . The method of claim 1 , wherein the playback of the plurality of shaped audio signals comprises outputting the plurality of shaped audio signals using respective predetermined gain profiles corresponding to a particular hearing loss profile. 7 . The method of claim 6 , wherein the specific hearing loss profile comprises two or more of a flat loss profile, a notched loss profile, or a sloped loss profile. The method of claim 1 , wherein the plurality of shape audio signals represent music.

9. The method of claim 1, wherein the personal gain profile comprises gain variations within an audible frequency range.

10. The method of claim 1, wherein the one or more processors are further configured to enable volume adjustment of a media system during playback of the plurality of shape audio signals.

11. The method according to claim 1, further comprising: generating, by the one or more processors, an audio output signal by applying the personal audio filter to the audio input signal; as well as The audio output signal is transmitted to an audio output device for playback by the audio output device.

12. A media system, comprising: One or more processors configured to: receiving, in response to playback of the one or more level audio signals by the speaker, a selection of an audibility selection element indicative of a user's personal gain level; receiving, in response to playback of a plurality of shaped audio signals, a selection of a tuning element indicative of a personal gain profile of the user, and The personal audio filter of the user is determined based in part on a personal audio filter having the personal gain level and the personal gain profile, wherein the personal audio filter is one of a plurality of level- and frequency-dependent audio filters and is configured to amplify the audio input signal based on an input level and an input frequency of the audio input signal.

13. The media system of claim 12, wherein playback of the one or more horizontal audio signals comprises outputting the one or more horizontal audio signals using corresponding predetermined gain levels so that the one or more horizontal audio signals are played back by the speaker at corresponding loudness.

14. The media system of claim 13, wherein the playback of the one or more horizontal audio signals comprises playing back a plurality of horizontal audio signals in order of increasing loudness.

15. The media system of claim 12, wherein playback of the plurality of shaped audio signals comprises outputting the plurality of shaped audio signals using respective predetermined gain profiles corresponding to a particular hearing loss profile.

16. The media system of claim 15, wherein the specific hearing loss profile comprises two or more of a flat loss profile, a notched loss profile, or a sloped loss profile.

17. A non-transitory computer readable medium containing instructions, which when executed by one or more processors of a media system causes the media system to perform a method comprising: receiving, in response to playback of the one or more level audio signals by the speaker, a selection of an audibility selection element indicative of a user's personal gain level; receiving, in response to playback of a plurality of shaped audio signals, a selection of a tuning element indicative of a personal gain profile of the user; as well as The personal audio filter of the user is determined based in part on a personal audio filter having the personal gain level and the personal gain profile, wherein the personal audio filter is one of a plurality of level- and frequency-dependent audio filters and is configured to amplify the audio input signal based on an input level and an input frequency of the audio input signal.

18. The non-transitory computer-readable medium of claim 17, wherein playback of the one or more horizontal audio signals comprises outputting the one or more horizontal audio signals using corresponding predetermined gain levels so that the one or more horizontal audio signals are played back by the speaker at corresponding loudness.

19. The non-transitory computer-readable medium of claim 18, wherein the playback of the one or more horizontal audio signals comprises playing back a plurality of horizontal audio signals in order of increasing loudness.

20. The non-transitory computer-readable medium of claim 19, wherein playback of the plurality of shaped audio signals comprises outputting the plurality of shaped audio signals using respective predetermined gain profiles corresponding to a particular hearing loss profile.

21. The non-transitory computer readable medium of claim 20, wherein the particular hearing loss profile comprises two or more of a flat loss profile, a notched loss profile, or a sloped loss profile.

Images