Apparatus, method and computer program for audio processing

Abstract

An apparatus comprising means for: determining that audio content to be played to a user contains at least one predetermined frequency; determining a plurality of frequencies different from the at least one predetermined frequency, the plurality of frequencies configured to cause the user to perceive audio output at the at least one predetermined frequency when the plurality of frequencies are output together to the user; and mixing the determined plurality of frequencies into the audio content to increase the perceived volume of the audio content at the at least one predetermined frequency when the audio content is perceived by the user.

Description

Technical Field

[0001] Examples of the present disclosure relate to apparatus, methods, and computer programs for audio processing. Some relate to apparatus, methods, and computer programs for audio processing in hearing sensitivity compensation. Background Art

[0002] Some electronic devices are configured to perform audio processing. In some cases, audio processing may be limited by the device configuration.

[0003] Improvements in audio processing are desirable in light of, for example, electronic device configurations. Summary of the Invention

[0004] According to several (but not necessarily all) embodiments, there is provided an apparatus comprising:

[0005] means for determining that audio content for playback to a user includes at least one predetermined frequency;

[0006] means for determining a plurality of frequencies different from at least one predetermined frequency, the plurality of frequencies being configured to cause the user to perceive audio output at the at least one predetermined frequency when the plurality of frequencies are output together to the user; and

[0007] Means for mixing the determined plurality of frequencies into the audio content to increase the perceived volume of the audio content at at least one predetermined frequency when the audio content is perceived by a user.

[0008] In some examples, determining the plurality of frequencies includes determining a plurality of frequencies harmonically related to at least one predetermined frequency.

[0009] In some examples, determining the plurality of frequencies includes determining a plurality of frequencies configured to cause a user to perceive at least one predetermined frequency as a psychoacoustic combined tone.

[0010] In some examples, determining the plurality of frequencies includes filtering the audio content using a bandpass filter configured at least in part based on an audiometric sensitivity profile of a user to provide filtered audio content, and determining the plurality of frequencies based at least in part on the filtered audio content.

[0011] In some examples, the bandpass filter is configured to allow at least one predetermined frequency to pass.

[0012] In some examples, determining the plurality of frequencies includes filtering the filtered audio content and the determined plurality of frequencies to remove the filtered audio content.

[0013] In some examples, the apparatus includes means for adjusting a volume of the determined plurality of frequencies prior to mixing based at least in part on at least one of: audio content, audio content type, audio content volume, or audio output capabilities.

[0014] In some examples, the component includes

[0015] at least one processor; and

[0016] at least one memory including computer program code;

[0017] At least one memory stores instructions that, when executed by at least one processor, cause performance of the apparatus.

[0018] According to various (but not necessarily all) embodiments, there is provided an electronic device comprising an apparatus as described herein.

[0019] According to various (but not necessarily all) embodiments, there is provided a method comprising:

[0020] determining that audio content for playback to a user includes at least one predetermined frequency;

[0021] determining a plurality of frequencies different from at least one predetermined frequency, the plurality of frequencies being configured to cause the user to perceive audio output at the at least one predetermined frequency when the plurality of frequencies are output together to the user; and

[0022] The determined plurality of frequencies are mixed into the audio content to increase a perceived volume of the audio content at at least one predetermined frequency when the audio content is perceived by a user.

[0023] In some examples, determining the plurality of frequencies includes determining a plurality of frequencies harmonically related to at least one predetermined frequency.

[0024] In some examples, determining the plurality of frequencies includes determining a plurality of frequencies configured to cause a user to perceive at least one predetermined frequency as a psychoacoustic combined tone.

[0025] In some examples, determining the plurality of frequencies includes filtering the audio content using a bandpass filter configured at least in part based on the user's audiometric sensitivity profile to provide filtered audio content; and determining the plurality of frequencies based at least in part on the filtered audio content.

[0026] In some examples, the bandpass filter is configured to allow at least one predetermined frequency to pass.

[0027] According to various (but not necessarily all) embodiments, there is provided a computer program comprising instructions for causing an apparatus to perform:

[0028] determining that audio content for playback to a user includes at least one predetermined frequency;

[0029] determining a plurality of frequencies different from at least one predetermined frequency, the plurality of frequencies being configured to cause the user to perceive audio output at the at least one predetermined frequency when the plurality of frequencies are output together to the user; and

[0030] The determined plurality of frequencies are mixed into the audio content to increase a perceived volume of the audio content at at least one predetermined frequency when the audio content is perceived by a user.

[0031] In some examples, determining the plurality of frequencies includes determining a plurality of frequencies harmonically related to at least one predetermined frequency.

[0032] According to various (but not necessarily all) examples, examples as claimed in the appended claims are provided.

[0033] According to various (but not necessarily all) embodiments, there is provided an apparatus comprising:

[0034] at least one processor; and

[0035] at least one memory including computer program code;

[0036] At least one memory stores instructions that, when executed by at least one processor, cause the apparatus to at least perform at least a portion of one or more methods disclosed herein.

[0037] According to various (but not necessarily all) embodiments, an apparatus is provided that includes means for performing at least a portion of one or more of the methods disclosed herein.

[0038] Descriptions of functions should additionally be considered to also disclose any means suitable for performing that function.

[0039] Although the above examples and optional features of the present disclosure are described separately, it should be understood that their provisions in all possible combinations and arrangements are included in the present disclosure. It should be understood that various examples of the present disclosure may include any or all of the features described with respect to other examples of the present disclosure, and vice versa. Moreover, it should be understood that any one or more or all of the features in any combination may be implemented / included in / executable by devices, methods, and / or computer program instructions as needed and appropriate. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Some examples will now be described with reference to the accompanying drawings, in which:

[0041] Figure 1An example of the subject matter described herein is shown;

[0042] Figure 2 Another example of the subject matter described herein is shown;

[0043] Figure 3 Another example of the subject matter described herein is shown;

[0044] Figure 4 Another example of the subject matter described herein is shown;

[0045] Figure 5 Another example of the subject matter described herein is shown;

[0046] Figure 6 Another example of the subject matter described herein is shown;

[0047] Figure 7A shows another example of the subject matter described herein; and

[0048] Figure 7B Another example of the subject matter described herein is shown.

[0049] The drawings are not necessarily drawn to scale. For clarity and simplicity, certain features and views of the drawings may be shown schematically or exaggerated in scale. For example, the dimensions of some elements in the drawings may be exaggerated relative to other elements to aid illustration. Like reference numerals are used in the drawings to indicate like features. For clarity, not all reference numerals are necessarily shown in all drawings. DETAILED DESCRIPTION

[0050] Examples of the present disclosure relate to apparatus, methods and / or computer programs for and / or relating to audio processing.

[0051] The following description and accompanying figures describe various examples of an apparatus 10 that includes components for:

[0052] determining that audio content 12 for playback to a user 14 includes at least one predetermined frequency 16;

[0053] determining a plurality of frequencies 18 different from the at least one predetermined frequency 16, the plurality of frequencies 18 being configured to cause the user 14 to perceive audio output at the at least one predetermined frequency 16 when the plurality of frequencies 18 are output together to the user 14; and

[0054] The determined plurality of frequencies 18 is mixed into the audio content 12 to increase the perceived volume of the audio content 12 at at least one predetermined frequency 16 when the audio content 12 is perceived by the user 14 .

[0055] The component may include at least one processor; and at least one memory including computer program code; the at least one memory storing instructions that, when executed by the at least one processor, cause performance of the apparatus.

[0056] As used herein, an apparatus, and / or device, and / or component for performing one or more actions should also be considered to disclose an apparatus, and / or device, and / or component configured to perform one or more actions.

[0057] Similarly, as used herein, an apparatus, and / or device, and / or component configured to perform one or more actions should also be considered to disclose an apparatus, and / or device, and / or component for performing one or more actions.

[0058] Figure 1 An example of an apparatus 10 is schematically shown.

[0059] In other figures Figure 1 Various related features can be found.

[0060] exist Figure 1 In the example of FIG. 1 , the apparatus 10 is configured to determine that the audio content 12 for playing to the user 14 includes at least one predetermined frequency 16 .

[0061] The apparatus 10 may be included and / or integrated in one or more devices, which may be considered to be one or more electronic devices 26. See, for example, Figure 2 .

[0062] Apparatus 10 may be included in any suitable device or devices.

[0063] Audio content 12 may be received from any suitable source or sources. For example, audio content 12 may be received from at least one device separate from the device comprising apparatus 10 (external source) and / or from at least one component of the device comprising apparatus 10 (internal source).

[0064] In an example, it may be considered that the at least one input 12 is received from an external source and / or an internal source.

[0065] Thus, apparatus 10 may be configured to receive audio content 12 from any suitable source or sources, such as from at least one external source and / or at least one internal source.

[0066] The apparatus 10 may be considered a device and / or electronic device 26 .

[0067] In an example, apparatus 10 is configured to determine a plurality of frequencies 18 different from at least one predetermined frequency 16 configured to cause user 14 to perceive audio output at at least one predetermined frequency 16 when the plurality of frequencies 18 are output together to user 14 .

[0068] Determining the plurality of frequencies 18 may include determining the plurality of frequencies 18 harmonically related to the at least one predetermined frequency 16 .

[0069] Determining the plurality of frequencies 18 may include determining the plurality of frequencies 18 configured to cause the user 14 to perceive at least one predetermined frequency as a psychoacoustic combined tone.

[0070] Determining the plurality of frequencies 18 may include filtering the audio content 12 using a bandpass filter 20 configured to provide filtered audio content 24 based at least in part on an audiometric sensitivity profile 22 of the user 14 , and determining the plurality of frequencies 18 based at least in part on the filtered audio content 24 .

[0071] In an example, the bandpass filter 20 is configured to allow at least one predetermined frequency 16 to pass.

[0072] In some examples, determining the plurality of frequencies 18 includes filtering the filtered audio content 24 and the determined plurality of frequencies 18 to remove the filtered audio content 24 .

[0073] In an example, the apparatus 10 is configured to mix the determined plurality of frequencies 18 into the audio content 12 to increase the perceived volume of the audio content 12 at at least one predetermined frequency when the audio content 12 is perceived by the user 14 .

[0074] In an example, the apparatus 10 is configured to adjust the volume of the determined plurality of frequencies prior to mixing based at least in part on at least one of: the audio content 12 , the audio content type, the audio content volume, and the audio output capabilities.

[0075] In an example, the apparatus 10 is configured to cause and / or control output of the mixed plurality of frequencies 18 and audio content 12 to a user 14 .

[0076] In some examples, device 10 is configured to output a mixed plurality of frequencies 18 and audio content 12 to user 14 .

[0077] In an example, the apparatus 10 may include Figure 1 Any number of additional elements not shown in the examples.

[0078] Figure 2 An example of an electronic device 26 is schematically shown.

[0079] exist Figure 2 In the example of Figure 1 Device 10 as described and / or as described herein.

[0080] therefore, Figure 2 An example of an electronic device 26 including an apparatus 10 as described herein is shown.

[0081] The electronic device 26 may include any suitable electronic device 26. For example, the electronic device 26 may include an output device, and / or a control device, etc.

[0082] The electronic device 26 may be and / or include any suitable personal device, any suitable mobile device, and / or any suitable wearable device, etc. For example, the electronic device 26 may be and / or include a hearing aid, at least one earphone, at least one earbud, a headset, a smart phone, etc.

[0083] In examples, the electronic device 26 may be considered a device.

[0084] The at least one transceiver 34 may include any suitable transceiver(s) 34. For example, the at least one transceiver 34 may include any suitable transceiver(s) 34 for transmitting and / or receiving one or more signals 40.

[0085] In an example, at least one transceiver 34 is configured to transmit and / or receive one or more signals 40 using wired and / or wireless communications. Any suitable wired and / or wireless communication protocol(s) may be used. For example, Wi-Fi and / or Bluetooth may be used.

[0086] In some examples, one or more separate transmitters and receivers may be used.

[0087] In an example, the at least one transceiver 34 is configured to receive one or more signals 40 and transmit the audio content 12 to the apparatus 10 .

[0088] In an example, the at least one transceiver 34 is configured to receive one or more signals 40 from the device 10 to provide one or more audio outputs. For example, the at least one transceiver 34 can be configured to receive the mixed multiple frequencies 18 and audio content 12 and transmit the mixed multiple frequencies 18 and audio content 12 for output to the user 14.

[0089] The at least one component 42 may include any suitable component(s) 42 of the electronic device 26. For example, the at least one component 42 may include any suitable component(s) 42 configured to provide audio content 12. For example, the at least one component 42 may include a memory, a microphone, etc. of the electronic device 26.

[0090] Thus, in an example, audio content 12 may be received via transceiver 34 and / or from component 42 .

[0091] Component 42 may be considered an internal component of electronic device 26 .

[0092] The means for outputting 38 may include any suitable means for outputting audio to the user 14. For example, the means for outputting 38 may include any suitable means for outputting the mixed plurality of frequencies 18 and audio content 12 to the user 14.

[0093] Means for outputting 38 may be considered to be at least one audio output, at least one audio output mechanism, audio output circuitry, at least one component configured to output audio, at least one audio user interface, and / or at least one speaker, among others.

[0094] The means for outputting 38 may be configured to output audio, such as the mixed plurality of frequencies 18 and the audio content 12. Thus, in examples, the electronic device 26 may be considered an output device 18.

[0095] In an example, the means for outputting 38 may be considered a component 42 of the electronic device 26 .

[0096] In an example, the apparatus 10 may provide at least one signal 40 to the means for outputting 38 to enable / control audio output, such as output of the mixed plurality of frequencies 18 and audio content 12 .

[0097] Additionally or alternatively, in an example, the apparatus 10 may provide at least one signal 40 to the at least one transceiver 34 to enable / control audio output, such as output of the mixed plurality of frequencies 18 and audio content 12 .

[0098] In an example, the mixed plurality of frequencies 18 and audio content 12 may be stored in memory for later retrieval and output to the user 14 .

[0099] In an example, the electronic device 26 may include Figure 2 Any number of additional elements shown in the examples of FIG. 2 may be included. For example, electronic device 26 may include a display.

[0100] like Figure 2As shown in the example of FIG, at least one transceiver 34, component 42, and means for output 38 are operatively coupled to device 10, and any number of intervening elements (excluding intervening elements) may be present therebetween.

[0101] Additionally or alternatively, Figure 2 One or more elements of the electronic device 26 shown in the examples of FIG. 1 may be integrated or combined.

[0102] Figure 3 An example of a method 300 is shown.

[0103] about Figure 3 One or more of the features discussed may be found in one or more other figures.

[0104] In an example, method 300 may be considered a method of audio processing.

[0105] In an example, method 300 may be considered a method of improving and / or enhancing audio output.

[0106] In an example, the method 300 may be considered a psychoacoustic audio processing method.

[0107] In an example, method 300 may be considered a method of compensating for a user's hearing sensitivity loss.

[0108] Method 300 may be performed by any suitable apparatus including any suitable components for performing method 300 .

[0109] In an example, method 300 may be performed by Figure 7A and Figure 7B devices, and / or Figure 1 devices, and / or Figure 2 electronic devices to perform.

[0110] At block 302 , the method 300 includes determining that audio content 12 for playback to a user 14 includes at least one predetermined frequency 16 .

[0111] Block 302 may be performed in any suitable manner using any suitable method. For example, block 302 may include processing and / or analyzing audio content 12 in any suitable manner to determine that audio content 12 includes at least one predetermined frequency 16.

[0112] For example, a Fourier transform of the audio content 12 may be analyzed to determine the amplitude of the audio content 12 at different frequencies.

[0113] For example, the audio content may be bandpass filtered to at least one predetermined frequency 16 .

[0114] Audio content 12 may include any suitable audio content 12. For example, audio content 12 may include any suitable audio content 12 from any suitable source.

[0115] In examples, audio content 12 may be considered to be any content that includes one or more audio components.

[0116] In examples, audio content 12 may be considered to be any content that includes one or more sound components.

[0117] In an example, the audio content 12 may include any audio content 12 to be played, and / or output, and / or presented to the user 14. For example, audio content 12 from a telecommunications call, music, video, situational awareness sounds, etc. In an example, the audio content 12 may be streamed and / or retrieved from a memory of the device.

[0118] In an example, the audio content 12 may be considered to be audio content 12 to be played to the user 14 , and / or to be output to the user 14 , and / or to be presented to the user 14 , and / or the like.

[0119] In an example, the method 300 includes receiving audio content 12 .

[0120] The at least one predetermined frequency 16 may include any suitable frequency(ies).

[0121] The at least one predetermined frequency 16 may be determined in any suitable manner using any suitable method.

[0122] In an example, the at least one predetermined frequency 16 comprises at least one frequency that has been selected for processing as part of the method 300. For example, the at least one predetermined frequency 16 may comprise at least one frequency that has been selected for psychoacoustic processing.

[0123] In some examples, at least one predetermined frequency 16 is associated with a user 14 to whom audio content 12 is to be output. For example, at least one predetermined frequency 16 may be determined based at least in part on at least one auditory characteristic of user 14.

[0124] In some examples, the at least one predetermined frequency 16 is determined based at least in part on the audiometric sensitivity profile 22 of the user 14. For example, the at least one predetermined frequency 16 may include or be at least one frequency at which the user 14 has reduced hearing sensitivity and / or has a hearing loss determined from, for example, the audiometric sensitivity profile 22 of the user 14.

[0125] Thus, in some examples, block 302 includes determining that audio content 12 for playing to user 14 includes at least one predetermined frequency 16 at which user 14 has reduced hearing sensitivity and / or at which user 14 has hearing loss.

[0126] In an example, when the sensitivity at a given frequency point / band is at least 25 dB below normal hearing sensitivity, the user 14 may be considered to have developed hearing loss at that frequency point / band.

[0127] By way of example, refer to Figure 4 .

[0128] Figure 4 The example of FIG. 1 shows an example of an audiometric sensitivity profile 22 for a user 14 . In the example, the audiometric sensitivity profile 22 may be considered to be a hearing profile for the user 14 .

[0129] The audiometric sensitivity profile 22 may be considered to be any information indicative of the user's hearing sensitivity with respect to at least one frequency.

[0130] In some examples, audiometric sensitivity profile 22 may include an indication of at least one frequency at which user 14 has reduced hearing sensitivity.

[0131] In some examples, audiometric sensitivity profile 22 may include an indication of the user's hearing sensitivity with respect to at least one frequency.

[0132] In some examples, audiometric sensitivity profile 22 may include an indication of a user's hearing sensitivity across a range of frequencies.

[0133] In some examples, audiometric sensitivity profile 22 may include an indication of a user's hearing sensitivity across the audible spectrum.

[0134] exist Figure 4 In the example of , the audiometric sensitivity profile provides an indication of the user's hearing sensitivity across a frequency range. In the example shown, frequency is shown on the x-axis 41 and sensitivity is shown on the y-axis 44. Figure 4 In the example, the frequency increases with increasing x-values, and the sensitivity increases with increasing y-values.

[0135] Figure 4 The audiometric sensitivity profile 22 in shows the hearing sensitivity of a user as a function of frequency. It can be seen that in the example shown, the user has a reduced hearing sensitivity at and / or around frequency F3.

[0136] Thus, in an example, frequency F3 may be determined as the predetermined frequency 16 based at least in part on the audiometric sensitivity profile 22 of the user 14 .

[0137] We will also discuss Figure 4 .

[0138] Back to Figure 3 In some examples, method 300 includes determining an audiometric sensitivity profile 22 for user 14. Determining the audiometric sensitivity profile 22 for user 22 may be performed in any suitable manner using any suitable method.

[0139] In an example, the at least one predetermined frequency 16 may include at least one frequency range and / or frequency band. Figure 3 In the example of , the at least one predetermined frequency 16 may include a frequency range / band around the frequency F3. For example, the frequency range / band may be a frequency range / band where the user 14 has a hearing sensitivity below a certain value.

[0140] At block 304 , the method 300 includes determining a plurality of frequencies 18 different from the at least one predetermined frequency 16 that are configured to cause the user 14 to perceive audio output at the at least one predetermined frequency 16 when the plurality of frequencies 18 are output together to the user 14 .

[0141] Block 304 may be performed in any suitable manner using any suitable method. For example, any suitable method of determining a plurality of frequencies that, when output together to user 14, causes user 14 to perceive audio output at at least one predetermined frequency 16 may be used.

[0142] Multiple frequencies 18 may include any suitable frequencies. For example, multiple frequencies 18 may include any frequency combination excluding predetermined frequency 16 that, when output together to user 14, causes user 14 to perceive audio output at at least one predetermined frequency 16.

[0143] In some examples, determining the plurality of frequencies 18 includes determining a plurality of frequencies 18 that are different from the at least one predetermined frequency 16 and have a frequency relationship with the at least one predetermined frequency 16 such that when the plurality of frequencies 18 are output together to the user 14 , the user 14 perceives audio output at the at least one predetermined frequency 16 .

[0144] In some examples, determining the plurality of frequencies 18 includes determining the plurality of frequencies 18 that are harmonically related to the at least one predetermined frequency 16 .

[0145] Multiple frequencies 18 may be harmonically related in any suitable manner to at least one predetermined frequency 16. For example, multiple frequencies 18 may be harmonically related to at least one predetermined frequency 16 such that when the multiple frequencies are output together to user 14, the multiple frequencies cause user 14 to perceive the at least one predetermined frequency 16.

[0146] In an example, the plurality of frequencies 18 has a psychoacoustic relationship with a predetermined at least one frequency.

[0147] In some examples, determining the plurality of frequencies 18 includes determining a plurality of frequencies configured to cause a user to perceive the at least one predetermined frequency 16 as a psychoacoustic combined tone.

[0148] For example, the plurality of frequencies 18 may be determined as at least F1 and F2 such that when the polyphonic sound of F1 and F2 is output to the user 14 , the user 14 perceives the at least one predetermined frequency 16 as a psychoacoustic combined tone.

[0149] Any suitable psychoacoustic combined tonal relationship to the predetermined at least one frequency 16 may be used in determining the plurality of frequencies 18 .

[0150] Any suitable sum or difference tone may be used.

[0151] For example, at least F1 and F2 may be determined such that the user 14 perceives at least one predetermined frequency 16 given by the combined pitch relationship |F1-F2| or F1+F2.

[0152] Additionally or alternatively, combined pitch relations 2F1+F2, and / or 3F1-2F2, and / or 3F1+2F2, etc. may be used.

[0153] By way of example, refer to Figure 4 .

[0154] As mentioned above, in Figure 4 In the example of , the user's audiometric sensitivity profile 22 identifies that the user 14 has reduced hearing sensitivity at frequency F3.

[0155] exist Figure 4 In the example of , the plurality of frequencies 18 are determined to be F1 and F2, which, when output together to the user 14 via a psychoacoustic combined tonal relationship F2-F1, cause a frequency F3 to be perceived by the user 14.

[0156] exist Figure 4 In the example of , the frequencies at which the user 14 would perceive the psychoacoustic combined tones via the psychoacoustic combined tonal relationship F2+F1 are also shown.

[0157] exist Figure 4In the example of , multiple frequencies 18 may be determined differently such that frequency F3 is perceived by user 14 when F1 and F2 are output together to user 14 via a psychoacoustic combined tonal relationship F2+F1, or any other suitable psychoacoustic relationship.

[0158] Back to Figure 3 For example, if there are multiple selections for multiple frequencies 18, for example because there are multiple harmonic and / or psychoacoustic combined tonal relationships that can be used to cause the user 14 to perceive at least one predetermined frequency 16, then determining the multiple frequencies 18 may include determining which harmonic and / or psychoacoustic combined tonal relationship to use to determine the multiple frequencies 18.

[0159] Determining which harmonic and / or psychoacoustic combination tonal relationships to use to determine the plurality of frequencies 18 may be performed in any suitable manner using any suitable method.

[0160] In an example, determining which harmonic and / or psychoacoustic combined tonal relationship to use to determine the plurality of frequencies 18 includes determining which harmonic and / or psychoacoustic combined tonal relationship to use based at least in part on at least one of: system performance, audio content type, presence of the plurality of frequencies 18 in the audio content 12, absence of the plurality of frequencies 18 in the audio content 12, and the like.

[0161] For example, the harmonic and / or psychoacoustic combination tonal relationships may be selected such that the plurality of frequencies 18 are less disruptive to the audio content 12 and / or such that an output device is easily configured and capable of outputting the audio content 12 .

[0162] In some examples, determining the plurality of frequencies 18 includes filtering the audio content 12 using a bandpass filter 20 configured to provide filtered audio content 24 based at least in part on an audiometric sensitivity profile 22 of the user 14 , and determining the plurality of frequencies 18 based at least in part on the filtered audio content 24 .

[0163] Any suitable bandpass filter 20 configured based at least in part on the audiometric sensitivity profile 22 of the user 14 may be used.

[0164] In some examples, bandpass filter 20 is configured to allow at least one predetermined frequency 16 to pass.

[0165] For example, the bandpass filter 20 may be configured to be substantially opposite to the audiometric sensitivity profile 22 of the user 14 .

[0166] For example, the bandpass filter 20 may have a transmission profile that is substantially opposite to the audiometric sensitivity profile 22 of the user 14 .

[0167] For example, the bandpass filter 20 may have at least one peak transmission frequency that substantially corresponds to the at least one predetermined frequency 16. See, for example, Figure 6 .

[0168] In some examples, determining the plurality of frequencies 18 includes filtering the filtered audio content 24 and the determined plurality of frequencies 18 to remove the filtered audio content 24. See, for example, Figure 6 .

[0169] Filtering the filtered audio content 24 and the determined plurality of frequencies 18 to remove the filtered audio content 24 may be performed in any suitable manner using any suitable method.

[0170] In an example, filtering the filtered audio content 24 and the determined plurality of frequencies 18 includes using a bandpass filter 21. In some examples, the bandpass filter 21 may be considered an additional bandpass filter 21. See, for example, Figure 6 .

[0171] Any suitable bandpass filter 21 configured to remove the filtered audio content 24 may be used. In an example, the bandpass filter 21 is configured at least in part based on the bandpass filter 20 used to provide the filtered audio content 24. For example, the bandpass filter 21 may be substantially the inverse bandpass filter of the bandpass filter 20 used to provide the filtered audio content 24.

[0172] In some examples, determining the plurality of frequencies 18 includes non-linear processing. Any suitable non-linear processing may be used, for example a squared function or an absolute function of the time samples may be used.

[0173] At block 306 , the method 300 includes mixing the determined plurality of frequencies 18 into the audio content 12 to increase the perceived volume of the audio content 12 at at least one predetermined frequency 16 when the audio content 12 is perceived by the user 14 .

[0174] therefore, Figure 3 A method is shown, comprising:

[0175] The audio content 12 determined for playback to the user 14 includes: at least one predetermined frequency 16;

[0176] determining a plurality of frequencies 18 different from the at least one predetermined frequency 16, the plurality of frequencies 18 being configured to cause the user 14 to perceive audio output at the at least one predetermined frequency 16 when the plurality of frequencies 18 are output together to the user 14; and

[0177] The determined plurality of frequencies 18 is mixed into the audio content 12 to increase the perceived volume of the audio content 12 at at least one predetermined frequency 16 when the audio content 12 is perceived by the user 14 .

[0178] The determined combination of the plurality of frequencies 18 and the audio content 12 may be considered the audio content 12, and / or updated audio content 12, and / or modified audio content 12, and / or mixed audio content 12, and / or the like.

[0179] In an example, mixing the determined plurality of frequencies 18 into the audio content 12 may be considered as combining the determined plurality of frequencies 18 with the audio content 12 , and / or merging the determined plurality of frequencies 18 into the audio content 12 , and so on.

[0180] In an example, block 306 may include mixing the determined plurality of frequencies 18 into the audio content 12 to increase the perceived volume of the audio content 12 at at least one predetermined frequency 16 when the audio content 12 is perceived by the user 14 .

[0181] In an example, the determined plurality of frequencies 18 is mixed into the audio content 12 to increase the apparent volume of the audio content 12 at at least one predetermined frequency 16 when the audio content 12 is perceived by the user 14 .

[0182] Block 306 may be performed in any suitable manner using any suitable method.

[0183] For example, any suitable method of mixing, and / or combining, and / or incorporating the determined plurality of frequencies 18 into the audio content 12 to increase the perceived volume of the audio content 12 at at least one predetermined frequency 16 when the audio content 12 is perceived by the user 14 may be used.

[0184] In an example, the determined plurality of frequencies 18 are mixed into the audio content 12 in an appropriate manner and / or at an appropriate time in the audio content 12 such that the output of the determined plurality of frequencies 18 causes the user 14 to perceive at least one predetermined frequency at an appropriate point in the audio content 12.

[0185] For example, reference Figure 3 For example, frequencies F1 and F2 may be mixed into the audio content such that when frequency F3 appears, user 14 is caused to perceive frequency F3 at a portion of audio content 12 via a harmonic relationship.

[0186] This is advantageous because, for example, it allows a user 14 with hearing loss at frequency F3 to perceive frequency F3 at an appropriate point in the audio content 12 using frequencies F1 and F2 without the user's hearing sensitivity being reduced at frequencies F1 and F2.

[0187] In some examples, the method 300 includes adjusting a volume of the determined plurality of frequencies 18 prior to mixing based at least in part on at least one of the audio content 12 , the audio content type 12 , the audio content volume, and the audio output capacity.

[0188] Adjusting the volume of the determined plurality of frequencies 18 may be performed in any suitable manner using any suitable method. Adjusting the volume of the determined plurality of frequencies 18 may be considered as equalizing the determined plurality of frequencies 18.

[0189] In an example, the volume of the determined plurality of frequencies 18 may be adjusted in any suitable manner.

[0190] For example, the volume of the determined plurality of frequencies 18 may be adjusted so that the output of the determined plurality of frequencies 18 and / or the harmonically related frequency(ies) perceived by the user 14 is non-destructive to the audio content 12, and / or is appropriate to the audio content 12, and / or the audio content type, and / or the audio content volume.

[0191] For example, the volume of the determined plurality of frequencies 18 may be adjusted so that the output of the determined plurality of frequencies 18 is consistent with the audio output capabilities of the output device.

[0192] In some examples, the method 300 includes controlling output of the mixed, determined plurality of frequencies 18 and the audio content 12 .

[0193] In some examples, the method 300 includes causing output of the mixed, determined plurality of frequencies 18 and the audio content 12 .

[0194] In some examples, the method 300 includes outputting the mixed, determined plurality of frequencies 18 and the audio content 12 .

[0195] Figure 5 An example of a method 500 is shown.

[0196] Method 500 may be performed by any suitable apparatus including any suitable components for performing method 500 .

[0197] In an example, method 500 may be performed by Figure 7A and Figure 7B devices, and / or Figure 1 devices, and / or Figure 2 electronic devices to perform.

[0198] Figure 5 It can be considered to show an example of a psychoacoustic processing chain.

[0199] exist Figure 5In the example of , audio content 12 is viewed (whether it is from a call, music stream, situational awareness sound, etc.) and when it sees content in the frequency points / bands where hearing sensitivity loss occurs, it will be pre-processed by the psychoacoustic processing unit (block 502) and then mixed to the original content before being presented to the user 14 (block 504).

[0200] Figure 6 An example of a method 600 is shown.

[0201] Method 600 may be performed by any suitable apparatus including any suitable components for performing method 600 .

[0202] In an example, method 600 may be performed by Figure 7A and Figure 7B devices, and / or Figure 1 devices, and / or Figure 2 electronic devices to perform.

[0203] Figure 6 It can be considered as showing an example of a psychoacoustic processing chain.

[0204] Figure 6 The processing steps for generating psychoacoustic content are shown if the user 14 hears the content again, even if the audiometric sensitivity profile 22 of the user 14 indicates the presence of a hearing loss in that particular frequency (or frequency band).

[0205] exist Figure 6 In the example of , the psychoacoustic processing chain uses a bandpass filter (BPF0, Figure 6 Item 20 in ) starts (block 602 ), the bandpass filter is designed based on the audiometric sensitivity profile 22 of the user 14 .

[0206] At block 602 , content in the audio content 12 that falls in an insensitive portion of the user spectrum (eg, speech or situational awareness sounds) is filtered by BPFO.

[0207] At block 604, the bandpass filtered content is then processed by a non-linear processing block that generates Figure 6 The original BPFO output in (as represented by bar 1 ) is harmonically related to content 18 , which is a harmonic of the original content 24 .

[0208] Many non-linear methods can be used for harmonic generation, an example (but not the only one) is to use a squared function or an absolute function of the time samples.

[0209] The output of the non-linear processing is then bandpass filtered (block 606) through BPF1 which removes the original content, leaving only the harmonically generated content 18. Then, after the content 18 has been equalized (block 606) (e.g. Figure 6 After the audio is processed (as shown by the dotted trace 46 in FIG. 4 ) to enhance the effect of the psychoacoustic content, it will be mixed with the original audio (block 608 ).

[0210] Examples of the present disclosure are advantageous and / or provide technical benefits.

[0211] For example, examples of the present disclosure provide a method for a user to perceive at least one predetermined frequency in audio content using a psychoacoustic method.

[0212] For example, examples of the present disclosure provide for the perceived volume of at least one predetermined frequency to be increased, which would otherwise not be possible due to device capabilities (such as amplifier headroom).

[0213] For example, examples of the present disclosure use psychoacoustic methods to provide compensation for a user's hearing loss at at least one frequency that would otherwise require reducing the overall volume of the audio content due to device capabilities (such as amplifier headroom).

[0214] For example, a user may have hearing loss at frequency F3, but it may not be possible to sufficiently increase the gain at frequency F3 due to amplifier headroom limitations, and examples of the present disclosure may provide for increased perceived volume at F3 using psychoacoustic combined tones.

[0215] Figure 7A Shown is suitable for use in Figure 1 and / or Figure 2 10. In the example, the controller 730 may be considered as the device 10.

[0216] The controller 730 may be implemented as controller circuitry.The controller 730 may be implemented in hardware alone, with certain aspects in software including firmware alone, or may be a combination of hardware and software (including firmware).

[0217] like Figure 7A As shown in , the controller 730 can be implemented using instructions that enable hardware functions, for example, by using executable instructions of a computer program 736 stored in a general or special purpose processor 732 on a computer readable storage medium (disk, memory, etc.) for execution by such processor 732.

[0218] The processor 732 is configured to read from and write to the memory 734. The processor 732 may also include an output interface and an input interface, through which data and / or commands are output by the processor 732 and through which data and / or commands are input to the processor 732.

[0219] The memory 734 stores a computer program 736 including computer program instructions (computer program code) that, when loaded into the processor 732, controls the operation of the apparatus. The computer program instructions of the computer program 736 provide the logic and routines for the apparatus to perform the methods shown in the accompanying drawings. By reading the memory 734, the processor 732 is able to load and execute the computer program 736.

[0220] The device includes:

[0221] at least one processor 732; and

[0222] At least one memory 734 includes computer program code.

[0223] The at least one memory 734 and the computer program code are configured to, together with the at least one processor 732, cause the apparatus to at least perform:

[0224] determining that audio content for playback to a user includes at least one predetermined frequency;

[0225] determining a plurality of frequencies different from at least one predetermined frequency, the plurality of frequencies being configured to cause the user to perceive audio output at the at least one predetermined frequency when the plurality of frequencies are output together to the user; and

[0226] The determined plurality of frequencies are mixed into the audio content to increase a perceived volume of the audio content at at least one predetermined frequency when the audio content is perceived by a user.

[0227] The device includes:

[0228] at least one processor 732; and

[0229] at least one memory 734 including computer program code,

[0230] The at least one memory stores instructions that, when executed by the at least one processor 732, cause the apparatus to at least:

[0231] The audio content determined for playback to the user includes: at least one predetermined frequency;

[0232] determining a plurality of frequencies different from at least one predetermined frequency, the plurality of frequencies being configured such that, when the plurality of frequencies are output together to a user, the user perceives audio output at the at least one predetermined frequency; and

[0233] The determined plurality of frequencies are mixed into the audio content to increase a perceived volume of the audio content at at least one predetermined frequency when the audio content is perceived by a user.

[0234] like Figure 7A As shown, the computer program 736 may arrive at the apparatus via any suitable delivery mechanism 762. The delivery mechanism 762 may be, for example, a machine-readable medium, a computer-readable medium, a non-transitory computer-readable storage medium, a computer program product, a memory device, a recording medium such as a compact disc read-only memory (CD-ROM) or a digital versatile disc (DVD) or a solid-state memory, or an article of manufacture that includes or tangibly embodies the computer program 736. The delivery mechanism may be a signal configured to reliably transmit the computer program 736. The apparatus may propagate or send the computer program 736 as a computer data signal.

[0235] Computer program instructions for causing an apparatus to perform at least the following, or for performing at least the following:

[0236] determining that audio content for playback to a user includes at least one predetermined frequency;

[0237] determining a plurality of frequencies different from at least one predetermined frequency, the plurality of frequencies being configured such that, when the plurality of frequencies are output together to a user, the user perceives audio output at the at least one predetermined frequency; and

[0238] The determined plurality of frequencies are mixed into the audio content to increase a perceived volume of the audio content at at least one predetermined frequency when the audio content is perceived by a user.

[0239] The computer program instructions may be included in a computer program, a non-transitory computer readable medium, a computer program product, a machine readable medium. In some, but not necessarily all, examples, the computer program instructions may be distributed across more than one computer program.

[0240] Although memory 734 is shown as a single component / circuitry, it may be implemented as one or more separate components / circuitry, some or all of which may be integrated / removable and / or may provide permanent / semi-permanent / dynamic / cached storage.

[0241] In an example, the memory 734 includes a random access memory 758 and a read-only memory 760. In an example, the computer program 736 may be stored in the read-only memory 758. For example, see Figure 7B .

[0242] In an example, memory 734 may be divided into random access memory 758 and read-only memory 760 .

[0243] Although processor 732 is shown as a single component / circuitry, it may be implemented as one or more separate components / circuitry, some or all of which may be integrated / removable.Processor 732 may be a single-core or multi-core processor.

[0244] References to "computer-readable storage medium," "computer program product," "tangibly embodied computer program," etc., or "controller," "computer," "processor," etc. should be understood to encompass not only computers having different architectures (such as single / multi-processor architectures and sequential (von Neumann) / parallel architectures), but also special-purpose circuits such as field-programmable gate arrays (FPGAs), application-specific circuits (ASICs), signal processing devices, and other processing circuits. References to computer programs, instructions, code, etc. should be understood to encompass software or firmware for a programmable processor, such as, for example, the programmable content of a hardware device, whether instructions for a processor or configuration settings for a fixed-function device, gate array, or programmable logic device, etc.

[0245] As used in this application, the term "circuitry" may refer to one or more or all of the following:

[0246] (a) hardware circuit implementation only (such as implementation only in analog and / or digital circuitry), and

[0247] (b) a combination of hardware circuitry and software such as (as applicable):

[0248] (i) a combination of analog and / or digital hardware circuits and software / firmware, and

[0249] (ii) any portion of hardware processor(s) (including digital signal processor(s)), software, and memory(s) with software that work together to enable a device (such as a mobile phone or server) to perform various functions, and

[0250] (c) Hardware circuit(s) and / or processor(s), such as microprocessor(s) or portion(s) of microprocessor(s), that require software (e.g., firmware) for operation, but in which case the software may not be present when not required for operation.

[0251] This definition of "circuitry" applies to all uses of the term in this application, including in any claims. As a further example, as used in this application, the term "circuitry" also covers merely hardware circuitry, or a processor, and its (or their) accompanying software and / or firmware implementation. For example, and if applicable to a particular claim element, the term "circuitry" also covers a baseband integrated circuit or server integrated circuit for a mobile device, a cellular network device, or a similar integrated circuit in other computing or network equipment.

[0252] The blocks shown in the figures may represent steps in a method, and / or code sections in a computer program 736. The description of a particular order for the blocks does not necessarily imply a required or preferred order for the blocks, and the order and arrangement of the blocks may be varied. In addition, some blocks may be omitted.

[0253] Where a structural feature has been described, it may be replaced by a component for performing one or more functions of the structural feature, whether that function or functions are described explicitly or implicitly.

[0254] Thus, the apparatus may include means for:

[0255] determining that audio content for playback to a user includes at least one predetermined frequency;

[0256] determining a plurality of frequencies different from at least one predetermined frequency, the plurality of frequencies being configured such that, when the plurality of frequencies are output together to a user, the user perceives audio output at the at least one predetermined frequency; and

[0257] The determined plurality of frequencies are mixed into the audio content to increase a perceived volume of the audio content at at least one predetermined frequency when the audio content is perceived by a user.

[0258] In an example, an apparatus may include means for performing one or more methods, and / or at least a portion of one or more methods, as disclosed herein.

[0259] In an example, an apparatus may be configured to perform one or more methods, and / or at least a portion of one or more methods, as disclosed herein.

[0260] According to examples of the present disclosure, the apparatus may be provided in an electronic device (e.g., a mobile terminal). However, it should be understood that a mobile terminal is merely an example of an electronic device that would benefit from examples of implementations of the present disclosure, and therefore, the scope of the present disclosure should not be limited thereto. Although in certain implementation examples, the apparatus may be provided in a mobile terminal, other types of electronic devices, such as, but not limited to: a mobile communication device, a handheld portable electronic device, a wearable computing device, a portable digital assistant (PDA), a pager, a mobile computer, a desktop computer, a television, a gaming device, a laptop computer, a camera, a video recorder, a GPS device, and other types of electronic systems that may readily employ examples of the present disclosure. Furthermore, a device may readily employ examples of the present disclosure regardless of its intent to provide mobility.

[0261] The term "comprise" is used in this document in an inclusive, rather than exclusive, sense. That is, any reference to X including Y indicates that X may include only one Y, or may include more than one Y. If the exclusive meaning of "comprise" is intended, this will be made clear in the context by reference to "comprising only one" or by use of "consisting."

[0262] Throughout this specification, the terms "connected," "coupled," and "in communication" and their derivatives mean operatively connected / coupled / in communication. It should be understood that any number or combination of intermediate components (including no intermediate components) may be present, i.e., to provide direct or indirect connection / coupling / communication. Any such intermediate components may include hardware and / or software components.

[0263] As used herein, the term "determine" (and grammatical variations thereof) may include at least calculating, computing, processing, deriving, measuring, investigating, identifying, searching (e.g., searching in a table, a database, or another data structure), confirming, etc. Furthermore, "determining" may include receiving (e.g., receiving information), accessing (e.g., accessing data in a memory), obtaining, etc. Furthermore, "determining" may include resolving, selecting, choosing, establishing, etc.

[0264] In this specification, reference has been made to various examples. The description of features or functionality associated with an example indicates that those features or functionality are present in that example. The use of the term "example", or "for example", or "may", or "could" in the text indicates (whether or not explicitly stated) that such features or functionality are present in at least the example being described, whether or not described as an example, and that they may, but need not, be present in some or all other examples. Thus, an "example", "for example", "may", or "could" refers to a particular instance of a class of examples. Attributes of an instance may be attributes of only that instance, or of a class, or of a subclass of a class that includes some but not all instances of the class. Thus, it is implicitly disclosed that features described with reference to one example but not with reference to another example may, where possible, be used as part of a working combination in that other example, but do not necessarily have to be used in that other example.

[0265] Although the examples have been described in the preceding paragraphs with reference to various examples, it should be appreciated that modifications to the examples given can be made without departing from the scope of the claims.

[0266] Features described in the preceding description may be used in combinations other than the combinations explicitly described above.

[0267] Although functions have been described with reference to certain features, those functions may be performable by other features whether described or not.

[0268] Although features have been described with reference to certain examples, those features may also be present in other examples whether described or not.

[0269] The terms "a," "an," or "the" are used in this document in an inclusive, rather than exclusive, sense. That is, unless the context clearly indicates otherwise, any reference to X that includes a / an / the Y indicates that X may include only one Y or may include more than one Y. If the exclusive meaning of "a," "an," or "the" is intended, it will be clearly stated in the context. In some cases, the use of "at least one" or "one or more" may be used to emphasize the inclusive meaning, but the absence of these terms should not be taken to infer any exclusive meaning.

[0270] The presence of a feature (or combination of features) in a claim is a reference to that feature (or combination of features) by itself, and also to features that achieve substantially the same technical effect (equivalent features). Equivalent features include, for example, features that are modified and achieve substantially the same result in substantially the same way. Equivalent features include, for example, features that perform substantially the same function in substantially the same way to achieve substantially the same result.

[0271] In this specification, reference has been made to various examples using adjectives or adjective phrases to describe characteristics of the examples. Such description of a characteristic in relation to the examples indicates that the characteristic exists in some examples exactly as described and in other examples substantially as described.

[0272] The above description describes some examples of the present disclosure, however, those skilled in the art will be aware of possible alternative structures and method features that provide equivalent functionality to the specific examples of such structures and features described above herein, and for the sake of brevity and clarity, such structures and method features have been omitted from the above description. Nevertheless, the above description should be understood to implicitly include reference to such alternative structures and method features that provide equivalent functionality, unless such alternative structures or method features are explicitly excluded in the above description of examples of the present disclosure.

[0273] Although attention has been drawn in the foregoing description to those features considered essential, it should be understood that the applicant may seek protection by way of claims for any patentable feature or combination of features mentioned above and / or shown in the drawings, whether or not emphasized.

Claims

1. A device comprising: means for determining that audio content for playback to a user includes at least one predetermined frequency; means for determining a plurality of frequencies different from the at least one predetermined frequency, the plurality of frequencies being configured such that, when the plurality of frequencies are output together to the user, the user perceives audio output at the at least one predetermined frequency; as well as means for mixing the determined plurality of frequencies into the audio content to increase the perceived volume of the audio content at the at least one predetermined frequency when the audio content is perceived by the user.

2. The apparatus of claim 1 , wherein determining a plurality of frequencies comprises: A plurality of frequencies harmonically related to the at least one predetermined frequency are determined.

3. The apparatus of claim 1 or 2, wherein determining a plurality of frequencies comprises: A plurality of frequencies configured to cause the user to perceive the at least one predetermined frequency as a psychoacoustic combined tone is determined.

4. The apparatus of any preceding claim, wherein determining a plurality of frequencies comprises: filtering the audio content using a bandpass filter, the bandpass filter configured to provide filtered audio content based at least in part on an audiometric sensitivity profile of a user; and determining the plurality of frequencies based at least in part on the filtered audio content. The apparatus according to claim 4 , wherein the bandpass filter is configured to allow the at least one predetermined frequency to pass.

6. The apparatus of claim 4 or 5, wherein determining a plurality of frequencies comprises: The filtered audio content and the determined plurality of frequencies are filtered to remove the filtered audio content.

7. The device according to any one of the preceding claims, comprising: Means for adjusting the determined volume of the plurality of frequencies prior to mixing based at least in part on at least one of: audio content, audio content type, audio content volume, or audio output capabilities.

8. An electronic device comprising: Device according to at least one of claims 1 to 7.

9. A method comprising: determining that audio content for playback to a user includes at least one predetermined frequency; determining a plurality of frequencies different from the at least one predetermined frequency, the plurality of frequencies being configured to cause the user to perceive audio output at the at least one predetermined frequency when the plurality of frequencies are output together to the user; as well as The determined plurality of frequencies are mixed into the audio content to increase a perceived volume of the audio content at the at least one predetermined frequency when the audio content is perceived by the user.

10. The method of claim 9, wherein determining a plurality of frequencies comprises: A plurality of frequencies harmonically related to the at least one predetermined frequency are determined.

11. The method of claim 9 or 10, wherein determining a plurality of frequencies comprises: A plurality of frequencies configured to cause the user to perceive the at least one predetermined frequency as a psychoacoustic combined tone is determined.

12. The method of any one of claims 9 to 11, wherein determining a plurality of frequencies comprises: filtering the audio content using a bandpass filter, the bandpass filter configured to provide filtered audio content based at least in part on an audiometric sensitivity profile of a user; and determining the plurality of frequencies based at least in part on the filtered audio content. The method of claim 12 , wherein the bandpass filter is configured to allow the at least one predetermined frequency to pass.

14. A computer program comprising instructions for causing an apparatus to: determining that audio content for playback to a user includes at least one predetermined frequency; determining a plurality of frequencies different from the at least one predetermined frequency, the plurality of frequencies being configured to cause the user to perceive audio output at the at least one predetermined frequency when the plurality of frequencies are output together to the user; and The determined plurality of frequencies are mixed into the audio content to increase a perceived volume of the audio content at the at least one predetermined frequency when the audio content is perceived by the user.

15. The computer program of claim 14, wherein determining a plurality of frequencies comprises: A plurality of frequencies harmonically related to the at least one predetermined frequency are determined.

Images