System and method for determining audio output device type

Abstract

The present disclosure relates to systems and methods for determining audio output device type. A method performed by a processor of an audio source device is disclosed. The method drives an audio output device of the audio source device to output sound with an audio output signal. The method obtains a microphone signal from a microphone of the audio source device, the microphone signal capturing the outputted sound; the method determines whether the audio output device is a headphone or a loudspeaker based on the microphone signal, and configures an acoustic dosimetry process based on the determination.

Description

[0001] Cross-reference to related applications

[0002] This application claims the benefit and priority of U.S. Provisional Patent Application Serial No. 63 / 025,026, filed May 14, 2020, which is incorporated herein by reference in its entirety. Technical Field

[0003] One aspect of this disclosure relates to configuring an audio source device based on determining whether the audio output device is a headset or a speaker. Other aspects are also described. Background Technology

[0004] A headset is an audio device that includes a pair of speakers, each placed in the user's ear when worn on or around the user's head. Similar to a headset, headphones (or in-ear headsets) are two separate audio devices, each with a speaker that inserts into the user's ear. Both headsets and headphones are typically wired to a separate playback device, such as an MP3 player, which drives each speaker of the device with an audio signal to produce sound (e.g., music). Headsets and headphones provide a convenient way for users to listen to audio content privately without having to broadcast it to others nearby. Summary of the Invention

[0005] One aspect of this disclosure is a method performed by an audio source device, such as a multimedia device, including a microphone. The audio source device transmits an audio output signal to an audio output device for driving a speaker to output sound, the audio output signal potentially containing audio content desired by a user, such as music. For example, the source device may transmit the signal via a wired or wireless connection to the output device. The source device receives a microphone signal from its microphone, which captures sound output by the speaker of the output device. The source device determines whether the output device is a headset (e.g., in-ear headphones) or a speaker, and configures an acoustic dosimetry process based on this determination.

[0006] In one aspect, the determination can be based on how much of the output sound is contained within the microphone signal. For example, the source device can process the microphone signal by performing an acoustic echo cancellation process on the microphone signal using the audio output signal as a reference input to produce a linear echo estimate corresponding to the amount of output signal contained within the microphone signal. The source device determines the correlation level between the audio output signal and the linear echo estimate. In some aspects, the output device is determined to be a speaker when the correlation level is above a threshold, and a headset when the correlation level is below a threshold.

[0007] The above overview does not constitute an exhaustive list of all aspects of this disclosure. It is contemplated that this disclosure encompasses all systems and methods that can be practiced by all suitable combinations of the aspects outlined above and those disclosed in the detailed embodiments below and specifically pointed out in the claims. Such combinations may have specific advantages not specifically set forth in the foregoing summary. Attached Figure Description

[0008] Multiple aspects are illustrated in the accompanying drawings by way of example rather than limitation, and similar reference numerals in the drawings indicate similar elements. It should be noted that references to "a" or "an" aspect in this disclosure do not necessarily refer to the same aspect, and each refers to at least one. Furthermore, for the sake of brevity and to reduce the total number of drawings, a single drawing may be used to illustrate features of more than one aspect, and for a particular aspect, not all elements in that drawing may be necessary.

[0009] Figure 1A An audio system including an audio source device and an audio output device is shown.

[0010] Figure 1B An audio system including an audio source device and speakers is shown.

[0011] Figure 2 A block diagram is shown showing an audio system that configures audio source devices based on the type of audio output device.

[0012] Figure 3 This is a flowchart of one aspect of the process of configuring an audio source device based on the type of audio output device. Detailed Implementation

[0013] Various aspects of this disclosure will now be explained with reference to the accompanying drawings. Unless the shape, relative position, and other aspects of the components described in any aspect are explicitly defined, the scope of this disclosure is not limited to the components shown, which are for illustrative purposes only. Furthermore, while numerous details have been set forth, it should be understood that some embodiments may be implemented without these details. In other instances, well-known circuits, structures, and techniques have not been shown in detail so as not to obscure the understanding of the description. Moreover, unless the meaning is explicitly contrary, all scopes shown herein are to be considered to include the endpoints of each scope.

[0014] Acoustic dosimetry can be a process of measuring audio exposure over a period of time (e.g., one hour, one day, one week, one month, etc.) to provide a cumulative audio exposure reading (e.g., a sound pressure level (SPL) value). For example, a listener may be exposed to audio content (e.g., music) desired by the user through an audio output device such as headphones worn by the listener. Acoustic dosimetry can also involve measuring a listener's exposure to ambient noise. To measure ambient noise, electronic equipment (e.g., an SPL meter) captures noise very close to the listener (e.g., using a microphone) and outputs an SPL reading (e.g., displaying the reading on the SPL meter's display).

[0015] It has been confirmed that prolonged exposure to loud noise can cause hearing loss (e.g., noise-induced hearing loss (NIHL)). NIHL is attributed to damage to the microscopic hair cells in the inner ear caused by loud noise exposure. For example, prolonged exposure to sound levels of 85 dB or higher can lead to temporary or permanent hearing loss in one or both ears. Therefore, some organizations (e.g., the National Institute for Occupational Safety and Health (NIOSH)) recommend that workers' exposure to ambient noise should be kept below the equivalent of eight hours of 85 dBA to minimize occupational NIHL.

[0016] Electronic headphones have become increasingly popular due to their high-fidelity reproduction of media such as music, podcasts, and movie soundtracks without disturbing others nearby. Recently, the World Health Organization (WHO) issued a hearing health safety standard limiting the maximum sound output of headphones to 85 dBA. To meet this standard, an acoustic dosimetry process (e.g., an acoustic dosimetry process performed within the headphones or another electronic device paired with them) monitors the intra-ear SPL at the headphones and notifies (or alerts) the user when the sound exceeds this threshold. Specifically, during sound playback, this acoustic dosimetry process measures or estimates the intra-ear SPL, for example, at or near a tympanic membrane reference point. In one aspect, the intra-ear SPL is measured as follows: The signal from the headphones' internal microphone, which picks up all sound within the ear canal, can be processed to an equivalent SPL using, for example, laboratory calibration results, including correction factors, such as equalization, to be applied to the microphone signal. These correction factors can result in an occlusion effect where the headphones at least partially block the user's ear canal. Intra-ear SPL can be determined during playback via headphones worn by a user. Once estimated, the intra-ear SPL is converted into sound samples having units defined by hearing health safety standards, as described herein. These sound samples can then be used by a dosimetry process to track audio exposure to the headphones. However, converting the intra-ear SPL into sound samples may be unnecessary when sound is played back to the surrounding environment, for example, by a speaker. Therefore, it may be necessary to determine the type of audio output device through which the listener is receiving the sound in order to properly configure the dosimetry process (e.g., to convert the intra-ear SPL value when the output device is headphones).

[0017] To overcome these shortcomings, this disclosure describes an audio system capable of configuring a dosimetry process based on determining whether the listener is listening through headphones or a speaker. Specifically, the audio system may include an audio source device that transmits an audio output signal to an audio output device for driving a speaker to output sound. A microphone signal is obtained from a microphone in the audio source device, which captures the output sound. The audio system determines whether the audio output device is headphones or a speaker based on this microphone signal. Based on this determination, an acoustic dosimetry process is configured. For example, when the audio output device is determined to be headphones, the process is configured to perform a sound level measurement associated with headphones. In contrast, when the audio output device is determined to be a speaker, the process is configured to perform a sound level measurement associated with ambient noise. Therefore, this audio system is able to provide accurate sound level measurement results and notifications based on the type of audio output device that outputs the sound.

[0018] Figure 1AAn audio system 1 is shown, comprising an audio source device 2 and an audio output device 3 worn by a user (or wearer). In one aspect, the audio system may include other devices, such as a remote electronic server (not shown), communicatively coupled to the headset or audio source device and configured to perform one or more operations as described herein. As shown, the output device is a headset, an electronic device designed to be worn on a user's head and arranged to direct sound into the wearer's ears. Specifically, as shown in the figure, the headset is a pair of earphones (in-ear headsets or earbuds), with only the right earphone shown positioned on the user's right ear. In one aspect, the headset may include two earphones (one left and one right) or may include one earphone. In some aspects, the headset may be a sealed earphone with a flexible earpiece end designed to acoustically seal the entrance to the user's ear canal from the surrounding environment by blocking or closing it in the ear canal. On the other hand, the headset may be an over-ear headset (or headset receiver) that at least partially covers the user's respective ears. In some aspects, the output device is an on-ear headset receiver. In other aspects, the output device may be any electronic device that includes at least one speaker and is arranged to be worn by the user and to output sound.

[0019] Audio source device 2 is a multimedia device, more specifically a smartphone. In one aspect, the audio source device can be any electronic device capable of performing audio signal processing operations and / or networking operations. Examples of such devices could be tablets, laptops, desktop computers, smart speakers, etc. In another aspect, the source device can be a portable device, such as the smartphone shown in the figure. In yet another aspect, the source device can be a head-mounted device such as smart glasses, or a wearable device such as a smartwatch.

[0020] As shown in the figure, audio source device 2 is communicatively coupled to audio output device 3 via wired connection 4. Specifically, this wired connection can be one or more wires that are fixedly coupled to the audio output device (or integrated with the audio output device) and removably coupled to the source device. In one aspect, the wired connection can be removably coupled to each device in the device. In another aspect, the wired connection can be an analog wired connection via a connector (such as a 3.5mm jack) inserted into a jack in the audio source device. Once connected, the audio source device can be configured to drive the speaker of the output device using one or more audio output signals so that the output device can reproduce sound. In this case, the audio output signal can be an analog audio signal transmitted to the output device (via wired connection 4). In another aspect, the wired connection can be a digital connection via a connector such as a Universal Serial Bus (USB) connector, in which one or more audio signals are digitally transmitted to the audio output device for playback.

[0021] Figure 1B An audio system 1 is illustrated, comprising an audio source device 2 and an audio output device 5. As shown, the audio output device is a speaker 5, arranged to direct sound into the (surrounding) environment. In one aspect, the audio output device can be any electronic device arranged to output sound into the environment. For example, the output device 5 can be a standalone speaker, a smart speaker, a home theater system, or part of an infotainment system integrated into a vehicle. For example, the output device 5 can be at least one speaker that is part of an audio system (such as a home theater system or an infotainment system), as described herein. In one aspect, the output device 5 may include one speaker and / or more than one speaker. Similar to... Figure 1A The audio source device and audio output device 5 are shown to be communicatively coupled via a wired connection 4, which may be an analog or digital connection, as described herein.

[0022] In one aspect, the audio source device 2 can be communicatively coupled to the audio output device 3 or the audio output device 5 via a wireless connection, alternative to the wired connection 4 (or other than a wired connection). Specifically, in Figure 1A In this embodiment, audio source device 2 can be paired with audio output device 3 via a wireless connection to form an audio system configured to output sound. For example, the source device can be configured to establish a wireless connection with the output device via a wireless communication link (e.g., via the BLUETOOTH protocol or any other wireless communication protocol). During the established wireless communication link, the source device can exchange (e.g., transmit and receive) data packets (e.g., Internet Protocol (IP) packets) with the output device. This document describes further details regarding the establishment of the wireless communication link and the exchange of data.

[0023] In one aspect, an audio source device (such as device 2) may be able to identify an audio output device to which it is paired (e.g., communicatively coupled). For example, once the two devices are paired, the output device can transmit device data to the audio source device containing identification information (such as the type of electronic device). However, in some cases, the audio output device may be unable to transmit information or may not have the capability (or electronic components, such as memory, one or more processors, etc.) to transmit such information. For example, speaker 5 may be unable to transmit any information because the wired analog connection 4 may only be arranged to transmit (e.g., for the speaker to receive and / or transmit) analog audio signals. As another example, the output device may have the capability to transmit such information (e.g., communication), but may be unable to transmit it for various reasons (e.g., such information may not be accessible to the device). To overcome these shortcomings, this disclosure provides an audio system capable of determining the type of an audio output device that is part of the audio system (e.g., whether the device is a headset or a speaker). More details on how this determination is made are described herein.

[0024] Figure 2 A block diagram of an audio system 1 is shown, which configures the audio source device 2 based on whether the audio output device 15 is a headset or a speaker. The audio source device includes one or more microphones 11, an input source 12, a controller 10, and a network interface 21. In one aspect, the audio source device may include more or fewer elements (or components) as described herein. For example, the audio source device may include at least one display screen configured to display image data and may include one or more speakers.

[0025] Microphone 11 can be any type of microphone (e.g., a differential pressure gradient microelectromechanical system (MEMS) microphone) configured to convert acoustic energy caused by sound waves propagating in an acoustic environment into a microphone signal. Microphone 11 can be an “external” (or reference) microphone configured to capture sound from the acoustic environment, in contrast to an “internal” (or error) microphone configured to capture sound (and / or sense pressure changes) inside a user’s ear (or ear canal), as described herein.

[0026] Input source 12 may include a programmed processor running a media player application and may include a decoder generating an audio output signal as a digital audio input to controller 10. In one aspect, the programmed processor may be part of audio source device 2, enabling the media player application to run within the device. In another aspect, the application may run on another electronic device paired with the audio source device. In this case, the electronic device executing the program may (e.g., wirelessly) transmit the audio output signal to the audio source device. In some aspects, the decoder may be able to decode encoded audio signals that have been encoded using any suitable audio codec such as, for example, Advanced Audio Codec (AAC), MPEG Audio Layer II, MPEG Audio Layer III, and Free Lossless Audio Codec (FLAC). Alternatively, input audio source 12 may include a codec that converts analog or optical audio signals from the line input into a digital form, for example, for the controller. Alternatively, more than one input audio channel may exist, such as a two-channel input, i.e., the left and right channels of a stereo recording of a musical work, or more than two input audio channels, such as the entire audio track in a 5.1 surround format for an animation reel or film. In one aspect, input source 12 may provide digital or analog input.

[0027] Controller 10 may be a dedicated processor such as an application-specific integrated circuit (ASIC), a general-purpose microprocessor, a field-programmable gate array (FPGA), a digital signal controller, or a set of hardware logic structures (e.g., filters, arithmetic logic units, and dedicated state machines). The controller is configured to perform acoustic dosimetry process operations, echo cancellation operations, and networking operations. For example, controller 10 is configured to receive an audio output signal from input source 12, determine whether the audio output device communicatively coupled (or paired) to the audio source device is a headset or a speaker, and configure the dosimetry process based on this determination. Further details regarding the operations performed by the controller are described herein. In one aspect, the operations performed by controller 10 may be implemented in software (e.g., instructions stored in the memory of audio source device 2 and executed by controller 10) and / or may be implemented by hardware logic structures as described herein.

[0028] The audio output device 15 includes at least one speaker 16. For example, as described herein, the audio output device may be headphones (e.g., Figure 1A Headphones 3) or speakers (e.g., Figure 1BThe speaker 5 in the speaker 16. In one aspect, the audio output device 15 may include more or fewer elements. For example, device 15 may include one or more processors that can be configured to perform audio signal processing operations, may include one or more (internal or external) microphones, and may include a network interface. Alternatively, the output device may include only one speaker. In one aspect, one or more speakers in speaker 16 may be, for example, motorized drivers specifically designed for sound output in a particular frequency band, such as woofers, tweeters, or midrange drivers. In one aspect, speaker 16 may be a “full-range” (or “full-band”) motorized driver that reproduces as much of the audible frequency range as possible.

[0029] As described herein, audio source device 2 can be paired with audio output device 15 to exchange data. For example, audio source device 2 can be a wireless electronic device configured to establish a (wireless) communication data link 13 (or wireless connection) with another electronic device (such as output device 15) via network interface 21 using, for example, the BLUETOOTH protocol or WLAN through a wireless computer network (e.g., a Wireless Personal Area Network (WPAN)) to exchange data. In one aspect, network interface 21 is configured to establish a wireless communication data link 13 with a wireless access point to exchange data with a remote electronic server (e.g., via the Internet). In another aspect, and as described herein, communication link 13 can be a wired connection (e.g., via a wire coupling the two devices together). When the two devices are paired, the audio source device is configured to transmit an audio output signal to audio output device 15 via the established communication link 13. Audio output device 15 drives one or more speakers 16 with the output signal to reproduce sound. Thus, the audio output device can stream and output audio signals from the source device, which may contain content desired by the user, such as music.

[0030] As shown, the controller 10 may have one or more operating blocks, which may include a linear echo canceller (or canceller) 17, a decision logic unit 19, and an acoustic dosimetry unit 20. The linear echo canceller 17 is configured to reduce (or eliminate) the linear component of the echo by estimating the echo from the audio output signal transmitted from the source device to the output device 15 for playback. Specifically, the canceller performs an acoustic echo cancellation process on the microphone signal using the audio output signal as a reference input to produce a linear echo estimate representing an estimate of the amount of audio output signal (output by the speaker 16) in the microphone signal generated by the microphone 11. The canceller determines a linear filter 18 (e.g., a finite impulse response (FIR) filter) and applies the filter to the audio output signal to generate the linear echo estimate. In one aspect, the linear filter 18 is a default filter stored in the memory of the source device 2 (the controller). In another aspect, the filter is determined by measuring the impulse response at the microphone 11. For example, the audio source device may drive the speaker 16 of the output device to output sound. In response to the sound, the microphone generates a microphone signal, and a pulse response is measured from the microphone signal, which represents the transmission path between the speaker 16 and the microphone 11.

[0031] The canceller 17 receives the microphone signal generated by the microphone 11. In one aspect, the microphone signal is generated in response to the speaker 16 of the audio output device 15 reproducing the audio output signal. Therefore, the microphone signal may contain the sound of the output sound of the speaker 16 (e.g., echo) and other sounds. The canceller 17 subtracts the linear echo estimate generated by the filter 18 from the microphone signal to generate an error signal in order to remove (all or at least some) the echo. The canceller 17 uses the error signal to update the filter 18 such that the difference between the microphone signal and the error signal is reduced.

[0032] Decision logic unit 18 is configured to obtain a linear echo estimate generated from canceller 17 and an audio output signal from input source 12, and is configured to determine whether audio output device 15 is a headset or a speaker. Specifically, the decision logic unit determines the correlation level between the linear echo estimate and the audio output signal. For example, the decision logic unit determines whether there is sufficient correlation between the echo estimate and the microphone signal. In one aspect, sufficient correlation exists when the correlation level between the estimate and the signal is above a threshold. If it is above the threshold, meaning that the microphone signal contains at least some of the audio output signal output by speaker 16, the decision logic unit determines that output device 15 is a speaker. A correlation level above the threshold is a result of sound being output to the surrounding environment. However, if the correlation level is below the threshold, the decision logic unit determines that the output device is a headset, because this may mean that the output device is not outputting sound to the surrounding environment. In one aspect, the threshold can be different. For example, the determination of whether the output device is a speaker can be based on a correlation level above a first threshold, while the determination of whether the output device is a headset can be based on a correlation level below a second threshold, which is lower than the first threshold.

[0033] Acoustic dosimetry unit 20 is configured to receive a signal from decision logic unit 19 indicating the type of audio output device 15 paired with the audio source device, and is configured to perform an acoustic dosimetry process based on the signal. Specifically, upon receiving an indication that the audio output device is a headset, the acoustic dosimetry process is configured to perform a sound level measurement associated with the use of the headset, and is configured to output a notification associated with the measurement result. For example, the dosimetry process may estimate the intraocular sound pressure level (SPL) as follows. Acoustic dosimetry unit 20 may calculate a measure of the intensity of the audio output signal being played back, such as a root mean square (RMS) value. Note that the output audio is the result of an audio rendering process that performs a conventional audio signal processing operation chain on the input playback signal (containing media such as music or movie soundtracks). These may include dynamic range adjustment, equalization, and gain adjustment for volume steps. The process then converts the RMS value of such output audio into the intraocular SPL by applying output sensitivity data (for the currently used headset) to the RMS value (multiplying it by the acoustic output sensitivity data). In one aspect, the output sensitivity data can be specified as data that may include headphone output sensitivity and volume profile parameters. This data can be stored within the audio source device 2. In another aspect, the data can be transmitted by the audio output device. In yet another aspect, the data can be general or default data (e.g., not used for any particular audio output device). For example, converting a dB full-scale RMS value to an in-ear SPL dB value.

[0034] In one aspect, the intra-ear SPL can be determined by processing microphone signals obtained from the internal microphone of the audio output device, as described herein. In another aspect, the intra-ear SPL can be determined by processing at least one of the internal microphone and external microphone of the audio output device.

[0035] Next, the measurement or estimate of the intra-ear SPL is converted into units of hearing health safety standards for audio exposure (standards or commonly defined measures of permissible audio exposure for hearing health). For example, the intra-ear SPL can be multiplied by a transfer function (which has been determined in a laboratory setting) that converts the intra-ear SPL into an equivalent free-field or diffuse-field measurement of sound picked up by a dummy reference microphone located at a distance from the user, as defined by hearing health safety standards. This result is referred to herein as a calculated sound sample, for example, in SPL dBA (A-weighted decibels).

[0036] In one aspect, sound samples can be repeatedly calculated over time, such as every second or other suitable interval during playback. These sound samples can then be presented by an application (also executed by the processor 10 in the audio source device 2) for visualization on the graphical user interface of the audio source device (not shown). For example, a health application may be authorized to access a locally stored health database to retrieve sound samples and calculate various statistical measures of the collected sound samples, such as Leq dBA (mean) over a specific time interval. The health application can then “show” the user their audio exposure due to playback from the headphones. The health application can also visualize to the user which parts of the sound samples were generated by which applications (e.g., music applications, video game applications, and movie players), and which models of on-ear audio devices generated which sound samples. It is anticipated that the user may use several different models of headphone devices to listen at different volume steps or with different media, such as in-ear wired earbuds, in-ear wireless earbuds, and on-ear headsets. This available information can be monitored and reported to the user by the health application. Other methods (acoustic dosimetry) are also possible for reporting useful information about such collected sound samples to the user. For example, the data can be presented by another electronic device paired with the source device. Alternatively, the audio source device can output tactile or audio alarms indicating audio exposure.

[0037] However, if the acoustic dosimetry unit 20 receives an indication from the decision logic unit 19 that the audio output device 15 is a speaker, the acoustic dosimetry process is configured to perform a sound level measurement associated with ambient noise and to output a notification associated with the measurement result. For example, to perform a sound level measurement, the process obtains a microphone signal generated by the microphone 11 of the source device 2 and uses this signal to estimate the SPL of the surrounding environment. Alternatively, the acoustic dosimetry unit may obtain the microphone signal from one or more electronic devices (e.g., wearable devices) paired with the source device 2. Based on the estimated SPL, the acoustic dosimetry unit 20 may output an alarm or notification associated with the ambient sound level, such as the current SPL, as described herein.

[0038] Figure 3 This is a flowchart of one aspect of the process of configuring an audio source device based on whether the audio output device is a headset or a speaker. In one aspect, process 40 is performed by the audio source device 2 (e.g., its controller 10) and / or by the audio output device 15. Therefore, reference will be made to... Figure 2 To describe the diagram, process 40 begins with controller 10 driving the audio output device of the audio source device to output sound using the audio signal (at box 41). Specifically, controller 10 of the audio source device may signal to network interface 21 that the audio output signal is being transmitted to output device 15 for playback. Once signaled, the audio output signal (via communication link 13) is transmitted to audio output device 15, which uses the signal to drive speaker 16 to output the sound contained within the signal. On the other hand, when audio output device 15 includes multiple speakers (e.g., in the case of headphones with left and right speakers), source device 2 may transmit multiple audio output signals (e.g., left audio channel and right audio channel).

[0039] Controller 10 receives a microphone signal from microphone 11 of audio source device 2, which captures the output sound (at box 42). Specifically, microphone 11 senses the output sound and, in response, generates a microphone signal containing the output sound and / or ambient noise in the surrounding environment. Controller 10 determines whether the audio output device is a headset or a speaker based on this microphone signal (at box 43). Specifically, controller 10 (with its linear echo canceller 18) processes the microphone signal by performing an acoustic echo cancellation process on the microphone signal using the audio output signal as a reference input to generate a linear echo estimate. Decision logic unit 19 determines whether the audio output device is a headset or a speaker based on the level of correlation between the audio output signal driving the audio output device and the linear echo estimate. Controller 10 configures the acoustic dosimetry process based on this determination (at box 44). For example, when the audio output device is a headset, controller 10 can determine the in-ear SPL to monitor sound samples, as described herein.

[0040] Some aspects may perform variations of the processes described herein. For example, at least some specific operations in these processes may not be performed in the exact order shown and described. The specific operation may not be performed in a sequential series of operations, and different specific operations may be performed in different aspects. For example, once an acoustic dosimetry process is configured, an audio source device captures and stores one or more sound samples to generate cumulative data over time (e.g., one day). In one aspect, based on this cumulative data, the source device may output a notification (or alert) to indicate an audio exposure reading to the user of the source device.

[0041] As described herein, one aspect of the present invention is the collection and use of data available from specific and legitimate sources to improve a user's hearing health and safety. This disclosure envisions that, in some instances, the collected data may include personal information data that uniquely identifies or can be used to identify a specific person. Such personal information data may include demographic data, location-based data, online identifiers, telephone numbers, email addresses, home addresses, data or records related to a user's health or fitness level (e.g., vital sign measurements, medication information, exercise information, SPL measurement results), date of birth, or any other personal information.

[0042] This disclosure recognizes that the use of such personal information data in the techniques of this invention can benefit users. For example, health and fitness data can be used to measure a user's audio exposure and provide cumulative audio exposure readings based on user preferences. Accordingly, the use of such personal information data enables users to develop better listening habits.

[0043] This disclosure assumes that entities responsible for collecting, analyzing, disclosing, transmitting, storing, or otherwise using such personal information data will comply with established privacy policies and / or privacy practices. Specifically, it is expected that such entities will implement and consistently apply privacy practices generally recognized as meeting or exceeding industry or governmental requirements for protecting user privacy. Such information regarding the use of personal data should be highlighted and easily accessible to users, and should be updated as the collection and / or use of data changes. Users' personal information should be collected only for lawful use. Furthermore, such collection / sharing should only occur after receiving user consent or other lawful grounds provided for in applicable law. In addition, such entities should consider taking any necessary steps to protect and safeguard access to such personal information data and ensure that others with access to personal information data comply with their privacy policies and processes. Additionally, such entities may be subject to third-party assessments to demonstrate their compliance with widely accepted privacy policies and practices. Furthermore, policies and practices should be tailored to the specific types of personal information data collected and / or accessed, and made applicable to applicable laws and standards, including jurisdiction-specific considerations that may be used to impose higher standards. For example, in the United States, the collection or access to certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while health data in other countries may be subject to other regulations and policies and should be handled accordingly.

[0044] Regardless of the foregoing, this disclosure also contemplates implementation schemes for users to selectively block the use or access to personal information data. That is, this disclosure contemplates providing hardware and / or software components to prevent or block access to such personal information data. For example, in the case of advertising delivery services, the inventive technology can be configured to allow users to opt-in or opt-out at any time during or after service registration to participate in the collection of personal information data. In addition to providing opt-in and opt-out options, this disclosure envisions providing notifications related to access to or use of personal information. For example, users may be notified when downloading an application that their personal information data will be accessed, and then reminded again just before the application accesses the personal information data.

[0045] Furthermore, the purpose of this disclosure is to manage and process personal information data to minimize the risk of unintentional or unauthorized access or use. Once data is no longer needed, this risk can be minimized by limiting data collection and deleting data. Additionally, and where applicable, including in certain health-related applications, data deidentification can be used to protect user privacy. Deidentification can be facilitated, where appropriate, by removing identifiers, controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than the address level), controlling how data is stored (e.g., aggregating data among users), and / or other methods such as differentiated privacy.

[0046] Therefore, while this disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, it is also contemplated that various embodiments can be implemented without access to such personal information data. That is, various embodiments of the present invention will not be rendered inoperable due to the absence of all or part of such personal information data. For example, content can be selected and delivered to the user based on aggregated non-personal information data or an absolute minimum amount of personal information, such as content processed only on the user's device or other non-personal information that can be used for content delivery services.

[0047] As previously described, one aspect of this disclosure may be a non-transitory machine-readable medium (such as a microelectronic memory) storing instructions thereon, which program one or more data processing units (generally referred to herein as a "processor") to perform network operations, signal processing operations, audio signal processing operations, and audio dosimetry operations. In other aspects, some of these operations may be performed by specific hardware components containing hard-wired logic. Alternatively, those operations may be performed by any combination of programmed data processing units and fixed hard-wired circuit components.

[0048] While certain aspects have been described and illustrated in the accompanying drawings, it should be understood that such aspects are merely illustrative of the broad disclosure and not limiting, and that this disclosure is not limited to the specific structures and arrangements shown and described, as various other modifications will be apparent to those skilled in the art. Therefore, the description is to be regarded as exemplary and not restrictive.

[0049] In some aspects, this disclosure may include the language "[element A] and [element B] at least one". This language may refer to one or more of these elements. For example, "at least one of A and B" may refer to "A", "B", or "A and B". Specifically, "at least one of A and B" may refer to "at least one of A and at least one of B" or "at least either A or B". In some aspects, this disclosure may include the language "[element A], [element B], and / or [element C]". This language may refer to any of these elements or any combination thereof. For example, "A, B, and / or C" may refer to "A", "B", "C", "A and B", "A and C", "B and C", or "A, B, and C".

Claims

1. A method executed by a processor of an audio source device, the method comprising: The audio output device of the audio source device is driven to output sound using the audio output signal; A microphone signal is obtained from the microphone of the audio source device, and the microphone signal captures sound output; The audio output device is determined to be either a headset or a speaker based on the correlation level between the audio output signal and the microphone signal. In response to determining that the audio output device is a headset, an acoustic dosimetry process is configured for the headset to estimate a sound level measurement in the ear of a user wearing the headset using a measurement of the signal strength of the audio output signal, wherein estimating the sound level measurement includes applying output sensitivity data of the headset to the signal strength measurement to convert the signal strength measurement into an intraocular sound pressure level; and In response to determining that the audio output device is a loudspeaker, an acoustic dosimetry process is configured for the loudspeaker, the acoustic dosimetry process being configured to perform a sound level measurement associated with ambient noise.

2. The method of claim 1, wherein the determination comprises: Using the audio output signal as a reference input, an acoustic echo cancellation process is performed on the microphone signal to generate a linear echo estimate; as well as Determine the correlation level between the audio output signal and the linear echo estimation.

3. The method according to claim 1, wherein When the correlation level is higher than a threshold, the audio output device is identified as the speaker, and When the correlation level is below the threshold, the audio output device is identified as the headphones.

4. The method of claim 1, wherein the audio source device is communicatively coupled to the audio output device via a wired connection.

5. The method of claim 1, wherein the speaker is part of a smart speaker.

6. The method of claim 1, wherein when it is determined that the audio output device is the headphones, the acoustic dosimetry procedure for the headphones is further configured to perform a sound level measurement associated with sound picked up in the ear canal of the user wearing the headphones.

7. The method of claim 1, wherein the ambient noise includes the sound output within the environment including the audio source device and the audio output device.

8. An audio source device, comprising: microphone; processor; and A memory storing instructions that, when executed by the processor, cause the audio source device to perform the following operations: Drive audio output devices to output sound using audio output signals; A microphone signal is obtained from the microphone, and the microphone signal captures sound output; The audio output device is determined to be either a headset or a speaker based on the correlation level between the audio output signal and the microphone signal. In response to determining that the audio output device is a headset, an acoustic dosimetry process is configured for the headset to estimate a sound level measurement in the ear of a user wearing the headset using a measurement of the signal strength of the audio output signal, wherein estimating the sound level measurement includes applying output sensitivity data of the headset to the signal strength measurement to convert the signal strength measurement into an intraocular sound pressure level; and In response to determining that the audio output device is a loudspeaker, an acoustic dosimetry process is configured for the loudspeaker, the acoustic dosimetry process being configured to perform a sound level measurement associated with ambient noise.

9. The audio source device of claim 8, wherein the instruction for determining whether the audio output device is a headset or a speaker includes instructions for the following operations: Using the audio output signal as a reference input, an acoustic echo cancellation process is performed on the microphone signal to generate a linear echo estimate; and Determine the correlation level between the audio output signal and the linear echo estimation.

10. The audio source device according to claim 8, wherein When the correlation level is higher than a threshold, the audio output device is identified as the speaker, and When the correlation level is below the threshold, the audio output device is identified as the headphones.

11. The audio source device of claim 8, wherein the audio source device is communicatively coupled to the audio output device via a wired connection.

12. The audio source device of claim 8, wherein the speaker is part of a smart speaker.

13. The audio source device of claim 8, wherein when it is determined that the audio output device is the headphones, the acoustic dosing measurement process for the headphones is further configured to perform a sound level measurement associated with the sound picked up in the ear canal of the user wearing the headphones.

14. The audio source device of claim 8, wherein the ambient noise includes the sound output within the environment comprising the audio source device and the audio output device.

15. An article of manufacture comprising a machine-readable medium storing instructions that, when executed by a processor of an audio source device, perform the following operations: The audio output device of the audio source device is driven to output sound using the audio output signal; A microphone signal is obtained from the microphone of the audio source device, and the microphone signal captures sound output; The audio output device is determined to be either a headset or a speaker based on the correlation level between the audio output signal and the microphone signal. In response to determining that the audio output device is a headset, an acoustic dosimetry process is configured for the headset to estimate the sound level in the ear of a user wearing the headset by measuring the signal strength of the audio output signal, wherein... Estimating the sound level measurement includes applying the output sensitivity data of the headphones to the signal strength measurement to convert the signal strength measurement into an intra-ear sound pressure level; and In response to determining that the audio output device is a loudspeaker, an acoustic dosimetry process is configured for the loudspeaker, the acoustic dosimetry process being configured to perform a sound level measurement associated with ambient noise.

16. The article of manufacture of claim 15, wherein the instruction for determining whether the audio output device is a headset or a speaker includes instructions for: Using the audio output signal as a reference input, an acoustic echo cancellation process is performed on the microphone signal to generate a linear echo estimate; and Determine the correlation level between the audio output signal and the linear echo estimation.

17. The article of manufacture according to claim 15, wherein: When the correlation level is higher than a threshold, the audio output device is identified as the speaker, and When the correlation level is below the threshold, the audio output device is identified as the headphones.

18. The article of manufacture according to claim 15, wherein the audio source device is communicatively coupled to the audio output device via a wired connection.

19. The article of manufacture according to claim 15, wherein the speaker is part of a smart speaker.

20. The article of manufacture according to claim 15, wherein, when determining that the audio output device is the headphones, the acoustic dosing measurement process for the headphones is further configured to perform a sound level measurement associated with sound picked up in the ear canal of the user wearing the headphones.

21. The article of manufacture according to claim 15, wherein the ambient noise includes the sound output within an environment including the audio source device and the audio output device.

Images