Electronic device and control method thereof
Patent Information
- Application Number
- CN202180072310.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-10-21
- Filing Date
- 2021-09-15
- Publication Date
- 2026-09-18
- Estimated Expiration
- 2041-09-15
AI Technical Summary
然而,扬声器可能易受环境噪声(ambient noise)的影响,结果,该测试的准确性可能差
[0017] According to various aspects of this disclosure, hearing tests using distortion product otoacoustic emissions can be performed for each ear using only one speaker with one channel.
Smart Images

Figure CN116348030B_ABST
Abstract
Description
Technical Field
[0001] This disclosure generally relates to signal processing, and more specifically, to an electronic device and its control method for performing hearing tests using distortion product otoacoustic emissions. Background Technology
[0002] With technological advancements, related services and functions are being offered through relevant electronic devices, such as smartphones or other portable electronic devices. As a result, more and more users are experiencing hearing loss due to the increased use of personal listening devices.
[0003] Accordingly, manufacturers of related electronic devices may be more interested in the field of personal hearing testing and care on electronic devices.
[0004] Relevant hearing tests may include, but are not limited to, pure tone audiometry (PTA), transient evoked otoacoustic emission (TEOAE), and distortion product otoacoustic emission.
[0005] PTA can refer to a manual test performed by having a user listen to pure tones produced in an anechoic chamber and press a button. The advantage of PTA is that it allows testing of various auditory organs. However, compared to other related hearing tests, a disadvantage of PTA may be that it requires long-term testing.
[0006] In transient evoked otoacoustic emissions (TEOAE) testing, a sound with a wide frequency range is briefly output through a loudspeaker, and the response sound is received with a certain delay through a microphone. This test can examine the condition of hair cells at each frequency based on the time-varying response characteristics. TEOAE testing can be performed on each ear using a single loudspeaker. However, loudspeakers can be susceptible to ambient noise, resulting in potentially poor accuracy of the test.
[0007] Distortion product otoacoustic emissions (DME) can output two pure signals at frequencies f1 and f2 to each ear, respectively. The response sound can be received via a microphone, and hearing can be tested based on third-order low-frequency intermodulation distortion signals (e.g., frequencies 2f1–f2) that, although not output by the device being tested, can be included in the response sound. As a result, DME offers advantages in accuracy and noise resistance compared to other relevant hearing tests. Summary of the Invention
[0008] Technical issues
[0009] While distortion product otoacoustic emissions (OAE) testing may be advantageous for the early detection of hearing loss, it may require two speakers per ear to prevent unwanted distortion signals. That is, because the two speakers must operate separately in a single hearing device corresponding to one ear, each ear may require two sound processors and two drivers for channel control. Furthermore, to perform testing on both ears simultaneously, two sound processors and two drivers per ear may be needed (e.g., a total of four sound processors and four drivers), which may impose limitations on the hardware required to perform hearing tests using OAE.
[0010] Therefore, further improvements are needed in performing hearing tests, as the need to use distortion-product otoacoustic emissions may be constrained by the hardware required for the tests. This paper proposes improvements. These improvements may also be applicable to other multi-audio signal processing techniques and standards employing these techniques.
[0011] According to various aspects of this disclosure, electronic devices and control methods thereof are provided, which are capable of performing hearing tests based on distortion product otoacoustic emissions by combining an acoustic signal for testing and an inverted signal for canceling distortion signals associated with distortion product otoacoustic emissions, or even by using a single loudspeaker operating on the acoustic tract of each ear.
[0012] Technical solution
[0013] According to one aspect of this disclosure, an electronic device is provided. The electronic device includes a speaker, a microphone, a memory storing instructions and multiple protocols, a digital signal processor (DSP), a driver, and a processor operatively coupled to the speaker, microphone, memory, DSP, and driver. The driver is configured to convert a digital signal output from the DSP into an analog signal and output the analog signal to the speaker. The processor is configured to execute instructions to control the DSP to obtain a first sound signal by combining a first signal, a second signal, and a first inverted signal based on a first protocol among the multiple protocols. The first inverted signal has a third frequency associated with distortion product otoacoustic emissions (DPOAE) of a first frequency of the first signal and a second frequency of the second signal. The processor is also configured to control the driver to output the first sound signal through the speaker. The processor is further configured to receive a second sound signal associated with the first sound signal through the microphone in response to the output of the first sound signal. The processor is further configured to extract a first DPOAE signal of the third frequency from the second sound signal. The processor is also configured to control the DSP to obtain a third sound signal by combining a fourth signal, a fifth signal, and a second inverted signal based on a second protocol among the multiple protocols. The second inverted signal has a sixth frequency associated with the DPOAE of the fourth frequency of the fourth signal and the fifth frequency of the fifth signal. The processor is also configured to control a driver to output a third sound signal via a speaker. The processor is also configured to receive a fourth sound signal associated with the third sound signal via a microphone in response to the output of the third sound signal. The processor is also configured to extract a second DPOAE signal with the sixth frequency from the fourth sound signal. The processor is also configured to obtain a user hearing profile based on the first and second DPOAE signals. The processor is also configured to perform at least one of a volume change and an equalization (EQ) change on the sound to be output based on the user hearing profile.
[0014] According to one aspect of this disclosure, a method for controlling an electronic device is provided. The method includes, based on a first protocol among a plurality of protocols stored in a memory of the electronic device, outputting a first sound signal obtained by combining a first signal having a first frequency, a second signal having a second frequency, and a first inverted signal having a third frequency associated with distortion product otoacoustic emissions (DPOAE) of the first and second frequencies via a speaker of the electronic device. The method further includes, in response to receiving a second sound signal associated with the first sound signal via a microphone of the electronic device, extracting the first DPOAE signal of the third frequency from the second sound signal. The method also includes, based on the second protocol among the plurality of protocols, outputting a third sound signal obtained by combining a fourth signal having a fourth frequency, a fifth signal having a fifth frequency, and a second inverted signal having a sixth frequency associated with the DPOAE of the fourth and fifth frequencies via a speaker. The method further includes, in response to receiving a fourth sound signal associated with the third sound signal via a microphone, extracting the second DPOAE signal of the sixth frequency from the fourth sound signal. The method also includes obtaining a user hearing profile based on the first and second DPOAE signals. The method further includes performing at least one of volume adjustment and equalization (EQ) adjustment of the sound to be output based on the user hearing profile.
[0015] According to one aspect of this disclosure, an electronic device is provided. The electronic device includes a memory storing instructions and a processor operatively coupled to the memory. The processor is configured to execute instructions to extract a plurality of DPOAE signals from corresponding plurality of received audio signals. The corresponding plurality of received audio signals have been received in response to the transmission of a plurality of associated audio signals, which are obtained by combining a first signal, a second signal, and an inverted signal according to a corresponding protocol of a plurality of protocols. The inverted signal has a third frequency associated with a DPOAE of a first frequency of the first signal and a second frequency of the second signal. The processor is further configured to obtain a user hearing profile based on the plurality of DPOAE signals. The processor is also configured to perform at least one of a volume change and an EQ change of the sound to be output based on the user hearing profile.
[0016] Beneficial effects
[0017] According to various aspects of this disclosure, hearing tests using distortion product otoacoustic emissions can be performed for each ear using only one speaker with one channel.
[0018] According to various aspects of this disclosure, hearing loss can be reduced by obtaining a customized equalization for each user to suit their hearing condition and outputting a sound signal.
[0019] Other aspects will be set forth in part in the description which follows, and will also be apparent in part from the description, or may be learned by practice of the presented embodiments. Attached Figure Description
[0020] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:
[0021] Figure 1 This is a view illustrating a hearing test system using distortion product otoacoustic emissions according to an embodiment of the present disclosure;
[0022] Figure 2 This is a view illustrating the configuration and operation of an electronic device according to embodiments of the present disclosure;
[0023] Figure 3 This is a view illustrating a method for controlling an electronic device using distortion product otoacoustic emissions according to an embodiment of the present disclosure;
[0024] Figure 4A This is a view illustrating the configuration and operation of an electronic device according to embodiments of the present disclosure;
[0025] Figure 4B This is a view showing the sound signal output from a loudspeaker according to an embodiment of the present disclosure;
[0026] Figure 4C This is a view illustrating a sound signal input from a user's ear according to an embodiment of the present disclosure;
[0027] Figure 5A and Figure 5B This is a view showing the sound signal output from a loudspeaker according to an embodiment of the present disclosure;
[0028] Figure 6A and Figure 6B This is a view illustrating a sound signal input from a user's ear according to an embodiment of the present disclosure;
[0029] Figure 7 This is a view illustrating the operation of an inverted signal for determining the otoacoustic emission frequency of a distortion product to be combined with an audio signal, according to an embodiment of the present disclosure;
[0030] Figure 8A and Figure 8B This is a view illustrating the operation of an inverted signal for determining the otoacoustic emission frequency of a distortion product to be combined with an audio signal, according to an embodiment of the present disclosure;
[0031] Figure 9 This is a view illustrating the operation of an inverted signal for determining the otoacoustic emission frequency of a distortion product to be combined with an audio signal, according to an embodiment of the present disclosure;
[0032] Figure 10 This is a view illustrating the operation of an inverted signal for determining the otoacoustic emission frequency of a distortion product to be combined with an audio signal, according to an embodiment of the present disclosure;
[0033] Figure 11 This is a view illustrating a hearing test performed by an electronic device according to an embodiment of the present disclosure;
[0034] Figure 12 This is a view illustrating the operation of outputting an audio signal based on an obtained user hearing profile, according to an embodiment of the present disclosure;
[0035] Figure 13 This is a view illustrating the operation of outputting an audio signal based on an obtained user hearing profile, according to an embodiment of the present disclosure;
[0036] Figure 14 This is a view illustrating the operation of outputting an audio signal based on an obtained user hearing profile, according to an embodiment of the present disclosure;
[0037] Figure 15 This is a view illustrating operation for outputting a sound signal based on an obtained user hearing profile, according to an embodiment of this disclosure; and
[0038] Figure 16 This is a view illustrating the operation of outputting an audio signal based on an obtained user hearing profile, according to an embodiment of the present disclosure. Detailed Implementation
[0039] The following description, provided with reference to the accompanying drawings, is intended to aid in a full understanding of embodiments of the present disclosure as defined by the claims and their equivalents. Various specific details are included to aid understanding, but these details are considered exemplary only. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Furthermore, for clarity and brevity, descriptions of well-known functions and structures have been omitted.
[0040] References to “an embodiment,” “an embodiment,” “an exemplary embodiment,” or similar language throughout this disclosure may indicate that a particular feature, structure, or characteristic described in connection with the indicated embodiment is included in at least one embodiment of the present solution. Therefore, throughout this disclosure, the phrases “in an embodiment,” “in an embodiment,” “in an exemplary embodiment,” and similar language may, but not necessarily, refer to the same embodiment.
[0041] It should be understood that the specific order or hierarchy of the boxes in the disclosed process / flowchart is an illustration of exemplary methods. Based on design preferences, it should be understood that the specific order or hierarchy of the boxes in the process / flowchart can be rearranged. Furthermore, some boxes can be combined or omitted. The appended claims present the elements of the various boxes in a sample order and are not intended to limit one to the specific order or hierarchy presented.
[0042] Various embodiments of the present disclosure are described below with reference to the accompanying drawings.
[0043] Figure 1 A hearing test system using distortion production otoacoustic emission (DPOAE) according to an embodiment is shown.
[0044] According to an embodiment, the hearing testing system may include an electronic device 100. The electronic device 100 may output sound and then receive sound generated from the ear of the user 10.
[0045] According to an embodiment, the electronic device 100 can determine whether the user 10's hearing is normal based on the distortion product otoacoustic emission signal in the sound generated from the user 10's ear, according to the sound output. For example, the electronic device 100 can output a single sound signal through a single speaker 150, which is a combination of multiple signals with different frequencies. The multiple signals with different frequencies may include a pure tone signal of a first frequency, a pure tone signal of a second frequency, multiple intermodulation distortion signals associated with the first and second frequency pure tone signals, and an inverted signal of the distortion product otoacoustic emission frequency among the multiple intermodulation distortion signals. (Refer to below) Figure 4A Describe the operation of combining multiple signals.
[0046] Intermodulation distortion can refer to the distortion caused when two independent input signals are combined in a filter. In other words, intermodulation distortion can be a nonlinear distortion through which frequencies generated by a linear combination of the fundamental frequency and harmonics of the input signals are included in the output signal. For example, when a first signal having a first frequency (e.g., f1) and a second signal having a second frequency (e.g., f2) are combined, multiple intermodulation distorted signals can be generated, such as, but not limited to, signals with frequencies of f2–f1, 2f1–f2, and 2f2–f1.
[0047] Otoacoustic emissions (OAEs) can refer to spontaneously generated and / or amplified acoustic energy through sound stimulation in the outer hair cells of the cochlea. That is, OAEs can occur regardless of whether the auditory nerve is severed. Alternatively or additionally, OAEs may not occur when there is no sensitivity to changes in external conditions and / or cochlear hearing loss. OAEs allow for the examination (testing) of abnormalities in the cochlea and / or auditory hair cells in a simplified manner and for a relatively short time, without impairing auditory function. Therefore, OAEs can be used for early diagnosis of hearing loss and for objective testing, such as, but not limited to, hearing tests in newborns and children.
[0048] Distortion product otoacoustic emissions (DMEs) can be a type of otoacoustic emission. DMEs refer to otoacoustic emissions of various frequencies that may occur at the overlap of two pure-tone stimuli with two different frequencies (e.g., a first signal f1 and a second signal f2) that have been applied simultaneously. That is, DMEs can be a product (e.g., a result) of nonlinear distortion induced by the cochlea. The magnitude of the response to DMEs may be influenced by the relative and / or absolute intensities of the pure tones and the frequency ratio of the pure tones. For example, when the frequency ratio is 1.2 (e.g., f2 = 1.2 × f1), and the intensity of the first signal f1 is approximately 5 to 10 dB SPL higher (e.g., larger) than the intensity of the second signal f2, a strong response (e.g., distortion) may occur at frequencies between 2f1 and f2.
[0049] In an embodiment, the electronic device 100 may repeatedly adjust the frequency of a sound and output the adjusted sound. Alternatively or additionally, the electronic device 100 may repeatedly receive the distortion product otoacoustic emissions (OAEs) of the (adjusted) output sound. That is, the electronic device 100 may obtain a user's hearing profile based on multiple received OAE signals.
[0050] According to various embodiments, the electronic device 100 may include an ear probe and output sound when the ear probe portion is inserted into the outer ear of the user 10.
[0051] According to various embodiments, the ear probe of the electronic device 100 can not only be inserted into the outer ear of the user 10, but can also surround a portion of the user 10's ear from the outside. That is, at least a portion of the electronic device 100 can be configured to be inserted into the outer ear, and at least another portion of the electronic device 100 can be configured to be positioned around the outside of the ear.
[0052] According to an embodiment, the hearing testing system may further include an external device 200 that communicates with the electronic device 100. The electronic device 100 may output stored sounds, and / or may receive sound signals from the external device 200 and output the obtained sounds. Figure 1 As shown, electronic device 100 and external device 200 can communicate wirelessly, but this disclosure is not limited thereto. For example, electronic device 100 and external device 200 can communicate with each other via wired, wireless, or a combination thereof.
[0053] like Figure 1 As shown, external device 200 in Figure 1 The device may be shown in the form of a smartphone. However, this disclosure is not limited thereto. For example, the external device 200 may include any device capable of communicating with the electronic device 100, such as, but not limited to, a desktop personal computer (PC), a television (TV), a compact disc (CD) player, a Moving Picture Experts Group Phase 1 (MPEG-1) audio player III (MP3) player, or a server.
[0054] Continue to refer to Figure 1 An earphone can be worn on one ear of user 10 as electronic device 100. However, this disclosure is not limited to this. For example, multiple electronic devices 100 can be worn on both ears of user 10 respectively.
[0055] Figure 2 An electronic device 100 according to an embodiment is shown. Figure 2 The electronic device 100 can be one of multiple headphones worn on the user's two ears.
[0056] According to an embodiment, the electronic device 100 may include a memory 110, a processor 120, a digital signal processor (DSP) 130, a driver 140, a speaker 150, and a microphone 160.
[0057] According to an embodiment, multiple protocols for hearing tests can be stored in memory 110. The protocols may include information about two different frequencies (e.g., f1 and f2) for the hearing test within a specific frequency range, and information about the inverted signal of the otoacoustic emission frequencies (OAEs) of the distortion products of multiple intermodulation distortion signals caused by the combination of the two different frequency signals. For example, the OAE frequencies of the distortion products may be 2f1–f2, which are frequencies of third-order low-frequency intermodulation distortion. According to an embodiment, the frequency ranges measured by the multiple protocols may be at least partially different.
[0058] According to an embodiment, processor 120 may run software (e.g., a program) to control at least one other component (e.g., a hardware or software component) of electronic device 100 connected to processor 120, and may process and / or compute various types of data. According to an embodiment, as at least part of data processing or computation, processor 120 may store commands and / or data received from another component (e.g., a sensor module or a communication module, not shown), and store the resulting data in memory 110.
[0059] According to an embodiment, processor 120 can obtain (①) at least one protocol from memory 110 and can control DSP 130 to generate (②) a first sound based on one of the obtained at least one protocol.
[0060] According to an embodiment, the DSP 130 can process digital signals under the control of the processor 120. For example, the DSP 130 can output a first sound signal through one channel of each speaker 150 corresponding to one of the user's ears. The first sound signal can be a sound signal used to detect distortion product otoacoustic emissions.
[0061] For example, the DSP 130 can combine two signals with different frequencies, along with a signal used to cancel intermodulation distortion, based on a protocol used for hearing tests, and output the combined signal to the driver 140. The intermodulation distortion signal has the same frequency as the otoacoustic emissions, the distortion product generated by the combination of these two signals. (See below for reference.) Figure 4A The operation of the combined signal is described. Therefore, hearing tests based on distortion product otoacoustic emissions can be performed using only one speaker 150 for each ear.
[0062] According to an embodiment, the driver 140 can convert digital signals received from the DSP 130 into analog signals and output the analog signals to the speaker 150.
[0063] According to an embodiment, the speaker 150 can output (③) a first sound signal to the outside of the electronic device 100. For example, the speaker 150 can be disposed on a portion of the ear probe of the electronic device 100 to output the first sound signal.
[0064] According to an embodiment, microphone 160 can receive external sound signals from electronic device 100. Microphone 160 can receive analog signals and convert them into digital signals, and transmit the converted digital signals to DSP 130.
[0065] For example, microphone 160 may be disposed on a portion of the ear probe of electronic device 100, and after the first sound signal is output through speaker 150, microphone 160 may receive (④) a second sound signal associated with the output first sound signal. For example, the otoacoustic emission signal, a distortion product generated in the user's cochlea due to the output first sound signal, may be included in the second sound signal associated with the output first sound signal.
[0066] According to an embodiment, the DSP 130 can extract (⑤) the distortion product otoacoustic emission signal from the second sound signal received through the microphone 160. For example, the frequency of the distortion product otoacoustic emission signal can be 2f1 – f2 based on the frequencies f1 and f2 of the two pure tone signals included in the first sound signal.
[0067] According to various embodiments, the second audio signal received by the microphone 160 can be transmitted to the processor 120. The operation of extracting the distortion product otoacoustic emission signal from the second audio signal can be performed by the processor 120.
[0068] According to various embodiments, the processor 120 can measure external noise via the microphone 160 and determine whether to perform a hearing test based on the external noise measurement results.
[0069] According to an embodiment, processor 120 can obtain (⑥) a user's hearing profile based on the extracted distortion product otoacoustic emission signal. For example, processor 120 can determine whether the user's hearing is normal within a specific frequency range based on the intensity of the extracted distortion product otoacoustic emission signal relative to the intensity of a first frequency signal and a second frequency signal included in the output first sound signal.
[0070] According to an embodiment, the processor 120 can modify the protocol and repeatedly output sound signals for hearing tests and extract distortion product otoacoustic emission signals. Therefore, the processor 120 can obtain a user's hearing profile across multiple frequency ranges based on multiple distortion product otoacoustic emission signals.
[0071] According to an embodiment, the processor 120 may perform (⑦) volume changes and / or equalization (EQ) changes based on the obtained user hearing profile. For example, when it is determined that the user's hearing has deteriorated based on the user hearing profile, the processor 120 may control the speaker 150 to reduce the volume of the output sound signal.
[0072] In optional or additional embodiments, processor 120 may adjust the equalization based on the user's hearing profile. Equalization may refer to adjusting the sound signal from low pitch to high pitch according to musical genre or user taste. For example, processor 120 may adjust the equalization based on the user's hearing profile such that the intensity differences (e.g., volume) between multiple frequencies included in the output sound signal fall within a set range.
[0073] For example, processor 120 can adjust the equalization based on the user's hearing profile to reduce the volume of specific frequency signals in the sound signal.
[0074] According to various embodiments, when a user's personal equalizer is pre-stored, the processor 120 can update the user's hearing profile using the pre-stored equalizer. According to optional or additional embodiments, when the user's personal equalizer is not available, the processor 120 can store an equalizer that has been modified based on the user's hearing profile.
[0075] Therefore, it is possible to obtain a customized equalizer for each user to suit their hearing condition.
[0076] According to various embodiments, when it is determined that a user's hearing is deteriorating based on their hearing profile, the processor 120 can provide feedback to notify the user of the hearing deterioration. For example, upon determining that a user's hearing is deteriorating, the processor 120 may display a message indicating hearing deterioration on the display of the electronic device 100, and / or may send another message to the external device 200 and cause the external device 200 to display that other message on its display. In one embodiment, upon determining that a user's hearing is deteriorating, the processor 120 may output a notification of hearing deterioration via the speaker 150.
[0077] According to various embodiments, although Figure 2 Although not shown, the electronic device 100 may also include at least one of a communication module, a sensor, or a power supply unit.
[0078] Figure 3 This is a flowchart illustrating a method for controlling an electronic device 100 using otoacoustic emissions (OAEs) with distortion products, according to an embodiment.
[0079] According to an embodiment, in operation 310, electronic device 100 (e.g., processor 120 and / or DSP 130) can output a first sound signal based on a first protocol. For example, electronic device 100 can output a first sound signal obtained by combining multiple signals using a first protocol among multiple protocols stored in memory 110 via speaker 150. According to an embodiment, electronic device 100 can output the first sound signal using one channel through speaker 150 corresponding to one ear.
[0080] For example, such as Figure 4A As shown, the electronic device 100 can output a first sound signal through the speaker 150. The first sound signal is a combination of a first signal 410 with a frequency of f1, a second signal 411 with a frequency of f2, and an inverted signal 420 with a frequency of 2f1-f2, where 2f1-f2 is the frequency associated with the otoacoustic emission, a distortion product of f1 and f2.
[0081] According to an embodiment, combining two signals to output two signals of different frequencies through a single channel may result in multiple intermodulation distortion signals. For example, if the first signal 410 and the second signal 411 are combined, multiple intermodulation distortion signals may be generated, such as, but not limited to, signals with frequencies of f2 – f1, 2f1 – f2, and 2f2 – f1.
[0082] According to the embodiments, such as Figure 4B As shown, the electronic device 100 can output a first sound signal via a speaker 150. In this first sound signal, an intermodulation distortion signal with a frequency of 2f1 – f2 has been canceled from among the multiple intermodulation distortion signals of f1 and f2. For example, the intermodulation distortion signal with a frequency of 2f1 – f2 has been canceled by further combining the first sound signal with an inverted signal 420 of the intermodulation distortion signal 412 with a frequency of 2f1 – f2, where the frequency 2f1 – f2 is the frequency among the multiple intermodulation distortion signals that is related to the otoacoustic emissions of the distortion products of f1 and f2.
[0083] Reference Figure 3 According to an embodiment, in operation 320, when a second sound signal associated with the first sound signal is received, the electronic device 100 can extract the first distortion product otoacoustic emission signal included in the second sound signal.
[0084] For example, refer to Figure 4A The electronic device 100 can output a first sound signal through the speaker 150 and then receive a second sound signal through the microphone 160. For example, as Figure 4C As shown, the second sound signal received by microphone 160 after the first sound signal is output may include a distortion product otoacoustic emission (DPOAE) signal 430 generated from the ear of user 10, and electronic device 100 may extract the DPOAE signal 430 from the second sound signal. For this reason, as... Figure 4B As shown, the first output sound signal is a signal in which the intermodulation distortion signal 412 with a frequency of 2f1–f2 has been canceled from multiple intermodulation distortion signals of f1 and f2. As a result, the distortion product otoacoustic emission signal 430 generated from the cochlea of user 10 stimulated by pure tone signals with frequencies of f1 and f2 can be accurately extracted.
[0085] According to an embodiment, in operation 330, the electronic device 100 can output a third audio signal based on a second protocol. For example, the electronic device 100 can output a third audio signal obtained by combining multiple signals using a second protocol among multiple protocols stored in the memory 110 via a speaker 150. According to an embodiment, the electronic device 100 can output a third audio signal using one channel through a speaker 150 corresponding to one ear.
[0086] According to an embodiment, the electronic device 100 can output a third sound signal through the speaker 150. The third sound signal can be a combination of a pure tone signal with a frequency of f3, a pure tone signal with a frequency of f4, and an inverted signal of 2f3-f4, where 2f3-f4 are frequencies related to the otoacoustic emissions of the distortion products of f3 and f4.
[0087] According to an embodiment, in operation 340, upon receiving a fourth sound signal associated with the third sound signal, the electronic device 100 can extract the second distortion product otoacoustic emission signal included in the fourth sound signal. For example, the electronic device 100 can output the third sound signal via a speaker 150 and then receive the fourth sound signal via a microphone 160. The fourth sound signal received via the microphone 160 after outputting the third sound signal may include the distortion product otoacoustic emission signal generated from the cochlea of the user 10, stimulated by a pure tone signal of frequency f3 and a pure tone signal of frequency f4. The electronic device 100 can extract the distortion product otoacoustic emission signal from the fourth sound signal.
[0088] According to an embodiment, the electronic device 100 can repeatedly output a sound signal with a changed frequency and extract the otoacoustic emission signal (OAE) of the output sound based on multiple protocols. That is, for each of the multiple protocols, the electronic device 100 can perform the operation of outputting a sound signal corresponding to that protocol and the operation of extracting the OAE of the output sound corresponding to that protocol.
[0089] According to an embodiment, in operation 350, the electronic device 100 can obtain a user's hearing profile based on a first distortion product otoacoustic emission signal and a second distortion product otoacoustic emission signal. For example, the electronic device 100 can obtain a user's hearing profile across multiple frequency ranges based on multiple distortion product otoacoustic emission signals.
[0090] According to an embodiment, in operation 360, the electronic device 100 may perform at least one of volume change or equalization change based on the user's hearing profile. For example, when it is determined that the user's hearing has deteriorated based on the user's hearing profile, the electronic device 100 may control the speaker 150 to reduce the volume of the output sound signal and / or change the equalization of the output sound signal to reduce the volume of a specific frequency signal.
[0091] According to various embodiments, when a user's personal equalizer is pre-stored, the electronic device 100 can use the pre-stored equalizer to update the user's hearing profile. For example, the user's personal equalizer can be stored in the memory 110 of the electronic device 100, or received from an external device 200 via a communication module.
[0092] According to optional or additional embodiments, when the user's personal equalization is not available, the electronic device 100 may store equalization that changes based on the user's hearing profile.
[0093] According to another optional or additional embodiment, when it is determined that a user's hearing is deteriorating based on the user's hearing profile, the electronic device 100 can provide a message to notify the user of her hearing deterioration.
[0094] Figure 5A and Figure 5B This is a view showing the sound signal output from the speaker 150 according to an embodiment of the present disclosure.
[0095] For example, electronic device 100 can output sound signals to two (2) cubic centimeter (e.g., 2cc) couplers 20. The 2cc couplers 20 can be components used for performance analysis of hearing aids. For example, the 2cc couplers 20 can have a two (2)cc shape similar to the volume of the user's ear canal. Although in Figure 5A A 2cc coupler 20 is shown, but a coupler 20 with a volume different from 2cc may be used depending on the volume of the user's ear canal. That is, this disclosure is not limited thereto. For example, other couplers with other volumes and / or shapes may be used without departing from the scope of this disclosure.
[0096] While the typical human ear may not possess linear characteristics, the 2cc coupler 20 can exhibit linear characteristics. The linearity of the 2cc coupler 20 can mean that when a sound signal with multiple frequencies is output to the 2cc coupler 20, the reflected signal of the output sound signal may not include intermodulation distortion sounds of multiple frequencies. In other words, for a sound signal with multiple frequencies passing through the 2cc coupler 20, intermodulation distortion sounds may not be generated.
[0097] Reference Figure 5AThe electronic device 100 can output each of sound signal 510 and sound signal 520 to the 2cc coupler 20 via the speaker 150. Sound signal 510 can be obtained by combining a first signal with frequency f1 and a second signal with frequency f2. Sound signal 520 can be obtained by combining a first signal with frequency f1, a second signal with frequency f2, and an inverted signal 521 with frequency 2f1-f2. Frequency 2f1-f2 is the frequency associated with otoacoustic emissions, the distortion products of f1 and f2.
[0098] In addition, such as Figure 5B As shown, the electronic device 100 can measure the intensity of a signal associated with a frequency (e.g., third-order low-frequency intermodulation distortion) of the distortion product otoacoustic emission included in the reflected signal obtained from the 2cc coupler 20.
[0099] Reference Figure 5B The intensity of signal 530 (e.g., signal-to-noise ratio, SNR) may be, for example, about 7 dBSPL, and signal 530 has frequencies associated with otoacoustic emissions, distortion products included in the reflected signal of sound signal 510 obtained by combining a first signal at frequency f1 and a second signal at frequency f2.
[0100] However, the strength of signal 540 may be approximately 1 dBSPL, and signal 540 has frequencies associated with the otoacoustic emissions of distortion products included in the reflected signal of sound signal 520 obtained by combining a first signal of frequency f1, a second signal of frequency f2, and an inverted signal 521 of frequency 2f1–f2, where 2f1–f2 are frequencies associated with the otoacoustic emissions of distortion products of f1 and f2.
[0101] Therefore, it can be identified that by using destructive interference by combining inverted signals with frequencies of 2f1 – f2, signals with frequencies associated with distortion product otoacoustic emissions can be canceled (or significantly reduced) in the sound signal output through loudspeaker 150, where frequencies 2f1 – f2 are the frequencies associated with distortion product otoacoustic emissions of f1 and f2.
[0102] Figure 6A and Figure 6B This is a view showing a sound signal input from a user's ear according to an embodiment of the present disclosure.
[0103] For example, the electronic device 100 of this disclosure can output a sound signal to the ear of user 10. In an embodiment, the ear of user 10 may have non-linear characteristics. That is, non-linear characteristics may mean that when a sound signal having multiple frequencies is output to the ear of user 10, the reflected signal of the output sound signal may include intermodulation distortion sound of multiple frequencies. For example, the intermodulation distortion sound included in the reflected signal may be third-order low-frequency intermodulation distortion sound.
[0104] Reference Figure 6A The electronic device 100 can output each of sound signal 610 and sound signal 620 to the ear of user 10 via speaker 150. Sound signal 610 is obtained by combining a first signal with frequency f1 and a second signal with frequency f2. Sound signal 620 is obtained by combining the first signal, the second signal and an inverted signal 621 with frequency 2f1-f2, where frequency 2f1-f2 is the frequency associated with otoacoustic emissions, the distortion products of f1 and f2.
[0105] like Figure 6B As shown, the electronic device 100 can measure the strength (e.g., signal-to-noise ratio (SNR)) of a signal associated with a frequency (e.g., third-order low-frequency intermodulation distortion) of a distortion product otoacoustic emission included in the reflected signal obtained from the ear of the user 10. A speaker 150 can be disposed on each of the user 10's two ears, and can output either a sound signal 610 or a sound signal 620 through each speaker 150.
[0106] In an embodiment, the intensity of signal 630 may be approximately 6 dB for the left ear and approximately 5.5 dB for the right ear. Signal 630 has a frequency associated with the otoacoustic emission distortion product included in the reflected signal of sound signal 610 obtained by combining a first signal at frequency f1 and a second signal at frequency f2.
[0107] However, for example, the intensity of signal 640 may be approximately 19 dB for the left ear and approximately 19 dB for the right ear, and the sound signal 640 has a frequency associated with the otoacoustic emission distortion product included in the reflected signal of sound signal 620.
[0108] Therefore, it can be identified that, without an inverted signal with combined frequencies of 2f1–f2, where frequencies 2f1–f2 are frequencies associated with the distortion product otoacoustic emissions of f1 and f2, the distortion product otoacoustic emission signal generated from the user's ear can be canceled out by the intermodulation distortion signal of frequencies f1 and f2 output through speaker 150. Consequently, the measured distortion product otoacoustic emission signal can be low, which may lead to incorrect diagnosis of hearing loss even if the user has normal hearing.
[0109] Figure 6B This demonstrates that, without an inverting signal, the distorted otoacoustic emission signal generated from the user's ear can be canceled out by the intermodulation distortion signals f1 and f2 output through speaker 150. Alternatively or additionally, the distorted otoacoustic emission signal generated from the user's ear can be amplified. As a result, it may be difficult to accurately measure the user's hearing.
[0110] However, if the inverted signal with frequencies of 2f1 – f2 is combined with the output sound signal, where 2f1 – f2 are frequencies associated with the otoacoustic emissions of the distortion products of f1 and f2, the intermodulation distortion signals of f1 and f2 output through the speaker 150 may have been canceled out, allowing the otoacoustic emission signals of the distortion products generated from the user's ear to be measured normally, thus allowing for accurate hearing tests.
[0111] Figure 7 This is a view illustrating the operation of an inverted signal for determining the otoacoustic emission frequency of a distortion product to be combined with an audio signal, according to an embodiment of the present disclosure.
[0112] Reference Figure 7 In operation 710, the electronic device 100 of this disclosure can measure the volume (e.g., sound pressure level (dB SPL)) at each frequency and calibrate the speaker 150 and the internal microphone 160. According to various embodiments, calibration can be performed before the electronic device 100 is shipped from the manufacturer. In other optional or additional embodiments, calibration can be performed by the user after the electronic device 100 has been shipped from the manufacturer.
[0113] According to various embodiments, the electronic device 100 can output a sound signal through the speaker 150 while changing the volume of each frequency of the sound signal. The electronic device 100 can compare the output sound signal with measurements using a sound level meter. (See also...) Figure 8A Describe the comparison results.
[0114] According to optional or additional embodiments, electronic device 100 can compare the measurement results using a sound level meter with the measurement results using a microphone 160 of electronic device 100 for the sound signal output through speaker 150. (See also...) Figure 8B Describe the comparison results.
[0115] Figure 8A It is a view showing the result of a comparison between the volume of an audio signal (e.g., a pure tone signal) output from the speaker 150 of the electronic device 100 and the volume measured by a sound level meter.
[0116] For example, electronic device 100 can sequentially change (e.g., from –30dBV to –120dBV) the volume of an audio signal (e.g., a pure tone signal) having a specific frequency (e.g., f1 or 2kHz) and a specific phase (e.g., 0°, 90°, 180°, 270°) while outputting through speaker 150, and use a sound level meter to measure the volume of the output audio signal.
[0117] For example, such as Figure 8A As shown, when the volume of the sound signal output from speaker 150 is proportional to the volume of the sound signal measured by the sound level meter, the output of speaker 150 can be identified as normal. If there is a specific range in which the volume is not proportional, the electronic device 100 can calibrate the characteristics of speaker 150 within that specific range.
[0118] Figure 8B This is a view showing the result of a comparison between the volume of the sound signal input through the microphone 160 of the electronic device 100 and the volume of the sound signal measured by the sound level meter. The sound signal input through the microphone 160 and the sound signal measured by the sound level meter can be signals output through the speaker 150 of the electronic device 100.
[0119] For example, electronic device 100 can sequentially change (e.g., from –30dBV to –120dBV) the volume of an audio signal (e.g., a pure tone signal) having a specific frequency (e.g., f1 or 2kHz) and a specific phase (e.g., 0°, 90°, 180°, 270°) while outputting through speaker 150, and use a sound level meter to measure the volume of the output audio signal.
[0120] For example, such as Figure 8B As shown, when the volume of the sound signal input to microphone 160 is proportional to the volume of the sound signal measured by the sound level meter, the input to microphone 160 can be identified as normal. If there is a specific range in which the volume is not proportional, the electronic device 100 can calibrate the characteristics of microphone 160 within that specific range.
[0121] Back Figure 7 According to various embodiments, in operation 720, the electronic device 100 can sub-optimize the sound source of the DPOAE. For example, the electronic device 100 can identify whether the volume of the input signal is a desired volume for achieving a desired output volume of a sound signal to be used in a hearing test using distortion product otoacoustic emissions. According to various embodiments, in operation 720, signals at frequencies associated with distortion product otoacoustic emissions (e.g., 2f1 – f2) may not be included in the output sound signal.
[0122] For example, electronic device 100 can output an audio signal, in which signals of multiple frequencies (e.g., f1 and f2) each having a specific volume, are combined through speaker 150 to 2cc coupler 20, receive signals reflected from 2cc coupler 20 through microphone 160, and identify the input volume relative to the output volume.
[0123] According to various embodiments, in operation 730, the electronic device 100 can optimize the strength of the intermodulation distortion inverted signal. For example, the frequency of the intermodulation distortion inverted signal can be a frequency (e.g., 2f1 – f2) associated with two frequencies (e.g., f1 and f2) of the distortion product otoacoustic emissions. In the following text, for ease of description, the frequency associated with the distortion product otoacoustic emissions can be represented as 2f1 – f2.
[0124] According to various embodiments, electronic device 100 can output a signal to 2cc coupler 20 via speaker 150, while simultaneously altering (e.g., from -30dBV to -120dBV) the intensity of the inverted signal with frequencies 2f1–f2 included in the audio signal, and measuring the intensity of the inverted signal with frequencies 2f1–f2 included in the audio signal input via microphone 160. (Refer to...) Figure 9 Describe the measurement results.
[0125] Figure 9 This is a view showing the intensity of the inverted 2f1-f2 signals included in the sound signal output through speaker 150 and the intensity of the inverted 2f1-f2 signals included in the sound signal input through microphone 160. According to various embodiments, for example, Figure 9 Measurement results of audio signals including f1 and f2 signals and audio signals including 2f1 – f2 signals, the audio signals including f1 and f2 signals having a phase of 0°, and the audio signals including 2f1 – f2 signals having different phases of 0°, 90°, 180° and 270°.
[0126] Reference Figure 9 For example, when a sound signal containing only two frequencies is output through speaker 150, the amplitude of the intermodulation distortion sound 910 of 2f1 – f2 included in the sound signal input through microphone 160 can be identified as approximately –70 dBV.
[0127] According to various embodiments, when a sound signal is output through speaker 150 in which an inverted signal with frequencies of 2f1-f2 is combined with signals of two frequencies (e.g., f1 and f2) each having a specific volume, it can be identified that the intensity of the signal with frequencies of 2f1-f2 in the sound signal input through microphone 160 is reduced to the specific intensity of the inverted signal with frequencies of 2f1-f2 included in the sound signal output through speaker 150.
[0128] For example, refer to Figure 9 When the phase of the inverted signal with frequencies 2f1–f2 included in the sound signal output through speaker 150 is 0° and the intensity is approximately –70 dBV, the intensity of the signal with frequencies 2f1–f2 in the sound signal input through microphone 160 can be minimized. For this reason, the intermodulation distortion sound with frequencies 2f1–f2 generated when f1 and f2 are combined in the filter of speaker 150 is canceled out by the inverted signal with frequencies 2f1–f2, which has a phase of 0° and an intensity of approximately –70 dBV, combined with f1 and f2.
[0129] According to various embodiments, refer to Figure 9 For example, the optimal strength 930 of the inverted signal with a frequency of 2f1 – f2 in the electronic device 100 can be identified as approximately –70 dBV.
[0130] In operation 730 described above, the strength of the signal with frequencies 2f1–f2 input through microphone 160 is measured when there is no inverted signal with frequencies 2f1–f2 combined. Simultaneously, while changing the strength of the inverted signal with frequencies 2f1–f2, the strength of the inverted signal with frequencies 2f1–f2 input through microphone 160 is measured, where the strength of the signal with frequencies 2f1–f2 input through microphone 160 is reduced. However, according to various embodiments, when f1 and f2 are combined and output, electronic device 100 can estimate the strength of the signal with frequencies 2f1–f2 to be input through microphone 160. Electronic device 100 can calculate the strength of the inverted signal with frequencies 2f1–f2 to be combined with the sound signal to be output through speaker 150 based on the estimated strength of the signal with frequencies 2f1–f2.
[0131] Reference Figure 7 According to various embodiments, in operation 740, electronic device 100 can optimize the angle (e.g., phase) of intermodulation distortion inverted signals.
[0132] For example, electronic device 100 can output a sound signal obtained by combining a first signal f1 and a second signal f2 with a specific volume and an inverted signal with a frequency of 2f1–f2 with a defined intensity to 2cc coupler 20 via speaker 150, and measure the intensity of the signal with a frequency of 2f1–f2 included in the sound signal input via microphone 160. According to various embodiments, for example, electronic device 100 can fix the phase of the f1 and f2 signals included in the sound signal output via speaker 150 to 0°, while changing the phase of the inverted signal with a frequency of 2f1–f2 (e.g., from 0° to 360°). For example, electronic device 100 can change the phase of the inverted signal with a frequency of 2f1–f2 in 1° increments. (Refer to...) Figure 10 The description describes the results of measuring the intensity of the signal with frequencies 2f1 – f2 included in the sound signal output through the microphone 160 while changing the phase of the inverted signal with frequencies 2f1 – f2 included in the sound signal output through the speaker 150.
[0133] Reference Figure 10 For example, when the speaker 150 outputs an audio signal that does not include the inverted signals 2f1-f2, the intensity of the 2f1-f2 signal 1010 included in the audio signal input through the microphone 160 can be approximately -70dBV.
[0134] According to various embodiments, refer to Figure 10 For example, when the phase of the inverted signal with frequencies 2f1–f2 included in the sound signal to be output through speaker 150 is 25°, the intensity of the signal 1020 with frequencies 2f1–f2 input through microphone 160 can be as low as approximately –81 dBV. For this reason, the intermodulation distortion sound with frequencies 2f1–f2 generated when f1 and f2 are combined in the filter of speaker 150 is canceled (or significantly reduced) by the inverted signal with a phase of 25° of 2f1–f2 combined with f1 and f2.
[0135] According to various embodiments, refer to Figure 10 For example, the optimal angle 1030 for the inverted signal with frequency 2f1 – f2 in the electronic device 100 can be identified as approximately 25°.
[0136] return Figure 7 According to various embodiments, in operation 750, the electronic device 100 can record the measured values.
[0137] For example, electronic device 100 may store calibration values for loudspeaker 150 for each frequency (e.g., f1 and f2), calibration values for microphone 160 for each frequency, amplitude of signals associated with frequencies of distortion product otoacoustic emissions generated due to frequency combinations in the filter, intensity of signals for each frequency, intensity of the inverse signal of the signals associated with frequencies of distortion product otoacoustic emissions, and angle values.
[0138] According to various embodiments, for example, when the strength of the signal associated with the frequency of distortion product otoacoustic emissions generated due to the combination in the filter is less than a set value, the strength of the inverted signal of the signal associated with the frequency of distortion product otoacoustic emissions can be zero (0). Accordingly, for example, the strength of the inverted signal of the signal associated with the frequency of distortion product otoacoustic emissions included in the protocol can be zero (0).
[0139] According to various embodiments, the measured values may be stored in the electronic device 100, or transmitted to the external device 200 via the communication module of the electronic device 100 and stored in the external device 200.
[0140] In some embodiments, when the support device corresponding to the electronic device 100 is manufactured in the form of a space with a volume (e.g., 2cc) similar to that of a user's outer ear, the electronic device 100 can use the space of the support device to perform calibration on the speaker 150 and microphone 160 if contact between the support device and the electronic device 100 is detected. For example, the support device may be a means for charging and / or storing the electronic device 100.
[0141] According to various embodiments, the electronic device 100 can obtain the characteristic value in the 2cc coupler 20 by adding a calibration value to the characteristic value in the bracket device using a conversion function between the characteristics of the audio signal per frequency in the bracket device and the characteristics of the audio signal per frequency in the 2cc coupler 20. Therefore, the bracket device can replace the 2cc coupler 20.
[0142] Figure 11 This is a view illustrating the hearing test operation of an electronic device 100 according to an embodiment of the present disclosure.
[0143] According to various embodiments, in operation 1101, the electronic device 100 can detect that it is being worn on a user's ear. For example, the electronic device 100 can use included sensors (e.g., proximity sensors, contact sensors, or illuminance sensors) to determine whether it is being worn on a user's ear.
[0144] According to various embodiments, in operation 1102, electronic device 100 may obtain protocols. For example, electronic device 100 may obtain multiple protocols stored in memory 110 and / or multiple protocols received from external device 200. According to various embodiments, each of the multiple protocols may include information about the frequencies of two pure tone signals, information about the frequencies associated with the distortion product otoacoustic emissions (OAEs) of the two pure tone signals, information about the intensities of the two pure tone signals, information about the intensity of the inverted signal of the frequency associated with the OAEs, and information about the angle of the inverted signal of the frequency associated with the OAEs.
[0145] According to various embodiments, in operation 1103, electronic device 100 can determine whether the environment is suitable for a hearing test. For example, if a set period of time (e.g., one month or one week) has elapsed since a previous hearing test was performed, electronic device 100 can determine that the environment is suitable for a hearing test. Alternatively or additionally, if no set period of time has elapsed since the last hearing test, electronic device 100 can determine that the environment is not suitable for a hearing test.
[0146] In optional or additional embodiments, the electronic device 100 can identify whether the noise in the surrounding environment is less than a set value. For example, if the intensity of the sound signal (e.g., noise) received by the microphone 160 before the sound signal for hearing testing is output is less than a set value, the electronic device 100 can determine that the environment is suitable for hearing testing. Alternatively or additionally, if the intensity of the sound signal (e.g., noise) received by the microphone 160 before the sound signal for hearing testing is output exceeds a set value, the electronic device 100 can determine that the environment is unsuitable for hearing testing.
[0147] In another alternative or additional embodiment, if an audio signal is being output through speaker 150, the electronic device 100 can determine that the environment is unsuitable for a hearing test. For example, if music is playing, an audio signal of video content is being output, or a voice and / or video call is being output through speaker 150, the electronic device 100 can determine that the environment is unsuitable for a hearing test. Alternatively or additionally, if no audio signal is being output through a speaker, the electronic device 100 can determine that the environment is suitable for a hearing test. That is, if no music is playing, no audio signal of video content is being output, and no voice call is being output through speaker 150, the electronic device 100 can determine that the environment is suitable for a hearing test.
[0148] In some embodiments, during operation 1103, the electronic device 100 may combine one or more of the aforementioned conditions to determine whether the environment is suitable for a hearing test. For example, the electronic device 100 may determine that the environment is suitable for a hearing test when the intensity of the sound signal (e.g., noise) received by the microphone 160 before the sound signal for the hearing test is output is less than a set value, and a set period of time has elapsed since the last hearing test was performed. However, this disclosure is not limited thereto. For example, without departing from the scope of this disclosure, the electronic device 100 may determine whether the environment is suitable for a hearing test based on other combinations of conditions.
[0149] According to various embodiments, when it is determined that the environment is suitable for hearing testing (yes in operation 1103), electronic device 100 may execute one of a plurality of protocols, including a target test protocol, in operation 1104.
[0150] For example, electronic device 100 can output a sound signal obtained by a speaker 150 by combining two frequency signals related to the hearing frequency range to be tested and a signal of a frequency related to the distortion product otoacoustic emission of the two frequencies based on a protocol, and measure the intensity of the signal of the frequency related to the distortion product otoacoustic emission included in the sound signal input through microphone 160, thereby testing the user's hearing.
[0151] According to various embodiments, in operation 1105, electronic device 100 can determine whether the hearing level is lower than existing records. For example, when storing a user's previous hearing test results, electronic device 100 can compare the previous hearing test results with the current hearing test results to determine whether the user's hearing level has decreased. In optional or additional embodiments, electronic device 100 can compare a set normal value with the current hearing test results to determine whether the user's hearing level is within the normal range.
[0152] According to various embodiments, when it is determined that a user's hearing level is lower than existing records (Yes in operation 1105), electronic device 100 can activate a hearing protection service in operation 1106. For example, electronic device 100 can provide feedback for hearing protection. In embodiments, when electronic device 100 includes a display, electronic device 100 can display messages on the display and / or send messages to external device 200 to display messages on the display of external device 200. Alternatively or additionally, electronic device 100 can output audible notifications via speaker 150.
[0153] According to various embodiments, the electronic device 100 can provide feedback suggesting ear rest, depth testing, volume reduction, feedback indicating ear fatigue, and / or can automatically reduce the volume of the tested frequency range and output it.
[0154] According to various embodiments, when it is determined that the user's hearing level remains at or better than the existing record (No in operation 1105), the electronic device 100 can record the test results for the tested frequency range and determine the next protocol to perform the test in operation 1107. For example, the order of execution of protocols can be set, and the electronic device 100 can determine the next protocol to be executed based on the set order. Alternatively or additionally, protocols related to the frequency ranges of the louder parts of the multiple frequency ranges of the sound signals that the user frequently listens to can be used, and the electronic device 100 can determine the next protocol to be executed based on the frequency of use of the protocol. However, this disclosure is not limited thereto. That is, without departing from the scope of this disclosure, the electronic device 100 may use other criteria, conditions, or techniques to select the next protocol to be executed.
[0155] According to various embodiments, before executing the next protocol, electronic device 100 can return to operation 1103 to determine whether the environment is suitable for hearing testing.
[0156] According to various embodiments, when it is determined that the environment is unsuitable for hearing testing (No in operation 1103), electronic device 100 may determine in operation 1108 whether music is being played. According to various embodiments, if no music is being played (No in operation 1108), electronic device 100 may return to operation 1103 to determine whether the environment is suitable for hearing testing. According to various embodiments, electronic device 100 may provide feedback to the user requesting to move to a quiet environment and / or a request for re-wearing (e.g., repositioning) electronic device 100.
[0157] In optional or additional embodiments, if music is playing (Yes in operation 1108), the electronic device 100 may determine in operation 1109 whether the playback of a song has ended. If the playback of a song has not ended (No in operation 1109), the electronic device 100 may again determine whether the playback of a song has ended. When the playback of a song ends (Yes in operation 1109), the electronic device 100 may execute a target test protocol in operation 1110. For example, the electronic device 100 may execute a test protocol after the playback of one song ends and before playing the next song.
[0158] For example, electronic device 100 can output a sound signal obtained by a speaker 150 by combining two frequency signals related to the hearing frequency range to be tested and a signal of a frequency related to the distortion product otoacoustic emission of the two frequencies based on a protocol, and measure the intensity of the signal of the frequency related to the distortion product otoacoustic emission included in the sound signal input through microphone 160, thereby testing the user's hearing.
[0159] Figure 11 The illustration shows a hearing test performed between song playbacks; however, according to various embodiments, electronic device 100 may play music for a hearing test that reflects a hearing test protocol, or play audio signals (e.g., music) of content with inserted audio signals based on a hearing test protocol. For example, electronic device 100 may analyze the audio signals of the content and insert audio signals based on a hearing test protocol into portions of the audio signal of the content in which such insertion does not interfere with listening.
[0160] According to various embodiments, as described above, electronic device 100 may perform at least one of operations 1105, 1106, or 1107 based on the result of executing the protocol in operation 1110.
[0161] Figure 12 This is a view illustrating operation for outputting a sound signal based on an obtained hearing profile of a user, according to an embodiment of this disclosure. The following description assumes that the electronic device 100 is detected to be worn on the user's ear. Whenever the electronic device 100 is worn on the user's ear, or when the user inputs a manipulation command for a hearing test, a hearing test can be performed based on a set time period (e.g., one month or one week).
[0162] According to various embodiments, refer to Figure 12 In operation 1201, electronic device 100 may output a first sound signal based on a protocol. For example, electronic device 100 may output a first sound signal obtained by combining two frequency signals related to the hearing frequency range to be tested based on the protocol and a frequency signal related to the distortion product otoacoustic emissions of the two frequencies via speaker 150.
[0163] According to various embodiments, the protocol may be stored in electronic device 100 and / or may be received from external device 200. For example, external device 200 is a device configured to communicate with electronic device 100. In embodiments, external device 200 may include a terminal device connected to electronic device 100, and electronic device 100 may include, for example, headphones.
[0164] According to various embodiments, in operation 1202, electronic device 100 can receive a second sound signal associated with the first sound signal via microphone 160.
[0165] According to various embodiments, in operation 1203, electronic device 100 can transmit the received second sound signal to external device 200.
[0166] According to various embodiments, in operation 1204, the external device 200 can extract the first distortion product otoacoustic emission signal included in the second sound signal received from the electronic device 100.
[0167] Figure 12 An external device 200 is shown extracting a first distortion product otoacoustic emission signal included in a second sound signal received from an electronic device 100. However, according to various embodiments, the electronic device 100 may extract the first distortion product otoacoustic emission signal included in the second sound signal and send the extracted first distortion product otoacoustic emission signal to the external device 200.
[0168] According to various embodiments, in operation 1205, the external device 200 can obtain a user's hearing profile based on the first distortion product otoacoustic emission signal. Figure 12 The illustration shows obtaining a user's hearing profile based on a first distortion product otoacoustic emission signal obtained according to a protocol. However, according to various embodiments, the external device 200 can obtain a user's hearing profile across multiple frequency ranges based on multiple distortion product otoacoustic emission signals obtained according to multiple protocols. According to various embodiments, the external device 200 can store the obtained user hearing profile.
[0169] According to various embodiments, in operation 1206, external device 200 can send a user's hearing profile to electronic device 100.
[0170] According to various embodiments, in operation 1207, electronic device 100 may perform at least one of volume change or equalization change based on user hearing profile received from external device 200.
[0171] For example, when the user's hearing is determined to be deteriorating based on their hearing profile, the electronic device 100 can reduce the volume. In optional or additional embodiments, the electronic device 100 can change the equalization based on the user's hearing profile to reduce the volume of specific frequency signals in the sound signal, or change the equalization so that the differences between the intensities (e.g., volume) of multiple frequencies included in the output sound signal fall within a set range. Thus, an equalization customized for each user can be obtained to suit the user's hearing condition.
[0172] According to various embodiments, electronic device 100 may provide visual feedback (e.g., display of a message) and / or audible feedback (e.g., output of a notification) indicating hearing deterioration in a user. According to various embodiments, external device 200 may also provide visual and / or audible feedback to indicate hearing deterioration in a user based on an obtained user hearing profile. Alternatively or additionally, electronic device 100 may provide visual and / or audible feedback based on a comparison between a set of normal value ranges and hearing test results to indicate that the user's hearing is outside and / or within the normal value range.
[0173] According to various embodiments, in operation 1208, external device 200 can send content audio signals to electronic device 100, and in operation 1209, electronic device 100 can output content audio signals based on at least one of a changed volume or a changed equalizer.
[0174] Figure 13 This is a view illustrating operation for outputting a sound signal based on an obtained hearing profile of a user, according to an embodiment of this disclosure. The following description assumes that the electronic device 100 is detected to be worn on the user's ear. Whenever the electronic device 100 is worn on the user's ear, or when the user inputs a manipulation command for a hearing test, a hearing test can be performed based on a set time period (e.g., one month or one week).
[0175] According to various embodiments, refer to Figure 13 In operation 1301, electronic device 100 may output a first audio signal based on a protocol. According to various embodiments, in operation 1302, electronic device 100 may receive a second audio signal associated with the first audio signal via microphone 160.
[0176] According to various embodiments, in operation 1303, electronic device 100 can transmit the received second audio signal to external device 200. According to various embodiments, in operation 1304, external device 200 can extract a first distortion product otoacoustic emission signal included in the second audio signal received from electronic device 100.
[0177] Figure 13 The illustration shows an external device 200 extracting a first distortion product otoacoustic emission signal from a second sound signal received from an electronic device 100. However, according to various embodiments, the electronic device 100 may extract the first distortion product otoacoustic emission signal from the second sound signal and transmit the extracted first distortion product otoacoustic emission signal to the external device 200.
[0178] According to various embodiments, in operation 1305, the external device 200 can obtain the user's hearing profile based on the first distortion product otoacoustic emission signal. Figure 13The illustration shows obtaining a user's hearing profile based on a first distortion product otoacoustic emission signal obtained according to a protocol. However, according to various embodiments, the external device 200 can obtain a user's hearing profile across multiple frequency ranges based on multiple distortion product otoacoustic emission signals obtained according to multiple protocols. According to various embodiments, the external device 200 can store the obtained user hearing profile.
[0179] Figure 13 Operations 1301 to 1305 in the middle Figure 12 Operations 1201 to 1205 are similar, therefore, for the sake of simplicity and brevity, their descriptions will not be repeated.
[0180] According to various embodiments, in operation 1306, the external device 200 may perform at least one of volume change or equalization change of the content audio signal based on the user's hearing profile.
[0181] For example, when it is determined that a user's hearing has deteriorated based on their hearing profile, the external device 200 can reduce the volume. In an embodiment, the external device 200 can change the equalization based on the user's hearing profile to reduce the volume of specific frequency signals in the sound signal, or change the equalization so that the differences between the intensities (e.g., volume) of multiple frequencies included in the output sound signal fall within a set range. Therefore, an equalization customized for each user can be obtained to suit the user's hearing condition.
[0182] According to various embodiments, in operation 1307, external device 200 can send a content audio signal with at least one of altered volume or altered equalization applied to electronic device 100.
[0183] According to various embodiments, in operation 1308, electronic device 100 can output audio signals received from external device 200 via speaker 150.
[0184] According to various embodiments, electronic device 100 may provide visual feedback (e.g., display of a message) and / or audible feedback (e.g., output of a notification) indicating hearing deterioration in a user. According to various embodiments, external device 200 may also provide visual and / or audible feedback to indicate hearing deterioration in a user based on an obtained user hearing profile. Alternatively or additionally, electronic device 100 may provide visual and / or audible feedback based on a comparison between a set of normal value ranges and hearing test results to indicate that the user's hearing is outside and / or within the normal value range.
[0185] Figure 14 This is a view illustrating operation for outputting a sound signal based on an obtained user hearing profile, according to an embodiment of this disclosure. For example, Figure 14The external device 200 can generate and analyze sound signals for the hearing test of this disclosure, and the electronic device 100 can simply output the sound signals received from the external device 200 and send the sound signals input through the microphone 160 to the external device 200. The following description assumes that the electronic device 100 is detected to be worn on the user's ear. Whenever the electronic device 100 is worn on the user's ear, or when the user inputs a manipulation command for the hearing test, the hearing test can be performed based on a set time period (e.g., one month or one week).
[0186] According to various embodiments, refer to Figure 14 In operation 1401, external device 200 may obtain a first sound signal based on a protocol. For example, external device 200 may generate a first sound signal by combining two frequency signals related to the hearing frequency range to be tested based on the protocol and a signal of a frequency related to the distortion product otoacoustic emissions of the two frequencies.
[0187] According to various embodiments, in operation 1402, the external device 200 can send a first sound signal to the electronic device 100, and in operation 1403, the electronic device 100 can output the received first sound signal through the speaker 150.
[0188] According to various embodiments, in operation 1404, electronic device 100 can receive a second sound signal associated with the first sound signal via microphone 160.
[0189] According to various embodiments, in operation 1405, electronic device 100 can transmit the received second sound signal to external device 200.
[0190] According to various embodiments, in operation 1406, the external device 200 can extract the first distortion product otoacoustic emission signal included in the second sound signal received from the electronic device 100.
[0191] According to various embodiments, in operation 1407, the external device 200 can obtain the user's hearing profile based on the first distortion product otoacoustic emission signal. Figure 14 The illustration shows obtaining a user's hearing profile based on a first distortion product otoacoustic emission signal obtained according to a protocol. However, according to various embodiments, the external device 200 can obtain a user's hearing profile across multiple frequency ranges based on multiple distortion product otoacoustic emission signals obtained according to multiple protocols. According to various embodiments, the external device 200 can store the obtained user hearing profile.
[0192] According to various embodiments, in operation 1408, the external device 200 may perform at least one of volume change or equalization change of the content audio signal based on the user's hearing profile.
[0193] According to various embodiments, in operation 1409, external device 200 can send a content audio signal with at least one of altered volume or altered equalization applied to electronic device 100.
[0194] According to various embodiments, in operation 1410, electronic device 100 can output audio signals received from external device 200 via speaker 150.
[0195] Figure 14 Operations 1404 to 1410 in the middle Figure 13 Operations 1302 to 1308 are similar, therefore, for the sake of simplicity and brevity, their descriptions will not be repeated.
[0196] Figure 15 This is a view illustrating the operation of outputting a sound signal based on an obtained hearing profile of a user, according to an embodiment of this disclosure.
[0197] According to various embodiments, refer to Figure 15 In operation 1501, electronic device 100 may store at least one of altered volume or altered equalization based on a user's hearing profile. According to various embodiments, the user's hearing profile may be obtained by electronic device 100, or by a terminal device (e.g., external device 200) connected to electronic device 100, and received by electronic device 100. According to various embodiments, altered volume and / or altered equalization may be altered by electronic device 100, or by a terminal device connected to electronic device 100, and received by electronic device 100.
[0198] According to various embodiments, in operation 1502, electronic device 100 may be connected to external audio device 300. According to various embodiments, external audio device 300 may be a terminal device previously connected to electronic device 100 (e.g., external device 200) or another external device 200 that may not be used when obtaining a user's hearing profile. For example, electronic device 100, which may include headphones (or headsets), may be connected to a different smartphone (e.g., external device 200) and / or audio device than a previously connected smartphone (e.g., external audio device 300).
[0199] According to various embodiments, in operation 1503, the external sound device 300 can send the content sound signal to the electronic device 100.
[0200] According to various embodiments, in operation 1504, electronic device 100 may output a content audio signal based on at least one of a changed volume or a changed equalizer. For example, electronic device 100 may change at least one of the volume or equalizer of a content audio signal received from external sound device 300 based on a value stored in operation 1501, and output the changed content audio signal.
[0201] Figure 16 This is a view illustrating the operation of outputting a sound signal based on an obtained hearing profile of a user, according to an embodiment of this disclosure.
[0202] According to various embodiments, refer to Figure 16 In operation 1601, electronic device 100 may store at least one of altered volume or altered equalization based on a user's hearing profile. According to various embodiments, the user's hearing profile may be obtained by electronic device 100, or by a terminal device (e.g., external device 200) connected to electronic device 100, and received by electronic device 100. According to various embodiments, altered volume and / or altered equalization may be altered by electronic device 100, or by a terminal device connected to electronic device 100, and received by electronic device 100.
[0203] According to various embodiments, in operation 1602, electronic device 100 may be connected to external audio device 300. According to various embodiments, external audio device 300 may be a terminal device previously connected to electronic device 100 (e.g., external device 200) or another external device 200 that may not be used when obtaining a user's hearing profile. For example, electronic device 100, which may include headphones (or headsets), may be connected to a different smartphone (e.g., external device 200) and / or audio device than a previously connected smartphone (e.g., external audio device 300).
[0204] According to various embodiments, in operation 1603, electronic device 100 can send the stored equalization to external sound device 300.
[0205] According to various embodiments, in operation 1604, the external sound device 300 can generate content sound signals based on the received equalization.
[0206] Figure 16 The diagram shows that electronic device 100 sends equalization data to external sound device 300. However, according to various embodiments, electronic device 100 may send user hearing profile data to external sound device 300, and external sound device 300 may generate equalization-modified content sound signals based on the received user hearing profile data.
[0207] According to various embodiments, in operation 1605, the external sound device 300 can send the content sound signal to the electronic device 100. According to various embodiments, in operation 1606, the electronic device 100 can output the content sound signal based on the stored volume.
[0208] According to various embodiments of this disclosure, hearing tests based on distortion product otoacoustic emissions can be performed using only one speaker 150 per ear. Furthermore, according to various embodiments of this disclosure, hearing loss in users can be reduced by obtaining an equalization tailored to the user's hearing condition based on the user's hearing profile.
[0209] According to various embodiments of the present disclosure, an electronic device 100 may include a speaker 150, a microphone 160, a memory 110, a DSP 130, a driver 140 configured to convert digital signals output from the DSP 130 into analog signals and output analog signals to the speaker 150, and a processor operatively connected to the speaker 150, the microphone 160, the memory 110, the DSP 130 and the driver 140. The processor can be configured to: control DSP 130 and driver 140 to output a first sound signal obtained by combining a signal of a first frequency, a signal of a second frequency, and an inverted signal of a third frequency related to the DPOAE of the first and second frequencies, through speaker 150 based on a first protocol among a plurality of protocols stored in memory 110; extract a first distortion product otoacoustic emission signal of the third frequency included in the second sound signal when a second sound signal related to the first sound signal is received through microphone 160; control DSP 130 and driver 140 to output a third sound signal obtained by combining a signal of a fourth frequency, a signal of a fifth frequency, and an inverted signal of a sixth frequency related to the DPOAE of the fourth and fifth frequencies, through speaker 150 based on the second protocol among a plurality of protocols; extract a second distortion product otoacoustic emission signal of the sixth frequency included in the fourth sound signal when a fourth sound signal related to the third sound signal is received through microphone 160; obtain a user hearing profile based on the first distortion product otoacoustic emission signal and the second distortion product otoacoustic emission signal; and perform at least one of volume adjustment or equalization (EQ) adjustment of the sound based on the user hearing profile.
[0210] According to various embodiments, the processor can be configured to change the equalization based on the user's hearing profile, such that the intensity difference between multiple frequencies included in the output sound falls within a set range.
[0211] According to various embodiments, the processor can be configured to provide feedback based on the user's hearing profile to indicate hearing deterioration in the user.
[0212] According to various embodiments, the processor can be configured to output the first sound signal if the intensity of the sound signal received by the microphone 160 before outputting the first sound signal is less than a set value.
[0213] According to various embodiments, the processor can be configured to output the first audio signal after the output of the content audio signal is completed, if a content audio signal is being output through the speaker 150 before the first audio signal is output.
[0214] According to various embodiments, the processor can be configured to output a first sound signal based on a set time period.
[0215] According to various embodiments, each of the multiple protocols may include information about the frequencies of the two pure tone signals, information about the frequencies associated with the distortion product otoacoustic emissions (OAEs) of the two pure tone signals, information about the strengths of the two pure tone signals, information about the strength of the inverted signal at the frequency associated with the OAEs, and information about the angle of the inverted signal at the frequency associated with the OAEs.
[0216] According to various embodiments, in at least some of the multiple protocols, the strength of the inverted signal of the frequency associated with the distortion product otoacoustic emission can be zero (0).
[0217] According to various embodiments, the electronic device 100 may also include an ear probe to be inserted into a user's outer ear. A speaker 150 and a microphone 160 may be disposed on a portion of the ear probe.
[0218] According to various embodiments, the processor can be configured to perform calibration on the speaker 150 and the microphone 160 when contact between the electronic device 100 and the support device corresponding to the electronic device 100 is detected.
[0219] According to various embodiments, the electronic device 100 may also include a communication module. The processor may be configured to: store at least one of a changed volume or a changed equalizer, send the stored equalizer to an external device 200 via the communication module, receive a content audio signal from the external device 200 with the stored equalizer applied, and output the received content audio signal through a speaker based on the stored volume.
[0220] According to various embodiments, a method for controlling an electronic device 100 may include: based on a first protocol among a plurality of protocols stored in a memory 110 of the electronic device 100, outputting a first sound signal obtained by combining a signal of a first frequency, a signal of a second frequency, and an inverted signal of a third frequency related to the DPOAE of the first and second frequencies via a speaker 150 of the electronic device 100; upon receiving a second sound signal related to the first sound signal via a microphone 160 of the electronic device 100, extracting a first distortion product otoacoustic emission signal of the third frequency included in the second sound signal; based on a plurality of protocols... The second protocol in the protocol outputs a third sound signal obtained by combining a signal of a fourth frequency, a signal of a fifth frequency, and an inverted signal of a sixth frequency (related to the fourth and fifth frequencies, DPOAE) through a speaker 150; when a fourth sound signal related to the third sound signal is received through a microphone 160, the second distortion product otoacoustic emission signal of the sixth frequency included in the fourth sound signal is extracted; a user hearing profile is obtained based on the first distortion product otoacoustic emission signal and the second distortion product otoacoustic emission signal; and at least one of the following is performed based on the user hearing profile: volume change or equalization (EQ) change of the sound.
[0221] According to various embodiments, performing at least one of volume change or equalization (EQ) change can change the equalization based on the user's hearing profile, such that the intensity difference between multiple frequencies included in the sound to be output falls within a set range.
[0222] According to various embodiments, the method may also include providing feedback based on the user's hearing profile to indicate hearing deterioration in the user.
[0223] According to various embodiments, the first sound signal can be output if the intensity of the sound signal received by the microphone 160 before the first sound signal is output is less than a set value.
[0224] According to various embodiments, the first audio signal can be output as follows: if a content audio signal is being output through the speaker 150 before the first audio signal is output, the first audio signal is output after the content audio signal output is completed.
[0225] According to various embodiments, each of the multiple protocols may include: information about the frequencies of two pure tone signals, information about the frequencies associated with the distortion product otoacoustic emissions (OAEs) of the two pure tone signals, information about the strengths of the two pure tone signals, information about the strength of the inverted signal at the frequency associated with the OAEs, and information about the angle of the inverted signal at the frequency associated with the OAEs.
[0226] According to various embodiments, in at least some of the multiple protocols, the strength of the inverted signal of the frequency associated with the distortion product otoacoustic emission can be zero (0).
[0227] According to various embodiments, the method may further include: performing calibration on the speaker 150 and the microphone 160 when contact between the electronic device 100 and the support device corresponding to the electronic device 100 is detected.
[0228] According to various embodiments, the method may further include: storing at least one of a changed volume or a changed equalizer, sending the stored equalizer to an external device 200 via a communication module of the electronic device 100, receiving a content audio signal with the stored equalizer applied from the external device 200, and outputting the received content audio signal through a speaker based on the stored volume.
[0229] The electronic device 100 according to various embodiments of this disclosure may be and / or includes one of various types of electronic devices 100. The electronic device 100 may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. According to embodiments of this disclosure, the electronic device 100 is not limited to those described above.
[0230] It should be understood that the various embodiments of this disclosure and the terminology used therein are not intended to limit the technical features set forth herein to the particular embodiments, but rather to include various changes, equivalents, or substitutions to the corresponding embodiments. Regarding the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It should be understood that the singular form of a noun corresponding to an item may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C” may include all possible combinations of the items listed together in the corresponding one of the phrases. As used herein, terms such as “first” and “second” or “first” and “second” may be used simply to distinguish one component from another without otherwise limiting the components (e.g., importance or order). It should be understood that if an element (e.g., a first element) is referred to as "coupled to another element (e.g., a second element)," "coupled to another element (e.g., a second element)," "connected to another element (e.g., a second element)," or "connected to another element (e.g., a second element)" with or without the use of the terms "operably" or "communically," it means that the element can be coupled to the other element directly (e.g., wired), wirelessly, or via a third element.
[0231] As used herein, the term "module" can include a unit implemented in hardware, software, or firmware, and is used interchangeably with other terms such as "logic," "logic block," "part," or "circuit." A module can be a single integrated component adapted to perform one or more functions, or its smallest unit or part. For example, according to an embodiment, the module can be implemented as an application-specific integrated circuit (ASIC).
[0232] The various embodiments described herein can be implemented as software (e.g., a program) comprising one or more instructions stored in a machine-readable storage medium (e.g., internal or external memory). For example, a processor (e.g., processor 120) of the machine (e.g., electronic device 100) can invoke at least one of the one or more instructions stored in the storage medium and, under the control of the processor, execute it with or without the use of one or more other components. This allows the machine to be operated to perform at least one function according to the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. The term "non-transitory" simply means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but this term does not distinguish between semi-permanently stored data and temporarily stored data in the storage medium.
[0233] According to embodiments, methods according to various embodiments of this disclosure can be included in and provided therein in a computer program product. The computer program product can be traded as a commodity between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)) or via an app store (e.g., the Play Store). TM The computer program product may be distributed online (e.g., downloaded or uploaded) or directly between two user devices (e.g., smartphones). If distributed online, at least a portion of the computer program product may be temporarily generated or at least temporarily stored in a machine-readable storage medium (such as the memory of a manufacturer's server, an app store's server, or a relay server).
[0234] According to various embodiments, each of the above-described components (e.g., a module or program) may include a single entity or multiple entities. Some of the multiple entities may be separately located in different components. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform one or more functions of each of the multiple components in the same or similar manner as performed by a corresponding component of the multiple components prior to integration. According to various embodiments, operations performed by a module, program, or other component may be performed sequentially, in parallel, repeatedly, or heuristically, or one or more of these operations may be performed in a different order or omitted, or one or more other operations may be added.
Claims
1. An electronic device comprising: speaker; microphone; Memory, storing instructions and multiple protocols; Digital signal processor (DSP); The driver is configured to convert a digital signal output from the DSP into an analog signal and output the analog signal to the speaker; as well as A processor, operatively coupled to the speaker, the microphone, the memory, the DSP, and the driver, wherein the processor is configured to execute the instructions to: The DSP is controlled to obtain a first sound signal by combining a first signal, a second signal, and a first inverted signal based on a first protocol among the plurality of protocols. The first inverted signal has a third frequency related to the distortion product otoacoustic emission (DPOAE) of the first frequency of the first signal and the second frequency of the second signal. Control the driver to output the first sound signal through the speaker; In response to the output of the first sound signal, a second sound signal related to the first sound signal is received through the microphone; Extract the first DPOAE signal of the third frequency from the second sound signal; The DSP is controlled to obtain a third audio signal by combining a fourth signal, a fifth signal, and a second inverted signal based on a second protocol among the plurality of protocols. The second inverted signal has a sixth frequency related to the DPOAE of the fourth frequency of the fourth signal and the fifth frequency of the fifth signal. Control the driver to output the third sound signal through the speaker; In response to the output of the third sound signal, a fourth sound signal related to the third sound signal is received through the microphone; Extract the second DPOAE signal of the sixth frequency from the fourth audio signal; A user's hearing profile is obtained based on the first DPOAE signal and the second DPOAE signal; and Based on the user's hearing profile, at least one of the following is performed: volume adjustment and equalization (EQ) adjustment of the sound to be output.
2. The electronic device according to claim 1, wherein, The processor is also configured to execute further instructions to: The intensity differences between multiple frequencies included in the sound to be output are calculated based on the user's hearing profile. Determine whether the strength difference is within the set range; Based on the determination that the intensity difference is outside the set range, the EQ of the sound to be output is changed based on the user's hearing profile, so that another intensity difference of the sound to be output is within the set range.
3. The electronic device according to claim 1, wherein, The processor is also configured to execute further instructions to: Based on the user's hearing profile, feedback is provided indicating that the user's hearing is deteriorating.
4. The electronic device according to claim 1, wherein, The processor is also configured to execute further instructions to: The first sound signal is output based on the fact that the intensity of the sound signal received through the microphone before the first sound signal is output is less than a set value.
5. The electronic device according to claim 1, wherein, The processor is also configured to execute further instructions to: The first sound signal is output after the content sound signal is completed, based on the fact that a content sound signal is being output through the speaker before the first sound signal is output.
6. The electronic device according to claim 1, wherein, The processor is also configured to execute further instructions to: The first sound signal is output based on a set time period.
7. The electronic device according to claim 1, wherein, Each of the plurality of protocols includes: Information about the frequencies of the two pure tone signals Information regarding the frequencies associated with the DPOAE of the two pure tone signals. Information regarding the intensity of the two pure tone signals, Information regarding the strength of the inverted signal at the frequency associated with the DPOAE, and Information regarding the phase of the inverted signal at the frequency associated with the DPOAE.
8. The electronic device according to claim 7, wherein, At least one of the multiple protocols sets the strength of the inverted signal at the frequency associated with the DPOAE to zero (0).
9. The electronic device according to claim 1, further comprising: An ear probe is inserted into the user's outer ear. The speaker and the microphone are mounted on a portion of the ear probe.
10. The electronic device according to claim 1, wherein, The processor is also configured to execute further instructions to: In response to the detection of contact between the electronic device and the support device corresponding to the electronic device, calibration is performed on the speaker and the microphone.
11. The electronic device according to claim 1, further comprising: Communication module, The processor is further configured to execute further instructions to: Store at least one of the changed volume and the changed EQ in the memory; The stored EQ is sent to an external device via the communication module; Receives audio signals containing the stored EQ applied from the external device; and The driver is controlled to output the received audio signal through the speaker at a volume based on the stored volume.
12. A method for controlling an electronic device, comprising: Based on a first protocol among multiple protocols stored in the memory of the electronic device, a first sound signal is output through the speaker of the electronic device by combining a first signal having a first frequency, a second signal having a second frequency, and a first inverted signal having a third frequency related to distortion product otoacoustic emissions (DPOAE) of the first and second frequencies. In response to receiving a second sound signal associated with the first sound signal via the microphone of the electronic device, the first DPOAE signal of the third frequency is extracted from the second sound signal; Based on the second protocol among the plurality of protocols, a third sound signal is obtained by the speaker outputting a combination of a fourth signal having a fourth frequency, a fifth signal having a fifth frequency, and a second inverted signal having a sixth frequency related to the DPOAE of the fourth and fifth frequencies; In response to receiving a fourth sound signal associated with the third sound signal via the microphone, the second DPOAE signal of the sixth frequency is extracted from the fourth sound signal; A user's hearing profile is obtained based on the first DPOAE signal and the second DPOAE signal; and Based on the user's hearing profile, at least one of the following is performed: volume adjustment and equalization (EQ) adjustment of the sound to be output.
13. The method according to claim 12, wherein, Performing at least one of the volume change and the equalization (EQ) change includes: Based on the determination that the intensity difference between multiple frequencies included in the sound to be output is outside a set range, the EQ of the sound to be output is changed based on the user's hearing profile so that another intensity difference of the sound to be output is within the set range.
14. The method of claim 12, further comprising: Based on the user's hearing profile, feedback is provided indicating that the user's hearing is deteriorating.
15. The method according to claim 12, wherein, The output of the first sound signal includes: The first sound signal is output based on the fact that the intensity of the sound signal received through the microphone before the first sound signal is output is less than a set value.
Citation Information
Patent Citations
Apparatus for determining cochlear dead region
CN104822119A
Distortion product otoacoustic emission probing scheme based on cycle self-correlation principle
CN107582068A