Hearing sense compensation method and device for earphone and earphone
By detecting and adjusting the hearing difference of the earphones, the problem of inconsistent hearing between the half-in-ear and ear clip earphones is solved, and a better user experience is achieved.
Patent Information
- Application Number
- CN202311637355.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-30
- Publication Date
- 2025-05-30
AI Technical Summary
In new forms of earphones such as semi-in-ear and ear clips, due to poor sealing and changing wearing positions, the hearing feeling of the left and right ears is inconsistent, which affects the user experience.
By detecting that when the user turns on the headphone service, the hearing feeling of the headphones on the left and right ears is obtained, and the earphones to be compensated and the corresponding compensation amount, including the amplitude and phase of the sound signal, are determined according to the difference between the two, so as to adjust the sound signal to be played by the headphones to be compensated to achieve consistency of the hearing feeling.
It effectively solves the problem of inconsistent listening experience for headphones on the left and right ears, improves the user's listening experience, and allows headphones to provide a more consistent and stable listening experience when reducing noise, listening to music or talking on calls.
Smart Images
Figure CN120075676A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the technical field of intelligent terminals, and particularly to a method and device for compensating headphone listening experience and a headphone. Background Art
[0002] In headphone products, especially new form headphones such as semi-in-ear and ear clip headphones, the wearing tightness is poor, the wearing positions are variable, and the leakage fluctuation space is large. Therefore, when performing operations such as noise reduction, listening to music or making a call, the listening experiences of the left and right ears of the headphones are inconsistent, affecting the user experience. For example, the noise reduction effects of the left and right ears are inconsistent, the ear pressures of the left and right ears are different, and / or the volumes of the left and right ears are inconsistent, etc. Summary of the Invention
[0003] The embodiments of the present application provide a method and device for compensating headphone listening experience and a headphone. The embodiments of the present application also provide a computer-readable storage medium to realize targeted compensation for the sound effects of the left or right ear headphone according to the listening experiences of the left and right ear headphones, so that the listening experiences of the left and right ear headphones are consistent and the user's auditory experience is improved.
[0004] In a first aspect, the embodiments of the present application provide a method for compensating headphone listening experience, including: in response to detecting that the user activates a headphone service, obtaining the listening experience of a first headphone and the listening experience of a second headphone connected to the first headphone; where the first headphone is the headphone worn on the left ear of the user, and the second headphone is the headphone worn on the right ear of the user; then, determining a headphone to be compensated and the compensation amount corresponding to the headphone to be compensated according to the listening experience of the first headphone and the listening experience of the second headphone; where the headphone to be compensated includes at least one of the first headphone and the second headphone, and the compensation amount includes the amplitude and phase to be compensated for the sound signal to be played; finally, adjusting the amplitude and phase of the sound signal to be played by the headphone to be compensated according to the compensation amount.
[0005] In the above method for compensating headphone listening experience, in response to detecting that the user activates a headphone service, the first headphone obtains the listening experience of the first headphone and the listening experience of the second headphone connected to the first headphone. The first headphone determines the headphone to be compensated and the compensation amount corresponding to the headphone to be compensated according to the listening experience of the first headphone and the listening experience of the second headphone. The compensation amount includes the amplitude and phase to be compensated for the sound signal to be played. Then, the first headphone can adjust the amplitude and phase of the sound signal to be played by the headphone to be compensated according to the above compensation amount, so that the amplitude and phase of the sound signal to be played by the first headphone or the second headphone can be targeted compensated according to the listening experiences of the first headphone and the second headphone, making the listening experiences of the first headphone and the second headphone consistent and improving the user's auditory experience.
[0006] In one possible implementation, determining the headphone to be compensated and the compensation amount corresponding to the headphone to be compensated according to the listening experience of the first headphone and the listening experience of the second headphone includes: determining whether the listening experience of the first headphone is the same as that of the second headphone; if they are not the same, comparing the magnitudes of the listening experience of the first headphone and the listening experience of the second headphone; determining the headphone with the smaller listening experience among the first headphone and the second headphone as the headphone to be compensated, and determining the difference between the listening experience of the first headphone and the listening experience of the second headphone as the compensation amount corresponding to the headphone to be compensated.
[0007] In one possible implementation, adjusting the amplitude and phase of the sound signal to be played by the headphone to be compensated according to the compensation amount includes: determining the amplitude and phase of the equalizer of the headphone to be compensated according to the compensation amount, so that the headphone to be compensated adjusts the amplitude and phase of the sound signal to be played according to the amplitude and phase of the equalizer itself.
[0008] In one possible implementation, obtaining the listening experience of the first headphone includes: obtaining the sound signal picked up by the error microphone in the first headphone; determining the sound signal received by the eardrum point of the user's left ear according to the sound signal picked up by the error microphone in the first headphone and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the eardrum point of the human ear; the sound signal received by the eardrum point of the user's left ear is the listening experience of the first headphone.
[0009] Before obtaining the sound signal picked up by the error microphone in the first headphone, it further includes: obtaining the sound signal picked up by the error microphone in the first headphone and the sound signal picked up by the reference microphone in the first headphone; using the sound signal picked up by the reference microphone to eliminate the environmental interference noise signal in the sound signal picked up by the error microphone; the sound signal picked up by the error microphone in the first headphone includes: the sound signal after eliminating the environmental interference noise signal.
[0010] In one possible implementation, obtaining the sound signal picked up by the error microphone in the first headphone includes: obtaining the sound signal picked up by at least one error microphone in the first headphone.
[0011] In the above-mentioned headphone listening experience compensation method, in response to detecting that the user activates the headphone service, the first headphone obtains the listening experience of the first headphone and the listening experience of the second headphone connected to the first headphone. According to the listening experience of the first headphone and the listening experience of the second headphone, the headphone to be compensated and the compensation amount corresponding to the headphone to be compensated are determined. The compensation amount includes the amplitude and phase to be compensated for the sound signal to be played. Then, the first headphone can adjust the amplitude and phase of the sound signal to be played by the headphone to be compensated according to the above compensation amount, so that the amplitude and phase of the sound signal to be played by the first headphone or the second headphone can be compensated specifically according to the listening experience of the first headphone and the second headphone, making the listening experiences of the first headphone and the second headphone consistent and improving the user's auditory experience.
[0012] In a second aspect, an embodiment of the present application provides a headphone listening experience compensation device, which is included in the headphone and has the function of implementing the behavior of the headphone in the first aspect and possible implementation manners of the first aspect. The function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above functions. For example, an acquisition module, a determination module, an adjustment module, etc.
[0013] In a third aspect, an embodiment of the present application provides a headphone, including: one or more processors; a memory; a plurality of application programs; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions that, when executed by the headphone, cause the headphone to execute the method provided in the first aspect.
[0014] It should be understood that the technical solutions of the second aspect and the third aspect of the embodiments of the present application are consistent with those of the first aspect of the embodiments of the present application, and the beneficial effects obtained by each aspect and corresponding feasible implementation manners are similar, and will not be elaborated herein.
[0015] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored, and when it runs on a computer, it causes the computer to execute the method provided in the first aspect.
[0016] In a fifth aspect, an embodiment of the present application provides a computer program that, when executed by a computer, is used to execute the method provided in the first aspect.
[0017] In a possible design, the program in the fifth aspect can be stored in whole or in part on a storage medium packaged together with the processor, or can be stored in whole or in part on a memory not packaged together with the processor. Description of the Drawings
[0018] Figure 1Schematic diagram of the structure of the earphone provided by an embodiment of the present application;
[0019] Figure 2 Flowchart of the earphone listening experience compensation method provided by an embodiment of the present application;
[0020] Figure 3 Flowchart of the earphone listening experience compensation method provided by another embodiment of the present application;
[0021] Figure 4 System architecture diagram of the earphone listening experience compensation method provided by an embodiment of the present application;
[0022] Figure 5 System architecture diagram of the earphone listening experience compensation method provided by another embodiment of the present application;
[0023] Figure 6 Schematic diagram of the structure of the earphone provided by another embodiment of the present application;
[0024] Figure 7 Schematic diagram of the structure of the earphone provided by still another embodiment of the present application. Detailed implementation manners
[0025] The terms used in the implementation manners part of the present application are only for explaining the specific embodiments of the present application, rather than aiming to limit the present application.
[0026] Regarding the problem of inconsistent listening experiences between the left and right ears of the earphone,
[0027] Based on the above problems, the embodiments of the present application provide an earphone listening experience compensation method, which can solve the problem of inconsistent listening experiences between the left and right ears of the earphone when the user uses true wireless stereo (TWS) earphones for services such as noise reduction, music listening, or calls.
[0028] The earphone listening experience compensation method provided by the embodiments of the present application can be applied to earphones. The above earphones can be TWS earphones; in terms of the in-ear form, the in-ear form of the above earphones can be semi-in-ear or ear-clip, and of course, it can also be fully in-ear; the embodiments of the present application do not impose any restrictions on the types of the above earphones.
[0029] Exemplarily, Figure 1 Schematic diagram of the structure of the earphone provided by an embodiment of the present application, as Figure 1As shown, the headset 100 may include a processor 110 and a communication interface 120. Optionally, the headset 100 may further include a memory 130. Among them, the processor 110, the communication interface 120, and the memory 130 may communicate with each other through an internal connection path to transmit control and / or data signals. The memory 130 is used to store computer programs, and the processor 110 is used to call and run the computer programs from the memory 130.
[0030] The above-mentioned processor 110 and the memory 130 may be integrated into a processing device. More commonly, they are independent components. The processor 110 is used to execute the program code stored in the memory 130. Specifically, the memory 130 may also be integrated in the processor 110, or be independent of the processor 110.
[0031] In addition, the headset 100 may further include a microphone 140 and a speaker 150. Among them, the microphone 140, also known as a "microphone" or "transmitter", is used to convert sound signals into electrical signals. In this embodiment, the headset 100 may be provided with at least two microphones 140. For example, the headset 100 may be provided with an error microphone and a reference microphone, or the headset may be provided with two error microphones and a reference microphone.
[0032] The speaker 150, also known as a "loudspeaker", is used to convert audio electrical signals into sound signals. The headset 100 may listen to music or hands-free calls through the speaker 150.
[0033] In addition, in order to make the functions of the headset 100 more complete, the headset 100 may further include a power supply 160, which is used to supply power to various devices or circuits in the headset 100.
[0034] It should be noted that Figure 1 the structure of the shown headset 100 is only the structure of one headset. Generally speaking, headsets are used in pairs. The structures of the left ear headset and the right ear headset are the same, and both the left headset and the right headset may adopt Figure 1 the structure shown.
[0035] It should be understood that Figure 1 the processor 110 in the shown headset 100 may be a system-on-chip (SOC), and the processor 110 may include a central processing unit (CPU).
[0036] For the convenience of understanding, the following embodiments of the present application will take the headset with the Figure 1 structure shown as an example, and in combination with the accompanying drawings and application scenarios, specifically elaborate on the headset sound perception compensation method provided by the embodiments of the present application.
[0037] Figure 2 The flowchart of the headphone listening experience compensation method provided by an embodiment of the present application is as follows. As Figure 2 shown, the above headphone listening experience compensation method may include:
[0038] Step 201, in response to detecting that the user activates the headphone service, the first headphone 100 obtains the listening experience of the first headphone 100 and the listening experience of the second headphone connected to the first headphone 100.
[0039] In this embodiment, the user activating the headphone service may include: the user uses the headphones for services such as noise reduction, listening to music, or making a call. The type of the above headphone service is not limited in this embodiment.
[0040] Among them, the first headphone 100 is the headphone worn on the user's left ear, and the second headphone is the headphone worn on the user's right ear. Of course, this is only for convenience of description and does not constitute a limitation on the embodiments of the present application. The first headphone 100 may also be the headphone worn on the user's right ear, and the second headphone is the headphone worn on the user's left ear. In some embodiments, the first headphone 100 may be the headphone that the user wears first. In some embodiments, the first headphone 100 may be the main headphone.
[0041] In some examples, the first headphone 100 obtaining the listening experience of the second headphone connected to the first headphone 100 may be: the first headphone 100 obtains the listening experience of the second headphone transmitted by the second headphone. That is to say, after the listening experience of the second headphone is obtained by the second headphone, it is then transmitted to the first headphone 100. Of course, the first headphone 100 may also directly obtain the listening experience of the second headphone. The manner in which the first headphone 100 obtains the listening experience of the second headphone is not limited in this embodiment.
[0042] In some embodiments, the listening experience of the headphone may be represented by the amplitude and / or phase characteristics of the sound signal received at the user's eardrum point. For example, the amplitude of the sound signal received at the eardrum point of the user's left ear obtained by the headphone worn on the user's left ear is the first amplitude, and the amplitude of the sound signal received at the eardrum point of the user's right ear obtained by the headphone worn on the user's right ear is the second amplitude. If the first headphone 100 determines that the first amplitude and the second amplitude are equal or the difference is within a preset range, it is determined that the listening experiences of the headphone worn on the left ear and the headphone worn on the right ear are consistent.
[0043] Step 202, the first headphone 100 determines the headphone to be compensated and the compensation amount corresponding to the headphone to be compensated according to the listening experience of the first headphone 100 and the listening experience of the second headphone.
[0044] Among them, the headphone to be compensated may be at least one of the first headphone and the second headphone, and the above compensation amount includes the amplitude and / or phase to be compensated for the sound signal to be played.
[0045] In some examples, the first earphone 100 determines the earphone to be compensated and the compensation amount corresponding to the earphone to be compensated according to the listening experience of the first earphone 100 and the listening experience of the second earphone, which may be: the first earphone 100 determines whether the listening experience of the first earphone 100 is consistent with the listening experience of the second earphone; if not, the first earphone 100 compares the magnitudes of the listening experience of the first earphone 100 and the listening experience of the second earphone, determines the earphone with the smaller listening experience among the first earphone 100 and the second earphone as the earphone to be compensated, and determines the difference between the listening experience of the first earphone and the listening experience of the second earphone as the compensation amount corresponding to the earphone to be compensated.
[0046] Step 203, the first earphone 100 adjusts the amplitude and / or phase of the sound signal to be played by the earphone to be compensated according to the above compensation amount.
[0047] In some examples, the first earphone 100 adjusts the amplitude and / or phase of the sound signal to be played according to the above compensation amount, which may be: the first earphone 100 determines the amplitude and / or phase of the equalizer (EQ) of the earphone to be compensated according to the above compensation amount, so that the earphone to be compensated can adjust the amplitude and / or phase of the sound signal to be played by the earphone to be compensated according to the amplitude and / or phase of the equalizer itself.
[0048] In the above earphone listening experience compensation method, in response to detecting that the user activates the earphone service, the first earphone 100 obtains the listening experience of the first earphone 100 and the listening experience of the second earphone connected to the first earphone 100. The first earphone 100 determines the earphone to be compensated and the compensation amount corresponding to the earphone to be compensated according to the listening experience of the first earphone 100 and the listening experience of the second earphone. The compensation amount includes the amplitude and / or phase to be compensated for the sound signal to be played. Then, the first earphone can adjust the amplitude and / or phase of the sound signal to be played by the earphone to be compensated according to the above compensation amount, so as to perform targeted compensation on the amplitude and / or phase of the sound signal to be played by the first earphone or the second earphone according to the listening experience of the first earphone and the second earphone, make the listening experiences of the first earphone and the second earphone consistent, and improve the user's auditory experience.
[0049] Figure 3 The flowchart of the earphone listening experience compensation method provided by another embodiment of the present application is as Figure 3 shown. In the embodiment shown in the present application Figure 2 shown, step 201 may include:
[0050] Step 301, in response to detecting that the user activates the earphone service, the first earphone 100 obtains the sound signal picked up by the error microphone in the first earphone 100.
[0051] In some examples, the sound signal picked up by the error microphone in the first earphone 100 can be the sound signal after eliminating the environmental interference noise signal. That is to say, the first earphone 100 can obtain the sound signal picked up by the error microphone in the first earphone 100 and the sound signal picked up by the reference microphone in the first earphone 100, and then use the sound signal picked up by the reference microphone above to eliminate the environmental interference noise signal in the sound signal picked up by the error microphone above, and use the sound signal after eliminating the environmental interference noise signal above as the sound signal picked up by the error microphone in the first earphone 100.
[0052] In addition, in some examples, the first earphone 100 obtaining the sound signal picked up by the error microphone in the first earphone 100 can be: the first earphone 100 obtains the sound signal picked up by at least one error microphone in the first earphone 100. That is to say, the number of error microphones in the first earphone 100 can be one or more. In this way, the sound signal picked up by the error microphone in the first earphone 100 can be the sound signal picked up by one or more (for example: two) error microphones in the first earphone 100.
[0053] Step 302, the first earphone 100 determines the sound signal received by the user's left eardrum point according to the sound signal picked up by the error microphone in the first earphone 100 and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the user's eardrum point. Among them, the sound signal received by the user's left eardrum point is the listening feeling of the first earphone 100.
[0054] Step 303, the first earphone 100 obtains the listening feeling of the second earphone connected to the first earphone 100.
[0055] In some examples, the listening feeling of the second earphone can be obtained by the second earphone, and then the second earphone transmits the obtained listening feeling of the second earphone to the first earphone 100. When specifically implemented, the way for the second earphone to obtain the listening feeling of the second earphone can be: the second earphone obtains the sound signal picked up by the error microphone in the second earphone, and the second earphone determines the sound signal received by the user's right eardrum point according to the sound signal picked up by the error microphone in the second earphone and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the user's eardrum point. Among them, the sound signal received by the user's right eardrum point is the listening feeling of the second earphone. As described above, the number of error microphones in the first earphone 100 can be one or more. Similarly, the number of error microphones in the second earphone can also be one or more, and the number of error microphones in the first earphone 100 and the second earphone is the same.
[0056] Of course, the first earphone 100 can also directly obtain the listening experience of the second earphone in the above manner, and this embodiment does not limit the manner in which the first earphone 100 obtains the listening experience of the second earphone.
[0057] In the above earphone listening experience compensation method, the first earphone 100 can obtain the listening experience of the first earphone 100 and the listening experience of the second earphone, so that the amplitude and / or phase of the sound signal to be played by the first earphone or the second earphone can be compensated specifically according to the listening experiences of the first earphone and the second earphone, making the listening experiences of the first earphone and the second earphone consistent and improving the user's auditory experience.
[0058] Figure 4 It is a system architecture diagram of the earphone listening experience compensation method provided by an embodiment of the present application. As Figure 4 shown, there is only one error microphone in both the first earphone 100 and the second earphone. The earphone listening experience compensation method provided by the embodiment of the present application will be introduced below with reference to Figure 4 the architecture shown.
[0059] See Figure 4 , in response to detecting that the user enables the earphone service, the first earphone 100 can obtain the sound signal picked up by the error microphone 44 in the first earphone 100 and the sound signal picked up by the reference microphone 45 in the first earphone 100. Then, the external environment interference elimination module in the first earphone 100 uses the sound signal picked up by the reference microphone 45 to eliminate the environmental interference noise signal in the sound signal picked up by the error microphone 44, and obtains SP ERP_L , where ERP is the abbreviation of error point, that is, the sound signal after eliminating the environmental interference noise signal is used as the sound signal SP picked up by the error microphone 44 in the first earphone 100 ERP_L .
[0060] Similarly, in response to detecting that the user enables the earphone service, the second earphone can obtain the sound signal picked up by the error microphone 49 in the second earphone and the sound signal picked up by the reference microphone 410 in the second earphone. Then, the external environment interference elimination module in the second earphone uses the sound signal picked up by the reference microphone 410 to eliminate the environmental interference noise signal in the sound signal picked up by the error microphone 49, and obtains SP ERP_R , that is, the sound signal after eliminating the environmental interference noise signal is used as the sound signal SP picked up by the error microphone 49 in the second earphone ERP_R .
[0061] In this embodiment, a mapping relationship model between the sound signal picked up by the error microphone and the sound signal received by the eardrum point of the human ear is established in advance. In this way, the first earphone 100 obtains SP ERP_LAfter that, the first earphone 100 can determine the sound signal SP received by the user's left eardrum point 41 according to the sound signal picked up by the above error microphone and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the human eardrum point. DRP_L . Wherein, DRP is the abbreviation of drump point, and SP DRP_L is the sound signal received by the user's left eardrum point 41, that is, the listening sensation of the first earphone 100.
[0062] Similarly, after the second earphone obtains SP ERP_R , the second earphone can determine the sound signal SP received by the user's right eardrum point 46 according to the sound signal picked up by the above error microphone and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the human eardrum point. DRP_R . Wherein, SP DRP_R is the sound signal received by the user's right eardrum point 46, that is, the listening sensation of the second earphone.
[0063] Next, the second earphone can transmit SP DRP_R to the first earphone 100, and the first earphone 100 can compare SP DRP_L with SP DRP_R to check if they are consistent. If not, the first earphone 100 compares the magnitudes of SP DRP_L and SP DRP_R to determine that the earphone corresponding to the smaller value of SP DRP_L and SP DRP_R is the earphone to be compensated, and to determine the difference between SP DRP_L and SP DRP_R as the compensation amount corresponding to the earphone to be compensated. This compensation amount includes the amplitude and / or phase to be compensated for the sound signal to be played.
[0064] Finally, the first earphone 100 can determine the amplitude and phase of the EQ of the earphone to be compensated according to the above compensation amount. In this way, the earphone to be compensated can adjust the amplitude and / or phase of the sound signal to be played by the earphone to be compensated according to the amplitude and / or phase of the above EQ itself, so that the listening sensations of the first earphone 100 and the second earphone are consistent, improving the user's auditory experience.
[0065] In the description of the above embodiments, it is illustrated by taking the second earphone obtaining SP DRP_R , and then transmitting SP DRP_R to the first earphone 100 as an example. In specific implementation, it can also be that after the second earphone obtains SP ERP_R , it transmits SP ERP_R to the first earphone 100, and the first earphone 100 determines SP DRP_R . This embodiment does not make any limitations in this regard.
[0066] Figure 5 The system architecture diagram of the headphone listening compensation method provided for another embodiment of the present application is as follows: Figure 5 As shown, there are two error microphones in both the first headphone 100 and the second headphone. Hereinafter, with reference to the architecture shown in Figure 5 the headphone listening compensation method provided for the embodiments of the present application will be introduced.
[0067] See Figure 5 , in response to detecting that the user activates the headphone service, the first headphone 100 can obtain the sound signals picked up by the first error microphone 54 and the second error microphone 55 in the first headphone 100, as well as the sound signal picked up by the reference microphone 56 in the first headphone 100. Then, the external environment interference elimination module in the first headphone 100 uses the sound signal picked up by the reference microphone 56 to respectively eliminate the environmental interference noise signals in the sound signals picked up by the first error microphone 54 and the second error microphone 55, and obtains SP ERP_L1 and SP ERP_L2 , SP ERP_L1 can be the sound signal picked up by the first error microphone 54, and SP ERP_L2 can be the sound signal picked up by the second error microphone 55.
[0068] Similarly, in response to detecting that the user activates the headphone service, the second headphone can obtain the sound signals picked up by the third error microphone 510 and the fourth error microphone 511 in the second headphone, as well as the sound signal picked up by the reference microphone 512. Then, the external environment interference elimination module in the second headphone uses the sound signal picked up by the reference microphone 512 to respectively eliminate the environmental interference noise signals in the sound signals picked up by the third error microphone 510 and the fourth error microphone 511, and obtains SP ERP_R1 and SP ERP_R2 , SP ERP_R1 can be the sound signal picked up by the third error microphone 510, and SP ERP_R2 can be the sound signal picked up by the fourth error microphone 511.
[0069] In this embodiment, a mapping relationship model between the sound signals picked up by the error microphones and the sound signals received by the human eardrum points is established in advance. In this way, after the first headphone 100 obtains SP ERP_L1 and SP ERP_L2 , the first headphone 100 can determine the sound signal SP ERP_L1 and SP ERP_L2 received by the left eardrum point 51 of the above user according to SP DRP_L and the mapping relationship between the sound signals picked up by the error microphones and the sound signals received by the human eardrum points. Among them, SPDRP_L is the sound signal received at the tympanic membrane point 51 of the user's left ear, that is, the listening sensation of the first earphone 100. In this embodiment, the first earphone 100 uses the sound signals picked up by two error microphones to map and obtain the sound signal received at the tympanic membrane point of the human ear, which can improve the accuracy of the mapped sound signal.
[0070] Similarly, the second earphone obtains SP ERP_R1 and SP ERP_R2 After that, the second earphone can, according to SP ERP_R1 and SP ERP_R2 , as well as the mapping relationship between the sound signal picked up by the error microphone and the sound signal received at the tympanic membrane point of the human ear, determine the sound signal SP DRP_R received at the tympanic membrane point 57 of the user's right ear. Among them, SP DRP_R is the sound signal received at the tympanic membrane point 57 of the user's right ear, that is, the listening sensation of the second earphone.
[0071] Next, the second earphone can transmit SP DRP_R to the first earphone 100. The first earphone 100 can compare whether SP DRP_L is consistent with SP DRP_R . If not, the first earphone 100 compares the magnitudes of SP DRP_L and SP DRP_R to determine that the earphone corresponding to the smaller value of SP DRP_L and SP DRP_R is the earphone to be compensated, and determine the difference between SP DRP_L and SP DRP_R as the compensation amount corresponding to the earphone to be compensated. This compensation amount includes the amplitude and / or phase to be compensated for the sound signal to be played.
[0072] Finally, the first earphone 100 can, according to the above compensation amount, determine the amplitude and / or phase of the EQ of the earphone to be compensated itself. In this way, the earphone to be compensated can adjust the amplitude and / or phase of the sound signal to be played by the earphone to be compensated according to the amplitude and / or phase of the above EQ itself, so that the listening sensations of the first earphone 100 and the second earphone are consistent, improving the user's auditory experience.
[0073] It can be understood that some or all of the steps or operations in the above embodiments are only examples. The embodiments of the present application can also perform other operations or various deformations of the operations. In addition, the various steps can be executed in different orders presented in the above embodiments, and it is possible not to execute all the operations in the above embodiments.
[0074] It can be understood that, in order to implement the above functions, the earphone includes the corresponding hardware and / or software modules for executing each function. Combining the algorithm steps of each example described in the embodiments disclosed in the present application, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to exceed the scope of the present application.
[0075] In this embodiment, the earphone can be divided into functional modules according to the above method embodiment. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is illustrative, only a logical function division, and there can be other division methods in actual implementation.
[0076] Figure 6 For the structural schematic diagram of the earphone provided in another embodiment of the present application, in the case of dividing each functional module corresponding to each function, Figure 6 it shows a possible composition schematic diagram of the earphone 600 involved in the above embodiment, as Figure 6 shown, the earphone 600 may include: an acquisition module 601, a determination module 602, and an adjustment module 603;
[0077] Among them, the acquisition module 601 is configured to obtain the listening feeling of the first earphone and the listening feeling of the second earphone connected to the first earphone in response to detecting that the user activates the earphone service; wherein, the first earphone is the earphone worn on the user's left ear, and the second earphone is the earphone worn on the user's right ear;
[0078] The determination module 602 is configured to determine the earphone to be compensated and the compensation amount corresponding to the earphone to be compensated according to the listening feeling of the first earphone and the listening feeling of the second earphone; wherein, the earphone to be compensated includes at least one of the first earphone and the second earphone, and the above compensation amount includes the amplitude and / or phase to be compensated for the sound signal to be played;
[0079] The adjustment module 603 is configured to adjust the amplitude and / or phase of the sound signal to be played of the earphone to be compensated according to the above compensation amount.
[0080] It should be noted that Figure 2 all relevant contents of each step involved in the method embodiment shown in the present application can be cited to the function description of the corresponding functional module, and will not be elaborated here.
[0081] The earphone 600 provided in this embodiment is used to execute the present application Figure 2The headphone listening experience compensation method provided by the illustrated embodiment can thus achieve the same effect as the above method.
[0082] Figure 7 FIG. is a schematic structural diagram of a headphone provided by another embodiment of the present application. Compared with Figure 6 the headphone shown, the difference lies in that Figure 7 in the headphone 600 shown, the determination module 602 may include: a judgment sub-module 6021, a comparison sub-module 6022, and a headphone determination sub-module 6023;
[0083] Among them, the judgment sub-module 6021 is used to judge whether the listening experience of the first headphone is the same as that of the second headphone;
[0084] The comparison sub-module 6022 is used to compare the magnitudes of the listening experiences of the first headphone and the second headphone when the listening experiences of the first headphone and the second headphone are different;
[0085] The headphone determination sub-module 6023 is used to determine the headphone with the smaller listening experience among the first headphone and the second headphone as the headphone to be compensated, and determine the difference between the listening experience of the first headphone and the listening experience of the second headphone as the compensation amount corresponding to the headphone to be compensated.
[0086] In this embodiment, the adjustment module 603 is specifically configured to determine the amplitude and / or phase of the equalizer of the headphone to be compensated according to the above compensation amount, so that the headphone to be compensated adjusts the amplitude and / or phase of the sound signal to be played according to the amplitude and / or phase of the equalizer itself.
[0087] In this embodiment, the acquisition module 601 may include: a signal acquisition sub-module 6011 and a signal determination sub-module 6012;
[0088] The signal acquisition sub-module 6011 is used to acquire the sound signal picked up by the error microphone in the first headphone;
[0089] The signal determination sub-module 6012 is used to determine the sound signal received by the user's left ear tympanic membrane point according to the sound signal picked up by the error microphone in the first headphone and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the human ear tympanic membrane point; the above sound signal received by the user's left ear tympanic membrane point is the listening experience of the first headphone.
[0090] In some examples, the signal acquisition sub-module 6011 is further configured to acquire the sound signal picked up by the error microphone in the first headphone and the sound signal picked up by the reference microphone in the first headphone before acquiring the sound signal picked up by the error microphone in the first headphone;
[0091] The acquisition module 601 may further include: a signal cancellation sub-module 6013;
[0092] A signal cancellation sub-module 6013 is configured to utilize the sound signal picked up by the above-mentioned reference microphone to cancel the environmental interference noise signal in the sound signal picked up by the error microphone. In this way, the sound signal picked up by the error microphone in the first earphone obtained by the signal acquisition sub-module 6011 includes: the sound signal after canceling the above-mentioned environmental interference noise signal.
[0093] In some examples, the signal acquisition sub-module 6011 is specifically configured to acquire the sound signal picked up by at least one error microphone in the first earphone.
[0094] It should be noted that all relevant contents of each step involved in the method embodiment shown in this application Figures 2 - 3 can be cited in the function descriptions of the corresponding functional modules and will not be elaborated here.
[0095] The earphone 600 provided in this embodiment is used to execute the earphone sound perception compensation method provided in the embodiment shown in this application Figures 2 - 3 and thus can achieve the same effect as the above method.
[0096] It should be understood that the earphone 600 can correspond to Figure 1 the earphone 100 shown. Among them, the functions of the acquisition module 601, the determination module 602, and the adjustment module 603 can be implemented by Figure 1 the processor 110 in the earphone 100 shown.
[0097] In the case of adopting an integrated unit, the earphone 600 may include a processing module, a storage module, and a communication module.
[0098] Among them, the processing module can be used to control and manage the actions of the earphone 600. For example, it can be used to support the earphone 600 to execute the steps performed by the above-mentioned modules. The storage module can be used to support the earphone 600 to store program codes and data, etc. The communication module can be used to support the communication of the earphone 600 with other devices.
[0099] Among them, the processing module can be a processor or a controller, which can implement or execute various exemplary logic blocks, modules, and circuits described in combination with the disclosed content of this application. The processor can also be a combination that realizes computing functions, such as a combination including one or more microprocessors, a combination of a digital signal processing (DSP) and a microprocessor, and so on. The storage module can be a memory. The communication module can specifically be a device for interacting with other electronic devices such as a radio frequency circuit, a Bluetooth chip, and / or a Wi-Fi chip.
[0100] In one embodiment, when the processing module is a processor and the storage module is a memory, the earphone 600 involved in this embodiment may be a device with Figure 1 the structure shown.
[0101] The embodiment of the present application also provides a computer-readable storage medium, in which a computer program is stored. When it runs on a computer, the computer is caused to execute the method provided by the embodiment of the present application Figures 2 - 3 shown.
[0102] The embodiment of the present application also provides a computer program product, which includes a computer program. When it runs on a computer, the computer is caused to execute the method provided by the embodiment of the present application Figures 2 - 3 shown.
[0103] In the embodiment of the present application, "at least one" means one or more, and "a plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent the cases of A existing alone, A and B existing simultaneously, and B existing alone. Where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after. "At least one of the following" and its similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, and c can represent: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, and c can be single or multiple.
[0104] Those of ordinary skill in the art can realize that the units and algorithm steps described in the embodiments disclosed herein can be implemented by a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.
[0105] Those skilled in the art can clearly understand that for the convenience and conciseness of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments, and will not be described herein again.
[0106] In several embodiments provided by the present application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present application. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical discs that can store program codes.
[0107] As described above, the above are only specific implementation manners of the present application. Any person skilled in the art within the technical scope disclosed by the present application can easily think of changes or substitutions, which should all be covered by the protection scope of the present application. The protection scope of the present application shall be subject to the protection scope of the claims.
Claims
1. A method for compensating the listening experience of earphones, characterized in that, it includes: In response to detecting that the user activates the earphone service, obtain the listening experience of the first earphone and the listening experience of the second earphone connected to the first earphone; wherein, the first earphone is the earphone worn on the user's left ear, and the second earphone is the earphone worn on the user's right ear; According to the listening experience of the first earphone and the listening experience of the second earphone, determine the earphone to be compensated and the compensation amount corresponding to the earphone to be compensated; wherein, the earphone to be compensated includes at least one of the first earphone and the second earphone, and the compensation amount includes the amplitude and phase to be compensated for the sound signal to be played; According to the compensation amount, adjust the amplitude and phase of the sound signal to be played by the earphone to be compensated.
2. The method according to claim 1, characterized in that, The determining the earphone to be compensated and the compensation amount corresponding to the earphone to be compensated according to the listening experience of the first earphone and the listening experience of the second earphone includes: Judge whether the listening experience of the first earphone and the listening experience of the second earphone are consistent; If they are inconsistent, then compare the magnitudes of the listening experience of the first earphone and the listening experience of the second earphone; Determine the earphone with the smaller listening experience among the first earphone and the second earphone as the earphone to be compensated, and determine the difference between the listening experience of the first earphone and the listening experience of the second earphone as the compensation amount corresponding to the earphone to be compensated.
3. The method according to claim 1, characterized in that, The adjusting the amplitude and phase of the sound signal to be played by the earphone to be compensated according to the compensation amount includes: According to the compensation amount, determine the amplitude and phase of the equalizer itself of the earphone to be compensated, so that the earphone to be compensated adjusts the amplitude and phase of the sound signal to be played according to the amplitude and phase of the equalizer itself.
4. The method according to claim 1, characterized in that, The obtaining the listening experience of the first earphone includes: Obtain the sound signal picked up by the error microphone in the first earphone; According to the sound signal picked up by the error microphone in the first earphone and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the eardrum point of the human ear, determine the sound signal received by the eardrum point of the user's left ear; the sound signal received by the eardrum point of the user's left ear is the listening experience of the first earphone.
5. The method according to claim 4, characterized in that, Before obtaining the sound signal picked up by the error microphone in the first earphone, it further includes: Obtain the sound signal picked up by the error microphone in the first earphone and the sound signal picked up by the reference microphone in the first earphone; Use the sound signal picked up by the reference microphone to eliminate the environmental interference noise signal in the sound signal picked up by the error microphone; The sound signal picked up by the error microphone in the first earphone includes: the sound signal after eliminating the environmental interference noise signal.
6. The method according to claim 4 or 5, characterized in that, The obtaining the sound signal picked up by the error microphone in the first earphone includes: Obtain the sound signal picked up by at least one error microphone in the first earphone.
7. An earphone listening experience compensation device, characterized in that, it includes: An acquisition module, configured to obtain the listening experience of the first earphone and the listening experience of the second earphone connected to the first earphone in response to detecting that the user activates an earphone service; wherein, the first earphone is the earphone worn on the user's left ear, and the second earphone is the earphone worn on the user's right ear; A determination module, configured to determine a headphone to be compensated and a compensation amount corresponding to the headphone to be compensated according to the listening experience of the first earphone and the listening experience of the second earphone; wherein, the headphone to be compensated includes at least one of the first earphone and the second earphone, and the compensation amount includes the amplitude and phase to be compensated for the sound signal to be played; An adjustment module, configured to adjust the amplitude and phase of the sound signal to be played by the headphone to be compensated according to the compensation amount.
8. An earphone, characterized in that, it includes: One or more processors; A memory; Multiple applications; And one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions that, when executed by the earphone, cause the earphone to execute the method according to any one of claims 1-6.
9. A computer-readable storage medium, characterized in that, A computer program is stored in the computer-readable storage medium, and when it runs on a computer, it causes the computer to execute the method according to any one of claims 1-6.