Compensation method and device for listening experience brought by earphone, and earphone

Abstract

Embodiments of the present application provide a compensation method and device for listening experience brought by an earphone, and an earphone. The compensation method for listening experience brought by an earphone comprises: in response to detecting that a user enables an earphone service, a first earphone acquiring listening experience brought by the first earphone and listening experience brought by a second earphone connected to the first earphone; on the basis of the listening experience brought by the first earphone and the listening experience brought by the second earphone, determining an earphone under compensation and a compensation amount corresponding to the earphone under compensation, wherein the compensation amount comprises the amplitude and phase to be compensated of a sound signal to be played back; and then, on the basis of the compensation amount, the first earphone adjusting the amplitude and phase of said sound signal of the earphone under compensation. Therefore, on the basis of the listening experience brought by the first earphone and the second earphone, the amplitude and phase of said sound signal of the first earphone or the second earphone are compensated in a targeted manner, such that the listening experience brought by the first earphone is consistent with the listening experience brought by the second earphone, thereby improving the listening experience of the user.

Description

Headphone hearing compensation method, device and headphone

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on November 30, 2023, with application number 202311637355.7 and application name “Headphone hearing compensation method, device and headphone”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of smart terminal technology, and in particular to a headphone hearing compensation method, device, and headphone. Background Art

[0003] Headphones, especially newer types like semi-in-ear and ear clip-on earphones, have poor sealing, variable wearing positions, and large leakage fluctuations. This can lead to inconsistent hearing in the left and right ears when performing noise reduction, listening to music, or making calls, affecting the user experience. For example, the left and right ears experience inconsistent noise reduction effects, different ear pressures, and / or inconsistent volume levels.

[0004] Summary of the Invention

[0005] The embodiments of the present application provide a headphone hearing compensation method, device, and headphone. The embodiments of the present application also provide a computer-readable storage medium to achieve targeted compensation for the sound effects of the left or right headphone based on the hearing perception of the left and right headphone, so that the hearing perception of the left and right headphone is consistent, thereby improving the user's auditory experience.

[0006] In a first aspect, an embodiment of the present application provides a method for compensating a headphone hearing perception, comprising: in response to detecting that a user has turned on a headphone service, obtaining a hearing perception of a first headphone and a hearing perception of a second headphone connected to the first headphone; wherein the first headphone is a headphone worn on the left ear of the user, and the second headphone is a headphone worn on the right ear of the user; then, based on the hearing perception of the first headphone and the hearing perception of the second headphone, determining a compensation amount corresponding to the headphone to be compensated and the headphone to be compensated; wherein the headphone to be compensated includes at least one of the first headphone and the second headphone, and the compensation amount includes the amplitude and phase of the sound signal to be played to be compensated; finally, based on the compensation amount, adjusting the amplitude and phase of the sound signal to be played of the headphone to be compensated.

[0007] In the above-mentioned headphone hearing compensation method, in response to detecting that the user has turned on the headphone service, the first headphone obtains the hearing perception of the first headphone and the hearing perception of the second headphone connected to the first headphone. The first headphone determines the compensation amount corresponding to the headphone to be compensated and the above-mentioned headphone to be compensated based on the hearing perception of the first headphone and the hearing perception of the second headphone. The compensation amount includes the amplitude and phase to be compensated of the sound signal to be played. Then, the first headphone can adjust the amplitude and phase of the sound signal to be played by the above-mentioned headphone to be compensated according to the above-mentioned compensation amount, so that the amplitude and phase of the sound signal to be played by the first headphone or the second headphone can be targetedly compensated according to the hearing perception of the first headphone and the second headphone, so that the hearing perception of the first headphone and the second headphone are consistent, thereby improving the user's auditory experience.

[0008] In one possible implementation, determining the compensation amounts corresponding to the earphone to be compensated and the earphone to be compensated based on the listening sensations of the first earphone and the second earphone includes: judging whether the listening sensations of the first earphone and the second earphone are consistent; if they are inconsistent, comparing the listening sensations of the first earphone and the second earphone; determining that the earphone with the smaller listening sensation between the first earphone and the second earphone is the earphone to be compensated, and determining the difference between the listening sensations of the first earphone and the second earphone as the compensation amount corresponding to the earphone to be compensated.

[0009] In one possible implementation, adjusting the amplitude and phase of the sound signal to be played by the headset to be compensated according to the compensation amount includes: determining the amplitude and phase of the equalizer of the headset to be compensated according to the compensation amount, so that the headset to be compensated can adjust the amplitude and phase of the sound signal to be played by the headset to be compensated according to the amplitude and phase of the equalizer itself.

[0010] In one possible implementation, obtaining the hearing sensation of the first earphone includes: obtaining a sound signal picked up by an error microphone in the first earphone; determining the sound signal received by the periosteal point of the user's left ear based on the sound signal picked up by the error microphone in the first earphone and a mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the periosteal point of the human ear; the sound signal received by the periosteal point of the user's left ear is the hearing sensation of the first earphone.

[0011] In one possible implementation, before obtaining the sound signal picked up by the error microphone in the first earphone, the method further includes: obtaining the sound signal picked up by the error microphone in the first earphone and the sound signal picked up by the reference microphone in the first earphone; using the sound signal picked up by the reference microphone to eliminate the environmental interference noise signal in the sound signal picked up by the error microphone; the sound signal picked up by the error microphone in the first earphone includes: the sound signal after the environmental interference noise signal is eliminated.

[0012] In one possible implementation manner, obtaining the sound signal picked up by the error microphone in the first earphone includes: obtaining a sound signal picked up by at least one error microphone in the first earphone.

[0013] In the above-mentioned headphone hearing compensation method, in response to detecting that the user has turned on the headphone service, the first headphone obtains the hearing perception of the first headphone and the hearing perception of the second headphone connected to the first headphone, and determines the compensation amount corresponding to the headphone to be compensated and the above-mentioned headphone to be compensated based on the hearing perception of the first headphone and the hearing perception of the second headphone, and the compensation amount includes the amplitude and phase to be compensated of the sound signal to be played. Then, the first headphone can adjust the amplitude and phase of the sound signal to be played by the above-mentioned headphone to be compensated according to the above-mentioned compensation amount, so that the amplitude and phase of the sound signal to be played by the first headphone or the second headphone can be targetedly compensated according to the hearing perception of the first headphone and the second headphone, so that the hearing perception of the first headphone and the second headphone are consistent, thereby improving the user's auditory experience.

[0014] In a second aspect, embodiments of the present application provide a headphone hearing compensation device, which is incorporated into headphones and has the functionality to implement the headphone behaviors described in the first aspect and possible implementations of the first aspect. This functionality can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the aforementioned functionality, such as an acquisition module, a determination module, and an adjustment module.

[0015] In a third aspect, an embodiment of the present application provides a headset, comprising: one or more processors; a memory; multiple applications; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the headset, enable the headset to execute the method provided in the first aspect.

[0016] It should be understood that the second and third aspects of the embodiments of the present application are consistent with the technical solutions of the first aspect of the embodiments of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated.

[0017] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes the method provided in the first aspect.

[0018] In a fifth aspect, an embodiment of the present application provides a computer program, which, when executed by a computer, is used to execute the method provided in the first aspect.

[0019] In one possible design, the program in the fifth aspect may be stored in whole or in part on a storage medium packaged with the processor, or may be stored in whole or in part on a memory not packaged with the processor. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] FIG1 is a schematic structural diagram of an earphone provided in one embodiment of the present application;

[0021] FIG2 is a flow chart of a headphone hearing compensation method provided by one embodiment of the present application;

[0022] FIG3 is a flow chart of a headphone hearing compensation method provided by another embodiment of the present application;

[0023] FIG4 is a system architecture diagram of a headphone hearing compensation method provided by one embodiment of the present application;

[0024] FIG5 is a system architecture diagram of a headphone hearing compensation method provided by another embodiment of the present application;

[0025] FIG6 is a schematic structural diagram of an earphone provided in another embodiment of the present application;

[0026] FIG7 is a schematic structural diagram of an earphone provided in yet another embodiment of the present application. DETAILED DESCRIPTION

[0027] The terms used in the implementation section of this application are only used to explain the specific embodiments of this application and are not intended to limit this application.

[0028] In response to the problem of inconsistent hearing between the left and right ears of headphones,

[0029] Based on the above problems, an embodiment of the present application provides a headphone hearing compensation method, which can solve the problem of inconsistent hearing sensations in the left and right ears when users use true wireless stereo (TWS) headphones for noise reduction, listening to music or making calls.

[0030] The headphone hearing compensation method provided in the embodiment of the present application can be applied to headphones, and the above-mentioned headphones can be TWS headphones; in terms of in-ear form, the in-ear form of the above-mentioned headphones can be semi-in-ear or ear clip, and of course it can also be full-in-ear; the embodiment of the present application does not impose any restrictions on the type of the above-mentioned headphones.

[0031] For example, FIG1 is a schematic diagram of the structure of a headset provided in one embodiment of the present application. As shown in FIG1 , the headset 100 may include a processor 110 and a communication interface 120. Optionally, the headset 100 may further include a memory 130. The processor 110, the communication interface 120, and the memory 130 may communicate with each other via an internal connection path to transmit control and / or data signals. The memory 130 is used to store computer programs, and the processor 110 is used to call and execute the computer programs from the memory 130.

[0032] The processor 110 and the memory 130 may be combined into a processing device, or more commonly, they are independent components. The processor 110 is used to execute program codes stored in the memory 130. In specific implementations, the memory 130 may also be integrated into the processor 110, or independent of the processor 110.

[0033] The headset 100 may also include a microphone 140 and a speaker 150. The microphone 140, also known as a "microphone" or "speaker," is configured to convert sound signals into electrical signals. In this embodiment, the headset 100 may include at least two microphones 140. For example, the headset 100 may include one error microphone and one reference microphone, or two error microphones and one reference microphone.

[0034] The speaker 150 , also called a “speaker,” is used to convert audio electrical signals into sound signals. The headset 100 can listen to music or make hands-free calls through the speaker 150 .

[0035] In addition, in order to make the functions of the earphone 100 more complete, the earphone 100 may further include a power supply 160 for providing power to various devices or circuits in the earphone 100 .

[0036] It should be noted that the structure of the earphone 100 shown in Figure 1 is only the structure of one earphone. Generally speaking, earphones are used in pairs, and the left earphone and the right earphone have the same structure. Both the left earphone and the right earphone can be implemented using the structure shown in Figure 1.

[0037] It should be understood that the processor 110 in the headset 100 shown in FIG. 1 may be a system on a chip (SOC), and the processor 110 may include a central processing unit (CPU).

[0038] For ease of understanding, the following embodiments of this application will take the headphones having the structure shown in Figure 1 as an example, and combine the accompanying drawings and application scenarios to specifically explain the headphone hearing compensation method provided in the embodiments of this application.

[0039] FIG2 is a flow chart of a headphone hearing compensation method according to an embodiment of the present application. As shown in FIG2 , the headphone hearing compensation method may include:

[0040] Step 201: In response to detecting that a user turns on the earphone service, the first earphone 100 obtains a hearing experience of the first earphone 100 and a hearing experience of a second earphone connected to the first earphone 100.

[0041] In this embodiment, the user enabling the headset service may include: the user using the headset for noise reduction, music listening, or conversation services, and this embodiment does not limit the types of the headset services.

[0042] The first earphone 100 is worn on the user's left ear, and the second earphone is worn on the user's right ear. This is for ease of description only and does not limit the present invention. The first earphone 100 can also be worn on the user's right ear, and the second earphone can be worn on the user's left ear. In some embodiments, the first earphone 100 can be the earphone worn first by the user. In some embodiments, the first earphone 100 can be the primary earphone.

[0043] In some examples, the first earphone 100 may obtain the auditory experience of the second earphone connected to the first earphone 100 by: the first earphone 100 obtains the auditory experience of the second earphone transmitted by the second earphone. In other words, the auditory experience of the second earphone may be obtained by the second earphone and then transmitted to the first earphone 100. Of course, the first earphone 100 may also directly obtain the auditory experience of the second earphone. This embodiment does not limit the method by which the first earphone 100 obtains the auditory experience of the second earphone.

[0044] In some embodiments, the auditory experience of headphones can be represented by the amplitude and / or phase characteristics of the sound signal received at the user's periosteal point. For example, the amplitude of the sound signal received at the periosteal point of the user's left ear by the headphone worn on the user's left ear is a first amplitude, and the amplitude of the sound signal received at the periosteal point of the user's right ear by the headphone worn on the user's right ear is a second amplitude. If the first headphone 100 determines that the first amplitude and the second amplitude are equal or the difference is within a preset range, then the auditory experience of the headphone worn on the left ear and the headphone worn on the right ear is determined to be consistent.

[0045] In step 202 , the first earphone 100 determines compensation amounts corresponding to the earphone to be compensated and the earphone to be compensated according to the listening experience of the first earphone 100 and the listening experience of the second earphone.

[0046] The earphone to be compensated may be at least one of the first earphone and the second earphone, and the compensation amount includes the amplitude and / or phase of the sound signal to be played to be compensated.

[0047] In some examples, the first earphone 100 determines the compensation amounts corresponding to the earphone to be compensated and the earphone to be compensated based on the listening experience of the first earphone 100 and the listening experience of the second earphone. This may be as follows: the first earphone 100 determines whether the listening experience of the first earphone 100 and the listening experience of the second earphone are consistent; if they are inconsistent, the first earphone 100 compares the listening experience of the first earphone 100 and the listening experience of the second earphone, determines that the earphone with the smaller listening experience among the first earphone 100 and the second earphone is the earphone to be compensated, and determines that the difference between the listening experience of the first earphone and the second earphone is the compensation amount corresponding to the earphone to be compensated.

[0048] In step 203 , the first earphone 100 adjusts the amplitude and / or phase of the sound signal to be played by the earphone to be compensated according to the compensation amount.

[0049] In some examples, the first earphone 100 adjusts the amplitude and / or phase of the sound signal to be played according to the compensation amount, which can be as follows: the first earphone 100 determines the amplitude and / or phase of the equalizer (EQ) of the earphone to be compensated according to the compensation amount, so that the earphone to be compensated can adjust the amplitude and / or phase of the sound signal to be played by the earphone to be compensated according to the amplitude and / or phase of the equalizer itself.

[0050] In the above-mentioned headphone hearing perception compensation method, in response to detecting that the user has turned on the headphone service, the first headphone 100 obtains the hearing perception of the first headphone 100 and the hearing perception of the second headphone connected to the first headphone 100. The first headphone 100 determines the compensation amounts corresponding to the headphone to be compensated and the above-mentioned headphone to be compensated based on the hearing perception of the first headphone 100 and the hearing perception of the second headphone. The compensation amount includes the amplitude and / or phase to be compensated of the sound signal to be played. Then, the first headphone can adjust the amplitude and / or phase of the sound signal to be played by the above-mentioned headphone to be compensated according to the above-mentioned compensation amount, so that the amplitude and / or phase of the sound signal to be played by the first headphone or the second headphone can be targetedly compensated according to the hearing perception of the first headphone and the second headphone, so that the hearing perception of the first headphone and the second headphone are consistent, thereby improving the user's auditory experience.

[0051] FIG3 is a flow chart of a headphone hearing compensation method provided by another embodiment of the present application. As shown in FIG3 , in the embodiment shown in FIG2 of the present application, step 201 may include:

[0052] Step 301 : In response to detecting that a user turns on the earphone service, the first earphone 100 obtains a sound signal picked up by an error microphone in the first earphone 100 .

[0053] In some examples, the sound signal picked up by the error microphone in the first earphone 100 can be a sound signal after the environmental interference noise signal is eliminated. That is, the first earphone 100 can obtain the sound signal picked up by the error microphone in the first earphone 100 and the sound signal picked up by the reference microphone in the first earphone 100, and then use the sound signal picked up by the above-mentioned reference microphone to eliminate the environmental interference noise signal in the sound signal picked up by the above-mentioned error microphone, so as to use the sound signal after the above-mentioned environmental interference noise signal is eliminated as the sound signal picked up by the error microphone in the first earphone 100.

[0054] Additionally, in some examples, the first earphone 100 acquiring the sound signal picked up by the error microphone in the first earphone 100 may include: the first earphone 100 acquiring the sound signal picked up by at least one error microphone in the first earphone 100. In other words, the number of error microphones in the first earphone 100 may be one or more, and thus, the sound signal picked up by the error microphone in the first earphone 100 may be the sound signal picked up by one or more (for example, two) error microphones in the first earphone 100.

[0055] In step 302, the first earphone 100 determines the sound signal received at the periosteal point of the user's left ear based on the sound signal picked up by the error microphone in the first earphone 100 and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received at the periosteal point of the human ear. The sound signal received at the periosteal point of the user's left ear represents the hearing perception of the first earphone 100.

[0056] In step 303 , the first earphone 100 obtains a listening experience of the second earphone connected to the first earphone 100 .

[0057] In some examples, the hearing sensation of the second earphone can be obtained by the second earphone, and then the second earphone transmits the obtained hearing sensation of the second earphone to the first earphone 100. In a specific implementation, the way in which the second earphone obtains the hearing sensation of the second earphone can be: the second earphone obtains the sound signal picked up by the error microphone in the second earphone, and the second earphone determines the sound signal received by the above-mentioned user's right ear periosteal point based on the sound signal picked up by the error microphone in the second earphone and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the human ear periosteal point. The sound signal received by the above-mentioned user's right ear periosteal point is the hearing sensation of the second earphone. As described above, the number of error microphones in the first earphone 100 can be one or more, and similarly, the number of error microphones in the second earphone can also be one or more, and the number of error microphones in the first earphone 100 and the second earphone is the same.

[0058] Of course, the first earphone 100 may also directly obtain the hearing experience of the second earphone in the above manner. This embodiment does not limit the manner in which the first earphone 100 obtains the hearing experience of the second earphone.

[0059] In the above-mentioned headphone hearing compensation method, the first headphone 100 can obtain the hearing perception of the first headphone 100 and the hearing perception of the second headphone, so that the amplitude and / or phase of the sound signal to be played by the first headphone or the second headphone can be targetedly compensated according to the hearing perception of the first headphone and the second headphone, so that the hearing perception of the first headphone and the second headphone is consistent, thereby improving the user's auditory experience.

[0060] FIG4 is a system architecture diagram of an earphone hearing compensation method provided by an embodiment of the present application. As shown in FIG4 , each of the first earphone 100 and the second earphone has only one error microphone. The earphone hearing compensation method provided by an embodiment of the present application will be introduced below with reference to the architecture shown in FIG4 .

[0061] Referring to FIG4 , in response to detecting that the user has turned on the earphone service, the first earphone 100 can obtain the sound signal picked up by the error microphone 44 in the first earphone 100 and the sound signal picked up by the reference microphone 45 in the first earphone 100. Then, the external environment interference elimination module in the first earphone 100 uses the sound signal picked up by the reference microphone 45 to eliminate the environmental interference noise signal in the sound signal picked up by the error microphone 44, and obtain SP ERP_L ERP is the abbreviation of error point, that is, the sound signal after eliminating the above-mentioned environmental interference noise signal is used as the sound signal SP picked up by the error microphone 44 in the first earphone 100 ERP_L .

[0062] Similarly, in response to detecting that the user turns on the earphone service, the second earphone can obtain the sound signal picked up by the error microphone 49 in the second earphone and the sound signal picked up by the reference microphone 410 in the second earphone, and then the external environment interference elimination module in the second earphone uses the sound signal picked up by the reference microphone 410 to eliminate the environmental interference noise signal in the sound signal picked up by the error microphone 49, and obtain SP ERP_R That is, the sound signal after eliminating the above-mentioned environmental interference noise signal is used as the sound signal SP picked up by the error microphone 49 in the second earphone. ERP_R .

[0063] In this embodiment, a mapping relationship model between the sound signal picked up by the error microphone and the sound signal received by the periosteum of the human ear is pre-established. In this way, the first earphone 100 obtains SP ERP_LAfterwards, the first earphone 100 can determine the sound signal SP received by the user's left ear periosteum point 41 based on the sound signal picked up by the error microphone and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the human ear periosteum point. DRP_L Among them, DRP is the abbreviation of periosteum point (drump point), SP DRP_L It is the sound signal received by the user's left ear periosteum point 41, that is, the hearing experience of the first earphone 100.

[0064] Likewise, the second headset gets SP ERP_R Afterwards, the second earphone can determine the sound signal SP received by the user's right ear periosteum point 46 based on the sound signal picked up by the error microphone and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the human ear periosteum point. DRP_R Among them, SP DRP_R It is the sound signal received by the user's right ear periosteum point 46, that is, the hearing sensation of the second earphone.

[0065] Next, the second headset can SP DRP_R Transmitted to the first headset 100, the first headset 100 can compare SP DRP_L With SP DRP_R If they are not consistent, the first headset 100 compares SP DRP_L With SP DRP_R The size of SP DRP_L With SP DRP_R The earphone corresponding to the smaller value is the earphone to be compensated, and the SP DRP_L With SP DRP_R The difference between them is the compensation amount corresponding to the earphone to be compensated, and the compensation amount includes the amplitude and / or phase to be compensated of the sound signal to be played.

[0066] Finally, the first earphone 100 can determine the amplitude and phase of the EQ of the earphone to be compensated based on the above compensation amount. In this way, the earphone to be compensated can adjust the amplitude and / or phase of the sound signal to be played by the earphone to be compensated according to the amplitude and / or phase of the EQ itself, so that the listening experience of the first earphone 100 and the second earphone is consistent, thereby improving the user's listening experience.

[0067] In the above embodiment, the second earphone is used to obtain SP DRP_R , and then SP DRP_R The example of transmitting the data to the first headset 100 is used for explanation. In the specific implementation, the second headset can also obtain the SP ERP_R Afterwards, SP ERP_R Transmitted to the first headset 100, the first headset 100 determines SP DRP_R , this embodiment does not limit this.

[0068] FIG5 is a system architecture diagram of an earphone hearing compensation method provided in another embodiment of the present application. As shown in FIG5 , both the first earphone 100 and the second earphone have two error microphones. The earphone hearing compensation method provided in an embodiment of the present application will be introduced below with reference to the architecture shown in FIG5 .

[0069] Referring to FIG5 , in response to detecting that the user has turned on the earphone service, the first earphone 100 can obtain the sound signals picked up by the first error microphone 54 and the second error microphone 55 in the first earphone 100, as well as the sound signals picked up by the reference microphone 56 in the first earphone 100. Then, the external environment interference elimination module in the first earphone 100 uses the sound signals picked up by the reference microphone 56 to eliminate the environmental interference noise signals in the sound signals picked up by the first error microphone 54 and the second error microphone 55, respectively, to obtain SP ERP_L1 and SP ERP_L2 , SP ERP_L1 The sound signal picked up by the first error microphone 54, SP ERP_L2 It can be the sound signal picked up by the second error microphone 55.

[0070] Similarly, in response to detecting that the user turns on the earphone service, the second earphone can obtain the sound signals picked up by the third error microphone 510 and the fourth error microphone 511 in the second earphone, as well as the sound signal picked up by the reference microphone 512. Then, the external environment interference elimination module in the second earphone uses the sound signal picked up by the reference microphone 512 to eliminate the environmental interference noise signals in the sound signals picked up by the third error microphone 510 and the fourth error microphone 511, respectively, to obtain SP ERP_R1 and SP ERP_R2 , SP ERP_R1 The sound signal picked up by the third error microphone 510, SP ERP_R2 It can be the sound signal picked up by the fourth error microphone 511.

[0071] In this embodiment, a mapping relationship model between the sound signal picked up by the error microphone and the sound signal received by the periosteum of the human ear is pre-established. In this way, the first earphone 100 obtains SP ERP_L1 and SP ERP_L2 Afterwards, the first headset 100 can ERP_L1 and SP ERP_L2 , and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the human ear periosteum point, to determine the sound signal SP received by the user's left ear periosteum point 51 DRP_L Among them, SP DRP_LThe sound signal received by the user's left ear periosteal point 51 is the hearing experience of the first earphone 100. In this embodiment, the first earphone 100 uses the sound signals picked up by the two error microphones to map the sound signal received by the human ear periosteal point, which can improve the accuracy of the mapped sound signal.

[0072] Likewise, the second headset gets SP ERP_R1 and SP ERP_R2 Afterwards, the second headset can be ERP_R1 and SP ERP_R2 , and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the human ear periosteum point, to determine the sound signal SP received by the user's right ear periosteum point 57 DRP_R Among them, SP DRP_R It is the sound signal received by the user's right ear periosteum point 57, that is, the hearing experience of the second earphone.

[0073] Next, the second headset can SP DRP_R Transmitted to the first headset 100, the first headset 100 can compare SP DRP_L With SP DRP_R If they are not consistent, the first headset 100 compares SP DRP_L With SP DRP_R The size of SP DRP_L With SP DRP_R The earphone corresponding to the smaller value is the earphone to be compensated, and the SP DRP_L With SP DRP_R The difference between them is the compensation amount corresponding to the earphone to be compensated, and the compensation amount includes the amplitude and / or phase to be compensated of the sound signal to be played.

[0074] Finally, the first earphone 100 can determine the amplitude and / or phase of the EQ of the earphone to be compensated based on the above compensation amount. In this way, the earphone to be compensated can adjust the amplitude and / or phase of the sound signal to be played by the earphone to be compensated based on the amplitude and / or phase of the EQ itself, so that the listening experience of the first earphone 100 and the second earphone is consistent, thereby improving the user's listening experience.

[0075] It is understood that some or all of the steps or operations in the above embodiments are merely examples, and the present application embodiments may also perform other operations or variations of various operations. In addition, the various steps may be performed in a different order than those presented in the above embodiments, and it is possible that not all of the operations in the above embodiments need to be performed.

[0076] It is understandable that in order to achieve the above functions, the headset includes hardware and / or software modules that perform the corresponding functions. In combination with the algorithm steps of each example described in the embodiments disclosed in this application, this application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0077] This embodiment can divide the headset into functional modules based on the above-mentioned method embodiment. For example, each functional module can be divided into corresponding functional modules, or two or more functions can be integrated into a single module. The above-mentioned integrated modules can be implemented in the form of hardware. It should be noted that the module division in this embodiment is illustrative and only represents a logical functional division. In actual implementation, other division methods may be used.

[0078] FIG6 is a schematic diagram of the structure of an earphone provided in another embodiment of the present application. In the case where the functional modules are divided according to their functions, FIG6 shows a possible schematic diagram of the composition of an earphone 600 involved in the above embodiment. As shown in FIG6 , the earphone 600 may include: an acquisition module 601, a determination module 602, and an adjustment module 603.

[0079] The acquisition module 601 is configured to, in response to detecting that the user has activated the earphone service, acquire the hearing experience of a first earphone and the hearing experience of a second earphone connected to the first earphone; wherein the first earphone is the earphone worn on the user's left ear and the second earphone is the earphone worn on the user's right ear;

[0080] Determination module 602, configured to determine, based on the listening experience of the first earphone and the listening experience of the second earphone, compensation amounts corresponding to the earphone to be compensated and the earphone to be compensated; wherein the earphone to be compensated includes at least one of the first earphone and the second earphone, and the compensation amount includes the amplitude and / or phase to be compensated of the sound signal to be played;

[0081] The adjustment module 603 is configured to adjust the amplitude and / or phase of the sound signal to be played by the headphone to be compensated according to the compensation amount.

[0082] It should be noted that all relevant contents of each step involved in the method embodiment shown in Figure 2 of the present application can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0083] The earphone 600 provided in this embodiment is used to execute the earphone hearing compensation method provided in the embodiment shown in FIG. 2 of the present application, and thus can achieve the same effect as the above method.

[0084] FIG7 is a schematic diagram of the structure of an earphone provided in yet another embodiment of the present application. Compared with the earphone shown in FIG6 , the difference is that in the earphone 600 shown in FIG7 , the determination module 602 may include: a judgment submodule 6021, a comparison submodule 6022, and an earphone determination submodule 6023;

[0085] The judgment submodule 6021 is configured to judge whether the listening experience of the first earphone is consistent with the listening experience of the second earphone;

[0086] A comparison submodule 6022 is configured to compare the hearing sensations of the first earphone and the second earphone when the hearing sensations of the first earphone are inconsistent with those of the second earphone;

[0087] The earphone determination submodule 6023 is configured to determine the earphone with the smaller hearing sense between the first earphone and the second earphone as the earphone to be compensated, and to determine the difference between the hearing sense of the first earphone and the second earphone as the compensation amount corresponding to the earphone to be compensated.

[0088] In this embodiment, the adjustment module 603 is specifically used to determine the amplitude and / or phase of the equalizer of the earphone to be compensated based on the above-mentioned compensation amount, so that the earphone to be compensated can adjust the amplitude and / or phase of the sound signal to be played by the earphone to be compensated according to the amplitude and / or phase of the above-mentioned equalizer itself.

[0089] In this embodiment, the acquisition module 601 may include: a signal acquisition submodule 6011 and a signal determination submodule 6012;

[0090] A signal acquisition submodule 6011 is configured to acquire a sound signal picked up by an error microphone in the first earphone;

[0091] The signal determination submodule 6012 is used to determine the sound signal received by the user's left ear periosteal point based on the sound signal picked up by the error microphone in the above-mentioned first earphone, and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the human ear periosteal point; the sound signal received by the above-mentioned user's left ear periosteal point is the hearing sensation of the first earphone.

[0092] In some examples, the signal acquisition submodule 6011 is further configured to acquire the sound signal picked up by the error microphone in the first earphone and the sound signal picked up by the reference microphone in the first earphone before acquiring the sound signal picked up by the error microphone in the first earphone;

[0093] The acquisition module 601 may further include: a signal elimination submodule 6013;

[0094] The signal elimination submodule 6013 is used to use the sound signal picked up by the above-mentioned reference microphone to eliminate the environmental interference noise signal in the sound signal picked up by the error microphone; in this way, the sound signal picked up by the error microphone in the first earphone obtained by the signal acquisition submodule 6011 includes: the sound signal after the above-mentioned environmental interference noise signal is eliminated.

[0095] In some examples, the signal acquisition submodule 6011 is specifically configured to acquire a sound signal picked up by at least one error microphone in the first earphone.

[0096] It should be noted that all relevant contents of each step involved in the method embodiment shown in Figures 2 to 3 of the present application can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0097] The earphone 600 provided in this embodiment is used to execute the earphone hearing compensation method provided in the embodiments shown in Figures 2 and 3 of this application, and can therefore achieve the same effect as the above method.

[0098] It should be understood that the earphone 600 may correspond to the earphone 100 shown in Figure 1 . The functions of the acquisition module 601 , the determination module 602 , and the adjustment module 603 may be implemented by the processor 110 in the earphone 100 shown in Figure 1 .

[0099] In the case of an integrated unit, the headset 600 may include a processing module, a storage module, and a communication module.

[0100] The processing module can be used to control and manage the operation of the headset 600. For example, it can be used to support the headset 600 in executing the steps performed by the above modules. The storage module can be used to support the headset 600 in storing program code and data. The communication module can be used to support the headset 600 in communicating with other devices.

[0101] Among them, the processing module can be a processor or a controller, which can implement or execute the various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, and so on. The storage module can be a memory. The communication module can specifically be a device that interacts with other electronic devices, such as a radio frequency circuit, a Bluetooth chip and / or a Wi-Fi chip.

[0102] In one embodiment, when the processing module is a processor and the storage module is a memory, the earphone 600 involved in this embodiment can be a device having the structure shown in FIG. 1 .

[0103] An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer-readable storage medium is run on a computer, the computer executes the method provided in the embodiments shown in Figures 2 to 3 of the present application.

[0104] An embodiment of the present application further provides a computer program product, which includes a computer program. When the computer program is run on a computer, the computer executes the method provided in the embodiments shown in Figures 2 to 3 of the present application.

[0105] In the embodiments of the present application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent the existence of A alone, the existence of A and B at the same time, and the existence of B alone. Among them, A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b and c can represent: a, b, c, a and b, a and c, b and c or a and b and c, where a, b, c can be single or multiple.

[0106] Those skilled in the art will appreciate that the various units and algorithm steps described in the embodiments disclosed herein can be implemented using a combination of electronic hardware, computer software, and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0107] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0108] In the several embodiments provided in this application, if any function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of this application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0109] The above description is merely a specific embodiment of the present application. Any person skilled in the art may easily conceive of variations or substitutions within the technical scope disclosed in this application, and such variations or substitutions shall be within the scope of protection of this application. The scope of protection of this application shall be subject to the scope of protection of the claims.

Claims

1. A method for compensating earphone hearing perception, characterized in that: include: In response to detecting that the user turns on the earphone service, obtaining a hearing sensation of a first earphone and a hearing sensation of a second earphone connected to the first earphone; wherein the first earphone is an earphone worn on the left ear of the user, and the second earphone is an earphone worn on the right ear of the user; Determine the compensation amount corresponding to the earphone to be compensated and the earphone to be compensated according to the hearing sense of the first earphone and the hearing sense of the second earphone; wherein the earphone to be compensated includes at least one of the first earphone and the second earphone, and the compensation amount includes the amplitude and phase to be compensated of the sound signal to be played; According to the compensation amount, the amplitude and phase of the sound signal to be played by the earphone to be compensated are adjusted.

2. The method according to claim 1, characterized in that The determining, according to the hearing sense of the first earphone and the hearing sense of the second earphone, the earphone to be compensated and the compensation amount corresponding to the earphone to be compensated comprises: Determining whether the listening experience of the first earphone is consistent with the listening experience of the second earphone; If they are inconsistent, comparing the hearing sensation of the first earphone with the hearing sensation of the second earphone; The earphone with smaller hearing sense between the first earphone and the second earphone is determined as the earphone to be compensated, and the difference between the hearing sense of the first earphone and the hearing sense of the second earphone is determined as the compensation amount corresponding to the earphone to be compensated.

3. The method according to claim 1, characterized in that: The adjusting the amplitude and phase of the sound signal to be played by the earphone to be compensated according to the compensation amount comprises: According to the compensation amount, the amplitude and phase of the equalizer of the earphone to be compensated are determined, so that the earphone to be compensated can adjust the amplitude and phase of the sound signal to be played by the earphone to be compensated according to the amplitude and phase of the equalizer itself.

4. The method according to claim 1, characterized in that The obtaining of the hearing sensation of the first earphone includes: Acquire a sound signal picked up by an error microphone in the first earphone; The sound signal received by the user's left ear periosteal point is determined based on the sound signal picked up by the error microphone in the first earphone and the mapping relationship between the sound signal picked up by the error microphone and the sound signal received by the human ear periosteal point; the sound signal received by the user's left ear periosteal point is the hearing sensation of the first earphone.

5. The method according to claim 4, characterized in that Before acquiring the sound signal picked up by the error microphone in the first earphone, the method further includes: Acquire a sound signal picked up by an error microphone in the first earphone and a sound signal picked up by a reference microphone in the first earphone; Using the sound signal picked up by the reference microphone, eliminating the environmental interference noise signal in the sound signal picked up by the error microphone; The sound signal picked up by the error microphone in the first earphone includes: the sound signal after the environmental interference noise signal is eliminated.

6. The method according to claim 4 or 5, characterized in that: The obtaining of the sound signal picked up by the error microphone in the first earphone comprises: Acquire a sound signal picked up by at least one error microphone in the first earphone.

7. An earphone hearing compensation device, characterized in that: include: an acquisition module, configured to acquire, in response to detecting that a user turns on an earphone service, a hearing sensation of a first earphone and a hearing sensation of a second earphone connected to the first earphone; wherein the first earphone is an earphone worn on the left ear of the user, and the second earphone is an earphone worn on the right ear of the user; A determination module, configured to determine the compensation amount corresponding to the earphone to be compensated and the earphone to be compensated according to the hearing sense of the first earphone and the hearing sense of the second earphone; wherein the earphone to be compensated includes at least one of the first earphone and the second earphone, and the compensation amount includes the amplitude and phase to be compensated of the sound signal to be played; The adjustment module is used to adjust the amplitude and phase of the sound signal to be played by the headset to be compensated according to the compensation amount.

8. A headset, characterized in that: include: one or more processors; Memory; Multiple applications; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions, which, when executed by the headset, enable the headset to perform the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which, when executed on a computer, enables the computer to execute the method according to any one of claims 1 to 6.

Images