Earphone control method and earphone

Abstract

This invention provides an earphone control method and earphones that can improve the perceived auditory effect. [Solution] The method includes: collecting a first audio signal with a feedforward microphone and a second audio signal with a feedback microphone 202; determining the current scene type of the external scene in which the earphone is located based on the first audio signal and acquiring a target effect audio signal corresponding to the current scene type 204; determining current frequency spectrum relationship information between the first audio signal and the second audio signal, and target frequency spectrum relationship information between the first audio signal and the target effect audio signal 206; and repeatedly adjusting the filter parameters of the earphone based on the current frequency spectrum relationship information and the target frequency spectrum relationship information 208, wherein the error between the newly collected second audio signal and the target effect audio signal is smaller than a predetermined error.

Description

[Technical Field]

[0001] This application relates to the technical field of audio processing, and more particularly to an earphone control method and an earphone. [Background technology]

[0002] With advancements in audio processing technology, earphones now have pass-through mode and active noise-canceling mode. In pass-through mode, the earphones can transmit external ambient sounds to the user's ears, while in active noise-canceling mode, the earphones can filter out ambient noise. In conventional technology, whether in pass-through mode or active noise-canceling mode, earphones typically have fixed filter parameters and process external audio signals based on these fixed filter parameters. However, because users' demands for audio listening effectiveness often differ depending on the external environment, if the filter parameters are fixed, the actual audio listening effect after the user puts on the earphones may not meet the user's desired audio listening effect, resulting in a reduced perceived listening effect of the earphones. [Overview of the project]

[0003] Based on this, it is necessary to provide an earphone control method and earphones that can improve the auditory effect after wearing the earphones to address the above technical problems.

[0004] In a first aspect, the present application provides an earphone control method applicable to earphones including feedforward microphones and feedback microphones, the method being: The steps include: collecting a first audio signal with the feedforward microphone and collecting a second audio signal with the feedback microphone; The steps include determining the current scene type of the external scene in which the earphones are located based on the first audio signal, and obtaining a target effect audio signal corresponding to the current scene type, The steps include determining the current frequency spectrum relationship information between the first audio signal and the second audio signal, and the target frequency spectrum relationship information between the first audio signal and the target effect audio signal, The steps include adjusting the filter parameters of the earphones based on the current frequency spectrum information and the target frequency spectrum information, The steps include: collecting the second audio signal again based on the adjusted filter parameters; If it is determined that the error between the second audio signal re-collected and the target effect audio signal is greater than or equal to a predetermined error, the process includes returning to the step of collecting the first audio signal with the feedforward microphone and collecting the second audio signal with the feedback microphone until the error between the second audio signal re-collected and the target effect audio signal becomes less than the predetermined error.

[0005] In a second aspect, the present invention further provides an earphone control device applicable to an earphone including a feedforward microphone and a feedback microphone, the device, A signal acquisition module that acquires a first audio signal using the feedforward microphone and a second audio signal using the feedback microphone, A signal acquisition module that determines the current scene type of the external scene in which the earphones are located based on the first audio signal and acquires a target effect audio signal corresponding to the current scene type, A frequency spectrum relationship information determination module that determines the current frequency spectrum relationship information between the first audio signal and the second audio signal, and the target frequency spectrum relationship information between the first audio signal and the target effect audio signal, A parameter adjustment module that adjusts the filter parameters of the earphones based on the current frequency spectrum related information and the target frequency spectrum related information, The signal acquisition module re-collects the second audio signal based on the adjusted filter parameters, The system includes, if it is determined that the error between the second audio signal re-collected and the target effect audio signal is greater than or equal to a predetermined error, an iterative circular module that returns to performing the steps of collecting the first audio signal with the feedforward microphone and collecting the second audio signal with the feedback microphone until the error between the second audio signal re-collected and the target effect audio signal becomes less than the predetermined error.

[0006] In a third aspect, the present invention further provides an earphone including a feedforward microphone, a feedback microphone, a memory storing a computer program, and a processor, wherein the processor executes the computer program. The system implements the following steps: collecting a first audio signal with a feedforward microphone and collecting a second audio signal with a feedback microphone; determining the current scene type of the external scene in which the earphone is located based on the first audio signal and acquiring a target effect audio signal corresponding to the current scene type; determining current frequency spectrum relationship information between the first audio signal and the second audio signal, and target frequency spectrum relationship information between the first audio signal and the target effect audio signal; adjusting the filter parameters of the earphone based on the current frequency spectrum relationship information and the target frequency spectrum relationship information; collecting the second audio signal again based on the adjusted filter parameters; and, if it is determined that the error between the re-collected second audio signal and the target effect audio signal is greater than or equal to a predetermined error, returning to the step of collecting the first audio signal with the feedforward microphone and collecting the second audio signal with the feedback microphone until the error between the re-collected second audio signal and the target effect audio signal becomes smaller than the predetermined error.

[0007] In a fourth aspect, the present invention further provides a computer-readable storage medium in which a computer program is stored, and the computer program is executed by a processor. The system implements the following steps: collecting a first audio signal with a feedforward microphone and collecting a second audio signal with a feedback microphone; determining the current scene type of the external scene in which the earphone is located based on the first audio signal and acquiring a target effect audio signal corresponding to the current scene type; determining current frequency spectrum relationship information between the first audio signal and the second audio signal, and target frequency spectrum relationship information between the first audio signal and the target effect audio signal; adjusting the filter parameters of the earphone based on the current frequency spectrum relationship information and the target frequency spectrum relationship information; collecting the second audio signal again based on the adjusted filter parameters; and, if it is determined that the error between the re-collected second audio signal and the target effect audio signal is greater than or equal to a predetermined error, returning to the step of collecting the first audio signal with the feedforward microphone and collecting the second audio signal with the feedback microphone until the error between the re-collected second audio signal and the target effect audio signal becomes smaller than the predetermined error.

[0008] In a fifth aspect, the present application further provides a computer program product including a computer program, which, when executed by a processor, The system implements the following steps: collecting a first audio signal with a feedforward microphone and collecting a second audio signal with a feedback microphone; determining the current scene type of the external scene in which the earphone is located based on the first audio signal and acquiring a target effect audio signal corresponding to the current scene type; determining current frequency spectrum relationship information between the first audio signal and the second audio signal, and target frequency spectrum relationship information between the first audio signal and the target effect audio signal; adjusting the filter parameters of the earphone based on the current frequency spectrum relationship information and the target frequency spectrum relationship information; collecting the second audio signal again based on the adjusted filter parameters; and, if it is determined that the error between the re-collected second audio signal and the target effect audio signal is greater than or equal to a predetermined error, returning to the step of collecting the first audio signal with the feedforward microphone and collecting the second audio signal with the feedback microphone until the error between the re-collected second audio signal and the target effect audio signal becomes smaller than the predetermined error.

[0009] In the above earphone control method and earphone, a first audio signal is collected by the feedforward microphone, and a second audio signal is collected by the feedback microphone. First, the current scene type of the external scene in which the earphone is located is determined based on the first audio signal, and a target effect audio signal corresponding to the current scene type is acquired. Furthermore, current frequency spectrum relationship information representing the frequency spectrum relationship between the first audio signal and the second audio signal is determined, and target frequency spectrum relationship information representing the frequency spectrum relationship between the first audio signal and the target effect audio signal is determined. In this way, by continuously repeating the process of adjusting the filter parameters of the earphone based on the current frequency spectrum relationship information and the target frequency spectrum relationship information, the feedback microphone The second audio signal collected by the feedback microphone can be gradually brought closer to the target effect audio signal until the signal error between the second audio signal collected by the cross-microphone and the target effect audio signal is smaller than a predetermined error. In this case, the audio signal heard by the user will essentially match the target effect audio signal. Since the target effect audio signal corresponds to the current scene type of the external scene in which the earphones are located, the auditory effect of the target effect audio signal will be adapted to the external environment in which the earphones are located. In this case, the auditory effect after the user puts on the earphones will usually be almost identical to the audio effect of the target effect audio signal and adapted to the external environment in which the earphones are located. Thus, the auditory effect of the earphones will stabilize at a good level, and the auditory effect after putting on the earphones can be improved.

[0010] To more clearly describe the technical means in the embodiments of this application or related art, the drawings necessary for describing the embodiments of this application or related art are briefly described below. Clearly, the drawings described below are only a few embodiments of this application, and those skilled in the art can obtain other related drawings based on these drawings without any creative work. [Brief explanation of the drawing]

[0011] [Figure 1] It is a flowchart of an earphone control method in an embodiment of the present application. [Figure 2] It is a flowchart for adjusting filter parameters of an earphone in an embodiment of the present application. [Figure 3] It is a block configuration diagram of an earphone control device in an embodiment of the present application. [Figure 4] It is an internal configuration diagram of an earphone in an embodiment of the present application.

Embodiments for Carrying Out the Invention

[0012] In order to make the object, technical means, and advantages of the present application clearer, the present application will be described in more detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described in this specification are only for explaining the present application and do not limit the present application.

[0013] In one embodiment, as shown in FIG. 1, an earphone control method is provided. This embodiment will be described by taking the application of the method to an earphone as an example. The earphone includes a feedforward microphone and a feedback microphone. As can be understood, in this embodiment, the form of the earphone is not limited, and the earphone may be a wireless Bluetooth (registered trademark) earphone or a headset, etc. In this embodiment, the method includes steps 202 to 210.

[0014] In step 202, a first audio signal is collected by the feedforward microphone, and a second audio signal is collected by the feedback microphone.

[0015] An earphone usually has a pass-through mode and a noise cancellation mode. In the pass-through mode, the earphone can transmit an external audio signal to the user. In the noise cancellation mode, the earphone blocks the transmission of the external audio signal to the user as noise. The earphone is provided with a feed-forward microphone (reference microphone) and a feedback microphone (error microphone). The feed-forward microphone is usually provided in a region that contacts the external space in the earphone and collects the external audio signal. The feedback microphone is usually provided in a region on the side facing the ear canal of the user of the earphone and collects the audio signal transmitted into the user's ear canal. The audio signal collected by the feedback microphone can be used as the actual audio signal that the user actually hears.

[0016] Note that the first audio signal is the external audio signal collected by the feed-forward microphone, and the second audio signal is the audio signal collected by the feedback microphone after the external audio signal is transmitted to the feedback microphone.

[0017] In step 204, based on the first audio signal, the current scene type of the external scene where the earphone is located is determined, and a target effect audio signal corresponding to the current scene type is obtained.

[0018] In the case of different external scenes, the user usually has different requirements for auditory effects. For example, in the case of an airport scene, the user usually hopes to retain the voices of other people while removing the noise during the takeoff and landing of the airplane. In the case of a sleep scene, the user usually hopes to block the snoring of other people but retain the voice of the alarm clock and voices, etc.

[0019] Note that in this embodiment, effect audio signals in multiple types of external scenes are set, which conform to the types of external scenes uniformly corresponding to each effect audio signal and can give the user a high auditory effect in the case of the corresponding type of external scene.

[0020] As an example, step 204 includes extracting audio signal features from a first audio signal, classifying the audio signal features to obtain feature classification results, and determining the current scene type of the external scene in which the earphones are located based on the feature classification results. The audio signal features represent at least one of the amplitude features and frequency features of the first audio signal.

[0021] In one embodiment, the current scene type of the external scene in which the earphones are located is determined based on a first audio signal. This includes extracting audio signal features from a first audio signal and determining the current scene type of the external scene in which the earphones are located, based on the audio signal features.

[0022] Specifically, the first audio signal is converted from the time domain to the frequency domain to obtain a first frequency spectrum signal corresponding to the first audio signal, and the current scene type of the external scene in which the earphones are located is detected based on the frequency spectrum signal characteristics in each predetermined frequency band of the first frequency spectrum signal.

[0023] Furthermore, in this embodiment, if a change in the external scene in which the earphones are located is detected, the following steps can be triggered: detecting the current scene type of the external scene in which the earphones are located based on the first audio signal and obtaining a scene type indicator; and using the scene type indicator as an index, searching for a target effect audio signal corresponding to the scene type indicator.

[0024] In some embodiments, if a change in the external scene in which the earphones are located is detected, the current scene type of the external scene in which the earphones are located can be detected based on the first audio signal, and a scene type indicator can be obtained. This scene type indicator is then pushed to a terminal device corresponding to the earphones, and the terminal device displays a plurality of corresponding effect audio signals based on the scene type indicator, all of which are audio signals that have a high auditory effect in the scene corresponding to the scene type indicator. In response to a user selection operation, the terminal device selects a target effect audio signal from the plurality of corresponding effect audio signals and pushes the target effect audio signal to the earphones, which receive the target effect audio signal fed back by the terminal device. The selection operation may be a click operation, a text input operation, or a box selection operation.

[0025] For example, the earphones include a motion detection module that detects whether or not the external scene in which the earphones are located is changing. The movement detection module in the earphones detects the displacement distance of the earphones in the external environment. If the displacement distance is greater than a predetermined distance threshold, it is considered that the external scene in which the earphones are located has changed. If the displacement distance is less than or equal to the predetermined distance threshold, it is considered that the external scene in which the earphones are located has not changed.

[0026] Furthermore, the target effect audio signal may be an audio signal representing the earphone's pass-through effect, an audio signal representing the earphone's active noise-canceling effect, or an audio signal representing both the earphone's pass-through effect and active noise-canceling effect. Therefore, the target effect audio signal is Active noise cancellation effect across the entire frequency band for audio signals, Pass-through effect audio signal across the entire frequency band, It includes at least one of a plurality of active noise-canceling effect audio signals in a plurality of first frequency bands and a plurality of pass-through effect audio signals in a plurality of second frequency bands, wherein the plurality of first frequency bands and the plurality of second frequency bands constitute the entire frequency band.

[0027] In step 206, the current frequency spectrum relationship information between the first audio signal and the second audio signal, and the target frequency spectrum relationship information between the first audio signal and the target effect audio signal are determined.

[0028] The target effect audio signal is an audio signal that has an anticipatory auditory effect. This anticipatory auditory effect is considered to be adapted to the external environment, and if the spectrogram of the second audio signal transmitted to the feedback microphone by the external sound signal closely matches the spectrogram of the target effect audio signal, then the earphones are considered to currently have an anticipatory auditory effect, and the user will experience a high auditory effect when wearing the earphones in the current external scene.

[0029] As an example, step 206 includes converting the first audio signal from the time domain to the frequency domain to obtain a first frequency spectrum signal corresponding to the first audio signal, converting the second audio signal from the time domain to the frequency domain to obtain a second frequency spectrum signal corresponding to the second audio signal, determining current frequency spectrum relationship information between the first frequency spectrum signal and the second frequency spectrum signal that represents the frequency spectrum relationship between the first audio signal and the second audio signal, and determining target frequency spectrum relationship information between the first frequency spectrum signal corresponding to the first audio signal and the third frequency spectrum signal corresponding to the target effect audio signal, wherein the target frequency spectrum relationship information represents the frequency spectrum relationship between the first audio signal and the target effect audio signal.

[0030] As an example, determining the current frequency-spectral relationship information between the first frequency-spectral signal and the second frequency-spectral signal is: This includes determining the signal ratio between the second frequency spectrum signal and the first frequency spectrum signal, and obtaining current frequency spectrum relationship information.

[0031] Specifically, the first sampling values ​​at each predetermined frequency of the first frequency spectrum signal and the second sampling values ​​at each predetermined frequency of the second frequency spectrum signal are obtained. The ratio of the second sampling value to the first sampling value at each predetermined frequency is calculated, and the ratio of the first sampling value at each predetermined frequency is obtained. This ratio of the first sampling value at each predetermined frequency can then be used as the current frequency spectrum relationship information.

[0032] As an example, determining the target frequency-spectrum relationship information between the first frequency-spectrum signal corresponding to the first audio signal and the third frequency-spectrum signal corresponding to the target effect audio signal is: This includes determining the signal ratio between the third frequency spectrum signal and the first frequency spectrum signal, and obtaining target frequency spectrum relationship information.

[0033] Specifically, the first sampling values ​​of the first frequency spectrum signal at each predetermined frequency and the third sampling values ​​of the third frequency spectrum signal at each predetermined frequency are obtained. The ratio values ​​of the third sampling values ​​and the first sampling values ​​at each predetermined frequency are calculated to obtain the second sampling value ratio values ​​at each predetermined frequency, and these second sampling value ratio values ​​at each predetermined frequency are used as the target frequency spectrum relationship information.

[0034] In step 208, the filter parameters of the earphones are adjusted based on the current frequency spectrum relation information and the target frequency spectrum relation information, and the second audio signal is collected again based on the adjusted filter parameters.

[0035] The filter parameters may also be gains at each predetermined frequency, and the amplitude of the audio signal at a predetermined frequency can be adjusted based on the gain at that frequency.

[0036] Furthermore, if the filter parameters of the earphones change, the audio signal transmitted from the external audio signal into the ear canal will also change accordingly, and therefore the second audio signal collected by the feedback microphone will also change.

[0037] As an example, step 208 includes calculating the difference between the current frequency spectrum relationship information and the target frequency spectrum relationship information to obtain frequency spectrum deviation information, and adjusting the filter parameters of the earphones based on the frequency spectrum deviation information.

[0038] In step 210, if it is determined that the error between the re-collected second audio signal and the target effect audio signal is greater than or equal to a predetermined error, the process returns to the step of collecting the first audio signal with the feedforward microphone and collecting the second audio signal with the feedback microphone until the error between the re-collected second audio signal and the target effect audio signal becomes less than the predetermined error.

[0039] The signal error between the second audio signal and the target effect audio signal may also be the frequency spectrum signal error between the second frequency spectrum signal corresponding to the second audio signal and the third frequency spectrum signal corresponding to the target effect audio signal.

[0040] As an example, step 210 includes, if it is determined that the signal error between the second audio signal re-collected by the feedback microphone and the target effect audio signal is greater than or equal to a predetermined error, re-determining the current frequency spectrum relational information and the target frequency spectrum relational signal by repeating the steps of collecting the first audio signal with the feedforward microphone and collecting the second audio signal with the feedback microphone until the error between the second audio signal re-collected by the feedback microphone and the target effect audio signal becomes smaller than the predetermined error.

[0041] Furthermore, if it is determined that the signal error between the second audio signal re-collected by the feedback microphone and the target effect audio signal is smaller than a predetermined error, the adjustment of the earphone filter parameters is completed, indicating that the adjusted filter parameters meet the requirements.

[0042] For example, current frequency-spectrum relationship information includes the ratio of the first sampled value at each predetermined frequency, and target frequency-spectrum relationship information includes the ratio of the second sampled value at each predetermined frequency. The difference between the current frequency-spectrum relationship information and the target frequency-spectrum relationship information is calculated to obtain frequency-spectrum deviation information, and the filter parameters of the earphones are adjusted based on this frequency-spectrum deviation information. This includes calculating the difference between the first sampling value ratio and the second sampling value ratio at each predetermined frequency to obtain the ratio difference value at each predetermined frequency, and using both ratio difference values ​​at each predetermined frequency as frequency spectral deviation information; searching for parameter adjustment information corresponding to the ratio difference value at each predetermined frequency based on the mapping relationship between the ratio difference value and parameter adjustment information; and adjusting the filter parameters of the earphone at each predetermined frequency based on the parameter adjustment information at each predetermined frequency.

[0043] In this embodiment, the mapping relationship between the relative value difference and the parameter adjustment information may be a fixed mapping relationship. Because there are differences in the ear canal structure and earphone wearing state of different users, after the first adjustment of the earphone filter parameters, it is usually not possible to directly adjust the perceived effect of the earphone to match the perceived effect of the target effect audio signal. However, in this embodiment, frequency spectral deviation information is continuously determined based on the first audio signal collected by the feedforward microphone and the second audio signal collected by the feedback microphone, and the adjustment of the earphone filter parameters is continuously repeated using this frequency spectral deviation information. In the process of continuously adjusting the filter parameters of the earphones, the second audio signal collected by the feedback microphone gradually approaches the target effect audio signal, finally achieving the desired earphone auditory effect. That is, the earphone auditory effect closely matches the auditory effect of the target effect audio signal. Therefore, even if there are differences in the ear canal structure and earphone wearing conditions of different users, in this embodiment, the second audio signal collected by the feedback microphone can usually be adjusted to closely match the target effect audio signal. In other words, the earphone auditory effect can be adjusted to suit the external environment in which the earphones are located, thereby improving the auditory effect after wearing the earphones.

[0044] In the above earphone control method, a first audio signal is collected by a feedforward microphone, and a second audio signal is collected by a feedback microphone. First, based on the first audio signal, the current scene type of the external scene in which the earphone is located is determined, and a target effect audio signal corresponding to the current scene type is acquired. Furthermore, current frequency spectrum relationship information representing the frequency spectrum relationship between the first audio signal and the second audio signal is determined, and target frequency spectrum relationship information representing the frequency spectrum relationship between the first audio signal and the target effect audio signal is determined. In this way, the filter parameters of the earphone are adjusted based on the current frequency spectrum relationship information and the target frequency spectrum relationship information, and this process is repeated continuously, thereby enabling the feedback microphone to... The second audio signal collected by the feedback microphone can be gradually brought closer to the target effect audio signal until the signal error between the second audio signal and the target effect audio signal is smaller than a predetermined error. In this case, the audio signal heard by the user will essentially match the target effect audio signal. Since the target effect audio signal corresponds to the current scene type of the external scene in which the earphones are located, the auditory effect of the target effect audio signal will be adapted to the external environment in which the earphones are located. In this case, the auditory effect after the user puts on the earphones will usually be almost identical to the audio effect of the target effect audio signal and adapted to the external environment in which the earphones are located. Thus, the auditory effect of the earphones will stabilize at a good level, and the auditory effect after putting on the earphones can be improved.

[0045] In one exemplary embodiment, as shown in Figure 2, adjusting the filter parameters of the earphones based on current frequency spectrum relation information and target frequency spectrum relation information includes steps 302-306.

[0046] In step 302, the deviation between the current frequency spectrum relationship information and the target frequency spectrum relationship information is calculated to obtain the first frequency spectrum deviation information.

[0047] The current frequency spectrum information may be the ratio of the first sampling value to the second sampling value at each predetermined frequency, and the target frequency spectrum information may be the ratio of the second sampling value to the first sampling value at each predetermined frequency, the first sampling value being the sampling value at a predetermined frequency in the first frequency spectrum signal corresponding to the first audio signal, the second sampling value being the sampling value at a predetermined frequency in the second frequency spectrum signal corresponding to the second audio signal, and the third sampling value being the sampling value at a predetermined frequency in the third frequency spectrum signal corresponding to the target effect audio signal.

[0048] As an example, step 302 includes calculating the difference between the first sampling value ratio and the second sampling value ratio at each predetermined frequency to obtain the ratio difference value at each predetermined frequency, and using the ratio difference value at each predetermined frequency as the first frequency spectral deviation information.

[0049] In step 304, first parameter adjustment information corresponding to the filter parameters of the earphones is determined based on a predetermined transfer function and first frequency spectral deviation information.

[0050] The predetermined transfer function may be a pre-set transfer function for when sound reproduced by the earphone's speaker is transmitted to the feedback microphone, and this predetermined transfer function is affected by the user's ear canal structure and the earphone wearing condition, the earphone wearing condition may be the degree of looseness when the earphone is worn.

[0051] As an example, step 304 includes calculating first parameter adjustment information corresponding to the filter parameters of the earphones based on a predetermined transfer function and first frequency spectral deviation information.

[0052] In one embodiment, the first parameter adjustment information includes the parameter adjustment range and the parameter adjustment direction, and the first parameter adjustment information corresponding to the filter parameters of the earphone is determined based on a predetermined transfer function and first frequency spectral deviation information. This includes determining the signal amplitude deviation of a first audio signal and a second audio signal in each predetermined frequency band based on first frequency spectral deviation information, and determining the parameter adjustment range and parameter adjustment direction of the earphone filter parameters in each predetermined frequency band based on the signal amplitude deviation and a predetermined transfer function in each predetermined frequency band.

[0053] Specifically, the deviation values ​​at each predetermined frequency in the first frequency spectrum deviation information are obtained, and the deviation value is the ratio difference between the first sampling value ratio and the second sampling value ratio at the predetermined frequency. The average value of the deviation values ​​corresponding to a predetermined frequency within each predetermined frequency band is calculated to obtain the signal amplitude deviation at each predetermined frequency band between the first frequency spectrum signal corresponding to the first audio signal and the second frequency spectrum signal corresponding to the second audio signal. Based on the signal amplitude deviation at each predetermined frequency band and a predetermined transfer function, the parameter adjustment range and parameter adjustment direction of the earphone filter parameters at each predetermined frequency band are calculated. The parameter adjustment range may be the absolute value of the first parameter adjustment information, and the parameter adjustment direction is related to the sign of the first parameter adjustment information. For example, if the value of the first parameter adjustment information is set to positive, the parameter adjustment direction is decreasing, and if the value of the first parameter adjustment information is set to negative, the parameter adjustment direction is increasing.

[0054] As an example, the specific formula for calculating the first parameter adjustment information corresponding to the filter parameters of earphones is as follows:

[0055]

number

Number

Number

Number

[0056] As can be easily understood from Equation (1), in this embodiment, the predetermined transfer function is set as a fixed value. However, due to differences in the ear canal structure and earphone wearing state of each user, there are still differences in the actual transfer function when the audio reproduced by the predetermined transfer function and the speaker of the earphone is transmitted to the feedback microphone. In the above Equation (1), H real -H target Based on the difference value of, continuously and repeatedly adjust the filter parameter. Therefore, in the adjustment iteration process, H real continuously approaches H target Finally, H real is H targetIn this case, the auditory effect perceived by the user is almost identical to the auditory effect of the target effect audio signal. Therefore, in this embodiment, the adjustment process for the auditory effect of the earphones is not affected by the user's ear canal structure or how the earphones are worn. The auditory effect of the earphones adapts to the external environment in which the earphones are located by stabilizing at a good level in the end.

[0057] As an example, the estimation process for equation (1) above is as follows:

[0058]

number

number

[0059] Subtracting equation (2) from equation (3) yields equation (1), and w k w is the filter parameter before adjustment. opt is the adjusted filter parameter, SP is a predetermined transfer function, and H real This is the audio signal collected by the feedback microphone after the external audio signal has been transmitted to the feedback microphone, i.e., the second audio signal, H targetFF is the target effect audio signal, FF is the external audio signal collected by the feedforward microphone, i.e., the first audio signal, SPK is the audio signal built into the earphones that is played back by the speaker, which may be, for example, music or a call audio signal played back by the earphones, and FB' is the audio signal that is transmitted directly to the feedback microphone without passing through the speaker and picked up by the feedback microphone. In a normal case, the external audio signal is collected by the feedforward microphone to obtain the first audio signal (FF), then the first audio signal is filtered and played back by the speaker and then transmitted to the feedback microphone. However, because earphones cannot be completely soundproofed due to material limitations, some external audio signals pass directly through the earphones and are transmitted to the feedback microphone, where they are picked up and form FB'.

[0060] In step 306, the filter parameters of the earphones are adjusted based on the first parameter adjustment information.

[0061] The earphone filter parameters may include filter parameters for each predetermined frequency band, each of which is used to filter external audio signals in each predetermined frequency band, and in one embodiment, the first parameter adjustment information may include the parameter adjustment direction and parameter adjustment range corresponding to each predetermined frequency band.

[0062] As an example, step 306 includes adjusting the filter parameters in each predetermined frequency band based on the parameter adjustment direction and parameter adjustment range corresponding to each predetermined frequency band.

[0063] In this embodiment, because there are differences in each user's ear canal structure and earphone wearing state, there is still a difference between the predetermined transfer function and the actual transfer function when the sound reproduced by the earphone's speaker is transmitted to the feedback microphone. Therefore, it is not possible to set the predetermined transfer function as a fixed value and adjust the earphone's auditory effect all at once to almost match the auditory effect of the target effect audio signal. However, because the earphone's filter parameters are adjusted continuously and iteratively based on the deviation between the current frequency spectrum relational information and the target frequency spectrum relational information, in the iterative process, the current frequency spectrum relational information continuously approaches the target frequency spectrum relational information and finally almost matches it. In this case, the auditory effect felt by the end user usually almost matches the auditory effect of the target effect audio signal. Therefore, in this embodiment, the adjustment process for the earphone's auditory effect is not affected by the user's ear canal structure and earphone wearing state, and the earphone's auditory effect stabilizes at a good level at the end, adapting to the external environment in which the earphone is located, thus improving the auditory effect after wearing the earphone.

[0064] In one embodiment, the earphone is provided with multiple feedforward microphones corresponding to multiple audio transmission directions, the first audio signal includes external audio signals from multiple audio transmission directions, the current frequency spectrum relation information includes first frequency spectrum relation information corresponding to external audio signals from multiple audio transmission directions, and the target frequency spectrum relation information includes second frequency spectrum relation information corresponding to external audio signals from multiple audio transmission directions. The filter parameters of the earphone are adjusted based on the current frequency spectrum relation information and the target frequency spectrum relation information. This includes: calculating the deviation between the first frequency spectrum relationship information and the second frequency spectrum relationship information in each sound transmission direction to obtain the second frequency spectrum deviation information in each sound transmission direction; determining the second parameter adjustment information corresponding to the filter parameters of the earphones in each sound transmission direction based on the second frequency spectrum deviation information in each sound transmission direction; and adjusting the filter parameters of the earphones in each sound transmission direction based on the second parameter adjustment information.

[0065] The earphone may be equipped with multiple feedforward microphones, which may collect external audio signals from different audio transmission directions. For example, the different audio transmission directions may be divided into left-right directions or front-back directions. The first frequency spectrum relational information may be the ratio of the first sampling value between the second sampling value and the first sampling value at each predetermined frequency in one audio transmission direction, and the second frequency spectrum relational information may be the ratio of the second sampling value between the third sampling value and the first sampling value at each predetermined frequency in one audio transmission direction.

[0066] Specifically, for the first frequency spectrum relationship information and the second frequency spectrum relationship information in each sound transmission direction, the difference between the first sampling value ratio and the second sampling value ratio at each predetermined frequency is calculated, and the ratio difference value at each predetermined frequency is obtained. This ratio difference value at each predetermined frequency in each sound transmission direction is used as the second frequency spectrum deviation information. Based on the predetermined transfer function and the second frequency spectrum deviation information in each sound transmission direction, second parameter adjustment information corresponding to the earphone filter parameters in each sound transmission direction is calculated, and the earphone filter parameters in each sound transmission direction are adjusted based on the second parameter adjustment information.

[0067] As an example, the specific calculation process for the second parameter adjustment information can be found by referring to the specific calculation process for the first parameter adjustment information described above, and therefore, the explanation is omitted here.

[0068] As an example, the filter parameters of the earphones in the audio transmission direction are adjusted based on the parameter adjustment direction and parameter adjustment range in the second parameter adjustment information.

[0069] In one embodiment, the earphone control method is: The system further includes adjusting the signal amplitude of the target effect audio signal in response to a first adjustment command.

[0070] The first adjustment command may be determined by the user touching or clicking the earphone body, or by the user operating on a terminal device connected to the earphone, and the first adjustment command is used to adjust the overall signal amplitude of the target effect audio signal, that is, to adjust the signal amplitude of each predetermined frequency band of the target effect audio signal to be generally lower or generally higher.

[0071] In one embodiment, the earphone control method is: The method further includes adjusting the signal amplitude distribution of the target effect audio signal in each predetermined frequency band in response to a second adjustment command.

[0072] The second adjustment command may be determined by the user touching or clicking the earphone body, or by the user operating on a terminal device connected to the earphone, and the second adjustment command is used to better match the target effect audio signal to the user's expectations by adjusting the frequency response characteristics of each predetermined frequency band of the target effect audio signal, for example, by choosing to adjust the frequency response characteristics of a predetermined frequency band corresponding to a human voice, human voice enhancement can be achieved, and the frequency response characteristics can represent the relationship between the amplitude and phase of the audio signal and its frequency.

[0073] In one embodiment, the earphone control method is: The system further includes adjusting the signal amplitude of the target effect audio signal in the target transmission direction in response to a third adjustment command.

[0074] The first adjustment command may be determined by the user touching or clicking the earphone body, or by the user operating on a terminal device connected to the earphone, and the third adjustment command is used to adjust the signal intensity of the target effect audio signal in the target transmission direction of the earphone, thereby enabling independent adjustment of the target effect audio signal in the target transmission direction, and thus enabling independent adjustment of the auditory effect in a single audio transmission direction of the earphone.

[0075] In one embodiment, the earphone control method is: In response to a fourth adjustment command, the system further includes adjusting the signal amplitude distribution of the target effect audio signal in each predetermined frequency band in the target transmission direction.

[0076] The fourth adjustment command may be determined by the user touching or clicking the earphone body, or by the user operating on a terminal device connected to the earphone, and the fourth adjustment command is used to better match the user's expectations of the target effect audio signal in the target transmission direction of the earphone by adjusting the frequency response characteristics of each predetermined frequency band of the target effect audio signal in the target transmission direction of the earphone, for example, by selecting to adjust the frequency response characteristics of a predetermined frequency band corresponding to a human voice in the target transmission direction alone, human voice enhancement in a single voice transmission direction can be achieved, and the frequency response characteristics can represent the relationship between the amplitude and phase of the voice signal and its frequency.

[0077] In one embodiment, the earphone control method is: The system further includes detecting the state in which the earphones are being worn in real time, and, if the state in which the earphones are being worn changes, triggering the execution of a step to determine the current frequency spectral relationship information between the first audio signal and the second audio signal, and the target frequency spectral relationship information between the first audio signal and the target effect audio signal.

[0078] The wearing state may refer to the position of the earphones or the degree of looseness when worn. In this embodiment, the wearing state of the earphones can be detected in real time. Since a change in the wearing state may affect the auditory effect of the earphones, a trigger is provided to detect the wearing state of the earphones in real time. When the earphone wearing state changes, the system triggers the execution of a step to determine the current frequency spectral relationship information between the first audio signal and the second audio signal, and the target frequency spectral relationship information between the first audio signal and the target effect audio signal, thereby adjusting the earphone's auditory effect to stabilize at a good level. In this way, even if the earphone's auditory effect is affected by changes in wearing state, the earphone can automatically adjust and trigger the execution of frequency spectral information determination, thereby optimally adjusting the earphone's auditory effect.

[0079] In this embodiment, the earphones may be configured to detect the current scene type of the external scene in which the earphones are located in real time. For example, the scene type of the external scene in which the earphones are located is detected based on at least one of the time-domain signal features and frequency-domain signal features of the first audio signal. However, in the process of detecting the scene type of the external scene in which the earphones are located based on at least one of the time-domain signal features and frequency-domain signal features of the first audio signal, it is usually necessary to use an AI model. Since this AI model requires high computational power, the power consumption of the earphones becomes excessive. Therefore, first, it is detected whether or not the scene type of the external scene in which the earphones are located is changing. If the scene type of the external scene in which the earphones are located is changing, the scene type of the external scene in which the earphones are located is detected based on at least one of the time-domain signal features and frequency-domain signal features of the first audio signal.

[0080] In one of these embodiments, the above earphone control method is: The process further includes obtaining the previously detected scene type of the earphones, determining a target detection frequency band based on the previously detected scene type, determining that the scene type of the external scene in which the earphones are located has changed if the signal amplitude change value of the first audio signal in the target detection frequency band is greater than a predetermined change threshold, and performing the step of determining the current scene type of the external scene in which the earphones are located based on the first audio signal, and determining that the scene type of the external scene in which the earphones are located has not changed if the signal amplitude change value of the first audio signal in the target detection frequency band is less than or equal to a predetermined change threshold, and determining the previously detected scene type as the current scene type of the external scene in which the earphones are located.

[0081] The target effect audio features for different scene types typically have specific audio signal distribution features in certain frequency bands, for example, the audio amplitude may match a specific audio amplitude size distribution in certain frequency bands.

[0082] Specifically, the system obtains a preceding scene type marker for the previously detected scene type of the earphones, searches for a target detection frequency band based on the preceding scene type marker, and if the signal amplitude change value of the first audio signal collected by the feedforward microphone in the target detection frequency band is greater than a predetermined change threshold, it is considered that the scene type of the external scene in which the earphones are located has changed. This triggers the execution of a step to determine the current scene type of the external scene in which the earphones are located based on the first audio signal. If the signal amplitude change value of the first audio signal collected by the feedforward microphone in the target detection frequency band is less than or equal to the predetermined change threshold, it is considered that the scene type of the external scene in which the earphones are located has not changed, and the previously detected scene type is directly determined as the current scene type of the external scene in which the earphones are located. In this way, by monitoring the change in audio amplitude in the target detection frequency band of the first audio signal based on the target detection frequency band of the previously detected scene type, it is possible to indirectly detect whether or not the scene type of the external scene in which the earphones are located has changed. This allows for a decision on whether or not to check the current scene type using the currently collected first audio signal, eliminating the need to re-detect the scene type of the external scene each time throughout the entire detection process. The detection process for the external scene in which the earphones are located is triggered only when a change in the scene type of the external scene in which the earphones are located is detected, and since the detection process for the external scene in which the earphones are located is not performed in real time, the power consumption of the earphones can be reduced.

[0083] To ensure clarity, the steps in the flowcharts for each of the above embodiments are indicated sequentially by arrows, but these steps are not necessarily performed in the order indicated by the arrows. Unless otherwise explicitly stated herein, the execution of these steps is not limited to a strict order, and these steps may be performed in other orders. Furthermore, at least some of the steps in the flowcharts for each of the above embodiments may include multiple steps or stages, and these steps or stages are not necessarily performed at the same time, but may be performed at different times, and the execution order of these steps or stages is not necessarily sequential, but may be performed sequentially or alternately with other steps or at least some of the steps or stages within other steps.

[0084] Based on a similar inventive concept, embodiments of the present application further provide an earphone control device that realizes the earphone control method described above. Since the means for solving the problems related to the device are similar to the means for solving the problems described above, the specific limitations in the one or more embodiments of the earphone control device described below can be referenced to the limitations on the earphone control method described above, and are therefore omitted from this explanation.

[0085] In one exemplary embodiment, as shown in Figure 3, an earphone control device is provided, which includes a signal acquisition module 402, a signal acquisition module 404, a frequency spectrum relation information determination module 406, a parameter adjustment module 408, and an iterative cycle module 410. The signal acquisition module 402 acquires a first audio signal using the feedforward microphone and a second audio signal using the feedback microphone. The signal acquisition module 404 determines the current scene type of the external scene in which the earphones are located based on the first audio signal, and acquires a target effect audio signal corresponding to the current scene type. The frequency spectrum relationship information determination module 406 determines the current frequency spectrum relationship information between the first audio signal and the second audio signal, and the target frequency spectrum relationship information between the first audio signal and the target effect audio signal. The parameter adjustment module 408 adjusts the filter parameters of the earphones based on the current frequency spectrum relationship information and the target frequency spectrum relationship information. The signal acquisition module 402 then acquires the second audio signal again based on the adjusted filter parameters. If the iterative loop module 410 determines that the error between the second audio signal, which has been collected again, and the target effect audio signal is greater than or equal to a predetermined error, it returns to the step of collecting the first audio signal with the feedforward microphone and collecting the second audio signal with the feedback microphone until the error between the second audio signal, which has been collected again, and the target effect audio signal is less than or equal to the predetermined error.

[0086] In one embodiment, the above signal acquisition module further includes: Audio signal features are extracted from the first audio signal described above, and the current scene type of the external scene in which the earphones are located is determined based on these audio signal features.

[0087] In one embodiment, the above signal acquisition module further includes: The previously detected scene type of the earphones is obtained, and based on the previously detected scene type, a target detection frequency band is determined. If the signal amplitude change value of the first audio signal in the target detection frequency band is greater than a predetermined change threshold, it is determined that the scene type of the external scene in which the earphones are located has changed. Based on the first audio signal, the current scene type of the external scene in which the earphones are located is determined. If the signal amplitude change value of the first audio signal in the target detection frequency band is less than or equal to a predetermined change threshold, it is determined that the scene type of the external scene in which the earphones are located has not changed, and the previously detected scene type is determined to be the current scene type of the external scene in which the earphones are located.

[0088] In one embodiment, the parameter adjustment module further includes: The deviation between the current frequency spectrum relationship information and the target frequency spectrum relationship information is calculated to obtain first frequency spectrum deviation information. Based on a predetermined transfer function and the first frequency spectrum deviation information, first parameter adjustment information corresponding to the filter parameters of the earphones is determined, and the filter parameters of the earphones are adjusted based on the first parameter adjustment information.

[0089] In one embodiment, the first parameter adjustment information includes the parameter adjustment range and the parameter adjustment direction, and in one embodiment, the parameter adjustment module further includes Based on the above first frequency spectrum deviation information, the signal amplitude deviation of the first audio signal and the second audio signal in each predetermined frequency band is determined, and based on the signal amplitude deviation in each predetermined frequency band and a predetermined transfer function, the parameter adjustment range and parameter adjustment direction of the filter parameters of the earphones in each predetermined frequency band are determined.

[0090] In one embodiment, the above-mentioned apparatus is The system further includes a signal adjustment module that adjusts the signal amplitude of the target effect audio signal in response to a first adjustment command, or adjusts the signal amplitude distribution of the target effect audio signal in each predetermined frequency band in response to a second adjustment command.

[0091] In one embodiment, the above-mentioned apparatus is The system further includes a wearing state detection module that detects the wearing state of the earphones in real time, and when the wearing state of the earphones changes, it triggers the execution of a step to determine the current frequency spectrum relationship information between the first audio signal and the second audio signal, and the target frequency spectrum relationship information between the first audio signal and the target effect audio signal.

[0092] In one embodiment, the target effect audio signal is: Active noise cancellation effect across the entire frequency band for audio signals, Pass-through effect audio signal across the entire frequency band, The system includes at least one of a plurality of active noise-canceling effect audio signals in a plurality of first frequency bands and a plurality of pass-through effect audio signals in a plurality of second frequency bands, wherein the plurality of first frequency bands and the plurality of second frequency bands constitute the entire frequency band.

[0093] In one embodiment, the earphone is provided with a plurality of feedforward microphones corresponding to a plurality of audio transmission directions, the first audio signal includes external audio signals in the plurality of audio transmission directions, the current frequency spectrum relation information includes first frequency spectrum relation information corresponding to the external audio signals in the plurality of audio transmission directions, the target frequency spectrum relation information includes second frequency spectrum relation information corresponding to the external audio signals in the plurality of audio transmission directions, and the parameter adjustment module further includes The deviation between the first frequency spectrum relationship information and the second frequency spectrum relationship information in each of the above sound transmission directions is calculated to obtain the second frequency spectrum deviation information in each of the above sound transmission directions. Based on the second frequency spectrum deviation information in each of the above sound transmission directions, the second parameter adjustment information corresponding to the filter parameters of the earphones in each of the above sound transmission directions is determined, and based on the second parameter adjustment information, the filter parameters of the earphones in each of the above sound transmission directions are adjusted accordingly.

[0094] Each module in the above-described earphone control device may be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above modules may be embedded in the processor within the earphone in hardware form or independently, or stored in the memory within the earphone in software form, in order to facilitate the processor performing operations corresponding to each of the above modules.

[0095] In one exemplary embodiment, an earphone is provided, the internal configuration diagram of which may be as shown in Figure 4. The earphone includes a feedforward microphone, a feedback microphone, a processor, memory, an input / output interface, a communication interface, a display unit, and an input device. The feedforward microphone collects external audio signals, and the feedback microphone collects audio signals within the ear canal to which the earphone is worn. The processor, memory, and input / output interface are connected via a system bus, and the communication interface, display unit, and input device are connected to the system bus via the input / output interface. The earphone's processor is used to provide computing and control capabilities. The earphone's memory includes a non-volatile storage medium and internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the execution of the operating system and computer programs in the non-volatile storage medium. The earphone's input / output interface exchanges information between the processor and external devices. The communication interface of the earphone communicates with an external terminal by wired or wireless means, and the wireless method may be implemented by Wi-Fi, mobile cellular network, Near Field Communication (NFC), or other technology. The computer program, when executed by the processor, implements an earphone control method.

[0096] As those skilled in the art will understand, the structure shown in Figure 4 is merely a block diagram of a substructure related to the solution of the present invention, and does not limit the earphones to which the solution of the present invention applies. Specific earphones may contain more or fewer components than those shown in the figure, or may be a combination of several components, or may have a different configuration of components.

[0097] In one embodiment, an earphone is provided that includes a feedforward microphone, a feedback microphone, a memory storing a computer program, and a processor, wherein the processor executes the computer program to realize the steps in each embodiment of the above method.

[0098] In one embodiment, a computer-readable storage medium is provided in which a computer program is stored, and when the computer program is executed by a processor, the steps in each embodiment of the above method are realized.

[0099] In one embodiment, a computer program product is provided that includes a computer program that, when executed by a processor, realizes the steps in each of the above embodiments of the method.

[0100] As those skilled in the art will understand, all or part of the flows in the methods of the above embodiments can be implemented by a computer program instructing the relevant hardware, and the computer program may be stored in a non-volatile computer-readable storage medium, and when the computer program is executed, it may include the flows of the embodiments of each of the above embodiments. Any reference to memory, database or other medium used in each embodiment of the present application may include at least one of non-volatile memory and / or volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM®), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM) or external cache memory, etc. For illustrative purposes only, rather than being limited, RAM may take various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database in each embodiment of this application may include at least one of relational databases and non-relational databases. Non-relational databases may include, but are not limited to, blockchain-based distributed databases.The processor in each embodiment of this application may be, but is not limited to, a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic processor, a quantum computing-based data processing logic processor, an artificial intelligence (AI) processor, or the like.

[0101] The technical features of the above embodiments can be combined in any way, and for the sake of explanation, not all possible combinations of the technical features in the above embodiments have been described. However, as long as there is no contradiction in these combinations of technical features, they should fall within the scope described in this application.

[0102] The embodiments described above merely illustrate some embodiments of the present application, and although the descriptions are specific and detailed, they should not be understood as limiting the scope of the claims of the present application. Furthermore, a person skilled in the art could make several modifications and improvements without departing from the concept of the present application, and these also fall within the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the attached claims.

Claims

1. An earphone control method applicable to earphones including feedforward microphones and feedback microphones, The steps include: collecting a first audio signal with the feedforward microphone and collecting a second audio signal with the feedback microphone; The steps include determining the current scene type of the external scene in which the earphones are located based on the first audio signal, and obtaining a target effect audio signal corresponding to the current scene type, The steps include determining the current frequency spectrum relationship information between the first audio signal and the second audio signal, and the target frequency spectrum relationship information between the first audio signal and the target effect audio signal, The steps include adjusting the filter parameters of the earphones based on the current frequency spectrum information and the target frequency spectrum information, The steps include: collecting the second audio signal again based on the adjusted filter parameters; An earphone control method characterized by: if it is determined that the error between the second audio signal re-collected and the target effect audio signal is greater than or equal to a predetermined error, the method returns to the step of collecting the first audio signal with the feedforward microphone and collecting the second audio signal with the feedback microphone until the error between the second audio signal re-collected and the target effect audio signal becomes less than the predetermined error.

2. The steps include obtaining the scene type previously detected by the earphone, and determining the target detection frequency band based on the previously detected scene type, If the signal amplitude change value of the first audio signal in the target detection frequency band is greater than a predetermined change threshold, it is determined that the scene type of the external scene in which the earphones are located has changed, and the step of determining the current scene type of the external scene in which the earphones are located based on the first audio signal is performed. The method according to claim 1, further comprising the steps of: determining that the scene type of the external scene in which the earphones are located does not change if the signal amplitude change value of the first audio signal in the target detection frequency band is less than or equal to a predetermined change threshold, and determining the previously detected scene type as the current scene type of the external scene in which the earphones are located.

3. The step of determining the current scene type of the external scene in which the earphones are located, based on the first audio signal, The steps include extracting audio signal features from the first audio signal, The method according to claim 1, comprising the step of determining the current scene type of the external scene in which the earphones are located, based on the aforementioned audio signal characteristics.

4. The step of adjusting the filter parameters of the earphones based on the current frequency spectrum relationship information and the target frequency spectrum relationship information is: The steps include: calculating the deviation between the current frequency spectrum relationship information and the target frequency spectrum relationship information to obtain first frequency spectrum deviation information; A step of determining first parameter adjustment information corresponding to the filter parameters of the earphone based on a predetermined transfer function and the first frequency spectrum deviation information, The method according to claim 1, comprising the step of adjusting the filter parameters of the earphones based on the first parameter adjustment information.

5. The first parameter adjustment information includes a parameter adjustment range and a parameter adjustment direction, and the step of determining the first parameter adjustment information corresponding to the filter parameters of the earphone based on a predetermined transfer function and the first frequency spectrum deviation information is: A step of determining the signal amplitude deviation of the first audio signal and the second audio signal in each predetermined frequency band based on the first frequency spectral deviation information, The method according to claim 4, comprising the step of determining the parameter adjustment range and parameter adjustment direction of the filter parameters of the earphone in each of the predetermined frequency bands based on the signal amplitude deviation and predetermined transfer function in each of the predetermined frequency bands.

6. Steps to adjust the signal amplitude of the target effect audio signal in response to a first adjustment command, Alternatively, the method according to claim 1, further comprising the step of adjusting the signal amplitude distribution in each predetermined frequency band of the target effect audio signal in response to a second adjustment command.

7. A step of detecting the wearing status of the aforementioned earphones in real time, The method according to claim 1, further comprising the step of triggering the execution of a step to determine the current frequency spectrum relationship information between the first audio signal and the second audio signal, and the target frequency spectrum relationship information between the first audio signal and the target effect audio signal, when the wearing state of the earphones changes.

8. The aforementioned target effect audio signal is Active noise cancellation effect across the entire frequency band for audio signals, Pass-through effect audio signal across the entire frequency band, The method according to claim 1, characterized in that it includes at least one of a plurality of active noise-canceling effect audio signals in a plurality of first frequency bands and a plurality of pass-through effect audio signals in a plurality of second frequency bands, wherein the plurality of first frequency bands and the plurality of second frequency bands constitute the entire frequency band.

9. The earphone is provided with a plurality of feedforward microphones corresponding to a plurality of sound transmission directions, the first audio signal includes external sound signals in the plurality of sound transmission directions, the current frequency spectrum relation information includes first frequency spectrum relation information corresponding to the external sound signals in the plurality of sound transmission directions, and the target frequency spectrum relation information includes second frequency spectrum relation information corresponding to the external sound signals in the plurality of sound transmission directions. The step of adjusting the filter parameters of the earphones based on the current frequency spectrum relationship information and the target frequency spectrum relationship information is: The steps include: calculating the deviation between the first frequency spectrum relationship information and the second frequency spectrum relationship information in each of the aforementioned sound transmission directions, and obtaining the second frequency spectrum deviation information in each of the aforementioned sound transmission directions; The steps include determining second parameter adjustment information corresponding to the filter parameters of the earphone in each of the aforementioned sound transmission directions based on the second frequency spectral deviation information in each of the aforementioned sound transmission directions, The method according to claim 1, comprising the step of adjusting the filter parameters of the earphones in each of the sound transmission directions based on each of the second parameter adjustment information.

10. An earphone comprising a feedforward microphone, a feedback microphone, a memory storing a computer program, and a processor, wherein the processor, upon executing the computer program, performs the steps of the method according to any one of claims 1 to 9.

Images