Headset noise processing method, device and headset

Abstract

The present embodiments provide a headset noise processing method, device, and headset for implementing a desired effect based on a user's request. The headset has at least two functions of ANC, HT, or AH. The headset includes a first microphone and a second microphone. The first microphone is configured to collect a first signal. The first signal represents a sound in a current external environment. The second microphone is configured to collect a second signal. The second signal represents an environmental sound in the ear canal of a user wearing the headset. The headset may be a left earphone or a right earphone. The processing modes or processing intensities of the left earphone and the right earphone may be the same or different. The headset obtains a target mode, which may be determined based on a scene type of the current external environment, and obtains a second audio signal based on the target mode, the first signal, and the second signal. The target mode is determined based on the scene type of the external environment, so that the auditory perception effect can be optimized in real time for the user.

Description

[Technical field]

[0001] [CROSS REFERENCE TO RELATED APPLICATIONS] This application claims priority to Chinese Patent Application No. 202010623983.X, entitled “HEADSET NOISE PROCESSING METHOD, APPARATUS AND HEADSET,” filed with the State Intellectual Property Office of the People's Republic of China on June 30, 2020, the entire contents of which are incorporated herein by reference.

[0002] TECHNICAL FIELD Embodiments of the present application relate to the field of audio processing technology, and in particular to a headset noise processing method, device and headset. [Background technology]

[0003] In recent years, the number of headset users has increased, and users' requirements for headset functions are becoming more and more diverse. For example, if a user does not want to hear external noise when wearing a headset, the user can use the active noise control (ANC) function to block noise from the ears. Some users want to hear sounds outside the headset. Some users need to use the environmental sound hear through (HT) function to hear sounds as if the user was not wearing a headset. Some users may have hearing loss. The augment hearing (AH) function can be used to send desired external signals to the user and filter out undesired signals.

[0004] However, currently headsets cannot implement desired effects based on user requests. Summary of the Invention

[0005] The embodiments of the present application provide a headset noise processing method, apparatus and headset to implement desired effects based on user requirements.

[0006] According to a first aspect, an embodiment of the present application provides a headset noise processing method. The headset has at least two functions of an active noise control ANC function, an environmental sound hear-through HT function, or an aural enhancement AH function. The headset includes a first microphone and a second microphone. The first microphone is configured to collect a first signal. The first signal is indicative of a sound in a current external environment. The second microphone is configured to collect a second signal. The second signal is indicative of an environmental sound in an ear canal of a user wearing the headset. The headset can be a left earphone or a right earphone. The left earphone and the right earphone can use the same processing mode or different processing modes. The headset receives a first audio signal from a terminal device, obtains a target mode (the target mode is determined based on a scene type of the current external environment, the target mode instructs the headset to perform a target processing function, the target processing function being one of an active noise control ANC function, an environmental sound hear-through HT function, or an aural enhancement AH function), and obtains a second audio signal based on the target mode, the first audio signal, the first signal, and the second signal.

[0007] According to the above method, the target mode is determined based on the scene type of the external environment, so that the auditory sensory effect can be optimized in real time for the user.

[0008] In a possible design, the headset further comprises a speaker, the speaker being configured to reproduce the second audio signal.

[0009] In a possible design, when the target processing function is an ANC function, the second audio signal played by the speaker can attenuate the user's perception of sounds in the current user environment and the environmental sounds in the user's ear canal, when the target processing function is an HT function, the second audio signal played by the speaker can enhance the user's perception of sounds in the current user environment, or when the target processing function is an AH function, the second audio signal played by the speaker can enhance the user's perception of event sounds, where the event sounds fill a pre-set spectrum.

[0010] It should be understood that when the left earphone uses the ANC mode, the audio signal reproduced by the speaker of the left earphone can attenuate the user's left ear sensing of sounds in the current user environment (i.e., sounds in the current external environment) and the environmental sounds in the user's left ear canal. When the right earphone uses the ANC mode, the audio signal reproduced by the speaker of the right earphone can attenuate the user's right ear sensing of sounds in the current user environment (i.e., sounds in the current external environment) and the environmental sounds in the user's right ear canal. Similarly, for the HT and AH modes, the left ear sensing depends on the processing mode of the left earphone, and the right ear sensing depends on the processing mode of the right earphone.

[0011] In a possible design, when the target processing function is an ANC function, the second audio signal is obtained based on the first audio signal, the third signal and the fourth signal, where the third signal is an anti-phase signal of the first signal and the fourth signal is an anti-phase signal of the second signal; when the target processing function is an HT function, the second audio signal is obtained based on the first audio signal, the first signal and the second signal; or when the target processing function is an AH function, the second audio signal is obtained based on the first audio signal, the fifth signal and the fourth signal, where the fifth signal is an event signal in the first signal, where the event signal indicates a specific sound in the current external environment, and the event signal meets a preset spectrum.

[0012] The above design provides a simple and effective way of acquiring the signal output by the speaker in different processing modes.

[0013] In a possible design, obtaining the target mode includes receiving a first control command from the terminal device, the first control command holding the target mode, and the target mode being determined by the terminal device based on a scene type of the current external environment.

[0014] In the above design, the target mode is determined by the terminal device based on the scene type of the external environment and indicates the headset, so that the auditory sensing effect can be optimized in real time for the user.

[0015] In a possible design, a second control command is received from the terminal device, the second control command holding a target processing strength, the target processing strength indicating a processing strength to be used when the headset performs the target processing function. Obtaining the second audio signal based on the target mode, the first audio signal, the first signal and the second signal includes obtaining the second audio signal based on the target mode, the target processing strength, the first audio signal, the first signal and the second signal.

[0016] According to the above design, the terminal device indicates the processing strength of the headset in the corresponding processing mode, and the processing strength is adjusted based on the processing mode to further improve the user's hearing perception.

[0017] In a possible design, a target event corresponding to an event sound in the current external environment is determined based on the first signal, and a target processing strength in a target mode is determined based on the target event, where the target processing strength indicates a processing strength to be used when the headset performs a target processing function. Obtaining a second audio signal based on the target mode, the first audio signal, the first signal, and the second signal includes obtaining a second audio signal based on the target mode, the target processing strength, the first audio signal, the first signal, and the second signal. Different processing strengths correspond to different events. The processing strengths correspond one-to-one to the events, or one processing strength corresponds to multiple events. For example, the same processing strength may be used for two events, and different processing strengths may not be used for the same event.

[0018] According to the above design, the headset determines the processing strength based on the event sound in the external environment to implement different hearing perception in different external environments, which can reduce background noise and enhance noise control strength.

[0019] In a possible design, the headset further includes a bone conduction sensor configured to collect a bone conduction signal generated by vibration of the user's vocal cords. Identifying the first scene in which the user is currently located based on the first signal includes identifying the first scene in which the user is currently located based on the first signal and the bone conduction signal.

[0020] In possible designs, the target event is a howling event, a wind noise event, an emergency event, or a voice event.

[0021] In a possible design, obtaining the target mode includes identifying a scene type of the current external environment as a target scene type (simply referred to as a target scene or target type) based on the first signal, and determining a target mode of the headset based on the target scene, where the target mode is a processing mode corresponding to the target scene. Different processing modes correspond to different scene types. The processing modes may correspond one-to-one to scene types, or one processing mode may correspond to multiple scene types. For example, the same processing mode may be used for two scene types.

[0022] In the above design, the headset determines its processing mode based on the identified scene type, resulting in reduced latency and optimized hearing perception for the user in real time.

[0023] In a possible design, the target scene is one of a walking scene, a running scene, a quiet scene, a multi-person talking scene, a cafe scene, a subway scene, a train scene, a waiting room scene, a dialogue scene, an office scene, an outdoor scene, a driving scene, a strong wind scene, an airplane scene, an alarm scene, a horn scene, and a crying scene.

[0024] In a possible design, the method further comprises: sending instruction information to the terminal device, the instruction information holding the target mode; and receiving a third control signal from the terminal device, the third control signal including a target processing strength in the target mode, the target processing strength indicating a processing strength to be used when the headset performs the target processing function. Obtaining the second audio signal based on the target mode, the first audio signal, the first signal, and the second signal includes obtaining the second audio signal based on the target mode, the target processing strength, the first audio signal, the first signal, and the second signal.

[0025] In the above design, the headset determines the processing mode and indicates the processing mode to the terminal device, so that the terminal device adjusts the processing intensity, thereby reducing the processing resources occupied by the headset.

[0026] In a possible design, when the target processing function is an ANC function, a greater target processing strength indicates weaker user detection of sounds in the current user environment and environmental sounds in the user's ear canal, when the target processing function is an HT function, a greater target processing strength indicates stronger user detection of sounds in the current user environment, or when the target processing function is an AH function, a greater target processing strength indicates stronger user detection of event sounds included in sounds in the current user environment.

[0027] In a possible design, the target mode instructs the headset to perform an ANC function. The target mode, the first audio signal, and obtaining the second audio signal based on the first signal and the second signal include performing a first filtering process (e.g., feed-forward FF filtering) on ​​the first signal to obtain a first filtered signal, filtering out the first audio signal included in the second signal to obtain a first filtered signal, performing an audio mixing process on the first filtered signal and the filtered signal to obtain a third audio signal, performing a third filtering process (e.g., feedback FB filtering) on ​​the third audio signal to obtain a fourth audio signal, and performing an audio mixing process on the fourth audio signal and the first audio signal to obtain the second audio signal.

[0028] In the above design, the ANC processing is implemented in the manner of FF filtering and FB serial processing to obtain a better denoised signal and enhance the noise control effect.

[0029] In a possible design, the filtering coefficients used for the first filtering process are filtering coefficients associated with a target processing strength for the first filtering process in the case of an ANC function, or the filtering coefficients used for the third filtering process are filtering coefficients associated with a target processing strength for the third filtering process in the case of an ANC function.

[0030] In the above design, instead of a fixed filtering coefficient, different filtering coefficients are used in the case of different processing strengths, thereby implementing a better ANC effect and improving the user's hearing perception.

[0031] In a possible design, the target mode instructs the headset to perform a HT function. The target mode, the first audio signal, obtaining a second audio signal based on the first signal and the second signal includes performing a first signal processing on the first signal to obtain a first processed signal, where the first signal processing includes a second filtering processing (e.g., HT filtering), performing an audio mixing processing on the first processed signal and the first audio signal to obtain a fifth audio signal, filtering out the fifth audio signal included in the second signal to obtain a second filtered signal, performing a third filtering processing (e.g., FB filtering) on ​​the second filtered signal to obtain a third filtered signal, and performing an audio mixing processing on the third filtered signal and the fifth audio signal to obtain the second audio signal.

[0032] Before the fifth audio signal included in the second signal is filtered out, a filtering compensation process may also be performed on the fifth audio signal to reduce the auditory perception loss. In the above design, a downlink audio mixing process and a filtering compensation process are performed during HT filtering to further reduce the auditory perception loss.

[0033] In a possible design, performing a first signal processing on the first environmental signal to obtain a processed environmental signal includes performing a second filtering process on the first signal to obtain a second filtered signal, and performing a second signal processing on the second filtered signal to obtain a second processed signal.

[0034] The second signal processing includes a blocking effect elimination process.

[0035] According to the above design, the blocking effect cancellation process is performed on the signal obtained through HT filtering, so that the user can hear the environmental sound more clearly.

[0036] In a possible design, the second signal processing further includes at least one of background noise control processing, wind noise control processing, gain adjustment processing, or frequency response adjustment processing.

[0037] The second signal processing described above reduces background noise and extraneous sounds and improves the user's hearing perception.

[0038] In a possible design, the filtering coefficients used for the second filtering process are filtering coefficients associated with a target processing strength for the second filtering process in the case of HT functionality, or the filtering coefficients used for the third filtering process are filtering coefficients associated with a target processing strength for the third filtering process in the case of HT functionality.

[0039] In a possible design, the target mode instructs the headset to perform an AH function. The target mode, the first audio signal, and obtaining the second audio signal based on the first signal and the second signal include performing a second filtering process (e.g., HT filtering) on ​​the first signal to obtain a second filtered signal, performing an enhancement process on the second filtered signal to obtain a filtered enhanced signal, performing a first filtering process (e.g., FF filtering) on ​​the first signal to obtain a first filtered signal, performing an audio mixing process on the filtered enhanced signal and the first audio signal to obtain a sixth audio signal, filtering out the sixth audio signal included in the second signal to obtain a fourth filtered signal, performing a third filtering process (e.g., FB filtering) on ​​the fourth filtered signal to obtain a fifth filtered signal, and performing an audio mixing process on the fifth filtered signal, the sixth audio signal, and the first filtered signal to obtain the second audio signal.

[0040] In the above design, active noise control and ambient sound hear-through are implemented in parallel. The hear-through filtering and enhancement processes make the hear-through signal clearer.

[0041] Optionally, before filtering out the sixth audio signal included in the second signal to obtain a fourth filtered signal, a filtering compensation process is performed on the sixth audio signal, so as to avoid the loss caused by FB filtering and to maximally ensure that the hear-through signal is not distorted.

[0042] In a possible design, performing an enhancement process on the second filtered signal to obtain a filtered-enhanced signal includes performing a blocking effect elimination process on the second filtered signal, and performing a noise control process on the signal obtained through the blocking effect elimination process, where the noise control process includes an artificial intelligence AI noise control process and / or a wind noise control process, and performing a gain amplification process and a frequency response adjustment on the signal obtained through the noise control process to obtain a filtered-enhanced signal.

[0043] In the above design, enhancement processing is performed on the hear-through signal, which improves the user's perception of external desired sounds.

[0044] In a possible design, the headset includes a bone conduction sensor configured to collect a bone conduction signal of a headset user, and performing a gain amplification process on the signal obtained through the noise control process includes performing a harmonic expansion on the bone conduction signal to obtain a harmonic expanded signal, performing an amplification process on the signal obtained through the noise control process based on a first gain factor, and filtering out the harmonic expanded signal included in the signal obtained through the amplification process based on a fourth filtering factor, the fourth filtering factor being determined based on the first gain factor.

[0045] In the above design, an amplification method is provided that amplifies only specific sounds other than the wearer's voice in order to improve the effect of specific sounds in the hear-through environmental sound.

[0046] In a possible design, the first gain factor is a gain factor associated with a target processing strength in a target mode.

[0047] In a possible design, performing an enhancement process on the second filtered signal to obtain a filtered-enhanced signal includes performing a blocking effect de-blocking process on the second filtered signal to obtain a de-blocked signal, performing audio event detection on the de-blocked signal to obtain an audio event signal in the de-blocked signal, and performing a gain amplification process and a frequency response adjustment on the audio event signal in the de-blocked signal to obtain the filtered-enhanced signal.

[0048] In a possible design, the headset further includes a bone conduction sensor configured to collect a bone conduction signal of the headset user. Performing a gain amplification process on the audio event signal in the deblocked signal includes performing a harmonic extension on the bone conduction signal to obtain a harmonic extended signal, performing amplification on the audio event signal in the deblocked signal based on a second gain factor to obtain an amplified signal, and filtering out the harmonic extended signal in the amplified signal based on a second filtering factor. The second filtering factor is determined based on the second gain factor.

[0049] In a possible design, the second gain coefficient is a gain coefficient associated with a target processing strength for the first filtering process when the first noise processing is performed, or the second gain coefficient is a gain coefficient associated with a first scene identifier for the first filtering process when the first noise processing is performed.

[0050] In a possible design, the filtering coefficient used for the first filtering process is a filtering coefficient associated with a target processing strength for the first filtering process in the case of an AH function, the filtering coefficient used for the second filtering process is a filtering coefficient associated with a target processing strength for the second filtering process in the case of an AH function, or the filtering coefficient used for the third filtering process is a filtering coefficient associated with a target processing strength for the third filtering process in the case of an AH function.

[0051] In a possible design, the headset further includes a bone conduction sensor, the bone conduction sensor being configured to collect a bone conduction signal of the headset user. Performing a blocking effect cancellation process on the second filtered signal includes determining a first audio harmonic signal that matches the bone conduction signal from an audio harmonic set, the audio harmonic set including a plurality of audio harmonic signals, and removing the first audio harmonic signal from the second filtered signal and amplifying high frequency components in the second filtered signal from which the first audio harmonic signal has been removed, or performing an adaptive filtering process on the second filtered signal to remove low frequency components in the second filtered signal to obtain a third filtered signal and amplifying high frequency components in the third filtered signal from which the low frequency components have been removed.

[0052] According to a second aspect, an embodiment of the present application provides a mode control method. The method is applied to a terminal device. The method includes: when a scene type of a current external environment is identified as a target scene, determining a target mode based on the target scene, the target mode being one of processing modes supported by the headset, the processing modes supported by the headset including at least two of an active noise control ANC mode, an environmental sound hear-through HT mode, or a hearing enhancement AH mode; and transmitting the target mode to the headset, the target mode instructing the headset to implement a processing function corresponding to the target mode. Different processing modes correspond to different scene types. The processing modes may correspond one-to-one to the scene types, or one processing mode may correspond to multiple scene types. For example, the same processing mode may be used for two scene types.

[0053] In the above design, the terminal device controls the processing mode of the headset in real time based on scene identification, so that the hearing perception is optimized for the user in real time.

[0054] In a possible design, when a target mode corresponding to a target scene in the processing modes of the headset is determined, the method further comprises displaying result prompt information, the result prompt information being used to prompt the user to cause the headset to implement a processing function corresponding to the target mode. In such a design, the user can determine the current processing mode of the headset in real time.

[0055] In a possible design, before the first control signal is sent to the headset, the method further includes a step of displaying selection prompt information, the selection prompt information being used to prompt the user whether to adjust the processing mode of the headset to the target mode, and a step of detecting an operation by the user to select adjusting the processing mode of the headset to the target mode.

[0056] In the above design, users can decide whether to adjust the processing mode of the headset based on their requirements, which will improve the user experience.

[0057] In a possible design, a first control and a second control are displayed. Different positions of the second control on the first control indicate different processing strengths in the target mode. Before the first control signal is sent to the headset, the method further includes: responding to a user's manipulation of touching and holding the second control and moving it to a first position on the first control, where the first position of the second control on the first control indicates a target processing strength in the target mode; and sending the target processing strength to the headset, where the target processing strength indicates a processing strength to be used when the headset implements a processing function corresponding to the target mode. In the above design, a user may select a processing strength of the headset based on the requirement to meet different requirements of the user.

[0058] In a possible design, the first control is ring-shaped, and when the user touches and holds the second control and moves it in a clockwise direction over the first control, the processing intensity in the target mode increases, or when the user touches and holds the second control and moves it in a counterclockwise direction over the first control, the processing intensity in the target mode increases.

[0059] In a possible design, the first control is bar-shaped. When the user touches and holds the second control and moves from top to bottom on the first control, the processing intensity in the target mode increases. When the user touches and holds the second control and moves from bottom to top on the first control, the processing intensity in the target mode increases. When the user touches and holds the second control and moves from left to right on the first control, the processing intensity in the target mode increases. Or, when the user touches and holds the second control and moves from right to left on the first control, the processing intensity in the target mode increases.

[0060] In a possible design, when the target processing function is an ANC function, a greater target processing strength indicates weaker user detection of sounds in the current user environment and environmental sounds in the user's ear canal, when the target processing function is an HT function, a greater target processing strength indicates stronger user detection of sounds in the current user environment, or when the target processing function is an AH function, a greater target processing strength indicates stronger user detection of event sounds included in sounds in the current user environment.

[0061] It should be noted that the left and right earphones may use the same processing mode and the same processing strength, and thus the user's left ear sensing and the user's right ear sensing may be the same. The left and right earphones may alternatively use different processing modes or different processing strengths, and thus the user's left ear sensing and the user's right ear sensing are different.

[0062] According to a third aspect, an embodiment of the present application provides a mode control method. The method is applied to a terminal device. The method includes: acquiring a target mode, the target mode being one of processing modes supported by a headset, the processing modes supported by the headset including at least two of an active noise control (ANC) mode, an ambient sound (HT) mode, or a hearing enhancement (AH) mode; determining a target processing strength in the target mode based on a scene type of a current external environment, where different scene types correspond to different processing strengths in the target mode; and transmitting the target processing strength to the headset, where the target processing strength indicates a processing strength to be used when the headset implements a processing function corresponding to the target mode.

[0063] In a possible design, obtaining the target mode comprises receiving the target mode transmitted by the headset or displaying a selection control, the selection control including processing modes supported by the headset, and detecting a user action of selecting the target mode from the processing modes of the headset by using the selection control, where the selection control includes processing modes supported by the headset, which means that the selection control provides options of processing modes supported by the headset or the selection control displays processing modes supported by the headset, and the user may select from the processing modes supported by the headset.

[0064] In a possible design, before determining a target processing intensity in the target mode based on a scene type of the current external environment, the method further comprises: if the target mode transmitted by the headset is received, displaying selection prompt information, the selection prompt information being used to prompt a user whether to adjust the processing mode of the headset to the target mode; and detecting an operation by the user to select adjusting the processing mode of the headset to the target mode.

[0065] In a possible design, when the target processing function is an ANC function, a greater target processing strength indicates weaker user detection of sounds in the current user environment and environmental sounds in the user's ear canal, when the target processing function is an HT function, a greater target processing strength indicates stronger user detection of sounds in the current user environment, or when the target processing function is an AH function, a greater target processing strength indicates stronger user detection of event sounds included in sounds in the current user environment.

[0066] According to a fourth aspect, an embodiment of the present application provides a mode control method, the method being applied to a terminal device. The method includes: displaying a first interface, the first interface including a first selection control, the first selection control including a processing mode supported by a first target earphone and a processing intensity corresponding to the processing mode supported by the first target earphone, the processing mode of the first target earphone including at least two of an active noise control (ANC) mode, an ambient sound (HT) mode, or a hearing enhancement (AH) mode; responding to a first operation performed by a user on the first interface, the first operation being generated when the user selects a first target mode from the processing modes supported by the first target earphone by using the first selection control and selects a processing intensity in the first target mode as a first target processing intensity; and transmitting the first target mode and the first target processing intensity to the first target earphone, the first target mode instructing the first target earphone to implement a processing function corresponding to the first target mode, and the first target processing intensity indicating a processing intensity to be used when the first target earphone implements the processing function corresponding to the first target mode.

[0067] The first selection control includes a processing mode supported by the first target earphone and a processing strength corresponding to the processing mode supported by the first target earphone, which means that the first selection control provides the user with an option of multiple processing modes (all supported by the first target earphone) and an adjustment item of the processing strength in each processing mode.

[0068] In the above design, a user can freely switch between the processing modes and intensities corresponding to the headset effects desired by the user by using the UI to meet the users' different requirements.

[0069] In a possible design, before displaying the first interface, the method further includes a step of displaying selection prompt information, where the selection prompt information is used to prompt a user whether to adjust the processing mode of the first target earphone, and a step of detecting an operation by the user to select adjusting the processing mode of the first target earphone.

[0070] In the above design, the user may decide whether to adjust the current processing mode based on the requirements.

[0071] In a possible design, before displaying the first interface, the method further comprises a step of identifying a scene type of the current external environment as a target scene, the target scene being adapted to the scene type for which the processing mode of the first target earphone needs to be adjusted.

[0072] In the above design, the first interface is actively popped up in certain scenes, which reduces the user's manual operation process.

[0073] In a possible design, before displaying the first interface, the method further comprises identifying that the terminal device triggers the first target earphone to play audio. Identifying that the terminal device triggers the first target earphone to play audio may be described as identifying that the terminal device starts transmitting an audio signal to the first target earphone.

[0074] In the above design, the first interface is actively popped up, which reduces the user's manual operation process.

[0075] In a possible design, before displaying the first interface, the method further comprises detecting that the terminal device establishes a connection with the first target earphone.

[0076] In the above design, the first interface is actively popped up, which reduces the user's manual operation process.

[0077] In a possible design, before displaying the first interface, the method further comprises detecting a second operation performed by a user on a home screen when it is detected that the terminal device establishes a connection with the first target earphone. The home screen includes an icon of the first application. The second operation is generated when the user touches the icon of the first application. The first interface is a display interface of the first application.

[0078] In a possible design, the first selection control includes a first control and a second control. Any two different positions of the second control on the first control indicate two different processing modes of the first target earphone, or any two different positions of the second control on the first control indicate different processing strengths in a same processing mode of the first target earphone. The first operation is generated when the user moves a first position of the second control on the first control in an area corresponding to the first target mode. The first position corresponds to a first target processing strength in the first target mode.

[0079] In a possible design, the first control is ring-shaped or bar-shaped.

[0080] For example, the first control is ring-shaped. The ring includes at least two arc segments. The second control located on different arc segments indicates different processing modes for the first target earphone. Different locations of the second control on the same arc segment indicate different processing intensities for the same processing mode for the first target earphone.

[0081] In another example, the first control is in the shape of a bar. The bar includes at least two bar segments. The second controls located on different bar segments indicate different processing modes of the first target earphone. Different positions of the second controls on the same bar segment indicate different processing intensities for the same processing mode of the first target earphone.

[0082] In a possible design, the method further comprises responding to a third operation performed by a user on the first interface, the first interface further comprising a second selection control, the second selection control comprising a processing mode supported by the second target earphone and a processing strength corresponding to the processing mode supported by the second target earphone, the processing modes supported by the second target earphone comprising at least two of an active noise control (ANC) mode, an ambient sound (HT) mode, or a hearing enhancement (AH) mode, the third operation being a user selecting a processing strength of the second target earphone by using the second selection control. the second target earphone is the right earphone when the first target earphone is the left earphone, or the second target earphone is the left earphone when the first target earphone is the right earphone; and transmitting the second target mode and the second target processing intensity to the second target earphone, wherein the second target mode instructs the second target earphone to implement a processing function corresponding to the second target mode, and the second target processing intensity indicates a processing intensity to be used when the second target earphone implements the processing function corresponding to the second target mode.

[0083] In the above design, the user can separately operate the processing mode and processing strength of the left earphone and the right earphone to meet the user's different requirements for left-ear and right-ear hearing sensing.

[0084] According to a fifth aspect, an embodiment of the present application further provides a noise processing device. The device is applied to a headset. The headset has at least two functions of an active noise control (ANC) function, an environmental sound hear-through (HT) function, or a hearing enhancement (AH) function. The headset includes a first microphone and a second microphone. The first microphone is configured to collect a first signal. The first signal is indicative of a sound in a current external environment. The second microphone is configured to collect a second signal. The second signal is indicative of an environmental sound in an ear canal of a user wearing the headset.

[0085] The noise processing device includes corresponding functional modules respectively configured to implement steps in the aforementioned method in the first aspect. For details, please refer to the detailed description of the method example. Details will not be described again here. The functions may be implemented by hardware or by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the aforementioned functions. For example, the noise processing device includes a communication module configured to receive a first audio signal from a terminal device, an acquisition module configured to acquire a target mode, where the target mode is determined based on a scene type of a current external environment, and the target mode instructs the headset to perform a target processing function, where the target processing function is one of an active noise control ANC function, an environmental sound hear-through HT function, or a hearing enhancement AH function, and a first processing module configured to acquire a second audio signal based on the target mode, the first audio signal, the first signal, and the second signal.

[0086] According to a sixth aspect, an embodiment of the present application provides a target headset including a left earphone and a right earphone, the left earphone configured to implement the method according to the first aspect or any one of the designs of the first aspect, or the right earphone configured to implement the method according to the first aspect or any one of the designs of the first aspect.

[0087] In a possible design, the left and right earphones use different processing modes.

[0088] According to a seventh aspect, an embodiment of the present application provides a target headset. The target headset includes a left earphone and a right earphone. The left or right earphone includes a first microphone, a second microphone, a processor, a memory, and a speaker. The first microphone is configured to collect a first signal. The first signal is indicative of a sound in a current external environment. The second microphone is configured to collect a second signal. The second signal is indicative of an environmental sound in an ear canal of a user wearing the headset. The memory is configured to store a program or instructions. The processor is configured to invoke the program or instructions to enable the electronic device to perform the method according to any of the designs of the first aspect to obtain the second audio signal. The speaker is configured to play the second audio signal.

[0089] According to an eighth aspect, an embodiment of the present application provides a mode control device. The device is applied to a terminal device. The device includes corresponding functional modules respectively configured to implement steps in the aforementioned methods in the second to fourth aspects. For details, please refer to the detailed description of the method example. Details will not be described again here. The functions may be implemented by hardware, or may be implemented by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the aforementioned functions.

[0090] According to a ninth aspect, an embodiment of the present application provides a terminal device comprising a memory, a processor and a display. The display is configured to display an interface. The memory is configured to store a program or instructions. The processor is configured to invoke the program or instructions to enable the terminal device to perform the steps of the methods in the second to fourth aspects.

[0091] According to a tenth aspect, the present application provides a computer readable storage medium. The computer readable storage medium stores a computer program or instructions. When the computer program or instructions are executed by a headset, the headset is enabled to perform the method of the first aspect or any one of the possible designs of the first aspect.

[0092] According to an eleventh aspect, the present application provides a computer readable storage medium, the computer readable storage medium storing a computer program or instructions, which when executed by a terminal device, enables the headset to execute a method in any one of the possible designs of the second to fourth aspects.

[0093] According to a twelfth aspect, the present application provides a computer program product. The computer program product includes a computer program or instructions. When the computer program or instructions are executed by the headset, the method of the first aspect or any one of the possible implementations of the first aspect is implemented.

[0094] According to a thirteenth aspect, the present application provides a computer program product. The computer program product includes a computer program or instructions. When the computer program or instructions are executed by the headset, a method in any possible implementation of the second to fourth aspects is implemented.

[0095] For the technical effects that can be achieved in any one of the fifth to thirteenth aspects, please refer to the description of the beneficial effects in the first to fourth aspects, and the details will not be described again here. [Brief description of the drawings]

[0096] [Figure 1] FIG. 1 is a schematic diagram of a hardware structure of a terminal device 100 according to an embodiment of the present application.

[0097] [Diagram 2]1 is a schematic diagram of a software structure of a terminal device 100 according to an embodiment of the present application;

[0098] [Diagram 3] 2 is a schematic diagram of the structure of a headset 200 according to an embodiment of the present application.

[0099] [Figure 4] FIG. 1 is a schematic diagram of the AHA pathway according to an embodiment of the present application.

[0100] [Figure 5A] 1 is a flowchart of an ANC process according to an embodiment of the present application.

[0101] [Figure 5B] 1 is a schematic flow chart of an ANC process according to an embodiment of the present application.

[0102] [Figure 6A] 1 is a flow chart of HT processing according to an embodiment of the present application.

[0103] [Figure 6B] 1 is a schematic flow chart of HT processing according to an embodiment of the present application;

[0104] [Figure 6C] 1 is a schematic flow chart of another HT process according to an embodiment of the present application;

[0105] [Figure 7] 2 is a schematic flow chart of a blocking effect resolution process according to an embodiment of the present application;

[0106] [Figure 8A] 1 is a flow chart of AH processing according to an embodiment of the present application;

[0107] [Figure 8B] 1 is a schematic flow chart of AH processing according to an embodiment of the present application;

[0108] [Figure 8C] 4 is a schematic flowchart of another AH processing according to an embodiment of the present application;

[0109] [Figure 9] 4 is a schematic flow chart of a noise control process according to an embodiment of the present application;

[0110] [Figure 10] 2 is a schematic flow chart of a gain amplification process according to an embodiment of the present application;

[0111] [Figure 11] 4 is a schematic flow chart of another gain amplification process according to an embodiment of the present application;

[0112] [Figure 12A] FIG. 2 is a schematic diagram of a home screen of a terminal device according to an embodiment of the present application;

[0113] [Figure 12B] FIG. 2 is a schematic diagram of a control interface of a headset application according to an embodiment of the present application.

[0114] [Figure 12C] FIG. 2 is a schematic control diagram of a terminal device controlling a headset in ANC mode according to an embodiment of the present application.

[0115] [Figure 12D] 2 is a schematic control diagram of a terminal device controlling a headset in HT mode according to an embodiment of the present application; FIG.

[0116] [Figure 12E] FIG. 2 is a schematic control diagram of a terminal device controlling a headset in an AH mode according to an embodiment of the present application;

[0117] [Figure 12F] FIG. 2 is a schematic diagram of a selection control according to an embodiment of the present application.

[0118] [Figure 12G] FIG. 2 is a schematic diagram of another selection control according to an embodiment of the present application.

[0119] [Figure 12H] FIG. 2 is a schematic diagram of triggering a headset control interface according to an embodiment of the present application.

[0120] [Figure 13] FIG. 13 is a schematic diagram of yet another selection control according to an embodiment of the present application.

[0121] [Figure 14A] FIG. 2 is a schematic diagram of enabling control of smart scene detection functionality according to an embodiment of the present application.

[0122] [Figure 14B] FIG. 13 is another schematic diagram of enabling control of the smart scene detection feature according to an embodiment of the present application.

[0123] [Figure 14C] FIG. 2 is a schematic diagram of a headset control interface according to an embodiment of the present application.

[0124] [Figure 15] FIG. 2 is a schematic diagram of event detection according to an embodiment of the present application;

[0125] [Figure 16] FIG. 2 is a schematic diagram of the interaction between a terminal device and a headset in terms of processing modes and processing strengths according to an embodiment of the present application;

[0126] [Figure 17A] FIG. 2 is a schematic diagram of displaying scene detection results according to an embodiment of the present application;

[0127] [Figure 17B]FIG. 13 is a schematic diagram of displaying another scene detection result according to an embodiment of the present application;

[0128] [Figure 18] FIG. 2 is a schematic diagram of scene detection according to an embodiment of the present application;

[0129] [Figure 19] 19 is a schematic diagram of the structure of a noise processing device 1900 according to an embodiment of the present application.

[0130] [Figure 20] 2 is a schematic diagram of the structure of a mode control device 2000 according to an embodiment of the present application.

[0131] [Figure 21] 21 is a schematic diagram of the structure of a mode control device 2100 according to an embodiment of the present application.

[0132] [Figure 22] 22 is a schematic diagram of the structure of a mode control device 2200 according to an embodiment of the present application.

[0133] [Figure 23] FIG. 23 is a schematic diagram of the structure of a terminal device 2300 according to an embodiment of the present application. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0134] Hereinafter, the embodiments of the present application will be described in detail with reference to the accompanying drawings. The terms used in the embodiments of the present application are only used to describe certain embodiments of the present application, and are not intended to limit the present application. It is clear that the described embodiments are only a part, not all, of the embodiments of the present application. All other embodiments obtained by those skilled in the art based on the embodiments of the present application without creative efforts shall be included in the protection scope of the present application.

[0135] In the following, first, some terms in the embodiments of the present application will be explained and described to facilitate understanding by those skilled in the art.

[0136] (1) An application (app) in the embodiments of the present application is a software program that can implement one or more specific functions. Generally, multiple applications, such as a camera application, a mailbox application, and a headset control application, can be installed on a terminal device. The applications referred to in the following description may be system applications installed on the terminal device before delivery, or third-party applications downloaded from the Internet or obtained from another terminal device by a user when using the terminal device.

[0137] (2) bark subband

[0138] The human hearing system has a masking effect. In other words, a strong sound interferes with the alignment of human perception of a weak sound occurring simultaneously in a nearby area, and the basilar membrane of the cochlea has a frequency selection and tuning function for the incoming sound signal from the outside. Therefore, in order to measure the sound frequency from the viewpoint of perception, the concept of critical frequency bands is introduced. It is generally believed that there are 24 critical frequency bands at the hearing threshold of 22Hz to 22kHz, which cause vibrations at different positions of the basilar membrane. Each critical frequency band is called a bark subband.

[0139] (3) Voice activity detection (VAD) VAD is used to pinpoint the beginning and end points of noisy speech. Since speech contains long periods of silence, the silence is separated from the actual speech. This is the first processing of the voice data.

[0140] (4) In the embodiments of the present application, "at least one (item)" means one (item) or multiple (items), and "multiple (items)" means two (items) or more (items). The term "and / or" describes a correspondence to describe associated objects and indicates that three relationships may exist. For example, A and / or B may represent the following three cases: only A is present, both A and B are present, and only B is present. Each of A and B may be singular or plural. The character " / " generally represents an "or" relationship between associated objects. "At least one of the following items" or similar expressions indicate any combination of these items, including any combination of a single item or multiple items. For example, at least one item of a, b, or c may represent a, b, c, ab, ac, bc, or abc, where a, b, and c may be singular or plural. In the present application, the symbol (a, b) represents an open interval greater than a and less than b, [a, b] represents a closed interval greater than a and less than b, (a, b] represents a half-open semi-closed interval greater than a and less than b, and (a, b] represents a half-open semi-closed interval greater than a and less than b. In addition, unless otherwise specified, in the embodiments of the present application, ordinals such as "first" and "second" are intended to distinguish between multiple objects, but are not intended to limit the size, content, order, chronological order, priority, importance, or the like, of the multiple objects. For example, a first microphone and a second microphone are simply used to distinguish between different microphones, but do not indicate different sizes, priorities, degrees of importance, or the like, of the two microphones.

[0141] An embodiment of the present application provides a system. The system includes a terminal device 100 and a headset 200. The terminal device 100 is connected to the headset 200. The connection can be a wireless connection or a wired connection. In the case of a wireless connection, for example, the terminal device can be connected to the headset by using Bluetooth technology, wireless fidelity (Wi-Fi technology), infrared IR technology, or ultra-wideband technology.

[0142] In this embodiment of the present application, the terminal device 100 is a device having a display interface function. The terminal device 100 may be, for example, a product having a display interface, such as a mobile phone, a display, a tablet computer, or an in-vehicle device, and a wearable product having an intelligent display, such as a smart watch or a smart band. The specific form of the mobile terminal is not particularly limited in this embodiment of the present application.

[0143] The headset 200 includes two sound generating units mounted on the ears. The device fitted to the left ear can be called a left earphone, and the device fitted to the right ear can be called a right earphone. From the viewpoint of wearing, the headset 200 in this embodiment of the present application can be a head-mounted headset, an ear-mounted headset, a neck-mounted headset, an earplug headset, or the like. The earplug headset further includes an in-ear headset (also called an ear canal headset) or a half in-ear headset. The headset 200 has at least two of the ANC function, the HT function, and the AH function. For ease of description, in this embodiment of the present application, the ANC, the HT, and the AH are collectively called AHA, and may naturally have other names. This is not limited in the present application.

[0144] An in-ear headset is used as an example. The left and right earphones have a similar structure. Both the left and right earphones may use the headset structure described below. The headset structure (left or right earphone) includes a rubber sleeve that can be inserted into the ear canal, an ear bag close to the ear, and a headset pole that hangs over the ear bag. The rubber sleeve guides sound to the ear canal. The ear bag includes components such as a battery, a speaker, and a sensor. A microphone and a physical button may be located on the headset pole. The headset pole may be a cylinder, a cube, an ellipse, or the like. The microphone located in the ear may be called an error microphone. The microphone located outside the headset is called a reference microphone. The error microphone is configured to collect sounds in the external environment. The reference microphone collects environmental sounds in the ear canal of the user wearing the headset when the user is wearing the headset. The two microphones may be analog microphones or digital microphones. After the user wears the headset, the two microphones and the speaker are located in the following positions. The error microphone is placed in the ear and near the rubber sleeve of the headset. The speaker is located between the error microphone and the reference microphone. The reference microphone is near the external structure of the ear and may be placed on the top of the headset pole. The error microphone's pipeline may face the speaker or may face the inside of the ear canal. A hole in the headset is provided near the reference microphone and is configured to allow sounds in the external environment to enter the reference microphone.

[0145] In this embodiment of the present application, the terminal device 100 is configured to transmit downlink audio signals and / or control signals to the headset 200. For example, the control signals are used to control a processing mode of the headset 200. The processing mode of the headset 200 may include at least two of a null mode indicating that no processing is being performed, an ANC mode indicating that an ANC function is implemented, an HT mode indicating that an HT function is implemented, or an AH mode indicating that an AH function is implemented.

[0146] When the headset uses the ANC mode, the user's perception of the sound in the current external environment and the environmental sound in the ear canal of the user wearing the headset can be weakened. When the headset uses the HT mode, the user's perception of the sound in the current external environment can be enhanced. When the headset uses the AH mode, the user's perception of the event sound included in the sound in the current external environment can be enhanced. The event sound is a preset sound in the external environment, or the event sound meets a preset spectrum. For example, if the event sound includes a station announcement sound or a whistle sound in a train station, the event sound meets the spectrum of the station announcement sound or the spectrum of the whistle sound in a train station. In another example, the event sound may include a notification sound in an airplane terminal building, a broadcast sound on an airplane, and, as another example, a call sound in a hotel.

[0147] It should be understood that the headset 200 includes a left earphone and a right earphone. The left earphone and the right earphone may use the same processing mode or different processing modes. When the left earphone and the right earphone use the same processing mode, the user's hearing sense may be the same at the left ear wearing the left earphone and the right ear wearing the right earphone. When the left earphone and the right earphone use different processing modes, the user's hearing sense is different at the left ear wearing the left earphone and the right ear wearing the right earphone. For example, the left earphone uses ANC and the right earphone uses AH. When the left earphone uses the ANC mode, the user's left ear sense of the sound in the current external environment and the environmental sound in the ear canal of the left ear of the user wearing the headset can be weakened. When the right earphone uses the AH mode, the user's right ear sense of the event sound included in the sound in the current external environment can be enhanced.

[0148] The processing mode of the headset may be determined in any one of the following possible ways:

[0149] In a first possible manner, the terminal device 100 provides a control interface so that the user selects the processing mode of the headset 200 based on the requirements. For example, the terminal device 100 is instructed by the user operation to send a control signal to the headset 200. The control signal indicates the processing mode of the headset 200.

[0150] It should be noted that the left and right earphones in headset 200 may use the same processing mode or different processing modes. For example, a selection control in the control interface is used to select the same processing mode for the left and right earphones. In another example, the control interface may include two selection controls, one selection control is used to select the processing mode for the left earphone and the other selection control is used to select the processing mode for the right earphone. The control interface and selection controls are described in detail in the following description and will not be described again in detail here.

[0151] In a second possible manner, the terminal device identifies the scene type of the user's current external environment. In different scenes, the headset 200 uses different processing modes. In other words, the processing functions implemented by the headset are different.

[0152] In a third possible manner, the headset 200 identifies a user action and determines that the headset 200 selected by the user uses the ANC mode, the HT mode, or the AH mode. For example, the user action may be a user tapping the headset. Alternatively, buttons are arranged on the headset, and different buttons indicate different processing modes.

[0153] In a fourth possible scheme, the headset identifies scene types in the headset's external environment, and the headset uses different processing modes in different scenes.

[0154] The first to fourth possible schemes will be described in detail later, and will not be described in detail again here.

[0155] FIG. 1 is a schematic diagram of an optional hardware structure of a terminal device 100.

[0156] The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) port 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display 194, a subscriber identity module (SIM) card interface 195, and the like. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, an optical proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0157] It may be understood that the structure shown in this embodiment of the present application does not constitute a specific limitation on the terminal device 100. In some other embodiments of the present application, the terminal device 100 may include more or fewer parts than those shown in the figure, may combine some parts, may divide some parts, or may have a different component arrangement. The components shown in the figure may be implemented by hardware, software, or a combination of software and hardware.

[0158] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be separate components or may be integrated into one or more processors.

[0159] The controller can generate an operation control signal according to the instruction operation code and the time series signal to complete the control of reading the instruction and executing the instruction.

[0160] A memory may also be disposed in the processor 110 and configured to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has used or is repeatedly using. If the processor 110 needs to use the instructions or data again, the processor may retrieve the instructions or data directly from the memory, thereby avoiding repeated accesses and reducing the wait time of the processor 110 and improving system efficiency.

[0161] In some embodiments, the processor 110 may include one or more interfaces, which may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, and / or the like.

[0162] The I2C interface is a bidirectional synchronous serial bus, and includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be separately coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 may be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface to implement the touch function of the terminal device 100.

[0163] The I2S interface may be configured to perform audio communication. In some embodiments, the processor 110 may include multiple groups of I2S buses. The processor 110 may be coupled to the audio module 170 via the I2S bus and implement communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may implement a function of sending an audio signal through the I2S interface to the wireless communication module 160 to answer a call through the headset 200 (e.g., a Bluetooth headset).

[0164] The PCM interface may also be configured to perform audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, audio module 170 may be coupled to wireless communication module 160 through a PCM bus interface. In some embodiments, audio module 170 may also implement the functionality of sending audio signals to wireless communication module 160 through the PCM interface to answer a call through Bluetooth headset 200. Both the I2S interface and the PCM interface may be used for audio communication.

[0165] The UART interface is a universal serial data bus and is configured to perform asynchronous communication. The bus may be a bidirectional communication bus. The bus converts data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is generally configured to connect the processor 110 to the wireless communication module 160. For example, the processor 110 communicates with a Bluetooth module in the wireless communication module 160 through the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 may send audio signals to the wireless communication module 160 through the UART interface to implement a functionality of playing music through the Bluetooth headset 200.

[0166] The MIPI interface may be configured to connect the processor 110 to a peripheral component such as a display 194 or a camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI), etc. In some embodiments, the processor 110 communicates with the camera 193 through the CSI interface to implement an image capture function of the terminal device 100. The processor 110 communicates with the display 194 through the DSI interface to implement a display function of the terminal device 100.

[0167] The GPIO interface may be configured in software. The GPIO interface may be configured as a control signal or a data signal. In some embodiments, the GPIO interface may be configured to connect the processor 110 to the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, or the like. The GPIO interface may alternatively be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, or the like.

[0168] The USB port 130 is a port conforming to the USB standard specification, and may be specifically a mini USB port, a micro USB port, or a USB Type-C port or the like. The USB port 130 may be used to connect to a charger to charge the terminal device 100, or may be used to transmit data between the terminal device 100 and a peripheral device, or may be configured to connect to the headset 200 to play audio through the headset 200. The interface may alternatively be used to connect to another terminal device, for example an AR device.

[0169] It may be understood that the interface connection relationships between modules in this embodiment of the present application are merely examples for explanation, and do not constitute limitations on the structure of the terminal device 100. In some other embodiments of the present application, the terminal device 100 may alternatively use an interface connection method different from the above embodiment, or may use a combination of multiple interface connection methods.

[0170] The charging management module 140 is configured to receive a charging input from a charger. The charger may be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 may receive the charging input of the wired charger through the USB port 130. In some embodiments of wireless charging, the charging management module 140 may receive the wireless charging input through a wireless charging coil of the terminal device 100. When charging the battery 142, the charging management module 140 may further provide power to the terminal device by using the power management module 141.

[0171] The power management module 141 is configured to connect the battery 142 and the charging management module 140 to the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the internal memory 121, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may further be configured to monitor parameters such as battery capacity, battery cycle count, and battery health (leakage and impedance). In some other embodiments, the power management module 141 may alternatively be located in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 may alternatively be located in the same component.

[0172] The wireless communication function of the terminal device 100 may be implemented by using an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, a modem processor, a baseband processor, and the like.

[0173] Antenna 1 and Antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna in the terminal device 100 may be configured to cover one or more communication frequency bands. Different antennas may be further multiplexed to improve antenna utilization. For example, Antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antennas may be used in combination with tuning switches.

[0174] The mobile communication module 150 may provide wireless communication solutions including 2G / 3G / 4G / 5G or the like, which are applied to the terminal device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 may receive electromagnetic waves through the antenna 1, perform processing such as filtering or amplification on the received electromagnetic waves, and send the electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 may further amplify the modulated signal by the modem processor and convert the signal to electromagnetic waves for emission through the antenna 1. In some embodiments, at least some functional modules in the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 may be disposed in the same device as at least some modules of the processor 110.

[0175] The modem processor may include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the low-frequency baseband signal obtained through demodulation to the baseband processor for processing. The low-frequency baseband signal is processed by the baseband processor and then transmitted to the application processor. The application processor outputs a sound signal by using an audio device (not limited to a speaker 170A or a receiver 170B or the like) or displays an image or video by using a display 194. In some embodiments, the modem processor may be an independent component. In some other embodiments, the modem processor may be independent from the processor 110 and be located as the same device with the mobile communication module 150 or another functional module.

[0176] The wireless communication module 160 may provide wireless communication solutions applied to the terminal device 100, including wireless local area network (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC) technology, infrared (IR) technology, or the like. The wireless communication module 160 may be one or more components integrating at least one communication processor module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may further receive signals to be transmitted from the processor 110, perform frequency modulation and amplification on the signals, and convert the signals into electromagnetic waves for radiation through the antenna 2. For example, the wireless communication module 160 may include a Bluetooth module, and the terminal device 100 may establish a wireless connection with the headset 200 by using Bluetooth. In another example, the wireless communication module 160 may include an infrared module, and the terminal device 100 may establish a wireless connection with the headset 200 by using the infrared module.

[0177] In some embodiments, in the terminal device 100, the antenna 1 and the mobile communication module 150 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the terminal device 100 can communicate with a network and other devices by using a wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, IR technology, and / or the like. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a BeiDou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite-based augmentation system (SBAS).

[0178] The terminal device 100 implements display functions by using a GPU, a display 194, an application processor, and the like. The GPU is a microprocessor for image processing and is connected to the display 194 and the application processor. The GPU is configured to perform mathematical and geometric calculations and render images. The processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0179] The display 194 is configured to display images, videos, and the like. The display 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini-LED, a micro-LED, a micro-OLED, a quantum dot light-emitting diode (QLED), or the like. In some embodiments, the terminal device 100 may include one or N1 displays 194, where N1 is a positive integer greater than 1.

[0180] The terminal device 100 may implement image capture functionality by using an ISP, a camera 193, a video codec, a GPU, a display 194, an application processor, and the like.

[0181] The ISP is configured to process data fed back by the camera 193. For example, during capture, the shutter is pressed and light is sent through the lens to the camera's photosensitive elements. The light signal is converted into an electrical signal, which is then sent to the ISP for processing to convert the electrical signal into a visible image. The ISP may further perform algorithmic optimization on noise, brightness, and color of the image. The ISP may further optimize parameters such as exposure and color temperature of the scene being captured. In some embodiments, the ISP may be located within the camera 193.

[0182] The camera 193 is configured to capture still images or video. An optical image of an object is generated through a lens and projected onto a photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts an optical signal into an electrical signal, which is then sent to the ISP for converting the electrical signal into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard format, such as RGB or YUV. In some embodiments, the processor 110 may trigger the camera 193 based on a program or instruction in the internal memory 121, so that the camera 193 captures at least one image, and correspondingly processes the at least one image based on the program or instruction. In some embodiments, the terminal device 100 may include 1 or N2 cameras 193, where N2 is a positive integer greater than 1.

[0183] The digital signal processor is configured to process digital signals and may process other digital signals in addition to the digital image signal. For example, when the terminal device 100 selects a frequency, the digital signal processor is configured to perform a Fourier transform on the frequency energy.

[0184] A video codec is configured to compress or decompress digital video. The terminal device 100 may support one or more video codecs. Thus, the terminal device 100 may play or record video in multiple encoding formats, for example, moving picture experts group (MPEG-1, MPEG-2, MPEG-3, and MPEG-4).

[0185] The NPU is a neural network (NN) processing unit. The NPU can quickly process input information by referring to the structure of biological neural networks, such as the transfer mode between human brain cells, and can also continuously perform self-learning. The NPU can implement applications such as intelligent recognition of the terminal device 100, such as image recognition, face recognition, voice recognition, and text understanding.

[0186] The external memory interface 120 may be configured to connect to an external memory card, such as a micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and video are stored in the external storage card.

[0187] The internal memory 121 may be configured to store computer executable program code. The executable program code includes instructions. The internal memory 121 may include a program storage area and a data storage area. The program storage area may store an operating system, an application required by at least one function (e.g., a camera application), and the like. The data storage area may store data created during use of the terminal device 100 (such as images captured by a camera), and the like. In addition, the internal memory 121 may include a high-speed random access memory, or may include at least one disk storage device, a flash memory, or a non-volatile memory such as a universal flash storage (UFS). The processor 110 executes instructions stored in the internal memory 121 and / or instructions stored in a memory located in the processor to perform various functional applications and data processing of the terminal device 100. The internal memory 121 may further store a downlink audio signal provided in this embodiment of the present application. The internal memory 121 may further store code used to implement a function to control the headset 200. When the code stored in the internal memory 121 and used to implement the function of controlling the headset 200 is executed by the processor 110, the headset 200 is controlled to implement the corresponding function, for example, the ANC function, the HT function, or the AH function. Of course, the code for controlling the function of the headset 200 provided in this embodiment of the present application can alternatively be stored in an external memory. In this case, the processor 110 can execute the corresponding data used to control the function of the headset 200, stored in the external memory, by using the external memory interface 120, to control the headset 200 and implement the corresponding function.

[0188] The terminal device 100 may implement audio functions such as playing or recording music through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset jack 170D, an application processor, and the like.

[0189] Audio module 170 is configured to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. Audio module 170 may further be configured to encode and decode audio signals. In some embodiments, audio module 170 may be located in processor 110, or some functional modules in audio module 170 may be located in processor 110.

[0190] The speaker 170A is also called a "loudspeaker" and is configured to convert an audio electrical signal into a sound signal. The terminal device 100 can use the speaker 170A to listen to music in a hands-free mode or answer a call.

[0191] The receiver 170B, also referred to as an "earphone," is configured to convert an audio electrical signal into a sound signal. When answering a call or receiving voice information by using the terminal device 100, the receiver 170B can be brought close to a person's ear to hear the voice.

[0192] The microphone 170C, also referred to as a "mike" or "mic", is configured to convert a sound signal into an electrical signal. When making a call or sending a voice message, a user may emit a sound near the microphone 170C through the user's mouth and input the sound signal into the microphone 170C. At least one microphone 170C may be disposed in the terminal device 100. In some other embodiments, two microphones 170C may be disposed in the terminal device 100 to collect sound signals and implement a noise control function. In some other embodiments, three, four or more microphones 170C may alternatively be disposed in the terminal device 100 to collect sound signals, implement noise control, identify sound sources, implement directional recording functions, and the like.

[0193] The headset jack 170D is configured to connect to a wired headset. When the headset 200 provided in this embodiment of the present application is a wired headset, the terminal device 100 is connected to the headset through the headset jack 170D. The headset jack 170D may be a USB port 130, or may be a 3.5mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0194] The pressure sensor 180A is configured to detect a pressure signal and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display 194. There are multiple types of pressure sensor 180A, for example, a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, etc. The capacitive pressure sensor may include at least two parallel plates made of a conductive material. When a force is applied to the pressure sensor 180A, a capacitance between the electrodes changes. The terminal device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is performed on the display 194, the terminal device 100 detects the intensity of the touch operation by using the pressure sensor 180A. The terminal device 100 may also calculate a touch position based on the detection signal of the pressure sensor 180A. In some embodiments, each touch operation performed at the same touch position but with a different strength of the touch operation may correspond to a different operation command. For example, when a touch operation with a touch operation intensity smaller than a first pressure threshold is performed on an SMS message application icon, an instruction to display an SMS message is executed. When a touch operation is performed on the SMS message application icon, where the touch operation has an intensity equal to or greater than a first pressure threshold, instructions are executed to compose a new SMS message.

[0195] The gyro sensor 180B may be configured to determine the motion attitude of the terminal device 100. In some embodiments, the angular velocity of the terminal device 100 around three axes (i.e., x, y, and z axes) may be determined by using the gyro sensor 180B. The gyro sensor 180B may be configured to implement image stabilization during shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle at which the terminal device 100 shakes, and calculates the distance that the lens module needs to compensate based on the angle, allowing the lens to offset the shaking of the terminal device 100 through a reverse movement, thereby implementing image stabilization. The gyro sensor 180B may also be used in navigation situations and physical game situations.

[0196] The air pressure sensor 180C is configured to measure air pressure. In some embodiments, the terminal device 100 calculates altitude by using the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

[0197] The magnetic sensor 180D includes a Hall sensor. The terminal device 100 may detect the opening and closing of the flip cover by using the magnetic sensor 180D. In some embodiments, when the terminal device 100 is a flip-type phone, the terminal device 100 may detect the opening and closing of the flip cover based on the magnetic sensor 180D. Furthermore, a function such as automatic unlocking of the flip cover is set based on the detected opening and closing state of the leather case or the detected opening and closing state of the flip cover.

[0198] The acceleration sensor 180E can detect the magnitude of acceleration of the terminal device 100 in various directions (usually three axes). The magnitude and direction of gravity can be detected when the terminal device 100 is stationary. The acceleration sensor 180E can further be configured to identify the orientation of the terminal device, and is applied to applications such as switching between landscape mode and portrait mode or a pedometer.

[0199] The distance sensor 180F is configured to measure distance. The terminal device 100 may measure distance by infrared or laser. In some embodiments, in a shooting scene, the terminal device 100 may measure distance by using the range sensor 180F and implement rapid focusing.

[0200] The optical proximity sensor 180G may include, for example, a light-emitting diode (LED) and a photodetector, such as a photodiode. The light-emitting diode may be an infrared light-emitting diode. The terminal device 100 uses the light-emitting diode to emit infrared light outward. The terminal device 100 uses the photodiode to detect infrared reflected light from a nearby object. When sufficient reflected light is detected, it is determined that there is an object near the terminal device 100. When insufficient reflected light is detected, the terminal device 100 may determine that there is no object near the terminal device 100. By using the optical proximity sensor 180G, the terminal device 100 may detect that a user holds the terminal device 100 close to the ear to make a call, and automatically perform screen off to save power. The optical proximity sensor 180G may also be used in leather case mode or pocket mode to automatically perform screen unlock or lock.

[0201] The ambient light sensor 180L is configured to detect ambient light brightness. In some embodiments, the terminal device 100 may determine an exposure time of an image based on the brightness of the ambient light sensed by the ambient light sensor 180L. In some embodiments, the terminal device 100 may adaptively adjust the brightness of the display 194 based on the brightness of the sensed ambient light. The ambient light sensor 180L may be configured to automatically adjust the white balance during shooting. The ambient light sensor 180L may further cooperate with the optical proximity sensor 180G to detect whether the terminal device 100 is in a pocket to prevent accidental touch.

[0202] The fingerprint sensor 180H is configured to collect a fingerprint. The terminal device 100 may use the collected fingerprint characteristics to implement fingerprint-based unlocking, application lock access, fingerprint-based photography, fingerprint-based phone answering, and the like.

[0203] The temperature sensor 180J is configured to detect temperature. In some embodiments, the terminal device 100 executes a temperature processing policy by using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the terminal device 100 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In some other embodiments, when the temperature is lower than another threshold, the terminal device 100 heats the battery 142 to avoid an abnormal shutdown of the terminal device 100 caused by a low temperature. In some other embodiments, when the temperature is still lower than another threshold, the terminal device 100 increases the output voltage of the battery 142 to avoid an abnormal shutdown caused by a low temperature.

[0204] The touch sensor 180K may also be referred to as a "touch component." The touch sensor 180K may be disposed on the display 194, and the touch sensor 180K and the display 194 may constitute a touch screen, also referred to as a "touch screen." The touch sensor 180K is configured to detect a touch operation performed on or near the touch sensor. The touch sensor may forward the detected touch operation to an application processor to determine a type of touch event. A visual output regarding the touch operation may be provided through the display 194. In some other embodiments, the touch sensor 180K may alternatively be disposed on the surface of the terminal device 100 at a location different from the display 194.

[0205] The bone conduction sensor 180M may obtain a vibration signal. In some embodiments, the bone conduction sensor 180M may obtain a vibration signal of the vibrating bone of the vocal cord part of the person. The bone conduction sensor 180M may also contact the pulse of the body to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M may also be disposed in a headset to realize a bone conduction headset. The audio module 170 may obtain a voice signal through analysis based on the vibration signal of the vibrating bone of the vocal cord part obtained by the bone conduction sensor 180M, and implement a voice function. The application processor may analyze heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M, and implement a heart rate detection function.

[0206] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The terminal device 100 may receive the button input and generate button signal inputs related to user settings and function control of the terminal device 100.

[0207] The motor 191 may generate a vibration prompt. The motor 191 may be configured to provide an incoming vibration prompt and touch vibration feedback. For example, touch operations performed in different applications (e.g., taking a photo and playing audio) may correspond to different vibration feedback effects. The motor 191 may also correspond to different vibration feedback effects for touch operations performed on different regions of the display 194. Also, different application scenes (e.g., time reminder, information reception, alarm clock, and games) may correspond to different vibration feedback effects. The touch vibration feedback effects may be further customized.

[0208] Indicator 192 may be an indicator light and may be configured to indicate charging status and power changes, or may be configured to indicate messages, missed calls, notifications, and the like.

[0209] The SIM card interface 195 is configured to be connected to a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to implement contact or separation with the terminal device 100. The terminal device 100 may support 1 or N3 SIM card interfaces, where N3 is a positive integer greater than 1. The SIM card interface 195 may support a nano SIM card, a micro SIM card, a SIM card, etc. Multiple cards may be inserted into the same SIM card interface 195 at the same time. The multiple cards may be of the same type or different types. The SIM card interface 195 may be compatible with different types of SIM cards. The SIM card interface 195 may also be compatible with an external storage card. The terminal device 100 interacts with the network by using a SIM card to implement functions such as calling and data communication. In some embodiments, the terminal device 100 uses an eSIM card, i.e., an embedded SIM card. The eSIM card may be integrated into the terminal device 100 and cannot be separated from the terminal device 100.

[0210] The software system of the terminal device 100 may use a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. In the embodiment of the present application, the Android system having a layered architecture is used as an example to describe the software structure of the terminal device 100.

[0211] FIG. 2 is a block diagram of the software structure of the terminal device 100 according to an embodiment of the present application.

[0212] In a layered architecture, software is divided into layers, each with a distinct role and task. The layers communicate with each other through software interfaces. In some embodiments, the Android® system is divided into four layers, from top to bottom: application layer, application framework layer, Android® runtime and system libraries, and kernel layer. The application layer may include a set of application packages.

[0213] As shown in FIG. 2, the application package may include applications such as camera, gallery, calendar, phone, map, navigation, WLAN, Bluetooth, music, video, and messaging.

[0214] The application framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0215] As shown in FIG. 2, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, and a notification manager.

[0216] A window manager is configured to manage window programs and may perform tasks such as getting the size of the display, determining if there is a status bar, performing screen locking, and taking screenshots.

[0217] Content providers are configured to store and retrieve data and make the data accessible by application programs. Data may include video, images, audio, calls made and answered, browsing history and bookmarks, address books, etc.

[0218] The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system can be configured to build application programs. A display interface can include one or more views. For example, a display interface that includes an SMS message notification icon can include a text display view and an image display view.

[0219] The telephony manager is configured to provide management of communication functions of the terminal device 100, such as call status (including answering, rejecting, or the like).

[0220] The resource manager provides various resources, such as localized strings, icons, images, layout files, and video files, to application programs.

[0221] The notification manager may be configured to enable application programs to display notification information in the status bar and to convey notification messages. The notification manager may disappear automatically after a short delay without requiring user interaction. For example, the notification manager may be configured to notify of download completion, provide message notifications, etc. The notification manager may alternatively be a notification that appears in the status bar at the top of the system in the form of a graph or scrollbar text, e.g., a notification of an application running on the background, or a notification that appears on the screen in the form of a dialog window. For example, text information is displayed in the status bar, an announcement is provided, the terminal device vibrates, or an indicator light flashes.

[0222] The Android runtime includes a kernel library and a virtual machine, and is responsible for scheduling and managing the Android system.

[0223] The kernel library includes two parts: the functions that need to be called in the Java language, and the Android kernel library.

[0224] The application layer and the application framework layer execute on a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is configured to implement functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0225] The system library may include multiple functional modules, such as a surface manager, a media library, a 3D graphics processing library (eg, OpenGL ES), and a 2D graphics engine (eg, SGL).

[0226] The surface manager is configured to manage the display subsystem and provide a blend of 2D and 3D layers for multiple applications.

[0227] The media library supports playback and recording of multiple commonly used audio and video formats, as well as still image files. The media library can support multiple audio and video encoding formats, such as MPEG-4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0228] The 3D graphics processing library is configured to implement 3D graphics drawing, image rendering, compositing, layer processing, and the like.

[0229] The 2D graphics engine is a drawing engine for 2D drawing.

[0230] The kernel layer is a layer between the hardware and the software, and includes at least a display driver, a camera driver, an audio driver, a headset driver, and a sensor driver.

[0231] In the following, an example of the operation procedures of the software and hardware of the terminal device 100 will be described with reference to the scene of capturing and playing audio.

[0232] When the touch sensor 180K receives a touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into an original input event (including information such as the touch coordinates and timestamp of the touch operation). The original input event is stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer and identifies a control corresponding to the input event. For example, the touch operation is a touch tap operation, and the control corresponding to the tap operation is a control of an audio application icon. The audio application calls an interface in the application framework layer to launch a headset and control the application, and then calls the kernel layer to launch a headset driver, send an audio signal to the headset, and play the audio signal by using the headset 200.

[0233] 3 is a schematic diagram of an optional hardware structure of a headset 200. The headset 200 includes a left earphone and a right earphone. The left earphone and the right earphone have a similar structure. Structurally, the headset (including the left earphone and the right earphone) includes a first microphone 301, a second microphone 302, and a third microphone 303. The headset may further include a processor 304 and a speaker 305. It should be understood that the headset described later may be interpreted as a left earphone or a right earphone.

[0234] The first microphone 301 is configured to collect sounds in the current external environment. The first microphone 301 may also be called a reference microphone. When the user wears the headset, the first microphone 301 is located outside the headset, or the first microphone 301 is located outside the ear. When the user wears the headset, the second microphone 302 collects environmental sounds in the user's ear canal. The second microphone 302 may also be called an error microphone. When the user wears the headset, the second microphone 302 is located inside the headset or near the ear canal. The third microphone 303 is configured to collect speech signals. The third microphone 303 may be located outside the headset. When the user wears the headset, the third microphone 303 is closer to the user's mouth than the first microphone 301.

[0235] It should be noted that the first microphone 301 is configured to collect sounds in the current external environment, which may be described as sounds in the external environment in which the user is wearing the headset. For example, on a train, the sounds in the external environment are sounds in the environment around the user wearing the headset. The first microphone 301 on the left earphone collects sounds in the external environment of the left earphone. The first microphone 301 on the right earphone collects sounds in the external environment of the right earphone.

[0236] For ease of distinction, the signal collected by the first microphone 301 (reference microphone) is called the first signal, and the signal collected by the second microphone 302 (error microphone) is called the second signal. The microphone in this embodiment of the present application may be an analog microphone or a digital microphone. When the microphone is an analog microphone, the analog signal may be converted into a digital signal before a filtering process is performed on the signal collected by the microphone. In this embodiment of the present application, for example, both the first microphone and the second microphone are digital microphones, and both the first signal and the second signal are digital signals.

[0237] The processor 304 is configured to perform processing, such as ANC processing, HT processing, or AH processing, on the downlink audio signal and / or the signal collected by the microphone (including the first microphone 301, the second microphone 302, or the third microphone 303). For example, the processor 304 may include a main controller and a noise control processing unit. The main controller is configured to generate a control command for a user operation on the headset, receive a control command from a terminal device, or the like. The noise control processing unit is configured to perform ANC processing, HT processing, or AH processing on the downlink audio signal and / or the signal collected by the microphone (including the first microphone 301, the second microphone 302, or the third microphone 303) based on the control command.

[0238] The left earphone and the right earphone may further include a memory. The memory is configured to store a program or instruction executed by the processor 304. The processor 304 performs the ANC process, the HT process, or the AH process based on the program or instruction stored in the memory. The memory may include one or more of a random access memory (RAM), a flash memory, a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a register, a hard disk, a removable hard disk, a CD-ROM, or any other form of storage medium known in the art.

[0239] The main controller may be implemented by one or more of an ARM processing chip, a central processing unit (CPU), a system on chip (SoC), a digital signal processor (DSP), or a micro controller unit (MCU), for example. The noise control processing unit may include, for example, a coder-decoder (CODEC) chip or a high-fidelity (Hi-Fi) chip. For example, the noise control processing unit includes a codec chip. In the codec, a filter, an equalizer (EQ), a dynamic range controller (DRC), a limiter, a gain regulator (gain), a mixer, and the like are implemented in hardware and are mainly configured to perform processing such as filtering, audio mixing, and gain adjustment on the signal. The noise control processing unit may further include a DSP. The DSP may be configured to perform processing such as scene detection, voice enhancement, and deblocking.

[0240] The headset may further include a wireless communication unit configured to establish a communication connection with the terminal device 100 through a wireless communication module 160 in the terminal device 100. The wireless communication unit may provide a wireless communication solution applied to the headset, including a wireless local area network (WLAN) (e.g., a wireless fidelity (Wi-Fi) network), Bluetooth (BT), near field communication (NFC) technology, infrared (IR) technology, or the like. The wireless communication unit may be one or more components integrating at least one communication processor module. For example, the wireless communication module 160 may be Bluetooth, and the wireless communication unit may also be Bluetooth, and the headset 200 is connected to the terminal device 100 by using Bluetooth.

[0241] In a possible example, the output for three different noise processing is implemented by using three paths: an active noise control output path, an ambient sound hear-through output path, and a hearing enhancement output path. For example, as shown in FIG. 4, the different output paths use different processing schemes.

[0242] The active noise control processing in the active noise control output path may include, but is not limited to, performing noise suppression by using the anti-phase signal of the first signal collected by the reference microphone and the anti-phase signal of the second signal collected by the error microphone. The active noise control output path includes the anti-phase signal of the first signal and the anti-phase signal of the second signal. It should be noted that the phase difference between the first signal and the anti-phase signal of the first signal is 180 degrees. The speaker outputs a signal obtained by superimposing the anti-phase signal of the first signal and the anti-phase signal of the second signal, so that the sound in the current external environment reproduced by the speaker is cancelled by the sound in the external environment actually heard by the ear, and the active noise control effect is implemented. Thus, when the headset uses the ANC mode, the sound in the current user environment and the user's perception of the environmental sound in the user's ear canal can be attenuated.

[0243] Optionally, when there is a downlink audio signal, filtering compensation can be performed on the downlink audio signal. In addition, the influence of the downlink audio signal can be eliminated when the anti-phase signal of the environmental sound is obtained.

[0244] When the anti-phase signal of the first signal and the anti-phase signal of the second signal are obtained, a first filtering process and a third filtering process may be used. For example, the first filtering process may be a feedforward (FF) filtering process and may be implemented by a feedforward filter. The third filtering process may be a feedback (FB) filtering process and may be implemented by a feedback filter. As shown in FIG. 4, the FF filtering and the FB filtering use a parallel processing architecture to enhance the noise control effect. The ANC processing procedure will be described in detail in the following description. Here, the details will not be described again.

[0245] The environmental sound hear-through processing in the environmental sound hear-through output path may include, but is not limited to, performing a third filtering process on the signal collected by the error microphone to implement a part of the active noise control function, and performing a second filtering process and a HT enhancement process on the signal collected by the reference microphone. For example, the second filtering process may be a hear-through (HT) filtering process and may be implemented by a hear-through filter. The audio signal played by the speaker is obtained based on the first signal and the second signal, so that after the audio signal is played by the speaker, the user can hear the sound in the external environment by using the headset. Compared with the sound in the external environment heard when the HT processing is not performed, this sound has a higher intensity and a better effect. Therefore, when the headset uses the HT mode, the user's perception of the intensity of the sound in the current user environment can be enhanced. The HT processing procedure will be described in detail in the following description. Here, the details will not be described again.

[0246] The environmental sound hear-through processing in the hearing enhancement output path may include, but is not limited to, implementing a part of the active noise control function by using the signal collected by the error microphone, performing a first filtering process and a hearing enhancement process on the signal collected by the reference microphone to enhance the event sound in the sound in the user's environment, and performing a second filtering process on the signal collected by the reference microphone. The output signal of the speaker is obtained based on a signal obtained after mixing the event signal in the first signal and the inverse phase signal of the second signal. It should be noted that the phase difference between the second signal and the inverse phase signal of the second signal is 180 degrees. The speaker outputs a signal obtained by superimposing the inverse phase signal of the second signal, the inverse phase signal of the first signal, and the event signal in the first signal, so that the signal output by the speaker cancels the sound in the environment that is actually heard by the ear, and the active noise control effect is implemented. In addition, the speaker outputs the event sound in the environment, so that the user can clearly hear the pre-set signal required by the user in the environment. Therefore, when the headset uses the AH mode, the headset user can enhance the headset user's perception of the event sound contained in the sound in the current external environment. The AH processing procedure will be described in detail in the following description, and will not be described in detail again here.

[0247] It should be understood that the downlink audio signal, the first signal and the second signal can all be one frame signal or a certain period signal. For example, when the downlink audio signal, the first signal and the second signal are all one frame signal, the downlink audio signal, the first signal and the second signal belong to three signal streams respectively, and the signal frame of the downlink audio signal, the signal frame of the first signal and the signal frame of the second signal are in the same period or overlap in time. In this embodiment of the present application, when a function process (e.g., ANC, HT or AH) is performed, the function process is continuously performed on the signal stream in which the downlink audio signal is located, the signal stream in which the first signal is located and the signal stream of the second signal.

[0248] First, the processing procedure of the active noise control path will be described in detail below.

[0249] 5A and 5B are schematic flow charts of an active noise control process. For example, the downlink audio signal transmitted by the terminal device 100 to the headset 200 is referred to as a first audio signal in the following description. The first audio signal may be a speech signal, a music signal, or the like. For example, the signal collected by the reference microphone is referred to as a first signal, and the signal collected by the error microphone is referred to as a second signal. The headset uses an ANC mode.

[0250] It should be noted that the downlink audio signals transmitted by the terminal device 100 to the left and right earphones in the headset 200 can be the same signal or different signals. For example, the terminal device uses a stereo effect. The terminal device 100 transmits different downlink audio signals to the headset 200 to implement the stereo effect. Of course, the terminal device can alternatively transmit the same downlink audio signal to the left and right earphones. The left and right earphones use stereo processing to implement the stereo effect. The left or right earphone can perform the processing in FIG. 5A or FIG. 5B in the case of user control.

[0251] S501: Perform a first filtering process on a first signal collected by a reference microphone to obtain a first filtered signal. In Fig. 5B, the first filtered signal is simply referred to as signal A1.

[0252] S502: Filter out a first audio signal included in a second signal collected by an error microphone to obtain a first filtered signal. In Fig. 5B, the first filtered signal is simply referred to as signal A2.

[0253] Optionally, when the first audio signal included in the second signal collected by the error microphone is filtered out, a filtering compensation process may be performed on the first audio signal first.

[0254] S503: Perform an audio mixing process on the first filtered signal and the first filtered signal to obtain a third audio signal. In Fig. 5B, the third audio signal is simply called signal A3. In other words, the signal A3 is obtained by performing an audio mixing process on the signal A1 and the signal A2.

[0255] S504: Perform a third filtering process on the third audio signal (signal A3) to obtain a fourth audio signal, which is briefly referred to as signal A4 in Fig. 5B.

[0256] S505: Perform an audio mixing process on the fourth audio signal and the first audio signal to obtain a second audio signal. The speaker is responsible for playing the second audio signal. In Fig. 5B, the second audio signal is briefly referred to as signal A5.

[0257] It should be noted that when there is no downlink audio signal, i.e. when the terminal device does not send the first audio signal to the headset, and when the headset uses the ANC mode, the signal output by the speaker is the fourth audio signal on which no audio mixing process is performed. In this case, S502 and S505 do not need to be performed.

[0258] In FIG. 5B, for example, the first filtering process is a FF filtering process implemented by a FF filter, and the third filtering process is a FB filtering process implemented by a FB filter. The reference microphone in the headset 200 picks up the first signal and inputs the first signal to the FF filter for FF filtering process to obtain a signal A1. The error microphone picks up the second signal and inputs the second signal to the subtractor. The downlink audio signal obtained through filtering compensation is also input to the subtractor. The subtractor removes the downlink audio signal included in the second signal obtained through filtering compensation, eliminates the influence of the downlink audio signal, and obtains a signal A2. The audio mixer performs an audio mixing process on the signal A1 and the signal A2 to obtain a signal A3, and inputs the signal A3 to the FB filter for FB filtering process to obtain a signal A4. Audio mixing is performed on the signal A4 and the downlink audio signal to obtain a signal A5, and the signal A5 is input to the speaker for playback.

[0259] The ANC processing is implemented in the manner of FF filtering and FB serial processing to obtain a better noise-removed signal and enhance the noise control effect.

[0260] In a possible implementation, the ANC effect may be determined by the processing strength of the ANC processing, which depends on the FF filtering coefficients used in the FF filtering and / or the FB filtering coefficients used in the FB filtering.

[0261] For the FF filtering coefficient, in one manner, the default FF filtering coefficient in the ANC mode may be used. In another manner, the FF filtering coefficient used when the ANC mode was last selected may be used. In yet another manner, the headset determines the FF filtering coefficient to be used in the ANC mode based on the identified scene. In yet another manner, the user indicates the FF filtering coefficient to be used in the ANC mode to the headset by using a UI control provided by the terminal device. For example, the user selects the processing strength in the ANC mode as the target processing strength by using a UI control provided by the terminal device. Different processing strengths correspond to different FF filtering coefficients.

[0262] For the FB filtering coefficient, in one manner, the default FB filtering coefficient in the ANC mode may be used. In another manner, the FB filtering coefficient used when the ANC mode was last selected may be used. In yet another manner, the headset determines the FB filtering coefficient based on the identified scene. In yet another manner, the user indicates to the headset the FF filtering coefficient to be used in the ANC mode by using a UI control provided by the terminal device. For example, the user selects the processing strength in the ANC mode as the target processing strength by using a UI control provided by the terminal device. Different processing strengths correspond to different FB filtering coefficients.

[0263] In the ANC mode, the FF filtering coefficient and the FB filtering coefficient may be obtained in any combination of the above-mentioned provided manners. In an example, the FF filtering coefficient uses a default filtering coefficient in the ANC mode, and the FB filtering coefficient is determined by the headset based on the identified scene. In another example, the FB filtering coefficient uses a default filtering coefficient in the ANC mode, and the FF filtering coefficient is determined by the user by using a UI control provided by the terminal device. In another example, the FB filtering coefficient uses a default filtering coefficient in the ANC mode, and the FF filtering coefficient is shown on the headset by the user by using a UI control provided by the terminal device. The determination of the processing strength in the ANC mode will be described in detail later by using a specific example. Here, the details will not be described again.

[0264] Secondly, the processing procedure of the environmental sound hear-through path will be described in detail below.

[0265] 6A, 6B and 6C are schematic flow charts of the environmental sound hear-through processing. For example, the downlink audio signal transmitted by the terminal device 100 to the headset 200 is referred to as the first audio signal in the following description. The first audio signal may be a speech signal, a music signal, or the like. For example, the signal collected by the reference microphone is referred to as the first signal, and the signal collected by the error microphone is referred to as the second signal. The left earphone or the right earphone in the headset 200 may perform the processing in FIG. 6A, FIG. 6B or FIG. 6C in the case of user control.

[0266] S601: A first signal processing is performed on a first signal collected by a reference microphone to obtain a first processed signal. In Fig. 6B and Fig. 6C, the first processed signal is called signal B1. The first signal processing includes HT filtering.

[0267] S602: Perform an audio mixing process on the first processed signal and the first audio signal to obtain a fifth audio signal, which is referred to as signal B2 in Figures 6B and 6C.

[0268] In other words, an audio mixing process is performed on the signal B1 and the downlink audio signal (ie, the first audio signal) to obtain a signal B2.

[0269] S603: Filter out the fifth audio signal included in the second signal to obtain a second filtered signal. In Fig. 6B and Fig. 6C, the second filtered signal is called signal B3. In other words, the signal B2 included in the second environment signal is filtered out to obtain signal B3.

[0270] Optionally, before the fifth audio signal included in the second signal is filtered out, a filtering compensation process may also be performed on the fifth audio signal to reduce hearing perception loss.

[0271] S604: Perform FB filtering on the second filtered signal to obtain a third filtered signal. In Figures 6B and 6C, the third filtered signal is called signal B4. In other words, FB filtering is performed on signal B3 to obtain signal B4.

[0272] S605: Perform an audio mixing process on the third filtered signal and the fifth audio signal to obtain a second audio signal. In other words, an audio mixing process is performed on the signal B4 and the signal B2 to obtain a second audio signal.

[0273] In an example, a first signal processing may be performed on a first signal collected by a reference microphone to obtain a first processed signal in the following manner.

[0274] An HT filtering process is performed on the first signal to obtain a second filtered signal. In Fig. 6B and Fig. 6C, the second filtered signal is referred to as signal B5. Further, a second signal processing is performed on the second filtered signal to obtain a second processed signal. The second signal processing may also be referred to as a low-delay algorithm processing or an HT enhancement processing. The low-delay algorithm processing includes one or more of a blocking effect elimination processing, a background noise control processing, a wind noise control processing, a gain adjustment processing, or a frequency response adjustment processing. The low-delay algorithm processing is further performed on the signal obtained through the HT filtering, thereby reducing background noise and extraneous sounds and improving the user's hearing perception.

[0275] In a possible manner, the HT filtering process can be implemented by a noise control processing unit, as shown in FIG. 6B. For example, the noise control processing unit of the headset includes a CODEC. The CODEC includes a HT filter, a FB filter, a subtractor, a first audio mixer, a second audio mixer, and a filtering compensation unit. FIG. 6B shows an example in which the noise control processing unit further includes a DSP. The DSP can be configured to perform low-delay algorithm processing. The reference microphone in the headset 200 picks up a first signal, and inputs the first signal into the HT filter for HT filtering processing to obtain a signal B5. The signal B5 is input to the DSP. The DSP performs low-delay algorithm processing on the signal B5 to obtain a signal B1. The signal B1 is input to the first audio mixer. The first audio mixer performs audio mixing processing on the downlink audio signal and the signal B1 to obtain a signal B2. The signal B2, on which filtering compensation is performed by the filtering compensation unit, is input to the subtractor. The subtractor is configured to filter out the signal B2 included in the second environmental signal picked up by the error microphone on which the filtering compensation process has been performed, to obtain a signal B3. The signal B3 is input to the FB filter. The FB filter performs an FB filtering process on the signal B3 to obtain a signal B4. The signal B4 is input to the second audio mixer. In addition, the input to the second audio mixer further includes the signal B2. The second audio mixer performs an audio mixing process on the signal B2 and the signal B4 to obtain a second audio signal. The second audio signal is input to the speaker for playback.

[0276] In another possible manner, as shown in FIG. 6C, the HT filtering process may be implemented by a DSP. The DSP may be configured to perform the HT filtering process and the low-delay algorithm process. The noise control processing unit of the headset includes an FB filter, a subtractor, a first audio mixer, a second audio mixer, and a filtering compensation unit. The reference microphone in the headset picks up a first signal and inputs the first signal to the DSP. The DSP performs the HT filtering process and the low-delay algorithm process on the first signal to obtain a signal B1. The signal B1 is input to the first audio mixer. The first audio mixer performs an audio mixing process on the downlink audio signal and the signal B1 to obtain a signal B2. The signal B2, on which the filtering compensation is performed by the filtering compensation unit, is input to the subtractor. The subtractor is configured to filter out the signal B2 included in the second signal picked up by the error microphone to obtain a signal B3. The signal B3 is input to the FB filter. The FB filter performs the FB filtering process on the signal B3 to obtain a signal B4. Signal B4 is input to a second audio mixer. In addition, the input to the second audio mixer further includes signal B2. The second audio mixer performs an audio mixing process on signal B2 and signal B4 to obtain a second audio signal. The second audio signal is input to a speaker for playback.

[0277] In the example, the low latency algorithm processing includes a blocking effect cancellation processing. Before introducing the blocking effect cancellation processing method, the principle of blocking effect generation will be explained first. There are two ways to detect the voice of the headset wearer. 1. The signal is transmitted from the bone to the periosteum and detected. The signal is only a low frequency signal. 2. The signal is propagated from the outside air to the periosteum and detected. The signal includes a low frequency signal and a medium to high frequency signal. After the low frequency signal and the medium to high frequency signal are superimposed, the low frequency signal is too large and the low frequency signal cannot be transmitted when the headset is worn. As a result, the low frequency signal becomes disordered in the ear, causing a blocking effect.

[0278] The blocking effect cancellation process is performed on the signal B5 obtained through the HT filtering process. Specifically, the following method may be used:

[0279] Scheme 1: See FIG.

[0280] S701: A first audio harmonic signal corresponding to the bone conduction signal is determined from an audio harmonic set, the audio harmonic set including a plurality of audio harmonic signals. The plurality of audio harmonic signals included in the audio harmonic set correspond to different frequencies. Specifically, the frequency of the bone conduction signal may be determined, and the first audio harmonic signal is determined from the audio harmonic set based on the frequency of the bone conduction signal. The audio harmonic signal may also be referred to as an audio harmonic component.

[0281] S702: Remove the first audio harmonic signal from the signal B5 obtained from the HT filtering process. For example, the first audio harmonic signal in the signal B5 obtained through the HT filtering process is removed to obtain a signal C1. Generally, the human voice collected by the bone conduction sensor is a low-frequency harmonic component. Therefore, in S702, the low-frequency harmonic component is removed from the signal B5 to obtain a signal C1 that does not include the low-frequency harmonic component.

[0282] S703: Amplify the high frequency components in the signal B5 from which the first audio harmonic signal has been removed, that is, amplify the high frequency components in the signal C1.

[0283] A first audio harmonic signal corresponding to the bone conduction signal can be determined in the audio harmonic set. In other words, the bone conduction sensor can detect a bone conduction signal that indicates that the headset wearer is currently making a sound, e.g., speaking or singing. The signal obtained by amplifying the high frequency components based on the signal C1 contains only mid- and high-frequency components, so that the signal heard by the headset wearer does not have a blocking effect.

[0284] The audio harmonic set may be pre-stored in the headset. In examples, the audio harmonic set may be obtained in an offline manner or in an online manner.

[0285] When the audio harmonic set is obtained in an offline manner, the bone conduction signals of multiple people can be collected by the bone conduction sensor. The following processing is performed for each person's bone conduction signal. Using the first bone conduction signal as an example, an FFT is performed on the first bone conduction signal to obtain a frequency domain signal. A fundamental frequency signal in the frequency domain signal is determined by searching for a fundamental frequency by using a pilot. The harmonic components of the bone conduction signal are determined based on the fundamental frequency signal. In this case, a mapping relationship between the frequency and harmonic components of the bone conduction signal is obtained, and an audio harmonic set is obtained. The audio harmonic set may include a mapping relationship between different frequencies and different harmonic components.

[0286] When the audio harmonic set is acquired in an online manner, a second bone conduction signal may be collected by a bone conduction sensor in the headset within a designated period of time. During the designated period of time, the headset may be used by multiple people or may be used by only one person or user. The following processing is performed on the second bone conduction signal:

[0287] An FFT is performed on the second bone conduction signal to obtain a frequency domain signal. A fundamental frequency signal in the frequency domain signal is determined by searching for a fundamental frequency by using pilots. If the headset is used by multiple people within the specified period, multiple fundamental frequency signals corresponding to multiple different periods within the specified period may be determined. Multiple harmonic components of the bone conduction signal may be determined based on the multiple fundamental frequency signals. In this case, a mapping relationship between the frequency and the harmonic components is obtained, and an audio harmonic set is obtained. The audio harmonic set may include a mapping relationship between different frequencies and different harmonic components.

[0288] Method 2: An adaptive filtering process is performed on the signal B5 obtained through the HT filtering process, and the low-frequency components are removed from the signal B5 to obtain a signal C1, that is, the sound signal of the headset wearer can be removed from the signal B5. The high-frequency components in the third filtered signal from which the low-frequency components have been removed are amplified. In other words, the high-frequency components in the signal C1 are amplified. The signal obtained by amplifying the high-frequency components based on the signal C1 only contains mid- and high-frequency components, so that the signal heard by the headset wearer does not have a blocking effect.

[0289] In a possible implementation, the HT effect may be determined by the processing strength of the HT processing, which depends on the HT filtering coefficients used in the HT filtering and / or the FB filtering coefficients used in the FB filtering.

[0290] For the HT filtering coefficient, in one manner, the default HT filtering coefficient in the HT mode may be used. In another manner, the HT filtering coefficient used when the HT mode was last selected may be used. In yet another manner, the headset determines the HT filtering coefficient to be used in the HT mode based on the identified scene. In yet another manner, the user indicates to the headset the HT filtering coefficient to be used in the HT mode by using a UI control provided by the terminal device. For example, the user selects the processing strength in the HT mode as the target processing strength by using a UI control provided by the terminal device. Different processing strengths correspond to different HT filtering coefficients. For the FB filtering coefficient, in one manner, the default FB filtering coefficient in the HT mode may be used. In another manner, the FB filtering coefficient used when the HT mode was last selected may be used. In yet another manner, the headset determines the FB filtering coefficient based on the identified scene. In yet another manner, the user indicates to the headset the HT filtering coefficient to be used in the HT mode by using a UI control provided by the terminal device. For example, the user selects the processing strength in the HT mode as the target processing strength by using a UI control provided by the terminal device. Different processing strengths correspond to different FB filtering coefficients.

[0291] In the HT mode, the HT filtering coefficients and the FB filtering coefficients may be obtained in any combination of the above provided manners.

[0292] Third, the processing steps of the auditory enhancement pathway are described in detail below.

[0293] 8A, 8B and 8C are schematic flow charts of hearing enhancement processing. For example, the downlink audio signal transmitted by the terminal device 100 to the headset 110 is referred to as the first audio signal in the following description. The first audio signal may be a speech signal, a music signal, an alert sound, or the like. For example, the signal collected by the reference microphone is referred to as the first signal, and the signal collected by the error microphone is referred to as the second signal. The left earphone or the right earphone in the headset 200 may perform the processing in FIG. 8A, FIG. 8B or FIG. 8C in case of user control.

[0294] S801: Perform HT filtering on a first signal collected by a reference microphone to obtain a second filtered signal (signal C1). In Figures 8B and 8C, the second filtered signal is called signal C1.

[0295] S802: Perform an enhancing process on the second filtered signal (i.e., the signal C1) to obtain a filtered enhanced signal. In Figures 8B and 8C, the filtered enhanced signal is simply referred to as the signal C2.

[0296] S803: Perform FF filtering on the first signal to obtain a first filtered signal. In Figures 8B and 8C, the first filtered signal is briefly referred to as signal C3.

[0297] S804: Perform an audio mixing process on the filtering enhanced signal and the first audio signal to obtain a sixth audio signal. In Fig. 8B and Fig. 8C, the sixth audio signal is simply referred to as signal C4. In other words, in step S804, an audio mixing process is performed on the signal C2 and the downlink audio signal to obtain signal C4.

[0298] S805: Filter out the sixth audio signal included in the second signal to obtain a fourth filtered signal. In Fig. 8B and Fig. 8C, the fourth filtered signal is simply called signal C5. In other words, in step S805, the signal C4 included in the second environment signal is filtered out to obtain signal C5.

[0299] In an example, when step S805 is performed, a filtering compensation process may be first performed on the signal C4 to obtain a compensated signal, and then the compensation signal included in the second signal is filtered out to obtain a signal C5.

[0300] S806: Perform FB filtering on the fourth filtered signal to obtain a fifth filtered signal.

[0301] 8B and 8C, the fifth filtered signal is simply referred to as signal C6. In other words, in step S806, FB filtering is performed on signal C5 to obtain signal C6.

[0302] S807: Perform an audio mixing process on the fifth filtered signal, the sixth audio signal and the first filtered signal to obtain a second audio signal. In other words, in step S806, an audio mixing process is performed on the signal C6, the signal C4 and the signal C3 to obtain a second audio signal.

[0303] In a possible implementation, an enhancement process may be performed on the second filtered signal (ie, signal C1), and a filtered enhanced signal (signal C2) may be obtained in the following manner 1 or 2.

[0304] Scheme 1: See FIG.

[0305] S901: Perform blocking effect cancellation processing on the second filtered signal (ie, the signal C1).

[0306] The manner of performing blocking effect cancellation processing on the signal C1 may be the same as the manner of performing blocking effect cancellation processing on the signal B5, for details, please refer to Scheme 1 and Scheme 2 in Scenario 2, and the details will not be described again here.

[0307] Next, a noise control process is performed on the signal obtained through the blocking effect cancellation process. The noise control process includes an artificial intelligence (AI) noise control process and / or a wind noise control process. In FIG. 9, for example, the noise control process includes an AI noise control process and a wind noise control process.

[0308] S902: Perform AI noise control processing on the signal acquired through the blocking effect elimination processing.

[0309] S903: Perform wind noise control processing on the signal acquired through the AI ​​noise control processing.

[0310] S904: Perform gain amplification processing on the signal acquired through the wind noise control processing.

[0311] S905: Perform frequency response adjustment on the signal obtained through the gain amplification process to obtain a filtered enhanced signal.

[0312] In the above S904, a feasible way of performing gain amplification processing on the signal obtained through the wind noise processing is to directly amplify the signal obtained through the wind noise processing. In the way of directly amplifying the signal, the external signal is amplified and the wearer's voice is also amplified. This embodiment of the present application provides a gain amplification processing way in which only the external signal is amplified, and the wearer's voice signal is not amplified. For example, as shown in FIG. 10, when gain amplification processing is performed on the signal obtained through the noise control processing, the following way can be used for implementation.

[0313] The wearer's voice signal is conducted to the periosteum through the bone, and the voice signal is concentrated in low frequencies, which is shown as the bone conduction signal D1. The bone conduction signal D1 is collected by the bone conduction sensor.

[0314] 1. Harmonic expansion is performed on the bone conduction signal D1 to obtain a harmonic expanded signal. For example, the harmonic expanded signal is called signal D2. For example, the harmonic expansion can be a harmonic enhancement method or a method of directly expanding on the harmonics of the bone conduction signal D1.

[0315] 2. Based on the first gain factor (gain), an amplification process is performed on the signal obtained through the noise control process. For ease of explanation, the signal obtained through the noise control process is called signal D3. Based on the first gain factor, an amplification process is performed on the signal D3 to obtain a signal D4. Here, the amplification process may be a direct amplification of the signal. The value of the first gain factor may be related to the value of the processing strength of the AH process. For example, the mapping relationship between the first gain factor and the value of the processing strength of the AH process is stored in the headset.

[0316] 3. The harmonic extension signal included in the signal obtained through the amplification process is filtered out based on the first filtering coefficient to obtain a signal D5. The signal D2 included in the signal D4 is filtered out based on the first filtering coefficient in an adaptive filtering manner. In this case, the signal D5 is a signal from which the wearer's voice has been filtered out. The first filtering coefficient is determined based on a first gain coefficient. The first gain coefficient (gain) is used to adjust the adaptive filtering strength and may also be referred to as the first filtering coefficient. In other words, the dB number by which the signal is amplified based on the first gain coefficient is the same as the dB number by which filtering is performed through adaptive filtering, so that the wearer's voice signal can be balanced and not amplified or reduced.

[0317] Method 2: See FIG.

[0318] S1101: Perform a blocking effect cancellation process on a second filtered signal (ie, the signal C1) to obtain a deblocked signal.

[0319] The manner of performing blocking effect cancellation processing on the signal C1 may be the same as the manner of performing blocking effect cancellation processing on the signal B5, for details, please refer to Scheme 1 and Scheme 2 in Scenario 2, and the details will not be described again here.

[0320] S1102: Perform audio event detection on the unblocked signal to obtain an audio event signal (may be simply referred to as an event signal) in the unblocked signal. The audio event signal is, for example, a station announcement sound and a horn sound.

[0321] S1103: Perform gain amplification processing on the audio event signal in the deblocked signal.

[0322] Gain amplification processing is performed on the audio event signals, such as station announcements and horn sounds, in the deblocked signal, so that the headset wearer can clearly hear the station announcements or horn sounds.

[0323] S1104: Perform frequency response adjustment on the signal obtained through the gain amplification process to obtain a filtered enhanced signal.

[0324] In the manner 2, the manner of performing the gain amplification process on the audio event signal in the deblocking signal may be the same as the manner of performing the gain amplification process on the signal obtained through the noise control process, and the details will not be described again here.

[0325] In a possible manner, as shown in FIG. 8B, for example, the noise control processing unit includes a CODEC and a DSP. The CODEC of the headset includes an HT filter, an FB filter, an FF filter, a subtractor, a first audio mixer, a second audio mixer, and a filtering compensation unit. The HT filtering process is performed by the CODEC. The DSP can be configured to perform an enhancement process. The reference microphone in the headset 110 picks up a first signal, and inputs the first signal into the HT filter for HT filtering process to obtain a signal C1. The signal C1 is input to the DSP. The DSP performs an enhancement process on the signal C1 to obtain a signal C2. The signal C2 is input to the first audio mixer. The first audio mixer performs an audio mixing process on the downlink audio signal and the signal C2 to obtain a signal C4. The signal C4, on which filtering compensation is performed by the filtering compensation unit, is input to the subtractor. The subtractor is configured to filter out the signal C4 included in the second environmental signal picked up by the error microphone on which filtering compensation is performed, and obtain a signal C5. The signal C5 is input to the FB filter. The FB filter performs an FB filtering process on the signal C5 to obtain a signal C6. The signal C6 is input to the second audio mixer. In addition, the input to the second audio mixer further includes the signal C4 and the signal C3. The second audio mixer performs an audio mixing process on the signal C3, the signal C4 and the signal C6 to obtain a second audio signal. The second audio signal is input to a speaker for playback.

[0326] In another possible manner, as shown in FIG. 8C, for example, the noise control processing unit includes a CODEC and a DSP. The DSP can be configured to perform HT filtering and enhancement processing. The CODEC of the headset includes an FB filter, an FF filter, a subtractor, a first audio mixer, a second audio mixer, and a filtering compensation unit. The reference microphone in the headset 110 picks up a first signal and inputs the first signal to the DSP. The DSP performs an HT filtering process on the first signal to obtain a signal C1. The DSP performs an enhancement process on the signal C1 to obtain a signal C2. The signal C2 is input to the first audio mixer. The first audio mixer performs an audio mixing process on the downlink audio signal and the signal C2 to obtain a signal C4. The signal C4, on which filtering compensation is performed by the filtering compensation unit, is input to the subtractor. The subtractor is configured to filter out the signal C4 included in the second environmental signal picked up by the error microphone on which filtering compensation is performed, to obtain a signal C5. The signal C5 is input to the FB filter. The FB filter performs an FB filtering process on the signal C5 to obtain a signal C6. The signal C6 is input to the second audio mixer. In addition, the input to the second audio mixer further includes the signal C4 and the signal C3. The second audio mixer performs an audio mixing process on the signal C3, the signal C4 and the signal C6 to obtain a second audio signal. The second audio signal is input to a speaker for playback.

[0327] In a possible implementation, the AH effect may be determined by the processing strength of the AH processing, which depends on at least one of the HT filtering coefficient, the FB filtering coefficient, or the FF filtering coefficient.

[0328] For the FF filtering coefficient, in one manner, the default FF filtering coefficient in the AH mode may be used. In another manner, the FF filtering coefficient used when the AH mode was last selected may be used. In yet another manner, the headset determines the FF filtering coefficient to be used in the AH mode based on the identified scene. In yet another manner, the user indicates to the headset the FF filtering coefficient to be used in the AH mode by using a UI control provided by the terminal device. For example, the user selects the processing strength in the AH mode as the target processing strength by using a UI control provided by the terminal device. Different processing strengths correspond to different FF filtering coefficients. For the HT filtering coefficient, in one manner, the default HT filtering coefficient in the AH mode may be used. In another manner, the HT filtering coefficient used when the AH mode was last selected may be used. In yet another manner, the headset determines the HT filtering coefficient to be used in the AH mode based on the identified scene. In yet another manner, the user indicates to the headset the HT filtering coefficient to be used in the AH mode by using a UI control provided by the terminal device. For example, the user selects the processing strength in the AH mode as the target processing strength by using a UI control provided by the terminal device. Different processing strengths correspond to different HT filtering coefficients. For the FB filtering coefficients, in one manner, the default FB filtering coefficients in the AH mode may be used. In another manner, the FB filtering coefficients used when the AH mode was last selected may be used. In yet another manner, the headset determines the FB filtering coefficients based on the identified scene. In yet still another manner, the user indicates the HT filtering coefficients to be used in the AH mode to the headset by using a UI control provided by the terminal device.For example, the user selects the processing strength in the AH mode as the target processing strength by using a UI control provided by the terminal device, and different processing strengths correspond to different FB filtering coefficients.

[0329] In the AH mode, the HT filtering coefficients, the FB filtering coefficients or the FF filtering coefficients may be obtained in any combination of the above provided manners.

[0330] The processing mode of the headset 200 (including the left and right earphones) may be determined by the user by using UI controls on the terminal device 100 and indicated to the headset, or may be determined by the terminal device based on an adaptively identified scene and indicated to the headset, or may be determined by the headset based on an adaptively identified scene.

[0331] Below, an example of a scheme for determining the processing mode of a headset is described.

[0332] Example 1: A single control controls the left and right earphones.

[0333] The terminal device 100 provides a control interface for a user to select a processing mode of the headset 200 (including the left earphone and the right earphone) based on requirements. The processing modes include a null mode, an ANC mode, an HT mode, or an AH mode. In the null mode, no processing is performed. It should be understood that all processing modes of the headset in the control interface selected by the user are processing modes supported by the headset. In example 1, the left earphone and the right earphone have the same processing capability or support the same processing mode. For example, both the left earphone and the right earphone support AHA. For example, a headset application adapted to the headset 200 is installed in the terminal device. In the adaptation process, the processing capability of the headset can be known. In another example, in the communication process in which the headset 200 establishes a connection with the terminal device, a capability parameter is sent to the terminal device, so that the terminal device can determine the processing capability of the headset based on the capability parameter.

[0334] For example, the user selects the ANC mode. The control interface includes a user interface (UI) control. The UI control is used by the user to select the processing mode of the headset 200. To facilitate distinction, the UI control used by the user to select the processing mode of the headset is called a selection control. The processing modes include at least two of the ANC mode, the HT mode, or the AH mode. The terminal device 100 transmits a control signal 1 to the left earphone and the right earphone separately in response to a user operation to select a target mode from the processing modes supported by the headset by using the selection control. The control signal 1 holds the target mode. The selection control can also be used to select a processing strength in the target mode. The selection control can be a ring shape, a bar shape, or another shape. The selection control can include a first control and a second control. Any two different positions of the second control on the first control correspond to different processing modes of the headset, or two different positions of the second control on the first control correspond to different processing strengths in the same processing mode of the headset. A user selects different processing modes and controls processing intensity by moving the position of a second control representing the user's selection on a first control of the display.

[0335] In a possible implementation, a headset application (APP) is used to control the processing modes of the left and right earphones.

[0336] The terminal device 100 includes a headset control application, which is briefly called a headset application, used to control the headset. For example, see the home screen of the terminal device shown in Fig. 12A. After the headset is connected to the terminal device, when a user taps an icon 001 of a headset application (APP) on the desktop, the terminal device may launch the headset application in response to the user's operation of tapping the icon 001, and display a control interface of the headset application on the display, or pop up the control interface of the headset application when the headset application is launched.

[0337] For example, the selection control is ring-shaped as shown in FIG. 12B. In FIG. 12B, for example, both the left earphone and the right earphone support ANC mode, HT mode, and AH mode. The first control in the ring-shaped selection control in FIG. 12B includes three arc segments corresponding to ANC mode, HT mode, and AH mode, respectively. If the second control is located on the arc segment of the ANC mode, it is determined that the ANC mode is used. Different positions of the second control on the arc segment of the ANC mode correspond to different processing intensities in the ANC mode. If the second control is located on the arc segment of the HT mode, it is determined that the HT mode is used. Different positions of the second control on the arc segment of the HT mode correspond to different processing intensities in the HT mode. If the second control is located on the arc segment of the AH mode, it is determined that the AH mode is used. Different positions of the second control on the arc segment of the AH mode correspond to different processing intensities in the AH mode.

[0338] The highlighted black dot on the ring (or outer periphery) represents a second control used by the user to select a processing intensity. The user may select different processing modes and control processing intensity by moving the position of the black dot on the outer periphery. The terminal device 100 (e.g., a processor) responds to operation 1 performed by the user on the control interface. For example, operation 1 is generated when the user moves the position of the second control representing the user selection, which is on the second control of the display. The terminal device 100 transmits control command 1 to the left earphone and the right earphone separately. Control command 1 indicates a target mode and a target processing intensity. In FIG. 12B, the target mode is the ANC mode.

[0339] In an example, the control command 1 may include an ANC identifier and a parameter value indicating a target processing strength of the ANC processing. In the ANC mode, different processing strengths (i.e., different values ​​of the processing strength) correspond to different FB filtering coefficients and / or FF filtering coefficients.

[0340] In another example, the control command 1 includes radians. The corresponding processing mode can be determined based on the range of radians. Different radian values ​​correspond to processing strengths in the processing modes. As shown in FIG. 12B, the processing mode corresponding to (0,180] is the ANC mode, the processing mode corresponding to (180,270] is the HT mode, and the processing mode corresponding to (270,360] is the AH mode. The left earphone and the right earphone may include a mapping relationship between the radian range and the processing mode, and a mapping relationship between the radian value and the filtering coefficient. In the example of the ANC mode, different radian values ​​correspond to different FB filtering coefficients and FF filtering coefficients.

[0341] FIG. 12B is used as an example. The user can touch and hold the black dot on the disk and rotate the black dot clockwise from 0 degrees to 360 degrees. Based on the FF filtering coefficient and FB filtering coefficient corresponding to 0 degrees, the ANC effect is strongest. In other words, the user's perception of the sound in the current user environment and the environmental sound in the user's ear canal is weakened. After the rotation, the FF filtering coefficient and the FB filtering coefficient change. As a result, the active noise control effect is gradually weakened. At 180 degrees, the active noise control effect is weakest. This is the same as the noise control is not performed after the headset is worn. At 180 degrees to 270 degrees, the environmental sound hear-through is controlled. The user can touch and hold the black dot on the disk and rotate it clockwise from 180 degrees to 270 degrees. Based on the HT filtering coefficient and FB filtering coefficient corresponding to 180 degrees, the environmental sound hear-through effect is weakest. In other words, the user's perception of the sound in the current user environment is weakened. This is similar to the null mode being used after the headset is worn. After clockwise rotation, the HT filtering coefficient and the FB filtering coefficient change, so that the environmental sound hear-through effect is improved. The hearing enhancement is controlled from 270 degrees to 360 degrees. The user touches and holds the black dot on the disk. Based on the FF filtering coefficient, HT filtering coefficient, and FB filtering coefficient corresponding to 180 degrees, the hearing enhancement effect is the weakest. In other words, the user's perception of the event sound contained in the environmental sound in the current user environment is weakened. After clockwise rotation, the FF filtering coefficient, HT filtering coefficient, and FB filtering coefficient change, which improves the hearing enhancement effect. In other words, the event signal that the user expects to hear becomes stronger. This promotes listening.

[0342] For example, the terminal device 100 is connected to the left and right earphones by using Bluetooth®.

[0343] For example, the ANC mode is selected. As shown in FIG. 12C, in response to the user's operation 1, the terminal device 100 sends control command 1 to the left earphone and the right earphone separately by using Bluetooth. The control command 1 may include an ANC identifier and a parameter value of a target processing strength. The left earphone and the right earphone perform similar operations after receiving the control command 1. The processing of the left earphone is used as an example in the following description. After receiving the control command 1, the main control unit of the left earphone obtains the FF filtering coefficient and the FB filtering coefficient of the ANC processing from the coefficient bank based on the ANC identifier and the target processing strength.

[0344] For example, the coefficient bank includes the mapping relationship shown in Table 1. Table 1 is merely an example and constitutes a specific limitation for the mapping relationship. For example, the parameter value of the target processing intensity is intensity 1. The main controller of the left earphone obtains the FF filtering coefficient FF1 and the FB filtering coefficient FB1 corresponding to intensity 1 according to Table 1. The main controller controls the FF filter to perform an FF filtering process on the first signal collected by the reference microphone based on the coefficient FF1 to obtain a signal A1. The main controller controls the FB filter to perform an FB filtering process on the signal A3 based on the coefficient FB1 to obtain a second audio signal. Specifically, the main controller writes the coefficient FF1 and the coefficient FB1 into the AHA kernel, so that the AHA kernel performs steps S501-S504 to obtain the second audio signal. Table 1 [Table 1]

[0345] For example, the HT mode is selected. As shown in FIG. 12D, in response to the user's operation 1, the terminal device 100 sends control command 1 to the left earphone and the right earphone separately by using Bluetooth. The control command 1 may include a HT identifier and a target processing strength. The target processing strength indicates the processing strength of the HT processing. The left earphone and the right earphone perform similar operations after receiving the control command 1. The processing of the left earphone is used as an example in the following description. After receiving the control command 1, the main control unit of the left earphone obtains the HT filtering coefficients and / or FB filtering coefficients of the HT processing from the coefficient bank based on the HT identifier and the target processing strength.

[0346] Table 1 is used as an example, and the value of the target processing intensity is intensity 5. The main controller of the left earphone obtains an HT filtering coefficient HT1 and an FB filtering coefficient FB5 corresponding to intensity 5 according to Table 1. The main controller controls the HT filter to perform an HT filtering process on the first signal collected by the reference microphone based on the coefficient HT1. The main controller controls the FB filter to perform an FB filtering process on the signal B3 based on the coefficient FB5. Specifically, the main controller writes the coefficient HT1 and the coefficient FB5 into the AHA kernel, so that the AHA kernel performs steps S601 to S605 to obtain the second audio signal.

[0347] For example, the AH mode is selected. As shown in FIG. 12E, the terminal device 100 sends control command 1 to the left earphone and the right earphone separately by using Bluetooth in response to the user's operation 1. The control command 1 may include an AH identifier and a parameter value of a target processing strength. The left earphone and the right earphone perform similar operations after receiving the control command 1. The processing of the left earphone is used as an example in the following description. After receiving the control command 1, the main control unit of the left earphone obtains the HT filtering coefficient, the FF filtering coefficient, and the FB filtering coefficient of the AH processing from the coefficient bank according to the HT identifier and the target processing strength.

[0348] Table 1 is used as an example. The value of the target processing strength is indication 7. The main controller of the left earphone obtains an HT filtering coefficient HT3, an FB filtering coefficient FB7, and an FF filtering coefficient FF5 corresponding to indication 7 according to Table 1. The main controller controls the HT filter to perform an HT filtering process on the first signal collected by the reference microphone based on the coefficient HT3. The main controller controls the FB filter to perform an FB filtering process on the signal C5 based on the coefficient FB7. The main controller controls the FF filter to perform an FF filtering process on the first signal based on the coefficient FF5. Specifically, the main controller writes the coefficient HT3, the coefficient FB7, and the coefficient FF5 into the AHA kernel, so that the AHA kernel performs steps S801 to S807 to obtain the second audio signal.

[0349] For example, as shown in FIG. 12F, the selection control may be in the shape of a bar. The selection control includes a first control and a second control. The bar of the first control may be divided into multiple bar segments based on the number of processing modes supported by the headset. The second control on different bar segments of the first control indicates different processing modes. Different positions of the second control on the same bar segment of the first control indicates different processing strengths in the same processing mode. In FIG. 12F, for example, both the left earphone and the right earphone support AHA. The bar of the first control includes three bar segments.

[0350] FIG. 12F is used as an example. A user may touch and hold the black bar, and slide the black bar to the left or right. Based on the FF filtering coefficient and the FB filtering coefficient corresponding to the black bar located at the position K1, the ANC effect is strongest. When the black bar slides to the right, the FF filtering coefficient and the FB filtering coefficient change, so that the active noise control effect gradually decreases. At the position K2, the active noise control effect is weakest. This is similar to that the noise control process is not performed after the headset is worn. In the area between the position K2 and the position K3, the environmental sound hear-through is controlled. A user touches and holds the black bar, and moves the black bar from the position K2 to the position K3. Based on the HT filtering coefficient and the FB filtering coefficient corresponding to the black bar at the position K2, the environmental sound hear-through effect is weakest. When the black bar is moved to the position K3, the HT filtering coefficient and the FB filtering coefficient change, so that the environmental sound hear-through effect is improved. Hearing enhancement is controlled from the position K3 to the position K4. The user touches and holds the black bar, and moves the black bar from position K3 to position K4. Based on the FF filtering coefficient, the HT filtering coefficient and the FB filtering coefficient corresponding to the black bar at position K3, the hearing enhancement effect is the weakest. When the black bar is moved from position K3 to position K4, the FF filtering coefficient, the HT filtering coefficient and the FB filtering coefficient change, so that the hearing enhancement effect is improved. In other words, the voice signal that the user expects to hear becomes stronger, which promotes listening.

[0351] For example, as shown in FIG. 12G, the selection control in (a) includes buttons corresponding to different processing modes, including an ANC button, a HT button, and an AH button. The ANC mode is used as an example. In response to a user operation of tapping the ANC button, the terminal device 100 displays a display interface in (b) of FIG. 12G. The display interface in (b) includes a control 002 used to select a processing strength. A user can touch and hold the black bar and slide the black bar up and down to determine the processing strength of the ANC processing, that is, select the corresponding FF filtering coefficient and the corresponding FB filtering coefficient. The black bar slides in the region L1-L2. Based on the FF filtering coefficient and the FB filtering coefficient corresponding to the black bar located at the position L1, the ANC effect is strongest. When the black bar slides down, the FF filtering coefficient and the FB filtering coefficient change, so that the active noise control effect gradually decreases. At the position L2, the active noise control effect is weakest. This is similar to that the noise control processing is not performed after the headset is worn.

[0352] In another possible implementation, when headset 200 establishes a connection with a terminal device, a headset APP may be triggered to display a control interface including a selection control, such as the control interface shown in FIG. 12A, FIG. 12B, FIG. 12F, or FIG. 12G.

[0353] For example, the interface displayed by the terminal device is interface 1. When the terminal device identifies that the headset 200 establishes a connection with the terminal device, interface 1 is switched to the control interface.

[0354] In yet another possible implementation, when the headset triggers the headset to play audio after the headset establishes a connection with the terminal device, the terminal device may trigger the headset APP and display a control interface including a selection control, for example, the display interface shown in FIG. 12A, FIG. 12B, FIG. 12C, or FIG. 12D. For example, when the headset triggers the headset to play audio, the terminal device may play a song after establishing a connection with the headset and display a control interface including a selection control. As another example, the terminal device may play a video and display a control interface including a selection control after establishing a connection with the headset.

[0355] In yet another possible implementation, after the headset establishes a connection with the terminal device, when the terminal device plays audio by using the headset, the identified scene type of the current external environment is a target scene, and the target scene matches the scene type for which the processing mode of the first target earphone needs to be adjusted, and prompt information may be displayed. The prompt information is used to prompt the user whether to adjust the processing mode of the headset. For example, the prompt information is a prompt box, as shown in FIG. 12H. In response to a user operation of selecting to adjust the processing mode of the headset, a control interface including a selection control, for example, the control interface shown in FIG. 12A, FIG. 12B, FIG. 12C, or FIG. 12D, may be displayed. FIG. 12E shows an example of the control interface shown in FIG. 12A.

[0356] For example, the terminal device identifies the current user's scene as a noisy scene. In this scene, the user may need to enable a processing mode to display selection prompt information (e.g., a prompt box) to prompt the user whether to adjust the processing mode of the headset. For example, the terminal device identifies the scene type of the external environment as a noisy scene. In this scene, the user may need to enable a processing mode to display a prompt box to prompt the user whether to adjust the processing mode of the headset.

[0357] In examples, scene types that trigger the display of a prompt box may include noisy scenes, terminal building scenes, train station scenes, bus station scenes and road scenes.

[0358] For example, when the signal strength reaches a set threshold, the scene is determined as a noisy scene. As another example, when a specific sound of an airport announcement is identified, the scene is determined as a terminal building scene. As yet another example, when the sound of a train time announcement is identified, the scene is determined as a train station scene. As yet another example, when a bus ticket announcement is identified, the scene is determined as a bus stop scene. As yet another example, when the sound of a traffic light tick or a car horn is identified, the scene is determined as a road scene.

[0359] In yet another possible scenario, after the headset establishes a connection with the terminal device, when the terminal device plays audio using the headset, the terminal device displays a control interface including selection controls based on the identified current user's scenario.

[0360] Example 2: Two controls control the left and right earphones.

[0361] The terminal device 100 provides a control interface for a user to separately select a left earphone processing mode and a right earphone processing mode based on requirements. The left and right earphone processing modes may be different. For example, the left earphone selects the ANC mode and the right earphone selects the HT mode. The control interface includes a left earphone selection control and a right earphone selection control. For ease of distinction, the left earphone selection control is called a first selection control and the right earphone selection control is called a second selection control. The first selection control is used by the user to select the left earphone processing mode, and the second selection control is used by the user to select the right earphone processing mode. The first selection control and the second selection control may be ring-shaped, bar-shaped or another shape. The first selection control and the second selection control may be the same shape or different shapes. The user selects different processing modes and controls the processing intensity by moving the position of the control on the display that represents the user selection. For the shape of the control used by the left earphone and the right earphone, please refer to the description in Example 1. Details will not be described again here.

[0362] An example in which both the left and right earphones use a ring-shaped selection control is used for illustration. As shown in FIG. 13, both the first selection control and the second selection control include a first control and a second control. Two different positions of the second control on the first control correspond to different processing modes, or two different positions of the second control on the first control correspond to different processing intensities in the same processing mode. The control interface shown in FIG. 13 is used as an example. A user can select a different processing mode implemented by the left earphone and control the processing intensity by moving the position of the second control (black dot) of the first selection control of the left earphone on the outer circumference of the first control. A user can select a different processing mode implemented by the right earphone and control the processing intensity by moving the position of the second control of the second selection control of the right earphone on the first control. In Example 2, a user can select different processing modes, or the same processing intensity in the same processing mode, or different processing intensities in the same processing mode for the left and right earphones to match ear differences or meet the requirements of different applications.

[0363] In Example 2, for a method of triggering the display of a control interface including a first selection control and a second selection control, please refer to the description of Example 1. Here, the details will not be described again.

[0364] Example 3: The terminal device performs smart scene detection.

[0365] The terminal device identifies the current user's scene. The headset uses different processing modes in different scenes. When identifying the scene type of the current external environment as a first scene, the terminal device determines a target mode corresponding to the first scene in the processing mode of the headset, and sends a control signal 2 to the left earphone and the right earphone separately. The control signal 2 indicates the target mode. Different target modes correspond to different scene types.

[0366] In this embodiment of the present application, the terminal device determines the function to be performed by the headset based on the identified scene. The AHA function corresponds to the scene type. The most appropriate function is selected for the scene type. In this way, the user automatically experiences the desired effect.

[0367] In examples, scene types may include walking scenes, running scenes, quiet scenes, multiple people talking scenes, cafe scenes, subway scenes, train scenes, car scenes, waiting room scenes, dialogue scenes, office scenes, outdoor scenes, driving scenes, strong wind scenes, airplane scenes, alarm scenes, horn scenes, and crying scenes.

[0368] When the terminal device performs smart scene detection, it may perform detection classification by using an artificial intelligence (AI) model. The AI ​​model may be constructed in an offline manner and stored in the terminal device. For example, a microphone on the terminal device records a large amount of noise and sensor data and / or video processing unit (VPU) data in different scenes, and manually marks the scenes corresponding to the data. Secondly, the AI ​​model is constructed through initialization. The model may be one of a convolutional neural network (CNN), a deep neural network (DNN), or a long short-term memory (LSTM) network, or may be a combination of different models. Then, model training is performed by using the marked data, and a corresponding AI model is obtained. In use, sound signals of the external environment collected in real time are input into the AI ​​model for calculation, and a classification result is obtained.

[0369] In the example, the processing modes applicable to different scene types include walking scene (HT), running scene (HT), quiet scene (HT), multiple people talking scene (ANC), cafe scene (ANC), subway scene (AH), train scene (ANC), waiting room scene (AH), dialogue scene (AH), office scene (ANC), outdoor scene (ANC), driving scene (ANC), strong wind scene (ANC), airplane scene (ANC), alarm sound scene (AH), horn sound scene (AH) and crying scene (AH). The brackets indicate the processing mode corresponding to the scene type. For example, in the airplane scene, when the airplane is flying, the noise is large and the ANC mode is appropriate. As another example, in the walking scene, running scene and quiet scene, the HT mode is appropriate and burst event sound can be heard. As another example, in the cafe scene, when the user needs silence, the ANC mode can be used. As another example, in the light music scene, the HT mode can be used. As another example, in the alarm scene (AH), horn scene (AH) and crying scene (AH), a pre-defined sound needs to be heard and the AH mode is appropriate.

[0370] In the example, in an airplane scene, when identifying the scene type of the current external environment as an airplane scene, the terminal device 100 may send a control signal 2 to the headset. The control signal 2 indicates that the headset needs to perform the ANC function, and indicates the headset to use the ANC mode. After receiving the control signal 2, the left earphone and the right earphone separately perform the processes of S501 to S504.

[0371] In an example, in a walking scene, when identifying the scene type of the current external environment as a walking scene, the terminal device 100 may send a control signal 2 to the headset. The control signal 2 indicates that the headset needs to perform the HT function, and indicates the headset to use the HT mode. After receiving the control signal 2, the left earphone and the right earphone separately perform the processes from S601 to S605.

[0372] In another example, in an alarm sound scene, when identifying the scene type of the current external environment as a train station scene, the terminal device 100 may send a control signal 2 to the headset. The control signal 2 indicates that the headset needs to perform the AH function, and indicates the headset to use the AH mode. After receiving the control signal 2, the left earphone and the right earphone separately perform the processes of S801 to S807.

[0373] In a possible implementation, after the headset establishes a connection with the terminal device, the terminal device starts scene detection. After completing the detection, the terminal device can further display the detection result to the user, so that the user knows the processing mode of the headset. For example, the detection result is displayed to the user in the form of a prompt box. The detection result can include the detected scene, and can further include the processing mode corresponding to the detected scene. For example, when identifying the scene as the first scene, the terminal device can determine a target mode corresponding to the first scene in the processing mode of the headset, display the detection result, i.e., the first scene and the target mode, to the user, and then send a control signal 2 to the left earphone and the right earphone separately. The control signal 2 indicates the target mode.

[0374] In another possible implementation, a function for enabling smart scene detection is configured on the terminal device. In response to a user operation for enabling the smart scene detection function, the terminal device triggers scene detection. When identifying the scene as a first scene, the terminal device determines a target mode corresponding to the first scene in the processing mode of the headset, and sends a control signal 2 to the left earphone and the right earphone separately. The control signal 2 indicates the target mode.

[0375] After completing the detection, the terminal device may further display the detection result to the user, so that the user knows the processing mode of the headset. The detection result may include the detected scene, and may further include the processing mode corresponding to the detected scene. For example, when identifying the scene as the first scene, the terminal device may determine a target mode corresponding to the first scene in the processing mode of the headset, display the detection result, i.e., the first scene and the target mode, to the user, and then send the control signal 2 to the left earphone and the right earphone separately. The control signal 2 indicates the target mode. Optionally, after the detection result is displayed to the user, the control signal 2 is sent to the left earphone and the right earphone in response to a user operation to determine the target mode.

[0376] For example, the function configured by the terminal device and used to enable smart scene detection may be configured in a control interface of a headset application, or may be configured on a system setting menu bar of the terminal device. For example, the function is configured in the control interface of the headset application. The terminal device may control the processing mode of the headset by identifying a scene. Alternatively, the terminal device may control the processing mode of the headset by identifying a user operation on a selection control of the control interface. The terminal device may determine whether to enable the smart scene detection function based on requirements. When the smart scene detection function is not enabled, the processing mode of the headset may be manually selected by using Example 1. When the smart scene detection function is enabled, the terminal device 100 identifies the scene of the current user. After the smart scene detection function is enabled, the user may update the processing mode manual selection interface to another interface, or display the detection result based on the processing mode manual selection interface.

[0377] For example, before the user enables the smart scene detection function, the processing function selected by the user on the terminal device is the HT function. After the smart scene detection function is enabled, the terminal device identifies the current user's scene as an airplane scene, and the ANC function is applicable for use. In the example, the user launches a headset application, and the control interface of the headset application is displayed on the display. A ring shape is used as an example. The processing function selected by the user is the HT function, as shown in (a) of FIG. 14A. The control interface includes an optional control for enabling or disabling the smart scene detection function. After the user triggers the optional control to enable the smart scene detection function, the user triggers the smart scene detection function, performs scene detection to obtain the detection result, and changes the position of the processing function control representing the user selection to the area belonging to the ANC function. The position of the black dot on the disk may be the position of the default value of the ANC function, or the processing strength selected by the user when the ANC function was last selected. Please refer to (b) of FIG. 14A. In (b) of FIG. 14A, for example, an airplane scene is detected. The terminal device 100 sends a control signal 2 to the left earphone and the right earphone separately, and the control signal 2 indicates the ANC function. In another example, the user launches a headset application, and the control interface of the headset application is displayed on the display. A ring shape is used as an example. The processing function selected by the user is the HT function, as shown in (a) of FIG. 14B. The control interface includes an optional control for enabling or disabling the smart scene detection function. After the user triggers the optional control to enable the smart scene detection function, the user triggers the smart scene detection function, performs scene detection to obtain the detection result, and displays the detection result in the detection result interface. The detection interface may further include scenes that can be identified by the terminal device and processing functions corresponding to the scenes. For example, as shown in (b) of FIG. 14B, the detection result is an airplane scene, and the corresponding processing function is the ANC function.The terminal device 100 sends a control signal 2 to the left earphone and the right earphone separately, where the control signal 2 indicates the ANC function.

[0378] In the smart scene detection manner of the terminal device, the target processing intensity in the target mode may be determined in any one of the following manners.

[0379] Method 1: The headset uses the default target processing strength in target mode.

[0380] After the terminal device sends the control signal 2 to the left earphone and the right earphone separately, the left earphone is used as an example. After receiving the control signal 2, the left earphone determines the processing mode as the target mode, and the control signal 2 does not indicate the target processing strength, and the headset determines to use the default target processing strength. For example, the target mode is the ANC mode. After receiving the control signal 2, the left earphone determines to use the ANC mode, and obtains the default FF filtering coefficient and the default FB filtering coefficient in the ANC mode from the left earphone.

[0381] Method 2: The processing intensity used the last time the target mode was used is used as the target processing intensity.

[0382] In the example, the terminal device determines a target processing strength and indicates the target processing strength to the left earphone and the right earphone by using a control signal. After performing scene detection and determining a target mode based on the detected scene, the terminal device obtains the processing strength used when the target mode was last used as the target processing strength, and sends a control signal 2 to the left earphone and the right earphone separately, where the control signal 2 indicates the target mode and the target processing strength.

[0383] In another example, the headset determines the processing strength in the target mode. After performing scene detection, the terminal device determines a target mode based on the detected scene, and sends a control signal 2 to the left earphone and the right earphone separately, where the control signal 2 indicates the target mode. After receiving the control signal 2, the left earphone and the right earphone determine the processing mode as the target mode, and obtain the stored processing strength used when the target mode was last used as the target processing strength. For example, the target mode is the ANC mode, and the FF filtering coefficient and the FB filtering coefficient stored when the ANC mode was last used are obtained to perform the ANC processing.

[0384] Method 3: The terminal device determines a target processing intensity based on the identified scene.

[0385] When the function for enabling smart scene detection is not configured on the terminal device, after identifying the scene, the terminal device may determine a target processing intensity based on the identified scene.

[0386] In an example, the processing mode determines that different scenes are the same, and different scenes correspond to different processing intensities. For example, the HT mode is applicable to a walking scene, a running scene, and a quiet scene. When the HT mode is used, the walking scene, the running scene, and the quiet scene correspond to different processing intensities separately. As another example, the ANC mode is applicable to a multi-person talking scene, a cafe scene, a train scene, an airplane scene, a strong wind scene, and an office scene. In the ANC mode, the multi-person talking scene, the cafe scene, the train scene, the airplane scene, the strong wind scene, and the office scene correspond to different processing intensities separately. As another example, the AH mode is applicable to a dialogue scene, an alarm sound scene, a whistle sound scene, and a crying scene. When the AH mode is used, the dialogue scene, the alarm sound scene, the whistle sound scene, and a crying scene correspond to different processing intensities separately.

[0387] Based on this, the terminal device sends a control signal 2 to the left earphone and the right earphone based on the stored correspondence between scene types, the target mode, and the processing strength, and the control signal 2 indicates the target mode and the target processing strength in the target mode. In this way, after receiving the control signal 2, the headset determines to use the target mode based on the control signal 2, and determines a filtering coefficient corresponding to the target processing strength. For example, the target mode is the AH mode. The FF filtering coefficient, the FB filtering coefficient, and the HT filtering coefficient are determined based on the target processing strength, and S801 to S807 are performed based on the FF filtering coefficient, the FB filtering coefficient, and the HT filtering coefficient.

[0388] Method 4: The user indicates to the headset the processing strength to be used in the target mode by using a UI control provided by the terminal device.

[0389] In an example, after the terminal device performs scene detection, the detection result is displayed on the display interface of the terminal device. The detection result includes the detected scene and the target mode corresponding to the detected scene. The display interface may include a control used to select a processing intensity. For ease of explanation, the control used to select the processing intensity is called an intensity control. The intensity control may include control 1 and control 2. Different positions of control 1 indicate different processing intensities in the target mode. The intensity control may be a ring shape, a bar shape, or another shape. As shown in FIG. 14C, the detected scene is a scene of a terminal building. For example, control 1 in the intensity control is a ring, and control 2 is a circular black dot. The user touches and holds control 2 and moves it to position 1 on control 1. Position 1 indicates the target processing intensity selected by the user in the target mode. Then, control command 2 is sent to the left earphone and the right earphone. Control command 2 indicates the target mode and the target processing intensity corresponding to position 1.

[0390] Optionally, the target mode and the target processing strength can be sent to the left earphone and the right earphone by using different control commands. After determining the target mode based on the detected scene, the terminal device sends a control signal indicating the target mode to the left earphone and the right earphone. After receiving the control signal indicating the target mode, the left earphone and the right earphone use the default processing strength in the target mode, i.e., the default filtering coefficient in the target mode to implement the target processing corresponding to the target mode. When the user touches and holds control 2 and moves it to position 1 on control 1, the control signal indicating the target processing strength is sent to the left earphone and the right earphone. Furthermore, the left earphone and the right earphone execute the target processing corresponding to the target mode based on the filtering coefficient corresponding to the target processing strength.

[0391] In another example, still refer to FIG. 14A. After the user triggers the optional control to enable the smart scene detection function, the user triggers the smart scene detection function, executes scene detection to obtain the detection result, and changes the position of the processing function control representing the user selection to the area belonging to the ANC function. The position of the black dot on the disk can be the default value of the ANC function, or the position of the processing strength selected by the user when the ANC function was last selected. The user selects the processing strength in the ANC mode by moving the black dot. In addition, a control signal 2 is sent to the left earphone and the right earphone. The control signal 2 indicates the ANC mode and the target processing strength.

[0392] Example 4: Headset scene detection. Different scenes correspond to different processing functions.

[0393] The headset has a scene detection function. The headset identifies the current user's scene. The processing function of the headset is different for different detected scene types. In the headset, the left earphone may have the scene detection function, or the right earphone may have the scene detection function, or both the left earphone and the right earphone have the scene detection function. In an example, one of the left earphone and the right earphone is used to perform scene detection. For example, the left earphone performs scene detection and transmits the detection result to the right earphone, so that both the left earphone and the right earphone perform processing used to implement the processing function corresponding to the detection result based on the detection result of the left earphone. Alternatively, the right earphone performs scene detection and transmits the detection result to the left earphone. Thus, both the left earphone and the right earphone perform processing used to implement the processing function corresponding to the detection result based on the detection result of the right earphone. In another example, both the left earphone and the right earphone perform scene detection, the left earphone performs processing used to implement the processing function corresponding to the detection result based on the detection result of the left earphone, and the right earphone performs processing used to implement the processing function corresponding to the detection result based on the detection result of the right earphone.

[0394] In a possible implementation, enabling the scene detection feature of the headset may be controlled by the user, by using the headset, or by using the terminal device.

[0395] In one manner, a button used to initiate the scene detection function is located on the headset. A user can enable or disable the scene detection function of the headset by touching the button. After the scene detection function of the headset is enabled, the headset identifies a current user scene (or a current headset scene). Based on the correspondence between the scene and the processing mode, it is determined that a processing mode corresponding to the scene is identified, and a processing function corresponding to the processing mode is implemented.

[0396] In another manner, a user enables or disables the scene detection function of the headset by a tap operation on the headset, for example, three consecutive taps. When the scene detection function of the headset is disabled, the headset enables the scene detection function of the headset in response to three consecutive taps. When the scene detection function of the headset is enabled, the headset disables the scene detection function of the headset in response to three consecutive taps. After the scene detection function of the headset is enabled, the headset identifies a current user scene (or a current headset scene). Based on the correspondence between the scene and the processing mode, it is determined that a processing mode corresponding to the scene is identified, and a processing function corresponding to the processing mode is implemented.

[0397] In yet another manner, enabling the scene detection function of the left earphone or the right earphone is controlled by the terminal device 100. For example, the headset control interface includes a button for enabling or disabling the scene detection function of the headset. The terminal device may determine whether to enable the scene detection function of the headset based on a user request. When the scene detection function of the headset is not enabled, the processing function that needs to be implemented by the headset may be manually selected by using Example 1. After the scene detection function of the headset is enabled, the headset identifies the scene type of the current external environment. Based on the correspondence between the scene type and the processing mode, it is determined that the processing mode corresponding to the scene type is identified, and implements the processing function corresponding to the processing mode. In response to a user operation to enable the scene detection function of the headset, the terminal device 100 sends a control signal 3 to the headset 200. The control signal 3 indicates the headset to enable the scene detection function. The headset 200 starts to perform scene detection based on the control signal 3. The headset 200 determines the processing function that needs to be executed based on the detected scene type of the current external environment. For example, if the processing function is the ANC function, the headset 200 executes the ANC process and executes S501 to S504.

[0398] In another possible implementation, the headset starts scene detection after the headset establishes a connection with the terminal device, or when the headset receives a downlink audio signal transmitted by the terminal device.

[0399] In Example 4, after the headset detection is completed, the detection result may be further sent to the terminal device. For example, the detection result may be included in the instruction information and sent to the terminal device. The detection result may include the detected scene and the processing mode corresponding to the scene. When receiving the detection result, the terminal device displays the detection result to the user, so that the user knows the processing mode of the headset. For example, the detection result is displayed to the user in the form of a prompt box. Optionally, the detection result may include only the detected scene. After receiving the detection result, the terminal device determines the processing mode corresponding to the scene detected by the headset, and displays the scene detected by the headset and the processing mode corresponding to the scene to the user. For example, when identifying the scene as a first scene, the headset may determine a target mode corresponding to the first scene in the processing mode of the headset, and display the detection result, i.e., the first scene and the target mode, to the user.

[0400] In another example, after the headset detection is completed, the processing function of the processing mode corresponding to the scene is not immediately executed, and the detection result is sent to the terminal device, and the terminal device displays the detection result to the user. In response to the user operation to determine the processing mode, the terminal device sends a confirmation command to the headset. When receiving the confirmation command, the headset executes the processing function by using the processing mode corresponding to the scene detected by the headset.

[0401] For example, scene types that can be identified by the headset may include a walking scene, a running scene, a quiet scene, a multi-person talking scene, a cafe scene, a subway scene, a train scene, a car scene, a waiting room scene, a dialogue scene, an office scene, an outdoor scene, a driving scene, a high wind scene, an airplane scene, an alarm scene, a horn scene, and a crying scene.

[0402] In the example, the processing modes applicable to different scene types include walking scene (HT), running scene (HT), quiet scene (HT), multiple people talking scene (ANC), cafe scene (ANC), subway scene (AH), train scene (ANC), waiting room scene (AH), dialogue scene (AH), office scene (ANC), outdoor scene (ANC), driving scene (ANC), strong wind scene (ANC), airplane scene (ANC), alarm sound scene (AH), horn sound scene (AH) and crying scene (AH). The brackets indicate the processing mode corresponding to the scene type. For example, in the airplane scene, when the airplane is flying, the noise is large and the ANC mode is appropriate. As another example, in the walking scene, running scene and quiet scene, the HT mode is appropriate and burst event sound can be heard. As another example, in the cafe scene, when the user needs silence, the ANC mode can be used. As another example, in the light music scene, the HT mode can be used. As another example, in the alarm scene (AH), horn scene (AH) and crying scene (AH), a pre-defined sound needs to be heard and the AH mode is appropriate.

[0403] In the example, in an airplane scene, when the scene type is identified as an airplane scene, it is determined that the ANC mode is to be used, and the left earphone and the right earphone perform the processes in S501 to S504 separately.

[0404] In the example, in a walking scene, when the scene type is identified as a walking scene, it is determined that the HT mode is used, and the left earphone and the right earphone perform the processes in S601 to S605 separately.

[0405] In another example, in a train station scene, when the scene type is identified as a train station scene, it is determined that the AH mode is to be used. The left earphone and the right earphone perform the processes of S801 to S807 separately.

[0406] In the headset scene detection scheme, the target processing strength in the target mode may be determined in any one of the following ways:

[0407] Method 1: The headset uses the default target processing strength in target mode.

[0408] The headset (left earphone or right earphone) determines the processing mode as a target mode based on the detected scene, and determines that the left earphone and the right earphone use a default target processing strength. For example, the target mode is an ANC mode. The left earphone and the right earphone obtain a default FF filtering coefficient and a default FB filtering coefficient in the ANC mode.

[0409] Method 2: The processing intensity used the last time the target mode was used is used as the target processing intensity.

[0410] In an example, the headset (left earphone or right earphone) determines the processing strength in the target mode. After the headset performs scene detection and determines the target mode based on the detected scene, the headset obtains the processing strength stored when the target mode was last used as the target processing strength. For example, the target mode is the ANC mode, and the FF filtering coefficient and the FB filtering coefficient stored when the ANC mode was last used are obtained to perform the ANC processing.

[0411] In another example, the terminal device determines a target processing strength and indicates the target processing strength to the left and right earphones by using a control signal. After performing scene detection, the headset sends the detection result to the terminal device, so that the terminal device obtains the processing strength used when the target mode was last used as the target processing strength, and sends a control signal 4 to the left and right earphones separately. The control signal 4 indicates the target processing strength.

[0412] Method 3: The headset determines the target processing strength based on the identified scene.

[0413] After identifying the scene, the headset may determine a target processing strength based on the identified scene.

[0414] In an example, the processing mode determines that different scenes are the same, and different scenes correspond to different processing intensities. For example, the HT mode is applicable to a walking scene, a running scene, and a quiet scene. When the HT mode is used, the walking scene, the running scene, and the quiet scene correspond to different processing intensities separately. As another example, the ANC mode is applicable to a multi-person talking scene, a cafe scene, a train scene, an airplane scene, a strong wind scene, and an office scene. In the ANC mode, the multi-person talking scene, the cafe scene, the train scene, the airplane scene, the strong wind scene, and the office scene correspond to different processing intensities separately. As another example, the AH mode is applicable to a dialogue scene, an alarm sound scene, a whistle sound scene, and a crying scene. When the AH mode is used, the dialogue scene, the alarm sound scene, the whistle sound scene, and a crying scene correspond to different processing intensities separately.

[0415] In view of this, the left earphone and the right earphone determine a target mode corresponding to the detected scene and a target processing strength in the target mode based on the stored correspondence between scene types, target modes, and processing strengths. In this way, the left earphone and the right earphone obtain a filtering coefficient corresponding to the target processing strength. For example, the target mode is the AH mode. The FF filtering coefficient, the FB filtering coefficient, and the HT filtering coefficient are determined based on the target processing strength, and S801 to S807 are performed based on the FF filtering coefficient, the FB filtering coefficient, and the HT filtering coefficient.

[0416] In another example, in different scenes, the headset may further detect emergency events to determine target events (or called target events). For example, the emergency events include one or more of a wind noise event, a howling event, an emergency event, a voice event, or a non-emergency event. Different events correspond to different processing strengths. The headset detects scenes and events. In the target mode, different events correspond to different filtering coefficients. ANC is used as an example. Different events correspond to different FF filtering coefficients and / or different FB filtering coefficients. After the left earphone or the right earphone performs scene and event detection, the left earphone and the ANC mode are used as an example. When the ANC function is implemented, the left earphone may obtain the FF filtering coefficient or the FB filtering coefficient corresponding to the detected event based on the detection result from the coefficient bank. The coefficient bank stores the mapping relationship between the processing mode, the event, the FF filtering coefficient, and the FB filtering coefficient. The processing effect of the ANC mainly depends on the FB filtering and / or the FF filtering. For example, the filtering coefficient of the FF filter is controlled based on the detected scene, and the FB filtering coefficient is a fixed value. In another example, the filtering coefficient of the FB filter is controlled based on the detected scene, and the FF filtering coefficient is a fixed value. In yet another example, the FF filtering coefficient and the FB filtering coefficient are controlled based on the detected scene. For example, as shown in Table 2, the event includes a howling event, a wind noise event, an emergency event, a voice event, or a non-emergency event. Table 2 [Table 2]

[0417] For example, the headset 200 may detect an event sound in the external environment, and determine a target event corresponding to the event sound in the external environment based on a signal collected by a reference microphone. For example, when the signal collected by the reference microphone includes a signal of a preset spectrum, an event corresponding to the signal of the preset spectrum is determined. For example, for a wind noise event, when the signal collected by the reference microphone includes a wind sound signal, i.e., when the collected signal includes a signal that matches the spectrum of the wind sound, it is determined that the event corresponding to the detected event sound in the external environment is a wind noise event. When the signal collected by the reference microphone includes a signal of a preset spectrum, it is determined that a spectrum matching method may be used, or a deep neural network (DNN) matching method may be used.

[0418] 15, the headset 200 may determine an event in the current user environment based on a signal collected by a reference microphone in the following manner: The headset 200 further includes a bone conduction sensor. The bone conduction sensor is configured to collect a bone conduction signal of a headset user. When the user wears the headset 200 and produces a sound, e.g., speaks or sings, the bone conduction sensor collects the bone conduction signal, i.e., collects a periosteal vibration signal generated when the user speaks to obtain the bone conduction signal.

[0419] Activating the scene detection function of the left or right earphone may be controlled by the terminal device 100 or by a user operation on the headset, such as tapping the left or right earphone. Alternatively, the headset includes a bone conduction sensor. When the user's upper and lower teeth touch, a teeth contact sound is generated, and as a result, the bone conduction sensor activates the scene detection function by detecting an audio signal generated when the user's upper and lower teeth touch.

[0420] S1501: Filter out the bone conduction signal in the third signal collected by the reference microphone to obtain a filtered signal (simply referred to as signal AA1).

[0421] In step S1501, the third signal collected by the reference microphone is a signal collected by the reference microphone after the headset activates a scene detection function.

[0422] It should be understood that when the user does not emit a sound while wearing the headset, for example, when the user does not speak or sing, the energy of the bone conduction signal collected by the bone conduction sensor is small. For example, when the energy of the bone conduction signal is less than a specified threshold, S1501 may not be executed, and the signal AA1 is the third signal. In an example, the headset 200 may first determine the energy of the bone conduction signal. If the energy of the bone conduction signal is less than a specified threshold, the filtering operation is not performed. In other words, S1501 is not executed. When it is determined that the energy of the bone conduction signal is equal to or greater than the specified threshold, S1501 is executed.

[0423] S1502: Perform a spectral analysis on the filtered signal to obtain an energy characteristic of the filtered signal.

[0424] In other words, headset 200 performs a spectral analysis on signal AA1 to obtain an energy signature of signal AA1. For example, headset 200 may perform a spectral analysis on the signal to obtain an energy signature of the entire frame of signal AA1 and an energy signature of each bark subband of signal AA1 to form an energy signature of signal AA1 represented by a vector.

[0425] S1503: A first energy feature that matches an energy feature of the filtered signal among the energy features included in the energy feature set is determined, where different energy features included in the energy feature set correspond to different event identifiers.

[0426] S1504: Determine an event identified by an event identifier corresponding to the first energy feature as an event in the current user environment, ie, a detection result of the event detection.

[0427] In an example, the energy feature set can be generated in the following manner: Wind noise detection, burst noise detection, howling detection, and voice detection are performed on the signals collected by the first microphone, the second microphone, and the third microphone, and a wind noise signal, a burst noise signal, and a howling signal are obtained. Then, a spectrum analysis is performed separately on the wind noise signal, the burst noise signal, the howling signal, and the voice signal, and a sub-band energy feature of the wind noise signal, a sub-band energy feature of the burst noise signal, a sub-band energy feature of the howling signal, and a sub-band energy feature of the voice signal are obtained. The sub-band energy feature of the wind noise signal, the sub-band energy feature of the burst noise signal, the sub-band energy feature of the howling signal, and the sub-band energy feature of the voice signal form an energy feature set. It should be understood that in a quiet scene, the sub-band energy of noise is weak.

[0428] Optionally, when a first energy feature in the energy feature set that matches the energy feature of the filtered signal is determined, a spectrum matching method or a deep neural network (DNN) matching method can be used. For example, when the DNN matching method is used, the matching degree between the energy feature of the filtered signal and each energy feature in the energy feature set can be determined by using the DNN, and the event identified by the event identifier corresponding to the first energy feature with the highest matching degree is the detection result.

[0429] In this embodiment of the present application, the main controller in the headset 200 may determine an event in the current user environment based on the signal collected by the reference microphone. For example, the main controller includes a DSP. The DSP is configured to execute S1501 to S1504.

[0430] Method 4: The user indicates to the headset the processing strength to be used in the target mode by using a UI control provided by the terminal device.

[0431] In the example, after performing scene detection, the headset transmits the detection result to the terminal device. The terminal device displays the detection result to the user. The detection result is displayed on a display interface of the terminal device. The detection result includes the scene detected by the headset and the target mode corresponding to the detected scene. The display interface further includes a control used to select a processing intensity. For ease of explanation, the control used to select the processing intensity is called an intensity control. The intensity control may include control 1 and control 2. Different positions of control 1 indicate different processing intensities in the target mode. The intensity control may be a ring shape, a bar shape, or another shape. As shown in FIG. 16, for example, the intensity control is a ring. The user touches and holds control 2 and moves it to position 2 on control 1. Position 2 indicates the target processing intensity selected by the user in the target mode. Then, a control command 5 is transmitted to the left earphone and the right earphone. The control command 5 indicates the target processing intensity corresponding to position 2. In FIG. 16, for example, the target mode is the HT mode.

[0432] In the example, the terminal device 100 sends a control signal 3 to the headset 200 in response to a user operation to enable the scene detection function of the headset. The control signal 3 indicates to the headset to enable the scene detection function. The headset 200 starts to perform scene detection and obtains a detection result based on the control signal 3. The headset 200 may send the detection result to the terminal device 100, so that the terminal device 100 displays the detection result to the user and displays to the user a processing mode corresponding to the detected scene that needs to be used by the headset.

[0433] Furthermore, after the scene detection function of the headset is enabled, the user may update the processing mode manual selection interface to another interface, or display the detection result based on the processing mode manual selection interface.

[0434] For example, before the user enables the scene detection function of the headset, the processing function selected by the user on the terminal device is the HT function. After the scene detection function of the headset is enabled, the headset 200 identifies the current user's scene as an airplane scene, and the ANC function is appropriate. The headset sends the detection result, i.e., the airplane scene and the ANC function, to the terminal device. In the example, the user launches a headset application, and the control interface of the headset application is displayed on the display. A ring shape is used as an example. The processing function selected by the user is the HT function, as shown in (a) of FIG. 17A. The control interface includes an optional control for enabling or disabling the scene detection function of the headset. After the user triggers the optional control to enable the scene detection function of the headset, the terminal device triggers the scene detection function of the headset and sends a control signal 3 to the headset 200. The control signal 3 indicates to the headset to enable the scene detection function. The headset 200 starts to perform scene detection based on the control signal 3 and obtains the detection result. The headset 200 sends the detection result to the terminal device 100. After receiving the detection result, the terminal device 100 changes the position of the processing function control representing the user selection to the area belonging to the ANC function. The user selects the processing strength in the ANC mode by moving the black dot on the disk. See (b) of FIG. 17A. In (b) of FIG. 17A, for example, an airplane scene is detected.

[0435] In another example, a user launches a headset application, and a control interface of the headset application is displayed on the display. A ring shape is used as an example. The processing function selected by the user is the HT function, as shown in FIG. 17B (a). The control interface includes an optional control for enabling or disabling the scene detection function of the headset. After the user triggers the optional control to enable the scene detection function of the headset, the terminal device triggers the scene detection function of the headset and sends a control signal 3 to the headset 200. The control signal 3 indicates to the headset to enable the scene detection function. The headset 200 starts to perform scene detection based on the control signal 3 and obtains the detection result. The headset 200 sends the detection result to the terminal device 100. After receiving the detection result, the terminal device 100 displays the detection result in the detection result interface. The detection interface may further include scenes that can be identified by the headset and processing modes corresponding to the scenes. The user selects the processing strength in the ANC mode by moving the black dot on the disk. For example, as shown in FIG. 17B(b), the detection result is an airplane scene, and the corresponding processing mode is the ANC mode.

[0436] For example, in one approach, headset 200 may perform detection classification by using an artificial intelligence (AI) model when performing scene detection. The AI ​​model may be configured in the headset. In another approach, the scene type may be determined based on a signal collected by a reference microphone. For example, as shown in FIG. 18, headset 200 may determine the current user's scene based on a signal collected by a reference microphone in the following manner:

[0437] S1801: Perform a spectral analysis on a first signal collected by a reference microphone, divide the first signal into a plurality of subbands, and calculate the energy of each subband. For example, the first signal collected by the reference microphone is divided into subbands in the frequency domain by using a bark subband division method, and the energy of each subband is calculated.

[0438] S1802: Determine a VAD, obtain a noise segment in the first signal, and obtain a smoothed energy of each subband in the noise segment.

[0439] In the example, the VAD determination method is as follows: calculate the signal cross-correlation between the reference microphone and the communication microphone to obtain a cross-correlation coefficient A, calculate the auto-correlation coefficient B of the reference microphone, and when A<alpha (first threshold) and B<beta (second threshold), determine the signal segment corresponding to the VAD as a noise segment, otherwise determine the signal segment corresponding to the VAD as a voice segment.

[0440] S1803: Determine a scene type based on the smooth energy of each subband in the noise segment.

[0441] In the example, quiet scenes, low frequency heavy noise scenes, and voice scenes are determined. For the determined noise segments, the following process is performed to determine the scene type: (1) Calculate the average energy value C of the 50~1KHz subband, the average energy value D of the 1~2KHz subband, and the average energy value E of the 2~3KHz subband in the noise segment, and determine the scene as a quiet scene if C / D / E is less than the threshold gamma for N consecutive frames; (2) If a=D / C, a is less than a threshold t, and C and D are both greater than a threshold k, and for M consecutive frames, a is less than the threshold t, and C and D are both greater than the threshold k, determine the scene as a low-frequency heavy noise scene; or (3) If a is greater than a threshold k and P consecutive frames are not noise frames, the scene is determined to be a voice (or music) scene.

[0442] Example 5: After determining the processing mode, the headset performs event detection in the processing mode, in which different events correspond to different filtering coefficients (i.e., processing strength in the processing mode).

[0443] The headset identifies the user operation and determines that the headset 200 selected by the user needs to implement ANC processing, HT processing, or AH processing. The processing mode used by the headset 200 is the ANC mode. In a possible manner, the user operation can be a user operation of tapping the headset. By using different operations, the processing mode is determined as the ANC mode, the HT mode, or the AH mode. In another possible manner, a button is disposed on the headset. Different buttons indicate different processing modes. The user presses the button to select the processing mode of the headset. For example, after the headset 200 receives an operation command of the ANC mode triggered by the user, the left earphone and the right earphone perform the ANC processing, specifically, execute S501-S504. In yet another possible manner, the processing mode that needs to be implemented by the headset is selected and controlled by the terminal device 100.

[0444] The left earphone or the right earphone may have an event detection function. In an example, one of the left earphone and the right earphone is used to perform event detection. For example, the left earphone performs event detection and sends the detection result to the right earphone, or the right earphone performs event detection and sends the detection result to the left earphone. In the ANC mode, different events correspond to different FF filtering coefficients and different FB filtering coefficients. After the left earphone or the right earphone performs event detection, the left earphone is used as an example. Based on the detection result, the left earphone may obtain the FF filtering coefficient or the FB filtering coefficient corresponding to the detected event in the ANC mode from the coefficient bank. For example, Table 2 describes the contents included in the coefficient bank, and the events include a howling event, a wind noise event, an emergency event, a human voice event, or a non-emergency event.

[0445] To implement the functions in the above method embodiments, the headset can be understood to include corresponding hardware structures and / or software modules for performing each function. Those skilled in the art will easily realize that the present application can be implemented by hardware or a combination of hardware and computer software with reference to the modules and method steps in the examples described in the embodiments disclosed herein. Whether the functions are performed by hardware or by hardware driven by computer software depends on the specific application scenario and the design constraints of the technical solution.

[0446] Based on the same inventive idea as the aforementioned method, as shown in FIG. 19, the embodiment of the present application further provides a noise processing device 1900. The noise processing device 1900 is applied to a headset. The headset has at least two functions of an ANC function, a HT function or an AH function. The headset includes a first microphone and a second microphone. The first microphone is configured to collect a first signal. The first signal indicates a sound in a current external environment. The second microphone is configured to collect a second signal. The second signal indicates an environmental sound in an ear canal of a user wearing the headset. The noise processing device 1900 can be configured to implement the function of the headset in the aforementioned method embodiment, and thus can implement the beneficial effects of the aforementioned method embodiment. The device can include a communication module 1901, an acquisition module 1902 and a first processing module 1903.

[0447] The communication module 1901 is configured to receive a first audio signal from a terminal device.

[0448] The acquisition module 1902 is configured to acquire a target mode, where the target mode is determined based on a scene type of a current external environment, and the target mode instructs the headset to perform a target processing function, where the target processing function is one of an active noise control ANC function, an environmental sound hear-through HT function, or a hearing enhancement AH function.

[0449] The first processing module 1903 is configured to obtain a second audio signal based on the target mode, the first audio signal, the first signal and the second signal.

[0450] In a possible implementation, the device further includes a playback module configured to play the second audio signal, the playback module being not shown in FIG.

[0451] In a possible implementation, when the target processing function is an ANC function, the second audio signal played by the playback module can weaken the user's perception of sounds in the current user environment and environmental sounds in the user's ear canal, when the target processing function is an HT function, the second audio signal played by the playback module can enhance the user's perception of sounds in the current user environment, or when the target processing function is an AH function, the second audio signal played by the playback module can enhance the user's perception of event sounds, where the event sounds fill a pre-set spectrum.

[0452] In a possible implementation, when the target processing function is an ANC function, the second audio signal is obtained based on the first audio signal, the third signal, and the fourth signal, where the third signal is an inverse phase signal of the first signal and the fourth signal is an inverse phase signal of the second signal; when the target processing function is an HT function, the second audio signal is obtained based on the first audio signal, the first signal, and the second signal; or when the target processing function is an AH function, the second audio signal is obtained based on the first audio signal, the fifth signal, and the fourth signal, where the fifth signal is an event signal in the first signal, where the event signal satisfies a predetermined spectrum.

[0453] In a possible implementation, the communication module 1901 is further configured to receive a first control command from the terminal device, the first control command holding a target mode, the target mode being determined by the terminal device based on a scene type of the current external environment, and to transmit the target mode to the acquisition module 1902.

[0454] In a possible implementation, the communication module 1901 is further configured to receive a second control command from the terminal device, the second control command holding a target processing intensity, the target processing intensity indicating a processing intensity to be used when the headset executes the target processing function.

[0455] The first processing module 1903 is specifically configured to obtain a second audio signal based on the target mode, the target processing strength, the first audio signal, the first signal and the second signal.

[0456] In a possible implementation, the device further includes a second processing module 1904 configured to determine a target event corresponding to an event sound in the current external environment based on the first signal, and to determine a target processing strength in the target mode based on the target event, where the target processing strength indicates a processing strength to be used when the headset performs a target processing function.

[0457] The first processing module 1903 is specifically configured to obtain a second audio signal based on the target mode, the target processing strength, the first audio signal, the first signal and the second signal.

[0458] In a possible implementation, the headset further includes a bone conduction sensor configured to collect bone conduction signals generated by vibrations of the user's vocal cords.

[0459] The first processing module 1903 is specifically configured to determine a target event corresponding to an event sound in the current external environment based on the first signal and the bone conduction signal.

[0460] In a possible implementation, the target event includes a howling event, a wind noise event, an emergency event or a voice event.

[0461] In a possible implementation, the device further includes a third processing module 1905 configured to identify a scene type of the current external environment as a target scene based on the first signal, and to determine a target mode of the headset based on the target scene, the target mode being a processing mode corresponding to the target scene.

[0462] In a possible implementation, the target scenes include one of a walking scene, a running scene, a quiet scene, a multi-person talking scene, a cafe scene, a subway scene, a train scene, a waiting room scene, a dialogue scene, an office scene, an outdoor scene, a driving scene, a strong wind scene, an airplane scene, an alarm scene, a horn scene, and a crying scene.

[0463] In a possible implementation, the communication module 1901 is further configured to: send instruction information to the terminal device, where the instruction information indicates maintaining a target mode; and receive a third control signal from the terminal device, where the third control signal includes a target processing strength in the target mode, where the target processing strength indicates a processing strength to be used when the headset executes a target processing function.

[0464] The first processing module 1903 is specifically configured to obtain a second audio signal based on the target mode, the target processing strength, the first audio signal, the first signal and the second signal.

[0465] In a possible implementation, when the target processing function is an ANC function, a greater target processing strength indicates weaker user detection of sounds in the current user environment and environmental sounds in the user's ear canal, when the target processing function is an HT function, a greater target processing strength indicates stronger user detection of sounds in the current user environment, or when the target processing function is an AH function, a greater target processing strength indicates stronger user detection of event sounds contained in sounds in the current user environment.

[0466] In a possible implementation, the headset is the left earphone or the headset is the right earphone.

[0467] In a possible implementation, the target mode instructs the headset to perform an ANC function. The first processing module 1903 is specifically configured to perform the following: performing a first filtering process on the first signal to obtain a first filtered signal, filtering out the first audio signal included in the second signal to obtain a first filtered signal, performing an audio mixing process on the first filtered signal and the filtered signal to obtain a third audio signal, performing a third filtering process on the third audio signal to obtain a fourth audio signal, and performing an audio mixing process on the fourth audio signal and the first audio signal to obtain a second audio signal.

[0468] In a possible implementation, the filtering coefficients used for the first filtering process are filtering coefficients associated with a target processing strength for the first filtering process in the case of an ANC function, or the filtering coefficients used for the third filtering process are filtering coefficients associated with a target processing strength for the third filtering process in the case of an ANC function.

[0469] In a possible implementation, the target mode instructs the headset to perform the HT function. The first processing module 1903 is specifically configured to: perform a first signal processing on the first signal to obtain a first processed signal, where the first signal processing includes a second filtering processing; perform an audio mixing processing on the first processed signal and the first audio signal to obtain a fifth audio signal; filter out the fifth audio signal included in the second signal to obtain a second filtered signal; perform a third filtering processing on the second filtered signal to obtain a third filtered signal; and perform an audio mixing processing on the third filtered signal and the fifth audio signal to obtain a second audio signal.

[0470] In a possible implementation, the filtering coefficients used for the second filtering process are filtering coefficients associated with a target processing strength for the second filtering process in the case of HT functionality, or the filtering coefficients used for the third filtering process are filtering coefficients associated with a target processing strength for the third filtering process in the case of HT functionality.

[0471] In a possible implementation, the target mode instructs the headset to perform an AH function. The first processing module 1903 is specifically configured to: perform a second filtering process on the first signal to obtain a second filtered signal, perform an enhancement process on the second filtered signal to obtain a filtered enhanced signal, perform a first filtering process on the first signal to obtain a first filtered signal, perform an audio mixing process on the filtered enhanced signal and the first audio signal to obtain a sixth audio signal, filter out the sixth audio signal included in the second signal to obtain a fourth filtered signal, perform a third filtering process on the fourth filtered signal to obtain a fifth filtered signal, and perform an audio mixing process on the fifth filtered signal, the sixth audio signal, and the first filtered signal to obtain a second audio signal.

[0472] In a possible implementation, the filtering coefficients used for the first filtering process are filtering coefficients associated with a target processing strength for the first filtering process in the case of an AH function, the filtering coefficients used for the second filtering process are filtering coefficients associated with a target processing strength for the second filtering process in the case of an AH function, or the filtering coefficients used for the third filtering process are filtering coefficients associated with a target processing strength for the third filtering process in the case of an AH function.

[0473] To implement the functions in the above method embodiments, the terminal device may be understood to include corresponding hardware structures and / or software modules for performing each function. Those skilled in the art will easily realize that the present application can be implemented by hardware or a combination of hardware and computer software with reference to the modules and method steps in the examples described in the embodiments disclosed herein. Whether the functions are performed by hardware or by hardware driven by computer software depends on the specific application scenario and the design constraints of the technical solution.

[0474] Based on the same inventive idea as the above-mentioned method, as shown in Fig. 20, the embodiment of the present application further provides a mode control device 2000. The mode control device 2000 can be applied to the terminal device 100 and configured to implement the functions of the terminal device in the above-mentioned method embodiments, so that the beneficial effects of the above-mentioned method embodiments can be implemented.

[0475] The mode control device 2000 includes a first detection module 2001 and a transmission module 2002 , and may further include a display module 2003 and a second detection module 2004 .

[0476] When the first detection module 2001 identifies a scene type of the current external environment as a target scene, it is configured to determine a target mode based on the target scene.

[0477] The target mode is one of the processing modes supported by the headset. Different processing modes correspond to different scene types. The processing modes supported by the headset include at least two of the following: active noise control (ANC) mode, ambient sound (HT) mode, or hearing enhancement (AH) mode.

[0478] The transmission module 2002 is configured to transmit a target mode to a headset, the target mode instructing the headset to implement a processing function corresponding to the target mode.

[0479] In a possible implementation, the device further comprises a display module 2003 configured to display result prompt information when a target mode is determined based on a target scene, the result prompt information being used to prompt a user to cause the headset to implement a processing function corresponding to the target mode.

[0480] In a possible implementation, the display module 2003 is configured to display selection prompt information before the first control signal is sent to the headset, and the selection prompt information is used to prompt the user whether to adjust the processing mode of the headset to the target mode.

[0481] The second detection module 2004 is configured to detect a user operation to select the processing mode of the headset as the target mode.

[0482] In a possible implementation, the display module 2003 is further configured to display a first control and a second control, where different positions of the second control on the first control indicate different treatment intensities in the target mode.

[0483] The second detection module 2004 is further configured to detect a user touching and holding the second control to move it to a first position on the first control before the transmission module 2002 transmits the first control signal to the headset, the first position of the second control on the first control indicating a target processing intensity in the target mode.

[0484] The transmission module 2002 is further configured to transmit a target processing strength to the headset, the target processing strength indicating a processing strength to be used when the headset implements a processing function corresponding to the target mode.

[0485] In a possible implementation, the first control is ring-shaped, and when the user touches and holds the second control and moves it over the first control in a clockwise direction, the processing intensity in the target mode increases, or when the user touches and holds the second control and moves it over the first control in a counterclockwise direction, the processing intensity in the target mode increases.

[0486] In a possible implementation, the first control is bar-shaped. When the user touches and holds the second control and moves from top to bottom on the first control, the processing intensity in the goal mode increases. When the user touches and holds the second control and moves from bottom to top on the first control, the processing intensity in the goal mode increases. When the user touches and holds the second control and moves from left to right on the first control, the processing intensity in the goal mode increases. Or, when the user touches and holds the second control and moves from right to left on the first control, the processing intensity in the goal mode increases.

[0487] In a possible implementation, when the target processing function is an ANC function, a greater target processing strength indicates weaker user detection of sounds in the current user environment and environmental sounds in the user's ear canal, when the target processing function is an HT function, a greater target processing strength indicates stronger user detection of sounds in the current user environment, or when the target processing function is an AH function, a greater target processing strength indicates stronger user detection of event sounds contained in sounds in the current user environment.

[0488] Based on the same inventive idea as the aforementioned method, as shown in Fig. 21, the embodiment of the present application further provides a mode control device 2100. The mode control device 2100 can be applied to the terminal device 100 and configured to implement the functions of the terminal device in the aforementioned method embodiments. Thus, the beneficial effects of the aforementioned method embodiments can be implemented. The mode control device 2100 includes a processing module 2101, a sending module 2102, a receiving module 2103, a display module 2104 and a detection module 2105.

[0489] The processing module 2101 is configured to obtain a target mode. The target mode is one of the processing modes supported by the headset. The processing modes supported by the headset include at least two of an active noise control (ANC) mode, an environmental sound hear-through (HT) mode, or a hearing enhancement (AH) mode.

[0490] The processing module 2101 is further configured to determine a target processing intensity in the target mode based on a scene type of the current external environment, where different scene types correspond to different processing intensities in the target mode.

[0491] The transmission module 2102 is configured to transmit a target processing strength to the headset, the target processing strength indicating a processing strength to be used when the headset implements a processing function corresponding to the target mode.

[0492] In a possible implementation, the device further comprises a receiving module 2103 configured to receive the target mode transmitted by the headset.

[0493] In a possible implementation, the device further comprises a display module 2104 configured to display a selection control including processing modes supported by the headset, and to detect a user action of selecting a target mode from the processing modes of the headset by using the selection control.

[0494] In a possible implementation, the display module 2104 is further configured to display selection prompt information when the receiving module 2103 receives a target mode transmitted by the headset before the processing module 2101 determines a target processing strength in the target mode based on a scene type of the current external environment, and the selection prompt information is used to prompt the user whether to adjust the processing mode of the headset to the target mode.

[0495] The apparatus further comprises a detection module 2105 configured to detect a user action to select and adjust the processing mode of the headset as the target mode.

[0496] In a possible implementation, when the target processing function is an ANC function, a greater target processing strength indicates weaker user detection of sounds in the current user environment and environmental sounds in the user's ear canal, when the target processing function is an HT function, a greater target processing strength indicates stronger user detection of sounds in the current user environment, or when the target processing function is an AH function, a greater target processing strength indicates stronger user detection of event sounds contained in sounds in the current user environment.

[0497] Based on the same inventive idea as the above-mentioned method, as shown in Fig. 22, the embodiment of the present application further provides a mode control device 2200. The mode control device 2200 can be applied to the terminal device 100 and configured to implement the functions of the terminal device in the above-mentioned method embodiments. Thus, the beneficial effects of the above-mentioned method embodiments can be implemented. The mode control device 2100 includes a display module 2201, a detection module 2202, a transmission module 2203 and an identification module 2204.

[0498] The display module 2201 is configured to display a first interface. The first interface includes a first selection control. The first selection control includes a processing mode supported by the first target earphone and a processing strength corresponding to the processing mode supported by the first target earphone. The processing mode of the first target earphone includes at least two of an active noise control (ANC) mode, an environmental sound (HT) mode, or a hearing enhancement (AH) mode.

[0499] The detection module 2202 is configured to detect a first operation performed by a user on the first interface, the first operation being generated when the user uses a first selection control to select a first target mode from the processing modes supported by the first target earphone and select a processing intensity in the first target mode as a first target processing intensity.

[0500] The transmitting module 2203 is configured to transmit a first target mode and a first target processing strength to the first target earphone. The first target mode instructs the first target earphone to implement a processing function corresponding to the first target mode. The first target processing strength indicates a processing strength to be used when the first target earphone implements the processing function corresponding to the first target mode.

[0501] In a possible implementation, the display module 2201 is further configured to display selection prompt information before the first interface is displayed, the selection prompt information being used by the user to select whether to adjust the processing mode of the first target earphone.

[0502] The detection module 2202 is further configured to detect a user operation to select and adjust a processing mode of the first target earphone.

[0503] In a possible implementation, the device further comprises an identification module 2204 configured to identify a scene type of the current external environment as a target scene before the display module 2201 displays the first interface, the target scene matching the scene type for which the processing mode of the first target earphone needs to be adjusted.

[0504] In a possible implementation, the apparatus further includes an identification module 2204 configured to identify that the terminal device triggers the first target earphone to play audio before the display module 2201 displays the first interface.

[0505] In a possible implementation, the detection module 2202 is further configured to detect that the terminal device establishes a connection with the first target earphone before the display module displays the first interface.

[0506] In a possible implementation, when it is detected that the terminal device establishes a connection with the first target earphone before the display module 2201 displays the first interface, the detection module 2202 detects a second operation performed by the user on the home screen.

[0507] The home screen includes an icon of the first application. The second action is generated when a user touches the icon of the first application. The first interface is a display interface of the first application.

[0508] In a possible implementation, the first selection control includes a first control and a second control, where any two different positions of the second control on the first control indicate two different processing modes for the first target earphone, or any two different positions of the second control on the first control indicate different processing strengths in the same processing mode for the first target earphone.

[0509] The first operation is generated when the user moves a first position of the second control over the first control in an area corresponding to a first goal mode, the first position corresponding to a first goal processing intensity in the first goal mode.

[0510] In a possible implementation, the first control is ring-shaped. The ring includes at least two arc segments. The second controls located on different arc segments indicate different processing modes for the first target earphone. Different locations of the second controls on the same arc segment indicate different processing intensities for the same processing mode for the first target earphone.

[0511] Alternatively, the first control is bar-shaped. The bar includes at least two bar segments. The second controls located on different bar segments indicate different processing modes of the first target earphone. Different positions of the second controls on the same bar segment indicate different processing intensities for the same processing mode of the first target earphone.

[0512] In a possible implementation, the detection module 2202 is further configured to detect a third operation performed by the user on the first interface. The first interface further includes a second selection control. The second selection control includes a processing mode supported by the second target earphone and a processing intensity corresponding to the processing mode supported by the second target earphone. The processing modes supported by the second target earphone include at least two of an active noise control ANC mode, an environmental sound hear-through HT mode, or a hearing enhancement AH mode. The third operation is generated when the user selects a second target mode from the processing modes of the second target earphone by using the second selection control and selects a processing intensity in the second target mode as the second target processing intensity. When the first target earphone is the left earphone, the second target earphone is the right earphone, or when the first target earphone is the right earphone, the second target earphone is the left earphone.

[0513] The transmitting module 2203 is further configured to transmit a second target mode and a second target processing strength to the second target earphone, the second target mode instructing the second target earphone to implement a processing function corresponding to the second target mode, and the second target processing strength indicating a processing strength to be used when the second target earphone implements the processing function corresponding to the second target mode.

[0514] In view of this, an embodiment of the present application further provides a terminal device. As shown in Fig. 23, the terminal device includes a processor 2301, a memory 2302, a communication interface 2303 and a display 2304. The memory 2302 is configured to store instructions or programs executed by the processor 2301, store input data required by the processor 2301 to execute the instructions or programs, or store data generated after the processor 2301 executes the instructions or programs. The processor 2301 is configured to execute the instructions or programs stored in the memory 2302 to perform the functions performed by the terminal device in the aforementioned method.

[0515] In a possible scenario, the processor 2301 is configured to perform the functions of the first detection module 2001, the transmission module 2002, the display module 2003, and the second detection module 2004. Alternatively, the processor 2301 is configured to perform the functions of the first detection module 2001 and the second detection module 2004. The functions of the transmission module 2002 are implemented by the communication interface 2303. The functions of the display module 2003 may be implemented by the display 2304.

[0516] In another possible scenario, the processing module 2101, the transmitting module 2102, the receiving module 2103, the display module 2104 and the detecting module 2105 may be implemented by the processor 2301. Alternatively, the processor 2301 may be configured to perform the functions of the processing module 2101 and the detecting module 2105. The functions of the transmitting module 2102 and the receiving module 2103 may be implemented by the communication interface 2303. The function of the display module 2104 may be implemented by the display 2304.

[0517] In yet another possible scenario, the display module 2201, the detection module 2202, the transmission module 2203, and the identification module 2204 may be implemented by the processor 2301. Alternatively, functions of both the detection module 2202 and the identification module 2204 may be implemented by the processor 2301. The function of the transmission module 2203 may be implemented by the communication interface 2303. The function of the display module 2201 may be implemented by the display 2304.

[0518] It should be understood that the processor referred to in the embodiments of this application may be a central processing unit (CPU), or the processor may be another general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or another programmable logic device, a transistor logic device, a hardware component, or any combination. The general-purpose processor may be a microprocessor or any conventional processor or the like.

[0519] The steps of the method in the embodiments of the present application may be implemented in a hardware manner or in a manner of executing software instructions by a processor. The software instructions may include corresponding software modules. The software modules may be stored in a random access memory (RAM), a flash memory, a read-only memory (ROM), or a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a register, a hard disk, a removable hard disk, a CD-ROM, or any other form of storage medium known in the art. For example, the storage medium is coupled to the processor so that the processor can read information from the storage medium or write information to the storage medium. Of course, the storage medium may be a component of the processor. The processor and the storage medium may be located in an ASIC. In addition, the ASIC may be located in a terminal device. Of course, the processor and the storage medium may exist in the terminal device as discrete components.

[0520] All or some of the above embodiments may be implemented by using software, hardware, firmware, or any combination thereof. When software is used to implement the embodiments, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer programs or instructions are loaded and executed on a computer, the procedures or functions according to the embodiments of the present application are implemented in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, a user equipment, or another programmable device. The computer programs or instructions may be stored in a computer-readable storage medium or may be transmitted from one computer-readable storage medium to another. For example, the computer programs or instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center in a wired or wireless manner. The computer-readable storage medium may be any available medium accessible by a computer or a data storage device such as a server or data center that integrates one or more available media. The usable medium may be a magnetic medium, such as a floppy disk, hard disk or magnetic tape, an optical medium, such as a digital video disc (DVD), a semiconductor medium, such as a solid state drive (SSD) or the like.

[0521] In the embodiments of the present application, unless otherwise specified or logically inconsistent, the terms and / or descriptions between different embodiments may be consistent and mutually referenced, and the technical features in different embodiments may be combined based on their internal logical relationships to form new embodiments. In addition, the terms "include", "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, to include a series of steps or units. A method, system, product or device is not necessarily limited to those steps or units literally recited, but may include other steps or units not literally recited or inherent to such a process, method, product or device.

[0522] Although the present application is described with reference to specific features and embodiments thereof, it is clear that various modifications and combinations can be made thereto without departing from the spirit and scope of the present application. Correspondingly, the specification and accompanying drawings are merely illustrative examples of the solutions defined by the appended claims, and any or all modifications, variations, combinations or equivalents covering the scope of the present application are to be considered.

[0523] It is obvious that a person skilled in the art can make various modifications and variations to the present application without departing from the scope of the present application. The present application is intended to cover these modifications and variations as long as they fall within the scope of protection defined by the following claims and equivalent technologies.

Claims

1. A headset noise processing method, comprising: a headset having an active noise control (ANC) function or an environmental sound hear-through (HT) function and a hearing enhancement (AH) function, the headset comprising a first microphone and a second microphone, the first microphone configured to collect a first signal, the first signal indicative of a sound in a current external environment, and the second microphone configured to collect a second signal, the second signal indicative of an environmental sound in an ear canal of a user wearing the headset; The headset noise processing method includes: receiving a first audio signal from a terminal device; obtaining a target mode, the target mode being determined based on a scene type of the current external environment, the target mode instructing the headset to perform a target processing function, the target processing function being one of the active noise control (ANC) function, the ambient sound hear-through (HT) function, or the hearing enhancement (AH) function; and obtaining a second audio signal based on the target mode, the first audio signal, the first signal, and the second signal; Equipped with When the target processing function is the AH function, the second audio signal is obtained based on the first audio signal, a fifth signal, and a fourth signal, the fourth signal being an anti-phase signal of the second signal, and the fifth signal being an event signal in the first signal, and the event signal satisfies a preset spectrum. method.

2. The method of claim 1 , wherein the fifth signal is a station announcement sound and a whistle sound.

3. The method of claim 1 or 2, wherein the headset further comprises a speaker, the speaker being configured to reproduce the second audio signal.

4. When the target processing function is the ANC function, the second audio signal reproduced by the speaker is capable of attenuating the sound in the current external environment, the user's perception of the environmental sound in the ear canal of the user; When the target processing function is the HT function, the second audio signal reproduced by the speaker is capable of enhancing the user's perception of the sound in the current external environment; or When the target processing function is the AH function, the second audio signal played by the speaker can enhance user perception of an event sound, and the event sound fills a preset spectrum. The method according to claim 3.

5. When the target processing function is the ANC function, the second audio signal is obtained based on the first audio signal, a third signal, and a fourth signal, the third signal being an anti-phase signal of the first signal, and the fourth signal being an anti-phase signal of the second signal; or When the target processing function is the HT function, the second audio signal is obtained based on the first audio signal, the first signal, and the second signal.

5. The method according to any one of claims 1 to 4.

6. The step of obtaining a target mode comprises:

6. The method according to claim 1, further comprising: receiving a first control command from the terminal device, the first control command holding the target mode, the target mode being determined by the terminal device based on the scene type of the current external environment.

7. The method further comprises receiving a second control command from the terminal device, the second control command carrying a target processing intensity, the target processing intensity indicating a processing intensity to be used when the headset executes the target processing function; The step of obtaining a second audio signal based on the target mode, the first audio signal, the first signal, and the second signal further comprises: The method of claim 6 , comprising obtaining the second audio signal based on the target mode, the target processing strength, the first audio signal, the first signal and the second signal.

8. The method further comprises determining a target event corresponding to an event sound in the current external environment based on the first signal, and determining a target processing strength for the target mode based on the target event, the target processing strength indicating a processing strength to be used when the headset performs the target processing function, different processing strengths corresponding to different events; obtaining a second audio signal based on the target mode, the first audio signal, the first signal, and the second signal, comprising: The method of claim 6 , comprising obtaining the second audio signal based on the target mode, the target processing strength, the first audio signal, the first signal, and the second signal.

9. The headset further comprises a bone conduction sensor configured to collect bone conduction signals generated by vibration of the user's vocal cords, and determining a target event corresponding to an event sound in the current external environment based on the first signal includes: The method of claim 8 , comprising determining the target event corresponding to the event sound in the current external environment based on the first signal and the bone conduction signal.

10. The method of claim 9 , wherein the target event comprises one of a feedback event, a wind noise event, an emergency event, or a voice event.

11. The step of obtaining a target mode comprises:

6. The method of claim 1, further comprising: identifying the scene type of the current external environment as a target scene based on the first signal; and determining the target mode of the headset based on the target scene, the target mode being a processing mode corresponding to the target scene, different processing modes corresponding to different scene types.

12. 12. The method of claim 11, wherein the target scene includes one of a walking scene, a running scene, a quiet scene, a multi-person talking scene, a cafe scene, a subway scene, a train scene, a waiting room scene, a dialogue scene, an office scene, an outdoor scene, a driving scene, a high wind scene, an airplane scene, an alarm scene, a horn scene, and a crying scene.

13. The method comprises: sending instruction information to the terminal device, the instruction information retaining the target mode; and receiving a third control signal from the terminal device, the third control signal including a target processing strength in the target mode, the target processing strength indicating a processing strength to be used when the headset executes the target processing function; and the step of obtaining a second audio signal based on the target mode, the first audio signal, the first signal, and the second signal further comprises:

13. The method of claim 11 or 12, comprising obtaining the second audio signal based on the target mode, the target processing strength, the first audio signal, the first signal and the second signal.

14. when the target processing function is the ANC function, a greater target processing strength indicates a weaker user perception of the sounds in the current external environment and the environmental sounds in the user's ear canal; When the target processing function is the HT function, a greater target processing strength indicates a stronger user perception of the sound in the current external environment; or 14. The method of claim 7, 8 or 13, wherein when the target processing function is the AH function, a greater target processing strength indicates a stronger user perception of an event sound contained in the sound in the current external environment.

15. The method of claim 1 , wherein the headset is a left earphone or the headset is a right earphone.

16. The target mode instructs the headset to perform the ANC function, and the step of obtaining a second audio signal based on the target mode, the first audio signal, the first signal, and the second signal comprises: performing a first filtering process on the first signal to obtain a first filtered signal; filtering out the first audio signal included in the second signal to obtain a first filtered signal; performing an audio mixing process on the first filtered signal and the first filtered signal to obtain a third audio signal; performing a third filtering process on the third audio signal to obtain a fourth audio signal; and performing an audio mixing process on the fourth audio signal and the first audio signal to obtain the second audio signal; 16. The method of any one of claims 1 to 15, comprising:

17. the filtering coefficient used in the first filtering process is a filtering coefficient associated with a target processing strength for the first filtering process in the case of the ANC function; or The method of claim 16 , wherein the filtering coefficient used for the third filtering process is a filtering coefficient associated with a target processing strength for the third filtering process in case of the ANC function.

18. The target mode instructs the headset to perform the HT function, and the step of obtaining a second audio signal based on the target mode, the first audio signal, the first signal, and the second signal comprises: performing a first signal processing on the first signal to obtain a first processed signal, the first signal processing including a second filtering operation; performing an audio mixing process on the first processed signal and the first audio signal to obtain a fifth audio signal; filtering out the fifth audio signal included in the second signal to obtain a second filtered signal; performing a third filtering process on the second filtered signal to obtain a third filtered signal; and performing an audio mixing process on the third filtered signal and the fifth audio signal to obtain the second audio signal.

16. The method of any one of claims 1 to 15, comprising:

19. The filtering coefficients used for the second filtering process are filtering coefficients associated with a target processing strength for the second filtering process in the case of the HT function, or The method of claim 18 , wherein the filtering coefficient used for the third filtering process is a filtering coefficient associated with a target processing strength for the third filtering process in the case of the HT functionality.

20. The target mode instructs the headset to perform the AH function, and the step of obtaining a second audio signal based on the target mode, the first audio signal, the first signal, and the second signal comprises: performing a second filtering process on the first signal to obtain a second filtered signal, and performing an enhancement process on the second filtered signal to obtain the fifth signal; performing a first filtering process on the first signal to obtain a first filtered signal; performing an audio mixing process on the fifth signal and the first audio signal to obtain a sixth audio signal; filtering out the sixth audio signal included in the second signal to obtain a fourth filtered signal; performing a third filtering process on the fourth filtered signal to obtain the fourth signal; performing an audio mixing process on the fourth signal, the sixth audio signal, and the first filtered signal to obtain the second audio signal; 16. The method of any one of claims 1 to 15, comprising:

21. the filtering coefficient used for the first filtering process is a filtering coefficient associated with a target processing strength for the first filtering process in the case of the AH function; The filtering coefficient used for the second filtering process is a filtering coefficient associated with a target processing strength for the second filtering process in the case of the AH function, or The method of claim 20, wherein the filtering coefficient used for the third filtering process is a filtering coefficient associated with a target processing strength for the third filtering process in the case of the AH function.

22. A noise processing device, the noise processing device being applied to a headset, the headset having an active noise control (ANC) function or an environmental sound hear-through (HT) function, and a hearing enhancement (AH) function, the headset comprising a first microphone and a second microphone, the first microphone configured to collect a first signal, the first signal being indicative of a sound in a current external environment, the second microphone configured to collect a second signal, the second signal being indicative of an environmental sound in an ear canal of a user wearing the headset, the noise processing device comprising: a communication module configured to receive a first audio signal from a terminal device; an acquisition module configured to acquire a target mode, the target mode being determined based on a scene type of the current external environment, the target mode instructing the headset to perform a target processing function, the target processing function being one of the active noise control (ANC) function, the ambient sound hear-through (HT) function, or the hearing enhancement (AH) function; and a first processing module configured to obtain a second audio signal based on the target mode, the first audio signal, the first signal, and the second signal; Equipped with When the target processing function is the AH function, the second audio signal is obtained based on the first audio signal, a fifth signal, and a fourth signal, the fourth signal being an anti-phase signal of the second signal, and the fifth signal being an event signal in the first signal, and the event signal satisfies a preset spectrum. Device.

23. 23. The apparatus of claim 22, wherein the fifth signal is a station announcement sound and a whistle sound.

24. 24. The apparatus of claim 22 or 23, further comprising a playback module configured to play back the second audio signal.

25. When the target processing function is the ANC function, the second audio signal reproduced by the reproduction module is capable of attenuating the sound in the current external environment and the user's perception of the environmental sound in the ear canal of the user; When the target processing function is the HT function, the second audio signal reproduced by the reproduction module is capable of enhancing the user's perception of the sound in the current external environment; or 25. The device of claim 24, wherein when the target processing function is the AH function, the second audio signal played by the playback module is capable of enhancing user perception of an event sound, the event sound filling a preset spectrum.

26. When the target processing function is the ANC function, the second audio signal is obtained based on the first audio signal, a third signal, and a fourth signal, the third signal being an anti-phase signal of the first signal, and the fourth signal being an anti-phase signal of the second signal; or When the target processing function is the HT function, the second audio signal is obtained based on the first audio signal, the first signal, and the second signal.

26. Apparatus according to any one of claims 22 to 25.

27. The communication module further comprises: receiving a first control command from the terminal device, the first control command holding the target mode, the target mode being determined by the terminal device based on the scene type of the current external environment; and transmitting said desired mode to said acquisition module; 27. The apparatus of any one of claims 22 to 26, configured to:

28. The communication module is further configured to receive a second control command from the terminal device, the second control command carrying a target processing intensity, the target processing intensity indicating a processing intensity to be used when the headset executes the target processing function; 28. The apparatus of claim 27, wherein the first processing module is specifically configured to obtain the second audio signal based on the target mode, the target processing intensity, the first audio signal, the first signal and the second signal.

29. The device further comprises a second processing module configured to determine a target event corresponding to an event sound in the current external environment based on the first signal, and to determine a target processing strength for the target mode based on the target event, the target processing strength indicating a processing strength to be used when the headset performs the target processing function, different processing strengths corresponding to different events; 30. The apparatus of claim 28, wherein the first processing module is specifically configured to obtain the second audio signal based on the target mode, the target processing intensity, the first audio signal, the first signal, and the second signal.

30. the headset further comprises a bone conduction sensor, the bone conduction sensor configured to collect bone conduction signals generated by vibrations of the user's vocal cords; 30. The apparatus of claim 29, wherein the first processing module is specifically configured to determine the target event corresponding to the event sound in the current external environment based on the first signal and the bone conduction signal.

31. The apparatus of claim 30, wherein the target event is a feedback event, a wind noise event, an emergency event, or a voice event.

32. 27. The apparatus of any one of claims 22 to 26, further comprising a third processing module configured to identify the scene type of the current external environment as a target scene based on the first signal, and to determine the target mode of the headset based on the target scene, the target mode being a processing mode corresponding to the target scene, different processing modes corresponding to different scene types.

33. 33. The apparatus of claim 32, wherein the target scene is one of a walking scene, a running scene, a quiet scene, a multiple people talking scene, a cafe scene, a subway scene, a train scene, a waiting room scene, a dialogue scene, an office scene, an outdoor scene, a driving scene, a strong wind scene, an airplane scene, an alarm scene, a horn scene, and a crying scene.

34. The communication module further comprises: sending instruction information to the terminal device, the instruction information maintaining the target mode; and receiving a third control signal from the terminal device, the third control signal including a target processing strength in the target mode, the target processing strength indicating a processing strength to be used when the headset performs the target processing function; and the first processing module is specifically configured to obtain the second audio signal based on the target mode, the target processing intensity, the first audio signal, the first signal, and the second signal.

35. when the target processing function is the ANC function, a greater target processing strength indicates a weaker user perception of the sounds in the current external environment and the environmental sounds in the user's ear canal; When the target processing function is the HT function, a greater target processing strength indicates a stronger user perception of the sound in the current external environment; or 35. The apparatus of claim 28, 29 or 34, wherein when the target processing function is the AH function, a greater target processing strength indicates a stronger user perception of an event sound contained in the sounds in the current external environment.

36. 36. The apparatus of any one of claims 22 to 35, wherein the headset is a left earphone or the headset is a right earphone.

37. The target mode instructs the headset to perform the ANC function, and the first processing module specifically: performing a first filtering process on the first signal to obtain a first filtered signal; filtering out the first audio signal in the second signal to obtain a first filtered signal; performing an audio mixing process on the first filtered signal and the first filtered signal to obtain a third audio signal; performing a third filtering operation on the third audio signal to obtain a fourth audio signal; and performing an audio mixing process on the fourth audio signal and the first audio signal to obtain the second audio signal; 37. An apparatus according to any one of claims 22 to 36, configured to:

38. the filtering coefficient used in the first filtering process is a filtering coefficient associated with a target processing strength for the first filtering process in the case of the ANC function; or 38. The apparatus of claim 37, wherein the filtering coefficient used for the third filtering process is a filtering coefficient associated with a target processing strength for the third filtering process in the case of the ANC function.

39. The target mode instructs the headset to perform the HT function, and the first processing module specifically: performing a first signal processing on the first signal to obtain a first processed signal, the first signal processing including a second filtering operation; performing an audio mixing process on the first processed signal and the first audio signal to obtain a fifth audio signal; filtering out the fifth audio signal included in the second signal to obtain a second filtered signal; performing a third filtering operation on the second filtered signal to obtain a third filtered signal; and performing an audio mixing process on the third filtered signal and the fifth audio signal to obtain the second audio signal.

37. The apparatus of any one of claims 22 to 36, configured to:

40. The filtering coefficients used for the second filtering process are filtering coefficients associated with a target processing strength for the second filtering process in the case of the HT function, or 40. The apparatus of claim 39, wherein the filtering coefficient used for the third filtering process is a filtering coefficient associated with a target processing strength for the third filtering process in the case of the HT function.

41. The target mode instructs the headset to perform the AH function, and the first processing module specifically: performing a second filtering process on the first signal to obtain a second filtered signal, and performing an enhancement process on the second filtered signal to obtain the fifth signal; performing a first filtering process on the first signal to obtain a first filtered signal; performing an audio mixing process on the fifth signal and the first audio signal to obtain a sixth audio signal; filtering out the sixth audio signal included in the second signal to obtain a fourth filtered signal; performing a third filtering process on the fourth filtered signal to obtain the fourth signal; performing an audio mixing process on the fourth signal, the sixth audio signal, and the first filtered signal to obtain the second audio signal; 37. Apparatus according to any one of claims 22 to 36, configured to:

42. the filtering coefficient used for the first filtering process is a filtering coefficient associated with a target processing strength for the first filtering process in the case of the AH function; The filtering coefficient used for the second filtering process is a filtering coefficient associated with a target processing strength for the second filtering process in the case of the AH function, or 42. The apparatus of claim 41, wherein the filtering coefficient used for the third filtering process is a filtering coefficient associated with a target processing strength for the third filtering process in the case of the AH function.

43. 22. A target headset, the target headset comprising a left earphone and a right earphone, the left earphone configured to implement a method according to any one of claims 1 to 21, or the right earphone configured to implement a method according to any one of claims 1 to 21.

44. A target headset comprising a first microphone, a second microphone, a processor, a memory, and a speaker, the first microphone is configured to collect a first signal, the first signal being indicative of a sound in a current external environment; the second microphone is configured to collect a second signal, the second signal being indicative of an environmental sound in an ear canal of a user wearing the headset; the memory is configured to store programs or instructions; The processor is configured to invoke the program or instructions to enable the target headset to execute a method according to any one of claims 1 to 21 on the first signal and the second signal to obtain a second audio signal; The speaker is configured to reproduce the second audio signal.

Images