Sound processing method, equipment and medium

Abstract

The embodiment of the invention provides a sound processing method, equipment and a medium, and relates to the technical field of sound processing. The method comprises the steps that a first signal and a second signal are acquired, the first signal is a voice signal picked up by a bone conduction microphone from a user, and the second signal is a sound signal picked up by an air conduction microphone at an ear; a first adjustment signal is formed based on the first signal, a second adjustment signal is formed based on the second signal, the first adjustment signal is used for adjusting the intensity of a voice signal received in the ear canal from the user, and the second adjustment signal is used for adjusting the intensity of a sound signal received in the ear canal from the outside of the ear; and controlling the loudspeaker to play the first adjustment signal and the second adjustment signal. Therefore, the mutual influence between the processing of the sound from the outside of the ear and the processing of the sound speaking by the user is small, and the sound from the outside of the ear and the sound speaking by the user can be processed to achieve a good effect.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of sound processing technology, and in particular to a sound processing method, device, and medium. Background Art

[0002] Headphone devices, hearing aid devices, head-mounted display devices and other electronic devices are widely used in our lives. With the diversification of user needs, the functions of electronic devices are becoming more and more abundant. In some electronic devices, the function of processing sounds from outside the ear may be provided. For example, some users do not want to hear the sounds outside the ear when wearing electronic devices. The active noise reduction (ANC) function can be used to reduce or eliminate the sounds from outside the ear. For another example, when some users wear electronic devices, they want to hear the sounds from outside the ear as if they were not wearing headphones. The hear through (HT) function can be used to feel the sounds from outside the ear as if they were not wearing headphones. For another example, some users may have hearing impairments. When wearing electronic devices, the augmented hearing (AH) function can be used to increase the sounds from outside the ear.

[0003] Usually, when a user wears an electronic device such as earphones, hearing aids, or head-mounted display devices, the electronic device will block the ear canal. Since the ear canal is blocked by the electronic device, a closed chamber is formed inside the ear canal. At this time, the user's own speech will produce an occlusion effect, also known as the ear-blocking effect. In other words, when the user's ear canal is blocked by the electronic device, the sound of the user's own speech will appear "amplified" or "muffled", making the user feel uncomfortable and unnatural.

[0004] In some related technologies, an electronic device may include a microphone, and the microphone may be used to pick up a sound signal at the ear, so that the electronic device can form an adjustment signal for processing the sound from outside the ear according to the sound signal at the ear picked up by the microphone. In order to suppress the occlusion effect, an adjustment signal for suppressing the occlusion effect may be formed according to the sound signal obtained by the microphone in the ear canal to adjust the sound of the user's own speech so that the sound of the user's own speech is more natural. However, the processing effect of the electronic device on the sound signal from outside the ear will be affected by the effect of the adjustment signal formed to suppress the occlusion effect, resulting in the problem that the electronic device is prone to poor processing effect on the sound from outside the ear or poor processing of the sound of the user's own speech when processing the sound from outside the ear. Summary of the invention

[0005] The embodiments of the present application provide a sound processing method, device, and medium, which can reduce the mutual influence between the processing of sounds from outside the ear and the processing of the sound of the user's own speech, thereby facilitating the processing of both the sound from outside the ear and the sound of the user's own speech to achieve better results.

[0006] On the one hand, an embodiment of the present application provides a method for processing sound, which can be used in an electronic device, the electronic device including a bone conduction microphone, an air conduction microphone and a speaker. The method includes: obtaining a first signal and a second signal, the first signal being a voice signal from a user picked up by the bone conduction microphone, and the second signal being a sound signal picked up at the ear by the air conduction microphone; forming a first adjustment signal based on the first signal, and forming a second adjustment signal based on the second signal, the first adjustment signal being used to adjust the intensity of the voice signal from the user received in the ear canal, and the second adjustment signal being used to adjust the intensity of the sound signal from outside the ear received in the ear canal; and controlling the speaker to play the first adjustment signal and the second adjustment signal.

[0007] The bone conduction microphone picks up the voice signal from the user conducted in the bone, and the air conduction microphone picks up the sound signal conducted in the air at the ear. The second signal may include at least one of the sound signal outside the ear canal and the sound signal inside the ear canal. The sound signal outside the ear canal may include the sound signal from the external environment outside the ear canal and the voice signal from the user outside the ear canal conducted through the air outside the ear. The sound signal inside the ear canal may include the sound signal from the external environment inside the ear canal, the voice signal from the user inside the ear canal conducted through the air outside the ear, and the voice signal from the user inside the ear canal conducted from the bone to the air. The voice signal from the user received in the ear canal includes the voice signal from the user inside the ear canal conducted through the air outside the ear and the voice signal from the user inside the ear canal conducted from the bone to the air. The sound signal from outside the ear received in the ear canal includes the sound signal from the external environment inside the ear canal and the voice signal from the user inside the ear canal conducted through the air outside the ear.

[0008] The sound processing method provided by the embodiment of the present application can form a second adjustment signal for adjusting the intensity of the sound signal from outside the ear received in the ear canal through the second signal picked up by the air conduction microphone, so as to realize the function of processing the sound from outside the ear. When the electronic device processes the sound from outside the ear, the first signal picked up by the bone conduction microphone will not include the sound signal from outside the ear. The first adjustment signal will not affect the intensity of the sound signal from the external environment received in the ear canal during the process of adjusting the intensity of the voice signal from the user received in the ear canal, so that the electronic device can adjust the intensity of the voice signal from the user separately when processing the sound from outside the ear. The adjustment effect of the first adjustment signal and the adjustment effect of the second adjustment signal have little mutual influence, which is conducive to better weakening the occlusion effect without affecting the intensity of the sound signal from the external environment received in the ear canal, and the sound signal from the external environment and the voice signal from the user can be processed to a more ideal intensity. For example, in the active noise reduction mode, the voice signal from the user can be adjusted to the intensity when the electronic device is not worn, while taking into account a large amount of noise reduction. In transparent transmission mode, there is no need to amplify the sound signal picked up at the ear. The sound signal from the external environment and the voice signal from the user can also be adjusted to the intensity when the electronic device is not worn. The sound signal is not prone to clipping, and in scenes with wind noise, the wind noise will not be amplified.

[0009] In a possible implementation manner, controlling the speaker to play the first adjustment signal and the second adjustment signal includes: mixing at least the first adjustment signal and the second adjustment signal to form a mixed signal; and controlling the speaker to play the mixed signal.

[0010] In a possible implementation, the electronic device has at least one of the following extra-ear sound processing modes: a first active noise reduction mode, a second active noise reduction mode, or an enhanced mode, wherein both the first active noise reduction mode and the second active noise reduction mode are used to attenuate the sound signal from outside the ear received in the ear canal, and the attenuation amplitude of the first active noise reduction mode is smaller than that of the second active noise reduction mode, and the enhanced mode is used to enhance the sound signal from outside the ear received in the ear canal. Forming a first adjustment signal based on the first signal and forming a second adjustment signal based on the second signal includes: forming a first adjustment signal based on the first signal and forming a second adjustment signal based on the second signal according to the target extra-ear sound processing mode selected by the user.

[0011] In a possible embodiment, the above-mentioned forming a first adjustment signal based on the first signal and forming a second adjustment signal based on the second signal according to the target extra-ear sound processing mode selected by the user includes: determining a corresponding target filter parameter group in a pre-stored filter parameter set according to the target extra-ear sound processing mode selected by the user, wherein the filter parameter set includes at least one group of filter parameter groups corresponding to at least one extra-ear sound processing mode, and the filter parameter group includes a first filter parameter and a second filter parameter; forming a first adjustment signal according to the first signal and the first filter parameter in the target filter parameter group; forming a second adjustment signal according to the second signal and the second filter parameter in the target filter parameter group.

[0012] The target extra-auricular sound processing mode is one of at least one extra-auricular sound processing mode of the electronic device. The target filtering parameter group is one of at least one filtering parameter group of the pre-stored filtering parameter set.

[0013] In a possible implementation, the target extra-ear sound processing mode is a first active noise reduction mode. The first adjustment signal includes a first suppression signal, which is used to weaken the intensity of a voice signal from the user received in the ear canal and whose frequency is within a first preset frequency range; the second adjustment signal includes a second suppression signal, which is used to weaken the intensity of a sound signal from outside the ear received in the ear canal. The above-mentioned forming of the first adjustment signal according to the first signal and the first filter parameter in the target filter parameter group includes: forming the first suppression signal according to the first signal and the first filter parameter in the target filter parameter group. The above-mentioned forming of the second adjustment signal according to the second signal and the second filter parameter in the target filter parameter group includes: forming the second suppression signal according to the second signal and the second filter parameter in the target filter parameter group.

[0014] The first preset frequency range is within the range of frequencies of sound waves that can be felt by human ears. The voice signal from the user received in the ear canal and having a frequency within the first preset frequency range is a signal with enhanced intensity due to the occlusion effect.

[0015] Exemplarily, the first preset frequency range is less than or equal to 2000 Hz and greater than or equal to the minimum frequency of sound waves that can be felt by the human ear. For example, the minimum frequency of sound waves that can be felt by the human ear is 20 Hz, and the first preset frequency range is greater than or equal to 20 Hz and less than or equal to 2000 Hz.

[0016] In a possible implementation, the target extra-ear sound processing mode is a first active noise reduction mode. The first adjustment signal includes a second compensation signal, and the second compensation signal is used to enhance the strength of a voice signal from the user received in the ear canal and having a frequency within a second preset frequency range; the second adjustment signal includes a second suppression signal, and the second suppression signal is used to weaken the strength of a sound signal from outside the ear received in the ear canal. The above-mentioned formation of the first adjustment signal according to the first signal and the first filtering parameter in the target filtering parameter group includes: forming the second compensation signal according to the first signal and the first filtering parameter in the target filtering parameter group. The above-mentioned formation of the second adjustment signal according to the second signal and the second filtering parameter in the target filtering parameter group includes: forming the second suppression signal according to the second signal and the second filtering parameter in the target filtering parameter group.

[0017] The second preset frequency range is within the range of frequencies of sound waves that can be felt by human ears. The voice signal from the user received in the ear canal and having a frequency within the second preset frequency range is a signal with reduced intensity due to the occlusion effect.

[0018] Exemplarily, the second preset frequency range is greater than 2000 Hz and less than or equal to the maximum frequency of sound waves that can be felt by the human ear. For example, the maximum frequency of sound waves that can be felt by the human ear is 20000 Hz, and the second preset frequency range is greater than 2000 Hz and less than or equal to 20000 Hz.

[0019] In a possible implementation, the target extra-ear sound processing mode is a second active noise reduction mode. The first adjustment signal includes a first compensation signal, which is used to enhance the strength of a voice signal from the user received in the ear canal and whose frequency is within a first preset frequency range; the second adjustment signal includes a third suppression signal, which is used to weaken the strength of a sound signal from outside the ear received in the ear canal. The above-mentioned formation of the first adjustment signal according to the first signal and the first filtering parameter in the target filtering parameter group includes: forming a first compensation signal according to the first signal and the first filtering parameter in the target filtering parameter group. The above-mentioned formation of the second adjustment signal according to the second signal and the second filtering parameter in the target filtering parameter group includes: forming a third suppression signal according to the second signal and the second filtering parameter in the target filtering parameter group.

[0020] In a possible implementation, the target extra-ear sound processing mode is a second active noise reduction mode. The first adjustment signal includes a third compensation signal, and the third compensation signal is used to enhance the strength of a voice signal from the user received in the ear canal and whose frequency is within a second preset frequency range; the second adjustment signal includes a third suppression signal, and the third suppression signal is used to weaken the strength of a sound signal from outside the ear received in the ear canal. The above-mentioned formation of the first adjustment signal according to the first signal and the first filtering parameter in the target filtering parameter group includes: forming the third compensation signal according to the first signal and the first filtering parameter in the target filtering parameter group. The above-mentioned formation of the second adjustment signal according to the second signal and the second filtering parameter in the target filtering parameter group includes: forming the third suppression signal according to the second signal and the second filtering parameter in the target filtering parameter group.

[0021] In a possible implementation, the target extra-ear sound processing mode is an enhancement mode. The first adjustment signal includes a first reverse adjustment signal, which is used to weaken the strength of a voice signal from the user received in the ear canal and whose frequency is within a first preset frequency range; the second adjustment signal includes a first positive adjustment signal, which is used to enhance the strength of the sound signal from outside the ear received in the ear canal. The above-mentioned formation of the first adjustment signal according to the first signal and the first filter parameter in the target filter parameter group includes: forming a first reverse adjustment signal according to the first signal and the first filter parameter in the target filter parameter group. The above-mentioned formation of the second adjustment signal according to the second signal and the second filter parameter in the target filter parameter group includes: forming a first positive adjustment signal according to the second signal and the second filter parameter in the target filter parameter group.

[0022] In a possible implementation, the target extra-ear sound processing mode is an enhancement mode. The first adjustment signal includes a second reverse adjustment signal, the second reverse adjustment signal is used to weaken the strength of the voice signal from the user received in the ear canal and whose frequency is within a second preset frequency range; the second adjustment signal includes a first positive adjustment signal, the first positive adjustment signal is used to enhance the strength of the sound signal from outside the ear received in the ear canal. The above-mentioned formation of the first adjustment signal according to the first signal and the first filter parameter in the target filter parameter group includes: forming the second reverse adjustment signal according to the first signal and the first filter parameter in the target filter parameter group. The above-mentioned formation of the second adjustment signal according to the second signal and the second filter parameter in the target filter parameter group includes: forming the first positive adjustment signal according to the second signal and the second filter parameter in the target filter parameter group.

[0023] In a possible implementation, the target extra-ear sound processing mode is an enhancement mode. The first adjustment signal includes a second positive adjustment signal, and the second positive adjustment signal is used to enhance the strength of a voice signal from the user received in the ear canal and whose frequency is within a second preset frequency range; the second adjustment signal includes a first positive adjustment signal, and the first positive adjustment signal is used to enhance the strength of a sound signal from outside the ear received in the ear canal. The above-mentioned formation of the first adjustment signal according to the first signal and the first filter parameter in the target filter parameter group includes: forming the second positive adjustment signal according to the first signal and the first filter parameter in the target filter parameter group. The above-mentioned formation of the second adjustment signal according to the second signal and the second filter parameter in the target filter parameter group includes: forming the first positive adjustment signal according to the second signal and the second filter parameter in the target filter parameter group.

[0024] In a possible implementation, the method further includes: in a parameter setting mode, acquiring a third signal and a fourth signal, the parameter setting mode being used to set parameters in a filter parameter set, the third signal being a voice signal from a user picked up by a bone conduction microphone, and the fourth signal being a sound signal picked up in the ear canal by an air conduction microphone; and according to the third signal and the fourth signal, setting a corresponding filter parameter group for each of at least one extra-auricular sound processing mode.

[0025] The fourth signal is a sound signal in the ear canal. The fourth signal may include a voice signal from the user in the ear canal conducted through the air outside the ear and a voice signal from the user in the ear canal conducted from the bone to the air. The amplitude of the intensity change of the voice signal from the user received in the ear canal under the effect of the occlusion effect can be obtained through the third signal and the fourth signal, so that a corresponding filter parameter group can be set for each of the at least one extra-ear sound processing mode.

[0026] In a possible implementation, the above-mentioned setting of a corresponding filter parameter group for each of at least one extra-ear sound processing mode according to the third signal and the fourth signal includes: setting a first filter parameter in the filter parameter group corresponding to each of at least one extra-ear sound processing mode according to the third signal and the fourth signal, and a second filter parameter preset in the filter parameter group corresponding to each of at least one extra-ear sound processing mode.

[0027] Another aspect of the present application embodiment provides an electronic device, including a bone conduction microphone, an air conduction microphone, a speaker, a processor and a memory. The bone conduction microphone is used to pick up a voice signal from a user. The air conduction microphone is used to pick up a sound signal at the ear. The speaker is used to play the signal. The memory stores computer-executable instructions. The processor executes the computer-executable instructions stored in the memory, so that the electronic device executes the method in any of the above embodiments.

[0028] On the other hand, the embodiments of the present application provide a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the method in any of the above embodiments is implemented.

[0029] Another aspect of the embodiments of the present application provides a computer program product, including a computer program, which enables a computer to execute any of the methods in the above-mentioned embodiments when the computer program is executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 A schematic diagram of an electronic device of an audio system provided by an embodiment of the present application being worn on the ear;

[0031] Figure 2 A schematic diagram of an audio system provided in an embodiment of the present application;

[0032] Figure 3 A schematic diagram of a wearable component of an electronic device provided in an embodiment of the present application being worn on the ear;

[0033] Figure 4 A schematic diagram of an electronic device provided in an embodiment of the present application;

[0034] Figure 5 for Figure 3 A schematic diagram of a wearable component of an electronic device;

[0035] Figure 6 A schematic diagram of a wearable component of another electronic device provided in an embodiment of the present application being worn on the ear;

[0036] Figure 7 for Figure 6 A schematic diagram of a wearable component of an electronic device;

[0037] Figure 8 A schematic diagram of a wearable component of another electronic device provided in an embodiment of the present application being worn on the ear;

[0038] Fig. 9 for Figure 8 A schematic diagram of a wearable component of an electronic device;

[0039] Fig.10A flowchart of a sound processing method provided in an embodiment of the present application.

[0040] Description of reference numerals:

[0041] 10. Electronic equipment;

[0042] 100. Wearing components;

[0043] 110, housing; 120, air conduction microphone; 121, feedforward microphone; 122, feedback microphone; 130, speaker; 140, processor; 141, feedforward signal processing unit; 142, feedback signal processing unit; 143, bone conduction signal processing unit; 144, signal mixing unit; 150, memory; 160, communication module; 170, communication line; 180, bone conduction microphone;

[0044] 20. Control equipment;

[0045] 30. Ear; 31. Ear canal; 32. Eardrum. DETAILED DESCRIPTION

[0046] The terms used in the implementation method part of this application are only used to explain the specific embodiments of this application, and are not intended to limit this application. The implementation method of the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0047] Figure 1 A schematic diagram of an electronic device of an audio system provided in an embodiment of the present application being worn on the ear.

[0048] like Figure 1 As shown, an embodiment of the present application provides an audio system, which includes an electronic device 10, and the electronic device 10 may include but is not limited to a headphone device, a hearing aid device, a head-mounted display device, a helmet device, etc. that can be worn at a user's ear 30. The embodiment of the present application takes the electronic device 10 as an example of a headphone device for explanation.

[0049] In terms of wearing style, the electronic device 10 may include but is not limited to a head-mounted device, an ear-hook device, a neck-hook device, an earplug device, etc. The earplug device may be an in-ear device or a semi-in-ear device.

[0050] In the embodiment of the present application, the electronic device 10 may have a function of processing the sound from outside the ear. For example, the electronic device 10 may have at least one of an active noise reduction function or an external ear sound enhancement function. Correspondingly, the electronic device 10 may have at least one of the following external ear sound processing modes: an active noise reduction mode or an enhancement mode. The active noise reduction mode is used to reduce the sound signal from outside the ear received in the ear canal 31. The enhancement mode is used to enhance the sound signal from outside the ear received in the ear canal 31.

[0051] The active noise reduction mode can be used to weaken all sound signals from outside the ear received in the ear canal 31. The active noise reduction mode can also be used to weaken part of the sound signals from outside the ear received in the ear canal 31. For example, the active noise reduction mode can be used to weaken the sound signal from outside the ear received in the ear canal 31 and satisfying the first preset spectrum. It should be noted that at least one external ear sound processing mode of the electronic device 10 may include one or more active noise reduction modes. For example, at least one external ear sound processing mode of the electronic device 10 may include two active noise reduction modes, one of which is used to weaken all sound signals from outside the ear received in the ear canal 31, and the other is used to weaken the sound signal from outside the ear received in the ear canal 31 and satisfying the first preset spectrum. For another example, at least one external ear sound processing mode of the electronic device 10 may include two active noise reduction modes, one of which has a greater attenuation amplitude of the sound signal from outside the ear received in the ear canal 31 than the other active noise reduction mode.

[0052] The enhancement mode can be used to enhance all sound signals from outside the ear received in the ear canal 31. The enhancement mode can also be used to enhance part of the sound signals from outside the ear received in the ear canal 31. For example, the enhancement mode can be used to enhance the sound signals from a specific direction outside the ear received in the ear canal 31. For another example, the enhancement mode can be used to enhance the sound signals from outside the ear received in the ear canal 31 and meeting the second preset spectrum. It should be noted that at least one external ear sound processing mode of the electronic device 10 may include one or more enhancement modes. For example, at least one external ear sound processing mode of the electronic device 10 may include three enhancement modes, one of which is used to enhance all sound signals from outside the ear received in the ear canal 31, another enhancement mode is used to enhance the sound signals from a specific direction outside the ear received in the ear canal 31, and another enhancement mode is used to enhance the sound signals from outside the ear received in the ear canal 31 and meeting the second preset spectrum. For another example, at least one external ear sound processing mode of the electronic device 10 may include two enhancement modes, one of which has a greater enhancement amplitude for the sound signal from outside the ear received in the ear canal 31 than the other enhancement mode.

[0053] Exemplarily, at least one external ear sound processing mode of the electronic device 10 may include a transparent transmission mode, which may be used to enhance the sound signal from outside the ear received in the ear canal 31 to achieve transparent transmission of the sound from outside the ear, so that the user can feel the sound from outside the ear as if the electronic device 10 is not worn at the ear 30, and the transparent transmission mode is an enhanced mode. It should be noted that at least one external ear sound processing mode of the electronic device 10 may include one or more transparent transmission modes. For example, at least one external ear sound processing mode of the electronic device 10 may include two transparent transmission modes, one of which is used to enhance the transparent transmission mode of the sound signal from a specific direction outside the ear received in the ear canal 31, and the other is used to enhance the sound signal from outside the ear received in the ear canal 31 and meeting the second preset spectrum.

[0054] It should be noted that at least one extra-ear sound processing mode of the electronic device 10 may include an extra-ear sound processing mode for weakening part of the sound signals from outside the ear received in the ear canal 31 and enhancing part of the sound signals. This extra-ear sound processing mode can be regarded as an active noise reduction mode or an enhancement mode.

[0055] Figure 2 A schematic diagram of an audio system provided in an embodiment of the present application.

[0056] In some examples, the audio system may further include a control device 20, and the electronic device 10 is connected to the control device 20, and the connection between the electronic device 10 and the control device 20 may be a wireless connection or a wired connection. For the wireless connection, for example, the connection may be made through Bluetooth (BT) technology, wireless high fidelity (Wi-Fi) technology, infrared (IR) technology, ultra-wideband technology, etc.

[0057] In some examples where the audio system includes a control device 20, the control device 20 may be used to send a downlink audio signal and / or a control signaling to the electronic device 10. For example, the control signaling is used to control the processing mode adopted by the electronic device 10. The processing mode of the electronic device 10 may include a null mode that does not process the sound from outside the ear and at least one external ear sound processing mode. For example, the processing mode adopted by the electronic device 10 may include a null mode, an active noise reduction mode, an enhancement mode, etc.

[0058] Exemplarily, the downlink audio signal may be a music signal or a call signal, etc.

[0059] The control device 20 may include but is not limited to a mobile phone, a computer, a vehicle-mounted device, a smart watch, and the like that can be used to control the electronic device 10 .

[0060] In some examples, for example, when the electronic device 10 is a hearing aid or the like, the audio system may not include the control device 20 .

[0061] Exemplarily, for an audio system including a control device 20, when selecting a processing mode of an electronic device 10, the control device 20 may provide a control interface, and the control interface may include a selection control for selecting a processing mode, so that the user can select the processing mode of the electronic device 10 according to needs. The user can operate the selection control on the control interface to send a control signal to the electronic device 10, and the control signal is used to control the electronic device 10 to operate according to the selected processing mode.

[0062] Exemplarily, when selecting a processing mode of the electronic device 10, the electronic device 10 may determine the processing mode of the electronic device 10 selected by the user by identifying the user's operation. For example, the user's operation may be an operation of the user tapping the electronic device 10, or the electronic device 10 has buttons, different buttons correspond to different processing modes, and the user's operation may be an operation of pressing the corresponding button.

[0063] like Figure 1 As shown, in an embodiment of the present application, the electronic device 10 may include a wearing component 100, which is used to be worn on the ear 30 of the user. The wearing component 100 picks up sound signals at the ear 30 of the user and processes the sound signals from outside the ear received in the ear canal 31 of the user.

[0064] In some examples, the electronic device 10 may include a wearing component 100, which may be a left-ear wearing component for wearing at the left ear of the user, the left-ear wearing component picks up sound signals at the left ear of the user, and processes the sound signals from outside the ear received in the ear canal 31 of the left ear of the user. The wearing component 100 may also be a right-ear wearing component for wearing at the right ear of the user, the right-ear wearing component picks up sound signals at the right ear of the user, and processes the sound signals from outside the ear received in the ear canal 31 of the right ear of the user.

[0065] In some examples, the electronic device 10 may include two wearing components 100. One of the wearing components 100 is a left-ear wearing component for wearing at the left ear of the user, the left-ear wearing component picks up sound signals at the left ear of the user, and processes the sound signals from outside the ear received in the ear canal 31 of the left ear of the user. The other wearing component 100 is a right-ear wearing component for wearing at the right ear of the user, the right-ear wearing component picks up sound signals at the right ear of the user, and processes the sound signals from outside the ear received in the ear canal 31 of the right ear of the user.

[0066] In an example where the electronic device 10 is an earphone device, the wearable component 100 may be an earphone.

[0067] In the example where the electronic device 10 is a helmet device, the electronic device 10 may also include a helmet, and the wearing assembly 100 may be installed in the helmet.

[0068] In an example where the electronic device 10 includes a left-ear worn component and a right-ear worn component, the left-ear worn component and the right-ear worn component may adopt the same processing mode or different processing modes.

[0069] In some examples where the electronic device 10 includes a left-ear worn component and a right-ear worn component, for an audio system including a control device 20, when selecting a processing mode of the electronic device 10, the control interface of the control device 20 may include two selection controls, one of which is used to select a processing mode for the left-ear worn component and the other is used to select a processing mode for the right-ear worn component.

[0070] When the electronic device 10 includes two wearing components 100, the structures of the two wearing components 100 are similar. Below, we take one wearing component 100 as an example to illustrate the structure of the wearing component 100 of the electronic device 10, and the wearing component 100 can be a left ear wearing component or a right ear wearing component.

[0071] Figure 3 A schematic diagram of a wearable component of an electronic device provided in an embodiment of the present application being worn on the ear.

[0072] like Figure 3As shown, in the embodiment of the present application, the wearing component 100 includes a housing 110, an air conduction microphone 120, a speaker 130 and a processor 140, and the air conduction microphone 120, the speaker 130 and the processor 140 are all installed on the housing 110, and the housing 110 is used to be worn at the ear 30 of the user. The air conduction microphone 120 is connected to the processor 140, and the processor 140 is connected to the speaker 130. After the electronic device 10 is worn at the ear 30 of the user, the air conduction microphone 120 can be used to pick up the sound signal conducted in the air at the ear 30, and transmit the channel sound signal to the processor 140 for processing. The processor 140 can form an adjustment signal according to the sound signal picked up by the air conduction microphone 120, and the adjustment signal is used to adjust the intensity of the sound signal from the outside of the ear received in the ear canal 31, and the speaker 130 is used to play the adjustment signal formed by the processor 140 according to the sound signal picked up by the air conduction microphone 120, so as to adjust the intensity of the sound signal from the outside of the ear received in the ear canal 31 in the ear canal 31. The adjustment signal formed according to the sound signal picked up by the air conduction microphone 120 may include a signal with a phase opposite to that of the sound signal from outside the ear, so as to weaken the strength of the sound signal from outside the ear received in the ear canal 31. The adjustment signal formed according to the sound signal picked up by the air conduction microphone 120 may include a signal with a phase identical to that of the sound signal from outside the ear, so as to enhance the strength of the sound signal from outside the ear received in the ear canal 31.

[0073] The air conduction microphone 120 can pick up a sound signal conducted in the air by acquiring vibrations of the air and analyzing the acquired vibrations. The wearable component 100 may include one or more air conduction microphones 120 .

[0074] The wearable assembly 100 may include one or more speakers 130 .

[0075] Figure 4 A schematic diagram of an electronic device provided in an embodiment of the present application.

[0076] like Figure 4As shown, the electronic device 10 may further include a memory 150, the memory 150 is used to store computer-executable instructions, and the processor 140 is used to execute the computer-executable instructions stored in the memory 150 to implement the functions of the wearable component 100. The memory 150 may include one or more of a random access memory (RAM), a flash memory, a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a register, a hard disk, a mobile hard disk, a CD-ROM, or any other form of storage medium known in the art.

[0077] Exemplarily, the memory 150 may be installed in the housing 110 , that is, the wearing assembly 100 may include the memory 150 .

[0078] like Figure 3 , Figure 4 As shown, the electronic device 10 may further include a communication module 160 for establishing a communication connection between the electronic device 10 and the control device 20. The communication module 160 may be arranged in the housing 110, that is, the wearable component may include the communication module 160. The communication module 160 may be a wired communication module or a wireless communication module. The wireless communication module may include one or more wireless communication units such as a wireless fidelity technology unit, a Bluetooth technology unit, a near field communication (NFC) technology unit, an infrared technology unit, an ultra-wideband technology unit, and the like. For example, the communication module 160 may include a Bluetooth technology unit, and the electronic device 10 and the control device 20 may be connected via Bluetooth technology.

[0079] The processor 140 , the memory 150 , the communication module 160 , the air conduction microphone 120 , and the speaker 130 may communicate with each other via the communication line 170 .

[0080] The processor 140 may include a main control unit (not shown) and at least one signal processing unit. The main control unit and the signal processing unit may be integrated on one chip, or on separate chips. The air conduction microphone 120, the speaker 130, and the signal processing unit may all be connected to the main control unit, the air conduction microphone 120 may be connected to the signal processing unit, and the signal processing unit may be connected to the speaker 130.

[0081] The main control unit may be used to control the working sequence of each component of the electronic device 10, configure the working parameters of each component of the electronic device 10, etc. Exemplarily, the main control unit may include one or more of an ARM processing chip, a central processing unit (CPU), a system on chip (SoC), or a microcontroller unit (MCU).

[0082] The signal processing unit may be used to process the acquired signal, such as filtering, signal strength adjustment, signal mixing, etc. Exemplarily, the signal processing unit may include one or more of a coder-decoder (CODEC) chip or a high-fidelity (HiFi) chip, etc.

[0083] The at least one signal processing unit may include at least one air conduction signal processing unit, the air conduction microphone 120 is connected to the air conduction signal processing unit, and the air conduction microphone 120 is connected to the main control unit and the speaker 130 respectively.

[0084] Figure 5 for Figure 3 Schematic diagram of wearable components of an electronic device.

[0085] like Figure 5 As shown, and see Figure 3 Exemplarily, the wearing component 100 may include a feedforward microphone 121, which is an air conduction microphone 120, and at least one air conduction signal processing unit may include a feedforward signal processing unit 141. The feedforward microphone 121 and the feedforward signal processing unit 141 are both connected to the main control unit, the feedforward microphone 121 is connected to the feedforward signal processing unit 141, and the feedforward signal processing unit 141 is connected to the speaker 130. After the wearing component 100 is worn on the user's ear 30, the feedforward microphone 121 is located outside the ear canal 31, the speaker 130 is located between the feedforward microphone 121 and the eardrum 32, and the feedforward microphone 121 is used to pick up the sound signal conducted in the air outside the ear canal 31. The feedforward signal processing unit 141 forms an adjustment signal for adjusting the intensity of the sound signal from outside the ear received in the ear canal 31 according to the sound signal picked up by the feedforward microphone 121.

[0086] The wearable assembly 100 may include one or more feed-forward microphones 121 .

[0087] The sound signal outside the ear canal 31 may include a sound signal from the external environment outside the ear canal 31 and a voice signal from the user outside the ear canal 31 conducted through the air outside the ear.

[0088] In some examples where the wearable component 100 includes a feedforward microphone 121, at least one signal processing unit further includes a signal mixing unit 144, the signal mixing unit 144 is connected to the main control unit, the feedforward signal processing unit 141 is connected to the signal mixing unit 144, and the signal mixing unit 144 is connected to the speaker 130, so that the feedforward microphone 121 is connected to the speaker 130 through the signal mixing unit 144. The signal mixing unit 144 is used to mix the signals it obtains, and the speaker 130 can be used to play the mixed signal formed by the mixing of the signal mixing unit 144.

[0089] In some examples where the wearable assembly 100 includes the feedforward microphone 121 , the at least one signal processing unit may also not include the signal mixing unit 144 .

[0090] Figure 6 A schematic diagram of a wearable component of another electronic device provided in an embodiment of the present application being worn on the ear, Figure 7 for Figure 6 Schematic diagram of wearable components of an electronic device.

[0091] like Figure 6 , Figure 7 As shown, exemplarily, the wearing component 100 may include a feedback microphone 122, the feedback microphone 122 is an air conduction microphone 120, and at least one air conduction signal processing unit may include a feedback signal processing unit 142. The feedback microphone 122 and the feedback signal processing unit 142 are both connected to the main control unit, the feedback microphone 122 is connected to the feedback signal processing unit 142, and the feedback signal processing unit 142 is connected to the speaker 130. After the wearing component 100 is worn on the user's ear 30, the feedback microphone 122 is located inside the ear canal 31, and the feedback microphone 122 is used to pick up the sound signal conducted in the air in the ear canal 31. The feedback microphone 122 can be located between the speaker 130 and the eardrum 32. The feedback signal processing unit 142 forms an adjustment signal for adjusting the intensity of the sound signal from outside the ear received in the ear canal 31 according to the sound signal picked up by the feedback microphone 122.

[0092] The wearable assembly 100 may include one or more feedback microphones 122 .

[0093] The sound signals in the ear canal 31 may include sound signals from the external environment in the ear canal 31, voice signals from the user in the ear canal 31 conducted through the air outside the ear, and voice signals from the user in the ear canal 31 conducted from the bones to the air.

[0094] In some examples where the wearable component 100 includes a feedback microphone 122, at least one signal processing unit also includes a signal mixing unit 144, the signal mixing unit 144 is connected to the main control unit, the feedback signal processing unit 142 is connected to the signal mixing unit 144, and the signal mixing unit 144 is connected to the speaker 130, so that the feedback microphone 122 is connected to the speaker 130 via the signal mixing unit 144.

[0095] In some examples where the wearable assembly 100 includes the feedback microphone 122 , the at least one signal processing unit may also not include the signal mixing unit 144 .

[0096] Figure 8 A schematic diagram of a wearable component of another electronic device provided in an embodiment of the present application being worn on the ear, Fig. 9 for Figure 8 Schematic diagram of wearable components of an electronic device.

[0097] like Figure 8 , Fig. 9 As shown, exemplarily, the wearing component 100 may include a feedforward microphone 121 and a feedback microphone 122. At least one air conduction signal processing unit may include a feedforward signal processing unit 141 and a feedback signal processing unit 142, the feedforward microphone 121, the feedback microphone 122, the feedforward signal processing unit 141 and the feedback signal processing unit 142 are all connected to the main control unit, the feedforward microphone 121 is connected to the feedforward signal processing unit 141, the feedback microphone 122 is connected to the feedback signal processing unit 142, and the feedforward signal processing unit 141 and the feedback signal processing unit 142 are both connected to the speaker 130. The feedforward signal processing unit 141 forms a first sub-adjustment signal according to the sound signal picked up outside the ear canal 31 by the feedforward microphone 121, and the feedback signal processing unit 142 forms a second sub-adjustment signal according to the sound signal picked up inside the ear canal 31 by the feedback microphone 122, and the first sub-adjustment signal and the second sub-adjustment signal form an adjustment signal for adjusting the intensity of the sound signal from outside the ear received in the ear canal 31. That is, the processor 140 forms an adjustment signal for adjusting the intensity of the sound signal from outside the ear received in the ear canal 31 based on the sound signal outside the ear canal 31 picked up by the feedforward microphone 121 and the sound signal inside the ear canal 31 picked up by the feedback microphone 122.

[0098] The wearable assembly 100 may include one or more feedforward microphones 121 and one or more feedback microphones 122 .

[0099] In some examples where the wearable component 100 includes a feedforward microphone 121 and a feedback microphone 122, at least one signal processing unit further includes a signal mixing unit 144, the signal mixing unit 144 is connected to the main control unit, the feedforward signal processing unit 141 and the feedback signal processing unit 142 are both connected to the signal mixing unit 144, and the signal mixing unit 144 is connected to the speaker 130, so that the feedforward signal processing unit 141 and the feedback signal processing unit 142 are both connected to the speaker 130 through the signal mixing unit 144. The signal mixing unit 144 mixes at least the first sub-adjustment signal and the second sub-adjustment signal to form a mixed signal, and the speaker 130 plays the mixed signal including the first sub-adjustment signal and the second sub-adjustment signal.

[0100] In some examples where the wearable assembly 100 includes the feedforward microphone 121 and the feedback microphone 122 , the at least one signal processing unit may also not include the signal mixing unit 144 .

[0101] In some examples, the electronic device 10 further includes a rubber sleeve (not shown), which is mounted on the surface of the housing 110 and is used to fully fit the ear canal 31 of the user so that the user can obtain a better passive noise reduction effect.

[0102] Generally, the user hears the sound of his own speech mainly in the following ways: first, the voice signal from the user conducted in the bone stimulates the auditory nerve; second, the voice signal from the user received in the ear canal 31 causes the eardrum 32 to vibrate, and the vibrating eardrum 32 stimulates the auditory nerve. Among them, the voice signal from the user received in the ear canal 31 can include the voice signal from the user in the ear canal 31 conducted through the air outside the ear and the voice signal from the user in the ear canal 31 conducted from the bone to the air. After the wearing component 100 is worn at the ear 30, the wearing component 100 will block the ear canal opening. Since the ear canal opening is blocked by the wearing component 100, a closed chamber is formed in the ear canal 31. At this time, the user's own speech will produce an occlusion effect, which can also be called an ear blocking effect. That is to say, after the ear canal opening of the user is blocked by the wearing component 100, the intensity of the voice signal from the user received in the ear canal 31 within some frequency ranges will be enhanced due to the formation of a closed chamber in the ear canal 31. The intensity of the voice signal from the user within other frequency ranges received in the ear canal 31 will be weakened due to the closed chamber formed by the ear canal 31, causing the sound of the user's own voice to appear "amplified" or "muffled", making the user feel uncomfortable and unnatural.

[0103] In order to suppress the occlusion effect, in some related technologies, an adjustment signal for suppressing the occlusion effect can be formed based on the sound signal in the ear canal picked up by the air conduction microphone in the ear canal to adjust the strength of the voice signal from the user received in the ear canal. However, the sound signal in the ear canal obtained by the air conduction microphone in the ear canal includes not only the voice signal from the user but also the sound signal from the external environment, and it is difficult to separate the voice signal from the user from the sound signal from the external environment. Therefore, the adjustment signal formed based on the sound signal in the ear canal picked up by the air conduction microphone in the ear canal will not only adjust the strength of the voice signal from the user received in the ear canal, but also adjust the strength of the sound signal from the external environment received in the ear canal. When the electronic device is in the extra-ear sound processing mode, since the sound signal picked up at the ear by the air conduction microphone includes the sound signal from the external environment and the voice signal from the user conducted through the air, when the adjustment signal formed according to the sound signal obtained at the ear by the air conduction microphone adjusts the intensity of the sound signal from outside the ear received in the ear canal, in addition to adjusting the intensity of the sound signal from the external environment received in the ear canal, the intensity of the voice signal from the user received in the ear canal will also be adjusted. In this way, when the electronic device is in the extra-ear sound processing mode, the processing effect of the electronic device on the sound signal from outside the ear will be affected by the effect of the adjustment signal formed for suppressing the occlusion effect, resulting in the problem that when the electronic device processes the sound from outside the ear, the processing effect of the sound from outside the ear or the sound of the user's own speech is poor.

[0104] For example, when an electronic device is in active noise reduction mode, if a larger noise reduction amount is considered, the voice signal from the user is likely to be over-attenuated, resulting in the user hearing a smaller voice of his own voice. If the voice signal from the user is adjusted to the intensity when the electronic device is not worn, the sound signal from the external environment is likely to be insufficiently attenuated, resulting in a poor noise reduction effect. For another example, when an electronic device is in transparent transmission mode, since it is necessary to attenuate the voice signal from the user within some frequency ranges, and attenuating the voice signal from the user will also cause the sound signal from the external environment to be attenuated, in order to prevent the user from hearing too little sound from the external environment, the sound signal picked up at the ear is often amplified first, and then an adjustment signal is formed to attenuate the voice signal from the user and the sound signal from the external environment. However, due to the limitation of the processor on the amplitude of signal processing, the amplified sound signal is prone to clipping. In addition, in a scene with wind noise, after the sound signal picked up at the ear is amplified, the wind noise will also increase accordingly.

[0105] Based on this, Figure 3-Figure 5As shown, in the embodiment of the present application, the wearable component 100 of the electronic device 10 further includes a bone conduction microphone 180, which is mounted on the housing 110. After the wearable component 100 is worn on the ear 30, the bone conduction microphone 180 can contact the ear 30, and the bone conduction microphone 180 is connected to the processor 140. The bone conduction microphone 180 is used to pick up a voice signal from the user and transmit the picked up voice signal from the user to the processor 140 for processing. The processor 140 can form an adjustment signal for adjusting the intensity of the voice signal from the user received in the ear canal 31 according to the voice signal from the user picked up by the bone conduction microphone 180. The speaker 130 is also used to play the adjustment signal formed by the processor 140 according to the voice signal from the user picked up by the bone conduction microphone 180, so as to adjust the intensity of the voice signal from the user received in the ear canal 31 in the ear canal 31. The adjustment signal formed according to the voice signal from the user picked up by the bone conduction microphone 180 may include a signal with a phase opposite to that of the voice signal from the user to weaken the strength of the voice signal from the user received in the ear canal 31. The adjustment signal formed according to the voice signal from the user picked up by the bone conduction microphone 180 may include a signal with a phase identical to that of the voice signal from the user to enhance the strength of the voice signal from the user received in the ear canal 31.

[0106] The bone conduction microphone 180 can pick up a voice signal from the user conducted in the bone by acquiring bone vibration and analyzing the acquired vibration.

[0107] The bone conduction microphone 180 and the processor 140 may communicate with each other via the communication line 170 .

[0108] The at least one signal processing unit further includes a bone conduction signal processing unit 143. Both the bone conduction microphone 180 and the bone conduction signal processing unit 143 may be connected to the main control unit. The bone conduction microphone 180 is connected to the bone conduction signal processing unit 143, and the bone conduction signal processing unit 143 is connected to the speaker 130. The bone conduction signal processing unit 143 forms an adjustment signal for adjusting the strength of the voice signal from the user received in the ear canal 31 according to the voice signal from the user picked up by the bone conduction microphone 180.

[0109] In the example where at least one signal processing unit also includes a signal mixing unit 144, the bone conduction signal processing unit 143 and the air conduction signal processing unit may both be connected to the signal mixing unit 144, so that the bone conduction signal processing unit 143 and the air conduction signal processing unit are both connected to the speaker 130 via the signal mixing unit 144.

[0110] In an example where at least one signal processing unit does not include the signal mixing unit 144 , the bone conduction signal processing unit 143 and the air conduction signal processing unit are connected to the speaker 130 , respectively.

[0111] like Figure 3 , Figure 5 As shown, in some examples where the wearable component 100 includes a feedforward microphone 121, at least one signal processing unit also includes a signal mixing unit 144, the feedforward signal processing unit 141 and the bone conduction signal processing unit 143 can both be connected to the signal mixing unit 144, and the adjustment signal formed by the feedforward signal processing unit 141 and the adjustment signal formed by the bone conduction signal processing unit 143 are both transmitted to the signal mixing unit 144, and the signal mixing unit 144 is used to mix the adjustment signal formed by at least the feedforward signal processing unit 141 and the adjustment signal formed by the bone conduction signal processing unit 143.

[0112] like Figure 6 , Figure 7 As shown, in some examples where the wearable component 100 includes a feedback microphone 122, at least one signal processing unit also includes a signal mixing unit 144, and the feedback signal processing unit 142 and the bone conduction signal processing unit 143 can both be connected to the signal mixing unit 144, and the adjustment signal formed by the feedback signal processing unit 142 and the adjustment signal formed by the bone conduction signal processing unit 143 are both transmitted to the signal mixing unit 144, and the signal mixing unit 144 is used to mix at least the adjustment signal formed by the feedback signal processing unit 142 and the adjustment signal formed by the bone conduction signal processing unit 143.

[0113] like Figure 8 , Fig. 9 As shown, in some examples where the wearable component 100 includes a feedforward microphone 121 and a feedback microphone 122, at least one signal processing unit also includes a signal mixing unit 144, and the feedforward signal processing unit 141, the feedback signal processing unit 142, and the bone conduction signal processing unit 143 are all connected to the signal mixing unit 144, and the first sub-adjustment signal formed by the feedforward signal processing unit 141, the second sub-adjustment signal formed by the feedback signal processing unit 142, and the adjustment signal formed by the bone conduction signal processing unit 143 are all transmitted to the signal mixing unit 144, and the signal mixing unit 144 is used to mix at least the first sub-adjustment signal formed by the feedforward signal processing unit 141, the second sub-adjustment signal formed by the feedback signal processing unit 142, and the adjustment signal formed by the bone conduction signal processing unit 143.

[0114] Fig.10 A flowchart of a sound processing method provided in an embodiment of the present application.

[0115] like Fig.10As shown, an embodiment of the present application provides a sound processing method, which can be applied to the above-mentioned electronic device 10.

[0116] The method includes:

[0117] S300 : Acquire a first signal and a second signal, the first signal being a voice signal from the user picked up by the bone conduction microphone 180 , and the second signal being a sound signal picked up at the ear 30 by the air conduction microphone 120 .

[0118] The bone conduction microphone 180 picks up a voice signal from the user that is conducted in the bone, and the air conduction microphone 120 picks up a sound signal that is conducted in the air at the ear 30. The second signal may include at least one of a sound signal outside the ear canal 31 and a sound signal inside the ear canal 31. The sound signal outside the ear canal 31 may be picked up by the feedforward microphone 121, and the sound signal outside the ear canal 31 may include a sound signal from the external environment outside the ear canal 31 and a voice signal from the user that is conducted through the air outside the ear outside the ear outside the ear canal 31. The sound signal inside the ear canal 31 may be picked up by the feedback microphone 122, and the sound signal inside the ear canal 31 may include a sound signal from the external environment inside the ear canal 31, a voice signal from the user that is conducted through the air outside the ear inside the ear canal 31, and a voice signal from the user that is conducted from the bone to the air inside the ear canal 31.

[0119] S400: A first adjustment signal is formed based on the first signal, and a second adjustment signal is formed based on the second signal, wherein the first adjustment signal is used to adjust the intensity of the voice signal from the user received in the ear canal 31, and the second adjustment signal is used to adjust the intensity of the sound signal from outside the ear received in the ear canal 31.

[0120] The bone conduction signal processing unit 143 is used to form a first adjustment signal based on the first signal, and the air conduction signal processing unit is used to form a second adjustment signal based on the second signal.

[0121] When the second signal includes the sound signal outside the ear canal 31 but does not include the sound signal inside the ear canal 31 , the feedforward signal processing unit 141 is configured to form a second adjustment signal based on the sound signal outside the ear canal 31 .

[0122] When the second signal includes the sound signal in the ear canal 31 but does not include the sound signal outside the ear canal 31 , the feedback signal processing unit 142 is configured to form a second adjustment signal based on the sound signal in the ear canal 31 .

[0123] When the second signal includes a sound signal outside the ear canal 31 and a sound signal inside the ear canal 31, a second adjustment signal can be formed according to a feedforward adjustment signal formed by the feedforward signal processing unit 141 based on the sound signal outside the ear canal 31 and a feedback adjustment signal formed by the feedback signal processing unit 142 based on the sound signal inside the ear canal 31.

[0124] The voice signal from the user received in the ear canal 31 includes the voice signal from the user conducted through the air outside the ear in the ear canal 31 and the voice signal from the user conducted from the bone to the air in the ear canal 31. The sound signal from outside the ear received in the ear canal 31 includes the sound signal from the external environment in the ear canal 31 and the voice signal from the user in the ear canal 31 conducted through the air outside the ear.

[0125] The first adjustment signal can be used to weaken the intensity of the voice signal received from the user in the ear canal 31, and the first adjustment signal can also be used to enhance the intensity of the voice signal received from the user in the ear canal 31. The first adjustment signal can be used to enhance part of the voice signal received from the user in the ear canal 31 and weaken part of the voice signal.

[0126] The second adjustment signal can be used to weaken the intensity of the sound signal from outside the ear received in the ear canal 31, and the second adjustment signal can also be used to enhance the intensity of the sound signal from outside the ear received in the ear canal 31. The first adjustment signal can be used to enhance part of the sound signal from outside the ear received in the ear canal 31 and weaken part of the sound signal.

[0127] S500: Control the speaker 130 to play the first adjustment signal and the second adjustment signal.

[0128] The first adjustment signal and the second adjustment signal may be played through the same speaker 130 or may be played through different speakers 130 .

[0129] In this way, the second adjustment signal for adjusting the intensity of the sound signal from outside the ear received in the ear canal 31 can be formed by the second signal picked up by the air conduction microphone 120, so as to realize the function of processing the sound from outside the ear. When the electronic device 10 processes the sound from outside the ear, the first signal picked up by the bone conduction microphone 180 does not include the sound signal from outside the ear. The intensity of the sound signal from the external environment received in the ear canal 31 is not affected by the first adjustment signal in the process of adjusting the intensity of the voice signal from the user received in the ear canal 31. It is convenient for the electronic device 10 to separately adjust the intensity of the voice signal from the user when processing the sound from outside the ear. The adjustment effect of the first adjustment signal and the adjustment effect of the second adjustment signal have little mutual influence, which is conducive to better weakening the occlusion effect without affecting the intensity of the sound signal from the external environment received in the ear canal 31. The sound signal from the external environment and the voice signal from the user can be processed to a more ideal intensity. For example, in the active noise reduction mode, the voice signal from the user can be adjusted to the intensity when the electronic device 10 is not worn, while taking into account a large amount of noise reduction. In the transparent transmission mode, there is no need to amplify the sound signal picked up at the ear 30. The sound signal from the external environment and the voice signal from the user can also be adjusted to the intensity when the electronic device 10 is not worn. The sound signal is not prone to clipping, and in scenes with wind noise, the wind noise will not be amplified.

[0130] In some examples, step S500 includes:

[0131] S510: Mix at least the first adjustment signal and the second adjustment signal to form a mixed signal. That is, the mixed signal includes at least the first adjustment signal and the second adjustment signal.

[0132] At least the first adjustment signal and the second adjustment signal may be mixed by the signal mixing unit 144 .

[0133] In some examples, at least the downlink audio signal, the first adjustment signal and the second adjustment signal are mixed to form a mixed signal. That is, the mixed signal includes at least the downlink audio signal, the first adjustment signal and the second adjustment signal.

[0134] S520: Control the speaker 130 to play the mixed signal.

[0135] In this way, it is convenient to play the first adjustment signal and the second adjustment signal through the same speaker 130, which is beneficial to reduce the number of speakers 130 of the wearable component 100 and make the structure of the wearable component 100 simpler.

[0136] In some examples, step S400 includes:

[0137] S410: According to the target extra-auricular sound processing mode selected by the user, a first adjustment signal is formed based on the first signal, and a second adjustment signal is formed based on the second signal.

[0138] The user can select the target extra-auricular sound processing mode by operating the control device 20. Alternatively, the user can also select the target extra-auricular sound processing mode by operating the electronic device 10.

[0139] In this way, it is convenient to adjust the first adjustment signal and the second adjustment signal according to different extra-auricular sound processing modes, so that in different extra-auricular sound processing modes, both the sound signal from the external environment and the voice signal from the user can be processed to a relatively ideal intensity.

[0140] In some examples, step S410 includes:

[0141] S411: According to the target extra-auricular sound processing mode selected by the user, a corresponding target filter parameter group is determined in a pre-stored filter parameter set, wherein the filter parameter set includes at least one filter parameter group corresponding to at least one extra-auricular sound processing mode, and the filter parameter group includes a first filter parameter and a second filter parameter.

[0142] The target extra-auricular sound processing mode is one of at least one extra-auricular sound processing mode of the electronic device 10. The target filtering parameter group is one of at least one filtering parameter group of the pre-stored filtering parameter set.

[0143] The filter parameter set may be set in the electronic device 10 before the electronic device 10 leaves the factory. Alternatively, the filter parameter set may be set in the electronic device 10 by the user after the electronic device 10 leaves the factory.

[0144] S412: Form a first adjustment signal according to the first signal and a first filtering parameter in the target filtering parameter group.

[0145] S413: Form a second adjustment signal according to the second signal and the second filtering parameter in the target filtering parameter group.

[0146] The bone conduction signal processing unit 143 is configured to form a first adjustment signal according to the first signal and a first filtering parameter in the target filtering parameter group.

[0147] The air conduction signal care unit is used to form a second adjustment signal according to the second signal and the second filter parameter in the target filter parameter group.

[0148] When the second signal includes a sound signal outside the ear canal 31 and a sound signal inside the ear canal 31, the second filter parameters include a feedforward filter parameter and a feedback filter parameter. The feedforward signal processing unit 141 is used to process the sound signal outside the ear canal 31 according to the feedforward filter parameter, and the feedback signal processing unit 142 is used to process the sound signal inside the ear canal 31 according to the feedback filter parameter. The feedforward signal processing unit 141 can form a feedforward adjustment signal according to the sound signal outside the ear canal 31 and the feedforward filter parameter, and the feedback signal processing unit 142 forms a feedback adjustment signal according to the sound signal inside the ear canal 31 and the feedback filter parameter.

[0149] In this way, the first filter parameter for processing the first signal and the second filter parameter for processing the second signal can be adjusted according to different extra-auricular sound processing modes, so that in different extra-auricular sound processing modes, both the sound signal from the external environment and the voice signal from the user can be processed to a more ideal intensity more efficiently.

[0150] In some examples, the target extra-ear sound processing mode is an enhancement mode. The first adjustment signal includes a first reverse adjustment signal, which is used to weaken the intensity of a voice signal from the user received in the ear canal 31 and whose frequency is within a first preset frequency range. The second adjustment signal includes a first forward adjustment signal, which is used to enhance the intensity of the sound signal from outside the ear received in the ear canal 31. Step S412 includes: forming a first reverse adjustment signal according to the first signal and the first filter parameter in the target filter parameter group. Step S413 includes: forming a first positive adjustment signal according to the second signal and the second filter parameter in the target filter parameter group.

[0151] The first preset frequency range is within the range of frequencies of sound waves that can be felt by the human ear 30. The voice signal from the user received in the ear canal 31 and having a frequency within the first preset frequency range is a signal with enhanced intensity due to the occlusion effect.

[0152] In this way, when the target extra-ear sound processing mode is the enhanced mode, the intensity of the voice signal from the user received in the ear canal 31 and enhanced by the occlusion effect can be weakened, which is conducive to adjusting the intensity of the voice signal from the user received in the ear canal 31 and enhanced by the occlusion effect to the level when the electronic device 10 is not worn.

[0153] Exemplarily, the first preset frequency range is less than or equal to 2000 Hz and greater than or equal to the minimum frequency of sound waves that can be felt by the human ear 30. For example, the minimum frequency of sound waves that can be felt by the human ear 30 is 20 Hz, and the first preset frequency range is greater than or equal to 20 Hz and less than or equal to 2000 Hz.

[0154] In some examples, the target extra-ear sound processing mode is an enhancement mode. The first adjustment signal includes a second reverse adjustment signal, which is used to weaken the intensity of a voice signal from the user received in the ear canal 31 and whose frequency is within a second preset frequency range. The second adjustment signal includes a first positive adjustment signal, which is used to enhance the intensity of the sound signal from outside the ear received in the ear canal 31. Step S412 includes: forming a second reverse adjustment signal based on the first signal and the first filter parameter in the target filter parameter group. Step S413 includes: forming a first positive adjustment signal based on the second signal and the second filter parameter in the target filter parameter group.

[0155] The second preset frequency range is within the range of frequencies of sound waves that can be felt by the human ear 30. The voice signal from the user received in the ear canal 31 and having a frequency within the second preset frequency range is a signal with reduced intensity due to the occlusion effect.

[0156] In this way, when the target extra-ear sound processing mode is the enhancement mode and the enhancement amplitude of the sound signal from outside the ear received in the ear canal 31 is large, that is, after the sound signal from outside the ear received in the ear canal 31 is enhanced, when the intensity of the voice signal from the user received in the ear canal 31 whose intensity is weakened due to the occlusion effect is greater than the level when the electronic device 10 is not worn, the intensity of the voice signal from the user received in the ear canal 31 whose intensity is weakened due to the occlusion effect is weakened, which is beneficial to adjust the intensity of the voice signal from the user received in the ear canal 31 whose intensity is weakened due to the occlusion effect to the level when the electronic device 10 is not worn.

[0157] Exemplarily, the second preset frequency range is greater than 2000 Hz and less than or equal to the maximum frequency of sound waves that can be felt by the human ear 30. For example, the maximum frequency of sound waves that can be felt by the human ear 30 is 20000 Hz, and the second preset frequency range is greater than 2000 Hz and less than or equal to 20000 Hz.

[0158] In some examples, the target extra-ear sound processing mode is an enhancement mode. The first adjustment signal includes a second positive adjustment signal, and the second positive adjustment signal is used to enhance the strength of a voice signal from the user received in the ear canal 31 and having a frequency within a second preset frequency range. The second adjustment signal includes a first positive adjustment signal, and the first positive adjustment signal is used to enhance the strength of a sound signal from outside the ear received in the ear canal 31. Step S412 includes: forming a second positive adjustment signal according to the first signal and a first filter parameter in the target filter parameter group. Step S413 includes: forming a first positive adjustment signal according to the second signal and a second filter parameter in the target filter parameter group.

[0159] In this way, when the target extra-ear sound processing mode is the enhancement mode and the enhancement amplitude of the sound signal from outside the ear received in the ear canal 31 is small, that is, after the sound signal from outside the ear received in the ear canal 31 is enhanced, when the intensity of the voice signal from the user received in the ear canal 31 whose intensity is weakened due to the occlusion effect is lower than the level when the electronic device 10 is not worn, the intensity of the voice signal from the user received in the ear canal 31 whose intensity is weakened due to the occlusion effect is enhanced, which is beneficial to adjust the intensity of the voice signal from the user received in the ear canal 31 whose intensity is weakened due to the occlusion effect to the level when the electronic device 10 is not worn.

[0160] In some examples, the target extra-ear sound processing mode is an active noise reduction mode. The first adjustment signal includes a third positive adjustment signal, and the third positive adjustment signal is used to enhance the strength of the voice signal from the user received in the ear canal 31 and whose frequency is within the second preset frequency range. The second adjustment signal includes a third reverse adjustment signal, and the third reverse adjustment signal is used to weaken the strength of the sound signal from outside the ear received in the ear canal 31. Step S412 includes: forming a third positive adjustment signal according to the first signal and the first filter parameter in the target filter parameter group. Step S413 includes: forming a third reverse adjustment signal according to the second signal and the second filter parameter in the target filter parameter group.

[0161] In this way, when the target extra-ear sound processing mode is the active noise reduction mode, the intensity of the voice signal from the user received in the ear canal 31 and weakened by the occlusion effect can be enhanced, which helps to adjust the intensity of the voice signal from the user received in the ear canal 31 and weakened by the occlusion effect to the level when the electronic device 10 is not worn.

[0162] In some examples, the target extra-ear sound processing mode is an active noise reduction mode. The first adjustment signal includes a fourth positive adjustment signal, which is used to enhance the strength of a voice signal from the user received in the ear canal 31 and whose frequency is within a first preset frequency range. The second adjustment signal includes a third reverse adjustment signal, which is used to weaken the strength of the sound signal from outside the ear received in the ear canal 31. Step S412 includes: forming a fourth positive adjustment signal according to the first signal and the first filter parameter in the target filter parameter group. Step S413 includes: forming a third reverse adjustment signal according to the second signal and the second filter parameter in the target filter parameter group.

[0163] In this way, when the target extra-ear sound processing mode is the active noise reduction mode and the sound signal from outside the ear received in the ear canal 31 is attenuated to a large extent, that is, after the sound signal from outside the ear received in the ear canal 31 is weakened, when the intensity of the voice signal from the user received in the ear canal 31 with the intensity enhanced due to the occlusion effect is lower than the level when the electronic device 10 is not worn, the intensity of the voice signal from the user received in the ear canal 31 with the intensity enhanced due to the occlusion effect is enhanced, which is beneficial to adjust the intensity of the voice signal from the user received in the ear canal 31 with the intensity enhanced due to the occlusion effect to the level when the electronic device 10 is not worn.

[0164] In some examples, the target extra-ear sound processing mode is an active noise reduction mode. The first adjustment signal includes a fourth reverse adjustment signal, which is used to weaken the intensity of a voice signal from the user received in the ear canal 31 and whose frequency is within a first preset frequency range. The second adjustment signal includes a third reverse adjustment signal, which is used to weaken the intensity of a sound signal from outside the ear received in the ear canal 31. Step S412 includes: forming a fourth reverse adjustment signal based on the first signal and the first filter parameter in the target filter parameter group. Step S413 includes: forming a third reverse adjustment signal based on the second signal and the second filter parameter in the target filter parameter group.

[0165] In this way, when the target extra-ear sound processing mode is the active noise reduction mode and the attenuation amplitude of the sound signal from outside the ear received in the ear canal 31 is small, that is, after the sound signal from outside the ear received in the ear canal 31 is weakened, when the intensity of the voice signal from the user received in the ear canal 31 with the intensity enhanced due to the occlusion effect is greater than the level when the electronic device 10 is not worn, the intensity of the voice signal from the user received in the ear canal 31 with the intensity enhanced due to the occlusion effect is weakened, which is beneficial to adjust the intensity of the voice signal from the user received in the ear canal 31 with the intensity enhanced due to the occlusion effect to the level when the electronic device 10 is not worn.

[0166] In some examples, the electronic device 10 has at least one of the following extra-ear sound processing modes: a first active noise reduction mode or a second active noise reduction mode. The first active noise reduction mode and the second active noise reduction mode are two different active noise reduction modes, and both the first active noise reduction mode and the second active noise reduction mode are used to attenuate the sound signal from outside the ear received in the ear canal 31, and the attenuation of the first active noise reduction mode is smaller than that of the second active noise reduction mode.

[0167] Exemplarily, at least one extra-ear sound processing mode may include a first active noise reduction mode and a second active noise reduction mode. When at least one extra-ear sound processing mode may include a first active noise reduction mode and a second active noise reduction mode, the filter parameter set includes a set of filter parameter groups corresponding to the first active noise reduction mode and a set of filter parameter groups corresponding to the second active noise reduction mode.

[0168] In some examples, the target extra-ear sound processing mode is a first active noise reduction mode. The first adjustment signal includes a first suppression signal, which is used to reduce the intensity of a voice signal from the user received in the ear canal 31 and whose frequency is within a first preset frequency range; the second adjustment signal includes a second suppression signal, which is used to reduce the intensity of a sound signal from outside the ear received in the ear canal 31. Step S412 includes: forming a first suppression signal according to the first signal and a first filter parameter in the target filter parameter group. Step S413 includes: forming a second suppression signal according to the second signal and a second filter parameter in the target filter parameter group.

[0169] In this way, when the target external-ear sound processing mode is the first active noise reduction mode and the attenuation amplitude of the sound signal from the outside of the ear received in the ear canal 31 is small, that is, after the sound signal from the outside of the ear received in the ear canal 31 is attenuated, when the intensity of the voice signal from the user received in the ear canal 31 with the intensity enhanced under the occlusion effect is greater than the level when the electronic device 10 is not worn, the intensity of the voice signal from the user received in the ear canal 31 with the intensity enhanced under the occlusion effect is weakened, which is conducive to adjusting the intensity of the voice signal from the user received in the ear canal 31 with the intensity enhanced under the occlusion effect to the level when the electronic device 10 is not worn. In addition, it is also convenient to adjust the first adjustment signal and the second adjustment signal according to different active noise reduction modes when at least one external-ear sound processing mode includes multiple different active noise reduction modes.

[0170] In some examples, the target extra-ear sound processing mode is a first active noise reduction mode. The first adjustment signal includes a second compensation signal, and the second compensation signal is used to enhance the strength of the voice signal from the user received in the ear canal 31 and whose frequency is within the second preset frequency range; the second adjustment signal includes a second suppression signal, and the second suppression signal is used to weaken the strength of the sound signal from the outside of the ear received in the ear canal 31. Step S412 includes: forming a second compensation signal according to the first signal and the first filter parameter in the target filter parameter group. Step S413 includes: forming a second suppression signal according to the second signal and the second filter parameter in the target filter parameter group.

[0171] In this way, when the target external ear sound processing mode is the first active noise reduction mode, the strength of the voice signal from the user received in the ear canal 31 and weakened by the occlusion effect can be enhanced, which is conducive to adjusting the strength of the voice signal from the user received in the ear canal 31 and weakened by the occlusion effect to the level when the electronic device 10 is not worn. In addition, it is also convenient to adjust the first adjustment signal and the second adjustment signal according to different active noise reduction modes when at least one external ear sound processing mode includes multiple different active noise reduction modes.

[0172] In some examples, the target extra-ear sound processing mode is a second active noise reduction mode. The first adjustment signal includes a first compensation signal, which is used to enhance the strength of a voice signal from the user received in the ear canal 31 and whose frequency is within a first preset frequency range; the second adjustment signal includes a third suppression signal, which is used to weaken the strength of a sound signal from outside the ear received in the ear canal 31. Step S412 includes: forming a first compensation signal according to the first signal and the first filter parameter in the target filter parameter group. Step S413 includes: forming a third suppression signal according to the second signal and the second filter parameter in the target filter parameter group.

[0173] In this way, when the target external-ear sound processing mode is the second active noise reduction mode and the sound signal from the outside of the ear received in the ear canal 31 is attenuated to a large extent, that is, after the sound signal from the outside of the ear received in the ear canal 31 is attenuated, when the strength of the voice signal from the user received in the ear canal 31 and whose strength is enhanced under the occlusion effect is lower than the level when the electronic device 10 is not worn, the strength of the voice signal from the user received in the ear canal 31 and whose strength is enhanced under the occlusion effect is enhanced, so as to adjust the strength of the voice signal from the user received in the ear canal 31 and whose strength is enhanced under the occlusion effect to the level when the electronic device 10 is not worn. In addition, it is also convenient to adjust the first adjustment signal and the second adjustment signal according to different active noise reduction modes when at least one external-ear sound processing mode includes multiple different active noise reduction modes.

[0174] It should be noted that the second suppression signal is used to reduce the intensity of the sound signal from outside the ear received in the ear canal 31, which is smaller than the third suppression signal is used to reduce the intensity of the sound signal from outside the ear received in the ear canal 31.

[0175] In some examples, the target extra-ear sound processing mode is a second active noise reduction mode. The first adjustment signal includes a third compensation signal, which is used to enhance the strength of a voice signal from the user received in the ear canal 31 and whose frequency is within a second preset frequency range; the second adjustment signal includes a third suppression signal, which is used to weaken the strength of a sound signal from outside the ear received in the ear canal 31. Step S412 includes: forming a third compensation signal according to the first signal and the first filter parameter in the target filter parameter group. Step S413 includes: forming a third suppression signal according to the second signal and the second filter parameter in the target filter parameter group.

[0176] In this way, when the target external ear sound processing mode is the second active noise reduction mode, the strength of the voice signal from the user received in the ear canal 31 and weakened by the occlusion effect can be enhanced, which is conducive to adjusting the strength of the voice signal from the user received in the ear canal 31 and weakened by the occlusion effect to the level when the electronic device 10 is not worn. In addition, it is also convenient to adjust the first adjustment signal and the second adjustment signal according to different active noise reduction modes when at least one external ear sound processing mode includes multiple different active noise reduction modes.

[0177] It should be noted that the second compensation signal is used to enhance the intensity of the voice signal from the user received in the ear canal 31 whose intensity is weakened due to the occlusion effect, which is smaller than the third compensation signal is used to enhance the intensity of the voice signal from the user received in the ear canal 31 whose intensity is weakened due to the occlusion effect.

[0178] In some examples, the electronic device 10 has at least one of the following extra-ear sound processing modes: a first enhancement mode or a second enhancement mode. The first enhancement mode and the second enhancement mode are two different enhancement modes, both of which are used to enhance the sound signal from outside the ear received in the ear canal 31, and the enhancement amplitude of the first enhancement mode is smaller than that of the second enhancement mode.

[0179] Exemplarily, at least one extra-auricular sound processing mode may include a first enhancement mode and a second enhancement mode. When at least one extra-auricular sound processing mode may include a first enhancement mode and a second enhancement mode, the filter parameter set includes a set of filter parameter groups corresponding to the first enhancement mode and a set of filter parameter groups corresponding to the second enhancement mode.

[0180] In some examples, the target extra-ear sound processing mode is a first enhancement mode. The first adjustment signal includes a fourth suppression signal, which is used to weaken the intensity of a voice signal from the user received in the ear canal 31 and whose frequency is within a first preset frequency range; the second adjustment signal includes a fourth compensation signal, which is used to enhance the intensity of the sound signal from outside the ear received in the ear canal 31. Step S412 includes: forming a fourth suppression signal according to the first signal and the first filter parameter in the target filter parameter group. Step S413 includes: forming a fourth compensation signal according to the second signal and the second filter parameter in the target filter parameter group.

[0181] In this way, when the target extra-auricular sound processing mode is the first enhancement mode, the intensity of the voice signal from the user received in the ear canal 31 and enhanced by the occlusion effect can be weakened, which is conducive to adjusting the intensity of the voice signal from the user received in the ear canal 31 and enhanced by the occlusion effect to the level when the electronic device 10 is not worn. In addition, when at least one extra-auricular sound processing mode includes multiple different enhancement modes, it is also convenient to adjust the first adjustment signal and the second adjustment signal according to different enhancement modes.

[0182] In some examples, the target extra-ear sound processing mode is a first enhancement mode. The first adjustment signal includes a fifth compensation signal, which is used to enhance the strength of a voice signal from the user received in the ear canal 31 and whose frequency is within a second preset frequency range; the second adjustment signal includes a fourth compensation signal, which is used to enhance the strength of a sound signal from outside the ear received in the ear canal 31. Step S412 includes: forming a fifth compensation signal according to the first signal and the first filter parameter in the target filter parameter group. Step S413 includes: forming a fourth compensation signal according to the second signal and the second filter parameter in the target filter parameter group.

[0183] In this way, when the target extra-ear sound processing mode is the first enhancement mode and the enhancement amplitude of the sound signal from outside the ear received in the ear canal 31 is small, that is, after the sound signal from outside the ear received in the ear canal 31 is enhanced, when the strength of the voice signal from the user received in the ear canal 31 whose strength is weakened by the occlusion effect is lower than the level when the electronic device 10 is not worn, the strength of the voice signal from the user received in the ear canal 31 whose strength is weakened by the occlusion effect is enhanced, which is conducive to adjusting the strength of the voice signal from the user received in the ear canal 31 whose strength is weakened by the occlusion effect to the level when the electronic device 10 is not worn. In addition, it is also convenient to adjust the first adjustment signal and the second adjustment signal according to different enhancement modes when at least one extra-ear sound processing mode includes multiple different enhancement modes.

[0184] In some examples, the target extra-ear sound processing mode is a second enhancement mode. The first adjustment signal includes a fifth suppression signal, which is used to weaken the intensity of a voice signal from the user received in the ear canal 31 and whose frequency is within a first preset frequency range; the second adjustment signal includes a sixth compensation signal, which is used to enhance the intensity of the sound signal from outside the ear received in the ear canal 31. Step S412 includes: forming a fifth suppression signal according to the first signal and the first filter parameter in the target filter parameter group. Step S413 includes: forming a sixth compensation signal according to the second signal and the second filter parameter in the target filter parameter group.

[0185] In this way, when the target extra-auricular sound processing mode is the second enhancement mode, the intensity of the voice signal from the user received in the ear canal 31 and enhanced by the occlusion effect can be weakened, which is conducive to adjusting the intensity of the voice signal from the user received in the ear canal 31 and enhanced by the occlusion effect to the level when the electronic device 10 is not worn. In addition, when at least one extra-auricular sound processing mode includes multiple different enhancement modes, it is also convenient to adjust the first adjustment signal and the second adjustment signal according to different enhancement modes.

[0186] It should be noted that the amplitude of the fourth compensation signal used to enhance the intensity of the sound signal from outside the ear received in the ear canal 31 is smaller than the amplitude of the sixth compensation signal used to enhance the intensity of the sound signal from outside the ear received in the ear canal 31.

[0187] It should be noted that the fourth suppression signal is used to reduce the intensity of the voice signal from the user received in the ear canal 31 and whose intensity is enhanced due to the occlusion effect, which is smaller than the fifth suppression signal is used to increase the intensity of the voice signal from the user received in the ear canal 31 and whose intensity is enhanced due to the occlusion effect.

[0188] In some examples, the target extra-ear sound processing mode is a second enhancement mode. The first adjustment signal includes a sixth suppression signal, which is used to weaken the intensity of a voice signal from the user received in the ear canal 31 and whose frequency is within a second preset frequency range; the second adjustment signal includes a sixth compensation signal, which is used to enhance the intensity of the sound signal from outside the ear received in the ear canal 31. Step S412 includes: forming a sixth suppression signal according to the first signal and the first filter parameter in the target filter parameter group. Step S413 includes: forming a sixth compensation signal according to the second signal and the second filter parameter in the target filter parameter group.

[0189] In this way, when the target extra-ear sound processing mode is the second enhancement mode and the enhancement amplitude of the sound signal from outside the ear received in the ear canal 31 is large, that is, after the sound signal from outside the ear received in the ear canal 31 is enhanced, when the intensity of the voice signal from the user received in the ear canal 31 and weakened by the occlusion effect is greater than the level when the electronic device 10 is not worn, the intensity of the voice signal from the user received in the ear canal 31 and weakened by the occlusion effect is weakened, which is beneficial to adjust the intensity of the voice signal from the user received in the ear canal 31 and weakened by the occlusion effect to the level when the electronic device 10 is not worn.

[0190] The processing mode of the electronic device 10 also includes a parameter setting mode, and the parameter setting mode is used to set parameters in the filtering parameter set.

[0191] In some examples, the method further includes:

[0192] S100: In the parameter setting mode, a third signal and a fourth signal are obtained, the third signal is a voice signal from the user picked up by the bone conduction microphone 180, and the fourth signal is a sound signal picked up in the ear canal 31 by the air conduction microphone 120.

[0193] The fourth signal is a sound signal in the ear canal 31, and the fourth signal can be picked up by the feedback microphone 142. The fourth signal may include a voice signal from the user in the ear canal 31 conducted by air outside the ear and a voice signal from the user in the ear canal 31 conducted by bones to air.

[0194] When setting the parameters in the filter parameter set, the user may set the parameters in a noise-free environment where the intensity of the sound signal from outside the ear is less than a preset value.

[0195] S200: According to the third signal and the fourth signal, a corresponding filtering parameter group is set for each of at least one extra-auricular sound processing mode.

[0196] The third signal and the fourth signal can be used to obtain the amplitude of the intensity change of the voice signal from the user received in the ear canal 31 under the influence of the occlusion effect, so that a corresponding filtering parameter group can be set for each extra-auricular sound processing mode in at least one extra-auricular sound processing mode.

[0197] In this way, the parameters in the filter parameter set can be set for each user, thereby reducing the impact of different structures of the ears 30 of different users on the sound processing effect, so that different users can have better sound processing effects when wearing the electronic device 10.

[0198] In some examples, step S200 includes: step S210: setting a first filter parameter in the filter parameter group corresponding to each extra-ear sound processing mode in at least one extra-ear sound processing mode based on the third signal and the fourth signal and a second filter parameter preset in the filter parameter group corresponding to each extra-ear sound processing mode in at least one extra-ear sound processing mode.

[0199] Before the electronic device 10 leaves the factory, the second filter parameter in the filter parameter group corresponding to each of the at least one extra-auricular sound processing modes may be set in the electronic device 10 .

[0200] In this way, it is convenient to set the first filtering parameter in the filtering parameter group corresponding to each of the at least one extra-ear sound processing mode according to each of the at least one extra-ear sound processing mode and different users, so that different users can have better processing effects on sound signals from outside the ear and voice signals from the user when wearing the electronic device 10.

[0201] The above method embodiments may be applied to the processor 140 of the electronic device 10, or implemented by the processor 140. The computer-executable instructions stored in the memory 150 of the electronic device 10 are used to implement the above method embodiments when executed by the processor 140. In the implementation process of the above method embodiments, each step of the above method embodiments may be completed by an integrated logic circuit of hardware in the processor 140 or an instruction in software form.

[0202] The above method embodiments can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the above method embodiment is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc.

[0203] In the description of the embodiments of the present application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, or it can be an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in the embodiments of the present application can be understood according to specific circumstances.

[0204] The terms "first", "second", "third", "fourth", etc. (if any) in the description and claims of the embodiments of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence.

[0205] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the embodiments of the present application, rather than to limit them. Although the embodiments of the present application have been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein by equivalents. These modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for processing sound, characterized in that: Used in an electronic device, the electronic device comprising a bone conduction microphone, an air conduction microphone and a speaker; The method comprises: Acquire a first signal and a second signal, wherein the first signal is a voice signal from a user picked up by the bone conduction microphone, and the second signal is a sound signal picked up at the ear by the air conduction microphone; forming a first adjustment signal based on the first signal, and forming a second adjustment signal based on the second signal, wherein the first adjustment signal is used to adjust the strength of the voice signal from the user received in the ear canal, and the second adjustment signal is used to adjust the strength of the sound signal from outside the ear received in the ear canal; The speaker is controlled to play the first adjustment signal and the second adjustment signal.

2. The method according to claim 1, characterized in that The controlling the speaker to play the first adjustment signal and the second adjustment signal includes: mixing at least the first adjustment signal and the second adjustment signal to form a mixed signal; The speaker is controlled to play the mixed signal.

3. The method according to claim 1 or 2, characterized in that: The electronic device has at least one of the following extra-ear sound processing modes: a first active noise reduction mode, a second active noise reduction mode or an enhanced mode, wherein the first active noise reduction mode and the second active noise reduction mode are both used to attenuate the sound signal from the outside of the ear received in the ear canal, and the attenuation amplitude of the first active noise reduction mode is smaller than that of the second active noise reduction mode, and the enhanced mode is used to enhance the sound signal from the outside of the ear received in the ear canal; The forming a first adjustment signal based on the first signal, and forming a second adjustment signal based on the second signal, comprises: According to the target extra-auricular sound processing mode selected by the user, the first adjustment signal is formed based on the first signal, and the second adjustment signal is formed based on the second signal.

4. The method according to claim 3, characterized in that: The step of forming the first adjustment signal based on the first signal and forming the second adjustment signal based on the second signal according to the target extra-auricular sound processing mode selected by the user comprises: According to the target extra-auricular sound processing mode selected by the user, determining a corresponding target filtering parameter group in a pre-stored filtering parameter set, wherein the filtering parameter set includes at least one filtering parameter group corresponding to the at least one extra-auricular sound processing mode, and the filtering parameter group includes a first filtering parameter and a second filtering parameter; forming the first adjustment signal according to the first signal and the first filtering parameter in the target filtering parameter group; The second adjustment signal is formed according to the second signal and the second filtering parameters in the target filtering parameter set.

5. The method according to claim 4, characterized in that The target extra-ear sound processing mode is the first active noise reduction mode; the first adjustment signal includes a first suppression signal, the first suppression signal is used to weaken the strength of the voice signal from the user received in the ear canal and whose frequency is within a preset frequency range; the second adjustment signal includes a second suppression signal, the second suppression signal is used to weaken the strength of the sound signal from the outside of the ear received in the ear canal; The forming the first adjustment signal according to the first signal and the first filtering parameter in the target filtering parameter group includes: forming the first suppression signal according to the first signal and the first filtering parameter in the target filtering parameter set; The forming the second adjustment signal according to the second signal and the second filtering parameter in the target filtering parameter group includes: The second suppression signal is formed according to the second signal and the second filter parameters in the target filter parameter set.

6. The method according to claim 4, characterized in that The target extra-ear sound processing mode is the second active noise reduction mode; the first adjustment signal includes a first compensation signal, the first compensation signal is used to enhance the strength of the voice signal from the user received in the ear canal and having a frequency within a preset frequency range; the second adjustment signal includes a third suppression signal, the third suppression signal is used to weaken the strength of the sound signal from the outside of the ear received in the ear canal; The forming the first adjustment signal according to the first signal and the first filtering parameter in the target filtering parameter group includes: forming the first compensation signal according to the first signal and the first filtering parameter in the target filtering parameter group; The forming the second adjustment signal according to the second signal and the second filtering parameter in the target filtering parameter group includes: The third suppression signal is formed according to the second signal and the second filter parameters in the target filter parameter set.

7. The method according to claim 4, characterized in that The target extra-ear sound processing mode is the enhancement mode; the first adjustment signal includes a first reverse adjustment signal, the first reverse adjustment signal is used to weaken the strength of the voice signal from the user received in the ear canal and whose frequency is within a preset frequency range; the second adjustment signal includes a first positive adjustment signal, the first positive adjustment signal is used to enhance the strength of the sound signal from the outside of the ear received in the ear canal; The forming the first adjustment signal according to the first signal and the first filtering parameter in the target filtering parameter group includes: forming the first reverse adjustment signal according to the first signal and the first filtering parameter in the target filtering parameter group; The forming the second adjustment signal according to the second signal and the second filtering parameter in the target filtering parameter group includes: The first forward adjustment signal is formed according to the second signal and the second filtering parameters in the target filtering parameter group.

8. The method according to any one of claims 4 to 7, characterized in that: The method further comprises: In a parameter setting mode, a third signal and a fourth signal are acquired, wherein the parameter setting mode is used to set parameters in the filter parameter set, the third signal is a voice signal from the user picked up by the bone conduction microphone, and the fourth signal is a sound signal picked up in the ear canal by the air conduction microphone; According to the third signal and the fourth signal, the corresponding filtering parameter group is set for each of the at least one extra-auricular sound processing mode.

9. The method according to claim 8, characterized in that The step of setting the corresponding filtering parameter group for each of the at least one extra-auricular sound processing mode according to the third signal and the fourth signal comprises: The first filter parameter in the filter parameter group corresponding to each of the at least one extra-ear sound processing mode is set according to the third signal and the fourth signal, and the second filter parameter preset in the filter parameter group corresponding to each of the at least one extra-ear sound processing mode.

10. An electronic device, characterized in that: Includes a bone conduction microphone, an air conduction microphone, a speaker, a processor and a memory; The bone conduction microphone is used to pick up a voice signal from the user; The air conduction microphone is used to pick up sound signals at the ear; The speaker is used to play the signal; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the electronic device performs the method according to any one of claims 1 to 9.

11. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.

12. A computer program product, characterized in that The invention comprises a computer program, which, when being executed, enables a computer to execute the method according to any one of claims 1 to 9.

Images