Audio signal processing method and related wearable device, and medium and program product

By separating and processing self-sound signals in wearable audio devices, the problem of ear blocking effect is solved, and the user's listening experience is improved. By differentiating the self-sound signals, the separation effect between self-sound and external sound is improved, and the improvement of self-sound and external sound is improved. Comfortable to wear.

WO2024234135A1PCT designated stage expired Publication Date: 2024-11-21INCUS (SHENZHEN) TECHNOLOGY CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2023/093844
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-12
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

Currently wearable audio devices often lead to an ear blocking effect during use, affecting the user's listening experience. The main reason is that the self-sound signal is mixed with external sound, and the bone conduction self-sound is partially blocked.

Method used

By separating the acoustic signals from the audio signals and specializing them, including reducing gain, etc., to reduce the ear plugging effect and improve the user experience. Specific steps include obtaining the audio signal, separating the self-acoustic signal, analyzing and processing, and finally synthesizing to improve the listening feeling.

Benefits of technology

Effectively reduce the ear blocking effect, improve the user's listening experience, and differentiate the self-sounding signal, improve the wearer's self-sounding and external sound separation effect, and improve the wearing comfort.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2023093844_21112024_PF_FP_ABST
    Figure CN2023093844_21112024_PF_FP_ABST
Patent Text Reader

Abstract

An audio signal processing method and a related wearable device, and a medium and a program product. The audio signal processing method is applied to a wearable audio device, and the related method may comprise: acquiring a first audio signal; separating a first self-generated-sound signal from the first audio signal; performing analysis on the first self-generated-sound signal to obtain a first analysis result; acquiring a second audio signal; separating a second self-generated-sound signal from the second audio signal according to the first analysis result; processing the second self-generated-sound signal by using a first signal processing solution, so as to obtain a first output audio signal; by using a second signal processing solution, processing the remaining signal in the second audio signal from which the second self-generated-sound signal has been separated, so as to obtain a second output audio signal, wherein the first signal processing solution is different from the second signal processing solution; and performing synthesis processing on the first output audio signal and the second output audio signal, so as to obtain a third output audio signal.
Need to check novelty before this filing date? Find Prior Art

Description

Audio signal processing method and related wearable device and media and program product Technical Field

[0001] The present application relates to the field of audio signal processing, and in particular to an audio signal processing method and related wearable devices, storage media, and program products. Background Art

[0002] Hearing aids are the best choice for people with moderate to severe hearing impairments to correct their hearing and improve their communication skills. Surveys show that over 15% of people aged 70-79 have moderate or severe hearing impairment, and this proportion exceeds 40% for those aged 80 and over. As populations in major countries around the world age, more and more elderly people will require hearing aids to hear external sounds and assist in daily communication.

[0003] With the rapid evolution of electronic products, wearable audio devices, such as True Wireless Stereo (TWS) headphones, are becoming increasingly popular. These headphones not only allow users to listen to Bluetooth music and participate in online conferences, but also enable a feature known as "transparency mode," allowing users to listen and participate in daily conversations while wearing the headphones.

[0004] Currently, when using wearable audio devices for daily communication, users often complain that their voices sound unnatural (e.g., loud, muffled, etc.). This unnatural hearing experience, also known as the "occlusion effect," can significantly impact the user experience, especially for first-time users. Improving the "occlusion effect" is a key approach to enhancing the user's listening experience.

[0005] Summary of the Invention

[0006] The embodiments of the present invention provide an audio signal processing method and related wearable device, storage medium, and program product, which are conducive to improving the ear blocking effect and thus enhancing the user's listening experience.

[0007] Research has found that the main reasons for the ear-blocking effect are as follows: 1) The air-conducted sound source of the wearer's own sound (such as the wearer's mouth) is usually physically closer to the receiver of the wearable audio device; 2) The wearer's own sound is ultimately a mixture of air-conducted sound (transmitted through the wearable audio device speaker and directly into the ear canal through the wearable audio device) and bone-conducted sound (transmitted through skull vibrations), while other people's voices usually do not have a path to be transmitted to the wearer through bone conduction; 3) Mainstream wearable audio devices such as hearing aids and TWS headphones usually use in-ear earplugs, and the earplugs in the ear canal will partially block the bone-conducted sound from flowing out of the ear.

[0008] Therefore, in order to improve the listening experience of wearable audio devices and reduce the ear-blocking effect, the inventors of the present application considered separating the self-acoustic signal from the audio signal and performing specific processing on the self-acoustic signal (for example, including reducing the gain, etc.) to achieve this.

[0009] An embodiment of the present application provides an audio signal processing method, which is applied to a wearable audio device. The audio signal processing method may include: obtaining a first audio signal; separating a first self-acoustic signal from the first audio signal; analyzing the first self-acoustic signal to obtain a first analysis result; obtaining a second audio signal; separating a second self-acoustic signal from the second audio signal based on the first analysis result; processing the second self-acoustic signal using a first signal processing scheme to obtain a first output audio signal; processing the residual signal obtained after separating the second self-acoustic signal from the second audio signal using a second signal processing scheme to obtain a second output audio signal, wherein the first signal processing scheme is different from the second signal processing scheme; and synthesizing the first output audio signal and the second output audio signal to obtain a third output audio signal.

[0010] Optionally, separating the first self-acoustic signal from the first audio signal includes: performing echo cancellation processing on the first audio signal to obtain a first de-echoed signal; performing noise reduction processing on the first de-echoed signal to obtain a first noise reduction signal; and performing self-acoustic separation processing on the first noise reduction signal to obtain a first self-acoustic signal.

[0011] Optionally, analyzing the first self-acoustic signal to obtain a first analysis result includes: performing a time-frequency domain analysis on the first self-acoustic signal to obtain a first analysis result, wherein the first analysis result includes a first time-frequency domain feature.

[0012] Optionally, separating the second self-acoustic signal from the second audio signal according to the first analysis result includes:

[0013] The second audio signal is subjected to echo cancellation processing to obtain a second de-echoed signal; the second de-echoed signal is subjected to noise reduction processing to obtain a second noise-reduced signal; and the second noise-reduced signal is subjected to self-sound separation processing according to the first analysis result to obtain a second self-sound signal.

[0014] The present application also provides a wearable audio device, including:

[0015] an acquiring unit, configured to acquire a first audio signal;

[0016] a separation unit, configured to separate a first self-acoustic signal from the first audio signal;

[0017] an analyzing unit, configured to analyze the first self-acoustic signal to obtain a first analysis result;

[0018] The acquiring unit is further configured to acquire a second audio signal;

[0019] The separation unit is further configured to separate a second self-acoustic signal from the second audio signal according to the first analysis result;

[0020] a first processing unit, configured to process the second self-acoustic signal using a first signal processing scheme to obtain a first output audio signal;

[0021] a second processing unit, configured to process a residual signal obtained after separating the second self-acoustic signal from the second audio signal using a second signal processing scheme to obtain a second output audio signal, wherein the first signal processing scheme is different from the second signal processing scheme;

[0022] A synthesis unit is configured to synthesize the first output audio signal and the second output audio signal to obtain a third output audio signal.

[0023] Optionally, separating the first self-acoustic signal from the first audio signal includes:

[0024] The first audio signal is subjected to echo cancellation processing to obtain a first de-echoed signal; the first de-echoed signal is subjected to noise reduction processing to obtain a first noise-reduced signal; and the first noise-reduced signal is subjected to self-sound separation processing to obtain a first self-sound signal.

[0025] Optionally, analyzing the first self-acoustic signal to obtain a first analysis result includes: performing a time-frequency domain analysis on the first self-acoustic signal to obtain a first analysis result, wherein the first analysis result includes a first time-frequency domain feature.

[0026] Optionally, separating the second self-acoustic signal from the second audio signal according to the first analysis result includes:

[0027] The second audio signal is subjected to echo cancellation processing to obtain a second de-echoed signal; the second de-echoed signal is subjected to noise reduction processing to obtain a second noise-reduced signal; and the second noise-reduced signal is subjected to self-sound separation processing according to the first analysis result to obtain a second self-sound signal.

[0028] An embodiment of the present application also provides another wearable audio device, including: a processor and a memory;

[0029] Among them, one or more computer programs are stored in the memory and configured to be executed by the processor to implement part or all of the steps of any method provided in the embodiments of the present application.

[0030] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein the computer program is used to implement part or all of the steps of any one of the methods provided in the embodiments of the present application.

[0031] An embodiment of the present application further provides a computer program product, wherein the computer program product is used to enable a wearable audio device to implement part or all of the steps of any one of the methods provided in the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0033] FIG1 is a schematic structural diagram of a wearable audio device provided in an embodiment of the present application.

[0034] FIG2 is a flow chart of an audio signal processing method provided in an embodiment of the present application.

[0035] FIG3 is a flow chart of another audio signal processing method provided in an embodiment of the present application.

[0036] FIG4 is a schematic structural diagram of a wearable audio device provided in an embodiment of the present application.

[0037] FIG5 is a schematic structural diagram of another wearable audio device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0038] In the specification, claims, and drawings of this application, the terms "first," "second," and the like are used to distinguish between different objects, not to describe a particular order. The terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.

[0039] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0040] To help those skilled in the art better understand the present invention, the following will provide a clear and complete description of the technical solutions in the embodiments of the present invention, in conjunction with the accompanying drawings. It is clear that the described embodiments are only a portion of the embodiments of the present invention, not all of them. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments of the present invention without creative effort are within the scope of protection of the present invention.

[0041] It is understood that the wearable audio devices involved in the embodiments of the present application may include various wearable audio devices with ambient sound acquisition and playback functions. For example, wearable audio devices may include hearing aids, TWS headphones, wearable augmented reality / virtual reality devices, smart glasses, etc. Of course, the specific product form of wearable audio devices is not limited to the above examples.

[0042] First, please refer to Figure 1, which is a schematic diagram of the structure of a wearable audio device provided in an embodiment of the present application. The wearable audio device may include a first audio acquisition device 103, a second audio acquisition device 101, and an audio playback device 102. The first audio acquisition device 103 and the second audio acquisition device 101 can be used to acquire audio signals, and the energy ratio of the self-acoustic signal to other signals in the audio signal acquired by the first audio acquisition device 103 is significantly greater (for example, more than 3 times) than the energy ratio of the self-acoustic signal to other signals in the audio signal acquired by the second audio acquisition device 101. The audio playback device 102 can be used to process and play the audio signals acquired by the first audio acquisition device 103 and the second audio acquisition device 101.

[0043] Referring to FIG2 , FIG2 is a flow chart of an audio signal processing method provided by way of example in an embodiment of the present application. An audio signal processing method may include:

[0044] 201. Obtain a first audio signal.

[0045] Specifically, the first audio acquisition device 103 may be used to acquire the first audio signal.

[0046] It is important to note that for the wearable audio device to operate properly, the first audio acquisition device 103 must possess a certain degree of physical shielding capability, ensuring that the energy ratio of the self-acoustic signal to other signals in the audio signal it picks up is significantly greater than that of the signal picked up by a conventional audio acquisition device. This physical shielding includes, but is not limited to, using an accelerometer instead of a conventional micro-electromechanical system (MEMS) air conduction microphone and wrapping the first audio acquisition device 103 with a microphone windproof net to reduce interference from wind noise and other factors.

[0047] 202. Separate a first self-acoustic signal from the first audio signal.

[0048] The first audio signal may contain noise caused by the wearable device's speaker, non-self-sound signals that cannot be completely blocked by physical shielding, and other noise signals. Algorithms such as echo removal and noise reduction can be used to reduce the difficulty of the separation algorithm and improve the quality of the separated signal.

[0049] 203. Analyze the first self-acoustic signal to obtain a first analysis result.

[0050] Here, analysis can refer to audio signal processing and analysis methods such as time domain analysis, frequency domain analysis, and time-frequency domain analysis.

[0051] 204. Obtain a second audio signal.

[0052] Specifically, the second audio acquisition device 101 may be used to acquire the first audio signal.

[0053] The second audio signal is usually a normal air conduction signal, which is used to collect sound information around the wearer.

[0054] 205. Separate a second self-acoustic signal from the second audio signal according to the first analysis result.

[0055] The second audio signal may contain noise signals such as noise caused by the wearable device speaker and environmental noise. Algorithms such as echo removal and noise reduction can be used to reduce the difficulty of the separation algorithm and improve the quality of the separated signal.

[0056] 206. Use a first signal processing scheme to process the second self-acoustic signal to obtain a first output audio signal.

[0057] The first signal processing solution may include reducing the wearer's own acoustic signal, applying dynamic range compression with a higher compression ratio to the wearer's own acoustic signal, etc. The purpose of the processing is to reduce the wearer's ear blocking effect and improve wearing comfort.

[0058] 207. Use a second signal processing scheme to process a residual signal obtained after separating the second self-acoustic signal from the second audio signal to obtain a second output audio signal, wherein the first signal processing scheme is different from the second signal processing scheme.

[0059] Among them, the second signal processing scheme may include: enhancing the volume of the voice frequency segment among other sounds, compressing the frequency of the audio to a frequency range that the wearer can perceive, dynamically adjusting the gain for input audio of different volumes, etc.

[0060] 208. Perform synthesis processing on the first output audio signal and the second output audio signal to obtain a third output audio signal.

[0061] The third output audio signal may be directly output by the air conduction speaker, or may be used as input to other algorithms for further processing.

[0062] Practice has shown that the solution of this embodiment can achieve differentiated processing of self-sound voice signals, which is beneficial to reducing the ear blocking effect and improving user experience.

[0063] Referring to FIG3 , FIG3 is a flow chart of another audio signal processing method provided as an example in an embodiment of the present application. The another audio signal processing method may include:

[0064] 301. Obtain a first audio signal.

[0065] Specifically, the first audio acquisition device 103 may be used to acquire the first audio signal.

[0066] It is important to note that for the wearable audio device to operate properly, the first audio acquisition device 103 must possess a certain degree of physical shielding capability, ensuring that the energy ratio of the self-acoustic signal to other signals in the audio signal it picks up is significantly greater than that of the signal picked up by a conventional audio acquisition device. This physical shielding includes, but is not limited to, using an accelerometer instead of a conventional micro-electromechanical system (MEMS) air conduction microphone and wrapping the first audio acquisition device 103 with a microphone windproof net to reduce interference from wind noise and other factors.

[0067] 302. Perform echo cancellation processing on the first audio signal to obtain a first echo-free signal.

[0068] 303. Perform noise reduction processing on the first echo-removed signal to obtain a first noise-reduced signal.

[0069] 304. Perform self-sound separation processing on the first noise reduction signal to obtain a first self-sound signal.

[0070] 305. Analyze the first self-acoustic signal to obtain a first analysis result.

[0071] The analysis may refer to audio signal processing and analysis methods such as time domain analysis, frequency domain analysis, time-frequency domain analysis, etc. For example, the first analysis result includes the time-frequency domain features of the first self-acoustic signal.

[0072] 306. Obtain a second audio signal.

[0073] Specifically, the second audio acquisition device 101 may be used to acquire the first audio signal.

[0074] The second audio signal is usually a normal air conduction signal, which is used to collect sound information around the wearer.

[0075] The second audio signal may contain noise signals such as noise caused by the wearable device speaker and environmental noise. Algorithms such as echo removal and noise reduction can be used to reduce the difficulty of the separation algorithm and improve the quality of the separated signal.

[0076] 307. Perform echo cancellation processing on the second audio signal to obtain a second echo-free signal.

[0077] 308. Perform noise reduction processing on the second echo-removed signal to obtain a second noise-reduced signal.

[0078] 309. Perform self-sound separation processing on the second noise reduction signal according to the first analysis result to obtain a second self-sound signal.

[0079] 310. Use a first signal processing scheme to process the second self-acoustic signal to obtain a first output audio signal.

[0080] The first signal processing solution may include reducing the wearer's own acoustic signal, applying dynamic range compression with a higher compression ratio to the wearer's own acoustic signal, etc. The purpose of the processing is to reduce the wearer's ear blocking effect and improve wearing comfort.

[0081] 311. Use a second signal processing scheme to process the residual signal obtained after separating the second self-acoustic signal from the second audio signal to obtain a second output audio signal, and the first signal processing scheme is different from the second signal processing scheme.

[0082] Among them, the second signal processing scheme may include: enhancing the volume of the voice frequency segment among other sounds, compressing the frequency of the audio to a frequency range that the wearer can perceive, dynamically adjusting the gain for input audio of different volumes, etc.

[0083] 312. Perform synthesis processing on the first output audio signal and the second output audio signal to obtain a third output audio signal.

[0084] The third output audio signal may be directly output by the air conduction speaker, or may be used as input to other algorithms for further processing.

[0085] Practice has shown that the solution of this embodiment can achieve differentiated processing of self-sound voice signals, which is beneficial to reducing the ear blocking effect and improving user experience.

[0086] 4 , an embodiment of the present application further provides a wearable audio device 400 , which may include:

[0087] An acquiring unit 410 is configured to acquire a first audio signal;

[0088] The separation unit 420 is configured to separate a first self-acoustic signal from the first audio signal;

[0089] An analyzing unit 430 is configured to analyze the first self-acoustic signal to obtain a first analysis result;

[0090] The acquiring unit 410 is further configured to acquire a second audio signal;

[0091] The separation unit 420 is further configured to separate a second self-acoustic signal from the second audio signal according to the first analysis result;

[0092] A first processing unit 440 is configured to process the second self-acoustic signal using a first signal processing scheme to obtain a first output audio signal;

[0093] a second processing unit 450 for processing a residual signal obtained after separating the second self-acoustic signal from the second audio signal using a second signal processing scheme to obtain a second output audio signal, wherein the first signal processing scheme is different from the second signal processing scheme;

[0094] The synthesis unit 460 is configured to synthesize the first output audio signal and the second output audio signal to obtain a third output audio signal.

[0095] Optionally, separating the first self-acoustic signal from the first audio signal includes:

[0096] The first audio signal is subjected to echo cancellation processing to obtain a first de-echoed signal; the first de-echoed signal is subjected to noise reduction processing to obtain a first noise-reduced signal; and the first noise-reduced signal is subjected to self-sound separation processing to obtain a first self-sound signal.

[0097] Optionally, analyzing the first self-acoustic signal to obtain a first analysis result includes: performing a time-frequency domain analysis on the first self-acoustic signal to obtain a first analysis result, wherein the first analysis result includes a first time-frequency domain feature.

[0098] Optionally, separating the second self-acoustic signal from the second audio signal according to the first analysis result includes:

[0099] The second audio signal is subjected to echo cancellation processing to obtain a second de-echoed signal; the second de-echoed signal is subjected to noise reduction processing to obtain a second noise-reduced signal; and the second noise-reduced signal is subjected to self-sound separation processing according to the first analysis result to obtain a second self-sound signal.

[0100] 5 , an embodiment of the present application further provides another wearable audio device 500, which may include: a processor 510 and a memory 520; one or more computer programs are stored in the memory 520 and configured to be executed by the processor 510 to implement part or all of the steps of any one of the methods provided in the embodiments of the present application.

[0101] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0102] In the several embodiments provided in this application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0103] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0104] In addition, the functional units in the various embodiments of the present invention may be integrated into a single processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0105] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk, etc. Various media that can store program codes.

[0106] As described above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that the technical solutions described in the above embodiments can still be modified, or some of the technical features can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. An audio signal processing method, characterized in that: The audio signal processing method is applied to a wearable audio device, and the audio signal processing method includes: Acquire a first audio signal; Separating a first self-acoustic signal from the first audio signal; analyzing the first self-acoustic signal to obtain a first analysis result; Acquire a second audio signal; and separate a second self-acoustic signal from the second audio signal according to the first analysis result; Processing the second self-acoustic signal using a first signal processing scheme to obtain a first output audio signal; Using a second signal processing scheme to process a residual signal obtained after separating the second audio signal from the second self-acoustic signal to obtain a second output audio signal, wherein the first signal processing scheme is different from the second signal processing scheme; The first output audio signal and the second output audio signal are synthesized to obtain a third output audio signal.

2. The method according to claim 1, characterized in that The step of separating the first self-acoustic signal from the first audio signal comprises: The first audio signal is subjected to echo cancellation processing to obtain a first de-echoed signal; the first de-echoed signal is subjected to noise reduction processing to obtain a first noise reduction signal; the first noise reduction signal is subjected to self-sound separation processing to obtain a first self-sound signal.

3. The method according to claim 2, characterized in that Analyzing the first self-acoustic signal to obtain a first analysis result includes: performing a time-frequency domain analysis on the first self-acoustic signal to obtain a first analysis result, wherein the first analysis result includes a first time-frequency domain feature.

4. The method according to any one of claims 1 to 3, characterized in that: The step of separating the second self-acoustic signal from the second audio signal according to the first analysis result comprises: The second audio signal is subjected to echo cancellation processing to obtain a second de-echoed signal; the second de-echoed signal is subjected to noise reduction processing to obtain a second noise-reduced signal; and the second noise-reduced signal is subjected to self-sound separation processing according to the first analysis result to obtain a second self-sound signal.

5. A wearable audio device, characterized in that: include: An acquisition unit, configured to acquire a first audio signal; A separation unit, configured to separate a first self-acoustic signal from the first audio signal; An analysis unit, configured to analyze the first self-acoustic signal to obtain a first analysis result; The acquisition unit is further used to acquire a second audio signal; The separation unit is further used to separate a second self-acoustic signal from the second audio signal according to the first analysis result; A first processing unit, configured to process the second self-acoustic signal using a first signal processing scheme to obtain a first output audio signal; a second processing unit, configured to process a residual signal obtained after separating the second self-acoustic signal from the second audio signal by a second signal processing scheme to obtain a second output audio signal, wherein the first signal processing scheme is different from the second signal processing scheme; A synthesis unit is used to synthesize the first output audio signal and the second output audio signal to obtain a third output audio signal.

6. The wearable audio device according to claim 5, characterized in that Separating the first self-acoustic signal from the first audio signal comprises: The first audio signal is subjected to echo cancellation processing to obtain a first de-echoed signal; the first de-echoed signal is subjected to noise reduction processing to obtain a first noise reduction signal; the first noise reduction signal is subjected to self-sound separation processing to obtain a first self-sound signal.

7. The wearable audio device according to claim 6, characterized in that Analyzing the first self-acoustic signal to obtain a first analysis result includes: performing a time-frequency domain analysis on the first self-acoustic signal to obtain a first analysis result, wherein the first analysis result includes a first time-frequency domain feature.

8. The wearable audio device according to any one of claims 5 to 7, characterized in that: The step of separating the second self-acoustic signal from the second audio signal according to the first analysis result comprises: The second audio signal is subjected to echo cancellation processing to obtain a second de-echoed signal; the second de-echoed signal is subjected to noise reduction processing to obtain a second noise-reduced signal; and the second noise-reduced signal is subjected to self-sound separation processing according to the first analysis result to obtain a second self-sound signal.

9. A wearable audio device, characterized in that: include: Processor and memory; One or more computer programs are stored in the memory and are configured to be executed by the processor to implement the method according to any one of claims 1 to 4.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program is used to implement the method according to any one of claims 1 to 4.

11. A computer program product, characterized in that The computer program product is used to enable the wearable audio device to implement the method according to any one of claims 1 to 4.

Citation Information

Patent Citations

  • Hearing device

    CN105101023A

  • Signal processing method, device and system

    CN111402915A

  • Call pickup and noise reduction method, earphone and storage medium

    CN111683319A

  • Audio signal processing method, device, readable storage medium and earphone

    CN113810828A

  • Earphone adaptive output method and device, equipment and storage medium

    CN115580804A