Audio processing method and electronic equipment

Abstract

The invention provides an audio processing method and electronic equipment, and the method comprises the steps: obtaining a first audio collected by first electronic equipment, and obtaining a second audio collected by second electronic equipment; wherein the first electronic equipment and the second electronic equipment are located in the same space area; and based on the second audio, performing noise reduction on the first audio. The method can improve the noise reduction effect of the first audio collected by the first electronic device.

Description

Technical Field

[0001] This application relates to the field of electronic equipment technology, and in particular to an audio processing method and an electronic device. Background Technology

[0002] Currently, in call scenarios, to improve call quality, electronic devices can perform audio noise reduction processing after audio is captured. However, due to limitations such as overall stack size, space layout, user comfort, and cost, some electronic devices (such as headsets or low-end mobile phones) have a limited number of microphones (usually around two) that can be placed on the device, and the distance between different microphones is very close, resulting in poor audio noise reduction performance. Summary of the Invention

[0003] This application provides an audio processing method and an electronic device for improving the effect of audio noise reduction.

[0004] In a first aspect, embodiments of this application provide an audio processing method, the method comprising: acquiring a first audio signal collected by a first electronic device, and acquiring a second audio signal collected by a second electronic device; wherein the first electronic device and the second electronic device are located in the same spatial region; and performing noise reduction on the first audio signal based on the second audio signal.

[0005] In this method, the first electronic device and the second electronic device are located in the same spatial region, therefore the ambient noise around the second electronic device and the first electronic device is similar. Thus, the audio collected by the second electronic device can be used as ambient noise or to assist in identifying ambient noise in the audio collected by the first electronic device. Therefore, when denoising the audio collected by the first electronic device based on the audio collected by the second electronic device, more accurate denoising can be achieved, thereby improving the audio denoising effect.

[0006] In one possible design, the distance between the first electronic device and the second electronic device is greater than or equal to a set first distance threshold and less than or equal to a set second distance threshold.

[0007] In this method, the distance between the first electronic device and the second electronic device can be within a suitable range. On the one hand, this avoids the audio collected by the second electronic device from being too similar to that collected by the first electronic device; on the other hand, it avoids the audio collected by the second electronic device from deviating too much from the ambient noise around the first electronic device. This ensures that the audio collected by the second electronic device can more stably and clearly represent the ambient noise around the first electronic device, thereby helping to further improve the noise reduction effect of the audio collected by the first electronic device based on the audio collected by the second electronic device.

[0008] In one possible design, the first electronic device is a pair of headphones, and the second electronic device is a wearable device different from the first electronic device, and both the first and second electronic devices are worn. Optionally, the second electronic device can be a smartwatch.

[0009] In this method, headphones can serve as the primary device for acquiring user audio. The distance between the headphones and the user's vocal cords is generally less than the distance between other wearable devices and the user's vocal cords. Therefore, the ambient noise in the audio acquired by other wearable devices is more pronounced and stable than the ambient noise in the audio acquired by the headphones. Furthermore, in scenarios where the user uses headphones, if other wearable devices are simultaneously acquiring audio, they primarily capture ambient sound. Therefore, the audio acquired by other wearable devices can be used as ambient noise. Thus, when noise reduction is applied to the audio acquired by the headphones based on the audio acquired by other wearable devices, it is possible to more accurately distinguish between human voices and noise by sound intensity, thereby achieving a more accurate noise reduction effect.

[0010] In one possible design, the method is applied to the first electronic device; before acquiring the second audio collected by the second electronic device, the method further includes: sending a first instruction to the second electronic device; wherein the first instruction is used to instruct the second electronic device to acquire audio; acquiring the second audio collected by the second electronic device includes: receiving the second audio from the second electronic device.

[0011] In this method, the first electronic device can instruct the second electronic device located in the same spatial area to collect audio, thereby obtaining audio that more accurately reflects environmental noise, which helps to improve the audio noise reduction effect of the first electronic device.

[0012] In one possible design, the computing power of the first electronic device is higher than that of the second electronic device.

[0013] Based on this method, audio noise reduction can be performed using devices with high computing power, thereby improving the efficiency and effectiveness of audio noise reduction.

[0014] In one possible design, the method is applied to the second electronic device, wherein the computing power of the second electronic device is higher than that of the first electronic device; or, the method is applied to a third electronic device, wherein the computing power of the third electronic device is higher than that of both the first and second electronic devices.

[0015] Based on this method, audio noise reduction can be performed using devices with high computing power, thereby improving the efficiency and effectiveness of audio noise reduction.

[0016] The methods provided above allow for audio noise reduction processing that can be performed by any audio acquisition device or any other device, offering high flexibility and practicality.

[0017] In one possible design, the noise reduction of the first audio based on the second audio includes: identifying and removing audio similar to the second audio contained in the first audio; wherein the similarity between the audio features of the audio similar to the second audio and the audio features of the second audio is higher than or equal to a set similarity threshold; or, fusing the first audio and the second audio into a third audio, and processing the third audio using a set noise reduction algorithm.

[0018] This method utilizes two audio samples collected by two electronic devices to achieve audio noise reduction in different ways, offering high flexibility and practicality.

[0019] Secondly, embodiments of this application provide an audio processing method applied to a system consisting of a first electronic device and a second electronic device located in the same spatial area. The method includes: the first electronic device acquiring a first audio; the second electronic device acquiring a second audio; the second electronic device sending the second audio to the first electronic device; and the first electronic device performing noise reduction on the first audio based on the second audio.

[0020] In this method, the first electronic device and the second electronic device are located in the same spatial region, therefore the ambient noise around the second electronic device and the first electronic device is similar. Thus, the audio collected by the second electronic device can be used as ambient noise or to assist in identifying ambient noise in the audio collected by the first electronic device. Therefore, when the first electronic device performs noise reduction on the audio collected by the second electronic device, it can achieve more accurate noise reduction, thereby improving the audio noise reduction effect.

[0021] In one possible design, before the second electronic device acquires the second audio, the method further includes: the first electronic device sending a first instruction to the second electronic device, the first instruction being used to instruct the second electronic device to acquire the audio.

[0022] In one possible design, the distance between the first electronic device and the second electronic device is greater than or equal to a set first distance threshold and less than or equal to a set second distance threshold.

[0023] In one possible design, the first electronic device is an earphone, and the second electronic device is a wearable device different from the first electronic device, and both the first electronic device and the second electronic device are in a wearing state.

[0024] In one possible design, the computing power of the first electronic device is higher than that of the second electronic device.

[0025] In one possible design, the first electronic device performs noise reduction on the first audio based on the second audio, including: the first electronic device identifying and removing audio similar to the second audio contained in the first audio; wherein the similarity between the audio features of the audio similar to the second audio and the audio features of the second audio is higher than or equal to a set similarity threshold; or, the first electronic device fuses the first audio and the second audio into a third audio, and processes the third audio using a set noise reduction algorithm.

[0026] Thirdly, embodiments of this application provide an audio processing method applied to a system consisting of a first electronic device and a second electronic device located in the same spatial area. The method includes: the first electronic device acquiring a first audio; the second electronic device acquiring a second audio; the first electronic device sending the first audio to the second electronic device; and the second electronic device performing noise reduction on the received first audio based on the second audio.

[0027] In this method, the first electronic device and the second electronic device are located in the same spatial region, therefore the ambient noise around the second electronic device and the first electronic device is similar. Thus, the audio collected by the second electronic device can be used as ambient noise or to assist in identifying ambient noise in the audio collected by the first electronic device. Therefore, when the second electronic device performs noise reduction on the audio collected by the first electronic device based on the audio collected by the second electronic device, it can achieve more accurate noise reduction, thereby improving the audio noise reduction effect.

[0028] In one possible design, before the second electronic device performs noise reduction on the received first audio based on the second audio, the method further includes: the first electronic device sending a first instruction to the second electronic device, the first instruction being used to instruct the second electronic device to acquire audio and perform noise reduction on the audio from the first electronic device based on the acquired audio.

[0029] Based on the above method, after the first electronic device collects audio, it can send the collected audio to the second electronic device for audio noise reduction processing, thereby reducing the processing load on the first electronic device. When the second electronic device has higher computing power, it can also achieve more efficient and better audio noise reduction processing.

[0030] In one possible design, the distance between the first electronic device and the second electronic device is greater than or equal to a set first distance threshold and less than or equal to a set second distance threshold.

[0031] In one possible design, the first electronic device is an earphone, and the second electronic device is a wearable device different from the first electronic device, and both the first electronic device and the second electronic device are in a wearing state.

[0032] In one possible design, the computing power of the second electronic device is higher than that of the first electronic device.

[0033] In one possible design, the second electronic device performs noise reduction on the received first audio based on the second audio, including: the second electronic device identifying and removing audio similar to the second audio contained in the first audio; wherein the similarity between the audio features of the audio similar to the second audio and the audio features of the second audio is higher than or equal to a set similarity threshold; or, the second electronic device fuses the first audio and the second audio into a third audio, and processes the third audio using a set noise reduction algorithm.

[0034] Fourthly, embodiments of this application provide an audio processing method applied to a system composed of a first electronic device, a second electronic device, and a third electronic device, wherein the first electronic device and the second electronic device are located in the same spatial area. The method includes: the first electronic device acquiring a first audio; the second electronic device acquiring a second audio; the first electronic device sending the first audio to the third electronic device; the second electronic device sending the second audio to the third electronic device; and the third electronic device performing noise reduction on the received first audio based on the received second audio.

[0035] In this method, the first electronic device and the second electronic device are located in the same spatial region, therefore the ambient noise around the second electronic device and the first electronic device is similar. Thus, the audio collected by the second electronic device can be used as ambient noise or to assist in identifying ambient noise in the audio collected by the first electronic device. Therefore, when the third electronic device performs noise reduction on the audio collected by the first electronic device based on the audio collected by the second electronic device, it can achieve more accurate noise reduction, thereby improving the audio noise reduction effect.

[0036] In one possible design, before the first electronic device acquires the first audio, the method further includes: the third electronic device sending a first instruction to the first electronic device, the first instruction being used to instruct the first electronic device to acquire audio; before the second electronic device acquires the second audio, the method further includes: the first electronic device sending a second instruction to the second electronic device, the second instruction being used to instruct the second electronic device to acquire audio and send the acquired audio to the third electronic device; or, the third electronic device sending a third instruction to the second electronic device, the third instruction being used to instruct the second electronic device to acquire audio.

[0037] In this method, the first electronic device can serve as the audio device for the third electronic device. In scenarios where the third electronic device collects audio through the first electronic device, the third electronic device can perform noise reduction processing on the audio collected by the first electronic device based on the audio collected by the second electronic device within the spatial area where the first electronic device is located, thereby improving the noise reduction effect on the audio collected by the first electronic device.

[0038] In one possible design, the distance between the first electronic device and the second electronic device is greater than or equal to a set first distance threshold and less than or equal to a set second distance threshold.

[0039] In one possible design, the first electronic device is an earphone, and the second electronic device is a wearable device different from the first electronic device, and both the first electronic device and the second electronic device are in a wearing state.

[0040] In one possible design, the computing power of the third electronic device is higher than that of the first electronic device and the second electronic device.

[0041] In one possible design, the third electronic device performs noise reduction on the received first audio based on the received second audio, including: the third electronic device identifying and removing audio similar to the second audio contained in the first audio; wherein the similarity between the audio features of the audio similar to the second audio and the audio features of the second audio is higher than or equal to a set similarity threshold; or, the third electronic device fuses the first audio and the second audio into a third audio, and processes the third audio using a set noise reduction algorithm.

[0042] Fifthly, this application provides an electronic device, the electronic device including a memory and one or more processors; wherein the memory is used to store computer program code, the computer program code including computer instructions; when the computer instructions are executed by the one or more processors, the electronic device performs the method described in the first aspect or any possible design of the first aspect, or performs the method applied to any electronic device described in the second aspect or any possible design of the second aspect, or performs the method applied to any electronic device described in the third aspect or any possible design of the third aspect, or performs the method applied to any electronic device described in the fourth aspect or any possible design of the fourth aspect.

[0043] In a sixth aspect, this application provides a computer-readable storage medium storing a computer program that, when executed on an electronic device, causes the electronic device to perform the method described in the first aspect or any possible design of the first aspect, or to perform the method applied to any electronic device described in the second aspect or any possible design of the second aspect, or to perform the method applied to any electronic device described in the third aspect or any possible design of the third aspect, or to perform the method applied to any electronic device described in the fourth aspect or any possible design of the fourth aspect.

[0044] In a seventh aspect, this application provides a computer program product comprising a computer program or instructions that, when executed on an electronic device, cause the electronic device to perform the method described in the first aspect or any possible design of the first aspect, or to perform the method applied to any electronic device described in the second aspect or any possible design of the second aspect, or to perform the method applied to any electronic device described in the third aspect or any possible design of the third aspect, or to perform the method applied to any electronic device described in the fourth aspect or any possible design of the fourth aspect.

[0045] Eighthly, this application provides a chip system including a processor and a memory, wherein the memory stores instructions; when the instructions are executed by the processor, they implement the method described in the first aspect or any possible design of the first aspect, or implement the method applied to any electronic device described in the second aspect or any possible design of the second aspect, or implement the method applied to any electronic device described in the third aspect or any possible design of the third aspect, or implement the method applied to any electronic device described in the fourth aspect or any possible design of the fourth aspect. The chip system may be composed of chips or may include chips and other discrete devices.

[0046] The beneficial effects of aspects two through eight mentioned above can be found in the beneficial effects of aspect one mentioned above, and will not be repeated here. Attached Figure Description

[0047] Figure 1 This application provides a schematic diagram of the architecture of an audio processing system.

[0048] Figure 2 This application provides a schematic diagram of the architecture of an audio processing system.

[0049] Figure 3 A schematic diagram of the hardware architecture of an earphone provided in an embodiment of this application;

[0050] Figure 4 A schematic diagram illustrating an audio processing method provided in an embodiment of this application;

[0051] Figure 5 A schematic diagram of an audio processing system provided in an embodiment of this application;

[0052] Figure 6 A schematic diagram illustrating an audio processing method provided in an embodiment of this application;

[0053] Figure 7 A schematic diagram illustrating an audio processing method provided in an embodiment of this application;

[0054] Figure 8 A schematic diagram of an audio processing system provided in an embodiment of this application;

[0055] Figure 9 A schematic diagram illustrating an audio processing method provided in an embodiment of this application;

[0056] Figure 10 A schematic diagram illustrating an audio processing method provided in an embodiment of this application;

[0057] Figure 11 A schematic diagram illustrating an audio processing method provided in an embodiment of this application;

[0058] Figure 12 A schematic diagram of an audio processing system provided in an embodiment of this application;

[0059] Figure 13 A schematic diagram illustrating an audio processing method provided in an embodiment of this application;

[0060] Figure 14 A schematic diagram illustrating an audio processing method provided in an embodiment of this application;

[0061] Figure 15A schematic diagram illustrating an audio processing method provided in an embodiment of this application;

[0062] Figure 16 A schematic diagram illustrating an audio processing method provided in an embodiment of this application;

[0063] Figure 17 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0064] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings.

[0065] In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. It should be understood that in the embodiments of this application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can be represented as: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be a single or multiple.

[0066] References to "one embodiment" or "some embodiments" as used in this specification mean that one or more embodiments of this specification include a particular feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.

[0067] To improve the effectiveness of audio noise reduction, this application provides an audio processing method and an electronic device. This method combines audio collected by other electronic devices near the electronic device with audio collected by the electronic device itself for noise reduction, thereby improving the audio noise reduction effect. Specifically, when the number of audio acquisition devices (e.g., microphones) on the electronic device is limited and / or the different audio acquisition devices are close together, the audio collected by the electronic device through its different audio acquisition devices is very similar, making it difficult to distinguish between environmental noise and human voices during audio noise reduction. However, the environmental noise in the audio collected by other electronic devices near the electronic device is more pronounced and can be used to assist in identifying environmental noise and human voices in the audio collected by the electronic device. Therefore, this method helps to improve the audio noise reduction effect.

[0068] The technical solutions provided in this application can be executed by any electronic device with audio acquisition and processing capabilities. In some embodiments of this application, the electronic device can be a portable device, such as headphones, mobile phones, wearable devices with wireless communication functions (e.g., watches, bracelets, watch-headphone combos, etc.), in-vehicle terminal devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), smart home devices (e.g., smart TVs, smart speakers, etc.), smart robots, workshop equipment, wireless terminals in self-driving vehicles, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, or wireless terminals in smart homes, and flying devices (e.g., smart robots, drones, airplanes), etc. Among them, wearable devices are portable devices that users can wear directly on their bodies or integrate into their clothing or accessories.

[0069] In some embodiments of this application, the electronic device may also be a portable terminal device that includes other functions such as audio playback. Exemplary embodiments of the portable terminal device include, but are not limited to, […]. Alternatively, it could be a portable terminal device with another operating system. The aforementioned portable terminal device could also be other portable terminal devices, such as a laptop computer with a touch-sensitive surface (e.g., a touch panel). It should also be understood that in some other embodiments of this application, the aforementioned electronic device may not be a portable terminal device, but rather a desktop computer with a touch-sensitive surface (e.g., a touch panel).

[0070] Optionally, the audio processing method provided in this application embodiment can be applied to an audio processing system composed of multiple electronic devices. For example, Figure 1 This is a schematic diagram of the architecture of an audio processing system provided in an embodiment of this application. Figure 1 As shown, the audio processing system includes at least a first electronic device and a second electronic device. The first and second electronic devices are located in the same spatial area. A wireless connection can be established between the first and second electronic devices. This wireless connection is established using wireless communication technology. This wireless communication technology can be Bluetooth (BT), wireless local area networks (WLAN) (such as Wireless Fidelity (WiFi) networks), near field communication (NFC), infrared (IR), etc. This application does not specifically limit the type of wireless communication technology.

[0071] In a first possible embodiment, the audio processing system includes a first electronic device and a second electronic device for acquiring audio. Either the first electronic device or the second electronic device can also be used to perform audio noise reduction processing based on the audio acquired by the first electronic device and the audio acquired by the second electronic device, thereby obtaining the noise-reduced audio. Based on this embodiment, in one possible scenario, the first electronic device can be used as the audio device of the second electronic device, and the second electronic device can be used to process the noise-reduced audio (e.g., saving or sending the noise-reduced audio, etc., without specific limitations in this embodiment). The audio device described in this embodiment can also be understood as, or referred to as, an audio input / output device.

[0072] In the second possible solution, such as Figure 1As shown, the audio processing system may further include a third electronic device. The first and second electronic devices can be used to acquire audio. Any of the first, second, and third electronic devices can also be used to perform audio noise reduction processing based on the audio acquired by the first and second electronic devices, thereby obtaining the noise-reduced audio. Based on this scheme, in one possible scenario, the first electronic device can be used as the audio device of the third electronic device, and the third electronic device can be used to process the noise-reduced audio (e.g., saving or sending the noise-reduced audio, etc., without specific limitations in this embodiment).

[0073] It should be understood that Figure 1 The audio processing system is illustrated exemplarily for ease of understanding only and does not constitute any limitation on this application. The audio processing system may also include a greater number of electronic devices, and the embodiments of this application do not limit this.

[0074] For ease of understanding and description, the following embodiments use headphones as the first electronic device, a watch (i.e., a smartwatch) as the second electronic device, and a mobile phone as the third electronic device to illustrate the solution provided in this application. However, this is only for illustrative purposes, and the specific types of electronic devices are not limited in the embodiments of this application. Solutions for scenarios where other types of electronic devices are used can be implemented with reference to the methods provided below. The headphones, watches, mobile phones, etc., mentioned below can be flexibly replaced with other types of devices depending on the actual application scenario.

[0075] For example, Figure 2 This is a schematic diagram of the architecture of an audio processing system provided in an embodiment of this application. Figure 2 As shown, the audio processing system includes at least headphones and a watch, and may also include a mobile phone.

[0076] like Figure 2 As shown, the headset may include an MCU and at least one MIC (e.g., Figure 2 The components shown include MIC1 and MIC2, an ADC (codec), a digital signal processor (DSP), and communication devices. A watch may include an MCU, at least one MIC (e.g., Figure 2The diagram shows a microphone (MIC3), an analog-to-digital converter (ADC), a DSP, and a communication device. The MCU acts as a processor, controlling the implementation of relevant audio processing methods within the device. At least one microphone can be used to acquire audio signals within its spatial area; these signals are analog signals. The ADC may include an analog-to-digital converter that converts the audio signals from analog to digital. The DSP can be used for encoding, decoding, and / or noise reduction of the audio signals. The communication device can be used to send audio signals to or receive audio signals from other devices.

[0077] It is important to understand that the system architecture and the structure of each electronic device described above are merely examples. In practical applications, each electronic device can have more advanced features than... Figure 2 Showing more or fewer components (e.g.) Figure 2 The headphones shown may also include the following Figure 3 The components shown may be combined in combination with two or more components, or may have different component configurations, without specific limitations in this application.

[0078] For example, Figure 3 This is a schematic diagram of the structure of an earphone 100 provided in an embodiment of this application. Figure 3 As shown, the headset 100 may include at least one processor 101, at least one memory 102, a wireless communication module 103, an audio module 104, a sensor module 105, and a power module 106, etc. The processor may include one or more interfaces for connecting to other components of the headset 100.

[0079] The memory 102 can be used to store program code, such as code for establishing wireless connections between the headset 100 and different electronic devices (the wireless connection can be a physical or virtual connection), switching wireless connections between the headset 100 and different electronic devices, handling audio services (such as volume adjustment, music playback, making / receiving calls, etc.) of electronic devices (such as smartwatches or mobile phones) with which the headset 100 has established a wireless connection, and charging the headset 100. The memory 102 can also be used to store other information, such as the priorities of multiple electronic devices.

[0080] The processor 101 can be used to execute the above-described program code and call relevant modules to implement the functions of the headset 100 in this embodiment. For example, the headset 100 can establish wireless connections with different electronic devices, process audio services (such as adjusting volume, playing music, making / receiving calls, etc.) of electronic devices that have established wireless connections with the headset 100, and switch wireless connections with different electronic devices according to priority.

[0081] Processor 101 may include one or more processing units, which may be independent devices or integrated into one or more processors 101. Specifically, processor 101 may be an integrated control chip or may consist of circuitry including various active and / or passive components, configured to perform the functions belonging to processor 101 as described in the embodiments of this application. In one example, processor 101 may be a microcontroller (multipoint control unit, MCU).

[0082] The wireless communication module 103 can be used to support data exchange between the headset 100 and different electronic devices or the headset 100 itself, including data exchange via wireless communication such as BT, WLAN (such as WiFi), NFC, IR, etc.

[0083] In some embodiments, the wireless communication module 103 can be a Bluetooth chip. The headset 100 can use this Bluetooth chip to pair with and establish wireless connections with Bluetooth chips of different electronic devices, thereby enabling wireless communication and business processing between the headset 100 and other electronic devices.

[0084] In addition, the wireless communication module 103 may also include an antenna. The wireless communication module 103 receives electromagnetic waves through the antenna, modulates and filters the electromagnetic wave signals, and sends the processed signal to the processor 101. The wireless communication module 103 may also receive signals to be transmitted from the processor 101, modulate and amplify them, and then convert them into electromagnetic waves for radiation through the antenna.

[0085] The audio module 104 can be used to manage audio data, enabling the input and output of audio signals to the headset 100, and allowing functions such as making and receiving calls, playing music, adjusting volume, and receiving / sending user voice data through the headset 100. The audio module 104 may include a microphone 104A (or microphone, transducer) for outputting audio signals, an earpiece 104B (or receiver) assembly, an audio ADC 104C, a power amplifier 104D, etc. The microphone 104A can be used to convert sound signals into audio electrical signals. The earpiece 104B can be used to convert audio electrical signals into sound signals and play them. The audio ADC 104C converts digital signals into analog signals and sends the analog signals to the power amplifier. The power amplifier 104D can be used to amplify the analog signals.

[0086] The sensor module 105 can detect the necessary information according to the different functions of the headset 100. For example, when a user pushes the headset 100 to control functions such as adjusting volume, playing music, or making / receiving calls, the processor 101 identifies the user's intention by collecting data from the motion sensor and capacitance sensor 105D of the headset 100.

[0087] The motion sensors for the earphone 100 may include an accelerometer 105A, an angular velocity sensor 105B, and a magnetic induction sensor 105C. For example, the processor 101 can use the accelerometer 105A to collect the acceleration values ​​of the earphone 100 in real time along the x, y, and z axes to calculate the attitude of the earphone 100. Alternatively, the processor 101 can use the angular velocity sensor 105B to collect the angular velocity values ​​of the earphone 100 in real time and integrate them over time to calculate the attitude of the earphone 100. Alternatively, the processor 101 can use the magnetic field strength information of the earphone 100 to collect the magnetic field strength information of the earphone 100 to calculate the attitude of the earphone 100. Whether using the accelerometer 105A, the angular velocity sensor 105B, or the magnetic induction sensor 105C, the motion information collected by these sensors can meet the accuracy requirements for the attitude recognition of the earphone 100. In this embodiment, these three types of sensors can be used separately or in combination to achieve different purposes such as low power consumption or high accuracy.

[0088] The capacitive sensor 105D can be used to detect the pressure applied to the pressing area of ​​the earphone 100. The pressing area corresponds to the region of the electrode of the capacitive sensor 105D. When the user of the earphone 100 presses this pressing area, the electrode in the capacitive sensor 105D deforms, causing the capacitance of the capacitive sensor 105D to change according to the change in pressure applied to the pressing area. The number of capacitive sensors 105D can be one, two, or more, depending on the specific needs of the earphone 100.

[0089] A proximity sensor 106D can be used to determine whether the earphone 100 is being worn by a user. In some embodiments, the sensor module 105 may further include a distance sensor, which can be used to detect whether there is an object near the earphone 100, thereby determining whether the earphone 100 is being worn by a user. When it is determined that the earphone 100 is being worn, the earphone 100 may turn on the earpiece 104B to emit a prompt tone.

[0090] For example, the sensor module 105 may also include a bone conduction sensor. Using this bone conduction sensor, the earphone 100 can acquire vibration signals from the vibrating bones of the human vocal cords, analyze the voice signals, and realize voice functionality, thereby receiving user voice commands. The earphone 100 can also perform voice authentication based on the user's voice signals acquired by the bone conduction sensor, for example, to authenticate the user's identity in business scenarios such as payment transactions.

[0091] For example, the sensor module 105 may also include: a touch sensor for detecting user touch operations such as single click, double click, multiple clicks, long press, and heavy pressure, and can also perform user fingerprint recognition to authenticate user identity in business scenarios such as payment transactions; a fingerprint sensor for detecting user fingerprints and identifying user identity; an ambient light sensor that can adaptively adjust some parameters (such as volume) according to the perceived brightness of ambient light; and other sensors.

[0092] The power module 106 provides system power to the headset 100, powering all modules within the headset 100; it also supports the headset 100 receiving charging input. The power module 106 may include a battery 106A, a power management unit (PMU) 106B, and a charging interface 106C. The power management unit 106B receives external charging input; it transforms the electrical signal input to the charging circuit and provides it to the battery 106A for charging; it can also transform the electrical signal provided by the battery 106A and provide it to other modules such as the wireless communication module 103, audio module 104, and sensor module 105; and it prevents the battery 106A from overcharging, over-discharging, short-circuiting, or experiencing overcurrent. In some embodiments, the power module 105 may also include a wireless charging coil for wirelessly charging the headset 100. Additionally, the power management unit 106B can monitor parameters such as the battery 106A capacity, battery 106A cycle count, and battery 106A health status (leakage current, impedance). The charging interface 106C can be used to provide a wired connection for charging or communication between the earphone 100 and the earphone case. In some embodiments, this input / output interface can be a USB interface. In other embodiments, the charging interface 106C can be an earphone electrical connector, which allows the earphone 100 to establish an electrical connection with the electrical connector in the earphone case when the earphone 100 is placed in the earphone case, thereby charging the battery 106A in the earphone 100. In other embodiments, after the electrical connection is established, the earphone 100 can also communicate data with the earphone case, for example, it can receive pairing commands from the earphone case.

[0093] It is understood that the structure illustrated in the embodiments of this application does not constitute a specific limitation on the earphone 100. It may have a more... Figure 3 The number of components shown may be more or less, and two or more components may be combined, or different component configurations may be used. For example, the outer surface of the headset 100 may also include buttons, indicator lights (which can indicate battery level, incoming / outgoing calls, pairing mode, etc.), a display screen (which can display relevant information to the user), a dust filter (which can be used with the earpiece), and other components. The buttons may be physical buttons or touch buttons (used in conjunction with a touch sensor), used to trigger operations such as power on / off, pause, play, record, initiate pairing, and reset.

[0094] Figure 3 The various components shown can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing or application-specific integrated circuits.

[0095] The following is in conjunction with the above. Figure 1 , Figure 2 The audio processing system shown and Figure 3The earphones shown further illustrate the audio processing method provided in the embodiments of this application.

[0096] The key processing steps in the audio processing solution provided in this application mainly include an audio acquisition process and an audio noise reduction process. The audio acquisition process includes the process of the headphones and the watch respectively acquiring audio from their respective spatial areas. The audio noise reduction process includes the process of performing noise reduction processing on the audio acquired by the headphones based on the audio acquired by the watch.

[0097] In this embodiment, the headphones and the watch can be in the same spatial environment, and a communication connection is established between them. Since the headphones and watch are in the same environment, the ambient noise around them is similar. However, the headphones are the primary device for collecting user audio, and the distance between the headphones and the user's vocal cords is generally less than the distance between the watch and the user's vocal cords. Therefore, the ambient noise in the audio collected by the watch is more pronounced and stable than that in the audio collected by the headphones. Furthermore, in scenarios where the user uses headphones, if the watch is also collecting audio, it primarily captures ambient sound. Therefore, the audio collected by the watch can be used as ambient noise. Thus, during audio noise reduction, sound intensity can be used to more accurately distinguish between human voices and noise, thereby achieving a more accurate noise reduction effect. Sound intensity refers to the strength of the dominant tone in the audio signal. The dominant tone in the audio collected by the watch is ambient noise; therefore, ambient noise can be identified based on the audio collected by the watch, and the identified ambient noise can be used to identify noise and human voices in the audio collected by the headphones.

[0098] Optionally, the distance between the headphones and the watch can be greater than or equal to a first distance threshold and less than or equal to a second distance threshold. Alternatively, both the headphones and the watch can be in a wearing state (or a dressed state), thus ensuring that the distance between the headphones and the watch is within a suitable range. A distance greater than or equal to the first distance threshold ensures a significant difference in the audio collected by the headphones and the watch, thereby helping to more accurately distinguish between human voices and noise based on sound intensity. A distance less than or equal to the second distance threshold ensures that the headphones and the watch are in the same noise environment, thus ensuring the accuracy of the noise collected. The above method ensures that the distance between the headphones and the watch is within a suitable range. When both the headphones and the watch are in a wearing state, they are also in the same noise environment, and a significant difference in the audio collected by the headphones and the watch is still guaranteed.

[0099] In this embodiment, the watch may or may not have network connectivity. Having network connectivity means the watch itself can connect to a network. For example, the watch may include a module for mobile communication (e.g., a modem) or a wireless communication module for network connection (e.g., a WiFi chip). Not having network connectivity means the watch cannot connect to a network itself and requires other devices or methods to do so. For example, the watch may not include a module for mobile communication (e.g., a modem) or a wireless communication module for network connection (e.g., a WiFi chip).

[0100] Scenario 1: The audio processing system includes headphones and a watch.

[0101] Based on the above methods, refer to Figure 4 In the first possible scenario, the audio processing system may include headphones and a watch. In this scenario, the audio acquisition process is completed by the headphones and the watch, and the audio noise reduction process can be completed by either the headphones or the watch. In one example, the audio noise reduction process can be completed by the device with stronger computing power in the headphones and watch, thereby further improving the efficiency and effect of audio noise reduction. When the computing power of the headphones and the watch is the same, the audio noise reduction process can be completed by either the headphones or the watch. In this example, as an optional way to determine the computing power, after the headphones and the watch establish a connection, they can each notify the other of their own computing power capabilities. Based on this, the headphones and the watch can determine the device to perform the audio noise reduction process based on their own computing power and the computing power of the other device. As another optional way to determine the computing power, after the headphones and the watch establish a connection, either device in the headphones and the watch can notify the other device of its own computing power capabilities. The other device can then determine the device with higher computing power based on its own computing power and the computing power of the other device, and use that device as the device to perform the audio noise reduction process. It can also notify the other device. The audio processing system corresponding to the above scenario is as follows: Figure 5 As shown, the headphones can function as the watch's audio device, performing audio processing under the watch's control. Optionally, Figure 5 The headphones and watch shown can also be different components of the same device (e.g., a headphone and watch combo product), and the headphones and watch can be used independently.

[0102] Example 1

[0103] Reference Figure 6 Based on scenario one, the first possible audio processing method provided in this application embodiment may include:

[0104] S601: In response to the received first operation, the watch sends a first instruction to the headset; wherein the first instruction is used to instruct the headset to capture audio.

[0105] In some embodiments of this application, the first operation can be used to instruct the watch to perform audio input and / or output. The specific form of the first operation is not limited in these embodiments. For example, in an audio / video call scenario, the first operation can be an operation performed by the user to initiate or join an audio / video call. In a recording scenario, the first operation can be an operation performed by the user to instruct recording. In a video recording scenario, the first operation can be an operation performed by the user to instruct recording.

[0106] Optionally, before step S601, the following steps may also be included: the watch determines, by performing distance detection, that the distance between it and the headphones is greater than or equal to a first distance threshold and less than or equal to a second distance threshold; or the watch determines, by performing wearing detection, that it is currently in a wearing state.

[0107] S602: The watch responds to the first operation and captures the first audio.

[0108] As an optional real-time method, the watch can respond to the first operation by acquiring audio signals in the spatial area to obtain the first audio. Alternatively, the watch can respond to the first operation by acquiring audio signals in the spatial area and extracting noise from the acquired audio signals to obtain the first audio.

[0109] S603: The headphones respond to the first instruction and capture the second audio.

[0110] S604: The watch sends the first audio signal to the headphones.

[0111] Optionally, before step S604, the watch can determine that its computing power is lower than that of the headphones. The method by which the watch determines the computing power difference between the watch and the headphones can refer to any of the methods described in Scenario 1, and will not be repeated here.

[0112] S605: The headphones perform noise reduction processing based on the first and second audio frequencies to obtain the third audio frequency.

[0113] As one optional implementation, the headphones can identify the characteristic information of ambient noise based on the first audio, and then, referring to the identified characteristic information, identify the ambient noise in the second audio and remove the ambient noise from the second audio to obtain the third audio. As another optional implementation, the headphones can fuse the first and second audio, and then use a pre-defined noise reduction algorithm to perform noise reduction processing on the fused audio to obtain the third audio.

[0114] Optionally, before step S605, the earphones can determine that their computing power is higher than that of the watch. The method by which the earphones determine the computing power difference between the earphones and the watch can refer to any of the methods described in Scenario 1, and will not be repeated here.

[0115] Optionally, after step S605, the following steps S606 to S607 may also be included:

[0116] S606: The headphones send a third audio signal to the watch.

[0117] S607: The watch processes the third audio signal.

[0118] Depending on the specific application scenario, the watch processes the third audio in different ways. For example, in a scenario where the watch (with network connectivity) is making a call with other devices, the watch might send the third audio to the other device being used in the call. As another example, in a scenario where the watch is recording audio via headphones, the watch might process the third audio by saving it. This embodiment does not limit the specific method by which the watch processes the third audio.

[0119] In one example, Figure 6 The method shown is applied to Figure 2In the system architecture shown, within the watch, the MCU, upon receiving a first operation, can send a first instruction to the earphone via the communication device, and can also acquire audio signals from the surrounding space via MIC3. MIC3 can send the acquired audio signal to the ADC. The ADC can convert the received audio signal into a digital signal format and send the converted audio signal to the DSP. The DSP can encode the received audio signal (e.g., subband coding, SBC) and send the encoded data to the communication device. The communication device can then send the received audio signal, i.e., the first audio signal, to the earphone. In the earphone, the communication device can send the first instruction received from the watch to the MCU. The MCU can control MIC1 and MIC2 to acquire audio signals (i.e., the second audio signal). MIC1 and MIC2 can send the acquired audio signals to the ADC. The ADC can convert the two audio signals (i.e., the second audio signal) received from MIC1 and MIC2 into a digital signal format and send the converted two audio signals to the DSP. The communication device can also send the received audio signal from the watch to the DSP, which can decode the received audio signal to obtain one audio signal (i.e., the first audio signal). After acquiring three audio signals—the first and second audio signals—the DSP can perform noise reduction processing on them to obtain a denoised audio signal, the third audio signal. The DSP can also send the third audio signal to a communication device, which then transmits it to the watch. Upon receiving the third audio signal, the watch can perform further processing based on it.

[0120] It should be noted that the execution order of steps S601 and S602 can be arbitrary, and the execution order of steps S603 and S604 can be arbitrary. No specific restrictions are imposed in this embodiment.

[0121] Example 2

[0122] Reference Figure 7 Based on scenario one, the second possible audio processing method provided in this application embodiment may include:

[0123] S701: In response to the received first operation, the watch sends a first instruction to the headset; wherein the first instruction is used to instruct the headset to capture audio.

[0124] S702: The watch responds to the first operation and captures the first audio.

[0125] S703: The headphones respond to the first instruction and capture the second audio.

[0126] For steps S701 to S703, please refer to the aforementioned steps S601 to S603, which will not be repeated here.

[0127] S704: The headphones send a second audio signal to the watch.

[0128] Optionally, before step S704, the earphone can determine that its computing power is lower than that of the watch. The method by which the earphone determines the computing power difference between the earphone and the watch can refer to any of the methods described in Scenario 1, and will not be repeated here.

[0129] S705: The watch performs noise reduction processing based on the first and second audio frequencies to obtain the third audio frequency.

[0130] The method by which the watch performs noise reduction processing based on the first and second audio frequencies to obtain the third audio frequency can be referred to the method in step 605 above, where the headphones perform noise reduction processing based on the first and second audio frequencies to obtain the third audio frequency. It will not be described in detail here.

[0131] Optionally, before step S705, the watch can determine that its computing power is higher than that of the headphones. The method by which the watch determines the computing power of the watch and the headphones can refer to any of the methods described in Scenario 1, and will not be repeated here.

[0132] Optionally, after step S705, the following step S706 may also be included:

[0133] S706: The watch processes the third audio signal.

[0134] Regarding step S706, please refer to the aforementioned step S607, which will not be repeated here.

[0135] In one example, Figure 7 The method shown is applied to Figure 2In the system architecture shown, within the watch, the MCU, upon receiving a first operation, can send a first instruction to the earphone via the communication device, and simultaneously acquire audio signals from its spatial area via MIC3. MIC3 can send the acquired audio signals to the ADC. The ADC can convert the received audio signals into digital signal format and send the converted audio signals to the DSP. Within the earphone, the communication device can send the first instruction received from the watch to the MCU. The MCU can control MIC1 and MIC2 to acquire audio signals (i.e., the second audio). MIC1 and MIC2 can send the acquired audio signals to the ADC. The ADC can convert the two audio signals (i.e., the second audio signals) received from MIC1 and MIC2 into digital signal format and send the converted two audio signals to the DSP. The DSP can encode the two received audio signals (e.g., subband coding (SBC)) and send the encoded data to the communication device. The communication device can then send the received audio signal, i.e., the second audio, back to the watch. In the watch, the communication device can send the received audio signal from the headphones to the DSP. The DSP can decode the received audio signal to obtain one audio signal (i.e., the second audio). After acquiring the three audio signals, namely the first audio and the second audio, the DSP can perform noise reduction processing on the first and second audio to obtain the noise-reduced audio signal, i.e., the third audio.

[0136] Scenario 2: The audio processing system includes headphones, watches, and mobile phones.

[0137] Based on the above methods, refer to Figure 4 In the second possible scenario, the audio processing system may include headphones, a watch, and a mobile phone. In this scenario, the audio acquisition process is completed by the headphones and the watch, and the audio noise reduction process can be completed by one of these devices. In one example, the audio noise reduction process can be completed by the device with the stronger computing power among the headphones, watch, and mobile phone, thereby further improving the efficiency and effectiveness of audio noise reduction. When the computing power of the headphones, watch, and mobile phone is the same, the audio noise reduction process can be completed by any one of these devices. When multiple devices among the headphones, watch, and mobile phone have the same computing power and higher than the computing power of the other devices, the audio noise reduction process can be completed by any one of these devices. The method for determining the computing power of the headphones, watch, and mobile phone can be implemented using the method for determining the computing power of the headphones and watch described in Scenario 1 above, and will not be detailed here. The audio processing system corresponding to the above scenarios is as follows: Figure 8 As shown, a connection can be established between any two devices among the headphones, watch, and mobile phone. The headphones can act as the mobile phone's audio device, performing audio processing under the control of the mobile phone. Optionally, Figure 8 The headphones and watch shown can also be different components of the same device (e.g., a headphone and watch combo product), and the headphones and watch can be used independently.

[0138] Example 3

[0139] Reference Figure 9 Based on scenario two, the first possible audio processing method provided in this application embodiment may include:

[0140] S901: In response to the received first operation, the mobile phone sends a first instruction to the headset; wherein the first instruction is used to instruct the headset to capture audio.

[0141] In some embodiments of this application, the first operation can be used to instruct the mobile phone to perform audio input and / or output. The specific form of the first operation is not limited in these embodiments. For example, in an audio / video call scenario, the first operation can be an operation performed by the user to initiate or join an audio / video call. In a recording scenario, the first operation can be an operation performed by the user to instruct recording. In a video recording scenario, the first operation can be an operation performed by the user to instruct recording.

[0142] S902: The headphones respond to the first instruction and acquire the first audio.

[0143] S903: The earphone responds to the first instruction and sends a second instruction to the watch; wherein the second instruction is used to instruct the watch to collect audio.

[0144] S904: The watch responds to the second instruction and acquires the second audio.

[0145] Optionally, after step S903 and before step S904, the following steps may also be included: the watch determines, by performing distance detection, that the distance between it and the headphones is greater than or equal to a first distance threshold and less than or equal to a second distance threshold; or the watch determines, by performing wearing detection, that it is currently in a wearing state.

[0146] S905: The watch sends a second audio signal to the headphones.

[0147] S906: The headphones perform noise reduction processing based on the first and second audio frequencies to obtain the third audio frequency.

[0148] Steps S905 to S906 can be implemented by referring to the aforementioned steps S604 to S605, and will not be repeated here.

[0149] S907: The headphones send a third audio signal to the phone.

[0150] Optionally, after receiving the third audio, the mobile phone can process the third audio. The specific implementation can be referred to the aforementioned step S607, which will not be described in detail here.

[0151] In one example, Figure 9 The method shown is applied to Figure 2 In the system architecture shown, the mobile phone can send a first instruction to the headset in response to receiving a first operation. In the headset, the communication device can send the received first instruction from the watch to the MCU. The MCU can send a second instruction to the watch via the communication device, and can also control MIC1 and MIC2 to acquire audio signals (i.e., the first audio). MIC1 and MIC2 can send the acquired audio signals to the ADC. The ADC can convert the two audio signals (i.e., the first audio) received from MIC1 and MIC2 into digital signal format and send the converted audio signals to the DSP. In the watch, the communication device can send the received second instruction from the headset to the MCU. The MCU can control MIC3 to acquire audio signals (i.e., the second audio). MIC3 can send the acquired audio signal to the ADC. The ADC can convert the received audio signal into digital signal format and send the converted audio signal to the DSP. The DSP can encode the received audio signal and send the encoded data to the communication device. The communication device can then send the received audio signal, i.e., the second audio, to the headset. In the headphones, after acquiring three audio signals—the first and second audio signals—the DSP can perform noise reduction processing on the first and second audio signals to obtain the noise-reduced third audio signal. The DSP can also send the third audio signal to a communication device, which then transmits it to the mobile phone.

[0152] It should be noted that the execution order of the above steps S902 and S903 to S905 can be arbitrary, and no specific restrictions are imposed in this embodiment.

[0153] Example 4

[0154] Reference Figure 10 Based on scenario two, the second possible audio processing method provided in this application embodiment may include:

[0155] S1001: In response to the received first operation, the mobile phone sends a first instruction to the headset; wherein the first instruction is used to instruct the headset to capture audio.

[0156] S1002: The headphones respond to the first instruction and acquire the first audio.

[0157] For steps S1001 to S1002, please refer to the aforementioned steps S901 to S902, which will not be repeated here.

[0158] S1003: The earphone responds to the first instruction and sends a second instruction to the watch; wherein the second instruction is used to instruct the watch to collect audio and perform noise reduction processing based on the collected audio and the audio from the earphone.

[0159] S1004: The watch responds to the second instruction and acquires the second audio.

[0160] Regarding step S1004, please refer to the aforementioned step S904, which will not be repeated here.

[0161] S1005: The headphones send the first audio signal to the watch.

[0162] S1006: The watch performs noise reduction processing based on the first and second audio frequencies to obtain the third audio frequency.

[0163] Steps S1005 to S1006 can be implemented by referring to the aforementioned steps S704 to S705, and will not be described in detail here.

[0164] S1007: The watch sends a third audio signal to the headphones.

[0165] S1008: The headphones send a third audio signal to the phone.

[0166] Optionally, after receiving the third audio, the mobile phone can process the third audio. The specific implementation can be referred to the aforementioned step S607, which will not be described in detail here.

[0167] In one example, Figure 10 The method shown is applied to Figure 2In the system architecture shown, the mobile phone can send a first instruction to the headset in response to receiving a first operation. In the headset, the communication device can send the received first instruction from the watch to the MCU. The MCU can send a second instruction to the watch via the communication device, and can also control MIC1 and MIC2 to acquire audio signals (i.e., the first audio). MIC1 and MIC2 can send the acquired audio signals to the ADC. The ADC can convert the two audio signals (i.e., the first audio) received from MIC1 and MIC2 into digital signal format and send the converted audio signals to the DSP. The DSP can encode the received audio signals and send the encoded data to the communication device. The communication device can send the received audio signal, i.e., the first audio, to the watch. In the watch, the communication device can send the received second instruction from the headset to the MCU. The MCU can control MIC3 to acquire audio signals (i.e., the second audio). MIC3 can send the acquired audio signal to the ADC. The ADC can convert the received audio signal into digital signal format and send the converted audio signal to the DSP. After acquiring three audio signals—the first and second audio signals—the DSP can perform noise reduction processing on the first and second audio signals to obtain a noise-reduced audio signal, the third audio signal. The DSP can also send the third audio signal to a communication device, which will then transmit the third audio signal to the mobile phone.

[0168] As an alternative implementation method, Figure 10 In the method, step S1001 can also be replaced by the following step: the mobile phone, in response to the received first operation, sends a first instruction to the headset; wherein the first instruction is used to instruct the headset to collect audio and send the collected audio to the watch. Step S1002 can also be replaced by the following step: the mobile phone, in response to the received first operation, sends a second instruction to the watch; wherein the second instruction is used to instruct the watch to collect audio and perform noise reduction processing based on the collected audio and the audio from the headset. Steps S1007 to S1008 can also be replaced by the following step: the watch sends a third audio to the mobile phone.

[0169] Example 5

[0170] Reference Figure 11 Based on scenario two, the third possible audio processing method provided in this application embodiment may include:

[0171] S1101: In response to the received first operation, the mobile phone sends a first instruction to the headset; wherein the first instruction is used to instruct the headset to collect audio.

[0172] S1102: The headphones respond to the first instruction and acquire the first audio.

[0173] For steps S1101 to S1102, please refer to the aforementioned steps S901 to S902, which will not be repeated here.

[0174] S1103: The earphone responds to the first instruction and sends a second instruction to the watch; wherein the second instruction is used to instruct the watch to collect audio and send the collected audio to the mobile phone.

[0175] S1104: The watch responds to the second instruction and acquires the second audio.

[0176] Regarding step S1104, please refer to the aforementioned step S904, which will not be repeated here.

[0177] S1105: The headphones send the first audio signal to the phone.

[0178] Optionally, before step S1105, the headset can determine that the computing power of the headset and watch is lower than that of the mobile phone. The method by which the headset determines the computing power of the headset, watch, and mobile phone can be referred to the method for determining computing power in Scenario 2, and will not be repeated here.

[0179] S1106: The watch sends a second audio signal to the phone.

[0180] Optionally, before step S1106, the watch can determine that the computing power of the headphones and the watch is lower than that of the mobile phone. The method by which the watch determines the computing power of the headphones, watch, and mobile phone can be referred to the method for determining computing power in Scenario 2, and will not be repeated here.

[0181] S1107: The phone performs noise reduction processing on the first and second audio frequencies to obtain the third audio frequency.

[0182] Optionally, after receiving the third audio, the mobile phone can process the third audio. The specific implementation can be referred to the aforementioned step S607, which will not be described in detail here.

[0183] Optionally, before step S1107, the mobile phone can determine that its computing power is higher than that of the headphones and the watch. The method by which the mobile phone determines the computing power of the headphones, watch, and mobile phone can be referred to the method for determining computing power in Scenario 2, and will not be repeated here.

[0184] The method for the mobile phone to perform noise reduction processing based on the first and second audio to obtain the third audio can be referred to the method for the headphones to perform noise reduction processing based on the first and second audio to obtain the third audio in step 605 above, and will not be described in detail here.

[0185] In one example, Figure 11 The method shown is applied to Figure 2In the system architecture shown, the mobile phone can send a first instruction to the headset in response to receiving a first operation. In the headset, the communication device can send the received first instruction from the watch to the MCU. The MCU can send a second instruction to the watch via the communication device, and can also control MIC1 and MIC2 to acquire audio signals (i.e., the first audio). MIC1 and MIC2 can send the acquired audio signals to the ADC. The ADC can convert the two audio signals (i.e., the first audio) received from MIC1 and MIC2 into digital signal format and send the converted audio signals to the DSP. The DSP can encode the received audio signals and send the encoded data to the communication device. The communication device can send the received audio signal, i.e., the first audio, to the mobile phone. In the watch, the communication device can send the received second instruction from the headset to the MCU. The MCU can control MIC3 to acquire audio signals (i.e., the second audio). MIC3 can send the acquired audio signal to the ADC. The ADC can convert the received audio signal into digital signal format and send the converted audio signal to the DSP. The DSP can encode the received audio signal and send the encoded data to the communication device. The communication device can send the received audio signal, i.e., the second audio signal, to the mobile phone. After the mobile phone receives the three audio signals, i.e., the first audio signal and the second audio signal, it can perform noise reduction processing on the first audio signal and the second audio signal to obtain the noise-reduced audio signal, i.e., the third audio signal.

[0186] As an alternative implementation method, Figure 11 In the method, step S1103 can also be replaced by the following steps: the mobile phone responds to the received first operation and sends a second instruction to the watch; wherein the second instruction is used to instruct the watch to collect audio.

[0187] Scenario 3: The audio processing system includes a watch and a mobile phone.

[0188] Based on the above methods, refer to Figure 4 In a third possible scenario, the audio processing system may include a watch and a mobile phone. In this scenario, the audio acquisition process can be completed by both the phone and the watch, and the audio noise reduction process can be completed by either the phone or the watch. In one example, the audio noise reduction process can be completed by the device with stronger computing power in the phone or watch, thereby further improving the efficiency and effectiveness of audio noise reduction. When the computing power of the phone and the watch is the same, the audio noise reduction process can be completed by either the phone or the watch. The method for determining the computing power of the phone and the watch can be implemented using the method described in Scenario 1 for determining the computing power of headphones and the watch, and will not be detailed here. The audio processing system corresponding to the above scenarios is as follows: Figure 12As shown in the diagram. Optionally, the mobile phone in this scenario can be a phone with a small number of microphones (e.g., the number of microphones is less than or equal to a set number) and / or the different microphones are very close together (e.g., different microphones are located on the same side of the phone). In this case, the effect of the mobile phone alone in acquiring audio and performing audio noise reduction processing is relatively poor. Therefore, a watch can be used to assist in audio acquisition and audio noise reduction processing, thereby improving the audio noise reduction effect. In this scenario, the implementation method on the mobile phone side can refer to the implementation method on the headphone side described in Scenario 1 above, and the implementation method on the watch side can refer to the implementation method on the watch side described in Scenario 1 above, and will not be described in detail here.

[0189] It should be understood that the implementation processes provided in the embodiments one to five above are merely illustrative examples of the applicable method processes in the embodiments of this application. The execution order of each step in each embodiment can be adjusted according to actual needs, and other steps can be added or some steps can be removed. The execution order between steps that are not temporally related in each embodiment can be arbitrary, and this application does not impose any restrictions on this.

[0190] It should be noted that the various application scenarios provided in the above embodiments are merely illustrative examples of the applicable scenarios of the embodiments of this application, and do not limit the applicable scenarios of the solutions of this application. Some methods or the same technical concepts provided in any of the above embodiments can also be applied in other embodiments or other scenarios, or can be combined with the methods provided in other embodiments. Specifically, they can be applied in combination with specific embodiments or specific scenarios, and will not be listed and described one by one in this application.

[0191] Based on the above embodiments and the same technical concept, this application also provides an audio processing method, such as... Figure 13 As shown, the method may include:

[0192] S1301: Acquire a first audio signal collected by a first electronic device, and acquire a second audio signal collected by a second electronic device; wherein the first electronic device and the second electronic device are located in the same spatial region.

[0193] In some embodiments of this application, the distance between the first electronic device and the second electronic device may be greater than or equal to a set first distance threshold and less than or equal to a set second distance threshold.

[0194] In one possible scenario, the first electronic device can be headphones, and the second electronic device can be a wearable device different from the first electronic device, with both the first and second electronic devices being worn. For example, the first electronic device can be the headphones described in any of the foregoing embodiments, and the second electronic device can be the watch described in any of the foregoing embodiments.

[0195] In another possible scenario, the first electronic device can be a mobile phone, and the second electronic device can be a wearable device. Optionally, in this scenario, the first electronic device can be held in hand, and the second electronic device can be worn. For example, the first electronic device can be the mobile phone described in scenario three above, and the second electronic device can be the watch described in scenario three above.

[0196] S1302: Based on the second audio, perform noise reduction on the first audio.

[0197] The process of denoising the first audio based on the second audio can include any of the following:

[0198] 1) Identify and remove audio elements in the first audio that are similar to the second audio; wherein the similarity between the audio features of the audio elements similar to the second audio and the audio features of the second audio is higher than or equal to a set similarity threshold.

[0199] In this method, the second audio signal can be used as ambient noise. The audio characteristics of the second audio signal can be used as the audio characteristics of the ambient noise. This method can remove audio signals in the first audio signal that are similar to ambient noise, thereby achieving noise reduction.

[0200] 2) The first and second audio are merged into a third audio, and the third audio is processed using the set noise reduction algorithm.

[0201] In a first possible implementation, the method described in steps S1301-S1302 can be applied to a first electronic device. In this scenario, in some embodiments, the first electronic device can acquire first audio in response to an audio acquisition instruction from a second electronic device or a third electronic device connected to the first electronic device. In some embodiments, before acquiring the second audio acquired by the second electronic device, the first electronic device can send a first instruction to the second electronic device, which can be used to instruct the second electronic device to acquire audio. The second electronic device can acquire the second audio and send it to the first electronic device in response to the received first instruction. Optionally, the first instruction can be sent by the first electronic device in response to the aforementioned audio acquisition instruction.

[0202] Optionally, the computing power of the first electronic device can be higher than or equal to that of the second electronic device. The method for determining the computing power of the first and second electronic devices can refer to any of the methods described in Scenario 1, and will not be repeated here.

[0203] In one example, the first electronic device can be the headphones described in Embodiment 1, and the second electronic device can be the watch described in Embodiment 1. In this example, the first audio in steps S1301-S1302 corresponds to (or can be) the second audio in Embodiment 1, and the second audio in steps S1301-S1302 corresponds to the first audio in Embodiment 1. The method described in steps S1301-S1302 can be implemented with reference to the method described in Embodiment 1, and will not be described in detail here. In another example, the first electronic device can be the headphones described in Embodiment 3, and the second electronic device can be the watch described in Embodiment 3. In this example, the first audio in steps S1301-S1302 corresponds to the first audio in Embodiment 3, and the second audio in steps S1301-S1302 corresponds to the second audio in Embodiment 3. The method described in steps S1301-S1302 can be implemented with reference to the method described in Embodiment 3, and will not be described in detail here.

[0204] In a second possible implementation, the method described in steps S1301-S1302 can be applied to a second electronic device. In this scenario, in some embodiments, a first electronic device can acquire first audio in response to an audio acquisition instruction from the second electronic device or a third electronic device connected to the first electronic device. As an optional implementation, before acquiring the first audio acquired by the first electronic device, the second electronic device can send a second instruction to the first electronic device, which can be used to instruct the first electronic device to acquire audio. The first electronic device can acquire the first audio and send it to the second electronic device in response to the received second instruction. As another optional implementation, before executing step S1302, the second electronic device can receive a third instruction sent by the first electronic device, which can be used to instruct the second electronic device to acquire audio and perform noise reduction processing on the audio from the first electronic device based on the acquired audio. The third instruction can be sent by the first electronic device in response to an audio acquisition instruction.

[0205] Optionally, the computing power of the second electronic device can be higher than or equal to that of the first electronic device. The method for determining the computing power of the first and second electronic devices can refer to any of the methods described in Scenario 1, and will not be repeated here.

[0206] In one example, the first electronic device can be the headphones described in Embodiment 2, and the second electronic device can be the watch described in Embodiment 2. In this example, the first audio in steps S1301-S1302 corresponds to the second audio in Embodiment 2, and the second audio in steps S1301-S1302 corresponds to the first audio in Embodiment 2. The methods described in steps S1301-S1302 and other related methods can be implemented with reference to the methods described in Embodiment 2, and will not be described in detail here. In another example, the first electronic device can be the headphones described in Embodiment 4, and the second electronic device can be the watch described in Embodiment 4. In this example, the first audio in steps S1301-S1302 corresponds to the first audio in Embodiment 4, and the second audio in steps S1301-S1302 corresponds to the second audio in Embodiment 4. The methods described in steps S1301-S1302 and other related methods can be implemented with reference to the methods described in Embodiment 4, and will not be described in detail here.

[0207] In a third possible implementation, the method described in steps S1301-S1302 can be applied to a third electronic device. In this scenario, as an optional implementation, before acquiring the first audio collected by the first electronic device and the second audio collected by the second electronic device, the third electronic device can send audio acquisition instructions to both the first and second electronic devices, respectively. These audio acquisition instructions can be used to instruct the first and second electronic devices to acquire audio. The first and second electronic devices can each acquire audio and send it to the third electronic device in response to the received audio acquisition instructions. As another optional implementation, before acquiring the first audio collected by the first electronic device, the third electronic device can send a first instruction to the first electronic device, which can be used to instruct the first electronic device to acquire audio. The first electronic device can acquire the first audio and send it to the third electronic device in response to the received first instruction. The first electronic device can also instruct the second electronic device to acquire audio and send the acquired audio to the third electronic device in response to the received first instruction. The second electronic device can acquire audio and send the acquired second audio to the third electronic device in response to the instruction from the first electronic device. Alternatively, the first electronic device can also instruct the second electronic device to acquire audio in response to the received first instruction. The second electronic device can acquire audio and send the acquired second audio to the first electronic device, which can then forward the second audio to the third electronic device.

[0208] Optionally, the computing power of the third electronic device can be higher than or equal to that of the first and second electronic devices. The method for determining the computing power of the third, first, and second electronic devices can refer to any of the methods described in Scenario 1, and will not be repeated here.

[0209] In one example, the first electronic device can be the earphone described in Embodiment 5, the second electronic device can be the watch described in Embodiment 5, and the third electronic device can be the mobile phone described in Embodiment 5. In this example, the first audio described in steps S1301-S1302 corresponds to the first audio described in Embodiment 5, and the second audio described in steps S1301-S1302 corresponds to the second audio described in Embodiment 5. The methods described in steps S1301-S1302 and other related methods can be implemented with reference to the methods described in Embodiment 5, and will not be described in detail here.

[0210] The specific steps performed by any electronic device in the above method can be found in the relevant descriptions in the foregoing embodiments, and will not be repeated here.

[0211] Based on the above embodiments and the same technical concept, this application also provides an audio processing method, which can be applied to a system composed of a first electronic device and a second electronic device located in the same spatial area. Figure 14 As shown, the method may include:

[0212] S1401: The first electronic device acquires the first audio signal.

[0213] S1402: The second electronic device acquires the second audio.

[0214] Regarding the first electronic device and the second electronic device, please refer to... Figure 13 The explanations in the corresponding methods will not be repeated here.

[0215] S1403: The second electronic device sends a second audio signal to the first electronic device.

[0216] S1404: The first electronic device performs noise reduction on the first audio based on the second audio.

[0217] Regarding steps S1403 to S1404 and related methods, you can refer to the first possible solution described in step S1302 above, or you can refer to the first or third embodiment above, which will not be described in detail here.

[0218] Optionally, the execution order of steps S1401 and S1402 to S1403 can be arbitrary, and no restriction is imposed in this embodiment.

[0219] The specific steps performed by any electronic device in the above method can be found in the relevant descriptions in the foregoing embodiments, and will not be repeated here.

[0220] Based on the above embodiments and the same technical concept, this application also provides an audio processing method, which can be applied to a system composed of a first electronic device and a second electronic device located in the same spatial area, such as... Figure 15 As shown, the method may include:

[0221] S1501: The first electronic device acquires the first audio signal.

[0222] S1502: The second electronic device acquires the second audio.

[0223] Regarding the first electronic device and the second electronic device, please refer to... Figure 13 The explanations in the corresponding methods will not be repeated here.

[0224] S1503: The first electronic device sends the first audio signal to the second electronic device.

[0225] S1504: The second electronic device performs noise reduction on the received first audio based on the second audio.

[0226] Regarding steps S1503 to S1504 and related methods, you can refer to the second possible solution described in step S1302 above, or you can refer to the above embodiment two or embodiment four, which will not be described in detail here.

[0227] Optionally, step S1503 is executed after step S1501. The execution order of steps S1501 and S1502 can be arbitrary, and no restriction is imposed in this embodiment.

[0228] The specific steps performed by any electronic device in the above method can be found in the relevant descriptions in the foregoing embodiments, and will not be repeated here.

[0229] Based on the above embodiments and the same technical concept, this application also provides an audio processing method, which can be applied to a system composed of a first electronic device, a second electronic device, and a third electronic device, wherein the first electronic device and the second electronic device are located in the same spatial region. Figure 16 As shown, the method may include:

[0230] S1601: The first electronic device acquires the first audio signal.

[0231] S1602: The second electronic device acquires the second audio.

[0232] Regarding the first electronic device and the second electronic device, please refer to... Figure 13The explanations in the corresponding methods will not be repeated here.

[0233] S1603: The first electronic device sends the first audio signal to the third electronic device.

[0234] S1604: The second electronic device sends a second audio signal to the third electronic device.

[0235] S1605: The third electronic device performs noise reduction on the received first audio based on the received second audio.

[0236] Regarding steps S1603 to S1605 and related methods, you can refer to the third possible solution described in step S1302 above, or you can refer to embodiment five above, which will not be described in detail here.

[0237] Optionally, step S1603 is executed after step S1601, and step S1604 is executed after step S1602. The execution order of steps S1601 and S1602 can be arbitrary, and no restriction is imposed in this embodiment.

[0238] The specific steps performed by any electronic device in the above method can be found in the relevant descriptions in the foregoing embodiments, and will not be repeated here.

[0239] Based on the above embodiments and the same technical concept, this application also provides an electronic device for implementing the audio processing method provided in this application for any electronic device. For example... Figure 17 As shown, electronic device 1700 may include: memory 1701, one or more processors 1702, and one or more computer programs (not shown). These devices may be coupled via one or more communication buses 1703. Optionally, electronic device 1700 may also include a display screen 1704.

[0240] The memory 1701 stores one or more computer programs (code), and the one or more computer programs include computer instructions; one or more processors 1702 call the computer instructions stored in the memory 1701, causing the electronic device 1700 to execute the audio processing method for any electronic device provided in the embodiments of this application.

[0241] In a specific implementation, memory 1701 may include high-speed random access memory, and may also include non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 1701 may store an operating system (hereinafter referred to as the system), such as embedded operating systems like Android, iOS, Windows, or Linux. Memory 1701 can be used to store implementation programs of the embodiments of this application. Memory 1701 may also store network communication programs, which can be used to communicate with one or more additional devices, one or more user devices, or one or more network devices.

[0242] One or more processors 1702 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of programs according to the present application.

[0243] Display screen 1704 is used to display application interfaces and other related user interfaces.

[0244] It should be noted that, Figure 17 This is merely one implementation of the electronic device 1700 provided in this application embodiment. In practical applications, the electronic device 1700 may include more or fewer components, for example, as can be referred to... Figure 3 The specific structure and description shown are not limited here.

[0245] Based on the above embodiments and the same technical concept, this application also provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the method provided in the above embodiments for use in any electronic device.

[0246] Based on the above embodiments and the same technical concept, this application also provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the computer performs the method provided in the above embodiments for application to any electronic device.

[0247] Based on the above embodiments and the same technical concept, this application also provides a computer program product, which includes a computer program or instructions. When the computer program or instructions are run on a computer, the computer performs the method provided in the above embodiments for application to any electronic device.

[0248] The methods provided in this application can be implemented, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, they can be implemented, in whole or in part, in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of the present invention is generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment, or other programmable device. Computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions can be transmitted from one website, computer, server, or data center to another via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. A computer-readable storage medium can be any available medium that a computer can access, or a data storage device such as a server or data center that integrates one or more available media. Available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., digital video discs (DVDs), or semiconductor media (e.g., SSDs), etc.

[0249] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. An audio processing method, characterized in that, include: Acquire a first audio signal collected by a first electronic device, and acquire a second audio signal collected by a second electronic device; wherein the first electronic device and the second electronic device are located in the same spatial region; Based on the second audio, noise reduction is performed on the first audio.

2. The method as described in claim 1, characterized in that, The distance between the first electronic device and the second electronic device is greater than or equal to a set first distance threshold and less than or equal to a set second distance threshold.

3. The method as described in claim 1 or 2, characterized in that, The first electronic device is an earphone, and the second electronic device is a wearable device different from the first electronic device, and both the first electronic device and the second electronic device are in a wearing state.

4. The method according to any one of claims 1 to 3, characterized in that, The method is applied to the first electronic device; before acquiring the second audio collected by the second electronic device, the method further includes: Send a first instruction to the second electronic device; wherein the first instruction is used to instruct the second electronic device to collect audio; The acquisition of the second audio collected by the second electronic device includes: Receive the second audio from the second electronic device.

5. The method as described in claim 4, characterized in that, The computing power of the first electronic device is higher than that of the second electronic device.

6. The method according to any one of claims 1 to 3, characterized in that, The method is applied to the second electronic device; wherein the computing power of the second electronic device is higher than that of the first electronic device; or The method is applied to a third electronic device; wherein the computing power of the third electronic device is higher than that of the first electronic device and the second electronic device.

7. The method according to any one of claims 1 to 6, characterized in that, The noise reduction of the first audio based on the second audio includes: Identify and remove audio elements in the first audio that are similar to the second audio; wherein the similarity between the audio features of the audio elements similar to the second audio and the audio features of the second audio is higher than or equal to a set similarity threshold; or The first and second audio are merged into a third audio, and the third audio is processed using a set noise reduction algorithm.

8. An audio processing method, applied to a system consisting of a first electronic device and a second electronic device located in the same spatial region, characterized in that, The method includes: The first electronic device acquires the first audio signal; The second electronic device acquires the second audio signal; The second electronic device sends the second audio to the first electronic device; The first electronic device performs noise reduction on the first audio based on the second audio.

9. The method as described in claim 8, characterized in that, Before the second electronic device acquires the second audio, the method further includes: The first electronic device sends a first instruction to the second electronic device, the first instruction being used to instruct the second electronic device to collect audio.

10. An audio processing method, applied to a system consisting of a first electronic device and a second electronic device located in the same spatial region, characterized in that, The method includes: The first electronic device acquires the first audio signal; The second electronic device acquires the second audio signal; The first electronic device sends the first audio to the second electronic device; The second electronic device performs noise reduction on the received first audio based on the second audio.

11. The method as described in claim 10, characterized in that, Before the second electronic device performs noise reduction on the received first audio based on the second audio, the method further includes: The first electronic device sends a first instruction to the second electronic device, the first instruction being used to instruct the second electronic device to collect audio and perform noise reduction on the audio from the first electronic device based on the collected audio.

12. An audio processing method, applied to a system comprising a first electronic device, a second electronic device, and a third electronic device, characterized in that, The method includes: The first electronic device and the second electronic device are located in the same spatial region. The first electronic device acquires the first audio signal; The second electronic device acquires the second audio signal; The first electronic device sends the first audio to the third electronic device; The second electronic device sends the second audio to the third electronic device; The third electronic device performs noise reduction on the received first audio based on the received second audio.

13. The method as described in claim 12, characterized in that, Before the first electronic device acquires the first audio, the method further includes: The third electronic device sends a first instruction to the first electronic device, the first instruction being used to instruct the first electronic device to collect audio; Before the second electronic device acquires the second audio, the method further includes: The first electronic device sends a second instruction to the second electronic device, the second instruction being used to instruct the second electronic device to collect audio and send the collected audio to the third electronic device.

14. An electronic device, characterized in that, The electronic device includes a memory and one or more processors; The memory is used to store computer program code, which includes computer instructions; when the computer instructions are executed by the one or more processors, the electronic device performs the method as described in any one of claims 1 to 7, or the method as described in any one of claims 8 to 9, or the method as described in any one of claims 10 to 11, or the method as described in any one of claims 12 to 13.

15. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed on an electronic device, causes the electronic device to perform the method as described in any one of claims 1 to 7, or the method as described in any one of claims 8 to 9, or the method as described in any one of claims 10 to 11, or the method as described in any one of claims 12 to 13.

16. A computer program product, characterized in that, The computer program product includes a computer program or instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1 to 7, or the method as described in any one of claims 8 to 9, or the method as described in any one of claims 10 to 11, or the method as described in any one of claims 12 to 13.

Images