Signal transmission method, device and system, and storage medium

By mixing the audio signals of audio devices in the audio processing network, the bandwidth problem caused by independent transmission of multiple devices is solved, and more efficient audio signal transmission is achieved.

CN114946177BActive Publication Date: 2025-09-05HUAWEI TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202080092756.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-05-15
Publication Date
2025-09-05
Estimated Expiration
2040-05-15

AI Technical Summary

Technical Problem

In the prior art, multiple audio devices each send an audio signal to an application audio device, resulting in a large transmission bandwidth of the audio signal.

Method used

In the audio processing network, the audio device mixes the collected audio signal with the audio signal sent by the previous hop device to form a mixed audio signal, and sends it to the next hop device, and finally to the target audio device.

Benefits of technology

The transmission bandwidth of the audio signal is reduced, which reduces the network bandwidth usage.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114946177B_ABST
    Figure CN114946177B_ABST
Patent Text Reader

Abstract

The present application discloses a signal transmission method, device, system, and storage medium, belonging to the field of communication technology. The method includes: obtaining an audio signal collected by a first audio device; upon receiving an audio signal sent by a previous-hop device of the first audio device, mixing the audio signal collected by the first audio device with the audio signal sent by the previous-hop device to obtain a mixed audio signal; and sending the mixed audio signal to a next-hop device of the first audio device; wherein the first audio device, the previous-hop device, and the next-hop device are adjacent audio devices on a first transmission path in an audio processing network. The present application helps to reduce the transmission bandwidth of audio signals.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of communication technology, and in particular to a signal transmission method, device and system, and storage medium. Background Art

[0002] Audio collaborative processing is a method of audio processing based on an audio processing network. It is a key trend in future audio processing and can be applied to audio processing scenarios such as multi-device collaborative voice enhancement and multi-device collaborative three-dimensional (3D) sound field acquisition.

[0003] The audio processing network includes multiple distributed audio devices. For a specific audio service, these multiple audio devices may include an application audio device and multiple collaborative audio devices. Each collaborative audio device can send collected audio signals to the application audio device, which then performs audio applications based on the collected audio signals and the audio signals sent by the collaborative audio devices. Currently, multiple collaborative audio devices each send audio signals to the application audio device separately. This audio signal transmission method results in a large audio signal transmission bandwidth (that is, the network bandwidth occupied by the audio signal transmission). Summary of the Invention

[0004] The embodiments of the present application provide a signal transmission method, device, system, and storage medium that help reduce the transmission bandwidth of audio signals. The technical solutions of the present application are as follows:

[0005] In a first aspect, a signal transmission method is provided, comprising: acquiring an audio signal collected by a first audio device; upon receiving an audio signal sent by a previous-hop device of the first audio device, mixing the audio signal collected by the first audio device with the audio signal sent by the previous-hop device to obtain a mixed audio signal; and sending the mixed audio signal to a next-hop device of the first audio device; wherein the first audio device, the previous-hop device, and the next-hop device are adjacent audio devices on a first transmission path in an audio processing network, and the first audio device is any audio device on the first transmission path except the audio device at a starting point and the audio device at a destination point.

[0006] The technical solution provided in the embodiments of the present application helps reduce the transmission bandwidth of audio signals, as the audio devices can mix the collected audio signals with the audio signals sent by the previous-hop device and then send the mixed signals to the next-hop device until the audio signals collected by each audio device are sent to the target audio device (i.e., the audio device at the destination point). Therefore, compared with a solution in which each audio device sends audio signals to the target audio device separately, the technical solution helps reduce the transmission bandwidth of audio signals.

[0007] Optionally, mixing the audio signal collected by the first audio device and the audio signal sent by the previous-hop device to obtain a mixed audio signal includes: processing the audio signal collected by the first audio device using an audio processing function of the first audio device to obtain a processed signal of the first audio device; and superimposing the processed signal of the first audio device and the audio signal sent by the previous-hop device to obtain a mixed audio signal.

[0008] In the technical solution provided by the embodiments of the present application, after a first audio device processes an audio signal collected by the first audio device to obtain a processed signal of the first audio device, the processed signal of the first audio device is superimposed with the audio signal sent by the previous-hop device of the first audio device to obtain a mixed audio signal. This eliminates the need to restore the audio signal sent by the previous-hop device of the first audio device, thereby reducing the computational complexity of signal mixing performed by the first audio device.

[0009] Optionally, the audio signal sent by the previous-hop device is a mixed signal of audio signals collected by at least two audio devices; mixing the audio signal collected by the first audio device and the audio signal sent by the previous-hop device to obtain a mixed audio signal includes: recovering the audio signals collected by the at least two audio devices from the audio signal sent by the previous-hop device; for the first audio device and each of the at least two audio devices, processing the audio signal collected by the audio device using an audio processing function of the audio device to obtain a processed signal of the audio device; and superimposing the processed signal of the first audio device and the processed signals of the at least two audio devices to obtain a mixed audio signal.

[0010] The technical solution provided in the embodiments of the present application allows a first audio device to recover the audio signals collected by at least two audio devices from the audio signal sent by the previous-hop device of the first audio device when mixing the audio signal collected by the first audio device with the audio signal sent by the previous-hop device of the first audio device (i.e., recover the audio signals collected by each audio device from the audio signal sent by the previous-hop device of the first audio device). This facilitates the first audio device to apply the audio signals collected by the at least two audio devices.

[0011] Optionally, before recovering the audio signals collected by the at least two audio devices from the audio signal sent by the previous-hop device, the method further includes: determining, based on source information carried by the audio signal sent by the previous-hop device, that the audio signal sent by the previous-hop device is a mixed signal of the audio signals collected by the at least two audio devices; accordingly, recovering the audio signals collected by the at least two audio devices from the audio signal sent by the previous-hop device includes: recovering the audio signals collected by the at least two audio devices from the audio signal sent by the previous-hop device based on the audio processing functions of the at least two audio devices.

[0012] The technical solution provided by an embodiment of the present application enables a first audio device to determine at least two audio devices that were the sources of an audio signal sent by a previous-hop device of the first audio device based on source information carried in the audio signal sent by the previous-hop device of the first audio device. This facilitates the first audio device to determine the audio processing functions of the at least two audio devices, thereby recovering the audio signals collected by the at least two audio devices from the audio signal sent by the previous-hop device of the first audio device based on the audio processing functions of the at least two audio devices.

[0013] Optionally, the audio signal sent by the previous-hop device is an audio signal collected by the previous-hop device; mixing the audio signal collected by the first audio device and the audio signal sent by the previous-hop device to obtain a mixed audio signal includes: for each audio device in the first audio device and the previous-hop device, using the audio processing function of the audio device to process the audio signal collected by the audio device to obtain a processed signal of the audio device; and superimposing the processed signal of the first audio device and the processed signal of the previous-hop device to obtain a mixed audio signal.

[0014] In the technical solution provided by the embodiments of the present application, a first audio device processes an audio signal collected by the first audio device according to an audio processing function of the first audio device, and processes an audio signal collected by the previous-hop device of the first audio device according to an audio processing function of the previous-hop device of the first audio device. This facilitates the first audio device to mix the audio signal collected by the first audio device with the audio signal collected by the previous-hop device of the first audio device.

[0015] Optionally, the audio signal sent by the previous-hop device is obtained by processing the audio signal collected by the previous-hop device; the audio signal collected by the first audio device and the audio signal sent by the previous-hop device are mixed to obtain a mixed audio signal, including: recovering the audio signal collected by the previous-hop device from the audio signal sent by the previous-hop device; for each audio device in the first audio device and the previous-hop device, using the audio processing function of the audio device to process the audio signal collected by the audio device to obtain a processed signal of the audio device; and superimposing the processed signal of the first audio device and the processed signal of the previous-hop device to obtain a mixed audio signal.

[0016] The technical solution provided in the embodiments of the present application allows a first audio device to recover the audio signal collected by the previous-hop device of the first audio device from the audio signal sent by the previous-hop device of the first audio device when the first audio device mixes the audio signal collected by the first audio device and the audio signal sent by the previous-hop device of the first audio device. This facilitates the first audio device to use the audio signal collected by the previous-hop device of the first audio device.

[0017] Optionally, the audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or, the audio processing function of each audio device in the audio processing network is generated by a function processing device in the audio processing network and sent to each audio device in the audio processing network.

[0018] The technical solution provided by the embodiments of the present application is that an audio device generates its own audio processing function and sends its own audio processing function to other audio devices, or a function processing device generates an audio processing function for each audio device and sends the audio processing function to each audio device. This can facilitate each audio device to obtain its own audio processing function and the audio processing function of other audio devices, and thus process the corresponding audio signal according to the audio processing function.

[0019] Optionally, before using the audio processing function of the first audio device to process the audio signal collected by the first audio device, the method further includes: generating the audio processing function of the first audio device; or receiving the audio processing function of the first audio device sent by a function processing device.

[0020] According to the technical solution provided in the embodiments of the present application, the first audio device generates an audio processing function of the first audio device or receives the audio processing function of the first audio device sent by a function processing device, which can facilitate the first audio device to obtain its own audio processing function.

[0021] Optionally, generating the audio processing function of the first audio device includes: generating a plurality of random numbers using a random number generation function; and generating the audio processing function of the first audio device according to the plurality of random numbers.

[0022] According to the technical solution provided by the embodiment of the present application, the first audio device generates its audio processing function in a random manner, thereby ensuring that the audio processing function of the first audio device is as unrelated as possible to the audio processing functions of other audio devices.

[0023] In a second aspect, a signal transmission method is provided, comprising: receiving a mixed audio signal sent by a previous-hop device of a target audio device, the mixed audio signal being a mixed signal of audio signals collected by at least two audio devices; and recovering the audio signals collected by the at least two audio devices from the mixed audio signal; wherein the target audio device and the previous-hop device are adjacent audio devices on a first transmission path in an audio processing network.

[0024] According to the technical solution provided by the embodiments of the present application, an audio device on the first transmission path can mix the collected audio signal and the received audio signal and send the mixed signal to the next-hop device until the audio signals collected by each audio device are sent to the target audio device. Therefore, the mixed audio signal received by the target audio device and sent by the previous-hop device of the target audio device is a mixed signal of the audio signals collected by at least two audio devices. Compared with a solution in which each audio device sends an audio signal to the target audio device separately, the target audio device can receive the audio signals collected by each audio device by receiving the mixed audio signal, which helps to reduce the transmission bandwidth of the audio signal.

[0025] Optionally, before recovering the audio signals collected by at least two audio devices from the mixed audio signal, the method further includes: determining, based on source information carried by the mixed audio signal, that the mixed audio signal is a mixed signal of the audio signals collected by the at least two audio devices; accordingly, recovering the audio signals collected by the at least two audio devices from the mixed audio signal includes: recovering the audio signals collected by the at least two audio devices from the mixed audio signal based on audio processing functions of the at least two audio devices.

[0026] The technical solution provided in the embodiments of the present application enables a target audio device to determine, based on source information carried by a mixed audio signal, that the mixed audio signal originates from at least two audio devices. This facilitates the target audio device to determine the audio processing functions of the at least two audio devices, thereby recovering the audio signals collected by the at least two audio devices from the mixed audio signal based on the audio processing functions of the at least two audio devices.

[0027] Optionally, the audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or, the audio processing function of each audio device in the audio processing network is generated by a function processing device in the audio processing network and sent to each audio device in the audio processing network.

[0028] The technical solution provided by the embodiments of the present application is that an audio device generates its own audio processing function and sends its own audio processing function to other audio devices, or a function processing device generates an audio processing function for each audio device and sends the audio processing function to each audio device. This can facilitate each audio device to obtain its own audio processing function and the audio processing function of other audio devices, and thus process the corresponding audio signal according to the audio processing function.

[0029] Optionally, before restoring the audio signals collected by the at least two audio devices from the mixed audio signal according to the audio processing functions of the at least two audio devices, the method includes: receiving the audio processing functions of the at least two audio devices.

[0030] The technical solution provided by the embodiment of the present application enables the target audio device to recover the audio signals collected by the at least two audio devices from the mixed audio signal according to the audio processing functions of the at least two audio devices by receiving the audio processing functions of the at least two audio devices.

[0031] Optionally, before receiving the mixed audio signal sent by the previous-hop device of the target audio device, the method also includes: determining at least one target transmission path whose destination point is the target audio device from the audio processing network, the at least one target transmission path including a first transmission path; sending transmission indication information to the audio device on each target transmission path, and the audio device on the target transmission path is used to transmit the audio signal through the target transmission path according to the received transmission indication information.

[0032] The technical solution provided in the embodiments of the present application enables a target audio device to determine at least one target transmission path to reach the target audio device, so that audio devices in an audio processing network transmit audio signals to the target audio device through the at least one target transmission path, without having to transmit audio signals to the target audio device through transmission paths other than the at least one target transmission path. This helps to reduce the transmission bandwidth of the audio signal.

[0033] Optionally, determining at least one target transmission path whose destination point is a target audio device from an audio processing network includes: selecting at least one transmission path as the at least one target transmission path from multiple transmission paths whose destination point is the target audio device in the audio processing network; accordingly, sending transmission indication information to the audio device on each target transmission path, including: sending dismantling indication information to the audio device on each target transmission path, wherein the dismantling indication information sent to the audio device on the target transmission path instructs the audio device to dismantle a redundant transmission path in the multiple transmission paths and transmit an audio signal through the target transmission path, the redundant transmission path being a transmission path in the multiple transmission paths other than the at least one target transmission path.

[0034] The technical solution provided in the embodiment of the present application can prevent the audio device on the target transmission path from transmitting audio signals to the target audio device through the redundant transmission path by instructing the audio device on the target transmission path to remove the redundant transmission path, thereby helping to reduce the transmission bandwidth of the audio signal.

[0035] Optionally, at least one transmission path is selected as at least one target transmission path from a plurality of transmission paths whose destination point is a target audio device in an audio processing network, including: receiving a path detection signal transmitted through each transmission path of the plurality of transmission paths, wherein the path detection signal transmitted through each transmission path contains information of each audio device on the transmission path; and based on the path detection signal transmitted through the plurality of transmission paths, selecting at least one transmission path from the plurality of transmission paths as the at least one target transmission path, wherein the at least one target transmission path is the transmission path with the least number of paths and the largest number of audio devices contained in the plurality of transmission paths.

[0036] According to the technical solution provided by the embodiment of the present application, the target audio device selects the transmission path with the least number of paths and the largest number of audio devices among multiple transmission paths as the target transmission path, which helps to minimize the transmission bandwidth of the audio signal.

[0037] Optionally, at least one transmission path is selected as at least one target transmission path from a plurality of transmission paths whose destination point is a target audio device in an audio processing network, including: for each transmission path in the plurality of transmission paths, obtaining a current processing capability of each audio device on the transmission path; and based on the current processing capability of the audio devices on the plurality of transmission paths, selecting at least one transmission path from the plurality of transmission paths as the at least one target transmission path, wherein the current processing capability of each audio device on the target transmission path is stronger than a preset processing capability.

[0038] The technical solution provided by the embodiment of the present application enables the target audio device to select the transmission path where the audio device whose current processing capability is stronger than the preset processing capability is located among multiple transmission paths as the target transmission path, which helps to maintain the system stability of the audio processing network.

[0039] Optionally, determining at least one target transmission path whose destination point is a target audio device from an audio processing network includes: obtaining topology information of the audio processing network and current processing capabilities of each audio device in the audio processing network; determining at least one collaborative audio device required by the target audio device from the audio processing network based on the current processing capabilities of each audio device in the audio processing network; determining at least one transmission path whose destination point is the target audio device and includes the at least one collaborative audio device as the at least one target transmission path based on the topology information of the audio processing network; and accordingly, sending transmission indication information to the audio device on each target transmission path, including: sending device indication information to the audio device on each target transmission path, wherein the device indication information sent to the audio device indicates the next-hop device of the audio device on the target transmission path.

[0040] According to a third aspect, a signal transmission device is provided, which includes modules for executing the signal transmission method provided by the first aspect or any optional implementation of the first aspect.

[0041] In a fourth aspect, a signal transmission device is provided, which includes: various modules for executing the signal transmission method provided by the second aspect or any optional implementation of the second aspect.

[0042] In a fifth aspect, a signal transmission device is provided, which includes: a processor and a memory, wherein a program is stored in the memory, and the processor is used to call the program stored in the memory so that the signal transmission device executes the signal transmission method provided in the first aspect or any optional implementation of the first aspect.

[0043] In the sixth aspect, a signal transmission device is provided, which includes: a processor and a memory, wherein a program is stored in the memory, and the processor is used to call the program stored in the memory so that the signal transmission device executes the signal transmission method provided in the second aspect or any optional implementation of the second aspect.

[0044] In the seventh aspect, a signal transmission system is provided, which includes: at least two audio devices, at least one of the at least two audio devices includes the signal transmission device provided in the third aspect or the fourth aspect, or at least one of the at least two audio devices includes the signal transmission device provided in the fifth aspect or the sixth aspect.

[0045] In an eighth aspect, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is run on a computer, the computer is caused to execute the signal transmission method provided in the first aspect or any optional manner of the first aspect, or the computer is caused to execute the signal transmission method provided in the second aspect or any optional manner of the second aspect.

[0046] In the ninth aspect, a computer program product comprising instructions is provided, which, when run on a computer, enables the computer to execute the signal transmission method provided in the first aspect or any optional manner of the first aspect, or enables the computer to execute the signal transmission method provided in the second aspect or any optional manner of the second aspect.

[0047] In the tenth aspect, a chip is provided, which includes a programmable logic circuit and / or program instructions, and when the chip is running, it is used to implement the signal transmission method provided by the first aspect or any optional method of the first aspect, or to implement the signal transmission method provided by the second aspect or any optional method of the second aspect.

[0048] The beneficial effects of the technical solutions provided by the embodiments of the present application may include at least:

[0049] The technical solution provided by the embodiment of the present application is that after a first audio device collects an audio signal, when it receives an audio signal sent by the previous-hop device of the first audio device, it mixes the audio signal collected by the first audio device with the audio signal sent by the previous-hop device of the first audio device to obtain a mixed audio signal, and sends the mixed audio signal to the next-hop device of the first audio device. Because the audio device can mix the collected audio signal and the received audio signal and send them to the next-hop device until the audio signals collected by each audio device are sent to the target audio device, this helps to reduce the transmission bandwidth of the audio signal compared to a solution in which each audio device sends an audio signal to the target audio device separately. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 is a schematic diagram of an implementation environment involved in various embodiments of the present application;

[0051] Figure 2 This is a flow chart of a method for determining a target transmission path from an audio processing network provided by an embodiment of the present application;

[0052] Figure 3 This is a flow chart of a method for selecting a target transmission path from multiple transmission paths provided by an embodiment of the present application;

[0053] Figure 4 is a flowchart of another method for selecting a target transmission path from multiple transmission paths provided by an embodiment of the present application;

[0054] Figure 5 This is a flow chart of a method for determining a target transmission path where the destination point is a target audio device, provided by an embodiment of the present application;

[0055] Figure 6 is a schematic diagram of at least one target transmission path in an audio processing network provided by an embodiment of the present application;

[0056] Figure 7 This is a flow chart of a signal transmission method provided by an embodiment of the present application;

[0057] Figure 8 is a schematic diagram of transmitting an audio signal through a first transmission path provided by an embodiment of the present application;

[0058] Figure 9 is a schematic diagram of another method of transmitting an audio signal through a first transmission path provided by an embodiment of the present application;

[0059] Figure 10is a schematic diagram of another embodiment of the present application for transmitting an audio signal through a first transmission path;

[0060] Figure 11 This is a flow chart of a method for mixing an audio signal collected by a first audio device and an audio signal sent by a previous-hop device of the first audio device, provided by an embodiment of the present application;

[0061] Figure 12 This is a flowchart of another method for mixing an audio signal collected by a first audio device with an audio signal sent by a previous-hop device of the first audio device, provided by an embodiment of the present application;

[0062] Figure 13 This is a flowchart of another method for mixing an audio signal collected by a first audio device and an audio signal sent by a previous-hop device of the first audio device, provided by an embodiment of the present application;

[0063] Figure 14 This is a flowchart of another method for mixing an audio signal collected by a first audio device and an audio signal sent by a previous-hop device of the first audio device, provided by an embodiment of the present application;

[0064] Figure 15 This is a schematic diagram of the logical structure of a signal transmission device provided in an embodiment of the present application;

[0065] Figure 16 This is a schematic diagram of the logical structure of another signal transmission device provided in an embodiment of the present application;

[0066] Figure 17 This is a hardware structure diagram of a signal transmission device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0067] In order to make the principles, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0068] Please refer to Figure 1, which shows a schematic diagram of an implementation environment involved in various embodiments of the present application, and the implementation environment provides an audio processing network, which may include multiple audio devices, and the multiple audio devices may be communicatively connected via a wired network or a wireless network. According to business needs, the multiple audio devices may be fully interconnected (that is, each audio device in the multiple audio devices is communicatively connected to all other audio devices in the multiple audio devices) or partially interconnected (that is, at least one of the multiple audio devices is communicatively connected to some of the multiple audio devices, and is not communicatively connected to some audio devices). The embodiment of the present application takes the audio processing network including audio devices 01 to 05 (that is, audio device 01, audio device 02, audio device 03, audio device 04 and audio device 05) as an example, as Figure 1 As shown, audio device 02 is connected to audio device 01, audio device 03, and audio device 04, respectively, but is not connected to audio device 05. Therefore, audio devices 01 to 05 are partially interconnected. The wireless network may include, but is not limited to, a wireless fidelity (WIFI) network, a Bluetooth network, an infrared network, and a ZigBee network. The wired network may include, but is not limited to, a universal serial bus (USB) network.

[0069] The audio device may be any device capable of collecting audio signals and / or processing audio signals, for example, the audio device may be a smartphone, a tablet computer, a laptop computer, a desktop computer, a television, a moving picture experts group audio layer III (MP3) player, a moving picture experts group audio layer IV (MP4) player, an e-book reader, a smart home device, a headset, a smart toy, a smart bracelet, a smart watch, a virtual reality (VR) device, and an augmented reality (AR) device, etc. In the audio processing network provided in the embodiment of the present application, the multiple audio devices may be audio devices of the same type, for example, audio devices 01 to 05 are all smartphones, or the types of the multiple audio devices are not all the same, for example, audio device 01 and audio device 02 are both smartphones, audio device 03 is a smart toy, audio device 04 is a television, and audio device 05 is a headset, which is not limited in the embodiment of the present application.

[0070] Optionally, the multiple audio devices can be distributed and deployed in the same sound field space, and the multiple audio devices can include application audio devices and collaborative audio devices. The application audio device refers to a device that needs to apply an audio signal, and the collaborative audio device refers to a device that processes the audio signal in collaboration with the application audio device. The collaborative audio device can send the collected audio signal to the application audio device for the application audio device to perform audio application. It is easy to understand that the application audio device has at least the function of processing the audio signal, and the collaborative audio device has at least the function of collecting the audio signal. Optionally, the application audio device can also have the function of collecting the audio signal, and the collaborative audio device can also have the function of processing the audio signal. For example, the embodiment of the present application takes the example that audio device 04 is an application audio device, audio devices 01~03 and audio device 05 are all collaborative audio devices, and audio devices 01~05 all have audio collection function and audio processing function. Among them, the same sound field space can be the space where the same sound source is located (for example, a room). For example, if audio devices 01~05 are in the room where sound source A is located, then audio devices 01~05 are in the sound field space emitted by sound source A.

[0071] At present, in an audio processing network, multiple collaborative audio devices each send an audio signal to an application audio device. This audio signal transmission method results in a larger transmission bandwidth for the audio signal. For example, audio devices 01 to 03 and audio device 05 each send an audio signal to audio device 04. In this way, audio devices 01 to 03 and audio device 05 sending audio signals to audio device 04 will occupy four bandwidths of the audio processing network (audio devices 01 to 03 and audio device 05 each occupy one bandwidth), and the transmission bandwidth of the audio signal is relatively large. In the signal transmission scheme provided in the embodiment of the present application, the audio signals collected by multiple collaborative audio devices can be mixed and sent to the application audio device through the target transmission path. In this way, there is no need for each collaborative audio device to send an audio signal to the application audio device separately, which helps to reduce the transmission bandwidth of the audio signal. For example, audio device 03 can send the collected audio signal to audio device 02, audio device 02 mixes the audio signal sent by audio device 03 with the audio signal collected by itself and sends it to audio device 01, and audio device 01 mixes the audio signal sent by audio device 02 with the audio signal collected by itself and sends it to audio device 04. In this way, there is no need for audio device 03 and audio device 02 to send audio signals to audio device 04 respectively. Compared with the solution in which audio device 03 and audio device 02 send audio signals to audio device 04 respectively, the bandwidth of two paths can be reduced, thereby reducing the transmission bandwidth of the audio signal.

[0072] It is worth noting that the communication connection between different audio devices can be the underlying link between the different audio devices, and the link for transmitting audio signals established by different audio devices based on the underlying link can be an audio link. It is easy to understand that different audio devices that have established an audio link have established an underlying link, but different audio devices that have established an underlying link do not necessarily have established an audio link. For example, Figure 1 As shown, an underlying link and an audio link are established between audio device 01 and audio device 02, and an underlying link but no audio link is established between audio device 01 and audio device 03. The audio link described in this section is also the transmission path described in the embodiments below.

[0073] It is easy for those skilled in the art to understand that Figure 1 The audio processing network shown is for illustrative purposes only and is not intended to limit the technical solutions of the embodiments of the present application. During implementation, the number of audio devices can be configured as needed, and other devices can also be configured in the audio processing network. For example, the audio processing network can also include a management device for managing the multiple audio devices. For another example, the audio processing network can also include a server, etc., which are not limited in the embodiments of the present application.

[0074] The solution provided in the embodiments of this application may include a path determination process and a signal transmission process. The path determination process is used to determine at least one target transmission path from the audio processing network, with the destination being a target audio device. The signal transmission process is used to cause the audio devices on each target transmission path to transmit audio signals to the target audio device via the target transmission path. The transmission path may be the audio link described above. The path determination process and the signal transmission process are described in two separate embodiments below.

[0075] First, the path determination process in the embodiment of the present application is introduced. The path determination process can be performed by a target audio device, which can be an application audio device in an audio processing network.

[0076] For example, please refer to Figure 2 , which shows a flow chart of a method for determining a target transmission path of a target audio device from an audio processing network provided by an embodiment of the present application. The method can be applied to Figure 1 The implementation environment shown. Figure 2 , the method may include the following steps:

[0077] Step 201: Determine at least one target transmission path whose destination is a target audio device from an audio processing network.

[0078] In an embodiment of the present application, the audio processing network may include multiple transmission paths whose destination is the target audio device, and the target audio device may select at least one transmission path from the multiple transmission paths as the at least one target transmission path. Alternatively, the target audio device may determine at least one target transmission path whose destination is the target audio device from the audio processing network (or establish at least one target transmission path whose destination is the target audio device) based on the topology information of the audio processing network and the current processing capabilities of each audio device in the audio processing network. Corresponding to these two situations, step 201 may include the following two possible implementation methods:

[0079] A first implementation manner: the target audio device selects at least one transmission path from a plurality of transmission paths whose destination point is the target audio device in the audio processing network as the at least one target transmission path.

[0080] Alternatively, the target audio device may select at least one transmission path from the multiple transmission paths as the at least one target transmission path based on a path detection signal transmitted via the multiple transmission paths, or may select at least one transmission path from the multiple transmission paths as the at least one target transmission path based on the current processing capabilities of the audio devices on the multiple transmission paths. Therefore, the first implementation of step 201 may include the following two optional implementations:

[0081] Embodiment 1: The target audio device selects at least one transmission path from the multiple transmission paths as at least one target transmission path according to the path detection signals transmitted through the multiple transmission paths.

[0082] For example, please refer to Figure 3 , which shows a flow chart of a method for selecting at least one target transmission path from multiple transmission paths provided by an embodiment of the present application, see Figure 3 , the method may include the following steps:

[0083] Sub-step 2011A: Receive a path detection signal transmitted through each transmission path of the plurality of transmission paths, wherein the path detection signal transmitted through each transmission path includes information of each audio device on the transmission path.

[0084] The audio device on each of the multiple transmission paths transmits a path detection signal to the target audio device via the transmission path on which it is located. The target audio device can receive the path detection signal transmitted via each transmission path. The path detection signal transmitted via each transmission path includes information about each audio device on that transmission path. The audio device information may include, for example, a device identifier of the audio device, etc., which is not limited in this embodiment of the present application.

[0085] Optionally, the audio device on each transmission path sends a path detection signal to the target audio device via the transmission path where it is located, which may include: the audio device at the starting point of each transmission path generates a path detection signal containing information of the audio device (such as a device identifier), and sends the path detection signal to the next-hop device of the audio device on the transmission path; after receiving the path detection signal, the next-hop device may add its own information (such as a device identifier) ​​to the path detection signal, and send the path detection signal with its own information added to the next-hop device of the next-hop device on the transmission path until the path detection signal is transmitted to the target audio device. The next-hop device of each audio device may be an audio device that is adjacent to the audio device on the transmission path where the audio device is located and is located after the audio device in the direction of the transmission path.

[0086] For example, Figure 1 For example, the audio device 04 may be a target audio device. The multiple transmission paths in the audio processing network with the audio device 04 as the destination may include:

[0087] Transmission path 1: audio device 03 -> audio device 02 -> audio device 01 -> audio device 04;

[0088] Transmission path 2: audio device 03 -> audio device 02 -> audio device 04;

[0089] Transmission path 3: audio device 03 -> audio device 04;

[0090] Transmission path 4: audio device 05 -> audio device 04;

[0091] Taking transmission path 1 as an example, the audio device on the transmission path 1 sending a path detection signal to the audio device 04 through the transmission path 1 may include: audio device 03 generates a path detection signal including the device identification ID-03 of the audio device 03, and sends the path detection signal to the audio device 02 (the next-hop device of the audio device 03); after receiving the path detection signal, the audio device 02 adds the device identification ID-02 of the audio device 02 to the path detection signal, and sends the path detection signal with the device identification ID-02 added to the audio device 01 (the next-hop device of the audio device 02); after receiving the path detection signal, the audio device 01 adds the device identification ID-01 of the audio device 01 to the path detection signal, and sends the path detection signal with the device identification ID-01 added to the audio device 04 (the next-hop device of the audio device 01). Finally, the path detection signal sent through the transmission path 1 and received by the audio device 04 includes the device identification ID-03 of the audio device 03, the device identification ID-02 of the audio device 02, and the device identification ID-01 of the audio device 01.

[0092] Similarly, the path detection signal sent via transmission path 2 and received by audio device 04 contains the device identification ID-03 of audio device 03 and the device identification ID-02 of audio device 02. The path detection signal sent via transmission path 3 and received by audio device 04 contains the device identification ID-03 of audio device 03. The path detection signal sent via transmission path 4 and received by audio device 04 contains the device identification ID-05 of audio device 05.

[0093] Sub-step 2012A: Based on the path detection signals transmitted through the multiple transmission paths, select at least one transmission path from the multiple transmission paths as at least one target transmission path, and the at least one target transmission path is the transmission path with the least number of paths and the largest number of audio devices among the multiple transmission paths.

[0094] Optionally, the target audio device may determine the number of audio devices on the transmission path based on the information of the audio devices contained in the path detection signal transmitted through each transmission path, and select at least one transmission path from the multiple transmission paths as at least one target transmission path based on the number of audio devices on the multiple transmission paths and the number of the multiple transmission paths, wherein the at least one target transmission path is the transmission path with the least number of paths and the largest number of audio devices among the multiple transmission paths. The at least one target transmission path being the transmission path with the least number of paths and the largest number of audio devices among the multiple transmission paths may mean that the at least one target transmission path is the transmission path in the combination of the multiple transmission paths (each combination including at least one transmission path) with the largest number of audio devices (for example, the number of audio devices on the at least one target transmission path is equal to the sum of the numbers of all audio devices on the multiple transmission paths) and the smallest number of paths.

[0095] For example, taking transmission paths 1 to 4 as an example, the number of audio devices on transmission path 1 is 4, the number of audio devices on transmission path 2 is 3, and the number of audio devices on transmission paths 3 and 4 is 2 respectively. Audio device 04 can select transmission path 1 and transmission path 4 as target transmission paths from the four transmission paths based on the number of audio devices on transmission paths 1 to 4 and the number of these four transmission paths. Among them, the combination of transmission path 1 and transmission path 4 contains the largest number of audio devices (a total of 5 audio devices), and the combination of transmission path 1 and transmission path 4 has the smallest number of paths among the combinations of transmission paths 1 to 4.

[0096] In the embodiment of the present application, the path detection signal can be an audio signal or a signal dedicated to path detection. The target audio device selects the transmission path with the least number of paths and the largest number of audio devices among the multiple transmission paths as the target transmission path, which helps to minimize the transmission bandwidth of the audio signal.

[0097] Implementation method 2: The target audio device selects at least one transmission path from the multiple transmission paths as at least one target transmission path according to the current processing capabilities of the audio devices on the multiple transmission paths.

[0098] For example, please refer to Figure 4 , which shows another method flow chart of selecting at least one target transmission path from multiple transmission paths provided by an embodiment of the present application, see Figure 4 , the method may include the following steps:

[0099] Sub-step 2011B: For each transmission path among the multiple transmission paths, obtain the current processing capability of each audio device on the transmission path.

[0100] Optionally, each audio device in the audio processing network can send (e.g., broadcast) its own processing capability information to other audio devices in the audio processing network in real time or periodically. The processing capability information sent by each audio device to other audio devices is used to represent the current processing capability of the audio device. For example, each audio device can broadcast its own processing capability information to other audio devices every 10 seconds or 60 seconds. For each transmission path, the target audio device can determine the current processing capability of each audio device on the transmission path based on the processing capability information most recently received from each audio device on the transmission path. Optionally, the processing capability information can include at least one of central processing unit (CPU) occupancy and absolute capability information, such as million instructions per second (MIPS), million operations per second (MOPS), or megabit code per second (MCPS), where MIPS is also known as the average execution speed of single-word fixed-point instructions.

[0101] Sub-step 2012B: Based on the current processing capabilities of the audio devices on the multiple transmission paths, select at least one transmission path from the multiple transmission paths as at least one target transmission path, and the current processing capability of the audio device on each target transmission path is stronger than the preset processing capability.

[0102] The preset processing capability may be pre-set by the target audio device or the management device in the audio processing network before executing sub-step 2012B. The preset processing capability is used to measure the strength of the current processing capability of the audio device.

[0103] Optionally, the target audio device may select, from among multiple transmission paths, a transmission path containing audio devices whose current processing capabilities exceed a preset processing capability based on the current processing capabilities of the audio devices on the multiple transmission paths as the target transmission path. Optionally, the current processing capabilities of all audio devices on the target transmission path exceed the preset processing capability, or the ratio of the number of audio devices whose current processing capabilities exceed the preset processing capability on the target transmission path to the number of all audio devices on the target transmission path is greater than a preset ratio. That is, if the proportion of audio devices whose current processing capabilities exceed the preset processing capability on a particular transmission path exceeds a preset ratio on the transmission path, the transmission path may be selected as the target transmission path. For example, the preset ratio may be 0.5, 0.6, or 0.8. Optionally, the preset processing capability may be represented by preset processing capability information, which may be at least one of CPU occupancy and absolute capability information, such as MIPS, MOPS, or MCPS.

[0104] For example, continuing with the above-mentioned transmission paths 1 to 4, assuming that the CPU usage of audio device 01 is greater than the preset CPU usage, audio device 04 (the target audio device) can select the transmission path where audio device 01 is located as the target transmission path, that is, select the above-mentioned transmission path 1 as the target transmission path. Assuming that the MIPS number of audio device 05 is greater than the preset MIPS number, audio device 04 can select the transmission path where audio device 05 is located as the target transmission path, that is, select the above-mentioned transmission path 4 as the target transmission path.

[0105] In an embodiment of the present application, the target audio device selects the transmission path where the audio device whose current processing capability is stronger than the preset processing capability is located from multiple transmission paths as the target transmission path, which helps to maintain the system stability of the audio processing network.

[0106] It is worth noting that the embodiment of the present application is illustrated by taking the audio device 04 selecting transmission path 1 and transmission path 4 as the target transmission path. In actual applications, the distance between the audio device 04 and the audio device 05 may be relatively close. If the distance between the audio device 04 and the audio device 05 is relatively close, the audio signal collected by the audio device 05 and the audio signal collected by the audio device 04 are highly correlated. For the audio device 04, the audio signal collected by the audio device 05 contains less useful information. Therefore, the audio device 04 may not select transmission path 4. The embodiment of the present application does not limit this.

[0107] A second implementation manner is to determine at least one target transmission path having a destination point as a target audio device from the audio processing network according to topology information of the audio processing network and current processing capabilities of each audio device in the audio processing network.

[0108] For example, please refer to Figure 5 , which shows a flow chart of a method for determining at least one target transmission path with a destination point being a target audio device provided by an embodiment of the present application, see Figure 5 , the method may include the following steps:

[0109] Sub-step 2011C: obtaining topology information of the audio processing network and the current processing capability of each audio device in the audio processing network.

[0110] Optionally, a management device of the audio processing network can maintain topology information of the audio processing network, and the target audio device can obtain the topology information of the audio processing network from the management device. The topology information may include the connection relationships between audio devices in the audio processing network. The management device can be any audio device in the audio processing network (e.g., an application audio device) or a device dedicated to managing the audio processing network, which is not limited in this embodiment of the present application.

[0111] Optionally, each audio device in the audio processing network can send its own processing capability information to other audio devices in the audio processing network in real time or periodically. For example, each audio device can broadcast its own processing capability information to other audio devices every 10 seconds or 60 seconds. The target audio device can determine the current processing capability of each audio device in the audio processing network based on the processing capability information most recently received from each audio device. The processing capability information may include at least one of CPU occupancy and absolute capability information, such as MIPS, MOPS, or MCPS.

[0112] Sub-step 2012C: Determine at least one cooperative audio device required by the target audio device from the audio processing network based on the current processing capabilities of each audio device in the audio processing network.

[0113] Optionally, the target audio device can determine at least one collaborative audio device required by the target audio device from the audio processing network based on business needs and the current processing capabilities of each audio device. The at least one collaborative audio device can be an audio device that can provide audio signals for the business needs of the target audio device and has strong current processing capabilities.

[0114] Optionally, the target audio device may sort the audio devices in the audio processing network that can provide audio signals for the target audio device in order of processing capabilities from strong to weak, and determine, according to the sorting result, at least one audio device with a higher processing capability ranking among the audio devices that can provide audio signals for the target audio device as the at least one collaborative audio device. Alternatively, the target audio device may determine, as the at least one collaborative audio device, at least one audio device whose current processing capability is stronger than a preset processing capability among the audio devices that can provide audio signals for the target audio device. The preset processing capability may be represented by preset processing capability information, and the preset processing capability information may be at least one of CPU occupancy and absolute capability information, such as MIPS number, MOPS number or MCPS number.

[0115] For example, Figure 1 For example, audio device 04 can be the target audio device, the MIPS number of audio device 01 is greater than the preset MIPS number, the MOPS number of audio device 02 is greater than the preset MOPS number, the CPU occupancy rate of audio device 03 is greater than the preset CPU occupancy rate, and the MCPS number of audio device 05 is greater than the preset MCPS number. Therefore, audio device 04 can determine audio device 01, audio device 02, audio device 03 and audio device 05 as at least one collaborative audio device required by audio device 04.

[0116] Sub-step 2013C: According to the topology information of the audio processing network, at least one transmission path having a destination point being the target audio device and including the at least one cooperative audio device is determined as at least one target transmission path.

[0117] Optionally, the target audio device can determine, based on the topology information of the audio processing network, multiple transmission paths whose destination point is the target audio device and which include the at least one collaborative audio device, and then select at least one transmission path from the multiple transmission paths as the at least one target transmission path. The at least one target transmission path is the transmission path with the least number of paths among the multiple transmission paths whose destination point is the target audio device and which include the at least one collaborative audio device. For example, the at least one target transmission path is a transmission path among multiple combinations of the multiple transmission paths (each combination includes at least one transmission path) that includes the at least one collaborative audio device and has the least number of paths.

[0118] For example, Figure 1For example, audio device 04 may be a target audio device, and audio device 01, audio device 02, audio device 03, and audio device 05 are collaborative audio devices of audio device 04. Audio device 04 determines, based on the topology information of the audio processing network, that the destination point is audio device 04 and that multiple transmission paths including audio device 01, audio device 02, audio device 03, and audio device 05 may include:

[0119] Transmission path 1: audio device 03 -> audio device 02 -> audio device 01 -> audio device 04;

[0120] Transmission path 2: audio device 03 -> audio device 02 -> audio device 04;

[0121] Transmission path 3: audio device 03 -> audio device 04;

[0122] Transmission path 4: audio device 05 -> audio device 04;

[0123] Audio device 04 can determine transmission path 1 and transmission path 4 as target transmission paths, the combination of transmission path 1 and transmission path 4 includes audio device 01, audio device 02, audio device 03 and audio device 05, and the combination of transmission path 1 and transmission path 4 is the combination with the least number of paths among the combinations of transmission path 1 to transmission path 4.

[0124] Step 202: Send transmission instruction information to the audio device on each target transmission path. The audio device on each target transmission path is configured to transmit the audio signal through the target transmission path according to the received transmission instruction information.

[0125] After the target audio device determines at least one target transmission path with the destination point being the target audio device from the audio processing network, it can send transmission instruction information to the audio devices on each target transmission path to instruct the audio devices on each target transmission path to transmit audio signals through the target transmission path.

[0126] Optionally, step 202 may include two possible implementations:

[0127] In a first implementation, the target audio device sends a removal instruction message to the audio device on each target transmission path. The removal instruction message sent by the target audio device to the audio device on each target transmission path indicates that the audio device is to remove a redundant transmission path among the multiple transmission paths of the target audio device and transmit audio signals through the target transmission path. The redundant transmission path is a transmission path among the multiple transmission paths other than the at least one target transmission path. Optionally, this first implementation may correspond to the first implementation in step 201.

[0128] Optionally, the dismantling instruction information sent by the target audio device to each audio device may carry the path information of the at least one target transmission path (the path information of each transmission path may include the device identification of the audio device on the transmission path, and the connection relationship between the audio devices on the transmission path), and each audio device determines the redundant transmission path where it is located based on the path information of the target transmission path carried by the received dismantling instruction information and the path information of its own transmission path, and dismantles the redundant transmission path. Alternatively, the dismantling instruction information sent by the target audio device to each audio device may carry the path information of the redundant transmission path, and each audio device dismantles the redundant transmission path based on the path information of the redundant transmission path carried by the received dismantling instruction information. After dismantling the redundant transmission path, the remaining transmission paths with the target audio device as the destination point are all target transmission paths, and each audio device can transmit audio signals through the target transmission path where it is located.

[0129] For example, Figure 1 For example, corresponding to the first implementation in step 201, among transmission paths 1 to 4 whose destination is audio device 04, transmission paths 1 and 4 are target transmission paths, and transmission paths 2 and 3 are redundant transmission paths. Audio device 04 can send a removal instruction message to audio devices 01, 02, 03, and 05 on the target transmission path. The removal instruction message can carry the path information of transmission path 1 and 4 (or carry the path information of transmission path 2 and 3). Audio devices 01, 02, 03, and 05 remove transmission paths 2 and 3 according to the removal instruction message. After removing transmission paths 2 and 3, audio devices 01, 02, and 03 transmit audio signals to audio device 04 via transmission path 1, and audio device 05 transmits audio signals to audio device 04 via transmission path 2.

[0130] It is worth noting that the implementation method for dismantling redundant transmission paths provided in the embodiment of the present application is merely exemplary. In actual applications, the target audio device can send a dismantling instruction message to the previous-hop device of the target audio device on each redundant transmission path, so that the previous-hop device dismantles the transmission path between it and the target audio device, thereby dismantling the redundant transmission path. The previous-hop device of the target audio device can be an audio device that is adjacent to the target audio device on the target transmission path and is located before the target audio device according to the direction of the target transmission path. Figure 1For example, audio device 04 may send removal instruction information to audio device 02 (the previous hop device of audio device 04 on transmission path 2) and audio device 03 (the previous hop device of audio device 04 on transmission path 3), respectively, instructing audio device 02 to remove transmission path 2 and instructing audio device 03 to remove transmission path 3. In the embodiment of the present application, removing a redundant transmission path may refer to removing the audio link corresponding to the redundant transmission path, without removing the underlying link. By removing the redundant transmission path, the audio device can be prevented from transmitting audio signals to the target audio device through the redundant transmission path, thereby helping to reduce the transmission bandwidth of the audio signal.

[0131] Second implementation method: The target audio device sends device indication information to the audio device on each target transmission path. The device indication information sent by the target audio device to the audio device on each target transmission path indicates the next-hop device of the audio device on the target transmission path. Each audio device can transmit an audio signal to the next-hop device of the audio device based on the received device indication information. The next-hop device of the audio device can be an audio device adjacent to the audio device on the target transmission path and located after the audio device in the direction of the target transmission path. Optionally, this second implementation method can correspond to the second implementation method in step 201.

[0132] Optionally, for each target transmission path, the target audio device may send device indication information to each audio device on the target transmission path, and the target audio device may send device indication information to each audio device including the device identification of the next-hop device of the audio device on the target transmission path, thereby indicating the next-hop device. Alternatively, for each target transmission path, the target audio device may send device indication information including its own device identification to the previous-hop device of the target audio device on the target transmission path, thereby indicating itself (that is, the target audio device) to the previous-hop device; after the previous-hop device receives the device indication information, it may send device indication information including its own device identification to the previous-hop device of the previous-hop device on the target transmission path, thereby indicating itself to the previous-hop device, and so on, until the audio device at the starting point of the target transmission path receives the device indication information.

[0133] For example, Figure 1For example, corresponding to the second implementation of step 201, transmission path 1 and transmission path 4 are target transmission paths with the destination being audio device 04. For transmission path 1, audio device 04 can send device indication information containing the device identification ID-04 of audio device 04 to audio device 01 to indicate audio device 04 (i.e., the next-hop device of audio device 01 on transmission path 1), send device indication information containing the device identification ID-01 of audio device 01 to audio device 02 to indicate audio device 01 (i.e., the next-hop device of audio device 02 on transmission path 1), and send device indication information containing the device identification ID-02 of audio device 02 to audio device 03 to indicate audio device 02 (i.e., the next-hop device of audio device 03 on transmission path 1). Alternatively, audio device 04 may send device indication information containing the device identification ID-04 of audio device 04 to audio device 01 (i.e., the previous hop device of audio device 04 on the transmission path 1) to indicate audio device 04. After receiving the device indication information, audio device 01 may send device indication information containing the device identification ID-01 of audio device 01 to audio device 02 (i.e., the previous hop device of audio device 01 on the transmission path 1) to indicate audio device 01. After receiving the device indication information, audio device 02 may send device indication information containing the device identification ID-03 of audio device 03 to audio device 03 (i.e., the previous hop device of audio device 02 on the transmission path 1) to indicate audio device 03. The same applies to transmission path 4 and will not be described in detail here.

[0134] The above steps 201 to 202 are the path determination process provided by the embodiment of the present application. After the above steps 201 to 202, the target audio device can determine at least one target transmission path from the audio processing network. For example, please refer to Figure 6 , which shows a schematic diagram of at least one target transmission path in an audio processing network provided by an embodiment of the present application, such as Figure 6 As shown, the audio processing network includes two target transmission paths with the destination being audio device 04, and the two target transmission paths are: transmission path 1: audio device 03->audio device 02->audio device 01->audio device 04, and transmission path 4: audio device 05->audio device 04. Among at least one target transmission path determined by the target audio device from the audio processing network, any target transmission path can be the first transmission path. For example, the first transmission path can be Figure 6 The transmission path shown is 1 or 4. The signal transmission process is described below by taking the audio device on the first transmission path transmitting an audio signal to the target audio device as an example.

[0135] For example, please refer to Figure 7 , which shows a method flow chart of a signal transmission method provided by an embodiment of the present application, the signal transmission method can be applied to Figure 1 The implementation environment shown. Figure 7 , the method may include the following steps:

[0136] Step 701: The previous-hop device of a first audio device sends an audio signal to the first audio device.

[0137] Optionally, the first audio device and the previous hop device of the first audio device can be any two adjacent audio devices on the first transmission path, and according to the direction of the first transmission path, the previous hop device of the first audio device is located before the first audio device. It is easy to understand that the previous hop device of the first audio device may also have a previous hop device, and the previous hop device of the previous hop device of the first audio device may be located before the previous hop device of the first audio device. In the embodiment of the present application, for the convenience of description, the previous hop device of the first audio device may be referred to as the second audio device, and the previous hop device of the previous hop device of the first audio device may be referred to as the third audio device, that is, the second audio device described in the embodiment of the present application and the previous hop device of the first audio device refer to the same audio device, and the third audio device and the previous hop device of the previous hop device of the first audio device refer to the same audio device. For example, the third audio device, the second audio device and the first audio device are arranged in the direction of the first transmission path.

[0138] Optionally, the audio signal sent by the previous-hop device of the first audio device to the first audio device may be an audio signal collected by a single audio device, or may be a mixed signal of audio signals collected by at least two audio devices. For example, the audio signal sent by the previous-hop device of the first audio device to the first audio device may be an audio signal collected by the previous-hop device of the first audio device, or may be obtained by processing the audio signal collected by the previous-hop device of the first audio device, or the audio signal sent by the previous-hop device of the first audio device to the first audio device may be a mixed signal of the audio signal collected by the previous-hop device of the first audio device and the audio signal collected by the previous-hop device of the previous-hop device of the first audio device, or even the audio signal sent by the previous-hop device of the first audio device to the first audio device may be a mixed signal of audio signals collected by n audio devices located before the first audio device on the first transmission path, where n is an integer greater than or equal to 3, and this embodiment of the present application is not limited to this.

[0139] For example, please refer to Figures 8 to 10 , which shows a schematic diagram of three audio signal transmissions through a first transmission path provided by an embodiment of the present application. Figures 8 to 10Two first transmission paths are provided. Figure 8 and Figure 9 As shown, the audio device at the starting point of the first transmission path is audio device 02, and the audio device at the destination point is audio device 04. The direction of the first transmission path can be from audio device 02 to audio device 04. The first audio device can be audio device 01, and the previous hop device of the first audio device can be audio device 02. Audio device 02 is the audio device at the starting point of the first transmission path, so audio device 02 has no previous hop device. The audio signal sent by audio device 02 to audio device 01 can be the audio signal collected by audio device 02, or the audio signal collected by audio device 02 can be processed. Figure 10 As shown, the audio device at the starting point of the first transmission path is audio device 03, and the audio device at the destination point is 04. The direction of the first transmission path can be from audio device 03 to audio device 04. The first audio device can be audio device 01, the previous-hop device of the first audio device can be audio device 02, and the previous-hop device of the previous-hop device of the first audio device can be audio device 03. Audio device 03 is the audio device at the starting point of the first transmission path. Therefore, audio device 03 has no previous-hop device. The audio signal sent by audio device 02 to audio device 01 can be a mixed signal of the audio signal collected by audio device 02 and the audio signal collected by audio device 03.

[0140] In the embodiment of the application, depending on the difference in the audio signal sent by the previous-hop device of the first audio device to the first audio device, step 701 may include three possible implementations:

[0141] A first implementation manner: the audio signal sent by the previous-hop device of the first audio device to the first audio device is an audio signal collected by the previous-hop device of the first audio device.

[0142] Optionally, the previous-hop device of the first audio device may have an audio acquisition component, and the previous-hop device of the first audio device may acquire an audio signal through the audio acquisition component and transmit the audio signal to the first audio device. The audio signal acquired by the previous-hop device of the first audio device may be a digital signal. For example, the audio signal acquired by the previous-hop device of the first audio device may be a digitized audio sequence comprising N sampling point data. Each sampling point data may be represented by a fixed bit, such as 16 bits.

[0143] For example, Figure 8As shown, the first audio device may be audio device 01, the previous hop device of the first audio device may be audio device 02, the audio signal collected by audio device 02 may be g2(n), n=0, 1, ..., N-1, and audio device 02 may send the audio signal g2(n) to audio device 01.

[0144] Second implementation manner: the audio signal sent by the previous-hop device of the first audio device to the first audio device is obtained by processing the audio signal collected by the previous-hop device of the first audio device.

[0145] Optionally, the previous-hop device of the first audio device can collect audio signals, then process the collected audio signals, and send the audio signals to the first audio device after processing. Optionally, each audio device in the audio processing network can have an audio processing function, and the previous-hop device of the first audio device can use the audio processing function of the previous-hop device of the first audio device to process the audio signal collected by the previous-hop device of the first audio device. For example, the previous-hop device of the first audio device uses the audio processing function of the previous-hop device of the first audio device to convolve the audio signal collected by the previous-hop device of the first audio device.

[0146] For example, Figure 9 As shown, the first audio device may be audio device 01, the previous-hop device of the first audio device may be audio device 02, the audio signal collected by audio device 02 may be g2(n), the audio processing function of audio device 02 may be h2(n), and audio device 02 may send an audio signal y2(n) to audio device 01, where y2(n)=g2(n)*h2(n). The symbol “*” represents convolution, and the audio signal y2(n) is obtained by convolving the audio signal g2(n) collected by audio device 02 according to the audio processing function h2(n) of audio device 02.

[0147] A third implementation manner: the audio signal sent by the previous-hop device of the first audio device to the first audio device is a mixed signal of audio signals collected by at least two audio devices.

[0148] Optionally, the previous-hop device of the first audio device can obtain audio signals collected by at least two audio devices, mix the audio signals collected by the at least two audio devices to obtain a mixed signal, and send the mixed signal to the first audio device. Optionally, each audio device in the audio processing network can have an audio processing function. For each of the at least two audio devices, the previous-hop device of the first audio device can use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain the processed signal of the audio device, and superimpose the processed signals of the at least two audio devices to obtain a mixed signal. Optionally, for each of the at least two audio devices, the previous-hop device of the first audio device can use the audio processing function of the audio device to convolve the audio signal collected by the audio device to obtain the processed signal of the audio device.

[0149] In an embodiment of the present application, the at least two audio devices may include the previous hop device of the first audio device (that is, the second audio device) and the previous hop device of the previous hop device of the first audio device (that is, the third audio device). Take the case where the at least two audio devices are the previous hop device of the first audio device (that is, the second audio device) and the previous hop device of the previous hop device of the first audio device (that is, the third audio device) as an example. The second audio device can collect audio signals, and the second audio device can receive audio signals sent by the third audio device. The second audio device can use the audio processing function of the second audio device to convolve the audio signal collected by the second audio device to obtain the processed signal of the second audio device, and use the audio processing function of the third audio device to convolve the audio signal collected by the third audio device to obtain the processed signal of the third audio device. Afterwards, the second audio device superimposes the processed signal of the second audio device and the processed signal of the third audio device to obtain a mixed signal.

[0150] For example, Figure 10As shown, the first audio device is audio device 01, the previous hop device of the first audio device (that is, the second audio device) is audio device 02, the previous hop device of the previous hop device of the first audio device (that is, the third audio device) is audio device 03, the audio signal collected by audio device 02 may be g2(n), the audio processing function of audio device 02 may be h2(n), the processed signal of audio device 02 may be g2(n)*h2(n), and the audio signal collected by audio device 03 may be g3(n). The audio processing function of audio device 03 can be h3(n), the processed signal of audio device 03 can be g3(n)*h3(n), and audio device 02 can send audio signal y2(n) to audio device 01, y2(n)=g2(n)*h2(n)+g3(n)*h3(n), the symbol "*" represents convolution, and the symbol "+" represents superposition. The audio signal y2(n) is a mixed signal of the audio signal g2(n) collected by audio device 02 and the audio signal g3(n) collected by audio device 03.

[0151] It is easy for those skilled in the art to understand that the audio signal g3(n) collected by the audio device 03 (that is, the previous-hop device of the previous-hop device of the first audio device) can be a digital signal, and the audio signal g3(n) can contain N sampling point data, and each sampling point data can be represented by a fixed bit. The audio signal g3(n) can be sent by the audio device 03 to the audio device 02 (that is, the previous-hop device of the first audio device). The process of the audio device 03 sending the audio signal to the audio device 02 can refer to the first implementation method and the second implementation method of step 701, and the embodiments of the present application will not be repeated here. It is worth noting that if the audio device 03 sends the audio signal to the audio device 02 with reference to the second implementation method of step 701, such as Figure 10 As shown, audio device 03 may transmit audio signal y3(n) obtained by processing audio signal g3(n) to audio device 02. Audio device 02 may first recover audio signal g3(n) from audio signal y3(n). The audio signal recovery process is described in detail below in the embodiments of the present application and will not be repeated here.

[0152] It is worth noting that when the previous-hop device of the first audio device (that is, the second audio device) sends an audio signal to the first audio device, source information can be added to the audio signal sent to the first audio device to indicate the source of the audio signal. The source information can be the device identification of the audio device, indicating that the audio signal originates from the audio device indicated by the device identification. Optionally, the source information added by the previous-hop device of the first audio device to the audio signal sent to the first audio device contains at least the device identification of the previous-hop device of the first audio device, indicating that the audio signal sent by the previous-hop device of the first audio device contains the audio signal collected by the previous-hop device of the first audio device. Optionally, the source information added by the previous-hop device of the first audio device to the audio signal sent to the first audio device may also contain the device identification of the previous-hop device of the previous-hop device of the first audio device (that is, the third audio device), indicating that the audio signal sent by the previous-hop device of the first audio device contains the audio signal collected by the previous-hop device of the previous-hop device of the first audio device. For example, the source information added by the previous-hop device of the first audio device to the audio signal sent to the first audio device includes the device identification of the previous-hop device of the first audio device and the device identification of the previous-hop device of the previous-hop device of the first audio device, indicating that the audio signal sent by the previous-hop device of the first audio device is a mixed signal of the audio signal collected by the previous-hop device of the first audio device and the audio signal collected by the previous-hop device of the previous-hop device of the first audio device.

[0153] Step 702: The first audio device receives an audio signal sent by the previous-hop device of the first audio device.

[0154] The previous-hop device corresponding to the first audio device (that is, the second audio device) sends an audio signal to the first audio device, and the first audio device can receive the audio signal sent by the previous-hop device of the first audio device.

[0155] For example, Figure 8 As shown, the audio device 01 receives the audio signal g2(n) sent by the audio device 02, or, as shown Figure 9 and Figure 10 As shown, the audio device 01 receives the audio signal y2(n) sent by the audio device 02.

[0156] Step 703: The first audio device obtains the audio signal collected by the first audio device.

[0157] Optionally, the first audio device may include an audio acquisition component, and the first audio device may acquire an audio signal through the audio acquisition component. The audio signal acquired by the first audio device may be a digital signal, and the audio signal acquired by the first audio device may include N sampling point data, each sampling point data may be represented by a fixed bit, and the fixed bit may be, for example, 16 bits.

[0158] For example, Figures 8 to 10 As shown, the first audio device may be the audio device 01, and the audio signal collected by the audio device 01 may be g1(n), where n=0, 1, ..., N-1.

[0159] Step 704: The first audio device mixes the audio signal collected by the first audio device with the audio signal sent by the previous-hop device of the first audio device to obtain a mixed audio signal.

[0160] As mentioned above, the audio signal sent by the previous-hop device of the first audio device (that is, the second audio device) to the first audio device can be an audio signal collected by a single audio device, or a mixed signal of audio signals collected by at least two audio devices. In an embodiment of the present application, the first audio device can superimpose the audio signal collected by the first audio device and the audio signal sent to the first audio device by the previous-hop device of the first audio device to obtain a mixed audio signal, or it can restore the audio signals collected by each audio device from the audio signal sent to the first audio device by the previous-hop device of the first audio device, and then mix the restored audio signals collected by each audio device with the audio signal collected by the first audio device to obtain a mixed audio signal. Depending on the difference in the audio signal sent by the previous-hop device of the first audio device and the difference in the mixing method, step 704 can include the following four possible implementation methods:

[0161] A first implementation method: The audio signal sent by the previous-hop device of the first audio device is a mixed signal of audio signals collected by at least two audio devices (for example, the audio signal sent by the previous-hop device of the first audio device is a mixed signal of the audio signal collected by the previous-hop device of the first audio device and the audio signal collected by the previous-hop device of the previous-hop device of the first audio device). Alternatively, the audio signal sent by the previous-hop device of the first audio device is obtained by processing the audio signal collected by the previous-hop device of the first audio device.

[0162] For example, please refer to Figure 11 , which shows a flow chart of a method for mixing an audio signal collected by a first audio device and an audio signal sent by a previous hop device of the first audio device, provided in an embodiment of the present application, see Figure 11 , the method may include the following steps:

[0163] Sub-step 7041A: Use the audio processing function of the first audio device to process the audio signal collected by the first audio device to obtain a processed signal of the first audio device.

[0164] Optionally, the first audio device may use an audio processing function of the first audio device to perform convolution on the audio signal collected by the first audio device to obtain a processed signal of the first audio device.

[0165] For example, the audio signal collected by the first audio device may be g1(n), and the audio processing function of the first audio device may be h1(n). Therefore, the processed signal of the first audio device may be g1(n)*h1(n), where the symbol “*” represents convolution.

[0166] Sub-step 7042A: superimpose the processed signal of the first audio device and the audio signal sent by the previous-hop device of the first audio device to obtain a mixed audio signal.

[0167] For example, the mixed audio signal may be y1(n), y1(n)=y2(n)+g1(n)*h1(n), where the symbol “*” represents convolution and the symbol “+” represents superposition.

[0168] It is worth noting that in the first implementation of step 704, the first audio device does not need to recover the original audio signals collected by each audio device from the audio signal sent by the previous-hop device of the first audio device, which helps to simplify the signal mixing process and reduce the computational complexity of the signal mixing process.

[0169] Second implementation manner: the audio signal sent by the previous-hop device of the first audio device is a mixed signal of audio signals collected by at least two audio devices.

[0170] For example, please refer to Figure 12 , which shows a flow chart of another method for mixing an audio signal collected by a first audio device and an audio signal sent by a previous hop device of the first audio device, provided in an embodiment of the present application, see Figure 12 , the method may include the following steps:

[0171] Sub-step 7041B: Recover audio signals collected by at least two audio devices from the audio signal sent by the previous-hop device of the first audio device.

[0172] Optionally, the audio signal sent by the previous-hop device of the first audio device (that is, the second audio device) can carry source information. The first audio device can determine, based on the source information carried by the audio signal sent by the previous-hop device of the first audio device, that the audio signal sent by the previous-hop device of the first audio device is a mixed signal of audio signals collected by at least two audio devices, and then can recover the audio signals collected by the at least two audio devices from the audio signal sent by the previous-hop device of the first audio device based on the audio processing functions of the at least two audio devices. Optionally, the first audio device can respectively use the audio processing functions of the at least two audio devices to convolve the audio signal sent by the previous-hop device of the first audio device, so as to separate the audio signal sent by the previous-hop device of the first audio device into at least two signal parts corresponding one-to-one to the at least two audio devices, and then recover the audio signal collected by the audio device from the signal part corresponding to each audio device.

[0173] Optionally, the first audio device separating the audio signal sent by the previous-hop device of the first audio device into at least two parts corresponding to the at least two audio devices may include: for each of the at least two audio devices, the first audio device convolving the audio signal sent by the previous-hop device of the first audio device using the audio processing function of the audio device to obtain a convolution signal corresponding to the audio device, where the convolution signal corresponding to the audio device is the signal portion corresponding to the audio device separated from the audio signal sent by the previous-hop device of the first audio device. The first audio device recovering the audio signal collected by the audio device from the signal portion corresponding to each audio device may include: the first audio device converting the convolution signal corresponding to the audio device into the frequency domain for processing to obtain the audio signal corresponding to the audio device in the frequency domain, and then converting the audio signal corresponding to the audio device in the frequency domain into the time domain to obtain the audio signal collected by the audio device. Optionally, the first audio device may convert the convolution signal into the frequency domain by using fast Fourier transform (FFT) or discrete cosine transform (DCT), and convert the audio signal in the frequency domain into the time domain by using inverse FFT transform or inverse DCT transform.

[0174] In an embodiment of the present application, the audio signal sent by the previous-hop device of the first audio device to the first audio device may be a mixed signal of audio signals collected by at least two audio devices, and the at least two audio devices may include the previous-hop device of the first audio device (that is, the second audio device) and the previous-hop device of the previous-hop device of the first audio device (that is, the third audio device). Take the at least two audio devices being the previous-hop device of the first audio device (that is, the second audio device) and the previous-hop device of the previous-hop device of the first audio device (that is, the third audio device) as an example. The source information carried by the audio signal sent by the second audio device to the first audio device may include the device identification of the second audio device and the device identification of the third audio device. The first audio device may determine, based on the device identification of the second audio device and the device identification of the third audio device, that the audio signal sent by the second audio device is a mixed signal of the audio signal collected by the second audio device and the audio signal collected by the third audio device. The first audio device convolves the audio signal sent by the second audio device using the audio processing function of the second audio device to obtain a convolved signal corresponding to the second audio device, and convolves the audio signal sent by the third audio device using the audio processing function of the third audio device to obtain a convolved signal corresponding to the third audio device. The first audio device converts the convolved signal corresponding to the second audio device into the frequency domain for processing to obtain an audio signal corresponding to the second audio device in the frequency domain, and converts the convolved signal corresponding to the third audio device into the frequency domain for processing to obtain an audio signal corresponding to the third audio device in the frequency domain. Thereafter, the first audio device converts the audio signal corresponding to the second audio device in the frequency domain into the time domain to obtain an audio signal collected by the second audio device, and converts the audio signal corresponding to the third audio device in the frequency domain into the time domain to obtain an audio signal collected by the third audio device.

[0175] For example, Figure 10 As shown, the first audio device is audio device 01, the previous-hop device of the first audio device (that is, the second audio device) is audio device 02, the previous-hop device of the previous-hop device of the first audio device (that is, the third audio device) is audio device 03, and the audio signal y2(n) sent by audio device 02 to audio device 01 includes the audio signal g2(n) collected by audio device 02 and the audio signal g3(n) collected by audio device 03. The audio processing function of audio device 02 can be h2(n), and the audio processing function of audio device 03 can be h3(n). The process by which audio device 01 recovers the audio signal g2(n) collected by audio device 02 and the audio signal g3(n) collected by audio device 03 from the audio signal y2(n) sent by audio device 02 can be as follows:

[0176] 1) Audio device 01 uses audio processing function h2(n) of audio device 02 and audio processing function h3(n) of audio device 03 to perform convolution on audio signal y2(n) sent by audio device 02, thereby separating the signal portion of audio device 02 and the signal portion of audio device 03 from the audio signal y2(n) sent by audio device 02. The convolution process is as follows:

[0177] y2(n)*h2(n)=[g2(n)*h2(n)+g3(n)*h3(n)]*h2(n) Formula (1);

[0178] y2(n)*h3(n)=[g2(n)*h2(n)+g3(n)*h3(n)]*h3(n) Formula (2);

[0179] In the embodiment of the present application, the audio processing functions of different audio devices are uncorrelated, and the result of convolution of uncorrelated signals is approximately 0. Therefore, in the above equations (1) and (2), g3(n)*h3(n)*h2(n) is approximately 0, and g2(n)*h2(n)*h3(n) is approximately 0. Therefore, the above equations (1) and (2) can be approximately simplified to the following equations (3) and (4):

[0180] y2(n)*h2(n)=g2(n)*h2(n)*h2(n) formula (3);

[0181] y2(n)*h3(n)=g3(n)*h3(n)*h3(n) formula (4);

[0182] Among them, g2(n)*h2(n)*h2(n) is the signal part of audio device 02 (that is, the convolution signal corresponding to audio device 02), and g3(n)*h3(n)*h3(n) is the signal part of audio device 03 (that is, the convolution signal corresponding to audio device 03).

[0183] 2) Audio device 01 recovers the audio signal g2(n) collected by audio device 02 from the signal portion of audio device 02 (i.e., the convolution signal corresponding to audio device 02), and recovers the audio signal g3(n) collected by audio device 03 from the signal portion of audio device 03 (i.e., the convolution signal corresponding to audio device 03). The recovery process is as follows:

[0184] First, the convolution signal corresponding to audio device 02 and the convolution signal corresponding to audio device 03 are converted into the frequency domain respectively using the following equations (5) and (6), thereby obtaining the convolution signal corresponding to audio device 02 in the frequency domain and the convolution signal corresponding to audio device 03 in the frequency domain.

[0185] y2(n)*h2(n)=g2(n)*h2(n)*h2(n)——>Y2(w)*H2(w)=G2(w)*H2(w)*H2(w) Formula (5);

[0186] y2(n)*h3(n)=g3(n)*h3(n)*h3(n)——>Y2(W)*H3(W)=G3(W)*H3(W)*H3(W) Formula (6);

[0187] Y2(W) represents the frequency domain signal of the audio signal y2(n) (that is, the signal corresponding to the audio signal y2(n) in the frequency domain), G2(w) represents the frequency domain signal of the audio signal g2(n) (that is, the signal corresponding to the audio signal g2(n) in the frequency domain), H2(w) represents the frequency domain function of the audio processing function h2(n) (that is, the function corresponding to the audio processing function h2(n) in the frequency domain), G2(w)*H2(w)*H2(w) represents the frequency domain signal of the convolution signal g2(n)*h2(n)*h2(n). number, which is the convolution signal corresponding to the audio device 02 in the frequency domain, G3(W) represents the frequency domain signal of the audio signal g3(n) (which is the signal corresponding to the audio signal g3(n) in the frequency domain), H3(W) represents the frequency domain function of the audio processing function h3(n) (which is the function corresponding to the audio processing function h3(n) in the frequency domain), G3(w)*H3(w)*H3(w) represents the frequency domain signal of the convolution signal g3(n)*h3(n)*h3(n), which is the convolution signal corresponding to the audio device 03 in the frequency domain.

[0188] Next, the convolution signal corresponding to the audio device 02 in the frequency domain is divided by the square of the frequency domain function H2(w) of the audio processing function h2(n) of the audio device 02 using the following equation (7), and the convolution signal corresponding to the audio device 03 in the frequency domain is divided by the square of the frequency domain function H3(w) of the audio processing function h2(n) of the audio device 03 using the following equation (8), to obtain the audio signal G3(w) corresponding to the audio device 03 in the frequency domain. The symbol “ / ” represents a division sign.

[0189] Y2(w)*H2(w) / H2(w)*H2(w)=G2(w)*H2(w)*H2(w) / H2(w)*H2(w)=G2(w) Formula (7);

[0190] Y2(W)*H3(W) / H3(W)*H3(W)=G3(W)*H3(W)*H3(W) / H3(W)*H3(W)=G3(W) Formula (8);

[0191] Finally, the audio signal G2(w) corresponding to the audio device 02 in the frequency domain is converted to the time domain using the following formula (9) to obtain the audio signal g2(n) collected by the audio device 02. The audio signal G3(w) corresponding to the audio device 03 in the frequency domain is converted to the time domain using the following formula (10) to obtain the audio signal g3(n) collected by the audio device 03.

[0192] G2(w)——>g2(n) formula (9);

[0193] G3(w)——>g3(n) formula (10).

[0194] Sub-step 7042B: For the first audio device and each of the at least two audio devices, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain a processed signal of the audio device.

[0195] Optionally, taking the example where the at least two audio devices are the previous-hop device of a first audio device (i.e., the second audio device) and the previous-hop device of the previous-hop device of the first audio device (i.e., the third audio device), the first audio device may convolve the audio signal collected by the first audio device using the audio processing function of the first audio device to obtain a processed signal of the first audio device, convolve the audio signal collected by the second audio device using the audio processing function of the second audio device to obtain a processed signal of the second audio device, and convolve the audio signal collected by the third audio device using the audio processing function of the third audio device to obtain a processed signal of the third audio device.

[0196] For example, Figure 10 As shown, the first audio device is audio device 01, the previous hop device of the first audio device (that is, the second audio device) is audio device 02, and the previous hop device of the previous hop device of the first audio device (that is, the third audio device) is audio device 03. The audio signal collected by audio device 01 may be g1(n), the audio processing function of audio device 01 may be h1(n), and the processed signal of audio device 01 may be g1(n)*h1(n). The audio signal collected by audio device 02 may be g2(n), the audio processing function of audio device 02 may be h2(n), and the processed signal of audio device 02 may be g2(n)*h2(n). The audio signal collected by audio device 03 may be g3(n), the audio processing function of audio device 02 may be h3(n), and the audio processed signal of audio device 03 may be g3(n)*h3(n). The symbol "*" represents convolution.

[0197] Sub-step 7043B: superimpose the processed signal of the first audio device and the processed signals of the at least two audio devices to obtain a mixed audio signal.

[0198] For example, Figure 10 As shown, the mixed audio signal may be y1(n), y1(n)=g1(n)*h1(n)+g2(n)*h2(n)+g3(n)*h3(n), where the symbol “*” represents convolution and the symbol “+” represents superposition.

[0199] A third implementation manner: the audio signal sent by the previous-hop device of the first audio device is an audio signal collected by the previous-hop device of the first audio device.

[0200] For example, please refer to Figure 13 , which shows a flow chart of another method for mixing an audio signal collected by a first audio device and an audio signal sent by a previous hop device of the first audio device, provided in an embodiment of the present application, see Figure 13 , the method may include the following steps:

[0201] Sub-step 7041C: For each audio device in the first audio device and the previous-hop device of the first audio device, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain a processed signal of the audio device.

[0202] Optionally, the audio signal sent by the previous-hop device of the first audio device (that is, the second audio device) to the first audio device may carry source information, and the first audio device may determine, based on the source information carried by the audio signal sent by the previous-hop device of the first audio device, that the audio signal sent by the previous-hop device of the first audio device is the audio signal collected by the previous-hop device of the first audio device. For example, the source information carried by the audio signal sent by the previous-hop device of the first audio device to the first audio device includes the device identification of the previous-hop device of the first audio device, and the first audio device may determine, based on the device identification of the previous-hop device of the first audio device, that the audio signal sent by the previous-hop device of the first audio device is the audio signal collected by the previous-hop device of the first audio device.

[0203] Optionally, the first audio device may use the audio processing function of the first audio device to convolve the audio signal collected by the first audio device to obtain the processed signal of the first audio device, and use the audio processing function of the previous-hop device of the first audio device to convolve the audio signal collected by the previous-hop device of the first audio device to obtain the processed signal of the previous-hop device of the first audio device.

[0204] For example, Figure 8As shown, the first audio device is audio device 01, and the previous hop device (i.e., the second audio device) of the first audio device is audio device 02. The audio signal collected by audio device 01 may be g1(n), the audio processing function of audio device 01 may be h1(n), and the processed signal of audio device 01 may be g1(n)*h1(n). The audio signal collected by audio device 02 may be g2(n), the audio processing function of audio device 02 may be h2(n), and the processed signal of audio device 02 may be g2(n)*h2(n). The symbol "*" represents convolution.

[0205] Sub-step 7042C: superimpose the processed signal of the first audio device and the processed signal of the previous-hop device of the first audio device to obtain a mixed audio signal.

[0206] For example, Figure 8 As shown, the mixed audio signal may be y1(n), y1(n)=g1(n)*h1(n)+g2(n)*h2(n), the symbol “*” represents convolution, and the symbol “+” represents superposition.

[0207] Fourth implementation manner: the audio signal sent by the previous-hop device of the first audio device is obtained by processing the audio signal collected by the previous-hop device of the first audio device.

[0208] For example, please refer to Figure 14 , which shows a flow chart of another method for mixing an audio signal collected by a first audio device and an audio signal sent by a previous hop device of the first audio device, provided in an embodiment of the present application, see Figure 14 , the method may include the following steps:

[0209] Sub-step 7041D: Recover the audio signal collected by the previous-hop device of the first audio device from the audio signal sent by the previous-hop device of the first audio device.

[0210] Optionally, the audio signal sent by the previous-hop device of the first audio device (that is, the second audio device) to the first audio device may carry source information, and the first audio device may determine, based on the source information carried by the audio signal sent by the previous-hop device of the first audio device, that the audio signal sent by the previous-hop device of the first audio device is obtained by processing the audio signal collected by the previous-hop device of the first audio device. For example, the source information carried by the audio signal sent by the previous-hop device of the first audio device to the first audio device includes the device identification of the previous-hop device of the first audio device, and the first audio device may determine, based on the device identification of the previous-hop device of the first audio device, that the audio signal sent by the previous-hop device of the first audio device is obtained by processing the audio signal collected by the previous-hop device of the first audio device.

[0211] Optionally, the first audio device can recover the audio signal collected by the previous hop device of the first audio device from the audio signal sent by the previous hop device of the first audio device according to the audio processing function of the previous hop device of the first audio device. For example, the first audio device can use the audio processing function of the previous hop device of the first audio device to convolve the audio signal sent by the previous hop device of the first audio device to obtain the convolution signal corresponding to the previous hop device of the first audio device, and then convert the convolution signal corresponding to the previous hop device of the first audio device to the frequency domain for processing to obtain the audio signal corresponding to the previous hop device of the first audio device in the frequency domain, and then convert the audio signal corresponding to the previous hop device of the first audio device in the frequency domain to the time domain to obtain the audio signal collected by the previous hop device of the first audio device.

[0212] For example, Figure 9 For example, the first audio device is audio device 01, and the previous-hop device (i.e., the second audio device) of the first audio device is audio device 02. The audio signal y2(n) sent by audio device 02 to audio device 01 is obtained by processing the audio signal g2(n) collected by audio device 02. The audio processing function of audio device 02 may be h2(n). The process by which audio device 01 recovers the audio signal g2(n) collected by audio device 02 from the audio signal y2(n) sent by audio device 02 may be as follows:

[0213] 1) Audio device 01 uses the audio processing function h2(n) of audio device 02 to convolve the audio signal y2(n) sent by audio device 02 to obtain the convolution signal corresponding to audio device 02. The convolution process is as follows:

[0214] y2(n)*h2(n)=[g2(n)*h2(n)]*h2(n)=g2(n)*h2(n)*h2(n) Formula (11);

[0215] Here, g2(n)*h2(n)*h2(n) may be the convolution signal corresponding to the audio device 02.

[0216] 2) Audio device 01 recovers the audio signal g2(n) collected by audio device 02 from the convolution signal corresponding to audio device 02. The recovery process is as follows:

[0217] First, the convolution signal corresponding to the audio device 02 is converted into the frequency domain using the following formula (12), thereby obtaining the convolution signal corresponding to the audio device 02 in the frequency domain.

[0218] y2(n)*h2(n)=g2(n)*h2(n)*h2(n)——>Y2(w)*H2(w)=G2(w)*H2(w)*H2(w) Equation (12);

[0219] Next, the convolution signal corresponding to the audio device 02 in the frequency domain is divided by the square of the frequency domain function H2(w) of the audio processing function h2(n) of the audio device 02 using the following equation (13), to obtain the audio signal G2(w) corresponding to the audio device 02 in the frequency domain. Here, the symbol “ / ” represents a division sign.

[0220] Y2(w)*H2(w) / H2(w)*H2(w)=G2(w)*H2(w)*H2(w) / H2(w)*H2(w)=G2(w) Formula (13);

[0221] Finally, the audio signal G2(w) corresponding to the audio device 02 in the frequency domain is converted to the time domain using the following formula (14) to obtain the audio signal g2(n) collected by the audio device 02.

[0222] G2(w)——>g2(n) formula (14).

[0223] Sub-step 7042D: For each audio device in the first audio device and the previous-hop device of the first audio device, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain a processed signal of the audio device.

[0224] Optionally, the first audio device can use the audio processing function of the first audio device to convolve the audio signal collected by the first audio device to obtain the processed signal of the first audio device, and use the audio processing function of the previous-hop device of the first audio device (that is, the second audio device) to convolve the audio signal collected by the previous-hop device of the first audio device to obtain the processed signal of the previous-hop device of the first audio device.

[0225] For example, Figure 9 As shown, the first audio device is audio device 01, the previous hop device of the first audio device (i.e., the second audio device) is audio device 02, the audio signal collected by audio device 01 may be g1(n), the audio processing function of audio device 01 may be h1(n), and the processed signal of audio device 01 may be g1(n)*h1(n). The audio signal collected by audio device 02 may be g2(n), the audio processing function of audio device 02 may be h2(n), and the processed signal of audio device 02 may be g2(n)*h2(n). The symbol "*" represents convolution.

[0226] Sub-step 7043D: superimpose the processed signal of the first audio device and the processed signal of the previous-hop device of the first audio device to obtain a mixed audio signal.

[0227] For example, Figure 9 As shown, the mixed audio signal may be y1(n), y1(n)=g1(n)*h1(n)+g2(n)*h2(n), the symbol “*” represents convolution, and the symbol “+” represents superposition.

[0228] Step 705: The first audio device sends a mixed audio signal to a next-hop device of the first audio device.

[0229] As mentioned above, it is easy to understand that the mixed audio signal can be a mixed signal of audio signals collected by at least two audio devices. Among them, the first audio device and the next-hop device of the first audio device can be any two adjacent audio devices on the first transmission path, and according to the direction of the first transmission path, the next-hop device of the first audio device is located after the first audio device. Optionally, the next-hop device of the first audio device can be the target audio device or not. The target audio device is the audio device at the destination point of the first transmission path. If the next-hop device of the first audio device is the target audio device, the first audio device is also the previous-hop device of the target audio device.

[0230] Optionally, when the first audio device sends a mixed audio signal to a next-hop device of the first audio device (e.g., a target audio device), source information may be added to the mixed audio signal to indicate the source of the mixed audio signal. The source information may be a device identifier of the audio device, indicating that the mixed audio signal originates from the audio device indicated by the device identifier. The source information added by the first audio device to the mixed audio signal includes at least the device identifier of the first audio device, indicating that the mixed audio signal includes an audio signal collected by the first audio device.

[0231] For example, for the first implementation method in step 704, since the audio signal sent by the previous-hop device of the first audio device (that is, the second audio device) to the first audio device already includes the source information of the audio signal sent by the previous-hop device of the first audio device (for example, the audio signal sent by the previous-hop device of the first audio device to the first audio device already includes the device identifier of the previous-hop device of the first audio device and the device identifier of the previous-hop device of the previous-hop device of the first audio device), the first audio device can add the device identifier of the first audio device to the mixed audio signal.

[0232] For example, for the second implementation in step 704, the first audio device can add the device identifier of the first audio device, the device identifier of the previous hop device of the first audio device (that is, the second audio device), and the device identifier of the previous hop device of the previous hop device of the first audio device (that is, the third audio device) to the mixed audio signal, indicating that the mixed audio signal is a mixed signal of the audio signal collected by the first audio device, the audio signal collected by the previous hop device of the first audio device, and the audio signal collected by the previous hop device of the previous hop device of the first audio device. Figure 10 As shown, the source information in the mixed audio signal y1(n) may include the device identification ID-01 of audio device 01, the device identification ID-02 of audio device 02 and the device identification ID-03 of audio device 03, indicating that the mixed audio signal y1(n) is a mixed signal of the audio signal of audio device 01, the audio signal of audio device 02 and the audio signal of audio device 03.

[0233] For example, for the third and fourth implementations in step 704, the first audio device can add the device identifier of the first audio device and the device identifier of the previous hop device of the first audio device (that is, the second audio device) to the mixed audio signal, indicating that the mixed audio signal is a mixed signal of the audio signal collected by the first audio device and the audio signal collected by the previous hop device of the first audio device. Figure 8 and Figure 9 As shown, the source information in the mixed audio signal y1(n) may include the device identification ID-01 of audio device 01 and the device identification ID-02 of audio device 02, indicating that the mixed audio signal y1(n) is a mixed signal of the audio signal of audio device 01 and the audio signal of audio device 02.

[0234] Step 706: The next-hop device of the first audio device receives the mixed audio signal sent by the first audio device.

[0235] Corresponding to the first audio device sending the mixed audio signal to the next-hop device (eg, target audio device) of the first audio device, the next-hop device of the first audio device may receive the mixed audio signal sent by the first audio device.

[0236] For example, Figures 8 to 10 As shown, the audio device 04 receives the mixed audio signal y1 (n) sent by the audio device 01.

[0237] Step 707: The next-hop device of the first audio device recovers the audio signals collected by at least two audio devices from the mixed audio signal.

[0238] As described above, it is easy to understand that in an embodiment of the present application, the mixed audio signal is obtained by mixing the audio signal collected by the first audio device to the first audio device and the audio signal sent by the previous-hop device of the first audio device (that is, the second audio device) to the first audio device. Therefore, the mixed audio signal is a mixed signal of the audio signals collected by at least two audio devices. Optionally, the mixed audio signal can carry source information, and the next-hop device of the first audio device (for example, the target audio device) can determine that the mixed audio signal is a mixed signal of the audio signals collected by the at least two audio devices based on the source information carried by the mixed audio signal, and then recover the audio signals collected by the at least two audio devices from the mixed audio signal based on the audio processing functions of the at least two audio devices.

[0239] For example, taking the mixed audio signal as a mixed signal of an audio signal collected by a first audio device, an audio signal collected by the previous-hop device of the first audio device (that is, a second audio device), and an audio signal collected by the previous-hop device of the previous-hop device of the first audio device (that is, a third audio device), the next-hop device of the first audio device (for example, a target audio device) can determine, based on the source information carried by the mixed audio signal, that the mixed audio signal is a mixed signal of the audio signal collected by the first audio device, the audio signal collected by the second audio device, and the audio signal collected by the third audio device, and then recover the audio signal collected by the first audio device, the audio signal collected by the second audio device, and the audio signal collected by the third audio device from the mixed audio signal based on the audio processing function of the first audio device, the audio processing function of the second audio device, and the audio processing function of the third audio device.

[0240] As another example, taking the example of a mixed audio signal being a mixed signal of an audio signal collected by a first audio device and an audio signal collected by a previous-hop device of the first audio device (i.e., a second audio device), the next-hop device of the first audio device (e.g., a target audio device) can determine, based on source information carried by the mixed audio signal, that the mixed audio signal is a mixed signal of the audio signal collected by the first audio device and the audio signal collected by the previous-hop device of the first audio device, and then recover the audio signal collected by the first audio device and the audio signal collected by the previous-hop device of the first audio device from the mixed audio signal based on the audio processing function of the first audio device and the audio processing function of the previous-hop device of the first audio device.

[0241] It is worth noting that in step 707, the implementation process of the next-hop device of the first audio device (e.g., the target audio device) recovering the audio signals collected by at least two audio devices from the mixed audio signal can refer to the implementation process of the aforementioned sub-step 7041B, and will not be repeated here in this embodiment of the present application.

[0242] In an embodiment of the present application, the target audio device may be an application audio device in an audio processing network. After recovering the audio signals collected by at least two audio devices from a mixed audio signal, the target audio device may apply the audio signals collected by the at least two audio devices. For example, the target audio device may implement 3D sound playback or spatial speech enhancement based on the audio signals collected by the at least two audio devices.

[0243] In embodiments of the present application, the audio signal recovered by the target audio device may contain redundant signals. In this case, the target audio device can remove redundant signals from the recovered audio signal before using it. For example, if the audio signal recovered by the target audio device contains multiple audio signals from a particular audio device, and the audio signal recovered by the target audio device contains redundant signals from the audio signal of the particular audio device, the target audio device can remove redundant signals from the audio signal of the particular audio device.

[0244] Optionally, the target audio device may select one audio signal from the multiple audio signals of the certain audio device as the audio signal of the certain audio device, and discard the other audio signals in the multiple audio signals to remove redundancy from the multiple audio signals. Alternatively, the target audio device may average the multiple audio signals of the certain audio device and use the averaged audio signal as the audio signal of the certain audio device to remove redundancy from the multiple audio signals. This embodiment of the application is not limited to this. For example, if Figures 8 to 10 As shown, the target audio device may be audio device 04. The audio signal restored by audio device 04 includes two audio signals x1(n). Audio device 04 may select one audio signal x1(n) from the two audio signals x1(n) as the audio signal for audio device 01. For another example, the audio signal restored by audio device 04 includes three audio signals x2(n). Audio device 04 may use an audio signal obtained by averaging the three audio signals x2(n) as the audio signal for audio device 02.

[0245] It is worth noting that the audio signals of each audio device restored by the target audio device are approximate signals of the audio signals collected by the respective audio devices. The multiple audio signals of a certain audio device restored by the target audio device may come from different mixed audio signals. The target audio device can select the audio signal restored from the mixed audio signal with the least source from the multiple audio signals as the audio signal of the certain audio device, so as to reduce the difference between the selected audio signal and the audio signal collected by the certain audio device.

[0246] Based on the foregoing description, it is easy to understand that in an embodiment of the present application, each audio device in the audio processing network has an audio processing function, and each audio device in the audio processing network can learn the audio processing functions of other audio devices to achieve the mixing and recovery process of audio signals. Optionally, the audio processing function of each audio device in the audio processing network is generated by the audio device and sent to the other audio devices in the audio processing network; or, the audio processing function of each audio device in the audio processing network is generated by the function processing device and sent to each audio device in the audio processing network. For example, after each audio device is connected to the audio processing network, it can generate its own audio processing function and broadcast its own audio processing function to other audio devices in the audio processing network, or, after each audio device is connected to the audio processing network, the function processing device generates an audio processing function for the audio device and broadcasts the audio processing function to the audio devices in the audio processing network. Among them, the function processing device can be any device in the audio processing network, for example, the function processing device can be the audio device at the starting point of the first transmission path, or the audio device at the destination point of the first transmission path, or the management device of the audio processing network, and the embodiment of the present application does not limit this.

[0247] In an embodiment of the present application, before step 704, the first audio device needs to obtain at least the audio processing function of the first audio device, and the first audio device may also obtain the audio processing function of the previous hop device of the first audio device (that is, the second audio device) and the audio processing function of the previous hop device of the previous hop device of the first audio device (that is, the third audio device). Before step 707, the next hop device of the first audio device (for example, the target audio device) needs to obtain the audio processing functions of at least two corresponding audio devices. For example, the next hop device of the first audio device needs to obtain the audio processing function of the first audio device, the audio processing function of the second audio device, and the audio processing function of the third audio device. Optionally, the first audio device obtaining the audio processing function of the first audio device may include: the first audio device generating the audio processing function of the first audio device; or the first audio device receiving the audio processing function of the first audio device sent by the function processing device. The next-hop device of the first audio device (e.g., the target audio device) obtaining the audio processing functions of at least two audio devices may include: the next-hop device of the first audio device receiving the audio processing functions of the at least two audio devices, for example, the next-hop device of the first audio device receiving the audio processing function of the first audio device sent by the first audio device, receiving the audio processing function of the second audio device sent by the second audio device, and receiving the audio processing function of the third audio device sent by the third audio device; or, the next-hop device of the first audio device receiving the audio processing function of the first audio device, the audio processing function of the second audio device, and the audio processing function of the third audio device sent by the function processing device, which is not limited in this embodiment of the present application.

[0248] This embodiment of the present application uses the example of a first audio device generating an audio processing function to describe the process of generating an audio processing function. Optionally, the first audio device generating the audio processing function may include: the first audio device generating multiple random numbers using a random number generation function, and generating the audio processing function of the first audio device based on the multiple random numbers. The random number generation function may be, for example, the rand() function in the C language, which can generate random numbers in the range [0, 32767]. The audio processing function of the first audio device may be a multi-dimensional random sequence composed of the multiple random numbers, for example, a 20-dimensional random sequence. It is understood that a higher dimensionality of the audio processing function improves the quality of audio signal recovery, but increases the computational complexity of audio signal recovery. For example, the first audio device generating the multiple random numbers using a random number generation function may include: the first audio device generating the multiple random numbers using the rand() function. The first audio device generating the audio processing function of the first audio device based on the multiple random numbers may include: the first audio device combining the multiple random numbers into a random sequence, where the random sequence is the audio processing function of the first audio device.

[0249] It is worth noting that the embodiment of the present application uses the example of a first audio device generating an audio processing function of the first audio device to describe the process of generating an audio processing function. The process of any audio device generating its own audio processing function, as well as the process of a function processing device generating audio processing functions for each audio device, can all refer to the process of the first audio device generating the audio processing function of the first audio device, and the embodiment of the present application will not be repeated here. The embodiment of the present application generates audio processing functions in a randomized manner, which can ensure that the audio processing functions of each audio device are as unrelated as possible, facilitating the mixing and recovery of audio signals.

[0250] In the embodiment of this application, Figure 2 In the embodiment shown, the target audio device can determine at least one target transmission path with the destination point being the target audio device from the audio processing network, and the audio device on each target transmission path can be based on Figure 7 The signal transmission process provided by the embodiment shown transmits an audio signal. Figure 7The embodiment shown is easy to understand. On each target transmission path, each audio device except the audio device at the starting point and the audio device at the destination point can mix the audio signal collected by itself and the received audio signal into an audio mixed signal and transmit it to the next hop device until the signal is transmitted to the target audio device (the audio device at the destination point of the target transmission path). In this way, the target audio device can receive the required audio signal through fewer transmission paths. Compared with the solution in which each audio device sends an audio signal to the target audio device separately, it helps to reduce the transmission bandwidth of the audio signal. Figure 1 and Figure 10 The principle of reducing the transmission bandwidth of the audio signal by the signal transmission method provided in the embodiment of the present application is explained.

[0251] For example, Figure 1 and Figure 10 As shown in the figure, assume that the audio signals collected by audio device 01, audio device 02, and audio device 03 are audio signal x1(n), audio signal x2(n), and audio signal x3(n), respectively. Audio signal x1(n), audio signal x2(n), and audio signal x3(n) each contain N sampling points, where n = 0, 1, ..., N-1, and each sampling point is represented by 16 bits. Without considering compression, each audio signal x1(n), audio signal x2(n), and audio signal x3(n) occupies a network bandwidth of 16 × N bits when transmitted separately, where the symbol "×" represents a multiplication sign.

[0252] like Figure 1 As shown, if audio device 01, audio device 02, and audio device 03 each send their own audio signals to audio device 04, the network bandwidth occupied by audio device 01, audio device 02, and audio device 03 transmitting audio signals to audio device 04 is 16×N×3 bits, where the symbol “×” represents a multiplication sign.

[0253] like Figure 10 As shown, if audio device 01 transmits audio signal x1(n) to audio device 02, audio device 02 mixes audio signal x1(n) with audio signal x2(n) and transmits it to audio device 03, and audio device 03 mixes audio signal x1(n), audio signal x2(n) and audio signal x3(n) and transmits it to audio device 04, then the mixed audio signal y1(n) received by audio device 04 contains mixed data of 3×N sampling points, and the mixed data of 3×N sampling points are respectively: 3 mixed data y1(0) of sampling point 0, 3 mixed data y1(1) of sampling point 1, 3 mixed data y1(2) of sampling point 2...3 mixed data y1(N-1) of sampling point N-1, and the symbol "×" represents the multiplication sign. Wherein:

[0254] y1(0)=x1(0)*h1(0)+x2(0)*h2(0)+x3(0)*h3(0);

[0255] y1(1)=x1(1)*h1(1)+x2(1)*h2(1)+x3(1)*h3(1);

[0256] y1(2)=x1(2)*h1(2)+x2(2)*h2(2)+x3(2)*h3(2);

[0257] y1(N-1)=x1(N-1)*h1(N-1)+x2(N-1)*h2(N-1)+x3(N-1)*h3(N-1);

[0258] The symbol "*" indicates convolution, and the symbol "+" indicates superposition. Taking y1(0) as an example, x1(0)*h1(0), x2(0)*h2(0), and x3(0)*h3(0) are each 16 bits. y1(0) is obtained by mathematical operation on three 16-bit sampling points, and y1(0) is still 16 bits. Similarly, y1(1), y1(2)...y1(N-1) are all 16 bits. The network bandwidth occupied by y1(n), which includes y1(0), y1(1), y1(2)...y1(N-1), during transmission is 16×N bits. The symbol "×" indicates multiplication.

[0259] It can be seen that the network bandwidth occupied by transmitting the mixed audio signal y1(1) is equal to the network bandwidth occupied by transmitting the audio signal collected by a single audio device (for example, audio signal x1(n), audio signal x2(n) or audio signal x3(n)). Therefore, compared with the solution in which audio device 01, audio device 02 and audio device 03 each send their own audio signals to audio device 04, the embodiment of the present application mixes the audio signals and then transmits them, thereby ensuring the effective transmission of the audio signals collected by audio device 01, audio device 02 and audio device 03, and can reduce the transmission bandwidth of the audio signals.

[0260] In summary, the signal transmission method provided by the embodiment of the present application is that after the first audio device collects an audio signal, when it receives an audio signal sent by the previous-hop device of the first audio device, the audio signal collected by the first audio device and the audio signal sent by the previous-hop device of the first audio device are mixed to obtain a mixed audio signal, and the mixed audio signal is sent to the next-hop device of the first audio device. Since the audio device can mix the collected audio signal and the received audio signal and send them to the next-hop device until the audio signal collected by each audio device is sent to the target audio device, this helps to reduce the transmission bandwidth of the audio signal compared to the solution in which each audio device sends an audio signal to the target audio device separately.

[0261] The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

[0262] Please refer to Figure 15 , which shows a logical structure diagram of a signal transmission device 1500 provided in an embodiment of the present application. The signal transmission device 1500 can be Figure 1 Any audio device or a functional component in the audio device in the implementation environment shown. Figure 15 The signal transmission device 1500 may include but is not limited to:

[0263] An acquisition module 1510 is configured to acquire an audio signal collected by a first audio device;

[0264] The processing module 1520 is configured to, upon receiving an audio signal sent by a previous-hop device of the first audio device, mix the audio signal collected by the first audio device with the audio signal sent by the previous-hop device to obtain a mixed audio signal;

[0265] A sending module 1530 is configured to send the mixed audio signal to a next-hop device of the first audio device;

[0266] The first audio device, the previous-hop device, and the next-hop device are adjacent audio devices on a first transmission path in an audio processing network.

[0267] Optionally, the processing module 1520 is configured to:

[0268] Using an audio processing function of a first audio device to process an audio signal collected by the first audio device to obtain a processed signal of the first audio device;

[0269] The processed signal of the first audio device and the audio signal sent by the previous-hop device are superimposed to obtain a mixed audio signal.

[0270] Optionally, the audio signal sent by the previous-hop device is a mixed signal of audio signals collected by at least two audio devices; the processing module 1520 is configured to:

[0271] Recovering the audio signals collected by the at least two audio devices from the audio signal sent by the previous-hop device;

[0272] For the first audio device and each of the at least two audio devices, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain a processed signal of the audio device;

[0273] The processed signal of the first audio device and the processed signals of the at least two audio devices are superimposed to obtain a mixed audio signal.

[0274] Optionally, the processing module 1520 is configured to:

[0275] determining, according to source information carried by the audio signal sent by the previous-hop device, that the audio signal sent by the previous-hop device is a mixed signal of audio signals collected by the at least two audio devices;

[0276] The audio signals collected by the at least two audio devices are restored from the audio signal sent by the previous-hop device according to the audio processing functions of the at least two audio devices.

[0277] Optionally, the audio signal sent by the previous-hop device is an audio signal collected by the previous-hop device;

[0278] The processing module 1520 is configured to:

[0279] For each audio device in the first audio device and the previous-hop device, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain a processed signal of the audio device;

[0280] The processed signal of the first audio device and the processed signal of the previous-hop device are superimposed to obtain a mixed audio signal.

[0281] Optionally, the audio signal sent by the previous-hop device is obtained by processing the audio signal collected by the previous-hop device; the processing module 1520 is configured to:

[0282] Recovering the audio signal collected by the previous-hop device from the audio signal sent by the previous-hop device;

[0283] For each audio device in the first audio device and the previous-hop device, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain a processed signal of the audio device;

[0284] The processed signal of the first audio device and the processed signal of the previous-hop device are superimposed to obtain a mixed audio signal.

[0285] Optionally, the audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or,

[0286] The audio processing function of each audio device in the audio processing network is generated by a function processing device in the audio processing network and sent to each audio device in the audio processing network.

[0287] Optionally, please continue to refer to Figure 15 , the signal transmission device 1500 further includes:

[0288] The generating module 1540 is configured to generate an audio processing function of the first audio device; or

[0289] The receiving module 1550 is configured to receive the audio processing function of the first audio device sent by the function processing device.

[0290] Optionally, the generating module 1540 is configured to:

[0291] A random number generation function is used to generate multiple random numbers;

[0292] An audio processing function of the first audio device is generated according to the multiple random numbers.

[0293] In summary, in the signal transmission device provided by the embodiment of the present application, after the acquisition module acquires the audio signal collected by the first audio device, the processing module mixes the audio signal collected by the first audio device with the audio signal sent by the previous-hop device of the first audio device to obtain a mixed audio signal, and the sending module sends the mixed audio signal to the next-hop device of the first audio device. Since the audio device can mix the collected audio signal and the received audio signal and send them to the next-hop device until the audio signal collected by each audio device is sent to the target audio device, this helps to reduce the transmission bandwidth of the audio signal compared to the solution in which each audio device sends an audio signal to the target audio device separately.

[0294] Please refer to Figure 16 , which shows a logical structure diagram of another signal transmission device 1600 provided in an embodiment of the present application. The signal transmission device 1600 can be Figure 1 Any audio device or a functional component in the audio device in the implementation environment shown. Figure 16 The signal transmission device 1600 may include but is not limited to:

[0295] A receiving module 1610 is configured to receive a mixed audio signal sent by a previous-hop device of a target audio device, where the mixed audio signal is a mixed signal of audio signals collected by at least two audio devices;

[0296] a processing module 1620, configured to restore the audio signals of the at least two audio devices from the mixed audio signal;

[0297] The target audio device and the previous-hop device are adjacent audio devices on a first transmission path in the audio processing network.

[0298] Optionally, the processing module 1620 is configured to:

[0299] determining, based on source information carried by the mixed audio signal, that the mixed audio signal is a mixed signal of audio signals collected by at least two audio devices;

[0300] The audio signals collected by the at least two audio devices are restored from the mixed audio signal according to the audio processing functions of the at least two audio devices.

[0301] Optionally, the audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or,

[0302] The audio processing function of each audio device in the audio processing network is generated by a function processing device in the audio processing network and sent to each audio device in the audio processing network.

[0303] Optionally, the receiving module 1610 is further configured to receive audio processing functions of the at least two audio devices.

[0304] Optionally, please continue to refer to Figure 16 , the signal transmission device 1600 further includes:

[0305] A determination module 1630 is configured to determine, from the audio processing network, at least one target transmission path whose destination is a target audio device, the at least one target transmission path including a first transmission path;

[0306] The sending module 1640 is configured to send transmission instruction information to the audio device on each target transmission path. The audio device on the target transmission path is configured to transmit the audio signal through the target transmission path according to the received transmission instruction information.

[0307] Optionally, the determining module 1630 is configured to select at least one transmission path from a plurality of transmission paths whose destination point is a target audio device in the audio processing network as at least one target transmission path;

[0308] The sending module 1640 is used to send dismantling indication information to the audio device on each target transmission path, wherein the dismantling indication information sent to the audio device on the target transmission path instructs the audio device to dismantle a redundant transmission path among the multiple transmission paths and transmit the audio signal through the target transmission path, and the redundant transmission path is a transmission path among the multiple transmission paths other than the at least one target transmission path.

[0309] Optionally, the determining module 1630 is configured to:

[0310] receiving a path detection signal transmitted through each transmission path of the plurality of transmission paths, wherein the path detection signal transmitted through each transmission path includes information of each audio device on the transmission path;

[0311] Based on the path detection signals transmitted through the multiple transmission paths, at least one transmission path is selected from the multiple transmission paths as at least one target transmission path, wherein the at least one target transmission path is the transmission path with the least number of paths and the largest number of audio devices among the multiple transmission paths.

[0312] Optionally, the determining module 1630 is configured to:

[0313] For each transmission path of the plurality of transmission paths, obtaining a current processing capability of each audio device on the transmission path;

[0314] According to current processing capabilities of the audio devices on the multiple transmission paths, at least one transmission path is selected from the multiple transmission paths as at least one target transmission path, wherein the current processing capability of the audio device on each target transmission path is stronger than the preset processing capability.

[0315] Optionally, the determining module 1630 is configured to:

[0316] Obtaining topology information of an audio processing network and current processing capabilities of each audio device in the audio processing network;

[0317] determining, from the audio processing network, at least one cooperative audio device required by the target audio device based on current processing capabilities of each audio device in the audio processing network;

[0318] determining, according to the topology information of the audio processing network, at least one transmission path having the target audio device as its destination and including the at least one cooperative audio device as at least one target transmission path;

[0319] The sending module 1640 is configured to send device indication information to the audio device on each target transmission path, wherein the device indication information sent to the audio device indicates the next hop device of the audio device on the target transmission path.

[0320] In summary, in the signal transmission device provided in the embodiment of the present application, the audio device on the first transmission path can mix the collected audio signal and the received audio signal and send the mixed audio signal to the next-hop device until the audio signals collected by each audio device are sent to the target audio device. Therefore, the mixed audio signal received by the target audio device and sent by the previous-hop device of the target audio device is a mixed signal of the audio signals collected by at least two audio devices. Compared with the solution in which each audio device sends an audio signal to the target audio device separately, the target audio device can receive the audio signals collected by each audio device by only receiving the mixed audio signal, which helps to reduce the transmission bandwidth of the audio signal.

[0321] Please refer to Figure 17 , which shows a hardware structure diagram of a signal transmission device 1700 provided in an embodiment of the present application. The signal transmission device 1700 may be Figure 1 Any audio device in the implementation shown. Figure 17 The signal transmission device 1700 includes a processor 1702, a memory 1704, a communication interface 1706, an audio collection component 1708, and a bus 1710. The processor 1702, the memory 1704, the communication interface 1706, and the audio collection component 1708 are connected to each other through the bus 1710. It should be understood by those skilled in the art that Figure 17 The connection method between the processor 1702, memory 1704, communication interface 1706 and audio acquisition component 1708 shown is merely exemplary. The processor 1702, memory 1704, communication interface 1706 and audio acquisition component 1708 may also be communicatively connected to each other using other connection methods besides the bus 1710.

[0322] The memory 1704 may be used to store instructions 17042 and data 17044. In the embodiment of the present application, the memory 1704 may be various types of storage media, such as random access memory (RAM), read-only memory (ROM), non-volatile RAM (NVRAM), programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, optical storage, and registers. Furthermore, the memory 1704 may include a hard disk and / or a memory.

[0323] Among them, the processor 1702 can be a general-purpose processor or a special-purpose processor. A general-purpose processor can be a processor that performs specific steps and / or operations by reading and executing instructions (e.g., instructions 17042) stored in a memory (e.g., memory 1704). The general-purpose processor may use data (e.g., data 17044) stored in the memory (e.g., memory 1704) in the process of performing the above steps and / or operations. The general-purpose processor can be, for example, but not limited to a CPU. A special-purpose processor can be a processor specially designed to perform specific steps and / or operations. The special-purpose processor can be, for example, but not limited to, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), and a programmable logic array (PLA). In addition, the processor 1702 can also be a combination of multiple processors, such as a multi-core processor. The processor 1702 may include one or more circuits to perform all or part of the steps of the signal transmission method provided in the above embodiment.

[0324] The communication interface 1706 may include an input / output (I / O) interface, a physical interface, and a logical interface, etc., for interconnecting devices within the signal transmission apparatus 1700, as well as an interface for interconnecting the signal transmission apparatus 1700 with other devices. The physical interface may be a gigabit Ethernet (GE) interface, which may be used to interconnect the signal transmission apparatus 1700 with other devices. The logical interface is an interface within the signal transmission apparatus 1700, which may be used to interconnect devices within the signal transmission apparatus 1700. It is easy to understand that the communication interface 1706 may be used for communication between the signal transmission apparatus 1700 and other devices. For example, the communication interface 1706 is used to send and receive information between the signal transmission apparatus 1700 and other devices.

[0325] The audio collection component 1708 may be any component capable of collecting audio signals, such as, but not limited to, a microphone or a microphone array. Optionally, the signal transmission device 1700 may include multiple audio collection components 1708, which may be disposed at different locations on the signal transmission device 1700 to collect stereo audio signals.

[0326] The bus 1710 may be any type of communication bus for interconnecting the processor 1702 , the memory 1704 , the communication interface 1706 , and the audio acquisition component 1708 . For example, the bus 1710 may be a system bus.

[0327] The aforementioned devices may be provided on separate chips, or at least partially or entirely on the same chip. Whether the devices are provided on separate chips or integrated on one or more chips often depends on product design requirements, and the embodiments of this application do not limit the implementation of the aforementioned devices.

[0328] Figure 17 The signal transmission device 1700 shown is merely exemplary. During implementation, the signal transmission device 1700 may further include other components, which are not listed one by one in the embodiments of the present application. Figure 17 The signal transmission device 1700 shown can perform audio signal transmission by executing all or part of the steps of the signal transmission method provided in the above embodiment.

[0329] The embodiment of the present application provides a signal transmission system, which includes: at least two audio devices, at least one of which includes Figures 15 to 17 Any of the signal transmission devices shown.

[0330] An embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a computer, the computer executes some or all of the steps of the signal transmission method provided in the above embodiment.

[0331] An embodiment of the present application provides a computer program product comprising instructions. When the computer program product is run on a computer, the computer is caused to execute part or all of the steps of the signal transmission method provided in the above embodiment.

[0332] An embodiment of the present application provides a chip, which includes a programmable logic circuit and / or program instructions, and when the chip is running, is used to implement some or all steps of the signal transmission method provided in the above embodiment.

[0333] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product, which includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server or data center to another website, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium, or a semiconductor medium (e.g., a solid-state hard disk).

[0334] In this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance. The term "at least one" refers to one or more, and "plurality" refers to two or more, unless otherwise expressly limited. The term "and / or" simply describes an association relationship between associated objects, indicating that three possible relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, or B exists alone.

[0335] The different types of embodiments, such as the method embodiments and device embodiments provided in the embodiments of this application, can refer to each other, and the embodiments of this application are not limited thereto. The order of the operations of the method embodiments provided in the embodiments of this application can be appropriately adjusted, and the operations can be increased or decreased in response to the circumstances. Any person skilled in the art who can easily think of a method of variation within the technical scope disclosed in this application should be included in the scope of protection of this application, and therefore will not be described in detail.

[0336] In the corresponding embodiments provided in this application, it should be understood that the disclosed devices, etc. can be implemented through other structural methods. For example, the device embodiments described above are merely schematic. For example, the division of units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0337] The units described as separate components may or may not be physically separate, and the components described as units may or may not be physical units, and may be located in one place or distributed across multiple network devices (e.g., terminal devices). Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0338] The above description is merely an exemplary embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and such modifications or substitutions should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A signal transmission method, characterized in that: The method comprises: Acquiring an audio signal collected by a first audio device; When receiving an audio signal sent by a previous-hop device of the first audio device, mixing the audio signal collected by the first audio device and the audio signal sent by the previous-hop device to obtain a mixed audio signal; sending the mixed audio signal to a next-hop device of the first audio device; The first audio device, the previous-hop device, and the next-hop device are adjacent audio devices on a first transmission path in an audio processing network; The audio signal sent by the previous-hop device includes an audio signal collected by a second audio device or a processed signal of the second audio device, and the second audio device includes the previous-hop device or at least one audio device located before the previous-hop device on the first transmission path; The mixed audio signal includes a superposition of a processed signal of the first audio device and a processed signal of the second audio device; The processed signal of the first audio device is a signal obtained by processing the audio signal collected by the first audio device using the audio processing function of the first audio device; Each processed signal of the second audio device is a signal obtained by processing an audio signal collected by the corresponding device in the second audio device using an audio processing function of the corresponding device; Any two audio processing functions among all the audio processing functions are unrelated.

2. The method according to claim 1, characterized in that The audio signal sent by the previous-hop device includes a processed signal of the second audio device; The mixing of the audio signal collected by the first audio device and the audio signal sent by the previous-hop device to obtain a mixed audio signal includes: Processing the audio signal collected by the first audio device using the audio processing function of the first audio device to obtain a processed signal of the first audio device; The processed signal of the first audio device and the audio signal sent by the previous-hop device are superimposed to obtain the mixed audio signal.

3. The method according to claim 1, characterized in that The audio signal sent by the previous-hop device is a mixed signal of audio signals collected by at least two audio devices, and the at least two audio devices are both the second audio devices; The mixing of the audio signal collected by the first audio device and the audio signal sent by the previous-hop device to obtain a mixed audio signal includes: Recovering the audio signals collected by the at least two audio devices from the audio signal sent by the previous-hop device; For the first audio device and each of the at least two audio devices, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain a processed signal of the audio device; The mixed audio signal is obtained by superimposing the processed signal of the first audio device and the processed signals of the at least two audio devices.

4. The method according to claim 3, characterized in that Before recovering the audio signals collected by the at least two audio devices from the audio signal sent by the previous-hop device, the method further includes: determining, according to source information carried by the audio signal sent by the previous-hop device, that the audio signal sent by the previous-hop device is a mixed signal of audio signals collected by the at least two audio devices; The recovering the audio signals collected by the at least two audio devices from the audio signal sent by the previous-hop device includes: The audio signals collected by the at least two audio devices are restored from the audio signal sent by the previous-hop device according to the audio processing functions of the at least two audio devices.

5. The method according to claim 1, wherein The audio signal sent by the previous-hop device is an audio signal collected by the previous-hop device; The mixing of the audio signal collected by the first audio device and the audio signal sent by the previous-hop device to obtain a mixed audio signal includes: For each audio device in the first audio device and the previous-hop device, processing the audio signal collected by the audio device using the audio processing function of the audio device to obtain a processed signal of the audio device; The processed signal of the first audio device and the processed signal of the previous-hop device are superimposed to obtain the mixed audio signal.

6. The method according to claim 1, characterized in that The audio signal sent by the previous-hop device is obtained by processing the audio signal collected by the previous-hop device; The mixing of the audio signal collected by the first audio device and the audio signal sent by the previous-hop device to obtain a mixed audio signal includes: Recovering the audio signal collected by the previous-hop device from the audio signal sent by the previous-hop device; For each audio device in the first audio device and the previous-hop device, processing the audio signal collected by the audio device using the audio processing function of the audio device to obtain a processed signal of the audio device; The processed signal of the first audio device and the processed signal of the previous-hop device are superimposed to obtain the mixed audio signal.

7. The method according to any one of claims 2 to 6, characterized in that: The audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or, The audio processing function of each audio device in the audio processing network is generated by a function processing device in the audio processing network and sent to each audio device in the audio processing network.

8. The method according to claim 7, characterized in that Before processing the audio signal collected by the first audio device using the audio processing function of the first audio device, the method further includes: generating an audio processing function of the first audio device; or, Receive the audio processing function of the first audio device sent by the function processing device.

9. The method according to claim 8, characterized in that Generating the audio processing function of the first audio device includes: Generate multiple random numbers using a random number generation function; An audio processing function of the first audio device is generated according to the multiple random numbers.

10. A signal transmission method, characterized in that: The method comprises: receiving a mixed audio signal sent by a previous-hop device of a target audio device, where the mixed audio signal is a mixed signal of audio signals collected by at least two audio devices; Restoring the audio signals collected by the at least two audio devices from the mixed audio signal; The target audio device and the previous-hop device are adjacent audio devices on a first transmission path in an audio processing network; The at least two audio devices include a first audio device and a second audio device, the first audio device is an audio device on the first transmission path, and the second audio device includes a previous-hop device of the first audio device or at least one audio device located before the previous-hop device of the first audio device on the first transmission path; The mixed audio signal includes a superposition of a processed signal of the first audio device and a processed signal of the second audio device; The processed signal of the first audio device is a signal obtained by processing the audio signal collected by the first audio device using the audio processing function of the first audio device; Each processed signal of the second audio device is a signal obtained by processing an audio signal collected by the corresponding device in the second audio device using an audio processing function of the corresponding device; Any two audio processing functions among all the audio processing functions are unrelated.

11. The method according to claim 10, characterized in that Before restoring the audio signals collected by the at least two audio devices from the mixed audio signal, the method further includes: determining, according to source information carried by the mixed audio signal, that the mixed audio signal is a mixed signal of audio signals collected by the at least two audio devices; The recovering the audio signals collected by the at least two audio devices from the mixed audio signal includes: The audio signals collected by the at least two audio devices are restored from the mixed audio signal according to the audio processing functions of the at least two audio devices.

12. The method according to claim 11, characterized in that The audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or, The audio processing function of each audio device in the audio processing network is generated by a function processing device in the audio processing network and sent to each audio device in the audio processing network.

13. The method according to claim 12, characterized in that Before restoring the audio signals collected by the at least two audio devices from the mixed audio signal according to the audio processing functions of the at least two audio devices, the method further includes: The audio processing functions of the at least two audio devices are received.

14. The method according to any one of claims 10 to 13, characterized in that: Before receiving the mixed audio signal sent by the previous-hop device of the target audio device, the method further includes: determining, from the audio processing network, at least one target transmission path whose destination is the target audio device, the at least one target transmission path including the first transmission path; Transmission instruction information is sent to each audio device on the target transmission path, and the audio device on the target transmission path is used to transmit the audio signal through the target transmission path according to the received transmission instruction information.

15. The method according to claim 14, characterized in that The determining, from the audio processing network, at least one target transmission path whose destination point is the target audio device comprises: selecting at least one transmission path from a plurality of transmission paths whose destination point is the target audio device in the audio processing network as the at least one target transmission path; The sending transmission instruction information to the audio device on each target transmission path includes: Send a dismantling indication message to the audio device on each of the target transmission paths, wherein the dismantling indication message sent to the audio device on the target transmission path instructs the audio device to dismantle a redundant transmission path among the multiple transmission paths and transmit an audio signal through the target transmission path, wherein the redundant transmission path is a transmission path among the multiple transmission paths other than the at least one target transmission path.

16. The method according to claim 15, characterized in that The selecting, from a plurality of transmission paths in the audio processing network whose destination point is the target audio device, at least one transmission path as the at least one target transmission path comprises: receiving a path detection signal transmitted through each of the plurality of transmission paths, wherein the path detection signal transmitted through each of the transmission paths includes information of each audio device on the transmission path; Based on the path detection signals transmitted through the multiple transmission paths, at least one transmission path is selected from the multiple transmission paths as the at least one target transmission path, wherein the at least one target transmission path is the transmission path with the least number of paths and the largest number of audio devices among the multiple transmission paths.

17. The method according to claim 15, characterized in that The selecting, from a plurality of transmission paths in the audio processing network whose destination point is the target audio device, at least one transmission path as the at least one target transmission path comprises: For each transmission path of the plurality of transmission paths, obtaining a current processing capability of each audio device on the transmission path; According to the current processing capabilities of the audio devices on the multiple transmission paths, at least one transmission path is selected from the multiple transmission paths as the at least one target transmission path, wherein the current processing capability of the audio device on each of the target transmission paths is stronger than the preset processing capability.

18. The method according to claim 14, characterized in that The determining, from the audio processing network, at least one target transmission path whose destination point is the target audio device comprises: Acquire topology information of the audio processing network and current processing capability of each audio device in the audio processing network; determining, from the audio processing network, at least one cooperative audio device required by the target audio device based on current processing capabilities of each audio device in the audio processing network; determining, based on the topology information of the audio processing network, at least one transmission path having the target audio device as its destination and including the at least one cooperative audio device as the at least one target transmission path; The sending transmission instruction information to the audio device on each target transmission path includes: Device indication information is sent to each audio device on the target transmission path, wherein the device indication information sent to the audio device indicates a next-hop device of the audio device on the target transmission path.

19. A signal transmission device, characterized in that: The device comprises: An acquisition module, configured to acquire an audio signal collected by a first audio device; a processing module configured to, upon receiving an audio signal sent by a previous-hop device of the first audio device, mix the audio signal collected by the first audio device and the audio signal sent by the previous-hop device to obtain a mixed audio signal; a sending module, configured to send the mixed audio signal to a next-hop device of the first audio device; The first audio device, the previous-hop device, and the next-hop device are adjacent audio devices on a first transmission path in an audio processing network; The audio signal sent by the previous-hop device includes an audio signal collected by a second audio device or a processed signal of the second audio device, and the second audio device includes the previous-hop device or at least one audio device located before the previous-hop device on the first transmission path; The mixed audio signal includes a superposition of a processed signal of the first audio device and a processed signal of the second audio device; The processed signal of the first audio device is a signal obtained by processing the audio signal collected by the first audio device using the audio processing function of the first audio device; Each processed signal of the second audio device is a signal obtained by processing an audio signal collected by the corresponding device in the second audio device using an audio processing function of the corresponding device; Any two audio processing functions among all the audio processing functions are unrelated.

20. The device according to claim 19, characterized in that The audio signal sent by the previous-hop device includes a processed signal of the second audio device; The processing module is used to: Processing the audio signal collected by the first audio device using the audio processing function of the first audio device to obtain a processed signal of the first audio device; The processed signal of the first audio device and the audio signal sent by the previous-hop device are superimposed to obtain the mixed audio signal.

21. The device according to claim 19, characterized in that The audio signal sent by the previous-hop device is a mixed signal of audio signals collected by at least two audio devices, and the at least two audio devices are both the second audio devices; The processing module is used to: Recovering the audio signals collected by the at least two audio devices from the audio signal sent by the previous-hop device; For the first audio device and each of the at least two audio devices, use the audio processing function of the audio device to process the audio signal collected by the audio device to obtain a processed signal of the audio device; The mixed audio signal is obtained by superimposing the processed signal of the first audio device and the processed signals of the at least two audio devices.

22. The device according to claim 21, characterized in that The processing module is used to: determining, according to source information carried by the audio signal sent by the previous-hop device, that the audio signal sent by the previous-hop device is a mixed signal of audio signals collected by the at least two audio devices; The audio signals collected by the at least two audio devices are restored from the audio signal sent by the previous-hop device according to the audio processing functions of the at least two audio devices.

23. The device according to claim 19, characterized in that The audio signal sent by the previous-hop device is an audio signal collected by the previous-hop device; The processing module is used to: For each audio device in the first audio device and the previous-hop device, processing the audio signal collected by the audio device using the audio processing function of the audio device to obtain a processed signal of the audio device; The processed signal of the first audio device and the processed signal of the previous-hop device are superimposed to obtain the mixed audio signal.

24. The device according to claim 19, characterized in that The audio signal sent by the previous-hop device is obtained by processing the audio signal collected by the previous-hop device; The processing module is used to: Recovering the audio signal collected by the previous-hop device from the audio signal sent by the previous-hop device; For each audio device in the first audio device and the previous-hop device, processing the audio signal collected by the audio device using the audio processing function of the audio device to obtain a processed signal of the audio device; The processed signal of the first audio device and the processed signal of the previous-hop device are superimposed to obtain the mixed audio signal.

25. The device according to any one of claims 20 to 24, characterized in that The audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or, The audio processing function of each audio device in the audio processing network is generated by a function processing device in the audio processing network and sent to each audio device in the audio processing network.

26. The device according to claim 25, characterized in that The device further comprises: a generating module, configured to generate an audio processing function of the first audio device; or The receiving module is configured to receive the audio processing function of the first audio device sent by the function processing device.

27. The device according to claim 26, characterized in that The generating module is used to: Generate multiple random numbers using a random number generation function; An audio processing function of the first audio device is generated according to the multiple random numbers.

28. A signal transmission device, characterized in that: The device comprises: A receiving module, configured to receive a mixed audio signal sent by a previous-hop device of a target audio device, wherein the mixed audio signal is a mixed signal of audio signals collected by at least two audio devices; a processing module, configured to recover the audio signals collected by the at least two audio devices from the mixed audio signal; The target audio device and the previous-hop device are adjacent audio devices on a first transmission path in an audio processing network; The at least two audio devices include a first audio device and a second audio device, the first audio device is an audio device on the first transmission path, and the second audio device includes a previous-hop device of the first audio device or at least one audio device located before the previous-hop device of the first audio device on the first transmission path; The mixed audio signal includes a superposition of a processed signal of the first audio device and a processed signal of the second audio device; The processed signal of the first audio device is a signal obtained by processing the audio signal collected by the first audio device using the audio processing function of the first audio device; Each processed signal of the second audio device is a signal obtained by processing an audio signal collected by the corresponding device in the second audio device using an audio processing function of the corresponding device; Any two audio processing functions among all the audio processing functions are unrelated.

29. The device according to claim 28, characterized in that The processing module is used to: determining, according to source information carried by the mixed audio signal, that the mixed audio signal is a mixed signal of audio signals collected by the at least two audio devices; The audio signals collected by the at least two audio devices are restored from the mixed audio signal according to the audio processing functions of the at least two audio devices.

30. The device according to claim 29, characterized in that The audio processing function of each audio device in the audio processing network is generated by the audio device and sent to other audio devices in the audio processing network; or, The audio processing function of each audio device in the audio processing network is generated by a function processing device in the audio processing network and sent to each audio device in the audio processing network.

31. The device according to claim 30, characterized in that The receiving module is further configured to receive the audio processing functions of the at least two audio devices.

32. The device according to any one of claims 28 to 31, characterized in that The device further comprises: a determining module, configured to determine, from the audio processing network, at least one target transmission path whose destination point is the target audio device, the at least one target transmission path including the first transmission path; The sending module is used to send transmission instruction information to each audio device on the target transmission path, and the audio device on the target transmission path is used to transmit the audio signal through the target transmission path according to the received transmission instruction information.

33. The device according to claim 32, characterized in that The determining module is configured to select at least one transmission path from a plurality of transmission paths whose destination point is the target audio device in the audio processing network as the at least one target transmission path; The sending module is used to send dismantling indication information to the audio device on each of the target transmission paths, wherein the dismantling indication information sent to the audio device on the target transmission path instructs the audio device to dismantle a redundant transmission path among the multiple transmission paths and transmit an audio signal through the target transmission path, and the redundant transmission path is a transmission path among the multiple transmission paths other than the at least one target transmission path.

34. The device according to claim 33, characterized in that The determining module is configured to: receiving a path detection signal transmitted through each of the plurality of transmission paths, wherein the path detection signal transmitted through each of the transmission paths includes information of each audio device on the transmission path; Based on the path detection signals transmitted through the multiple transmission paths, at least one transmission path is selected from the multiple transmission paths as the at least one target transmission path, wherein the at least one target transmission path is the transmission path with the least number of paths and the largest number of audio devices among the multiple transmission paths.

35. The device according to claim 33, characterized in that The determining module is configured to: For each transmission path of the plurality of transmission paths, obtaining a current processing capability of each audio device on the transmission path; According to the current processing capabilities of the audio devices on the multiple transmission paths, at least one transmission path is selected from the multiple transmission paths as the at least one target transmission path, wherein the current processing capability of the audio device on each of the target transmission paths is stronger than the preset processing capability.

36. The device according to claim 32, characterized in that The determining module is configured to: Acquire topology information of the audio processing network and current processing capability of each audio device in the audio processing network; determining, from the audio processing network, at least one cooperative audio device required by the target audio device based on current processing capabilities of each audio device in the audio processing network; determining, based on the topology information of the audio processing network, at least one transmission path having the target audio device as its destination and including the at least one cooperative audio device as the at least one target transmission path; The sending module is configured to send device indication information to each audio device on the target transmission path, wherein the device indication information sent to the audio device indicates a next-hop device of the audio device on the target transmission path.

37. A signal transmission system, characterized in that: Includes at least two audio devices; At least one of the at least two audio devices includes the signal transmission device according to any one of claims 19 to 27, and at least another one includes the signal transmission device according to any one of claims 28 to 36.

38. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is run on a computer, the computer is enabled to execute the signal transmission method according to any one of claims 1 to 18.

Citation Information

Patent Citations

  • Audio device, audio processing method and audio processing system

    CN108564936A