Audio data transmission method and device, equipment and storage medium

Abstract

The embodiment of the invention discloses an audio data transmission method and device, equipment and a storage medium. The method comprises the following steps: acquiring hardware parameter information of audio equipment and virtual equipment configuration information of virtual equipment corresponding to the audio equipment; configuring an audio stream mapping relation in the device according to the hardware parameter information and the virtual device configuration information; performing in-device transmission on the received audio data according to the in-device audio stream mapping relation; wherein the virtual device is a virtual audio device based on the AES 70 standard. According to the technical scheme provided by the embodiment of the invention, the audio data transmission channel between the hardware audio equipment and the virtual audio equipment is constructed, external audio data transmission can be completed by the virtual equipment, and the capability of the virtual audio equipment is associated with the capability of the entity audio equipment, so that unnecessary virtual sound card service provision is avoided, and the user experience is improved. And the equipment capability utilization rate is improved.

Description

Technical Field

[0001] The present invention relates to the field of sound service technology, and in particular to an audio data transmission method, device, equipment and storage medium. Background Art

[0002] The AES70 standard is an international standard for controlling professional audio products developed and open-sourced by the Open Content Alliance (OCA). It can be used to control and supervise audio equipment. Different sound service vendors can develop AES70 audio equipment based on this standard to ensure device compatibility. However, OCA only provides the AES70 standard. Different vendors use different underlying technologies based on the AES70 standard, and there is no way to know the solution for audio data transmission.

[0003] The existing audio data mapping technology is mainly implemented through spatial audio coding tools, and the standard it adopts is often the Spatial Audio Object Coding (SAOC) standard, which is a different standard type from the AES70 standard, and the corresponding mapping method for executing audio data conversion and transmission is also different. In the audio data processing solution based on the AES70 standard, it is often necessary to provide a virtual sound card service as the basis, without considering whether the computer supports the sound card capability. A virtual sound card is directly provided, and audio data mapping and transmission are completed based on the virtual sound card data. The computer hardware capabilities cannot be fully utilized, and the virtual sound card service involves driver development, which requires related kernel technology, increasing the difficulty of software development while reducing software stability. Summary of the invention

[0004] The present invention provides an audio data transmission method, apparatus, device and storage medium, so that audio data can be transmitted from a physical device to a virtual device in an audio device under the AES70 standard, and then the virtual device can complete the external audio data transmission, and the capabilities of the virtual audio device are associated with the capabilities of the physical audio device, thereby avoiding unnecessary virtual sound card service provision and improving device capacity utilization.

[0005] In a first aspect, an embodiment of the present invention provides an audio data transmission method, including:

[0006] Obtaining hardware parameter information of the audio device and virtual device configuration information of the virtual device corresponding to the audio device;

[0007] Configure the audio stream mapping relationship in the device according to the hardware parameter information and the virtual device configuration information;

[0008] The received audio data is transmitted within the device according to the audio stream mapping relationship within the device;

[0009] The virtual device is a virtual audio device based on the AES70 standard.

[0010] In a second aspect, an embodiment of the present invention further provides an audio data transmission device, including:

[0011] A configuration information acquisition module, used to acquire hardware parameter information of an audio device and virtual device configuration information of a virtual device corresponding to the audio device;

[0012] The device mapping configuration module is used to configure the audio stream mapping relationship in the device according to the hardware parameter information and the virtual device configuration information;

[0013] An audio data transmission module, used for transmitting the received audio data within the device according to the audio stream mapping relationship within the device;

[0014] The virtual device is a virtual audio device based on the AES70 standard.

[0015] In a third aspect, an embodiment of the present invention further provides an audio data transmission device, including:

[0016] at least one processor; and

[0017] a memory communicatively connected to at least one processor; wherein,

[0018] The memory stores a computer program that can be executed by at least one processor. The computer program is executed by at least one processor so that the at least one processor can execute the audio data transmission method provided by the embodiment of the present invention.

[0019] In a fourth aspect, an embodiment of the present invention further provides a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute the audio data transmission method provided by an embodiment of the present invention.

[0020] An audio data transmission method, apparatus, device and storage medium provided by an embodiment of the present invention obtain hardware parameter information of an audio device and virtual device configuration information of a virtual device corresponding to the audio device; configure an audio stream mapping relationship within the device according to the hardware parameter information and the virtual device configuration information; and transmit the received audio data within the device according to the audio stream mapping relationship within the device; wherein the virtual device is a virtual audio device based on the AES70 standard. By adopting the above technical scheme, before the audio device is put into use, the hardware parameter information of the audio device and the virtual device configuration information of the virtual device corresponding to the audio device established according to the AES70 standard are used to clarify the correspondence between the hardware port of the audio device and the audio channel used for audio stream transmission in the virtual device, and use it as an intra-device audio stream mapping relationship for transmitting audio data within the group of audio devices and the virtual device. Then, based on the intra-device audio stream mapping relationship, the audio data received by the audio device from the hardware end or the software end is transmitted within the device, and an audio data transmission channel between the hardware audio device and the virtual audio device is constructed. The virtual device can complete external audio data transmission, and the capabilities of the virtual audio device are associated with the capabilities of the physical audio device, thereby avoiding unnecessary virtual sound card service provision and improving device capacity utilization.

[0021] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0023] Figure 1 A flowchart of an audio data transmission method provided in Embodiment 1 of the present invention;

[0024] Figure 2 A flowchart of an audio data transmission method provided in Embodiment 2 of the present invention;

[0025] Figure 3 A schematic diagram of a port channel mapping relationship of an audio input device provided in Embodiment 2 of the present invention;

[0026] Figure 4 A schematic diagram of a port channel mapping relationship of an audio output device provided in Embodiment 2 of the present invention;

[0027] Figure 5 An example diagram of the structure of an AES70 control system provided in Embodiment 2 of the present invention;

[0028] Figure 6 A schematic diagram of the structure of an audio data transmission device provided in Embodiment 3 of the present invention;

[0029] Figure 7 A schematic diagram of the structure of an audio data transmission device provided in Embodiment 4 of the present invention. DETAILED DESCRIPTION

[0030] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0031] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0032] As the open source AES70 standard is gradually being implemented in the field of audio device control and management, different manufacturers have developed various types of AES70 audio devices based on this standard to ensure compatibility between devices. However, since the underlying technologies of the implementation solutions of various manufacturers are different and not open to the public, different types of device media have different technical solutions for audio data transmission. For devices that receive external audio input, how to send the audio stream to the port of the device media processor through the audio channel; for devices that output audio to the outside, how to send the port audio of the device media processor to the audio channel corresponding to the audio stream are both problems that need to be solved. In the prior art, in order to solve the problems mentioned above, such as Dante audio technology, it is often implemented by providing a virtual sound card service. Since the virtual sound card service is in a virtual software state when it is provided, and the mapping relationship between each port and channel has been given, there is no need to consider whether the audio device configured with the virtual sound card supports the sound card capabilities. However, in the above method, the audio device's own hardware sound card capabilities are not fully utilized, so the embodiment of the present invention provides an audio data transmission method, which associates the capabilities of the virtual device with the hardware sound card capabilities by constructing a mapping relationship between the audio device's own hardware and the virtual audio device software pulled up under the AES70 standard, thereby avoiding unnecessary virtual sound card service provision and improving device capability utilization. The audio data transmission method provided by the present invention is explained below in conjunction with specific embodiments.

[0033] Embodiment 1

[0034] Figure 1 The flowchart of an audio data transmission method provided in the first embodiment of the present invention is applicable to the case where multiple audio devices are pulled up as virtual devices under the AES70 standard, and when audio data transmission between different virtual devices is realized, an audio data transmission mapping relationship between the same group of entities and virtual devices is constructed. The method can be executed by an audio data transmission device, which can be realized by software and / or hardware, and the audio data transmission device can be configured in the audio data transmission device. Optionally, the audio data transmission device can be a notebook, a desktop computer, a smart tablet, etc., which is not limited by the embodiment of the present invention.

[0035] like Figure 1 As shown, an audio data transmission method provided by an embodiment of the present invention specifically includes the following steps:

[0036] S101. Acquire hardware parameter information of an audio device and virtual device configuration information of a virtual device corresponding to the audio device.

[0037] The virtual device is a virtual audio device based on the AES70 standard.

[0038] In this embodiment, the audio device can be specifically understood as a hardware and software system for inputting, processing, storing and outputting sound, which can be divided into different types according to different functions, including a microphone for performing audio input tasks, and a speaker for performing audio output tasks, etc., which is not limited by the embodiment of the present invention. The hardware parameter information can be specifically understood as the hardware port information for inputting audio data in the audio device entity, and other hardware corresponding information that can affect the audio device's processing of audio data, which can include the number of ports, port numbers and port types, etc., which is not limited by the embodiment of the present invention.

[0039] In this embodiment, the virtual device can be specifically understood as a software device corresponding to an audio device pulled up based on the AES70 standard, and the virtual device can establish an audio stream connection between virtual devices corresponding to other audio devices. Exemplarily, assuming that one virtual device is a virtual device for an audio input device and the other virtual device is a virtual device for an audio output device, when an audio stream connection is established between the two virtual devices, the audio input into the audio input device can be played in the audio output device. The virtual device configuration information can be specifically understood as configuration information for determining the audio data transmission method between the audio device entity and the channel used to transmit the audio stream in the virtual device.

[0040] Specifically, before multiple interrelated audio devices are put into use, for each of the audio devices, a virtual device corresponding to the audio device is pulled up in the network according to the AES70 standard to realize the networking of the audio device for audio data processing capabilities. In order to clarify the transmission method of audio data between the audio device entity and the virtual device, it is necessary to obtain the hardware parameter information of the audio device to clarify the hardware ports through which the audio device is input, as well as the input form and number of channels, etc. At the same time, it is necessary to obtain the virtual device configuration information for subsequent configuration of the audio data transmission method between the channels used to transmit audio streams in the audio device entity and the virtual device.

[0041] S102: Configure the audio stream mapping relationship in the device according to the hardware parameter information and the virtual device configuration information.

[0042] In this embodiment, the audio stream mapping relationship within the device can be specifically understood as the audio data conversion and transmission relationship determined between different types of systems in the audio device entity and the virtual device.

[0043] Specifically, the number and configuration of ports that the audio device entity can use to input or output audio data are determined based on the hardware parameter information, and then a mapping relationship between the audio device entity ports and the audio channels used by the virtual device to send or receive audio data in the network is constructed based on the virtual device configuration information, and this is used as an intra-device audio stream mapping relationship for transmitting audio data within the device.

[0044] In an embodiment of the present invention, the configuration of the audio stream mapping relationship within the device is completed based on the hardware parameter information and the virtual device configuration information, and the association of audio processing and transmission capabilities between the physical audio device and the virtual device under the AES70 standard is established, so that when the physical audio device is sufficient to support the audio data processing and transmission requirements, there is no need to provide a virtual sound card service separately. At the same time, the virtual networking of the physical audio device is realized, so that multiple physical unrelated audio devices can flexibly perform audio data transmission and control processing.

[0045] S103: Transmit the received audio data within the device according to the audio stream mapping relationship within the device.

[0046] Specifically, after the audio device is put into use, it can receive audio data through the hardware interface of the audio device entity, or it can receive audio data due to the virtual device corresponding to the audio device. After receiving the audio data, it determines the path that the received audio data should be transmitted based on the pre-configured audio stream mapping relationship within the device, and then transmits the audio data within the path to achieve transmission within the device.

[0047] The technical solution of this embodiment is to obtain the hardware parameter information of the audio device and the virtual device configuration information of the virtual device corresponding to the audio device; configure the audio stream mapping relationship in the device according to the hardware parameter information and the virtual device configuration information; and transmit the received audio data in the device according to the audio stream mapping relationship in the device; wherein the virtual device is a virtual audio device based on the AES70 standard. By adopting the above technical solution, before the audio device is put into use, according to the hardware parameter information of the audio device and the virtual device configuration information of the virtual device corresponding to the audio device established according to the AES70 standard, the corresponding relationship between the hardware port of the audio device and the audio channel used for audio stream transmission in the virtual device is clarified, and it is used as the audio stream mapping relationship in the device for transmitting the audio data in the group of audio devices and the virtual device, and then according to the audio stream mapping relationship in the device, the audio data received by the audio device from the hardware end or the software end is transmitted in the device, and an audio data transmission channel between the hardware audio device and the virtual audio device is constructed, and the external audio data transmission can be completed by the virtual device, and the capability of the virtual audio device is associated with the capability of the physical audio device, thereby avoiding unnecessary virtual sound card service provision and improving the utilization rate of device capability.

[0048] Embodiment 2

[0049] Figure 2A flowchart of an audio data transmission method provided for Embodiment 2 of the present invention. The technical solution of the embodiment of the present invention is further optimized on the basis of the above-mentioned optional technical solutions. The configuration of the audio stream mapping relationship in the device is completed by configuring the software port mapping relationship between the audio device and the virtual device and the port channel mapping relationship in the virtual device. At the same time, the corresponding situation of the port channel mapping relationship for different audio device types and the specific process of transmission within the device under different audio device types are clarified. The configuration method of the audio stream mapping relationship between different virtual devices is also given, and the capabilities of the virtual audio device are associated with the capabilities of the physical audio device, thereby avoiding unnecessary virtual sound card service provision, realizing flexible configuration between different ports and channels, and between channels, and improving device capacity utilization and audio data transmission flexibility.

[0050] like Figure 2 As shown, the second embodiment of the present invention provides an audio data transmission method, which specifically includes the following steps:

[0051] S201. Acquire hardware parameter information of an audio device and virtual device configuration information of a virtual device corresponding to the audio device.

[0052] S202: Determine hardware port information according to hardware parameter information.

[0053] In this embodiment, the hardware port information can be specifically understood as information of an interface in the audio device for receiving external input or outputting external audio data. Optionally, the hardware port information can specifically include the number of hardware ports configured on the audio device, the number of each port, the type of audio data that can be accessed by the port, etc., which is not limited in the embodiment of the present invention.

[0054] Specifically, the number of hardware ports of the audio device is determined based on the acquired hardware parameter information, unique port numbers are set for different hardware ports, and the number of channels and audio data types that can be input and output by each hardware port are determined based on the hardware parameter information, and the above information corresponding to the hardware port is determined as the hardware port information.

[0055] S203: Determine a hardware and software port mapping relationship of the audio device according to the hardware and software port configuration information and the hardware port information in the virtual device configuration information.

[0056] The audio port of the audio device is a hardware port, the audio port of the virtual device corresponding to the audio device is a software port, and the hardware-software port mapping relationship is a mapping relationship between the hardware port and the software port.

[0057] In this embodiment, the hardware and software port configuration information can be specifically understood as information used to bind a group of hardware ports of audio device entities and software ports of corresponding virtual devices, that is, information that clarifies the transmission path of audio data between the hardware port and the software port.

[0058] Specifically, since the software port is created when the virtual device is pulled up, and the hardware port is determined when the audio device is produced, the audio device hardware port and the virtual device software port can be bound when the virtual device corresponding to the audio device is pulled up. That is, according to the hardware and software port configuration information included in the virtual device configuration information, the matching relationship between the software port of the virtual device and the hardware port of the audio device is determined, and the set of matching relationships of each group of successful matches is determined as the hardware and software port mapping relationship of the audio device.

[0059] Exemplarily, assuming that the audio device has two hardware ports port1_1 and port2_1, and two software ports port1_2 and port2_2 are created and registered on the virtual device pulled up by the audio device, the mapping relationship between the hardware port and the software port can be determined according to the binding status completed when the virtual device is pulled up, such as port1_1->port1_2, port2_1->port2_2; or port1_1->port2_2, port2_1->port2_1, etc. The mapping relationship can be directly configured when the virtual device is pulled up, or it can be readjusted according to the actual situation by receiving the configuration information input from the outside, and the embodiment of the present invention is not limited to this.

[0060] S204: Determine a port channel mapping relationship between a software port and an audio channel in the virtual device according to the port channel configuration information in the virtual device configuration information.

[0061] In this embodiment, the port channel configuration information may be specifically understood as configuration information for configuring the correspondence between each software port in a virtual device and an audio channel for outputting or inputting audio stream data.

[0062] Specifically, each virtual device may have multiple software ports and multiple audio channels for outputting audio stream data to the outside or receiving external input audio stream data. The correspondence between each software port and the audio channel in the virtual device is set according to the port channel configuration information in the virtual device configuration information, and the correspondence is determined as a port channel mapping relationship.

[0063] It is understandable that the same software port can establish a mapping relationship with only one audio channel, or can establish a mapping relationship with multiple audio channels at the same time, and can be adaptively set and adjusted according to actual needs and received configuration information, and the embodiment of the present invention does not limit this.

[0064] S205: Determine a combination of the hardware and software port mapping relationship and the port channel mapping relationship as an intra-device audio stream mapping relationship.

[0065] Specifically, since the transmission path of audio data in a single-sided device is composed of hardware ports, software ports and audio channels, and the hardware-software port mapping relationship indicates the transmission path of audio data in the hardware and software ports, and the port-channel mapping relationship indicates the transmission path of audio data in the virtual device, combining the hardware-software port mapping relationship with the port-channel mapping relationship is the complete transmission path of audio data in a single-sided device, which is also the audio stream mapping system within the device.

[0066] When the audio device is an audio input device, the port channel mapping relationship is a one-to-one mapping relationship, and step S206 is executed.

[0067] Specifically, when the audio device is an audio input device, that is, when the hardware port of the audio device is a port for audio data input, according to the configuration requirements of the audio input device, the mapping relationship between the port and the channel needs to be determined as a one-to-one mapping relationship, that is, one software port can only be mapped to one audio channel. At this time, step S206 is executed to perform corresponding in-device transmission of audio data.

[0068] Exemplarily, assuming that the audio input device is a dual-channel microphone, Figure 3 A schematic diagram of a port channel mapping relationship of an audio input device provided in the second embodiment of the present invention, such as Figure 3 As shown, the virtual device under the AES70 standard obtained by pulling up has two software ports which can be represented as port1_2 and port2_2 respectively, and the audio channels created in the virtual device can be represented as channel1_1 and channel2_1. Then, the port channel mapping relationship corresponding to the audio input device can be port1_2->channel1_1, port2_2->channel2_1, port1_2->channel2_1 or port2_2->channel1_1. This embodiment of the present invention does not limit this. Figure 3 The mapping relationship of port1_2->channel1_1 and port2_2->channel2_1 is taken as an example.

[0069] When the audio device is an audio output device, the port channel mapping relationship is a one-to-many mapping relationship, and step S209 is executed.

[0070] Specifically, when the audio device is an audio output device, that is, when the hardware port of the audio device is a port for outputting audio data, according to the configuration requirements of the audio output device, the mapping relationship between the port and the channel needs to be determined as a one-to-many mapping relationship, that is, multiple audio channels can be mapped to one software port at the same time, and one audio channel can also be mapped to multiple software ports at the same time. At this time, step S209 is executed to perform corresponding in-device transmission of audio data.

[0071] For example, assuming that the audio output device is a computer speaker, Figure 4 A schematic diagram of a port channel mapping relationship of an audio output device provided in Embodiment 2 of the present invention, such as Figure 4 As shown, the virtual device under the AES70 standard obtained by pulling up has two software ports which can be represented as port1_2 and port2_2 respectively, and the audio channels created in the virtual device can be represented as channel1_2 and channel2_2. Then, the port channel mapping relationship corresponding to the audio input device can be channel1_2->port1_2, channel1_2->port2_2, channel2_2->port1_2 and / or channel2_2->port2_2. The above mapping relationships can exist simultaneously or separately, and the embodiment of the present invention is not limited to this. Figure 4 The mapping relationships of channel1_2->port1_2, channel1_2->port2_2, and channel2_2->port2_2 are taken as examples.

[0072] S206: Receive audio data input from the hardware port.

[0073] Specifically, when the audio device is an audio input device, the audio acquisition device may be connected to the hardware port so that the audio data acquired by the audio acquisition device is input into the audio input device via the hardware port.

[0074] S207: Convert the audio data into at least one audio stream data according to the audio data type and the mapping relationship between the hardware and software ports, and store the audio stream data in the software port corresponding to the hardware port.

[0075] In this embodiment, the audio data type may include a single-channel audio type and a multi-channel audio type.

[0076] Specifically, since each port in the audio device can only receive audio data of one channel, when the input audio data type is a single-channel audio type, the hardware port for audio data input can be directly determined as the target hardware port, and the software port corresponding to the target hardware port can be determined according to the hardware-software port mapping relationship, that is, the transmission path of the audio data in the device is from the target hardware port to the corresponding software port, and the data stream generated by the transmission process can be determined as audio stream data corresponding to the audio data. After the audio stream data is transmitted to the software port corresponding to the target hardware port, the audio stream data is stored in the software port. When the input audio data type is a multi-channel audio type, the audio data needs to be separated by channels first, and then the software ports corresponding to the audio data of different channels are determined according to the hardware-software port mapping relationship, and the audio stream data generated by transmitting the audio data of different channels to the software port is stored in the corresponding software port.

[0077] S208. Determine the audio output channel corresponding to the software port according to the port channel mapping relationship, and output the audio stream data through the audio output channel.

[0078] In this embodiment, the audio output channel can be specifically understood as an audio channel used to transmit audio stream data to other virtual devices outside the device.

[0079] Specifically, the corresponding relationship between different software ports and audio output channels can be determined according to the port channel mapping relationship. The audio output channel obtains the audio stream data that needs to be transmitted externally from the corresponding software port, and outputs the audio stream data externally. That is, for the audio input device, the transmission path of the audio data input therein is sent from the target hardware port to the corresponding software port for storage, and then sent from the software port to the corresponding audio output channel, so as to be output to other audio devices other than the audio input device via the audio output channel.

[0080] S209: Receive at least one audio stream data input by an audio input channel.

[0081] In this embodiment, the audio input channel can be specifically understood as an audio channel for receiving audio stream data sent by other virtual devices outside the device.

[0082] Specifically, when the audio device is an audio output device, it can be considered that the audio device performs the task of outputting audio to the outside, that is, it is a device that plays the received audio data to the outside. At this time, the audio output device corresponds to the audio input channel in the virtual device, and can receive at least one audio stream data sent by other virtual devices pulled up under the AES70 standard, which needs to be played to the outside by the audio output device.

[0083] S210: Separate the audio stream data into channels, and push and store the separated audio stream data into corresponding software ports according to the port channel mapping relationship.

[0084] Specifically, each received audio stream data is channel separated. Since the port channel mapping relationship in the audio output device can be a one-to-many mapping relationship, at least one software port corresponding to each audio input channel can be determined according to the port channel mapping relationship, and the separated audio stream data input by the audio input channel can be pushed to the corresponding software port, and the software port stores the separated audio stream data after receiving it.

[0085] S211. Determine a hardware port corresponding to the software port according to a hardware-software port mapping relationship, and output the separated audio stream data through the hardware port.

[0086] Specifically, since there is a one-to-one correspondence between the hardware port and the software port in the audio device, the hardware port corresponding to each software port can be determined according to the hardware-software port mapping relationship, and then the separated audio stream data stored in the software port is sent to the corresponding hardware port for channel merging and output. That is, for the audio output device, the transmission path of the audio data input therein is that after the audio input channel is input and channel separated, it is stored by the corresponding software port, and sent by the software port to the corresponding hardware port for channel merging and output.

[0087] Furthermore, the second embodiment of the present invention also provides a method for transmitting audio data between different virtual devices, which may specifically include the following steps:

[0088] 1) Receive audio transmission configuration information between devices.

[0089] 2) Configure the audio stream mapping relationship between devices according to the audio transmission configuration information between devices.

[0090] The audio stream mapping relationship between devices is the mapping relationship between the audio input channels and the audio output channels in each virtual device.

[0091] 3) Complete the audio data transmission between virtual devices based on the audio stream mapping relationship between devices.

[0092] In this embodiment, the inter-device audio transmission configuration information can be specifically understood as information for configuring a mapping relationship between audio channels for audio data transmission between virtual devices pulled up under different AES70 standards.

[0093] Optional, Figure 5 An example diagram of the structure of an AES70 control system provided in the second embodiment of the present invention is shown in FIG. Figure 5As shown, an AES70 control system including an AES70 controller 21 and two AES70 virtual devices 22 is taken as an example. When each AES70 virtual device 22 is pulled up, the AES70 controller 21 can establish a connection with different AES70 virtual devices 22. The connection method can be a heartbeat connection or any other feasible connection method. The AES70 controller 21 and each AES virtual device 22 can transmit data according to the AES70+67 protocol, and the embodiment of the present invention does not limit this. The AES70 controller 21 obtains the configuration information of each AES70 virtual device 22 based on the connection, that is, obtains the audio channel information corresponding to different AES70 virtual devices. The audio channel information may include information such as the audio channel type, the number of audio channels, and the audio channel number. According to the actual needs received, the AES70 controller 21 can clarify the data transmission requirements between different AES70 virtual devices 22, that is, the data transmission relationship between the audio input channels and audio output channels of different AES70 virtual devices 22. The AES70 controller 21 constructs inter-device audio transmission configuration information corresponding to different AES70 virtual devices 22 according to the above data transmission relationship, and sends the inter-device audio transmission configuration information to different AES70 virtual devices 22 for configuration, so that the AES70 virtual devices 22 that need to perform audio data transmission can construct an inter-device audio stream mapping relationship based on the inter-device audio transmission configuration information, and then the audio input channels and audio output channels in each AES70 virtual device 22 can be mapped based on the inter-device audio stream mapping relationship, so that the audio stream data can be transmitted between the corresponding devices.

[0094] The technical solution of this embodiment completes the configuration of the audio stream mapping relationship in the device by configuring the software port mapping relationship between the audio device and the virtual device and the port channel mapping relationship in the virtual device, sets the port channel mapping relationship to one-to-one and one-to-many mapping relationships for the audio input device and the audio output device respectively, and correspondingly executes the transmission of audio data in the two devices from the hardware port to the audio output channel output, and from the audio input channel input to the hardware port output, associates the capabilities of the virtual audio device with the capabilities of the physical audio device, avoids unnecessary virtual sound card service provision, realizes flexible configuration between different ports and channels, and between channels, improves the utilization rate of device capabilities and the flexibility of audio data transmission. At the same time, based on the AES70 controller, the configuration of audio stream mapping relationships between different AES70 virtual devices is realized, so that different audio input channels and audio output channels can be flexibly configured, and the audio streams of different virtual device output and input can be flexibly adjusted according to actual conditions without the need to separately construct audio channel transmission, thereby improving the flexibility of audio data transmission.

[0095] Embodiment 3

[0096] Figure 6 A schematic diagram of the structure of an audio data transmission device provided in Embodiment 3 of the present invention is shown in FIG. Figure 6 As shown, the audio data transmission device includes: a configuration information acquisition module 31, an in-device mapping configuration module 32 and an audio data transmission module 33.

[0097] Among them, the configuration information acquisition module 31 is used to obtain the hardware parameter information of the audio device and the virtual device configuration information of the virtual device corresponding to the audio device; the in-device mapping configuration module 32 is used to configure the audio stream mapping relationship in the device according to the hardware parameter information and the virtual device configuration information; the audio data transmission module 33 is used to transmit the received audio data in the device according to the audio stream mapping relationship in the device; wherein the virtual device is a virtual audio device based on the AES70 standard.

[0098] The technical solution of this embodiment is to obtain the hardware parameter information of the audio device and the virtual device configuration information of the virtual device corresponding to the audio device; configure the audio stream mapping relationship in the device according to the hardware parameter information and the virtual device configuration information; and transmit the received audio data in the device according to the audio stream mapping relationship in the device; wherein the virtual device is a virtual audio device based on the AES70 standard. By adopting the above technical solution, before the audio device is put into use, according to the hardware parameter information of the audio device and the virtual device configuration information of the virtual device corresponding to the audio device established according to the AES70 standard, the corresponding relationship between the hardware port of the audio device and the audio channel used for audio stream transmission in the virtual device is clarified, and it is used as the audio stream mapping relationship in the device for transmitting the audio data in the group of audio devices and the virtual device, and then according to the audio stream mapping relationship in the device, the audio data received by the audio device from the hardware end or the software end is transmitted in the device, and an audio data transmission channel between the hardware audio device and the virtual audio device is constructed, and the external audio data transmission can be completed by the virtual device, and the capability of the virtual audio device is associated with the capability of the physical audio device, thereby avoiding unnecessary virtual sound card service provision and improving the utilization rate of device capability.

[0099] Optionally, the device mapping configuration module 32 includes:

[0100] A port information determining unit, used to determine hardware port information according to hardware parameter information;

[0101] A port mapping determination unit, configured to determine a hardware-software port mapping relationship of an audio device according to the hardware-software port configuration information and the hardware port information in the virtual device configuration information; wherein the audio port of the audio device is a hardware port, the audio port of the virtual device corresponding to the audio device is a software port, and the hardware-software port mapping relationship is a mapping relationship between the hardware port and the software port;

[0102] A port channel mapping determination unit, configured to determine a port channel mapping relationship between a software port and an audio channel in a virtual device according to the port channel configuration information in the virtual device configuration information;

[0103] The in-device mapping determination unit is used to determine the combination of the hardware and software port mapping relationship and the port channel mapping relationship as the in-device audio stream mapping relationship.

[0104] Wherein, when the audio device is an audio input device, the port channel mapping relationship is a one-to-one mapping relationship, and accordingly, the audio data transmission module 33 is specifically used for:

[0105] Receive audio data input from the hardware port;

[0106] Convert the audio data into at least one audio stream data according to the audio data type and the mapping relationship between the hardware and software ports, and store the audio stream data in the software port corresponding to the hardware port;

[0107] The audio output channel corresponding to the software port is determined according to the port channel mapping relationship, and the audio stream data is output through the audio output channel.

[0108] Wherein, when the audio device is an audio output device, the port channel mapping relationship is a one-to-many mapping relationship, and accordingly, the audio data transmission module 33 is specifically used for:

[0109] Receiving at least one audio stream data input by an audio input channel;

[0110] Separate the audio stream data into channels, and push and store the separated audio stream data into corresponding software ports according to the port channel mapping relationship;

[0111] The hardware port corresponding to the software port is determined according to the hardware-software port mapping relationship, and the separated audio stream data is output through the hardware port.

[0112] Optionally, the audio data transmission device further includes: an external device mapping configuration module, specifically used for:

[0113] Receive audio transmission configuration information between devices;

[0114] Configure the audio stream mapping relationship between devices according to the audio transmission configuration information between devices;

[0115] Complete audio data transmission between virtual devices based on the audio stream mapping relationship between devices;

[0116] The audio stream mapping relationship between devices is the mapping relationship between the audio input channels and the audio output channels in each virtual device.

[0117] The audio data transmission device provided in the embodiment of the present invention can execute the audio data transmission method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0118] Embodiment 4

[0119] Figure 7 A schematic diagram of the structure of an audio data transmission device provided for Embodiment 4 of the present invention. The audio data transmission device 40 may be an electronic device intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0120] like Figure 7 As shown, the audio data transmission device 40 includes at least one processor 41, and a memory connected to the at least one processor 41, such as a read-only memory (ROM) 42, a random access memory (RAM) 43, etc., wherein the memory stores a computer program that can be executed by the at least one processor, and the processor 41 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 42 or the computer program loaded from the storage unit 48 to the random access memory (RAM) 43. In the RAM 43, various programs and data required for the operation of the audio data transmission device 40 can also be stored. The processor 41, the ROM 42, and the RAM 43 are connected to each other through a bus 44. An input / output (I / O) interface 45 is also connected to the bus 44.

[0121] A number of components in the audio data transmission device 40 are connected to the I / O interface 45, including: an input unit 46, such as a keyboard, a mouse, etc.; an output unit 47, such as various types of displays, speakers, etc.; a storage unit 48, such as a disk, an optical disk, etc.; and a communication unit 49, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 49 allows the audio data transmission device 40 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0122] The processor 41 may be a variety of general and / or dedicated processing components with processing and computing capabilities. Some examples of the processor 41 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 41 performs the various methods and processes described above, such as an audio data transmission method.

[0123] In some embodiments, the audio data transmission method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 48. In some embodiments, part or all of the computer program may be loaded and / or installed on the audio data transmission device 40 via the ROM 42 and / or the communication unit 49. When the computer program is loaded into the RAM 43 and executed by the processor 41, one or more steps of the audio data transmission method described above may be performed. Alternatively, in other embodiments, the processor 41 may be configured to perform the audio data transmission method in any other suitable manner (e.g., by means of firmware).

[0124] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0125] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0126] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0127] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0128] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0129] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0130] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0131] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. An audio data transmission method, characterized in that: include: Acquire hardware parameter information of an audio device and virtual device configuration information of a virtual device corresponding to the audio device; Configure the audio stream mapping relationship in the device according to the hardware parameter information and the virtual device configuration information; Transmitting the received audio data within the device according to the audio stream mapping relationship within the device; Wherein, the virtual device is a virtual audio device based on the AES70 standard.

2. The method according to claim 1, characterized in that The configuring the audio stream mapping relationship in the device according to the hardware parameter information and the virtual device configuration information includes: Determine hardware port information according to the hardware parameter information; Determine the hardware-software port mapping relationship of the audio device according to the hardware-software port configuration information in the virtual device configuration information and the hardware port information; wherein the audio port of the audio device is a hardware port, the audio port of the virtual device corresponding to the audio device is a software port, and the hardware-software port mapping relationship is a mapping relationship between the hardware port and the software port; Determine, according to the port channel configuration information in the virtual device configuration information, a port channel mapping relationship between a software port and an audio channel in the virtual device; A combination of the hardware-software port mapping relationship and the port channel mapping relationship is determined as an intra-device audio stream mapping relationship.

3. The method according to claim 2, characterized in that When the audio device is an audio input device, the port channel mapping relationship is a one-to-one mapping relationship.

4. The method according to claim 3, characterized in that The transmitting the received audio data within the device according to the audio stream mapping relationship within the device includes: Receive audio data input from the hardware port; Convert the audio data into at least one audio stream data according to the audio data type and the hardware-software port mapping relationship, and store the audio stream data in a software port corresponding to the hardware port; An audio output channel corresponding to the software port is determined according to the port channel mapping relationship, and the audio stream data is output through the audio output channel.

5. The method according to claim 2, characterized in that: When the audio device is an audio output device, the port channel mapping relationship is a one-to-many mapping relationship.

6. The method according to claim 5, characterized in that The transmitting the received audio data within the device according to the audio stream mapping relationship within the device includes: Receiving at least one audio stream data input by an audio input channel; Separating the audio stream data into channels, and pushing and storing the separated audio stream data into corresponding software ports according to the port channel mapping relationship; The hardware port corresponding to the software port is determined according to the hardware-software port mapping relationship, and the separated audio stream data is output through the hardware port.

7. The method according to any one of claims 1 to 6, characterized in that: Also includes: Receive audio transmission configuration information between devices; Configure the audio stream mapping relationship between devices according to the audio transmission configuration information between devices; Complete the audio data transmission between the virtual devices based on the audio stream mapping relationship between the devices; The audio stream mapping relationship between devices is a mapping relationship between audio input channels and audio output channels in each of the virtual devices.

8. An audio data transmission device, characterized in that: include: A configuration information acquisition module, used to acquire hardware parameter information of an audio device and virtual device configuration information of a virtual device corresponding to the audio device; An in-device mapping configuration module, used to configure an in-device audio stream mapping relationship according to the hardware parameter information and the virtual device configuration information; An audio data transmission module, used for transmitting the received audio data within the device according to the audio stream mapping relationship within the device; Wherein, the virtual device is a virtual audio device based on the AES70 standard.

9. An audio data transmission device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the audio data transmission method according to any one of claims 1 to 7.

10. A storage medium containing computer executable instructions, characterized in that: When the computer executable instructions are executed by a computer processor, they are used to perform the audio data transmission method according to any one of claims 1 to 7.

Images