Live broadcast system, sound card device, computer program product and storage medium

Abstract

The embodiment of the invention provides a live broadcast system, a sound card device, an audio acquisition device, a monitoring device, a computer program product and a storage medium. In order to realize wireless connection between the sound card device and other devices in the live broadcast system, a first wireless transmission channel and a second wireless transmission channel can be arranged in the sound card device, and the two wireless transmission channels can work based on different wireless transmission protocols. The first wireless transmission channel can be used for transmission of voice data with a high real-time requirement between audio acquisition equipment and monitoring equipment, and the second wireless transmission channel can be used for transmission of accompaniment audio and other data with a low real-time requirement between accompaniment equipment. Through the mode, the audio acquisition equipment, the monitoring equipment, the accompaniment equipment and the like in the live broadcast system can be accessed to the sound card equipment in a wireless connection mode, and the construction process of the live broadcast system is simplified.

Description

Technical Field

[0001] The present application relates to the field of live broadcast technology, and more specifically, to a live broadcast system, a sound card device, an audio acquisition device, a monitoring device, a computer program product, and a storage medium. Background Art

[0002] Traditional personal live broadcast systems usually include audio acquisition devices (e.g., live broadcast microphones), accompaniment devices (e.g., mobile phones that play accompaniment audio), sound card devices, monitoring devices (e.g., monitoring headphones), and live broadcast devices (e.g., mobile phones with live broadcast software installed). The audio acquisition device is used to collect the host's voice data and transmit it to the sound card device. The accompaniment device is used to provide accompaniment audio and transmit it to the sound card device. The sound card device is used to mix the host's voice data and accompaniment audio and process the sound effects. The processed mixed data is then divided into two outputs, one output to the live broadcast device as the voice data in the live video stream, and the other output to the monitoring device, so that the live broadcast user can monitor whether the sound effect of the final processed mixed data meets expectations. At present, the audio acquisition device, accompaniment device, monitoring device and sound card device in the personal live broadcast system are all connected through data cables. Before each live broadcast, it takes time to connect these devices with data cables, which is cumbersome. In addition, the wires are not only unsightly, but also have certain restrictions on the distance between the connected devices, which is not very convenient. Summary of the invention

[0003] In view of this, the present application provides a live broadcast system, a sound card device, an audio acquisition device, a monitoring device, a computer program product and a storage medium.

[0004] According to a first aspect of the present application, a live broadcast system is provided, the live broadcast system comprising an audio acquisition device, a sound card device, and a monitoring device, the audio acquisition device and the monitoring device are wirelessly connected to the sound card device respectively, and the sound card device is also wirelessly connected to an accompaniment device; the sound card device comprises a first wireless transmission channel and a second wireless transmission channel; the first wireless transmission channel and the second wireless transmission channel operate based on different wireless transmission protocols, and the transmission delay of the first wireless transmission channel is lower than the transmission delay of the second wireless transmission channel; The audio acquisition device is used to collect voice data of live broadcast users and send it to the sound card device through the first wireless transmission channel; The sound card device is used to receive the accompaniment audio sent by the accompaniment device through the second wireless transmission channel, mix the voice data and the accompaniment audio to obtain mixed data, and send the mixed data to the monitoring device through the first wireless transmission channel; and output the mixed data to the live broadcast device; The monitoring device is used to play the mixed sound data so that the live broadcast user can monitor the mixed sound data.

[0005] According to a second aspect of the present application, a sound card device is provided, which is wirelessly connected to an audio acquisition device, a monitoring device, and an accompaniment device respectively, and the sound card device includes a first wireless transmission channel and a second wireless transmission channel, the first wireless transmission channel and the second wireless transmission channel operate based on different wireless transmission protocols, and the transmission delay of the first wireless transmission channel is lower than the transmission delay of the second wireless transmission channel; the sound card device is used to receive voice data of a live broadcast user collected by the audio acquisition device through the first wireless transmission channel, receive accompaniment audio sent by the accompaniment device through the second wireless transmission channel, mix the voice data and the accompaniment audio to obtain mixed data, and send the mixed data to the monitoring device through the first wireless transmission channel so that the monitoring device plays the mixed data; and output the mixed data to the live broadcast device.

[0006] According to a third aspect of the present application, an audio acquisition device is provided, wherein the audio acquisition device is used to implement the function of the audio acquisition device in the live broadcast system mentioned in the first aspect above.

[0007] According to a fourth aspect of the present application, a monitoring device is provided, which is used to implement the function of the monitoring device in the live broadcast system mentioned in the first aspect above.

[0008] According to a fifth aspect of the present application, a computer program product is provided, the computer program product comprising a computer program, the computer program can realize the functions of a client when executed, the client is wirelessly connected to the sound card device in the live broadcast system mentioned in the first aspect, and is used to send the sound effect adjustment parameters set by the user to the sound card device through the second wireless transmission channel; After the sound card device mixes the voice data and the accompaniment audio to obtain mixed data, it is further used to perform sound effect adjustment processing on the mixed data based on the sound effect adjustment parameter, and then send the mixed data after the sound effect adjustment processing to the monitoring device through the first wireless transmission channel, and output it to the live broadcast device; or Before the sound card device performs mixing processing on the voice data and the accompaniment audio to obtain mixed data, it is also used to perform sound effect adjustment processing on the voice data and / or accompaniment audio based on the sound effect adjustment parameters, and then performs mixing processing to obtain mixed data, and sends it to the monitoring device through the first wireless transmission channel, and outputs it to the live broadcast device.

[0009] According to a sixth aspect of the present application, a computer-readable storage medium is provided, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed, the functions of a client can be realized, wherein the client is wirelessly connected to the sound card device in the live broadcast system mentioned in the first aspect, and is used to send the sound effect adjustment parameters set by the user to the sound card device through the second wireless transmission channel; After the sound card device mixes the voice data and the accompaniment audio to obtain mixed data, it is further used to perform sound effect adjustment processing on the mixed data based on the sound effect adjustment parameter, and then send the mixed data after the sound effect adjustment processing to the monitoring device through the first wireless transmission channel, and output it to the live broadcast device; or Before the sound card device performs mixing processing on the voice data and the accompaniment audio to obtain mixed data, it is also used to perform sound effect adjustment processing on the voice data and / or accompaniment audio based on the sound effect adjustment parameters, and then performs mixing processing to obtain mixed data, and sends it to the monitoring device through the first wireless transmission channel, and outputs it to the live broadcast device.

[0010] By applying the solution provided by the present application, in order to realize the wireless connection between the sound card device and other devices in the live broadcast system, two wireless transmission channels can be set in the sound card device, namely the first wireless transmission channel and the second wireless transmission channel. The two wireless transmission channels can work based on different wireless transmission protocols to meet the requirements of different data for transmission delay, wherein the transmission delay of the first wireless transmission channel is lower than the transmission delay of the second wireless transmission channel, the first wireless transmission channel can be used to transmit voice data with high real-time requirements between the audio acquisition device and the monitoring device, and the second wireless transmission channel can be used to transmit data with low real-time requirements such as accompaniment audio between the accompaniment device. In this way, the audio acquisition device, monitoring device, accompaniment device, etc. in the live broadcast system can be connected to the sound card device by wireless connection, simplifying the construction process of the live broadcast system, and by setting two wireless transmission channels with different delays to transmit different types of data, the efficiency of wireless transmission of various data in the live broadcast system and the real-time transmission can be guaranteed.

[0011] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0013] Figure 1 It is a schematic diagram of a live broadcast system in the prior art.

[0014] Figure 2 , Figure 3 , Figure 4 It is a schematic diagram of a live broadcast system according to an embodiment of the present application.

[0015] Figure 5 It is a schematic diagram of a sound card device according to an embodiment of the present application.

[0016] Figure 6 It is a schematic diagram of a sound card device according to another embodiment of the present application.

[0017] Figure 7 It is a schematic diagram of a live broadcast system according to an embodiment of the present application. DETAILED DESCRIPTION

[0018] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0019] like Figure 1As shown, it is a schematic diagram of a traditional personal live broadcast system, which includes an audio acquisition device 11 (e.g., a live broadcast microphone), a sound card device 12, a monitoring device 13 (e.g., a monitoring headset), an accompaniment device 14 (e.g., a mobile phone 1), and a live broadcast device 15 (e.g., a mobile phone 2). The audio acquisition device 11 acquires the host's voice data and transmits it to the sound card device 12. The accompaniment device 14 is used to transmit the accompaniment audio to the sound card device 12. The sound card device 12 is used to mix the host's voice data and the accompaniment audio and perform sound effect processing, and then output the processed mixed data in two ways, one way is output to the live broadcast device 15 as the voice data in the live broadcast video stream, and the other way is output to the monitoring device 13, so that the live broadcast user can monitor whether there is any abnormality in the voice during the live broadcast, and whether the sound effect of the processed mixed data meets expectations. At present, the audio acquisition device 11, accompaniment device 14, monitoring device 13 and sound card device 12 in the personal live broadcast system are all connected through data cables. It takes time to connect these devices before each live broadcast, which is cumbersome. In addition, the wires are not only unsightly, but also have certain restrictions on the distance between the connected devices, which is not very convenient.

[0020] Considering that in the existing live broadcast system, the sound card device 12 is the center of audio data processing. When different devices are connected to the sound card device 12, they all need to be connected through wired connections, which will make the connection of the devices in the entire live broadcast system very cumbersome and not conducive to the rapid construction of the live broadcast system. Based on this, the embodiment of the present application thinks of converting wired connections into wireless connections, so as to simplify the construction of the live broadcast system. Considering that during the live broadcast process, the sound card device 12 needs to establish connections with multiple devices and transmit data with these multiple devices. The amount of data to be transmitted is large, and the data types transmitted between these multiple devices are different. These data also have different requirements for transmission delay. For example, the live broadcast process has higher real-time requirements for the host's voice data, while for the accompaniment music, its real-time requirements are lower. Therefore, in the embodiment of the present application, two wireless transmission channels can be set in the sound card device 12, namely the first wireless transmission channel and the second wireless transmission channel. The two wireless transmission channels can work based on different wireless transmission protocols to meet the requirements of different data for transmission delay, wherein the transmission delay of the first wireless transmission channel is lower than the transmission delay of the second wireless transmission channel, and the first wireless transmission channel can be used to transmit data with high real-time requirements such as voice data, and the second wireless transmission channel can be used to transmit data with low real-time requirements such as accompaniment audio. In this way, the audio acquisition device 11, the monitoring device 13, the accompaniment device 14, etc. in the live broadcast system can be connected to the sound card device 12 by wireless connection, simplifying the construction process of the live broadcast system, and by setting two wireless transmission channels with different delays to transmit different types of data, the efficiency of wireless transmission of various data in the live broadcast system and the real-time transmission can be guaranteed.

[0021] Based on the above invention concept, firstly, the embodiment of the present application provides a live broadcast system, such as Figure 2 As shown, the live broadcast system includes an audio acquisition device 11, a sound card device 12, and a monitoring device 13. The audio acquisition device 11 is a device that can be used to collect the host's voice data, such as a microphone. The sound card device 12 is a device that can be used to perform various types of processing on the audio data, such as mixing, adding effects, dynamic range control, sound effect volume adjustment, etc. The monitoring device 13 is a device that can be used to play audio data so that the user can listen to the effect of the audio data, such as headphones, or other devices with audio playback function.

[0022] The sound card device 12 serves as an audio data processing center, which is wirelessly connected to the audio acquisition device 11 and the monitoring device 13 respectively, and the sound card device 12 is also wirelessly connected to the accompaniment device 14. The accompaniment device 14 can be various devices for providing accompaniment audio during the live broadcast, for example, it can be a user's mobile phone, tablet, laptop computer, etc.

[0023] The sound card device 12 includes a first wireless transmission channel and a second wireless transmission channel, wherein the first wireless transmission channel and the second wireless transmission channel can be implemented by two wireless modules, and the two wireless modules can be integrated on the same chip or on two different chips respectively.

[0024] In order to meet the requirements of different types of data on transmission delay during live broadcast, the first wireless transmission channel and the second wireless transmission channel can work based on different wireless transmission protocols, and the transmission delay of the first wireless transmission channel is lower than the transmission delay of the second wireless transmission channel. For example, the first wireless transmission channel and the second wireless transmission channel can work based on some existing standard wireless transmission protocols, such as Bluetooth, WiFi, Zigbee, LoRa, etc., or based on some customized private protocols.

[0025] Considering that during the live broadcast, in order to ensure the synchronization of the host's voice and the picture, the real-time requirement for the host's voice data is relatively high, and the host also needs to monitor whether there is any abnormality in the voice processed by the sound card device 12 in a timely manner, therefore, the audio data between the sound card device 12 and the audio acquisition device 11 and the monitoring device 13 can be transmitted through the first wireless transmission channel with a smaller transmission delay, so that the transmission delay of such data is as low as possible. As for the accompaniment audio, since it is not strictly required to be synchronized with the picture, the real-time requirement is not high, therefore, the sound card device 12 and the accompaniment device 14 can be transmitted through the second wireless transmission channel with a larger transmission delay.

[0026] During the live broadcast process, the audio acquisition device 11 can collect the voice data of the live broadcast user and send it to the sound card device 12 through the first wireless transmission channel. The accompaniment device 14 can send the accompaniment audio to the sound card device 12 through the second wireless transmission channel. After receiving the above two types of data, the sound card device 12 can mix the voice data and the accompaniment audio to obtain mixed data, and output the mixed data in two ways, one of which is sent to the monitoring device 13 through the first wireless transmission channel. The monitoring device 13 can play the mixed data so that the user can monitor whether there is an abnormality in the mixed data or whether the sound effect of the mixed data meets the expected effect. The other mixed data can be output to the live broadcast device 15 as the audio in the live video stream. Usually, considering that the live broadcast device 15 is a device produced by a third-party manufacturer, if the mixed data is transmitted to the live broadcast device based on the existing WiFi or Bluetooth protocol, it may not meet the requirements of the live broadcast scene for delay. Therefore, a wired connection can be used between the live broadcast device 15 and the sound card device to ensure the real-time nature of data transmission.

[0027] In the prior art, the sound card device 12 in the live broadcast system usually includes buttons, and the user can set the sound effect adjustment parameters by adjusting these buttons to adjust the sound effect of the audio data. However, the setting of the sound effect parameters often requires a professional tuner to operate, which requires the tuner to go to the live broadcast site to adjust the sound effect, which is relatively cumbersome. In order to facilitate the adjustment of the sound effect during the live broadcast, such as Figure 3 As shown, the live broadcast system may also include a client 16 wirelessly connected to the sound card device 12. The client 16 may be an APP installed on a personal terminal device such as a mobile phone or a computer. The user may set the sound effect adjustment parameters through the APP, and the client 16 may send the sound effect adjustment parameters to the sound card device 12 through the second wireless transmission channel. In some scenarios, the sound card device 12 may first perform a mixing process on the voice data and the accompaniment audio to obtain mixed data, and then perform a sound effect adjustment on the mixed data based on the sound effect adjustment parameters, and then output it to the live broadcast device 15 and the monitoring device 13. In some scenarios, the sound card device 12 may also first perform a sound effect adjustment process on one or both of the voice data and the accompaniment audio, and then perform a mixing process on the two to obtain mixed data.

[0028] Considering that the sound effect data is usually pre-stored in the sound card device 12, the sound effect adjustment parameters only need to control and adjust the sound effect, so they can be transmitted using the second wireless transmission channel with higher latency. In this way, the tuner does not need to go to the live broadcast site, but can set the sound effect adjustment parameters remotely.

[0029] Of course, in some scenarios, in order to allow live broadcast users to adjust the sound effects without the help of a tuner, some debugging pages can be set in the APP to facilitate live broadcast users to adjust the sound effects. For example, multiple adjustment controls can be set in the debugging interface, and users can touch these adjustment controls to set the sound effect adjustment parameters. At the same time, in order to let users know whether the currently set sound effect adjustment parameters meet expectations, you can also set an audition button in the debugging interface. When the user clicks the button, he can audition the sound effects of the audio adjusted using the currently set sound effect adjustment parameters.

[0030] In some embodiments, it is considered that the audio acquisition device 11, the sound card device 12, and the monitoring device 13 in the live broadcast system are usually used in conjunction with each other and are generally produced by the same manufacturer, while the accompaniment device 14 and the personal terminal equipped with the client 16 for setting the sound effect adjustment parameters are usually produced by other manufacturers. In order to allow the sound card device 12 to achieve wireless connection with the accompaniment device 14 and the personal terminal produced by other manufacturers, the second wireless transmission channel can realize data transmission based on the existing standard wireless transmission protocol, for example, it can work based on some common wireless transmission protocols such as WiFi and Bluetooth, so that the sound card device 12 can achieve wireless connection with the devices produced by other manufacturers. Considering that the audio acquisition device 11 and the monitoring device 13 need to ensure low latency and high-quality audio quality for recording and monitoring, and also need to take into account low power consumption, transmission distance and anti-interference performance, therefore, for the first wireless transmission channel, it can achieve wireless transmission through a customized private protocol. For example, the private protocol can be a customized 2.4G private protocol, which can flexibly select the codec protocol according to the audio delay and quality requirements of the audio acquisition device 11 and the monitoring device 13, and follow the basic wireless communication rules (3 broadcast channels and 37 data communication channels) and anti-interference frequency hopping mechanism. Before the connection is established, the audio acquisition device 11, the monitoring device 13 and the sound card device 12 can exchange relevant information through the broadcast channel and establish a connection for subsequent audio data transmission.

[0031] In some embodiments, considering that the Bluetooth protocol has lower power consumption, the second wireless transmission channel may operate based on the Bluetooth protocol to reduce the overall power consumption of the sound card device 12 .

[0032] In some embodiments, the customized private protocol may be a private 2.4G protocol. Due to the high real-time requirements in scenarios such as live broadcast, it is necessary to ensure low latency and high-quality audio quality of recording, while also taking into account low power consumption, transmission distance and anti-interference performance. The A2DP (Advanced Audio Distribution Profile) used in the standard Bluetooth protocol still has a relatively large latency, and the HFP (Hands-free Profile) protocol is limited by codecs and supports poor audio quality. Therefore, users often choose to support private 2.4G protocols for wireless transmission of audio data. Compared with the standard Bluetooth protocol, the private 2.4G protocol can be deeply customized according to the needs of specific applications, providing more flexible transmission rates, lower latency, and more streamlined system costs. In addition, the private 2.4G protocol can achieve stronger and more stable connection performance than the 2.4G wireless connection technology, with advantages such as millisecond-level response technology, plug-and-play, low power consumption, longer transmission distance, and suitable for high-speed data transmission scenarios. These advantages make the private 2.4G protocol in specific fields, such as high-performance wireless mouse, remote control toys, etc. This application uses a customized private protocol to achieve the transmission of audio data in the live broadcast scene, ensuring the real-time transmission.

[0033] In some embodiments, in order to simplify the live broadcast system, the client 16 can be installed in the accompaniment device 14. For example, the accompaniment device 14 can be a personal terminal such as a mobile phone or a tablet, and the client 16 can be installed on the personal terminal. Thus, the accompaniment audio can be provided through one device, and the remote setting of the audio adjustment parameters can be realized.

[0034] In some embodiments, in order to facilitate users to remotely adjust the sound effects of the mixed data, such as Figure 4As shown, the live broadcast system may also include a wireless controller 17 wirelessly connected to the sound card device 12. The wireless controller 17 may be a hardware device that facilitates the user to adjust the sound effects. For example, the wireless controller 17 may include control components such as joysticks and buttons. The user may touch these control components to issue sound effect adjustment instructions to the sound card device 12 to adjust the sound effects of the mixed data. The wireless controller 17 may obtain the user's sound effect control instructions, and send the sound effect control instructions to the sound card device 12 through the second wireless transmission channel. The sound card device 12 may adjust the sound effects of the mixed data based on the sound effect control instructions, and then send them to the monitoring device 13 through the first wireless transmission channel, or output them to the live broadcast device 15. Considering that the sound effect data is usually pre-stored in the sound card device 12, the sound effect control only needs to control and adjust the sound effects, so the sound effect control instructions can be sent to the sound card device 12 through the second wireless transmission channel. In some embodiments, considering that the sound card device 12 is used as an audio data processing center, it needs to establish wireless connections with multiple devices and process multiple data channels. In order to improve its processing performance, such as Figure 5 As shown, the sound card device 12 may include two main control chips, and the first wireless transmission channel and the second wireless transmission channel are respectively integrated on the two main control chips. Considering that the two wireless transmission channels can work at the same time, in order to reduce the interference of the two wireless transmission channels to the other wireless transmission channel during operation, any of the two main control chips can determine the working channel of the wireless transmission channel integrated in itself based on the working channel of the wireless transmission channel integrated on the other main control chip. For example, assuming that the sound card device 12 includes a main control chip 1 and a main control chip 2, the first wireless transmission channel is integrated on the main control chip 1, and the second wireless transmission channel is integrated on the main control chip 2. In order to avoid the first wireless transmission channel from interfering with the second wireless transmission channel, when determining the current working channel of the second wireless transmission channel, the main control chip 2 can first obtain the channel identifier of the current working channel of the first wireless transmission channel from the main control chip 1 (assuming it is channel A), and then can determine the working channel of the second wireless transmission channel based on channel A, and the working channel is a channel that will not interfere with channel A as much as possible.

[0035] The entire wireless communication frequency band can be roughly divided into three frequency bands, one is the frequency band where the main interference source is located, that is, the frequency band range of 2.40G~2.44G, one is the frequency band where the first wireless transmission channel works, that is, the frequency band range of 2.44G~2.46G with a total of 10 optional working channels, and one is the frequency band where the second transmission channel works, that is, the frequency band range of 2.46G~2.48G with a total of 10 optional working channels. Since the working environments of the two wireless transmission channels are basically the same, the interference sources are basically similar. Therefore, the channel intervals of the working channels applicable to the two wireless transmission channels are also basically the same. Since wireless communication protocols usually specify the scanning and processing of surrounding signal interference by devices through mechanisms such as adaptive frequency hopping, interference detection, continuous channel monitoring, and signal strength detection, so as to ensure that wireless devices can maintain stable connection and communication quality in complex wireless environments, the sound card device can estimate the channel where the main interference source is located by scanning the surrounding signals based on the scanning mechanism specified in these protocols, and then reallocate the working channels of the two wireless transmission channels according to the frequency band of the interference source, as far away from the interference source as possible, and the interval between the working channels of the two wireless transmission channels is not easy to cause adjacent channel interference, so that the first wireless transmission channel and the second wireless transmission channel can work simultaneously without interfering with each other. In some embodiments, in order to reduce the channel interference between the first wireless transmission channel and the second wireless transmission channel, the number of channels between the working channels of the first wireless transmission channel and the working channels of the second wireless transmission channel is greater than the preset number threshold. That is, the working channels of the two wireless transmission channels should not take adjacent channels as much as possible, but there is a certain degree of isolation to minimize the interference between the two.

[0036] In some embodiments, when the working channel of the first wireless transmission channel is switched to a new channel, the working channel of the second wireless transmission channel is also switched to another new channel. When the frequency hopping process is triggered in either the first wireless transmission channel or the second wireless transmission channel, the main control chip 1 or 2 can identify the distribution of the main interference channels according to the strength of the interference signal, and identify the available idle channels, and divide the idle channels into two relatively isolated available channel intervals, and respectively allocate them to the first wireless transmission channel and the second wireless transmission channel as the preferred frequency bands for frequency hopping, so as to achieve the purpose of working independently of each other.

[0037] In addition, the embodiment of the present application also provides a sound card device 12, such as Figure 6As shown, the sound card device 12 is wirelessly connected to the audio acquisition device 11, the monitoring device 13, and the accompaniment device 14 respectively, and the sound card device 12 includes a first wireless transmission channel and a second wireless transmission channel, wherein the sound card device 12 may include two wireless modules (such as the wireless module 1 and the wireless module 2 in the figure), and the first wireless transmission channel and the second wireless transmission channel may be implemented by two wireless modules respectively. The first wireless transmission channel and the second wireless transmission channel work based on different wireless transmission protocols, and the transmission delay of the first wireless transmission channel is lower than the transmission delay of the second wireless transmission channel; the sound card device 12 is used to receive the voice data of the live broadcast user collected by the audio acquisition device 11 through the first wireless transmission channel, receive the accompaniment audio sent by the accompaniment device 14 through the second wireless transmission channel, mix the voice data and the accompaniment audio to obtain mixed data, and send the mixed data to the monitoring device 13 through the first wireless transmission channel so that the monitoring device 13 plays the mixed data; and output the mixed data to the live broadcast device 15.

[0038] In some embodiments, the first wireless transmission channel implements data transmission based on a user-defined private protocol, and the second wireless transmission channel implements data transmission based on an existing standard wireless transmission protocol.

[0039] In some embodiments, the existing standard wireless transmission protocol includes a Bluetooth protocol.

[0040] In some embodiments, the sound card device 12 includes two main control chips, and the first wireless transmission channel and the second wireless transmission channel are respectively integrated on the two main control chips. Any of the two main control chips can determine the working channel of the wireless transmission channel integrated in itself based on the working channel of the wireless transmission channel integrated on the other main control chip.

[0041] In some embodiments, the number of channels spaced between the working channel of the first wireless transmission channel and the working channel of the second wireless transmission channel is greater than a preset number threshold.

[0042] Among them, the specific structure and function implementation of the sound card device 12 can refer to the introduction of the sound card device 12 in the above-mentioned live broadcast system, which will not be repeated here.

[0043] In addition, an embodiment of the present application also provides an audio acquisition device 11, which can implement the functions of the audio acquisition device 11 in the live broadcast system introduced in the above embodiment.

[0044] In addition, the embodiment of the present application also provides a monitoring device 13, which can implement the functions of the monitoring device 13 in the live broadcast system introduced in the above embodiment.

[0045] In some embodiments, the monitoring device may be a Bluetooth headset that supports a customized private 2.4G protocol and a Bluetooth protocol.

[0046] Due to the high real-time requirements in live broadcasting and other scenarios, it is necessary to ensure low latency and high-quality audio quality of recording, while also taking into account low power consumption, transmission distance and anti-interference performance. The A2DP (Advanced Audio Distribution Profile) used in the standard Bluetooth protocol still has a relatively large latency, and the HFP (Hands-free Profile) protocol is limited by the codec and supports poor audio quality. Therefore, users often choose to support the private 2.4G protocol for wireless transmission of audio data. Compared with the standard Bluetooth protocol, the private 2.4G protocol can be deeply customized according to the needs of specific applications, providing more flexible transmission rates, lower latency, and more streamlined system costs. In addition, the private 2.4G protocol can be more powerful and stable in connection performance than the 2.4G wireless connection technology, with advantages such as millisecond-level response technology, plug-and-play, low power consumption, longer transmission distance, and suitable for high-speed data transmission scenarios. These advantages make the private 2.4G protocol in specific fields, such as high-performance wireless mouse, remote control toys and other applications. This application innovatively proposes to apply a Bluetooth headset that supports a private 2.4G protocol and a Bluetooth protocol to a monitoring device. The headset can work based on a custom 2.4G protocol in a live broadcast scenario and be used as a monitoring headset. In ordinary scenarios, it can be used as an ordinary Bluetooth headset.

[0047] In order to further introduce the live broadcast system provided by the embodiment of the present application, a specific embodiment is introduced below.

[0048] In traditional personal live broadcast systems, microphones, monitoring headphones, mobile phones for providing accompaniment audio and other devices all need to be connected to the sound card device through wires, making the construction of the live broadcast system very cumbersome, especially when outdoor live broadcast scenarios are not used. Based on this, in this embodiment, the wired connection of the microphone, monitoring headphones, mobile phones for providing accompaniment audio and the sound card device is changed to a wireless connection, which can greatly reduce the complexity of carrying equipment when individuals travel, as well as the complexity of building the live broadcast system.

[0049] like Figure 7As shown, it is a schematic diagram of the live broadcast system of this embodiment. Considering that the mobile phone and other devices providing accompaniment audio and installing the APP for implementing the setting of sound effect adjustment parameters are devices produced by third-party manufacturers, in order to establish a wireless connection with these devices, general WiFi, Bluetooth and other protocols can be used. In order to save power consumption, the Bluetooth protocol is selected in this embodiment. Due to the large delay of the classic Bluetooth protocol A2DP, the audio quality supported by the HFP protocol due to codec restrictions is poor, but the wireless microphone 21 and the monitoring headset 23 need to ensure low delay and high-quality audio quality for recording and monitoring, and at the same time, it is also necessary to take into account low power consumption, transmission distance and anti-interference performance. The audio data transmission between the wireless microphone 21 and the monitoring headset 23 and the sound card device 22 is not suitable for using the Bluetooth protocol. Therefore, the wireless microphone 21, the monitoring headset 23 and the sound card device 22 can use a custom 2.4G private protocol for wireless transmission of audio data, and the transmission delay of the custom 2.4G private protocol is lower than the transmission delay of the Bluetooth protocol.

[0050] In order to enable the sound card device 22 to achieve wireless connection with the above-mentioned multiple devices, the sound card device 22 includes two wireless transmission modules, corresponding to two wireless transmission channels RF1 and RF2 respectively. RF1 works on the 2.4G private wireless protocol, and RF2 works on the standard wireless Bluetooth protocol. The sound card device 22 can transmit data between the monitoring headset 23 and the wireless microphone 21 through RF1, and can transmit data between the wireless controller and the mobile phone A24 (providing accompaniment audio and installed with an APP for setting sound effect adjustment parameters) through RF2. Since the two wireless transmission channels work at the same time, in order to avoid mutual interference between the channels of the two, in addition to doing the best possible wireless isolation in hardware design, relevant wireless frequency hopping strategies are also designed at the software level. The two wireless transmission channels are integrated on different main control chips. When RF1 currently needs to hop frequency to deal with external interference, RF1 can obtain the current working frequency band of RF2, so as to stagger with the working frequency band of RF2, thereby reducing the possibility of mutual interference as much as possible and ensuring the reliability of wireless communication.

[0051] The workflow of the entire live broadcast system is as follows: (1) RF1 of the sound card device 22 is paired with the wireless microphone 21 and the monitoring headset 23 using the 2.4G private protocol, and RF2 of the sound card device 22 is paired with the mobile phone and the wireless controller using the Bluetooth standard protocol.

[0052] (2) The wireless microphone 21 collects voice data, encodes it and sends it.

[0053] The wireless microphone 21 collects the host's voice data. In order to ensure the reliability of wireless transmission and take into account low latency and high-quality audio quality, the voice data can be encoded using the LC3+ encoding method, and the encoded voice data is sent to the sound card device 22 via RF1.

[0054] (3) The sound card device 22 receives the accompaniment audio and the sound effect adjustment parameters sent by the mobile phone A 24 , mixes the voice data and the accompaniment audio, and processes the mixed data based on the sound effect adjustment parameters.

[0055] In order to facilitate users to adjust the sound effects remotely, an APP is installed in the mobile phone A24, which can be used to set the sound effect adjustment parameters. The sound card device 22 receives the accompaniment audio sent by the mobile phone A24 and the sound effect adjustment parameters sent by the APP in the mobile phone A24 through RF2, decodes the accompaniment audio, mixes it with the voice data, and adjusts the sound effect of the mixed data based on the received sound effect adjustment parameters.

[0056] (4) The sound card device 22 receives the sound effect control instruction sent by the wireless controller 26 to adjust the sound effect of the mixed data.

[0057] In order to facilitate the user to adjust the sound effect, the live broadcast system may also include a wireless controller 26, and the user can issue a sound effect control instruction through the wireless controller 26. The sound card device 22 receives the sound effect control instruction sent by the wireless controller 26 through RF2 to adjust the sound effect and volume of the mixed data.

[0058] (5) The sound card device 22 outputs the processed mixed audio data in two ways, one way is sent to the monitoring earphone 23 via RF1, and the other way is output to the mobile phone B25 as the audio of the live video stream.

[0059] (6) The monitoring earphone 23 decodes the mixed audio data.

[0060] After receiving the mixed audio data sent by the sound card device 22, the monitoring earphone 23 decodes and plays the mixed audio data so that the user can monitor whether there is any audio abnormality during the live broadcast process.

[0061] Among them, the solutions of the above-mentioned embodiments can be freely combined to obtain new solutions when there is no conflict. Due to space constraints, they will not be listed one by one here.

[0062] In addition, an embodiment of the present application also provides an audio acquisition device, which is used to perform the functions of the audio acquisition device in the live broadcast system introduced in the above embodiment.

[0063] In addition, an embodiment of the present application also provides a monitoring device, which is used to implement the functions of the monitoring device in the live broadcast system introduced in the above embodiment.

[0064] In addition, an embodiment of the present application also provides a computer program product, which includes a computer program, and when the computer program is executed, it implements the functions of the client in the live broadcast system introduced in the embodiment.

[0065] Correspondingly, an embodiment of the present application also provides a computer storage medium, in which a program is stored. When the program is executed by a processor, the functions of the client in the live broadcast system introduced in any of the above embodiments are implemented.

[0066] The embodiments of the present application may take the form of a computer program product implemented on one or more storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing program code. Computer-usable storage media include permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be a computer-readable instruction, a data structure, a module of a program, or other data. Examples of computer storage media include but are not limited to: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0067] For the device embodiment, since it basically corresponds to the method embodiment, the relevant parts can refer to the partial description of the method embodiment. The device embodiment described above is only schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative work.

[0068] The user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0069] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. The terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "comprises a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0070] The method and device provided in the embodiments of the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of the present application should not be understood as a limitation on the present application.

Claims

1. A live broadcast system, characterized in that: The live broadcast system comprises an audio acquisition device, a sound card device, and a monitoring device. The audio acquisition device and the monitoring device are wirelessly connected to the sound card device respectively, and the sound card device is also wirelessly connected to the accompaniment device; the sound card device comprises a first wireless transmission channel and a second wireless transmission channel; the first wireless transmission channel and the second wireless transmission channel work based on different wireless transmission protocols, and the transmission delay of the first wireless transmission channel is lower than the transmission delay of the second wireless transmission channel; The audio acquisition device is used to collect voice data of live broadcast users and send it to the sound card device through the first wireless transmission channel; The sound card device is used to receive the accompaniment audio sent by the accompaniment device through the second wireless transmission channel, mix the voice data and the accompaniment audio to obtain mixed data, and send the mixed data to the monitoring device through the first wireless transmission channel; and for outputting the mixed audio data to a live broadcast device; The monitoring device is used to play the mixed sound data so that the live broadcast user can monitor the mixed sound data.

2. The live broadcast system according to claim 1, characterized in that: The live broadcast system further includes a client wirelessly connected to the sound card device, and the client is used to send the sound effect adjustment parameters set by the user to the sound card device through the second wireless transmission channel; After the sound card device mixes the voice data and the accompaniment audio to obtain mixed data, it is further used to perform sound effect adjustment processing on the mixed data based on the sound effect adjustment parameter, and then send the mixed data after the sound effect adjustment processing to the monitoring device through the first wireless transmission channel, and output it to the live broadcast device; or Before the sound card device performs mixing processing on the voice data and the accompaniment audio to obtain mixed data, it is also used to perform sound effect adjustment processing on the voice data and / or accompaniment audio based on the sound effect adjustment parameters, and then performs mixing processing to obtain mixed data, and sends it to the monitoring device through the first wireless transmission channel, and outputs it to the live broadcast device.

3. The live broadcast system according to claim 1 or 2, characterized in that: The first wireless transmission channel implements data transmission based on a user-defined private protocol, and the second wireless transmission channel implements data transmission based on an existing standard wireless transmission protocol.

4. The live broadcast system according to claim 3, characterized in that: The existing standard wireless transmission protocol includes the Bluetooth protocol, and the customized private protocol is a private 2.4G protocol.

5. The live broadcast system according to claim 1, characterized in that: The live broadcast system also includes a wireless controller wirelessly connected to the sound card device, the wireless controller is used to obtain the user's sound effect control instructions, and send the sound effect control instructions to the sound card device through the second wireless transmission channel; the sound card device is used to adjust the sound effect of the mixed data based on the sound effect control instructions, and then send it to the monitoring device through the first wireless transmission channel, and output it to the live broadcast device.

6. The live broadcast system according to claim 1, characterized in that: The sound card device includes two main control chips, the first wireless transmission channel and the second wireless transmission channel are respectively integrated on the two main control chips, and any one of the two main control chips determines the working channel of the wireless transmission channel integrated in itself based on the working channel of the wireless transmission channel integrated on the other main control chip.

7. The live broadcast system according to claim 6, characterized in that: The number of channels separated between the working channel of the first wireless transmission channel and the working channel of the second wireless transmission channel is greater than a preset number threshold.

8. A sound card device, characterized in that: The sound card device is wirelessly connected to the audio acquisition device, the monitoring device, and the accompaniment device respectively, and the sound card device includes a first wireless transmission channel and a second wireless transmission channel. The first wireless transmission channel and the second wireless transmission channel work based on different wireless transmission protocols, and the transmission delay of the first wireless transmission channel is lower than the transmission delay of the second wireless transmission channel. The sound card device is used to receive the voice data of the live broadcast user collected by the audio collection device through the first wireless transmission channel, receive the accompaniment audio sent by the accompaniment device through the second wireless transmission channel, mix the voice data and the accompaniment audio to obtain mixed data, and send the mixed data to the monitoring device through the first wireless transmission channel, so that the monitoring device plays the mixed data; And used to output the mixed audio data to a live broadcast device.

9. The sound card device according to claim 8, characterized in that: The first wireless transmission channel implements data transmission based on a user-defined private protocol, and the second wireless transmission channel implements data transmission based on an existing standard wireless transmission protocol.

10. The sound card device according to claim 8, characterized in that: The sound card device includes two main control chips, the first wireless transmission channel and the second wireless transmission channel are respectively integrated on the two main control chips, and any one of the two main control chips determines the working channel of the wireless transmission channel integrated in itself based on the working channel of the wireless transmission channel integrated on the other main control chip.

11. The sound card device according to claim 10, characterized in that: The number of channels separated between the working channel of the first wireless transmission channel and the working channel of the second wireless transmission channel is greater than a preset number threshold.

12. The device according to claim 10, characterized in that When the working channel of the first wireless transmission channel is switched to a new channel, the working channel of the second wireless transmission channel is also switched to another new channel.

13. An audio acquisition device, characterized in that: The audio acquisition device is used to implement the functions of the audio acquisition device in the live broadcast system described in any one of claims 1-7.

14. A monitoring device, characterized in that: The monitoring device is used to implement the functions of the monitoring device in the live broadcast system described in any one of claims 1-7 above.

15. The monitoring device according to claim 14, characterized in that The monitoring device includes a Bluetooth headset, and the Bluetooth headset supports a customized private 2.4G protocol and a Bluetooth protocol.

16. A computer program product, characterized in that The computer program product includes a computer program, and when the computer program is executed, the functions of the client in the live broadcast system described in claim 2 are realized.

17. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed, the functions of the client in the live broadcast system described in claim 2 are implemented.

Images