Audio livestreaming method and apparatus, audio processing method and apparatus, and storage medium

Abstract

The present application discloses an audio livestreaming method and apparatus, an audio processing method and apparatus, and a storage medium. The audio livestreaming method is applied to a livestreaming device, and comprises: generating an audio to be pushed, which is configured to be pushed to a livestreaming platform; writing first audio data of said audio into a first device file, wherein the first device file corresponds to a first microphone device associated with a livestreaming application program; and using the livestreaming application program to read the first audio data from the first device file by means of an operating system, and transmitting the first audio data to the livestreaming platform, wherein the livestreaming application program corresponds to the livestreaming platform.

Description

Audio live broadcast and audio processing method, device and storage medium Technical Field

[0001] The present application relates to the field of live broadcast technology, and in particular to an audio live broadcast and audio processing method, device and storage medium. Background Art

[0002] Currently, with the advancement of network communication technology, live streaming has been increasingly developed and applied. Live streaming devices for live streaming have been proposed to generate push audio based on audio data from different audio sources and push it to a live streaming platform.

[0003] In reality, users of live streaming devices, i.e., broadcasters, are often deeply tied to various live streaming platforms. Therefore, it is inevitable that when using live streaming devices, broadcasters want to use their desired live streaming applications (where live streaming applications correspond to live streaming platforms) to broadcast live, so that the pushed audio can be pushed to the desired live streaming platform. However, since existing live streaming applications (such as the Douyin application and the Kuaishou application) are all developed for tablet devices such as mobile phones, the live streaming applications obtain audio from the tablet device's microphone by default.

[0004] In this case, even if the live broadcasting application corresponding to the live broadcasting platform (such as the Douyin application and the Kuaishou application) is installed on the live broadcasting device, the live broadcasting application cannot push the push audio generated by the live broadcasting device to the corresponding live broadcasting platform. Therefore, the anchor cannot push the push audio generated by the live broadcasting device to the desired live broadcasting platform through the desired live broadcasting application, and thus cannot use the live broadcasting device to perform audio live broadcast on the desired live broadcasting platform.

[0005] With respect to the technical problem in the above-mentioned prior art that the anchor personnel cannot push the push audio generated by the live broadcast device to the corresponding live broadcast platform through the desired live broadcast application, no effective solution has been proposed yet. Summary of the Invention

[0006] The embodiments of the present disclosure provide an audio live broadcast and audio processing method, device and storage medium to at least solve the technical problem in the prior art that the host cannot push the push audio generated by the live broadcast device to the corresponding live broadcast platform through the desired live broadcast application.

[0007] According to one aspect of an embodiment of the present disclosure, a method for live audio broadcasting is provided, including: generating push audio for pushing to a live broadcasting platform; writing first audio data of the push audio into a first device file, wherein the first device file corresponds to a first microphone device associated with a live broadcasting application; and using the live broadcasting application to read the first audio data from the first device file via an operating system, and transmitting the first audio data to the live broadcasting platform, wherein the live broadcasting application corresponds to the live broadcasting platform.

[0008] According to another aspect of an embodiment of the present disclosure, an audio processing method is also provided, including: generating push audio for pushing to a live broadcast platform; and writing first audio data of the push audio into a first device file configured by an operating system, wherein the first device file corresponds to a first microphone device associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform.

[0009] According to another aspect of an embodiment of the present disclosure, a storage medium is further provided, the storage medium including a stored program, wherein when the program is run, a processor executes any one of the above methods.

[0010] According to another aspect of an embodiment of the present disclosure, an audio live broadcast device is also provided, including: a first push audio generation module, used to generate push audio for pushing to a live broadcast platform; a first push audio writing module, used to write the first audio data of the push audio into a first device file, wherein the first device file corresponds to the first microphone device associated with the live broadcast application; and a first audio data reading module, used to use the live broadcast application to read the first audio data from the first device file via the operating system, and transmit the first audio data to the live broadcast platform, wherein the live broadcast application corresponds to the live broadcast platform.

[0011] According to another aspect of an embodiment of the present disclosure, an audio processing device is also provided, including: a second push audio generation module, used to write the first audio data of the push audio into a first device file configured by an operating system, wherein the first device file corresponds to a first microphone device associated with a live broadcast application, and the live broadcast application corresponds to a live broadcast platform.

[0012] According to another aspect of an embodiment of the present disclosure, an audio live broadcast device is also provided, including: a first processor; and a first memory, connected to the first processor, for providing the first processor with instructions for processing the following processing steps: generating push audio for pushing to a live broadcast platform; writing the first audio data of the push audio into a first device file, wherein the first device file corresponds to the first microphone device associated with the live broadcast application; and using the live broadcast application to read the first audio data from the first device file via the operating system, and transmitting the first audio data to the live broadcast platform, wherein the live broadcast application corresponds to the live broadcast platform.

[0013] According to another aspect of an embodiment of the present disclosure, an audio processing device is also provided, including: a second processor; and a second memory connected to the second processor, for providing the second processor with instructions for processing the following processing steps; generating push audio for pushing to a live broadcast platform; and writing the first audio data of the push audio into a first device file configured by an operating system, wherein the first device file corresponds to a first microphone device associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform.

[0014] This application provides an audio live streaming method, which is applied to a live streaming device. First, an audio processing application generates push audio for pushing to a live streaming platform. Then, the audio processing application writes first audio data of the push audio to a first device file. The first device file corresponds to a first microphone device associated with the live streaming application. Finally, the live streaming application reads the first audio data from the first device file via an operating system and transmits the first audio data to the live streaming platform. The live streaming application corresponds to the live streaming platform.

[0015] Since the first device file in this application corresponds to the first microphone device associated with the live broadcast application, and the live broadcast application corresponds to the live broadcast platform, after the operating system receives the request sent by the live broadcast application to obtain data from the first microphone device, the operating system directly reads the corresponding data from the first device file and sends the read data to the live broadcast application.

[0016] Furthermore, since this application writes the first audio data of the pushed audio into the first device file, the data read by the operating system from the first device file is the first audio data of the pushed audio. Thus, after the operating system sends the first audio data to the live broadcast application, the live broadcast application transmits the first audio data to the live broadcast platform. Thus, the audience user can listen to the live broadcast audio corresponding to the pushed audio on the corresponding live broadcast platform through the terminal device.

[0017] This achieves the technical effect of ensuring that the anchor can use the desired live broadcast platform for live broadcasting, thereby solving the technical problem in the prior art that the anchor cannot push the push audio generated by the live broadcast device to the corresponding live broadcast platform through the desired live broadcast application. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The drawings described herein are used to provide a further understanding of the present disclosure and constitute a part of this application. The illustrative embodiments of the present disclosure and their descriptions are used to explain the present disclosure and do not constitute an improper limitation of the present disclosure. In the drawings:

[0019] FIG1 is a schematic diagram of an audio live broadcast system and multiple live broadcast platforms according to Example 1 of the present application;

[0020] FIG2 is a schematic diagram of the hardware modules of the audio live broadcast system and multiple live broadcast platforms according to Example 1 of the present application;

[0021] FIG3 is a schematic diagram of the hierarchical relationship structure of the audio live broadcast system according to Example 1 of the present application;

[0022] FIG4 is a flow chart of the audio live broadcast method according to Example 1 of the present application;

[0023] FIG5 is a flowchart of the audio processing method according to Embodiment 1 of the present application;

[0024] FIG6 is a schematic diagram of an audio live broadcast device according to Example 2 of the present application;

[0025] FIG7 is a schematic diagram of an audio processing device according to Embodiment 2 of the present application;

[0026] FIG8 is a schematic diagram of an audio live broadcast device according to Example 3 of the present application; and

[0027] FIG9 is a schematic diagram of an audio processing device according to Embodiment 3 of the present application. DETAILED DESCRIPTION

[0028] In order to enable those skilled in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present disclosure.

[0029] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0030] First, some nouns or terms that appear in the description of the embodiments of the present disclosure are subject to the following explanations:

[0031] Push audio: The push audio described in the present invention refers to the audio generated by the live broadcast device and sent to the live broadcast platform for live broadcast.

[0032] Live audio: The live audio described in the present invention refers to the audio corresponding to the pushed audio sent by the live broadcast platform to the terminal devices of each audience user.

[0033] Live streaming device: The live streaming device described in this invention refers to a device with live streaming functionality, which refers to the ability to send generated push audio to a live streaming platform. Therefore, live streaming devices in this invention also include computers, mobile phones, tablets, etc. that have live streaming applications installed.

[0034] Example 1

[0035] According to this embodiment, an embodiment of a method for audio live broadcast and audio processing is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0036] Figure 1 is a schematic diagram of an audio live broadcast system and multiple live broadcast platforms according to Example 1 of the present application. Referring to Figure 1 , the audio live broadcast system includes: a live broadcast device 100 and multiple different types of audio sources 201-204.

[0037] As shown in reference figure 1, audio sources 201 to 203 can be connected to the live broadcast device 100 through corresponding audio source input interfaces, for example. The audio source 204 can also be connected to the live broadcast device 100 for communication (wherein, the network used by the audio source 204 to communicate with the live broadcast device 100 includes but is not limited to a mobile communication network, a wireless network, etc.). In addition, although not shown in Figure 1, for example, an audio source 205 provided inside the live broadcast device 100 can also be included. And the audio sources 201 to 205 can include, for example, a 3.5 microphone 201, a computer 202, a USB microphone 203, and a mobile phone 204. It is worth noting that those skilled in the art should understand that the above are only examples of the types of audio sources and the connection methods of the audio sources and the live broadcast device 100, and the actual situation is not limited to this.

[0038] In addition, as shown in Figure 1, multiple live broadcast platforms 301 to 30n are also included. After generating the push audio, the processor in the live broadcast device 100 transmits the first audio data corresponding to the push audio to the live broadcast platforms 301 to 30n. Thus, the audience user can listen to the live broadcast audio corresponding to the push audio from the corresponding live broadcast platform 301 to 30n through the terminal device. Among them, the live broadcast platform can be, for example, the Douyin live broadcast platform, the Kuaishou live broadcast platform, and the Huya live broadcast platform.

[0039] It is worth noting that, although not shown in FIG1 , the audio source may also be, for example, audio stored locally in the live broadcast device 100 or network audio accessed by the processor in the live broadcast device 100 through a link address, etc., and no specific limitation is made here.

[0040] FIG2 is a schematic diagram of the hardware modules of the audio live broadcast system and multiple live broadcast platforms according to Example 1 of the present application. Referring to FIG2 , a 3.5 microphone 201 is connected to the processor 110 in the live broadcast device 100 via an audio codec 111; a computer 202 is connected to the processor 110 in the live broadcast device 100 via an HDMI interface 112; a USB microphone 203 is connected to the processor 110 in the live broadcast device 100 via a USB interface 113; a mobile phone 204 is connected to the processor 110 in the live broadcast device 100 via a network communication circuit 114; and a built-in microphone 115 is also connected to the processor 110 via the audio codec 111.

[0041] Furthermore, as shown in FIG2 , the processor 110 in the live streaming device 100 is communicatively connected to the live streaming platforms 301 to 30n via the network communication circuit 114. This allows the first audio data corresponding to the pushed audio to be sent to the live streaming platforms 301 to 30n. Furthermore, although not shown in FIG2 , the processor 110 may also be communicatively connected to the live streaming platforms 301 to 30n via, for example, a mobile communication circuit.

[0042] It is worth noting that the processor 110 can send the first audio data to one live broadcast platform, or can send the first audio data to multiple different live broadcast platforms respectively, which is not specifically limited here.

[0043] Figure 3 is a schematic diagram of the hierarchical relationship of the audio live streaming system according to an embodiment of the present application. Referring to Figure 3 , the live streaming device 100 is deployed with an operating system and the hardware layer below the operating system. In this embodiment, Android is used as an example of an operating system. Furthermore, as shown in Figure 3 , the operating system includes a driver layer, a HAL layer, a service layer, a framework layer, and an application layer.

[0044] Among them, an audio processing application is deployed at the application layer. The audio processing application is used to generate push audio during the live broadcast process. In addition, multiple live broadcast applications 1 to n are also deployed at the application layer. Live broadcast applications 1 to n are used to transmit push audio to the corresponding live broadcast platform. Among them, live broadcast applications 1 to n can be, for example, live broadcast applications developed by third parties based on the Android system (for example, Douyin application and Kuaishou application, etc.).

[0045] Furthermore, a first device file may be deployed in the operating system (for example, the first device file may be / dev / snd / pcmC0D0c deployed in the / dev directory of the operating system). And wherein, "C0" indicates that the sound card ID is 0, "D0" indicates that the device ID is 0, and "c" indicates that it is used for recording. And in the case where the operating system is deployed with the first device file, the corresponding function can be used at the HAL layer to specify the first device file as the device file corresponding to the first microphone device associated with the live broadcast applications 1 to n. For example, the first microphone device associated with the live broadcast applications 1 to n is the microphone of a tablet device such as a mobile phone, so that the corresponding function can be used at the HAL layer to specify the first device file as the device file corresponding to the microphone associated with the live broadcast applications 1 to n. Thus, when the audio processing application writes audio data to the first device file, the live broadcast applications 1 to n can receive the audio data read from the first device file by the operating system.

[0046] In addition, a second device file may be deployed in the operating system of the live broadcast device 100 (for example, the second device file may be / dev / snd / pcmC0D0p deployed in the / dev directory of the operating system). "C0" indicates that the sound card ID is 0, "D0" indicates that the device ID is 0, and "p" indicates that it is used for playback. Therefore, as can be seen from the above, the first device file and the second device file correspond to the same virtual sound card.

[0047] In addition, although not shown in Figure 3, a virtual sound card driver is also deployed at the driver layer, so that the virtual sound card driver can generate a first device file corresponding to the second microphone device of the virtual sound card and a second device file corresponding to the virtual player device of the virtual sound card at the driver layer.

[0048] The operating system can also create a corresponding third device file at the driver layer based on the type of audio source input interface at the hardware layer. For example, the hardware layer includes audio codec 111, HDMI interface 112, and USB interface 113. For audio codec 111, regardless of whether audio codec 111 is connected to 3.5 microphone 201 or built-in microphone 115, the operating system will generate a corresponding third device file. The third device file can be, for example, / dev / snd / pcmC1D0c in the operating system's / dev directory. For HDMI interface 112, regardless of whether HDMI interface 112 is connected to computer 202, the operating system will generate a corresponding third device file. The third device file can be, for example, / dev / snd / pcmC2D0c in the operating system's / dev directory. For USB interface 113, the operating system will only generate a corresponding third device file if USB microphone 203 is connected to USB interface 113. The third device file can be, for example, / dev / snd / pcmC3D0c in the operating system's / dev directory.

[0049] In addition, it is worth noting that in this embodiment, Android is used as an example of an operating system for description, but those skilled in the art should be aware that other types of operating systems are also within the scope of protection of this application.

[0050] In the above operating environment, according to the first aspect of this embodiment, a method for live audio broadcasting and audio processing is provided, which is implemented by the processor 110 shown in Figure 2. Figure 4 shows a flow chart of the method. Referring to Figure 4, the method includes:

[0051] S402: Generate push audio for pushing to the live broadcast platform;

[0052] S404: Writing the first audio data of the pushed audio into a first device file, where the first device file corresponds to a first microphone device associated with the live broadcast application; and

[0053] S406: Using the live broadcast application to read the first audio data from the first device file via the operating system, and transmitting the first audio data to the live broadcast platform, wherein the live broadcast application corresponds to the live broadcast platform.

[0054] Specifically, first, when the host performs audio live broadcast, the host uses the live broadcast device 100 to generate push audio for pushing to the live broadcast platform (S402).

[0055] Furthermore, the live broadcast device 100 writes the generated first audio data of the pushed audio into the first device file deployed in the operating system (S404). As described above, the first device file can be / dev / snd / pcmC0D0c deployed in the / dev directory of the operating system. Thus, the live broadcast device 100 writes the generated first audio data of the pushed audio into the device file. In addition, with reference to the above, in this embodiment, the corresponding function can be used in advance at the HAL layer to specify the first device file as the device file corresponding to the first microphone device associated with the live broadcast application 1 to n. Specifically, in this embodiment, the live broadcast application (for example, the Douyin application and the Kuaishou application, etc.) is a live broadcast application developed by a third party based on a tablet device such as a mobile phone, and the live broadcast application obtains audio data from the microphone of the tablet device by default. Therefore, in this embodiment, the first microphone device corresponds to the default microphone of the live broadcast application. Furthermore, in this embodiment, the corresponding function can be used in advance at the HAL layer to specify the first device file as the device file corresponding to the microphone of the tablet device, so that the live broadcast application can read audio data from the first device file through the operating system. The above content will be described in detail later, so it will not be repeated here.

[0056] Finally, the live broadcast application reads the first audio data from the first device file via the operating system and transmits the first audio data to the live broadcast platform (S406). Referring to the above, since the first device file in this embodiment corresponds to the first microphone device associated with the live broadcast application, the live broadcast application can obtain the first audio data corresponding to the pushed audio from the first device file via the operating system and send the first audio data as pushed audio to the live broadcast platform.

[0057] Based on the content described in the background technology, it can be known that existing live broadcast applications (for example, vibrato application and Kuaishou application, etc.) are all developed based on tablet devices such as mobile phones, and the live broadcast application obtains audio data from the microphone of the tablet device by default. For example, when the anchor needs to perform audio live broadcast, the live broadcast application responds to the click operation of the anchor and sends a request to the operating system in the tablet device to obtain audio from the microphone. The operating system then responds to the request and reads the audio data collected by the microphone from the device file corresponding to the microphone. The operating system then sends the read audio data to the live broadcast application, so that the live broadcast application can generate push audio based on the audio data collected by the microphone and transmit the push audio to the broadcast platform.

[0058] Since existing live broadcast applications are all developed based on tablet devices, that is, the live broadcast applications obtain audio data from the microphone of the tablet device by default, even if the live broadcast application corresponding to the live broadcast platform (for example, the Douyin application and the Kuaishou application, etc.) is installed in the live broadcast device, the live broadcast application cannot push the push audio generated by the live broadcast device to the live broadcast platform desired by the anchor.

[0059] Therefore, in order to solve the above problem, this embodiment deploys a first device file in the operating system of the live broadcast device. The first device file corresponds to the first microphone device associated with the live broadcast application. The first microphone device can be, for example, the microphone device used by the live broadcast application by default (for example, the first microphone device corresponds to the microphone of the tablet device). Thus, the live broadcast application can obtain the first audio data corresponding to the pushed audio from the first device file through the operating system, and send the first audio data as pushed audio to the live broadcast platform.

[0060] Based on the above description, since the first device file corresponds to the first microphone device associated with the live broadcast application, no matter what the circumstances, as long as the operating system receives a request sent by the live broadcast application to obtain audio data from the first microphone device, the operating system will read the corresponding audio data from the pre-deployed first device file.

[0061] Thus, during a live broadcast, the live broadcast device can, for example, write the first audio data of the pushed audio to a first device file. The live broadcast application can, through the operating system, retrieve the first audio data corresponding to the pushed audio from the first device file and send the first audio data as pushed audio to the live broadcast platform. The host can then use the desired live broadcast application to send the pushed audio generated by the live broadcast device to the corresponding live broadcast platform, and the audience can watch the live audio corresponding to the pushed audio on the corresponding live broadcast platform through their terminal devices.

[0062] This achieves the technical effect of ensuring that anchors can use live broadcast equipment to broadcast live on the desired live broadcast platform. This also solves the technical problem in the prior art that anchors cannot send the push audio generated by the live broadcast equipment to the corresponding live broadcast platform through the desired live broadcast application.

[0063] Optionally, the first device file also corresponds to a second microphone device of a virtual sound card deployed on the live broadcast device, the second microphone device is a virtual microphone device, and the operation of writing the first audio data of the pushed audio to the first device file includes: writing the pushed audio to the second device file, wherein the second device file corresponds to the virtual player device of the virtual sound card; and using the virtual sound card to call the pushed audio from the second device file, and write the pushed audio to the first device file.

[0064] Specifically, since the device file for recording and the device file for playback are actually two different device files, the same device file cannot be used for both playback and recording. Therefore, in this embodiment, the driver layer of the operating system is deployed with a virtual sound card driver, which can generate a first device file corresponding to the virtual microphone device and a second device file corresponding to the virtual player device. For example, the first device file can be / dev / snd / pcmC0D0c deployed in the / dev directory of the operating system. And wherein, "C0" indicates that the sound card ID is 0, "D0" indicates that the device ID is 0, and "c" indicates that it is used for recording. For another example, the second device file can be / dev / snd / pcmC0D0p deployed in the / dev directory of the operating system. And wherein, "C0" indicates that the sound card ID is 0, "D0" indicates that the device ID is 0, and "p" indicates that it is used for playback.

[0065] As can be seen from the above content, the first device file and the second device file actually correspond to the same virtual sound card and are device files used for "recording" and "playing" respectively.

[0066] Thus, for example, a specific function can be used at the HAL layer to specify the first device file as the device file corresponding to the tablet device's microphone. Therefore, when the audio processing application writes the first audio data of the pushed audio to the second device file, the virtual sound card application retrieves the first audio data from the second device file and writes the first audio data to the first device file. Consequently, when the operating system receives a request from the live broadcast application to obtain audio data from the first microphone device, the operating system reads the first audio data from the first device file and sends the first audio data to the corresponding live broadcast application.

[0067] Since the device file for recording and the device file for playback are actually two different device files, the same device file cannot be used for both playback and recording. Therefore, in this embodiment, two first device files for recording and a second device file for playback corresponding to the same virtual sound card are set up at the driver layer. Therefore, when the audio processing application writes the first audio data to the second device file, the operating system can read the first audio data from the first device file corresponding to the second device file and send the first audio data to the live broadcast application associated with the live broadcast platform, thereby achieving the technical effect of ensuring that the anchor can use the live broadcast equipment to perform audio live broadcast normally.

[0068] Optionally, the operation of using the live broadcast application to read the first audio data from the first device file via the operating system includes: using the live broadcast application to send a request to the operating system to obtain data from the first microphone device; and using the live broadcast application to receive from the operating system the first audio data read by the operating system from the first device file.

[0069] Specifically, as shown in FIG3 , for example, when a live streamer uses live streaming device 100 to broadcast live via the live streaming platform corresponding to live streaming applications 1-n, live streaming applications 1-n on live streaming device 100 each send a request to the operating system to obtain audio data from their associated first microphone devices (e.g., the microphone of a tablet device). The operating system then responds to the data acquisition requests sent by live streaming applications 1-n by reading the first audio data from the first device file and sending the read first audio data to live streaming applications 1-n, respectively.

[0070] Therefore, in the technical solution of this application, the live broadcast device can be used to push audio to the corresponding live broadcast platform through any live broadcast application supported by the operating system. Therefore, for the anchor, only the desired live broadcast application needs to be installed in the operating system of the live broadcast device, and the live broadcast device can be used to broadcast on the live broadcast platform corresponding to the live broadcast application, thus facilitating the use of the anchor.

[0071] Optionally, the operation of generating push audio for pushing to the live broadcast platform includes: obtaining second audio data from at least one audio source, wherein at least one audio source includes a third microphone device different from the first microphone device and the second microphone device; and generating push audio based on the second audio data using an audio processing application.

[0072] Specifically, as shown in FIG3 , the audio processing application first obtains second audio data from at least one audio source. The at least one audio source includes a third microphone device that is different from the first and second microphone devices associated with the live broadcast application. Furthermore, the second audio data may be, for example, audio data obtained by the live broadcast device 100 from the at least one audio source and not yet processed by the audio processing application.

[0073] The at least one audio source mentioned above can be, for example, an external microphone connected to the live broadcast device 100, an external computer or a built-in microphone, audio locally stored on the live broadcast device 100, or network audio accessed by the live broadcast device 100 via a link address. In short, the at least one audio source mentioned above is a different audio source from the first microphone device associated with the live broadcast application and the second microphone device of the virtual sound card, and is not specifically limited here.

[0074] Thereafter, when the audio processing application obtains second audio data from at least one audio source, a push audio is generated based on the second audio data for pushing to the live broadcast platform.

[0075] Unlike existing anchors who can only generate push audio using live broadcast applications installed on mobile phones, tablets or computers, in the technical solution of this application, at least one audio source including a mobile phone, tablet computer or computer can be connected to the live broadcast device, so that the audio processing application can receive the second audio data transmitted by at least one audio source and generate push audio based on the second audio data.

[0076] Therefore, in the technical solution of the present application, the push audio used to push to the live broadcast platform contains richer audio information than the push audio directly generated by the live broadcast application installed on the mobile phone, tablet computer or computer, thereby achieving the technical effect of attracting audience users to listen to the live broadcast.

[0077] Optionally, the operation of obtaining the second audio data from the at least one audio source includes: using the operating system to read the second audio data from a third device file corresponding to the third microphone device.

[0078] Specifically, referring to FIG3 , first, the operating system automatically creates a corresponding third device file at the driver layer according to the type of the audio source input interface at the hardware layer, and writes the second audio data into the corresponding third device file.

[0079] In the case where the audio source input interface is an audio codec and / or an HDMI interface, the operating system will pre-generate a corresponding third device file regardless of whether the audio codec and / or HDMI interface is connected to the corresponding audio source. Furthermore, when the audio codec and / or HDMI interface is connected to the corresponding audio source, the operating system directly writes the received second audio data into the corresponding third device file.

[0080] For example, when the audio source input interface is the audio codec 111, and the audio codec 111 in the live broadcast device 100 is connected to 305 the microphone 201 and / or the built-in microphone 115, the operating system directly writes the received second audio data into the corresponding third device file 1.

[0081] For another example, when the audio source input interface is the HDMI interface 112 and the HDMI interface 112 of the live broadcast device 100 is connected to the computer 202, the operating system directly writes the received second audio data into the corresponding third device file 2.

[0082] Furthermore, when the audio source input interface is the USB interface 113, the operating system dynamically generates the third device file 3. That is, when the USB interface 113 is connected to the USB microphone 203, the operating system generates the corresponding third device file 3; when the USB interface 113 is not connected to the USB microphone 203, the operating system does not generate the corresponding third device file 3.

[0083] In addition, it is worth noting that when the second audio data corresponding to the mobile phone 204 is received in the live broadcast device 100 through the network communication circuit 114, the operating system directly writes the second audio data into the memory without generating a third device file.

[0084] If the live broadcast device 100 does not have an external audio source, and the second audio data transmitted to the audio processing application is audio locally stored on the live broadcast device 100 or audio accessed by the live broadcast device 100 via a link address, the operating system does not need to deploy a third device file at the driver layer. The operating system can directly send the second audio data of the locally stored audio or the second audio data of the network audio accessed via the link address to the audio processing application at the application layer.

[0085] It is worth noting that there can be one or more third device files.

[0086] For example, when there is an audio codec 111 or an HDMI interface 112 in the live broadcast device 100, the operating system pre-generates a corresponding third device file 1 or third device file 2. Then, the operating system writes the second audio data received through the audio codec 111 or the HDMI interface 112 into the corresponding third device file 1 or third device file 2.

[0087] For another example, when the live broadcast device 100 includes both an audio codec 111 and / or an HDMI interface 112, and a USB interface 113, the operating system pre-generates a third device file 1 and / or a third device file 2 corresponding to the audio codec 111 and / or the HDMI interface 112. Then, when the audio codec 111 is connected to the 3.5 microphone 201 and / or the HDMI interface 112 is connected to the computer 202, the operating system writes the corresponding second audio data into the pre-generated third device file 1 and / or the third device file 2. When the USB interface 113 is connected to the USB microphone 203, the operating system dynamically generates a corresponding third device file 3 and writes the second audio data received through the USB interface 113 into the corresponding third device file 3.

[0088] The operating system then reads the second audio data from the third device file corresponding to the third microphone device, and sends the second audio data to the audio processing application, so that the audio processing application performs mixing and / or fusion processing on the second audio data to generate push audio for pushing to the live broadcast platform.

[0089] In the technical solution of this application, since a third device file is deployed at the driver layer, the operating system can write the second audio data of at least one audio source external to the live broadcast device into the third device file. The operating system can then read the second audio data from the third device file and send the second audio data to the audio processing application. Therefore, when a live broadcaster needs to use an external audio source for live broadcasting, the audio processing application can obtain the second audio data from the external audio source, thereby ensuring that the live broadcaster can continue normally.

[0090] Optionally, before generating the push audio for pushing to the live broadcast platform, it also includes: using a virtual sound card driver to deploy a first device file and a second device file associated with the first device file in the operating system; and associating the first device file with the first microphone device in the operating system.

[0091] Specifically, as shown in FIG3 , before the audio processing application generates push audio for pushing to the live broadcast platform, a virtual sound card driver is deployed at the driver layer of the operating system (specifically, a virtual sound card driver is deployed at the driver layer).

[0092] The virtual sound card driver then generates a first device file and a second device file. The first device file is used to read the first audio data, and the second device file is used to write the first audio data. This allows the HAL layer to use corresponding functions to specify the first device file as the device file corresponding to the first microphone device associated with the live broadcast application.

[0093] Therefore, in the technical solution of the present application, when the live broadcast application sends a request to the operating system to obtain data from the first microphone device, the operating system reads the first audio data from the first device file and sends the first audio data to the live broadcast application. Therefore, for the anchor, only needs to send a live broadcast instruction to the live broadcast device 100 through the live broadcast application to start live broadcasting, thereby achieving the technical effect of facilitating anchors to use the live broadcast device for live broadcasting.

[0094] Thus, according to the first aspect of this embodiment, the technical effect of ensuring that the anchor can use the desired live broadcast platform for audio live broadcast is achieved.

[0095] Thus, during the live broadcast process, the live broadcast device 100 obtains the second audio data from the external microphone device and uses the operating system to write the second audio data to the third device file. Then, the operating system reads the second audio data from the third device file and sends the second audio data to the audio processing application. Thereafter, the audio processing application generates push audio based on the second audio data and writes the first audio data of the push audio to the second device file. At the same time, the operating system writes the first audio data in the second device file to the first device file. Furthermore, the live broadcast application sends a request to the operating system to obtain audio data from the respective associated first microphone devices. Then, in response to the request, the operating system reads the first audio data from the first device file and sends the first audio data to the live broadcast application. Finally, the live broadcast application sends the first audio data of the push audio to the corresponding live broadcast platform.

[0096] In addition, according to the second aspect of this embodiment, an audio processing method is provided, which is implemented by the processor 110 shown in Figure 2. Figure 5 shows a flow chart of the method. Referring to Figure 5, the method includes:

[0097] S502: Generate push audio for pushing to the live broadcast platform; and

[0098] S504: Writing the first audio data of the pushed audio into a first device file configured by the operating system, wherein the first device file corresponds to a first microphone device associated with the live broadcast application, and the live broadcast application corresponds to the live broadcast platform.

[0099] It is worth noting that, as described in the first aspect of the embodiment of the present application, the live broadcast device 100 can be pre-installed with a live broadcast application, so that the operating system can send the first audio data read from the first device file to the pre-installed live broadcast application, and the live broadcast application transmits the first audio data to the live broadcast platform. As described in the second aspect of the embodiment of the present application, the live broadcast device 100 may not have a live broadcast application pre-installed, and the live broadcast application may be downloaded during the audio live broadcast. For example, the live broadcast application may be downloaded after the live broadcast device 100 is connected to an external audio source; or the live broadcast application may be downloaded after the live broadcast device 100 calls the audio stored locally or accesses the network audio through a link address. No specific limitation is made here.

[0100] Therefore, according to the second aspect of this embodiment, the technical effect of ensuring that the anchor can use the desired live broadcast platform for audio live broadcast is achieved.

[0101] In addition, referring to FIG1 , according to a third aspect of this embodiment, a storage medium is provided, wherein the storage medium includes a stored program, wherein when the program is run, a processor executes any one of the above methods.

[0102] Therefore, according to this embodiment, the technical effect of ensuring that the anchor can use the desired live broadcast platform for audio live broadcast is achieved.

[0103] It should be noted that for the aforementioned method embodiments, for simplicity of description, they are all expressed as a series of action combinations. However, those skilled in the art should be aware that the present invention is not limited by the order of the actions described, because according to the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

[0104] Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus the necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0105] Example 2

[0106] FIG6 shows an audio live broadcast device 600 according to the first aspect of this embodiment, which corresponds to the method according to the first aspect of Example 1. Referring to FIG6 , the device 600 includes: a first push audio generation module 610, configured to generate push audio for pushing to a live broadcast platform; a first push audio writing module 620, configured to write first audio data of the push audio to a first device file, wherein the first device file corresponds to a first microphone device associated with a live broadcast application; and a first audio data reading module 630, configured to read the first audio data from the first device file via the operating system using the live broadcast application, and transmit the first audio data to the live broadcast platform, wherein the live broadcast application corresponds to the live broadcast platform.

[0107] Optionally, the first device file also corresponds to a second microphone device of a virtual sound card deployed on the live broadcast device, the second microphone device is a virtual microphone device, and the first push audio write module 620 includes: a first push audio write submodule, for writing the push audio to the second device file, wherein the second device file corresponds to the virtual player device of the virtual sound card; and a second push audio write submodule, for using the virtual sound card to call the push audio from the second device file and write the push audio to the first device file.

[0108] Optionally, the first audio data reading module 630 includes: a data request module, used to use the live broadcast application to send a request to the operating system to obtain data from the first microphone device; and a data receiving module, used to use the live broadcast application to receive the first audio data read by the operating system from the first device file from the operating system.

[0109] Optionally, the first push audio generation module 610 includes: a data acquisition module for acquiring second audio data from at least one audio source, wherein at least one audio source includes a third microphone device different from the first microphone device and the second microphone device; and a first push audio generation sub-module for generating push audio based on the second audio data using an audio processing application.

[0110] Optionally, the data acquisition module includes: a second audio data reading module, configured to read second audio data from a third device file corresponding to a third microphone device using an operating system.

[0111] Optionally, before generating push audio for pushing to the live broadcast platform, the device 600 also includes: a device file deployment module, which is used to deploy a first device file and a second device file associated with the first device file in the operating system using a virtual sound card driver; and a device file association module, which is used to associate the second device file with the first microphone device in the operating system.

[0112] In addition, FIG7 shows an audio processing device 700 according to the second aspect of this embodiment, which corresponds to the method according to the second aspect of Example 1. Referring to FIG7 , the device 700 includes: a second push audio generation module 710 for generating push audio for push to the live broadcast platform; and a second push audio writing module 720 for writing first audio data of the push audio to a first device file configured by the operating system, wherein the first device file corresponds to a first microphone device associated with the live broadcast application, and the live broadcast application corresponds to the live broadcast platform.

[0113] Therefore, according to this embodiment, the technical effect of ensuring that the anchor can use the desired live broadcast platform for audio live broadcast is achieved.

[0114] Example 3

[0115] FIG8 shows an audio live streaming device 800 according to the first aspect of this embodiment, which corresponds to the method according to the first aspect of Example 1. Referring to FIG8 , the device 800 includes: generating push audio for pushing to a live streaming platform; writing first audio data of the push audio to a first device file, where the first device file corresponds to a first microphone device associated with a live streaming application; and using the live streaming application to read the first audio data from the first device file via the operating system, and transmitting the first audio data to the live streaming platform, where the live streaming application corresponds to the live streaming platform.

[0116] Optionally, the first device file also corresponds to a second microphone device of a virtual sound card deployed on the live broadcast device, the second microphone device is a virtual microphone device, and the operation of writing the first audio data of the pushed audio to the first device file includes: writing the pushed audio to the second device file, wherein the second device file corresponds to the virtual player device of the virtual sound card; and using the virtual sound card to call the pushed audio from the second device file, and write the pushed audio to the first device file.

[0117] Optionally, the operation of using the live broadcast application to read the first audio data from the first device file via the operating system includes: using the live broadcast application to send a request to the operating system to obtain data from the first microphone device; and using the live broadcast application to receive from the operating system the first audio data read by the operating system from the first device file.

[0118] Optionally, the operation of generating push audio for pushing to the live broadcast platform includes: obtaining second audio data from at least one audio source, wherein at least one audio source includes a third microphone device different from the first microphone device and the second microphone device; and generating push audio based on the second audio data using an audio processing application.

[0119] Optionally, the operation of obtaining the second audio data from the at least one audio source includes: using the operating system to read the second audio data from a third device file corresponding to the third microphone device.

[0120] Optionally, before generating the push audio for pushing to the live broadcast platform, it also includes: using a virtual sound card driver to deploy a first device file and a second device file associated with the first device file in the operating system; and associating the second device file with the first microphone device in the operating system.

[0121] In addition, Figure 9 shows an audio processing device 900 according to the second aspect of this embodiment, which corresponds to the method described according to the second aspect of Example 1. Referring to Figure 9 , the device 900 includes: generating push audio for pushing to a live broadcast platform; and writing first audio data of the push audio to a first device file configured by the operating system, wherein the first device file corresponds to a first microphone device associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform.

[0122] Therefore, according to this embodiment, the technical effect of ensuring that the anchor can use the desired live broadcast platform for audio live broadcast is achieved.

[0123] The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.

[0124] In the above embodiments of the present invention, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0125] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0126] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0127] In addition, the functional units in the various embodiments of the present invention may be integrated into a single processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0128] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk, etc. Various media that can store program codes.

[0129] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as within the scope of protection of the present invention.

Claims

1. An audio live broadcast method, used for a live broadcast device, characterized in that: include: Generate push audio for pushing to the live broadcast platform; Writing the first audio data of the pushed audio into a first device file, wherein the first device file corresponds to a first microphone device associated with the live broadcast application; as well as The live broadcast application is used to read the first audio data from the first device file via the operating system, and the first audio data is transmitted to the live broadcast platform, wherein the live broadcast application corresponds to the live broadcast platform.

2. The method according to claim 1, characterized in that The first device file further corresponds to a second microphone device of a virtual sound card deployed on the live broadcast device, the second microphone device being a virtual microphone device, and the operation of writing the first audio data of the pushed audio into the first device file includes: Writing the pushed audio into a second device file, wherein the second device file corresponds to the virtual player device of the virtual sound card; and The pushed audio is called from the second device file using the virtual sound card, and the pushed audio is written into the first device file.

3. The method according to claim 2, characterized in that The operation of reading the first audio data from the first device file via the operating system using the live broadcast application includes: Using the live broadcast application, sending a request to the operating system to obtain data from the first microphone device; and The first audio data read from the first device file by the operating system is received from the operating system using the live broadcast application.

4. The method according to claim 3, characterized in that Generates the audio push operation for pushing to the live streaming platform, including: obtaining second audio data from at least one audio source, wherein the at least one audio source includes a third microphone device different from the first microphone device and the second microphone device; and The push audio is generated using an audio processing application based on the second audio data.

5. The method according to claim 1 or 4, characterized in that The operation of obtaining second audio data from at least one audio source includes: The second audio data is read from a third device file corresponding to the third microphone device using the operating system.

6. The method according to claim 1, characterized in that Before generating the push audio for pushing to the live broadcast platform, the method further includes: Deploying the first device file and a second device file associated with the first device file in the operating system using a virtual sound card driver; and The second device file is associated with the first microphone device in the operating system.

7. An audio processing method for a live broadcast device, characterized in that: include: Generate push audio for pushing to the live broadcast platform; as well as The first audio data of the pushed audio is written into a first device file configured by an operating system, wherein the first device file corresponds to a first microphone device associated with a live broadcast application, and the live broadcast application corresponds to the live broadcast platform.

8. A storage medium, characterized in that: The storage medium includes a stored program, wherein when the program is executed, the processor executes the method according to any one of claims 1 to 7.

9. An audio live broadcast device, characterized in that: include: A first push audio generation module, configured to generate push audio for pushing to a live broadcast platform; A first pushed audio writing module is configured to write first audio data of the pushed audio into a first device file, wherein the first device file corresponds to a first microphone device associated with the live broadcast application; as well as The first audio data reading module is used to use the live broadcast application to read the first audio data from the first device file via the operating system, and transmit the first audio data to the live broadcast platform, wherein the live broadcast application corresponds to the live broadcast platform.

10. An audio live broadcast device, characterized in that: include: a first processor; as well as A first memory is connected to the first processor and is configured to provide the first processor with instructions for processing the following processing steps: Generate push audio for pushing to the live broadcast platform; Writing the first audio data of the pushed audio into a first device file, wherein the first device file corresponds to a first microphone device associated with the live broadcast application; as well as The live broadcast application is used to read the first audio data from the first device file via the operating system, and the first audio data is transmitted to the live broadcast platform, wherein the live broadcast application corresponds to the live broadcast platform.

Images