A method and device for processing cloud director data of live stream signals

Abstract

The present invention discloses a method and device for processing cloud live streaming signal data. Among them, the method includes: a cloud service device receiving two or more live streaming signals and receiving instructions from a cloud director device; the cloud service device selecting a target live streaming signal according to the instructions of the cloud director device; the cloud service device unpacking the target live streaming signal into video data and audio data; the cloud service device performing decoding processing on the audio data; the cloud service device encapsulating the decoded audio data and the non-decoded video data; and the cloud service device sending the encapsulated decoded audio data and non-decoded video data to a user terminal. The method for processing cloud live streaming signal data disclosed by the present invention can effectively alleviate the problems of delay, picture freezing, and very easy occurrence of stream interruption during picture switching caused by live streaming through a cloud service device, and reduce the data processing volume of the cloud service device and the performance requirements for the cloud server.

Description

Technical Field

[0001] The present invention relates to the technical field of video live broadcast transmission, and particularly to a method and device for processing cloud live broadcast data of live stream signals. Background Art

[0002] With the development of cloud technology, it has become a new trend to use cloud live broadcast devices as live broadcast devices in the field of video live broadcast. A cloud live broadcast device is a video production and live broadcast tool based on cloud computing technology, which allows users to perform functions such as switching of live streams, picture-in-picture mixed stream broadcasting, recording and replay, and adding watermark text in the cloud.

[0003] Traditional live broadcast scenarios usually require expensive live broadcast vehicles, while cloud live broadcast only requires a computer to complete multiple professional live broadcasts, greatly reducing the hardware cost. Moreover, it has the advantages of automatically expanding resources according to needs without purchasing expensive hardware devices and being applicable to various live broadcast scenarios. Therefore, more and more companies use cloud live broadcast devices for video live broadcast.

[0004] During the cloud live broadcast process, when it comes to live broadcasts at multiple locations, such as Figure 1 As shown, the video sources in Xiamen, Shenzhen, and Barcelona usually need to send video streams to the cloud server through the RTMP protocol respectively. The cloud live broadcast device performs video stream switching or editing in the cloud, etc. Then, the cloud server uniformly sends the processed video stream to the playback terminal through the RTMP protocol. In this process, the cloud server needs to decode and encode the received video stream and then re-encode it before pushing the stream to the playback terminal. However, due to the large amount of calculation for video stream decoding and encoding, which consumes the performance of the CPU very much, and the cloud server does not have a hardware decoder and does not support hardware decoding, and can only rely on software decoding. When performing multi-channel video stream decoding, it is found that there is a delay phenomenon in the playback terminal, resulting in frame freezing of the picture. The original 1980P30-frame picture becomes 4 or 5 frames per second, and it is very easy to have a disconnection problem when switching the picture. For this reason, an attempt is made to upgrade the server to 8 cores and 16G. This configuration is already at a mid-to-high level in the server field, but the problem still cannot be solved. Summary of the Invention

[0005] To solve the above technical problems, the present invention provides a method and device for processing cloud live broadcast data of live stream signals, which can effectively alleviate the problems of delay, frame freezing of the picture, and very easy disconnection problem when switching the picture caused by live broadcast through cloud service devices, and greatly reduce the data processing volume of the cloud service device and the performance requirements for the cloud server.

[0006] An embodiment of the invention provides a method for processing cloud live broadcast data of live stream signals, and the method includes:

[0007] The cloud service device receives two or more live stream signals and the instructions of the cloud director device;

[0008] The cloud service device selects a target live stream signal according to the instructions of the cloud director device;

[0009] The cloud service device unpacks the target live stream signal into video data and audio data;

[0010] The cloud service device performs decoding processing on the audio data;

[0011] The cloud service device encapsulates the decoded audio data and the undecoded video data;

[0012] The cloud service device sends the encapsulated decoded audio data and undecoded video data to the user terminal.

[0013] Preferably, the cloud service device communicates with the live stream signal sender and the user terminal through the RTMP protocol.

[0014] Preferably, the decoding processing of the audio data uses at least one of the following decoders: Opus, AAC, MP3.

[0015] An embodiment of the present invention provides a method for processing cloud director data of a live stream signal. The method includes:

[0016] The user terminal receives the encapsulated data packet sent by the cloud service device. The encapsulated data is the audio data decoded by the cloud service device and the video data not decoded by the cloud server;

[0017] The user terminal unpacks the encapsulated data packet into audio data and video data;

[0018] The user terminal decodes the audio data and video data,

[0019] The user terminal plays the decoded audio data and video data.

[0020] An embodiment of the present invention provides a cloud service device. The cloud service device includes:

[0021] A first transmission unit for receiving two or more live stream signals;

[0022] An instruction interaction unit for receiving the instructions of the cloud director device;

[0023] A flow path control unit for selecting a target live stream signal according to the instructions of the cloud director device;

[0024] A first unpacking unit for unpacking the target live stream signal into video data and audio data;

[0025] An audio decoding and encoding unit for decoding and encoding the audio data;

[0026] An encapsulation unit for encapsulating the decoded audio data and the undecoded video data;

[0027] A second transmission unit for sending the encapsulated decoded audio data and the undecoded video data to a user terminal.

[0028] Preferably, both the first transmission unit and the second transmission unit communicate with a live stream signal sending end and a user terminal through the RTMP protocol.

[0029] Preferably, the audio decoding and encoding unit adopts at least one of the following decoders: Opus, AAC, MP3.

[0030] An embodiment of the present invention provides a user terminal, and the user terminal includes:

[0031] A third transmission unit for receiving an encapsulated data packet sent by a cloud service device, where the encapsulated data is decoded audio data and undecoded video data by the cloud service device;

[0032] A second de-encapsulation unit for de-encapsulating the encapsulated data packet into audio data and video data;

[0033] An audio decoding unit for decoding the audio data;

[0034] A video decoding unit for decoding the video data;

[0035] A playback unit for playing the decoded audio data and video data.

[0036] Preferably, the third transmission unit communicates with the cloud service device through the RTMP protocol.

[0037] Preferably, the audio decoding and encoding unit adopts at least one of the following decoders: Opus, AAC, MP3.

[0038] The live stream signal cloud director data processing method provided by the embodiment of the present invention, after unpacking the pulled live stream signal, only decodes the audio data and does not decode the video data. The video data is directly used for subsequent encapsulation and pushing together with the decoded audio data. In this embodiment, by not decoding the video data, the consumption of computing resources of the cloud service device is greatly reduced, and the picture delay and stuttering phenomenon of the playback terminal are greatly alleviated. Moreover, by encoding and encapsulating the audio data for transmission, it is possible to avoid the problem of live stream disconnection and the resulting disconnection and offline of the live terminal when the user terminal watches a live stream on, for example, WeChat Video. After testing, using the live stream signal cloud director data processing method in the embodiment of the present invention can stably conduct a live stream on a server with 2 cores and 4G of memory, and can reduce the CPU load rate to below 30%, greatly reducing the performance requirements of the cloud server. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] Figure 1 Schematic diagram of a multi-site live broadcast scenario;

[0040] Figure 2 Schematic block diagram of the live stream signal cloud director data processing method provided by the embodiment of the present invention;

[0041] Figure 3 One embodiment diagram of the live stream signal cloud director data processing method provided by the embodiment of the present invention;

[0042] Figure 4 Another embodiment diagram of the live stream signal cloud director data processing method provided by the embodiment of the present invention;

[0043] Figure 5 Schematic diagram of the structure of the cloud service device provided by the embodiment of the present invention;

[0044] Figure 6 Schematic diagram of the structure of the user terminal provided by the embodiment of the present invention;

[0045] Figure 7 Device block diagram provided by the embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0046] In order to make the technical means, creative features, achieved purposes, and effects of the present invention easy to understand, the present invention will be further described below in conjunction with specific embodiments. However, the following embodiments are only the preferred embodiments of the present invention, not all of them. Based on the embodiments in the implementation manner, other embodiments obtained by those skilled in the art without creative efforts all belong to the protection scope of the present invention. The experimental methods in the following embodiments are all conventional methods unless otherwise specified. The materials, reagents, etc. used in the following embodiments can all be obtained from commercial channels unless otherwise specified.

[0047] In the description of the present invention, it should be noted that the orientation or positional relationship indicated by the terms "upper", "lower", "inner", "outer", "front end", "rear end", "both ends", "one end", "the other end", etc. is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as a limitation on the present invention. In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be construed as indicating or implying relative importance.

[0048] In the description of the present invention, it should be noted that unless otherwise clearly specified and defined, the terms "installed", "provided with", "connected", etc. should be understood in a broad sense. For example, "connected" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the communication inside two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific situations.

[0049] In addition, the drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus repeated descriptions thereof will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware units or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.

[0050] The embodiments of the present invention will be described below with reference to the drawings.

[0051] Please refer to Figure 2 、 Figure 3 , this embodiment provides a method for processing live stream signal cloud director data. This method can be used on cloud service devices (such as cloud servers). Figure 3 As shown, this method at least includes the following steps:

[0052] The cloud service device receives two or more live stream signals and instructions from the cloud director device; in this step, the cloud service device pulls two or more live stream signals through the network. The live stream signals encapsulate video data and audio data. Encapsulation means packing audio, video and other data into a specific file format according to certain rules. Common encapsulation formats include MP4, AVI, MKV, FLV, etc.; for example, when using communication including but not limited to RTMP (Real-Time Messaging Protocol), the FLV encapsulation format is generally used; FLV (Flash Video) is a streaming media format. Due to its characteristics such as small size and simple encapsulation of the encapsulated audio and video files, it is very suitable for use on the Internet; currently, most mainstream video websites basically support FLV; it has the characteristics of low latency and easy transmission when pulling streams in a live broadcast scenario.

[0053] During live broadcast, as Figure 2 shown, the cloud service device pulls the RTMP1 live stream signal, unpacks the RTMP1 live stream signal (the unpacking method can use existing open source audio and video processing libraries including but not limited to FFmpeg) to obtain audio and video data, and then decodes the audio data (the decoding is performed using existing open source libraries including but not limited to libfdk_aac), while the video data is not processed at all and is packaged with the decoded audio data and then pushed to a user terminal such as a video number for playback;

[0054] When a switch is needed, the cloud service device selects a target live stream signal according to the instructions of the cloud director device; as Figure 2 shown, for example, when switching from the RTMP1 stream to the RTMP2 stream, before the switch, the cloud service device has been pulling the data stream of RTMP1. When it receives the switch signal from the cloud director device, the cloud service device goes to pull the data stream of RTMP2, unpacks the RTMP2 live stream signal, decodes the audio data after unpacking, and the video data is not processed at all. When the audio data switch is completed, the video data of RTMP2 is directly used for format packaging, and the video data and decoded audio data of RTMP2 are packaged and pushed to the user terminal. Finally, the cloud service device releases the video stream of RTMP1 to complete the switch;

[0055] During signal switching, since the audio encoder of the audio data usually has a certain data caching mechanism (it will first cache the audio data of RTMP1), during switching, the remaining RTMP1 data in the cache is processed first, and then the newly input audio data of RTMP2 is processed, so as to achieve seamless connection with the audio data of the new input source (RTMP2) during switching, avoid audio interruption or stuttering, and thus avoid the problem of live stream disconnection.

[0056] In the live stream signal cloud director data processing method provided by the embodiment of the present invention, after unpacking the pulled live stream signal, only the audio data is decoded and the video data is not decoded. The video data is directly used for subsequent packaging and pushing together with the decoded audio data. In this embodiment, by not decoding the video data, the consumption of computing resources of the cloud service device is greatly reduced, and the picture delay and freezing phenomenon of the playback terminal are reduced. Moreover, by encoding and packaging the audio data for sending, it is possible to avoid the problem of live stream disconnection and subsequent disconnection of the live terminal when a user terminal watches a live stream on, for example, WeChat Video. After testing, by using the live stream signal cloud director data processing method provided by the present invention, live streaming can be stably performed on a server with 2 cores and 4G of memory, and the CPU load rate can be reduced to less than 30%, greatly reducing the performance requirements for the cloud server.

[0057] Specifically, the cloud service device communicates with the live stream signal sender and the user terminal through the RTMP protocol. The RTMP protocol is applied in the live streaming field and has characteristics such as low latency, high-efficiency transmission, high reliability, and wide support. When combined with the solution in the embodiment of the present invention, it can improve the live streaming stability.

[0058] Specifically, at least one of the following decoders is used for the decoding process of the audio data: Opus, AAC, and MP3. Preferably, the AAC decoder is used. AAC has advantages such as high compression ratio, high sound quality, multi-channel support, flexible configuration, wide support, open standard, efficient decoder, scalability, low bit rate application, and compatibility, making it a popular choice for audio processing and transmission.

[0059] As Figure 4 shown, the embodiment of the present invention provides a live stream signal cloud director data processing method. The method in this embodiment is the same as the above embodiment, except that this embodiment is applied to the user terminal. The method includes:

[0060] The user terminal receives the encapsulated data packet sent by the cloud service device. The encapsulated data is the audio data decoded by the cloud service device and the video data not decoded by the cloud server.

[0061] The user terminal unpacks the encapsulated data packet into audio data and video data.

[0062] The user terminal decodes the audio data and video data.

[0063] The user terminal plays the decoded audio data and video data.

[0064] As Figure 5As shown in the figure, the present invention provides a cloud service device, and the live stream signal cloud director data processing method adopted by it is the same as that in the above embodiment. The cloud service device includes:

[0065] A first transmission unit, configured to receive two or more live stream signals, and receive multiple live source inputs through streaming media protocols such as RTMP and SRT;

[0066] An instruction interaction unit, configured to receive instructions from the cloud director device;

[0067] A stream path control unit, configured to select a target live stream signal according to the instructions of the cloud director device; the switching of different signal sources can be realized through an existing software logic unit or a hardware switch matrix unit, such as performing PGM / PVW stream switching according to the instructions of the cloud director device;

[0068] A first de-encapsulation unit, configured to de-encapsulate the target live stream signal into video data and audio data; it can adopt, including but not limited to, the FFmpeg library, which supports the parsing of multiple encapsulation formats (such as MP4, FLV, TS, etc.);

[0069] An audio decoding unit, configured to perform decoding processing on the audio data, including but not limited to AAC, MP3, Opus audio decoders, etc.;

[0070] An encapsulation unit, configured to encapsulate the decoded audio data and the undecoded video data; it can adopt, including but not limited to, the FFmpeg library, which supports multiple encapsulation formats (such as MP4, FLV, TS, etc.);

[0071] A second transmission unit, responsible for transmitting the encapsulated data to the user terminal through a streaming media protocol, and data distribution can be realized by adopting, including but not limited to, standard protocols such as RTMP, HLS, and DASH.

[0072] Preferably, both the stream signal access unit and the transmission unit communicate with the live stream signal sending end and the user terminal through the RTMP protocol.

[0073] Preferably, the audio decoding unit adopts at least one of the following decoders: Opus, AAC, MP3.

[0074] Such as Figure 6 As shown in the figure, the present invention provides a user terminal, and the live stream signal cloud director data processing method adopted by it is the same as that in the above embodiment. The user terminal includes:

[0075] A third transmission unit, configured to receive the encapsulated data packet sent by the cloud service device, and the encapsulated data is the audio data decoded by the cloud service device and the video data not decoded by the cloud server;

[0076] A second decompression unit, configured to decompress the encapsulated data packet into audio data and video data;

[0077] An audio decoding unit, configured to decode the audio data;

[0078] A video decoding unit, configured to decode the video data;

[0079] A playback unit, configured to play the decoded audio data and video data.

[0080] Preferably, the third transmission unit communicates with the RTMP protocol cloud service device.

[0081] Preferably, the audio codec unit adopts at least one of the following codecs: Opus, AAC, MP3.

[0082] The present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the live stream signal cloud director data processing method as described above is implemented.

[0083] An embodiment of the present invention provides a device 900, corresponding to the cloud service device and the user terminal in the above embodiment. The device 900 includes:

[0084] A processor; and a memory, configured to store executable instructions of the processor;

[0085] Wherein, the processor is configured to implement the live stream signal cloud director data processing method as described above by executing the executable instructions.

[0086] The device in this embodiment can implement the above-mentioned live stream signal cloud director data processing method, and the specific implementation manner can be referred to the method embodiment and will not be elaborated here.

[0087] Next, refer to Figure 7 to describe the device 900 according to this embodiment of the present invention. Figure 7 The shown device 900 is only an example, and should not bring any limitation to the functions and usage scope of the embodiments of the present invention.

[0088] As Figure 7 shown, the device 900 is presented in the form of a general-purpose computing device. The components of the device 900 may include but are not limited to: at least one of the above-mentioned processing units 910, at least one of the above-mentioned storage units 920, and a bus 930 connecting different system components (including the storage unit 920 and the processing unit 910).

[0089] Among them, the storage unit stores program code, and the program code can be executed by the processing unit 910, so that the processing unit 910 executes the steps according to various exemplary embodiments of the present invention described in the "Exemplary Method" section above of this specification. For example, the processing unit 910 can execute as Figure 3 , Figure 4 shown in the live stream signal cloud director data processing method.

[0090] The storage unit 920 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 9201 and / or a cache storage unit 9202, and may further include a read-only storage unit (ROM) 9203.

[0091] The storage unit 920 may also include a program / utilities 9204 having a set (at least one) of program units 9205. Such program units 9205 include but are not limited to: an operating system, one or more application programs, other program units, and program data. Each or some combination of these examples may include the implementation of a network environment.

[0092] The bus 930 may represent one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus structures.

[0093] The device 900 can also communicate with one or more external devices 1000 (such as a keyboard, a pointing device, a Bluetooth device, etc.), and can also communicate with one or more devices that enable a user to interact with the device 900, and / or communicate with any device that enables the device 900 to communicate with one or more other computing devices (such as a router, a modem, etc.). Such communication can be carried out through an input / output (I / O) interface 950. And the device 900 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through a network adapter 960. As Figure 7 shown, the network adapter 960 communicates with other units of the device 900 through the bus 930. It should be understood that although not shown in the figure, other hardware and / or software units can be used in combination with the device 900, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0094] Based on the descriptions of the above embodiments, those skilled in the art can easily understand that the exemplary embodiments described herein can be implemented by software or by a combination of software and necessary hardware. Therefore, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, a USB flash drive, a portable hard disk, etc.) or on a network, including several instructions for causing a computing device (such as a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.

[0095] In another embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, it implements the live stream signal cloud director data processing method described in any one of the above.

[0096] A computer-readable storage medium provided in this embodiment stores a program product capable of implementing the method described in this specification. In some possible implementation manners, various aspects of the present invention can also be implemented in the form of a program product, which includes program code. When the program product runs on a terminal device, the program code is used to cause the terminal device to execute the steps according to various exemplary embodiments of the present invention described in the "Exemplary Method" section of this specification.

[0097] A program product for implementing the above method according to the embodiments of the present invention is described. It can be a portable compact disc read-only memory (CD-ROM) and includes program code, and can run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, the readable storage medium can be any tangible medium that contains or stores a program, and this program can be used by or in combination with an instruction execution system, device, or apparatus.

[0098] The program product can adopt any combination of one or more readable media. The readable media can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any combination of the above. More specific examples (non-exhaustive list) of the readable storage medium include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0099] A computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The readable signal medium may also be any readable medium other than a readable storage medium, which can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0100] The program code contained on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, and the like, or any suitable combination of the foregoing.

[0101] The program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and also including conventional procedural programming languages such as the "C" language or similar programming languages. The program code may be executed entirely on the user's computing device, partially on the user's device, executed as a stand-alone software package, partially on the user's computing device and partially on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or, alternatively, may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0102] It should be noted that although several units or elements of the devices for action execution are mentioned in the foregoing detailed description, such division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more of the above-mentioned units or elements may be embodied in one unit or element. Conversely, the features and functions of one unit or element described above may be further divided and embodied by a plurality of units or elements.

[0103] In addition, although the steps of the methods in the present disclosure are described in a specific order in the drawings, this does not require or imply that these steps must be performed in that specific order, or that all of the steps shown must be performed to achieve the desired result. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step for execution, and / or one step may be decomposed into multiple steps for execution, etc.

[0104] Through the description of the above embodiments, those skilled in the art can easily understand that the example embodiments described herein can be implemented by software or by a combination of software and necessary hardware. Therefore, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on the network, including several instructions to enable a computing device (which can be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.

[0105] Although the embodiments of the present invention have been shown and described, those of ordinary skill in the art can understand that various changes, modifications, substitutions, and variations can be made to these embodiments without departing from the principles and spirit of the present invention. The scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A method for processing cloud director data of live stream signals, characterized in that, The method includes: The cloud service device receives two or more live stream signals and receives instructions from the cloud director device; The cloud service device selects a target live stream signal according to the instructions of the cloud director device; The cloud service device unpacks the target live stream signal into video data and audio data; The cloud service device performs decoding processing on the audio data; The cloud service device encapsulates the decoded audio data and the undecoded video data; The cloud service device sends the encapsulated decoded audio data and undecoded video data to the user terminal.

2. The live stream signal cloud director data processing method according to claim 1, wherein: The cloud service device communicates with the live stream signal sender and the user terminal through the RTMP protocol.

3. The live stream signal cloud director data processing method according to claim 1, wherein: The decoding processing of the audio data uses at least one of the following decoders: Opus, AAC, MP3.

4. A method for processing cloud director data of live stream signals, characterized in that, The method includes: The user terminal receives the encapsulated data packet sent by the cloud service device, and the encapsulated data is the audio data decoded by the cloud service device and the video data not decoded by the cloud server; The user terminal unpacks the encapsulated data packet into audio data and video data; The user terminal decodes the audio data and the video data; The user terminal plays the decoded audio data and video data.

5. A cloud service device, characterized in that, The cloud service device includes: A first transmission unit for receiving two or more live stream signals; An instruction interaction unit for receiving instructions from the cloud director device; A stream path control unit for selecting a target live stream signal according to the instructions of the cloud director device; A first unpacking unit for unpacking the target live stream signal into video data and audio data; An audio decoding unit for performing decoding processing on the audio data; An encapsulation unit for encapsulating the decoded audio data and the undecoded video data; A second transmission unit for sending the encapsulated decoded audio data and undecoded video data to the user terminal.

6. The cloud service device according to claim 5, wherein: Both the first transmission unit and the second transmission unit communicate with the live stream signal sender and the user terminal through the RTMP protocol.

7. The cloud service device according to claim 5, wherein: The audio decoding unit uses at least one of the following decoders: Opus, AAC, MP3.

8. A user terminal, characterized in that, The user terminal includes: A third transmission unit for receiving the encapsulated data packet sent by the cloud service device, and the encapsulated data is the audio data decoded by the cloud service device and the video data not decoded by the cloud server; A second unpacking unit for unpacking the encapsulated data packet into audio data and video data; An audio decoding unit for decoding the audio data; A video decoding unit for decoding the video data; A playing unit for playing the decoded audio data and video data.

9. The user terminal according to claim 8, wherein: The third transmission unit communicates with the cloud service device through the RTMP protocol.

10. The user terminal according to claim 8, characterized in that: The audio decoding unit uses at least one of the following decoders: Opus, AAC, MP3.

Images