Live streaming media data low-delay transmission method

Abstract

The invention relates to the technical field of image communication, in particular to a live broadcast streaming media data low-delay transmission method, which comprises the following steps of: determining audience interaction data and network time delay of adjacent transmission data packets in respective time periods; determining a redundancy change degree of live broadcast effective interactivity between adjacent transmission data packets by using the audience interaction data; and determining a target redundancy level of the current transmission data packet by using the redundancy change degree and the network delay, and performing redundancy transmission based on the target redundancy level. According to the technical scheme of the invention, on the basis of the fusion of the interaction condition of the audience and the network delay, while the live broadcast delay is reduced, the live broadcast interaction interference caused by network instability or packet loss is reduced, and the interaction experience of the live broadcast audience is ensured.

Description

Technical Field

[0001] The present invention relates to the technical field of image communication, and particularly to a method for low-latency transmission of live streaming media data. Background Art

[0002] Live streaming media data refers to video and audio data streams transmitted over the Internet. Nowadays, many live streaming platforms incorporate social elements, enabling viewers to interact in real time during the live stream. For some highly interactive live streams, excessive latency can significantly reduce the viewers' sense of participation and may even cause them to miss crucial moments. Therefore, to ensure a good experience for interactive live streams, achieving low-latency transmission is of utmost importance.

[0003] To reduce the stuttering and packet loss caused by network instability, a packet redundancy technology needs to be introduced. In the prior art, when the network conditions are poor, to ensure the smooth transmission of data, the redundancy level of packets is reduced; when the network conditions improve, both the bandwidth and throughput increase, and the stability of network transmission is enhanced, so the redundancy level of packets is increased.

[0004] However, for highly interactive live streams, especially when there is frequent interaction between viewers and the host, if only the redundancy level is adjusted according to the network conditions, the live stream experience and interaction effect are not ideal enough, and the loss of live stream data still occurs relatively frequently. Summary of the Invention

[0005] In order to solve the technical problem that only adjusting the redundancy level of packets according to changes in network conditions cannot well ensure the interactive experience of live stream viewers, the purpose of the present invention is to provide a method for low-latency transmission of live streaming media data, and the specific technical solution adopted is as follows: The present invention provides a method for low-latency transmission of live streaming media data, and the method includes: Determine the viewer interaction data and network latency of adjacent transmitted packets within their respective time periods; Use the viewer interaction data to determine the redundancy change degree of the effective interactivity of the live stream between adjacent transmitted packets; Use the redundancy change degree and network latency to determine the target redundancy level of the current transmitted packet and perform redundant transmission based on the target redundancy level; Wherein, adjacent transmitted packets include the current transmitted packet and its corresponding previous transmitted packet.

[0006] Further, the determination of the viewer interaction data of adjacent transmitted packets within their respective time periods includes: Determine the number of viewers, the viewing duration of each viewer, and the interaction content of adjacent transmitted packets within their respective time periods; Take the number of viewers, the viewing duration of each viewer, and the interaction content as the viewer interaction data.

[0007] Further, the determining the redundant change degree of the live effective interactivity between adjacent transmission data packets by using the viewer interaction data includes: Determine the consistency of the interaction content between the target viewer and any other viewer by using the interaction content of each viewer; Determine the viewer interactivity of the target viewer in the respective time periods of adjacent transmission data packets by using the interaction content consistency and the number of viewers; Determine the redundant change degree of the live effective interactivity between adjacent transmission data packets by using the viewer interactivity.

[0008] Further, the determining the redundant change degree of the live effective interactivity between adjacent transmission data packets by using the viewer interactivity includes: Determine the viewer interaction effectiveness of the target viewer by using the viewing duration of each viewer; Determine the redundant change degree of the live effective interactivity between adjacent transmission data packets by using the viewer interactivity and the viewer interaction effectiveness.

[0009] Further, the determining the viewer interaction effectiveness of the target viewer by using the viewing duration of each viewer includes: Determine the target viewing duration of the target viewer, the longest viewing duration and the shortest viewing duration among all viewers' viewing durations; Calculate the viewer interaction effectiveness of the target viewer by using the target viewing duration, the longest viewing duration, and the shortest viewing duration.

[0010] Further, the determining the redundant change degree of the live effective interactivity between adjacent transmission data packets by using the viewer interactivity and the viewer interaction effectiveness includes: Calculate the live effective interactivity of each of the adjacent transmission data packets by using the viewer interactivity and the viewer interaction effectiveness of each of the adjacent transmission data packets; Compare the live effective interactivity of each of the adjacent transmission data packets to obtain the redundant change degree of the live effective interactivity.

[0011] Further, the determining the target redundancy level of the current transmission data packet and performing redundant transmission based on the target redundancy level by using the redundant change degree and the network delay includes: Determine the corrected target redundant change degree of the current transmission data packet by using the redundant change degree and the network delay; Determine the target redundancy level of the current transmission data packet by using the target redundant change degree and perform redundant transmission based on the target redundancy level.

[0012] Further, the step of determining the corrected target redundancy change degree of the current transmission data packet by using the redundancy change degree and network delay includes: Calculating the corrected target redundancy change degree of the current transmission data packet by using the redundancy change degree and the network delay difference between adjacent transmission data packets.

[0013] Further, the step of determining the target redundancy level of the current transmission data packet by using the target redundancy change degree and performing redundancy transmission based on the target redundancy level includes: Determining the previous redundancy level of the previous transmission data packet; Calculating the target redundancy level of the current transmission data packet by using the target redundancy change degree and the previous redundancy level; Performing redundancy transmission on the current transmission data packet based on the target redundancy level.

[0014] Further, after the step of determining the target redundancy level of the current transmission data packet by using the redundancy change degree and network delay and performing redundancy transmission based on the target redundancy level, it further includes: When the formation of the current transmission data packet and the replication according to the target redundancy level are completed, generating the next transmission data packet; Taking the next transmission data packet as the current transmission data packet, and looping to execute the step of determining the audience interaction data and network delay of adjacent transmission data packets in their respective time periods until the live broadcast ends.

[0015] The present invention has the following beneficial effects: Compared with the problem that the prior art cannot well ensure the live broadcast audience interaction experience by only adjusting the redundancy level of data packets according to network condition changes, the present invention evaluates in real time the improvement or weakening of the audience interaction of the currently transmitted data packet compared with the previous transmitted data packet in terms of comparative usefulness, so as to adjust the redundancy level of the currently transmitted data packet according to the redundancy level of the previous transmitted data packet.

[0016] Specifically, for the time period of the current data packet transmission, if each audience has good (audience) interactivity, then the currently transmitted data packet also has good interactivity, but the importance of each audience to the live broadcast (audience interaction effectiveness) is different. If the audience with a higher degree of importance also has a higher audience interactivity, then the higher the live broadcast effective interactivity of the currently transmitted data packet, the more it is necessary to increase the redundancy level to ensure the transmission experience of the interactive information. Therefore, the higher the live broadcast effective interactivity of the currently transmitted data packet compared to the last transmitted data packet, the higher the redundancy increase corresponding to the redundancy change degree should be, and vice versa, the higher the redundancy reduction corresponding to the redundancy change degree. However, this adjustment is only effective when the network delay environment is consistent. The effect of increasing or decreasing redundancy is available. At this point, the network delay is taken into account to obtain the corrected redundancy change degree of the currently transmitted data packet compared to the last transmitted data packet, and finally the target redundancy level of the currently transmitted data packet can be obtained. Based on the integration of the audience's interaction and network delay, the live broadcast delay is reduced while reducing the live broadcast interaction interference caused by network instability or packet loss, ensuring the live audience interaction experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions and advantages in the embodiments of the present invention or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 A flowchart of a method for low-latency transmission of live streaming media data provided by an embodiment of the present invention; Figure 2 A detailed flow chart of step S2 in a method for low-latency transmission of live streaming media data provided by an embodiment of the present invention; Figure 3 A detailed flow chart of step S23 in a method for low-latency transmission of live streaming media data provided by one embodiment of the present invention; Figure 4 A detailed flow chart of step S3 in a method for low-latency transmission of live streaming media data provided by an embodiment of the present invention; Figure 5 A schematic diagram of the structure of the hardware operating environment of a low-latency transmission device for live streaming media data involved in an embodiment of the present invention; Figure 6 The present invention is a schematic diagram of the framework structure of a low-latency transmission system for live streaming media data according to an embodiment of the present invention. DETAILED DESCRIPTION

[0019] In order to further elaborate on the technical means and effects adopted by the present invention to achieve the intended invention purpose, the following specifically describes, in conjunction with the accompanying drawings and preferred embodiments, a method for low-latency transmission of live streaming media data proposed according to the present invention, including its specific implementation manner, structure, features and effects. In the following description, different "one embodiment" or "another embodiment" do not necessarily refer to the same embodiment. In addition, the specific features, structures or characteristics in one or more embodiments can be combined in any suitable form.

[0020] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field to which the present invention belongs.

[0021] The following specifically describes the specific solution of a method for low-latency transmission of live streaming media data provided by the present invention with reference to the accompanying drawings. Embodiment 1

[0022] For the method for low-latency transmission of live streaming media data provided by the present invention, please refer to Figure 1 , which shows the flowchart of the steps of the method for low-latency transmission of live streaming media data provided by an embodiment of the present invention.

[0023] The method includes: Step S1, determining the audience interaction data and network delay of adjacent transmission data packets within their respective time periods; In this embodiment, adjacent transmission data packets include the current transmission data packet and its corresponding previous transmission data packet.

[0024] As the interactive live broadcast progresses, whenever a data packet is packed, the sender will copy the data packet according to its redundancy level and send it to the receiver. For example, if the redundancy level of a data packet is 3, then the data packet will be copied three times and sent.

[0025] After the previous data packet is packed, the live broadcast data will form a new data packet within a time span T (customized). The resolution data, audience interaction data, and network delay data of the live broadcast within the time period when the new data packet is formed can be collected.

[0026] Specifically, the step S1 includes: Determining the number of audiences, the viewing duration of each audience, and the interaction content of adjacent transmission data packets within their respective time periods; Regarding the number of audiences, the viewing duration of each audience, and the interaction content as the audience interaction data.

[0027] Here, taking the current transmission data packet A as an example: Indicates the network latency measured when the current transmission data packet A is formed.

[0028] The audience interaction data of the current transmission data packet A in the current time period is shown in Table 1 below: , Among them, Indicates the audience The (total) viewing duration before the formation of the current transmission data packet A, Indicates the audience The (total) viewing duration before the formation of the current transmission data packet A, and so on, Indicates the audience The (total) viewing duration before the formation of the current transmission data packet A.

[0029] Indicates the audience The interaction content within the time period (current time period) when the current transmission data packet A is formed, Indicates the audience The interaction content within the time period (current time period) when the current transmission data packet A is formed, and so on, Indicates the audience The interaction content within the time period (current time period) when the current transmission data packet A is formed.

[0030] Indicates the audience The total number of characters of the interaction content within the time period when the currently transmitted data packet A is formed is pieces, Indicates the audience The total number of characters of the interaction content within the time period when the currently transmitted data packet A is formed is pieces, and so on, Indicates the audience The total number of characters of the interaction content within the time period when the currently transmitted data packet A is formed is pieces.

[0031] Step S2, using the audience interaction data to determine the redundant change degree of the effective interactivity of the live broadcast between adjacent transmission data packets; Specifically, in one embodiment, please refer to Figure 2 , the step S2 includes: Step S21, using the interaction content of each audience to determine the consistency of the interaction content between the target audience and any other audience; Step S22, using the interaction content consistency and the number of audiences to determine the audience interactivity of the target audience in the respective time periods of adjacent transmission data packets; Step S23: Determine the redundancy change degree of the effective interactivity during the live broadcast between adjacent transmission data packets by using the audience interactivity.

[0032] For each audience during the time period of the current transmission data packet, when the audience sends interactive content with longer characters, it often indicates that they have invested more thinking and emotions during the live broadcast, and are willing to spend time participating in discussions, asking questions, or interacting with the anchor, that is, the audience interactivity is stronger. However, this longer character needs to be based on non-repetition. If the audience repeatedly sends similar or repetitive content, such as interacting by commenting "+1" and other operations, then these interactions do not reflect the real investment of the audience in the live broadcast, and thus cannot achieve the interactivity effect that long-character interactions should have.

[0033] From the above analysis and description, it can be seen that the audience with more characters in the interactive content they send and non-repetitive interactive content has better audience interactivity. Therefore, the following formula can be constructed to represent the audience interactivity of any i-th audience (target audience) during the time period of the current transmission data packet A: , Formula explanation: Among them, represents the audience interactivity of the i-th audience during the current time period of the current transmission data packet A, represents that there are a total of audiences during the time period of the current transmission data packet A, represents the audience and the consistency of the interactive content between the audience j (0 for consistent, 1 for inconsistent), represents a hyperparameter that makes the denominator non-zero, such as 0.0001, represents the audience the non-repetitiveness of the interactive content, represents the audience the total number of characters in the interactive content during the time period when the current transmission data packet A is formed is pieces.

[0034] Similarly, the audience interactivity of each audience during the current time period of the current transmission data packet can be determined.

[0035] Please refer to Figure 3 In step S23, it specifically includes: Step S231: Determine the effectiveness of the audience interaction of the target audience by using the viewing duration of each audience; In step S231, it specifically includes: Determine the target viewing duration of the target audience, the longest viewing duration and the shortest viewing duration among the viewing durations of all audiences; The audience interaction effectiveness of the target audience is calculated using the target viewing duration, the maximum viewing duration, and the minimum viewing duration.

[0036] For all audiences during the time period of the current transmitted data packet, the effectiveness of the audience interaction obtained by different audiences is different. As the viewing time increases, the emotional connection between the audience and the live content gradually deepens. This emotional investment makes them more inclined to engage in effective and in-depth interactions, rather than just superficial participation. Therefore, audiences with longer live viewing times have better audience interaction effectiveness.

[0037] Through the above description, the following formula can be constructed to represent the audience interaction effectiveness (maximum-minimum normalization) of the i-th audience during the current time period of the current transmitted data packet A: , Formula explanation: Among them, represents the audience interaction effectiveness of the i-th audience during the current time period of the current transmitted data packet A, represents the audience viewing duration before the formation of the current transmitted data packet A, represents the shortest viewing duration of all audiences before the formation of the current transmitted data packet A, represents the longest viewing duration of all audiences before the formation of the current transmitted data packet A.

[0038] Similarly, the audience interaction effectiveness of each audience during the current time period of the current transmitted data packet can be determined.

[0039] Step S232: Determine the redundant change degree of the live effective interaction between adjacent transmitted data packets using the audience interactivity and the audience interaction effectiveness.

[0040] The said step S232 specifically includes: Calculate the live effective interactivity of each of the adjacent transmitted data packets using the audience interactivity and the audience interaction effectiveness of each of the adjacent transmitted data packets; Compare the live effective interactivity of each of the adjacent transmitted data packets to obtain the redundant change degree of the live effective interactivity.

[0041] The above embodiments have determined the audience interactivity of each audience for the current transmission data packet within the current time period, and determined the audience interaction effectiveness of each audience for the current transmission data packet within the current time period. Since the live interaction of the current transmission data packet within the current time period is composed of the interactions of all audiences, for the live broadcast of the current transmission data packet within the current time period, if all audiences have strong audience interactivity under the audience interaction effectiveness, then the effective interactivity of the live interaction composed of these audience interactions (i.e., the live effective interactivity) is also higher. Therefore, the following formula can be constructed to represent the live effective interactivity of the current transmission data packet A within the current time period: , Explanation of the formula: Among them, represents the live effective interactivity of the current transmission data packet A within the current time period, represents that there are a total of audiences for the current transmission data packet A within the current time period, represents the audience interaction effectiveness of the i-th audience for the current transmission data packet A within the current time period, represents the audience interactivity of the i-th audience for the current transmission data packet A within the current time period.

[0042] Similarly, the live effective interactivity of the current transmission data packet within the current time period can be determined.

[0043] For data packets with strong live interactivity, that is, in the case of frequent data interaction, the stable transmission of interaction information is crucial for the interaction experience of live broadcast audiences. A higher redundancy level means that the data packet has more duplicate packets, which helps to recover lost data in a timely manner in case of unstable network environment or packet loss, ensuring a stable live broadcast experience and interaction effect. Therefore, if the live effective interactivity of the current transmission data packet A compared to the previous transmission data packet (A - 1) is relatively increased, then its redundancy level should also be further increased, and vice versa.

[0044] Through the above description, the following formula can be constructed to represent the (preliminary) redundancy change degree of the current transmission data packet A compared to the previous transmission data packet (A - 1): , Explanation of the formula: Among them, represents the (preliminary) redundancy change degree of the current transmission data packet A compared to the previous transmission data packet (A - 1), represents the live effective interactivity of the current transmission data packet A within the current time period, represents the live effective interactivity of the previous transmission data packet A - 1 within the previous time period.

[0045] Step S3: Determine the target redundancy level of the current transmitted data packet based on the redundancy change degree and network delay, and perform redundant transmission based on the target redundancy level; Please refer to Figure 4 , and the step S3 includes: Step S31: Determine the corrected target redundancy change degree of the current transmitted data packet by using the redundancy change degree and network delay; The step S31 specifically includes: Calculate the corrected target redundancy change degree of the current transmitted data packet by using the redundancy change degree and the network delay gap between adjacent transmitted data packets.

[0046] Step S32: Determine the target redundancy level of the current transmitted data packet by using the target redundancy change degree, and perform redundant transmission based on the target redundancy level.

[0047] The step S32 specifically includes: Determine the previous redundancy level of the previous transmitted data packet; Calculate the target redundancy level of the current transmitted data packet by using the target redundancy change degree and the previous redundancy level; Perform redundant transmission on the current transmitted data packet based on the target redundancy level.

[0048] For the preliminary redundancy change degree of the current transmitted data packet calculated above compared with the previous transmitted data packet, it needs to be calculated in the same network environment. When the network environment changes during transmission, since the main goal of this technology is to achieve low-latency transmission, if the network delay increases when the data packet is formed, it may lead to stuttering, which in turn affects the overall transmission quality and user experience, and cannot achieve the expected low-latency effect. Therefore, in order to ensure the low latency of the live broadcast, in addition to optimizing based on the redundancy increase degree, it is also necessary to ensure that the network delay does not increase as much as possible. Therefore, this embodiment can construct the following formula to represent the network delay gap between the formation of the current transmitted data packet A and the formation of the previous transmitted data packet (A-1): , Formula explanation: Among them, represents the network delay gap between the formation of the current transmitted data packet A and the formation of the previous transmitted data packet (A-1), represents the network delay when the current transmitted data packet A is formed, represents the network delay when the previous transmitted data packet A-1 is formed.

[0049] Further, to ensure low latency, the network latency should not increase on the basis of the preliminary redundancy change degree. Therefore, the following formula can be constructed to represent the target redundancy change degree of the current transmitted data packet A compared to the previous transmitted data packet (A - 1): , Formula explanation: Among them, represents the target redundancy change degree of the current transmitted data packet A compared to the previous transmitted data packet (A - 1), exp represents the exponential function with the natural constant e as the base, represents the network latency gap between the formation of the current transmitted data packet A and the formation of the previous transmitted data packet (A - 1), represents the (preliminary) redundancy change degree of the current transmitted data packet A compared to the previous transmitted data packet (A - 1).

[0050] Further, the following formula can be constructed to represent the target redundancy level of the current transmitted data packet A: , Formula explanation: Among them, represents the target redundancy level of the current transmitted data packet A, represents the target redundancy change degree of the current transmitted data packet A compared to the previous transmitted data packet (A - 1), represents the previous redundancy level of the previous transmitted data packet A - 1.

[0051] Among them, the redundancy level refers to the number of data packets copied and transmitted additionally to cope with factors such as network fluctuations, packet loss, and latency. If the redundancy level is 3, three data packets are copied. During the live broadcast transmission with strong live interaction, the transmission of redundant data packets is very important. If the network is unstable or packet loss occurs, the redundant data packets can help recover the lost information and ensure the continuity and stability of the live broadcast content.

[0052] In one embodiment, after the step S3, the method further includes: When the formation of the current transmitted data packet is completed and the copying according to the target redundancy level is finished, generate the next transmitted data packet; Take the next transmitted data packet as the current transmitted data packet, and loop to execute the step of determining the audience interaction data and network latency of adjacent transmitted data packets in their respective time periods until the live broadcast ends.

[0053] Based on the above embodiments, the target redundancy level of the current transmitted data packet at the sending end is determined, and then the current transmitted data packet is copied and sent multiple times according to the redundancy level. When the receiving end receives the data packets, the data will be reorganized in the original order according to the timestamps. This process will continue until the live broadcast ends. The specific steps are as follows: 1. When the current transmission data packet is formed, start generating the next transmission data packet and use the next transmission data packet as the new current transmission data packet.

[0054] 2. Within the custom time period T, complete the generation of the next transmission data packet and collect the live broadcast and interactive data within this time period.

[0055] 3. Then, based on steps S1 to S3, a new redundancy level of the currently transmitted data packet is calculated.

[0056] 4. Perform redundant transmission on the new currently transmitted data packet according to the redundancy level.

[0057] 5. Repeat the above steps until the live broadcast ends.

[0058] Compared with the prior art that only adjusts the redundancy level of data packets according to changes in network conditions and cannot well ensure the interactive experience of live audiences, the present invention evaluates in real time the improvement or reduction in audience interactivity of the currently transmitted data packet relative to the previously transmitted data packet in terms of comparative usefulness, thereby adjusting the redundancy level of the currently transmitted data packet according to the redundancy level of the previously transmitted data packet.

[0059] Specifically, for the time period of the current data packet transmission, if each audience has good (audience) interactivity, then the currently transmitted data packet also has good interactivity, but the importance of each audience to the live broadcast (audience interaction effectiveness) is different. If the audience with a higher degree of importance also has a higher audience interactivity, then the higher the live broadcast effective interactivity of the currently transmitted data packet, the more it is necessary to increase the redundancy level to ensure the transmission experience of the interactive information. Therefore, the higher the live broadcast effective interactivity of the currently transmitted data packet compared to the last transmitted data packet, the higher the redundancy increase corresponding to the redundancy change degree should be, and vice versa, the higher the redundancy reduction corresponding to the redundancy change degree. However, this adjustment is only effective when the network delay environment is consistent. The effect of increasing or decreasing redundancy is available. At this point, the network delay is taken into account to obtain the corrected redundancy change degree of the currently transmitted data packet compared to the last transmitted data packet, and finally the target redundancy level of the currently transmitted data packet can be obtained. Based on the integration of the audience's interaction and network delay, the live broadcast delay is reduced while reducing the live broadcast interaction interference caused by network instability or packet loss, ensuring the live audience interaction experience.

[0060] Embodiment 2: The embodiment of the present invention also provides a low-delay transmission device for live streaming media data. The low-delay transmission device for live streaming media data can be a data computing and processing device such as a mobile phone, a tablet computer, a computer, a server, or a combination of multiple devices.

[0061] As shown Figure 5 in Figure 5 FIG. 1, it is a schematic structural diagram of the hardware operating environment of the live streaming media data low-latency transmission device according to the embodiment of the present invention.

[0062] As shown Figure 5 in FIG. 2, the live streaming media data low-latency transmission device may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display (Display) and an input unit such as a control panel. Optionally, the user interface 1003 may further include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WIFI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001. As a computer storage medium, the memory 1005 may include a live streaming media data low-latency transmission program.

[0063] Those skilled in the art can understand that Figure 5 the hardware structure shown in FIG. 3 does not constitute a limitation on the device, and may include more or fewer components than shown, or combine some components, or have a different component layout.

[0064] Continuing to refer to Figure 5 FIG. 4, Figure 5 as a computer-readable storage medium, the memory 1005 may include an operating system, a user interface module, a network communication module, and a live streaming media data low-latency transmission program.

[0065] In Figure 5 FIG. 5, the network communication module is mainly used to connect to the server and can communicate with the server for data; while the processor 1001 can call the live streaming media data low-latency transmission program stored in the memory 1005 and execute the steps in the above various embodiments.

[0066] Based on the above hardware structure of the live streaming media data low-latency transmission device, various embodiments for implementing the live streaming media data low-latency transmission method of the present invention are realized.

[0067] In addition, the present invention further provides a live streaming media data low-latency transmission system. Please refer to Figure 6 FIG. 6, the live streaming media data low-latency transmission system includes: The data acquisition module A10 is used to determine the audience interaction data and network delay of adjacent transmission data packets within their respective time periods; The live broadcast analysis module A20 is used to determine the redundancy change degree of the live broadcast effective interactivity between adjacent transmission data packets by using the audience interaction data; The redundancy processing module A30 is used to determine the target redundancy level of the current transmission data packet by using the redundancy change degree and network delay and perform redundancy transmission based on the target redundancy level.

[0068] Furthermore, the data acquisition module A10 is further used to: Determine the number of audiences, the viewing duration of each audience, and the interaction content within the respective time periods of adjacent transmission data packets; Use the number of audiences, the viewing duration of each audience, and the interaction content as the audience interaction data.

[0069] Furthermore, the live broadcast analysis module A20 is further used to: Determine the consistency of the interaction content between the target audience and any other audience by using the interaction content of each audience; Determine the audience interactivity of the target audience within the respective time periods of adjacent transmission data packets by using the interaction content consistency and the number of audiences; Determine the redundancy change degree of the live broadcast effective interactivity between adjacent transmission data packets by using the audience interactivity.

[0070] Furthermore, the live broadcast analysis module A20 is further used to: Determine the effectiveness of the audience interaction of the target audience by using the viewing duration of each audience; Determine the redundancy change degree of the live broadcast effective interactivity between adjacent transmission data packets by using the audience interactivity and the effectiveness of the audience interaction.

[0071] Furthermore, the live broadcast analysis module A20 is further used to: Determine the target viewing duration of the target audience, the longest viewing duration and the shortest viewing duration among the viewing durations of all audiences; Calculate the effectiveness of the audience interaction of the target audience by using the target viewing duration, the longest viewing duration, and the shortest viewing duration.

[0072] Furthermore, the live broadcast analysis module A20 is further used to: Calculate the live broadcast effective interactivity of adjacent transmission data packets respectively by using the audience interactivity and the effectiveness of the audience interaction of adjacent transmission data packets; Compare the live broadcast effective interactivity of adjacent transmission data packets respectively to obtain the redundancy change degree of the live broadcast effective interactivity.

[0073] Further, the redundancy processing module A30 is further configured to: Determine the corrected target redundancy change degree of the current transmission data packet by using the redundancy change degree and the network delay. Determine the target redundancy level of the current transmission data packet by using the target redundancy change degree and perform redundancy transmission based on the target redundancy level.

[0074] Further, the redundancy processing module A30 is further configured to: Calculate the corrected target redundancy change degree of the current transmission data packet by using the redundancy change degree and the network delay gap between adjacent transmission data packets.

[0075] Further, the redundancy processing module A30 is further configured to: Determine the last redundancy level of the previous transmission data packet. Calculate the target redundancy level of the current transmission data packet by using the target redundancy change degree and the last redundancy level. Perform redundancy transmission on the current transmission data packet based on the target redundancy level.

[0076] Further, the redundancy processing module A30 is further configured to: When the formation of the current transmission data packet and the replication according to the target redundancy level are completed, generate the next transmission data packet. Use the next transmission data packet as the current transmission data packet, and loop to execute the step of determining the audience interaction data and network delay of adjacent transmission data packets in their respective time periods until the live broadcast ends.

[0077] The specific implementation manner of the live streaming media data low-latency transmission system of the present invention is basically the same as each embodiment of the above live streaming media data low-latency transmission method, and will not be described in detail here.

[0078] In addition, the present invention further provides a computer-readable storage medium. A live streaming media data low-latency transmission program is stored on the computer-readable storage medium of the present invention. When the live streaming media data low-latency transmission program is executed by a processor, the steps of the live streaming media data low-latency transmission method as described above are implemented.

[0079] Wherein, the method implemented when the live streaming media data low-latency transmission program is executed can refer to each embodiment of the live streaming media data low-latency transmission method of the present invention, and will not be described in detail here.

[0080] It should be noted that: the above sequence of embodiments of the present invention is only for description and does not represent the advantages and disadvantages of the embodiments. The processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0081] Each embodiment in this specification is described in a progressive manner. For the same or similar parts among the embodiments, reference can be made to each other, and the key point of each embodiment is to illustrate the differences from other embodiments.

[0082] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, a system, or a computer program product. Therefore, the present invention can be implemented in the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can be implemented in the form of a computer program product on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0083] The above are only the preferred embodiments of the present invention, and do not limit the protection scope of the present invention accordingly. Any equivalent structural / method transformation made by using the description and drawings of the present invention under the inventive concept of the present invention, or any direct / indirect application in other related technical fields, is included in the protection scope of the present invention.

Claims

1. A low-latency transmission method for live streaming media data, characterized in that: The method comprises: Determine audience interaction data and network latency of adjacent transmission packets in respective time periods; Using audience interaction data to determine the degree of redundant variation in live broadcast effective interactivity between adjacent transmitted data packets; Using the redundancy variation degree and network delay, determine the target redundancy level of the currently transmitted data packet and perform redundant transmission based on the target redundancy level; The adjacent transmission data packets include a current transmission data packet and its corresponding last transmission data packet.

2. The low-delay transmission method for live streaming media data according to claim 1, characterized in that: The step of determining audience interaction data of adjacent transmission data packets in respective time periods includes: Determine the number of viewers, viewing time and interactive content of each viewer in each time period of adjacent transmission data packets; The number of viewers, the viewing time of each viewer, and the interactive content are used as audience interaction data.

3. The low-delay transmission method for live streaming media data according to claim 2, characterized in that: The method of using the audience interaction data to determine the degree of redundant variation of the live broadcast effective interactivity between adjacent transmission data packets includes: Use the interactive content of each audience to determine the consistency of interactive content between the target audience and any other audience; Determine audience interactivity of target audiences of adjacent transmission packets in respective time periods using interactive content consistency and audience numbers; The audience interactivity is used to determine the redundant variation degree of the live broadcast effective interactivity between adjacent transmitted data packets.

4. The low-delay transmission method for live streaming media data according to claim 3 is characterized in that: The method of utilizing audience interactivity to determine the degree of redundant variation of live broadcast effective interactivity between adjacent transmission data packets includes: Determine the effectiveness of audience engagement for target audiences using viewing time of each audience; The audience interactivity and audience interaction effectiveness are used to determine the redundant variation degree of live broadcast effective interactivity between adjacent transmission data packets.

5. The low-delay transmission method for live streaming media data according to claim 4, characterized in that: Determining the audience interaction effectiveness of the target audience by using the viewing time of each audience member includes: Determine the target viewing time of the target audience, the longest viewing time and the shortest viewing time among all audiences; The audience interaction effectiveness of the target audience is calculated using the target viewing time, the longest viewing time, and the shortest viewing time.

6. The low-delay transmission method for live streaming media data according to claim 4, characterized in that: The method of using audience interactivity and audience interaction effectiveness to determine the degree of redundant variation of live broadcast effective interactivity between adjacent transmission data packets includes: Using the audience interactivity and audience interaction effectiveness of each adjacent transmission data packet, the live broadcast effective interactivity of each adjacent transmission data packet is calculated; The live broadcast effective interactivity of adjacent transmission data packets is compared to obtain the redundant variation degree of the live broadcast effective interactivity.

7. The low-delay transmission method for live streaming media data according to claim 1, characterized in that: The method of using the redundancy variation degree and the network delay to determine the target redundancy level of the currently transmitted data packet and performing redundant transmission based on the target redundancy level includes: Determine the target redundancy change degree after the current transmission data packet is corrected by using the redundancy change degree and network delay; The target redundancy level of the currently transmitted data packet is determined by utilizing the target redundancy variation degree, and redundant transmission is performed based on the target redundancy level.

8. The low-delay transmission method for live streaming media data according to claim 7, characterized in that: The method of determining the corrected target redundancy change degree of the current transmission data packet by using the redundancy change degree and the network delay includes: The target redundancy change degree after correction of the current transmission data packet is calculated by using the redundancy change degree and the network delay difference between adjacent transmission data packets.

9. The low-delay transmission method for live streaming media data according to claim 7, characterized in that: The method of using the target redundancy variation degree to determine the target redundancy level of the currently transmitted data packet and performing redundant transmission based on the target redundancy level includes: determining the last redundancy level of the last transmitted data packet; The target redundancy level of the currently transmitted data packet is calculated using the target redundancy change degree and the last redundancy level; The currently transmitted data packet is redundantly transmitted based on the target redundancy level.

10. The low-delay transmission method for live streaming media data according to claim 1, characterized in that: The method further comprises: determining a target redundancy level of a currently transmitted data packet by utilizing the redundancy variation degree and the network delay and performing redundant transmission based on the target redundancy level; and then: When the current transmission data packet is formed and replicated according to the target redundancy level, the next transmission data packet is generated; The next transmission data packet is used as the current transmission data packet, and the steps of determining the audience interaction data and network delay of adjacent transmission data packets in their respective time periods are executed cyclically until the live broadcast ends.

Images