Online live broadcast method, device and medium based on cloud network interconnection

By employing a cloud-network interconnected online live streaming method, and utilizing multi-angle acquisition, dynamic network load adjustment, and multi-dimensional optimization algorithms, the problem of low live streaming quality was solved, achieving high-quality live streaming content transmission and improved user experience.

CN118158451BActive Publication Date: 2024-11-08SHENZHEN OPTICAL NETWORK CENTURY TECH CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202410441276.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-04-12
Publication Date
2024-11-08
Estimated Expiration
2044-04-12

Smart Images

  • Figure CN118158451B_ABST
    Figure CN118158451B_ABST
Patent Text Reader

Abstract

The present invention relates to the field of Internet of Things technology, and discloses an online live broadcast method and device based on cloud network interconnection, including: detecting the initial live broadcast state of the online live broadcast, collecting multiple live broadcast angles of the online live broadcast, and extracting the real-time live broadcast content of the online live broadcast according to the multiple live broadcast angles; calculating the real-time network load value corresponding to the online live broadcast, and dynamically adjusting the resources of the storage cloud space of the real-time live broadcast content according to the real-time network load value; dynamically encoding the real-time live broadcast content in the optimal storage cloud space, and selecting the target encoded content corresponding to the target user in the live broadcast encoded content; distributing the target encoded content in real time, and monitoring the real-time content quality of the online live broadcast distribution content to obtain the content quality value; optimizing the content quality of the online live broadcast distribution content according to the content quality value, and executing the online live broadcast according to the optimized online live broadcast distribution content and the online live broadcast demand. The present invention can improve the live broadcast quality during online live broadcast.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of Internet of Things, and in particular to an online live broadcast method, device and medium based on cloud network interconnection. Background Art

[0002] With the vigorous development of the digital content industry, people's demand for high-quality content continues to increase. Online live broadcast platforms provide users with rich and diverse content, meet users' diverse needs, and promote the development of online live broadcast. In order to improve the user experience during online live broadcast, it is necessary to analyze the various influencing factors involved in the online live broadcast process in order to carry out better online live broadcast.

[0003] Most of the existing online live broadcast technologies use the real-time message transmission protocol to transmit the live broadcast content, and then display the live broadcast content on the user terminal interface. In actual applications, only using the real-time message transmission protocol to transmit content leads to insufficient network bandwidth, poor network conditions, and reduced live broadcast quality, resulting in the problem of low live broadcast quality during online live broadcast. Summary of the invention

[0004] The present invention provides an online live broadcast method, device and medium based on cloud network interconnection, the main purpose of which is to solve the problem of low live broadcast quality during online live broadcast.

[0005] To achieve the above-mentioned purpose, the present invention provides an online live broadcast method based on cloud network interconnection, comprising:

[0006] Detecting an initial live broadcast state of the online live broadcast according to a preset live broadcast plan, collecting multiple live broadcast angles of the online live broadcast when the initial live broadcast state meets the preset live broadcast state requirement, and extracting real-time live broadcast content of the online live broadcast according to the multiple live broadcast angles;

[0007] The real-time network load value corresponding to the online live broadcast is calculated by a preset multiple load fusion algorithm, including: generating a multicast source distribution tree of the online live broadcast; obtaining a load index corresponding to each node in the multicast source distribution tree; and calculating the real-time network load value corresponding to the online live broadcast according to the load index and a preset initial load weight using the following preset multiple load algorithm:

[0008]

[0009] Among them, Q t is the real-time network load value at time t, w i0 is the initial load weight of the i-th load indicator, k i is the weight adjustment speed of the i-th load indicator, b it is the change of the i-th load index at the t-th time, ait is the load value of the i-th load indicator at the t-th time;

[0010] Dynamically adjust the resources of the storage cloud space of the real-time live content according to the real-time network load value to obtain the optimal storage cloud space;

[0011] Dynamically encode the real-time live content in the optimal storage cloud space to obtain live encoded content, and select target encoded content corresponding to a target user from the live encoded content according to preset user terminal requirements;

[0012] Distributing the target encoded content in real time to obtain online live distribution content, and performing real-time content quality monitoring on the online live distribution content to obtain a content quality value;

[0013] The content quality of the online live broadcast distribution content is optimized according to the content quality value using a preset multi-dimensional optimization algorithm, and the online live broadcast is performed according to the optimized online live broadcast distribution content and preset online live broadcast requirements.

[0014] Optionally, detecting the initial live broadcast state of the online live broadcast according to a preset live broadcast plan includes:

[0015] Extracting multi-dimensional live broadcast attribute information in the live broadcast plan;

[0016] Determine the live broadcast attribute values ​​in the multi-dimensional live broadcast attribute information one by one;

[0017] When all the live broadcast attribute values ​​are at the preset target attribute threshold, determining that the initial live broadcast state of the online live broadcast is a waiting live broadcast state;

[0018] When any of the live broadcast attribute values ​​is not a preset target attribute threshold, it is determined that the initial live broadcast state of the online live broadcast is an abnormal state.

[0019] Optionally, extracting the real-time live content of the online live broadcast according to the multiple live broadcast angles includes:

[0020] Generate multiple video streams of the online live broadcast according to the multiple live broadcast angles;

[0021] Generate a mapping matrix between the multiple live broadcast angles and the multiple video streams;

[0022] Switching the target live broadcast angle in the mapping matrix in real time according to the preset live broadcast angle requirement;

[0023] The real-time live content of the online live broadcast is collected through the video stream corresponding to the target live broadcast angle.

[0024] Optionally, dynamically adjusting resources of the storage cloud space of the real-time live content according to the real-time network load value to obtain an optimal storage cloud space includes:

[0025] Monitor the load trend of the real-time network load value within a preset target time;

[0026] When the load trend is a continuous upward trend and the fluctuation value is greater than or equal to a preset load threshold, a preset resource dynamic change strategy is triggered according to a preset first factor, and an optimal storage cloud space is generated according to the resource dynamic change strategy;

[0027] When the load trend is a fluctuating trend, the weight change rate of each node in the multicast source distribution tree is calculated, wherein the weight change rate calculation formula is:

[0028]

[0029] Among them, f k is the weight change rate of node k, L k (t2) is the weight of node k at time t2, L k (t1 is the weight of node k at time t1;

[0030] Selecting the storage cloud space corresponding to the node with the smallest weight change rate as the optimal storage cloud space;

[0031] When the load trend is a stable trend, the storage cloud space corresponding to the real-time live content is used as the optimal storage cloud space.

[0032] Optionally, dynamically encoding the real-time live content in the optimal storage cloud space to obtain live encoded content includes:

[0033] Performing parameter encoding on the real-time live broadcast content to obtain content encoding parameters;

[0034] Generate a bit rate version corresponding to the real-time live content according to the content encoding parameters;

[0035] Packaging the real-time live broadcast content corresponding to the bit rate version into a streaming media format;

[0036] Generate a content link of the real-time live content according to the streaming media format;

[0037] Generate live encoded content corresponding to the real-time live content according to the content link.

[0038] Optionally, distributing the target encoded content in real time to obtain online live distribution content includes:

[0039] Obtaining the communication coverage area of ​​each distribution node in the multicast source distribution tree;

[0040] Extracting the geographic coordinates of the target user according to the preset live viewing request;

[0041] Determining whether the geographic coordinates are within the communication coverage area;

[0042] When the geographic coordinates are within the range of the communication coverage area and the load value of the communication coverage area meets a preset load threshold, a distribution server closest to the geographic coordinates is selected within the communication coverage area to distribute the target encoded content in real time to obtain online live distribution content;

[0043] When the geographic coordinates are within the range of the communication coverage area and the load value of the communication coverage area does not meet the preset load threshold, the live viewing request is stored in the buffer of the distribution node, and after a preset waiting time, the target encoded content corresponding to the live viewing request in the buffer is distributed in real time to obtain online live distribution content.

[0044] Optionally, the performing real-time content quality monitoring on the online live broadcast distribution content to obtain a content quality value includes:

[0045] Generate a content frame sequence of the online live broadcast distribution content;

[0046] Calculating the multidimensional quality factor corresponding to each frame in the content frame sequence one by one;

[0047] The quality value of each frame in the content frame sequence is calculated according to the multi-dimensional quality factor, wherein the quality value calculation formula is:

[0048]

[0049] Among them, Z h is the quality value corresponding to the hth frame, x hg is the multidimensional quality factor corresponding to the g-th multidimensional quality indicator in the h-th frame, and m is the number of quality indicators;

[0050] The quality value is superimposed as the content quality value of the online live broadcast distribution content.

[0051] Optionally, the optimizing the content quality of the online live broadcast distribution content according to the content quality value by using a preset multi-dimensional optimization algorithm includes:

[0052] Extracting external quality factors and internal quality factors corresponding to the content quality value;

[0053] The optimal content quality value of the online live broadcast distribution content is calculated according to the quality external factors and the quality internal factors using the following preset multi-dimensional optimization algorithm:

[0054]

[0055] Where R is the optimal content quality value, γ1 is the external factor control factor, γ2 is the internal factor control factor, arg max is the maximum value function, p(z h ∣x h ,θ h ) is the video parameter value x of the hth frame in the quality external factor h and the audio parameter value θ h Under the condition of h The probability, p(x h ,z h ,θ h is the video parameter value x at the hth frame h , the audio parameter value θ h , content quality value z h The probability of simultaneous occurrence, d hb is the control parameter value of the bth quality external factor at the hth frame, u is the number of frames of the online live broadcast distribution content, and log is the logarithmic function;

[0056] The optimization parameter corresponding to the best content quality value is selected to optimize the content quality of the online live distribution content.

[0057] In order to solve the above problem, the present invention further provides an electronic device, the electronic device comprising:

[0058] at least one processor; and,

[0059] a memory communicatively connected to the at least one processor; wherein,

[0060] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the above-mentioned online live broadcast method based on cloud network interconnection.

[0061] In order to solve the above problems, the present invention also provides a computer-readable storage medium, in which at least one computer program is stored. The at least one computer program is executed by a processor in an electronic device to implement the above-mentioned online live broadcast method based on cloud network interconnection.

[0062] The embodiment of the present invention detects whether the current online live broadcast state meets the preset live broadcast state requirements through a preset live broadcast plan to determine whether it is possible to start collecting real-time live broadcast content; once the initial live broadcast state meets the requirements, multiple live broadcast angles are collected and real-time live broadcast content is extracted to meet the user's needs for diversified viewing experience; the real-time network load value is calculated through a multiple load fusion algorithm, and the storage cloud space of the real-time live broadcast content is dynamically adjusted to ensure the best storage cloud space utilization; the real-time live broadcast content in the best storage cloud space is dynamically encoded to obtain live broadcast encoded content, and the target encoded content is selected according to the user terminal requirements to meet the needs of different terminal users; the target encoded content is distributed in real time to obtain online live broadcast distribution content, and then the online live broadcast distribution content is monitored in real time to obtain the content quality value, and the online live broadcast distribution content is optimized according to the content quality value using a multi-dimensional optimization algorithm to ensure the best quality of the content, and the online live broadcast is performed according to the optimized content to meet the preset online live broadcast requirements. Therefore, the online live broadcast method, device and medium based on cloud network interconnection proposed by the present invention can solve the problem of low live broadcast quality when performing online live broadcast. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] Figure 1 A schematic diagram of a process flow of an online live broadcast method based on cloud network interconnection provided by an embodiment of the present invention;

[0064] Figure 2 A schematic diagram of a process for calculating a real-time network load value provided by an embodiment of the present invention;

[0065] Figure 3 A schematic diagram of a process for encoding real-time live broadcast content provided by an embodiment of the present invention;

[0066] Figure 4 A schematic diagram of the structure of an electronic device for implementing the online live broadcast method based on cloud network interconnection provided in one embodiment of the present invention.

[0067] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0068] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0069] The embodiment of the present application provides an online live broadcast method based on cloud-network interconnection. The execution subject of the online live broadcast method based on cloud-network interconnection includes but is not limited to at least one of the electronic devices such as a server, a terminal, etc. that can be configured to execute the method provided by the embodiment of the present application. In other words, the online live broadcast method based on cloud-network interconnection can be executed by software or hardware installed on a terminal device or a server device, and the software can be a blockchain platform. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, etc. The server can be an independent server, or it can be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and big data and artificial intelligence platforms.

[0070] Reference Figure 1 FIG. 1 is a flow chart of an online live broadcast method based on cloud network interconnection provided by an embodiment of the present invention. In this embodiment, the online live broadcast method based on cloud network interconnection includes:

[0071] S1. Detect an initial live broadcast state of an online live broadcast according to a preset live broadcast plan. When the initial live broadcast state meets a preset live broadcast state requirement, collect multiple live broadcast angles of the online live broadcast, and extract real-time live broadcast content of the online live broadcast according to the multiple live broadcast angles.

[0072] In an embodiment of the present invention, the initial live broadcast state refers to the state before the online live broadcast starts, that is, whether the live broadcast is ready and about to start, or whether it has already started, which includes the waiting live broadcast state, the live broadcast state, and the abnormal state. By detecting the live broadcast state of the online live broadcast, it is possible to ensure that the live broadcast starts smoothly and avoid unnecessary waiting and anxiety of the user when waiting for the live broadcast to start, thereby improving the user's viewing experience.

[0073] In the embodiment of the present invention, the step of detecting the initial live broadcast state of the online live broadcast according to the preset live broadcast plan includes:

[0074] Extracting multi-dimensional live broadcast attribute information in the live broadcast plan;

[0075] Determine the live broadcast attribute values ​​in the multi-dimensional live broadcast attribute information one by one;

[0076] When all the live broadcast attribute values ​​are at the preset target attribute threshold, determining that the initial live broadcast state of the online live broadcast is a waiting live broadcast state;

[0077] When any of the live broadcast attribute values ​​is not a preset target attribute threshold, it is determined that the initial live broadcast state of the online live broadcast is an abnormal state.

[0078] In detail, the live broadcast plan includes relevant information such as the start time, end time, and live stream name of the live broadcast, while the multi-dimensional live broadcast attribute information includes live broadcast device attributes, live broadcast start time attributes, live broadcast theme attributes, and delay attributes. The live broadcast device attributes include the normal operation of the camera, microphone, network connection, etc., and the ability to capture video and audio normally. The network connection is stable. In the live broadcast room preset by the live broadcast platform, a test live broadcast link is used to test to confirm that the video and audio can be pushed to the live broadcast platform normally, and the delay during the live broadcast process is observed to ensure that the delay is within an acceptable range and does not affect the audience's viewing experience.

[0079] Specifically, the extracted live broadcast attribute information is parsed, and each attribute value is determined one by one. When all the detections of the live broadcast device in the multi-dimensional live broadcast attribute information are normal, the live broadcast attribute value corresponding to the live broadcast device attribute is 1, otherwise, there is an abnormality in the detection of any item in the live broadcast device, and its live broadcast attribute value is 1; the live broadcast start time and live broadcast theme attributes are detected, and if they meet the requirements, their live broadcast attribute value is 1, otherwise it is 0; the latency is detected, and if the latency meets the requirements, its live broadcast attribute value is 1, otherwise it is 0. Only when all the live broadcast attributes are 1, it means that there is no abnormal situation and the live broadcast can be prepared at any time, that is, the initial live broadcast state of the online live broadcast is the waiting live broadcast state; and when as long as there is a live broadcast attribute value that is not 1, it means that there is an abnormal state, and the online live broadcast should no longer be carried out. The relevant problems need to be resolved before the live broadcast can be carried out, that is, the initial live broadcast state of the online live broadcast is the abnormal state.

[0080] Furthermore, only when the initial live broadcast state meets the preset live broadcast state requirements, that is, all live broadcast attributes are 1, it is necessary to enter the live broadcast state. At this time, it is necessary to collect multiple live broadcast angles of the online live broadcast, where the multiple live broadcast angles include the speaker's perspective, which is a perspective centered on the speaker, showing the speaker's expression, movements and speech content; the panoramic perspective shows the overall situation of the live broadcast site from a panoramic perspective, including the audience seats, stage layout, etc.; the interactive perspective captures the interaction between the speaker and the audience, including question sessions, interactive games, etc., the close-up perspective shows the details of the speaker or specific objects through close-up shots, allowing the audience to be more focused and have a deeper understanding, the background perspective shows the design, layout and atmosphere creation of the live broadcast background, and increases the artistic sense and atmosphere of the live broadcast site; the real-scene perspective shows the real scene of the live broadcast event location, including architectural scenery, natural environment, etc., giving the audience a more real feeling, and the backstage perspective shows the operation and preparation of the behind-the-scenes staff to show the audience the hard work behind the live broadcast. Different perspectives can be captured through multiple cameras or multiple acquisition devices. After the live broadcast starts, start collecting content from multiple live broadcast angles. According to the changes and focus of the live broadcast content, different angles are switched in time through multiple video streams to enrich the audio-visual experience of the live broadcast.

[0081] Furthermore, through multiple live broadcast angles, live broadcast perspective content of online live broadcasts from different angles can be obtained, which can provide viewers with a richer viewing experience. Viewers can choose different angles to watch the live content, so as to better understand and feel the overall picture of the activity or event, and can capture different scenes and perspectives, thereby enhancing the visual presentation of the live content.

[0082] In the embodiment of the present invention, the real-time live broadcast content refers to the video, audio and other related data transmitted in real time by the live broadcast platform during the live broadcast process. The real-time live broadcast content is generated and published instantly, and the audience can watch and participate in real time during the live broadcast process.

[0083] In the embodiment of the present invention, extracting the real-time live content of the online live broadcast according to the multiple live broadcast angles includes:

[0084] Generate multiple video streams of the online live broadcast according to the multiple live broadcast angles;

[0085] Generate a mapping matrix between the multiple live broadcast angles and the multiple video streams;

[0086] Switching the target live broadcast angle in the mapping matrix in real time according to the preset live broadcast angle requirement;

[0087] The real-time live content of the online live broadcast is collected through the video stream corresponding to the target live broadcast angle.

[0088] In detail, multiple cameras or other acquisition devices are used to capture different live broadcast angles and generate multiple video streams. The video stream captured by each camera represents a different live broadcast angle, that is, to extract the real-time content of online live broadcast, it is necessary to select the corresponding camera source or video stream for acquisition according to different live broadcast angles. By setting up multiple cameras or using multiple video streams, content acquisition from different angles can be achieved, thereby presenting diversified live broadcast content. During the live broadcast process, operators can flexibly switch different camera sources as needed to display different perspectives and content, increasing the richness and attractiveness of the live broadcast.

[0089] Specifically, a mapping matrix is ​​created to map each live broadcast angle with its corresponding video stream. Each row of the mapping matrix represents a live broadcast angle, and each column represents a video stream. By filling in the elements in the matrix, the video stream corresponding to each live broadcast angle is determined, and then the switching is triggered according to the trigger conditions. For example, according to the specific timing of the live broadcast content, the audience interaction, the host's instructions, etc., the target live broadcast angle in the mapping matrix is ​​switched in real time. According to the switched target live broadcast angle, the corresponding video stream is collected as the real-time live broadcast content. This can be achieved through programming languages ​​​​(such as Python, JavaScript, etc.) combined with the API of the live broadcast platform, so as to process and present the collected real-time live broadcast content, including video encoding and decoding, picture adjustment, audio processing and other steps to ensure the final live content quality and viewing experience.

[0090] Furthermore, during the live broadcast process, it is necessary to dynamically adjust resource allocation according to the actual live broadcast traffic situation to ensure the stability and smoothness of the live broadcast content transmission. Therefore, it is necessary to analyze the network load during online live broadcast and reasonably allocate network resources to ensure the sequential operation of various components during the online live broadcast process.

[0091] S2. Calculate the real-time network load value corresponding to the online live broadcast through a preset multiple load fusion algorithm, and dynamically adjust the resources of the storage cloud space of the real-time live broadcast content according to the real-time network load value to obtain the optimal storage cloud space.

[0092] In an embodiment of the present invention, the real-time network load value refers to the load condition of the network at a certain moment, that is, information such as the data traffic, number of connections, load status, etc. currently carried by the network, which is used to reflect the current load status and performance of the online live broadcast network.

[0093] In the embodiment of the present invention, referring to Figure 2 As shown, the real-time network load value corresponding to the online live broadcast is calculated by a preset multiple load fusion algorithm, including:

[0094] S21, generating a multicast source distribution tree for the online live broadcast;

[0095] S22, obtaining a load indicator corresponding to each node in the multicast source distribution tree;

[0096] S23, using the following preset multiple load algorithm to calculate the real-time network load value corresponding to the online live broadcast according to the load index and the preset initial load weight:

[0097]

[0098] Among them, Q t is the real-time network load value at time t, w i0is the initial load weight of the i-th load indicator, k i is the weight adjustment speed of the i-th load indicator, b it is the change of the i-th load index at the t-th time, a it is the load value of the i-th load indicator at the t-th time.

[0099] In detail, according to the network topology of online live broadcast and the characteristics of multicast transmission, a multicast source distribution tree is generated. The multicast source distribution tree is usually a tree structure with a source node as a root node and a receiving node as a leaf node, which is used to effectively distribute the live stream to each audience. The multicast source distribution tree has a source node as a root node and a distribution server as a leaf node, which is then distributed to the audience by the distribution server, forming a distribution tree composed of multiple two paths. Each node in the multicast source distribution tree, including a source node and a receiving node, plays a different role in the real-time network load calculation. The source node is responsible for publishing the live stream, and the receiving node is responsible for receiving the live stream and forwarding it to the downstream node. For each node, its corresponding load index is obtained. These indicators may include network bandwidth utilization, delay rate, packet loss rate, and network congestion level. Then, the network load value corresponding to the online live broadcast at each moment is calculated based on the load index obtained in real time and the initial load weight corresponding to each load index set in advance.

[0100] Specifically, the initial load weight of each load indicator is pre-defined, where bandwidth utilization reflects the rate at which data is transmitted in the network, and has a very important impact on the network load. If the bandwidth utilization is too high, it will increase the data transmission delay and even packet loss. Therefore, you can consider giving it a higher weight, such as setting the weight to 0.4 or higher; delay refers to the time required for data to travel from the sender to the receiver. For online live broadcast scenarios, delay is a very important indicator. Lower delay can improve the user's viewing experience, so you can consider giving it a higher weight, such as setting the weight to 0.6 or higher; packet loss rate refers to the proportion of data packets lost during data transmission, which can cause video freezes or graphics. The surface is not coherent. Although the packet loss rate is also an important indicator, its impact may be lower than bandwidth utilization and delay in general. You can consider giving it a lower weight, such as setting the weight to 0.2. The degree of network congestion reflects the degree to which the data flow in the network exceeds the processing capacity of the network equipment, which will directly affect indicators such as delay and packet loss rate. Although its impact is high, it can usually be alleviated by adjusting other indicators. Therefore, you can consider giving it a medium weight, such as setting the weight to 0.1. The sum of all weights of the initial load weight of each load indicator is 1, where the weight adjustment speed is configured in the multiple load algorithm, which indicates the speed or sensitivity of the weight adjustment. The weight adjustment speed k i The value of will affect the speed of change of weight in unit time, k iThe value of will affect the speed of change of weight in unit time. i A value of k will make the weights tend to adjust faster to follow changes in the indicator, while a smaller k i If you need to quickly respond to changes in indicators and adjust weights to maintain the stability of live broadcast performance, you can choose a larger k i If the k value is too small, the weight will adjust faster to follow the change of the indicator; if you want the weight to change relatively smoothly and slowly to avoid frequent weight fluctuations, you can choose a smaller k. i The value can reduce the speed of weight change and make the online live network state more stable. The change of the i-th load indicator at the t-th time b it It is the difference between the load values ​​of the load indicator measured at the current time t and the time t-1, that is, the change in the load indicator, so that the real-time network load value corresponding to the online live broadcast can be calculated, so as to better monitor and manage network resources, ensure the smoothness and stability of the live broadcast, adapt to the changes in network load, and thus ensure the audience's viewing experience.

[0101] Furthermore, according to the network load, the storage cloud space resources can be analyzed and adjusted in time to make more reasonable use of resources, avoid waste or shortage of resources, better adapt to changes in network load, and improve the performance of storing and transmitting live content.

[0102] In an embodiment of the present invention, the optimal storage cloud space refers to the cloud storage space that is most suitable for storing real-time live broadcast content at a specific moment, ensuring that the live broadcast content can be stored and transmitted in an efficient and stable manner to meet the user's demand for real-time live broadcast and ensure the quality of user experience.

[0103] In an embodiment of the present invention, dynamically adjusting resources of the storage cloud space of the real-time live content according to the real-time network load value to obtain the optimal storage cloud space includes:

[0104] Monitor the load trend of the real-time network load value within a preset target time;

[0105] When the load trend is a continuous upward trend and the fluctuation value is greater than or equal to a preset load threshold, a preset resource dynamic change strategy is triggered according to a preset first factor, and an optimal storage cloud space is generated according to the resource dynamic change strategy;

[0106] When the load trend is a fluctuating trend, the weight change rate of each node in the multicast source distribution tree is calculated, wherein the weight change rate calculation formula is:

[0107]

[0108] Among them, f k is the weight change rate of node k, L k (t2) is the weight of node k at time t2, L k (t1 is the weight of node k at time t1;

[0109] Selecting the storage cloud space corresponding to the node with the smallest weight change rate as the optimal storage cloud space;

[0110] When the load trend is a stable trend, the storage cloud space corresponding to the real-time live content is used as the optimal storage cloud space.

[0111] Specifically, within a preset time, the change trend of the real-time network load value will be monitored to determine whether the load trend of the network load of the online live broadcast is rising, fluctuating or stable. When the load trend is a continuous rising trend and the fluctuation value is greater than or equal to the preset load threshold (large fluctuation), the resource dynamic change strategy is triggered according to the preset first factor to generate the best storage cloud space, adjust the storage resources according to the real-time situation, and ensure sufficient space for storing live content to cope with the increasing load demand, wherein the first factor refers to the triggering condition in the resource dynamic change strategy, and the resource dynamic change strategy includes operations such as expanding storage capacity, adding storage nodes, optimizing data storage methods, and backup links. The first trigger factor includes trigger condition A, B, C, D, then the resource policy corresponding to trigger condition A is to expand storage capacity, the resource policy corresponding to trigger condition B is to add storage nodes, the resource policy corresponding to trigger condition C is to optimize data storage methods, and the resource policy corresponding to trigger condition D is backup links. Trigger condition A means that when the network load growth rate exceeds the threshold, the strategy of expanding storage capacity will be triggered; trigger condition B means that when the network load fluctuates greatly or reaches a certain level, the strategy of adding storage nodes will be triggered; trigger condition C means that when it is found that the storage resource utilization rate is low or there are problems such as storage fragmentation, the strategy of optimizing data storage methods can be triggered; trigger condition D means that when it is detected that the main storage link fails or the performance is degraded, the strategy of the backup link can be triggered.

[0112] Specifically, when the network load shows a fluctuating trend, the weight change rate of each node in the multicast source distribution tree is calculated. The weight change rate is calculated by dividing the difference in the weight of the node at two moments by the time interval. The weight value range is between 0 and 1. By calculating the weight change rate, the load change trend of each node can be monitored in real time, and the resource allocation strategy can be better optimized. If the weight change rate of a node continues to increase, it may mean that the node needs more resources to cope with the increase in load. Therefore, it is possible to consider adjusting resource allocation to meet demand. Potential problems can also be identified. For example, a sudden increase or decrease in the load of a node may mean node failure, network congestion or other abnormal conditions. Timely detection of these problems can help reduce the risk of failure. The load balancer selects the optimal back-end server to respond to and process user requests based on the weights of each back-end server, and t2>t1, f k It represents the weight change rate of the node within a period T, that is, the weight change rate within the target time. If it exceeds the target time, the weight change rate needs to be recalculated, and then the storage cloud space corresponding to the node with the smallest weight change rate will be selected as the optimal storage cloud space, so as to select the most stable storage node to store the live content to ensure stable content distribution; when the network load trend is stable, the storage cloud space corresponding to the real-time live content will be directly used as the optimal storage cloud space, indicating that the network storage space for online live broadcast believes that the current storage settings are the most suitable and no adjustment is required.

[0113] Furthermore, in order to adapt to the characteristics and resolutions of different users' devices, it is necessary to analyze the real-time live content, thereby expanding the coverage of the live content to adapt to different network environments and user devices, thereby providing a better viewing experience.

[0114] S3. Dynamically encode the real-time live content in the optimal storage cloud space to obtain live encoded content, and select target encoded content corresponding to the target user from the live encoded content according to preset user terminal requirements.

[0115] In an embodiment of the present invention, the live encoded content refers to adaptive bitrate encoding, which allows the same video content to be encoded into multiple versions with different bitrates, and dynamically selects the most suitable bitrate version for playback based on the audience's network conditions and device performance, thereby improving the audience's experience of watching videos under different network conditions and avoiding video freezes or buffering processes.

[0116] In the embodiment of the present invention, referring to Figure 3 As shown, the real-time live content in the optimal storage cloud space is dynamically encoded to obtain live encoded content, including:

[0117] S31, performing parameter encoding on the real-time live broadcast content to obtain content encoding parameters;

[0118] S32, generating a bit rate version corresponding to the real-time live content according to the content encoding parameters;

[0119] S33, packaging the real-time live broadcast content corresponding to the bit rate version into a streaming media format;

[0120] S34, generating a content link of the real-time live content according to the streaming media format;

[0121] S35: Generate live encoded content corresponding to the real-time live content according to the content link.

[0122] In detail, according to the characteristics of the real-time live content and the network environment, the video is encoded with parameters, including bit rate, bit rate, and encoding format, and then different bit rate versions of the live content are generated according to the parameter encoding. The original video content is encoded to generate multiple video versions with different bit rates, usually including high, medium, and low bit rate versions, corresponding to higher, moderate, and lower clarity and image quality, respectively, to adapt to different network bandwidths and device performance. The high bit rate version is suitable for high-bandwidth environments and high-resolution devices, and the low bit rate version is suitable for low-bandwidth environments and low-performance devices.

[0123] Specifically, the video is divided into several segments, and the length of each segment is generally from a few seconds to more than ten seconds. Then, different bit rate versions of the video are generated for each segment, and the generated bit rate version of the live content is packaged into a streaming media format, such as HLS (HTTP Live Streaming) or MPEG-DASH (Dynamic Adaptive Streaming over HTTP). The streaming media format can support dynamic switching of different bit rate versions to adapt to real-time network bandwidth and device performance, and generate corresponding content links for each bit rate version. These links can be provided to users through HTTP or other network protocols, and users can access live content of different bit rate versions through these links, which can better support adaptive bit rate playback, and create a playlist for each video version of different bit rate, including content links of each bit rate version. According to the content link, live encoding content is generated, which includes information of the live stream and content links of each bit rate version. Users can obtain all information of the real-time live content through the live encoding content, and select the appropriate bit rate version for playback according to their own needs, and then the real-time live content can be dynamically encoded, and the corresponding live encoding content can be generated to provide users with the best viewing experience.

[0124] Furthermore, the live broadcast encoded content can be analyzed for different terminal devices, which can avoid problems such as freezes and blurs caused by mismatched encoding, thereby improving user experience and avoiding transmitting unnecessary high-bitrate versions to users, thereby saving bandwidth and server resources, helping to reduce the cost of the live broadcast platform and improving overall service efficiency.

[0125] In an embodiment of the present invention, the target coded content refers to the content most suitable for target users to play, selected from the live coded content according to the user terminal requirements and device characteristics. The target coded content is usually the best matching version after matching and screening to ensure that users can obtain the best viewing experience when watching live broadcasts. The target coded content includes video bit rate versions suitable for the target user's device resolution, network bandwidth and performance, etc., which allows users to watch live content smoothly on different devices and network environments, providing a better user experience.

[0126] In the embodiment of the present invention, the selecting of target coded content corresponding to the target user from the live coded content according to the preset user terminal requirement includes:

[0127] Determine the terminal encoding parameters corresponding to the target user according to the preset user terminal requirements;

[0128] Matching the terminal encoding parameters with the encoding parameters in the live encoding content to obtain matching encoding parameters;

[0129] The target coding content corresponding to the target user is selected according to the matching coding parameters.

[0130] In detail, in the live encoded content, different target encoded contents can be selected for different terminal requirements and network conditions to provide video streams suitable for user devices and network conditions. It is necessary to understand the device types, network conditions, and viewing habits used by the target user group, which can help determine the user's requirements for video quality and the performance limitations of the device. There will be a set of preset encoding parameters, and the most suitable parameters can be selected according to the user terminal situation. Then, according to the user terminal requirements, suitable terminal encoding parameters such as resolution, bit rate, frame rate, encoding format, etc. are determined, and the terminal encoding parameters of the target user are matched with the encoding parameters of each bit rate version in the live encoded content. The matching principle is usually to select the encoding parameters that are closest to or adapted to the target user terminal requirements. According to the matched encoding parameters, the corresponding target encoded content is selected as the playback content of the target user, and one or more bit rate versions closest to the target user terminal encoding parameters are selected as the target encoded content. A corresponding content link is generated for the selected target encoded content so that the target user can access and watch the live content through the link, which can better meet the user's needs and improve the fluency and quality of the user's viewing of the live content. At the same time, it can also effectively reduce the freeze or buffering phenomenon that occurs during the live broadcast.

[0131] Furthermore, in order to ensure that users can obtain high-quality and smooth viewing experience in different terminal devices and network environments, it is necessary to distribute the target encoded content, thereby bringing a better viewing experience and saving bandwidth and resources.

[0132] S4. Distribute the target encoded content in real time to obtain online live distribution content, and perform real-time content quality monitoring on the online live distribution content to obtain a content quality value.

[0133] In an embodiment of the present invention, the online live broadcast content distribution refers to the process of transmitting the video, audio and other content generated in real time by the online live broadcast to the user end through the network, ensuring that the user can watch the events or programs happening in real time without being affected by network delays or bandwidth limitations.

[0134] In the embodiment of the present invention, the target encoded content is distributed in real time to obtain online live distribution content, including:

[0135] Obtaining the communication coverage area of ​​each distribution node in the multicast source distribution tree;

[0136] Extracting the geographic coordinates of the target user according to the preset live viewing request;

[0137] Determining whether the geographic coordinates are within the communication coverage area;

[0138] When the geographic coordinates are within the range of the communication coverage area and the load value of the communication coverage area meets a preset load threshold, a distribution server closest to the geographic coordinates is selected within the communication coverage area to distribute the target encoded content in real time to obtain online live distribution content;

[0139] When the geographic coordinates are within the range of the communication coverage area and the load value of the communication coverage area does not meet the preset load threshold, the live viewing request is stored in the buffer of the distribution node, and after a preset waiting time, the target encoded content corresponding to the live viewing request in the buffer is distributed in real time to obtain online live distribution content.

[0140] In detail, the communication range information of each distribution node in the multicast source distribution tree is obtained through the network topology structure, and the communication range information includes the geographical coordinates of each distribution node and the wireless signal coverage range. Then, when the user initiates a live viewing request, the geographical location information of the target viewing user is obtained through the GPS function or IP address positioning on the user device, and the geographical coordinates of the target user are compared with the communication range of each distribution node to determine whether the target user is within the communication range of a certain distribution node. If the user is within the communication range of a certain distribution node and the communication load of the node does not exceed the preset load threshold, the distribution server closest to the user will be selected instead of directly obtaining content from the original server, which can significantly reduce the data transmission time, reduce latency, and improve the live viewing experience, thereby distributing the target encoded content in real time, which can ensure that users can Obtain stable live content; if the user is within the communication range of a distribution node, but the communication load of the node exceeds the preset load threshold, the user's live viewing request will be stored in the buffer of the node. After the preset waiting time, the target coded content corresponding to the live viewing request in the buffer will be distributed in real time to avoid the degradation of live service quality under overload conditions. That is, after the waiting time is over, the system first checks whether there are pending live viewing requests in the buffer. If so, it will select a suitable distribution server according to the preset strategy, establish a connection between the selected distribution server and the corresponding target coded content, and start real-time content distribution. Users can receive and watch the real-time distributed content through their devices; when the geographic coordinates are not within the range of the communication coverage area and the load value of the communication coverage area does not meet the preset load threshold, the user's access is denied. At the same time, it is necessary to continuously monitor the user's connection status and the load of the distribution server, and make timely adjustments to ensure the stability and quality of the service.

[0141] Furthermore, after the live content is distributed, it is also necessary to monitor the quality of the live content in real time, promptly detect problems such as image blur, freeze, and delay, and take measures to optimize or repair them, which is conducive to ensuring that users can enjoy a high-quality viewing experience and improve user satisfaction and loyalty.

[0142] In the embodiment of the present invention, the content quality value is an evaluation index of the overall quality of online live broadcast distribution content, reflecting the overall performance of the live broadcast content, including aspects such as video image clarity, color accuracy, motion smoothness, etc. The higher the content quality value, the better the quality of the live broadcast content and the better the user experience.

[0143] In the embodiment of the present invention, the real-time content quality monitoring of the online live broadcast distribution content to obtain the content quality value includes:

[0144] Generate a content frame sequence of the online live broadcast distribution content;

[0145] Calculating the multidimensional quality factor corresponding to each frame in the content frame sequence one by one;

[0146] The quality value of each frame in the content frame sequence is calculated according to the multi-dimensional quality factor, wherein the quality value calculation formula is:

[0147]

[0148] Among them, Z h is the quality value corresponding to the hth frame, x hg is the multidimensional quality factor corresponding to the g-th multidimensional quality indicator in the h-th frame, and m is the number of quality indicators;

[0149] The quality value is superimposed as the content quality value of the online live broadcast distribution content.

[0150] In detail, the online live distribution content is divided into video streams, that is, a content frame sequence corresponding to the online live distribution content expressed frame by frame. For each frame, the multidimensional quality factor is calculated one by one, and the multidimensional quality factor is an evaluation value of the multidimensional index. If the requirements are met, the multidimensional quality factor is 1, and if the requirements are not met, the multidimensional quality factor is 0. The multidimensional indicators include a snowflake noise index, a screen freeze or signal loss index, a frame loss index, and a sound index. For example, the snowflake noise index is used to evaluate the noise level in the video. If the snowflake noise in the video reaches an acceptable level, the multidimensional quality factor is 1, otherwise it is 0; the sound index is used to evaluate the quality of the audio, including clarity, volume, etc. If the audio quality is good, the multidimensional quality factor is 1, otherwise it is 0, and it can be passed Among them I N (x,y) is the difference map I N The pixel value of IN The middle pixel is D n , according to D n The size of can be used to determine whether there is snowflake noise in the image to be tested, such as Where P is the initial snowflake discrimination value, N is the noise threshold, when the P value is 1, it is initially judged that there is snowflake noise in the image; the freezing of the monitoring video screen and the signal loss can be attributed to the same type of abnormal problem detection. When the monitoring video screen is frozen, the display feature on the screen is usually to always keep the same frame of monitoring screen, and the screen is still or suddenly jumps between frames and then remains still as time changes; when the monitoring video signal is lost, the display feature on the screen is a pure blue screen or gray screen phenomenon. These two abnormal phenomena have a common feature, that is, when the monitoring video screen freezes and the signal is lost, the content of the two adjacent frames of the video image remains unchanged. According to the common characteristics of the screen freezing and signal loss, the screen abnormality I is detected by the adjacent frame images. N =|II P |, where I N is the difference image, I is the image to be detected, I P is the previous frame of image I. Using V I =Var(I N ) Calculate the difference image I N Variance V I , according to V I The size determines whether the image is abnormal, that is, Where T v is the discrimination threshold, S is the abnormal discrimination factor, when S is 1, the image is abnormal; otherwise, the image is normal; when the image to be detected meets the abnormal condition of S=1, continue to test the N frames of video after the frame image, if the abnormal condition is met continuously, it is determined that the monitoring video image is frozen or the signal is lost; for a frame of image to be tested I, the image size is M×N, N pixels are intercepted horizontally in the middle of the image, and M pixels are intercepted vertically, and the grayscale richness C1 of these M+N pixels is counted, and the formula is used Judging the image quality, T C Grayscale richness threshold, C is the frame loss discrimination factor. When the C value is 1, it can be determined that the video image has frame loss. Detect whether the sound is intermittent. Use time domain analysis technology, such as waveform diagram or time domain waveform analysis, to observe the continuity of the sound signal. If the sound signal shows discontinuous characteristics in the time domain, it may indicate that there is an intermittent phenomenon. If there is intermittent sound, the sound factor in its multidimensional quality factor is 0, otherwise the sound factor is 1.

[0151] Specifically, for each frame, its multi-dimensional quality factors are weighted and summed to obtain the quality value of the frame. The quality value is calculated as the weighted sum of the quality factors. The quality value of each frame is accumulated or averaged to obtain the content quality value of the entire online live distribution content. Real-time quality monitoring of online live distribution content can be achieved. Real-time monitoring and evaluation of content quality values ​​are crucial for optimizing online live services and improving user experience.

[0152] Furthermore, the content quality of online live broadcast content can be optimized according to the content quality value, which can improve the viewing experience of online live broadcast. By optimizing the stability of video images and reducing frame loss and intermittent sound, users can get smoother, clearer and more stable audio-visual effects when watching live broadcasts, thereby improving user satisfaction.

[0153] S5. Utilize a preset multi-dimensional optimization algorithm to optimize the content quality of the online live broadcast distribution content according to the content quality value, and execute the online live broadcast according to the optimized online live broadcast distribution content and preset online live broadcast requirements.

[0154] In the embodiment of the present invention, whether the online live broadcast distribution content needs to be optimized can be judged according to the size of the content quality value, thereby improving the content quality optimization efficiency. Optimizing the content quality can attract more viewers to watch and leave a good impression, making users more inclined to continue to pay attention to and watch subsequent live broadcast content.

[0155] In the embodiment of the present invention, the method of optimizing the content quality of the online live broadcast distribution content according to the content quality value by using a preset multi-dimensional optimization algorithm includes:

[0156] Extracting external quality factors and internal quality factors corresponding to the content quality value;

[0157] The optimal content quality value of the online live broadcast distribution content is calculated according to the quality external factors and the quality internal factors using the following preset multi-dimensional optimization algorithm:

[0158]

[0159] Where R is the optimal content quality value, γ1 is the external factor control factor, γ2 is the internal factor control factor, arg max is the maximum value function, p(z h ∣x h ,θ h ) is the video parameter value x of the hth frame in the quality external factor h and the audio parameter value θ h Under the condition of h The probability, p(x h ,z h ,θh is the video parameter value x at the hth frame h , the audio parameter value θ h , content quality value z h The probability of simultaneous occurrence, d hb is the control parameter value of the bth quality external factor at the hth frame, u is the number of frames of the online live broadcast distribution content, and log is the logarithmic function;

[0160] The optimization parameter corresponding to the best content quality value is selected to optimize the content quality of the online live distribution content.

[0161] In detail, if there are 6 frames in total and 4 index factors in total, there are 24 in total. If the content quality value is less than 24, it needs to be optimized according to the optimization algorithm. If it is equal to 24, the current parameters can be maintained. When it is necessary to optimize the parameters through the multi-dimensional optimization algorithm, it is necessary to consider the external factors and internal factors of quality. The external factors of quality include the contrast, brightness and network bandwidth of the live screen. The internal factors of quality include video encoding parameters, such as bit rate, frame rate, compression ratio, and audio encoding parameters, such as bit rate and sampling rate. Then, the optimal parameter values ​​of the external factors and the internal factors of quality are determined through the multi-dimensional optimization algorithm. The multi-dimensional optimization algorithm It includes two parts. The first part is a probability model for content quality, which takes into account the relationship between video parameter values, audio parameter values ​​and content quality values. The second part is about the control parameter values ​​of external factors of quality. By calculating the probability model in the multidimensional optimization algorithm, the optimal video parameter values ​​and the optimal audio parameter values ​​determined under the condition of obtaining the optimal content quality value can be obtained, and the optimal parameter values ​​of contrast, brightness and network bandwidth in the external factors of quality can be determined under the condition of the optimal content quality. The optimal content quality value can be maximized by adjusting internal and external factors to obtain the best user experience and viewing effect.

[0162] Specifically, the external factor control factor γ1 and the internal factor control factor γ2 in the multidimensional optimization algorithm can flexibly adjust the algorithm's emphasis on external factors and internal factors, making the optimization results more controllable, thereby obtaining the expected optimal content quality value and optimization parameters. When the external factor value needs to be adjusted, γ1=0, γ2=1 will be configured. When the internal factor value needs to be adjusted, γ1=1, γ2=0 will be configured. When both the external factor value and the internal factor value need to be adjusted at the same time, γ1=1, γ2=1 will be configured. Once the optimal content quality value is obtained, the appropriate optimization parameters can be selected according to this value to perform quality control on the online live broadcast distribution content. Optimization. Optimization parameters include video encoding parameters, such as bit rate, frame rate, compression ratio, and audio encoding parameters, such as bit rate, sampling rate, contrast, brightness, and network bandwidth. In addition, you can also increase or decrease video resolution, adjust the audio spectrum, balance the volume of each frequency band, improve sound quality, use low-latency audio transmission technology, reduce sound transmission delay, and improve real-time performance; optimize node server bandwidth allocation to ensure sufficient bandwidth to support high-quality video and audio transmission, perform encoding optimization on video and audio, adjust network transmission parameters, and other operations to ensure that the content can achieve the best playback effect on different devices and network environments.

[0163] Furthermore, based on the user's online live broadcast needs, the optimized online live broadcast content is selected to correspond to the content that is of interest to the target audience and the platform specifications, and then the optimized online live broadcast content is distributed to the corresponding playback platform or server for users to watch. Once the online live broadcast content starts playing, it is necessary to continuously monitor the user's viewing situation and feedback information, and adjust the content quality and distribution strategy in time. The algorithm can be fed back and optimized according to the actual situation to further improve the quality of the online live broadcast and user experience. After the live broadcast, a review and summary will be conducted to analyze the live broadcast effect and audience feedback.

[0164] The embodiment of the present invention detects whether the current online live broadcast state meets the preset live broadcast state requirements through a preset live broadcast plan to determine whether it is possible to start collecting real-time live broadcast content; once the initial live broadcast state meets the requirements, multiple live broadcast angles are collected and real-time live broadcast content is extracted to meet the user's needs for diversified viewing experience; the real-time network load value is calculated through a multiple load fusion algorithm, and the storage cloud space of the real-time live broadcast content is dynamically adjusted to ensure the best storage cloud space utilization; the real-time live broadcast content in the best storage cloud space is dynamically encoded to obtain live broadcast encoded content, and the target encoded content is selected according to the user terminal requirements to meet the needs of different terminal users; the target encoded content is distributed in real time to obtain online live broadcast distribution content, and then the online live broadcast distribution content is monitored in real time to obtain the content quality value, and the online live broadcast distribution content is optimized according to the content quality value using a multi-dimensional optimization algorithm to ensure the best quality of the content, and the online live broadcast is performed according to the optimized content to meet the preset online live broadcast requirements. Therefore, the online live broadcast method, device and medium based on cloud network interconnection proposed by the present invention can solve the problem of low live broadcast quality when performing online live broadcast.

[0165] like Figure 4 The figure is a schematic diagram of the structure of an electronic device for implementing an online live broadcast method based on cloud network interconnection provided by one embodiment of the present invention.

[0166] The device may include a processor 10, a memory 11, a communication bus 12 and a communication interface 13, and may also include a computer program stored in the memory 11 and executable on the processor 10, such as an online live broadcast program based on cloud network interconnection.

[0167] In some embodiments, the processor 10 may be composed of an integrated circuit, for example, a single packaged integrated circuit, or a plurality of integrated circuits with the same or different functions, including one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and combinations of various control chips. The processor 10 is the control core (ControlUnit) of the electronic device, and uses various interfaces and lines to connect the various components of the entire electronic device, and executes or executes programs or modules stored in the memory 11 (for example, executing online live broadcast programs based on cloud network interconnection, etc.), and calls data stored in the memory 11 to execute various functions of the electronic device and process data.

[0168] The memory 11 includes at least one type of readable storage medium, and the readable storage medium includes a flash memory, a mobile hard disk, a multimedia card, a card-type memory (for example, SD or DX memory, etc.), a magnetic memory, a disk, an optical disk, etc. In some embodiments, the memory 11 may be an internal storage unit of an electronic device, such as a mobile hard disk of the electronic device. In other embodiments, the memory 11 may also be an external storage device of an electronic device, such as a plug-in mobile hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device. Further, the memory 11 may also include both an internal storage unit of the electronic device and an external storage device. The memory 11 can not only be used to store application software and various types of data installed in the electronic device, such as the code of an online live broadcast program based on cloud network interconnection, but also can be used to temporarily store data that has been output or is to be output.

[0169] The communication bus 12 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. The bus is configured to realize connection and communication between the memory 11 and at least one processor 10, etc.

[0170] The communication interface 13 is used for communication between the above-mentioned electronic device and other devices, including a network interface and a user interface. Optionally, the network interface may include a wired interface and / or a wireless interface (such as a WI-FI interface, a Bluetooth interface, etc.), which is generally used to establish a communication connection between the electronic device and other electronic devices. The user interface may be a display (Display), an input unit (such as a keyboard (Keyboard)), and optionally, the user interface may also be a standard wired interface, a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, and an OLED (Organic Light-Emitting Diode, organic light-emitting diode) touch device, etc. Among them, the display may also be appropriately referred to as a display screen or a display unit, which is used to display information processed in the electronic device and to display a visual user interface.

[0171] The figure only shows an electronic device with components. Those skilled in the art will understand that the structure shown in the figure does not constitute a limitation on the electronic device, and may include fewer or more components than shown in the figure, or combine certain components, or arrange the components differently.

[0172] For example, although not shown, the electronic device may also include a power source (such as a battery) for supplying power to each component. Preferably, the power source may be logically connected to the at least one processor 10 through a power management device, so that the power management device can realize functions such as charging management, discharging management, and power consumption management. The power source may also include one or more DC or AC power sources, recharging devices, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components. The electronic device may also include a variety of sensors, Bluetooth modules, Wi-Fi modules, etc., which will not be repeated here.

[0173] It should be understood that the embodiment is for illustration only and the scope of the patent application is not limited to this structure.

[0174] The online live broadcast program based on cloud network interconnection stored in the memory 11 in the electronic device is a combination of multiple instructions. When running in the processor 10, it can achieve:

[0175] Detecting an initial live broadcast state of the online live broadcast according to a preset live broadcast plan, collecting multiple live broadcast angles of the online live broadcast when the initial live broadcast state meets the preset live broadcast state requirement, and extracting real-time live broadcast content of the online live broadcast according to the multiple live broadcast angles;

[0176] The real-time network load value corresponding to the online live broadcast is calculated by a preset multiple load fusion algorithm, and the storage cloud space of the real-time live broadcast content is dynamically adjusted according to the real-time network load value to obtain the optimal storage cloud space;

[0177] Dynamically encode the real-time live content in the optimal storage cloud space to obtain live encoded content, and select target encoded content corresponding to a target user from the live encoded content according to preset user terminal requirements;

[0178] Distributing the target encoded content in real time to obtain online live distribution content, and performing real-time content quality monitoring on the online live distribution content to obtain a content quality value;

[0179] The content quality of the online live broadcast distribution content is optimized according to the content quality value using a preset multi-dimensional optimization algorithm, and the online live broadcast is performed according to the optimized online live broadcast distribution content and preset online live broadcast requirements.

[0180] Specifically, the specific implementation method of the processor 10 for the above instructions can refer to the description of the relevant steps in the corresponding embodiment of the accompanying drawings, which will not be repeated here.

[0181] Furthermore, if the module / unit integrated in the device is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. The computer-readable storage medium can be volatile or non-volatile. For example, the computer-readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a USB flash drive, a mobile hard disk, a magnetic disk, an optical disk, a computer memory, and a read-only memory (ROM).

[0182] The present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor of an electronic device, the computer program can implement:

[0183] Detecting an initial live broadcast state of the online live broadcast according to a preset live broadcast plan, collecting multiple live broadcast angles of the online live broadcast when the initial live broadcast state meets the preset live broadcast state requirement, and extracting real-time live broadcast content of the online live broadcast according to the multiple live broadcast angles;

[0184] The real-time network load value corresponding to the online live broadcast is calculated by a preset multiple load fusion algorithm, and the storage cloud space of the real-time live broadcast content is dynamically adjusted according to the real-time network load value to obtain the optimal storage cloud space;

[0185] Dynamically encode the real-time live content in the optimal storage cloud space to obtain live encoded content, and select target encoded content corresponding to a target user from the live encoded content according to preset user terminal requirements;

[0186] Distributing the target encoded content in real time to obtain online live distribution content, and performing real-time content quality monitoring on the online live distribution content to obtain a content quality value;

[0187] The content quality of the online live broadcast distribution content is optimized according to the content quality value using a preset multi-dimensional optimization algorithm, and the online live broadcast is performed according to the optimized online live broadcast distribution content and preset online live broadcast requirements.

[0188] In the several embodiments provided by the present invention, it should be understood that the disclosed methods, devices and media can be implemented in other ways. For example, the device embodiments described above are merely illustrative.

[0189] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0190] In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional modules.

[0191] It is obvious to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.

[0192] Therefore, the embodiments should be considered in all respects as illustrative and non-restrictive, and the scope of the invention is defined by the appended claims rather than the foregoing description, and it is therefore intended that all changes that fall within the meaning and range of equivalent elements of the claims are embraced in the present invention.

[0193] The embodiments of the present application can acquire and process relevant data based on artificial intelligence technology. Among them, artificial intelligence (AI) is the theory, method, technology and application device that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results.

[0194] In addition, it is clear that the word "comprising" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or devices stated in a device claim can also be implemented by one unit or device through software or hardware. The words first, second, etc. are used to indicate names, and do not indicate any particular order.

[0195] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present invention.

Claims

1. An online live broadcast method based on cloud network interconnection, characterized in that: The method comprises: Detecting an initial live broadcast state of the online live broadcast according to a preset live broadcast plan, collecting multiple live broadcast angles of the online live broadcast when the initial live broadcast state meets the preset live broadcast state requirement, and extracting real-time live broadcast content of the online live broadcast according to the multiple live broadcast angles; The real-time network load value corresponding to the online live broadcast is calculated by a preset multiple load fusion algorithm, including: generating a multicast source distribution tree of the online live broadcast; obtaining a load index corresponding to each node in the multicast source distribution tree; and calculating the real-time network load value corresponding to the online live broadcast according to the load index and a preset initial load weight using the following preset multiple load fusion algorithm: Among them, Q t is the real-time network load value at time t, w i0 is the initial load weight of the i-th load indicator, k i is the weight adjustment speed of the i-th load indicator, b it is the change of the i-th load index at the t-th time, a it is the load value of the i-th load indicator at the t-th time; Dynamically adjust the resources of the storage cloud space of the real-time live content according to the real-time network load value to obtain the optimal storage cloud space; Dynamically encode the real-time live content in the optimal storage cloud space to obtain live encoded content, and select target encoded content corresponding to a target user from the live encoded content according to preset user terminal requirements; Distributing the target encoded content in real time to obtain online live distribution content, and performing real-time content quality monitoring on the online live distribution content to obtain a content quality value; The content quality of the online live broadcast distribution content is optimized according to the content quality value using a preset multi-dimensional optimization algorithm, and the online live broadcast is performed according to the optimized online live broadcast distribution content and preset online live broadcast requirements.

2. The online live broadcast method based on cloud network interconnection as claimed in claim 1, characterized in that: The detecting the initial live broadcast state of the online live broadcast according to the preset live broadcast plan includes: Extracting multi-dimensional live broadcast attribute information in the live broadcast plan; Determine the live broadcast attribute values ​​in the multi-dimensional live broadcast attribute information one by one; When all the live broadcast attribute values ​​are at the preset target attribute threshold, determining that the initial live broadcast state of the online live broadcast is a waiting live broadcast state; When any of the live broadcast attribute values ​​is not a preset target attribute threshold, it is determined that the initial live broadcast state of the online live broadcast is an abnormal state.

3. The online live broadcast method based on cloud network interconnection as claimed in claim 1, characterized in that: The extracting the real-time live content of the online live broadcast according to the multiple live broadcast angles includes: Generate multiple video streams of the online live broadcast according to the multiple live broadcast angles; Generate a mapping matrix between the multiple live broadcast angles and the multiple video streams; Switching the target live broadcast angle in the mapping matrix in real time according to the preset live broadcast angle requirement; The real-time live content of the online live broadcast is collected through the video stream corresponding to the target live broadcast angle.

4. The online live broadcast method based on cloud network interconnection as claimed in claim 1, characterized in that: The dynamically adjusting the resources of the storage cloud space of the real-time live content according to the real-time network load value to obtain the optimal storage cloud space includes: Monitor the load trend of the real-time network load value within a preset target time; When the load trend is a continuous upward trend and the fluctuation value is greater than or equal to a preset load threshold, a preset resource dynamic change strategy is triggered according to a preset first factor, and an optimal storage cloud space is generated according to the resource dynamic change strategy; When the load trend is a fluctuating trend, the weight change rate of each node in the multicast source distribution tree is calculated, wherein the weight change rate calculation formula is: Among them, f k is the weight change rate of node k, L k (t2) is the weight of node k at time t2, L k (t1 is the weight of node k at time t1; Selecting the storage cloud space corresponding to the node with the smallest weight change rate as the optimal storage cloud space; When the load trend is a stable trend, the storage cloud space corresponding to the real-time live content is used as the optimal storage cloud space.

5. The online live broadcast method based on cloud network interconnection as claimed in claim 1, characterized in that: The step of dynamically encoding the real-time live content in the optimal storage cloud space to obtain the live encoded content includes: Performing parameter encoding on the real-time live broadcast content to obtain content encoding parameters; Generate a bit rate version corresponding to the real-time live content according to the content encoding parameters; Packaging the real-time live broadcast content corresponding to the bit rate version into a streaming media format; Generate a content link of the real-time live content according to the streaming media format; Generate live encoded content corresponding to the real-time live content according to the content link.

6. The online live broadcast method based on cloud network interconnection as claimed in claim 1, characterized in that: The target encoded content is distributed in real time to obtain online live distribution content, including: Obtaining the communication coverage area of ​​each distribution node in the multicast source distribution tree; Extracting the geographic coordinates of the target user according to the preset live viewing request; Determining whether the geographic coordinates are within the communication coverage area; When the geographic coordinates are within the range of the communication coverage area and the load value of the communication coverage area meets a preset load threshold, a distribution server closest to the geographic coordinates is selected within the communication coverage area to distribute the target encoded content in real time to obtain online live distribution content; When the geographic coordinates are within the range of the communication coverage area and the load value of the communication coverage area does not meet the preset load threshold, the live viewing request is stored in the buffer of the distribution node, and after a preset waiting time, the target encoded content corresponding to the live viewing request in the buffer is distributed in real time to obtain online live distribution content.

7. The online live broadcast method based on cloud network interconnection as claimed in claim 1, characterized in that: The real-time content quality monitoring of the online live broadcast distribution content to obtain a content quality value includes: Generate a content frame sequence of the online live broadcast distribution content; Calculating the multidimensional quality factor corresponding to each frame in the content frame sequence one by one; The quality value of each frame in the content frame sequence is calculated according to the multi-dimensional quality factor, wherein the quality value calculation formula is: Among them, Z h is the quality value corresponding to the hth frame, x hg is the multidimensional quality factor corresponding to the g-th multidimensional quality indicator in the h-th frame, and m is the number of quality indicators; The quality value is superimposed as the content quality value of the online live broadcast distribution content.

8. The online live broadcast method based on cloud network interconnection as claimed in claim 1, characterized in that: The optimizing the content quality of the online live broadcast distribution content according to the content quality value by using a preset multi-dimensional optimization algorithm includes: Extracting external quality factors and internal quality factors corresponding to the content quality value; The optimal content quality value of the online live broadcast distribution content is calculated according to the quality external factors and the quality internal factors using the following preset multi-dimensional optimization algorithm: Where R is the optimal content quality value, γ1 is the external factor control factor, γ2 is the internal factor control factor, argmax is the maximum value function, p(z h ∣x h ,θ h ) is the video parameter value x of the hth frame in the quality external factor h and audio parameter value θ h Under the condition of h The probability, p(x h ,z h ,θ h ) is the video parameter value x at the hth frame h , the audio parameter value θ h , content quality value z h The probability of simultaneous occurrence, d hb is the control parameter value of the bth quality external factor at the hth frame, u is the number of frames of the online live broadcast distribution content, and log is the logarithmic function; The optimization parameter corresponding to the best content quality value is selected to optimize the content quality of the online live distribution content.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the online live broadcast method based on cloud network interconnection as described in any one of claims 1 to 8.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by the processor, it implements the online live broadcast method based on cloud network interconnection as described in any one of claims 1 to 8.

Citation Information

Patent Citations

  • Method and system for video program playing in network broadcast

    CN105828091A

  • Live broadcast method and device

    CN106254916A

  • Live broadcast stream scheduling method and device, electronic equipment and readable storage medium

    CN113038191A

  • Video transmission method, multicast management platform, terminal and storage medium

    CN114339269A

  • Video coding adjustment method and device, storage medium and electronic equipment

    CN114466194A