An audio and video stream pulling method, system, server and medium

Abstract

The application discloses a kind of audio and video stream pulling method, system, server and medium, mainly related to audio and video field, which comprises: obtaining the level data of user in the live platform and the occupied bandwidth value of live server corresponding to live platform;According to the relationship between occupied bandwidth value and bandwidth threshold value, and level data determine the pulling type corresponding to user.Through the above method, avoid the problem that platform invests cost high or user delay long caused by using one pulling stream in platform for user in platform, so that user can be distributed different pulling type according to own level data and the relationship between occupied bandwidth value and bandwidth threshold value, realize the cost of platform is reduced while guaranteeing that user has good use experience;The audio and video stream pulling system, server and medium provided in the application have the same effect as the above method.

Description

Technical Field

[0001] This application relates to the field of audio and video, and in particular to a method, system, server, and medium for pulling audio and video streams. Background Technology

[0002] With the development of technology, the number of users watching live audio and video broadcasts is constantly increasing. The current strategies for users' clients to pull streams from the origin server mainly include: real-time audio and video retrieval strategy and content delivery network (CDN) retrieval strategy. Among them, the latency of the real-time audio and video retrieval strategy is generally within 300ms, which basically meets the business requirements of all live broadcasts; the latency of the CDN retrieval strategy is generally between 3s and 5s, which can only meet some basic business requirements.

[0003] However, while the real-time audio and video fetching strategy mentioned above offers low latency and a better user experience, the platform's investment costs are very high. On the other hand, the CDN fetching strategy has lower costs but high latency, which can affect the user experience. Platforms typically only provide users with one type of streaming strategy, which can lead to either higher platform costs or a lower user experience.

[0004] Therefore, how to design a current pulling method that effectively reduces costs while controlling the current pulling delay to a low value is a problem that urgently needs to be solved by those skilled in the art. Summary of the Invention

[0005] The purpose of this application is to provide a method, system, server, and medium for pulling audio and video streams, in order to solve the problem that current audio and video platforms only offer users a single streaming strategy, resulting in high platform costs or a poor user experience.

[0006] To address the aforementioned technical problems, this application provides a method for retrieving audio and video streams, comprising:

[0007] Obtain the user's level data on the current live streaming platform;

[0008] Get the current bandwidth usage value of the live streaming server;

[0009] The user's corresponding streaming type is determined based on the relationship between the occupied bandwidth value and the bandwidth threshold, as well as the level data.

[0010] Preferably, before obtaining the user's level data on the current live streaming platform, the method further includes:

[0011] If the parameters related to the current live stream meet the preset conditions, proceed to the step of obtaining the user's level data on the current live stream platform;

[0012] Among them, the parameters related to live streaming include at least one of the following: user level, bandwidth threshold, or live streaming server uptime;

[0013] Correspondingly, the preset conditions must include at least one of the following:

[0014] The user's level data has been updated;

[0015] Or, the bandwidth threshold changes;

[0016] Alternatively, the live streaming server may have reached the preset running time.

[0017] Preferably, the streaming types include: real-time streaming and CDN streaming; the tier data includes: tier and tier score;

[0018] Based on the relationship between bandwidth usage and bandwidth threshold, and using tier data, the user's corresponding streaming type is determined as follows:

[0019] If the bandwidth usage value has reached the bandwidth threshold, the user's corresponding streaming type will be determined based on the ranking result of the grade score.

[0020] If the bandwidth usage value does not reach the bandwidth threshold, the corresponding streaming type for the user will be determined based on the user's level.

[0021] Preferably, determining the user's corresponding streaming type based on their level includes:

[0022] If the level is the highest level, then the user's corresponding streaming type is determined to be real-time streaming;

[0023] If the level is not the highest level, the user's corresponding streaming type is determined based on the relationship between the occupied bandwidth value and the bandwidth threshold.

[0024] Preferably, determining the user's corresponding traffic type based on the ranking results of the grade scores includes:

[0025] Determine whether a user's level score is greater than a preset level score from the ranking results of the level scores;

[0026] If it is greater than 1, then the user's corresponding streaming type is determined to be real-time streaming.

[0027] If it is not greater than, then the user's corresponding streaming type is determined to be CDN streaming;

[0028] or,

[0029] The first preset number of users to be added to the real-time streaming is determined based on the relationship between the occupied bandwidth value and the bandwidth threshold.

[0030] Select a first preset number of users from the ranking results of the ranking scores in descending order;

[0031] The selected user's corresponding streaming type is determined as real-time streaming, and the other users' corresponding streaming type is determined as CDN streaming.

[0032] Preferably, the level and level score are determined based on behavioral data information;

[0033] Specifically, behavioral data is used to determine a user's corresponding level score, and the user's level is determined based on the level score.

[0034] Preferably, the levels include a first level, a second level, and a third level, wherein the first level is the highest level; the second and third levels are not the highest levels.

[0035] If the level is not the highest level, the user's corresponding streaming type is determined based on the relationship between the bandwidth occupied and the bandwidth threshold, including:

[0036] When the level is the second level, it is determined whether the occupied bandwidth value is less than the first preset value, where the first preset value is less than the bandwidth threshold.

[0037] If the bandwidth usage value is not less than the first preset value, then the user's corresponding streaming type is determined to be CDN streaming.

[0038] If the bandwidth usage value is less than the first preset value, then the user's corresponding streaming type is determined to be real-time streaming.

[0039] When the level is level 3, determine whether the bandwidth occupied is less than the second preset value;

[0040] If the bandwidth usage value is not less than the second preset value, then the user's corresponding streaming type is determined to be CDN streaming.

[0041] If the bandwidth usage value is less than the second preset value, then the user's corresponding streaming type is determined to be real-time streaming.

[0042] The second preset value is less than the first preset value.

[0043] Preferably, if the bandwidth usage value corresponding to the highest-level user is not greater than the bandwidth threshold, the method further includes:

[0044] Obtain the sorting results of the level scores corresponding to users who are not at the highest level, select a second preset number of users from the sorting results according to the order of level scores from high to low, and determine the pull stream type corresponding to the users as real-time pull stream;

[0045] The bandwidth occupied by the highest-level users and the second preset number of users shall not exceed the bandwidth threshold.

[0046] Preferably, if the occupied bandwidth value is less than a third preset value, then it further includes:

[0047] Users using CDN streaming are sorted from highest to lowest based on their tier scores;

[0048] Select the third preset number of users from the sorted results in descending order, and adjust the CDN streaming used by these users to real-time streaming.

[0049] Among them, the third preset value is less than the bandwidth threshold.

[0050] Preferably, if the occupied bandwidth value is greater than the fourth preset value, then it further includes:

[0051] Users of the real-time streaming service are sorted from lowest to highest based on their rating scores.

[0052] Select the fourth preset number of users from the sorted results in ascending order, and adjust the real-time streaming used by these users to CDN streaming.

[0053] Among them, the fourth preset value is greater than the third preset value and less than the bandwidth threshold.

[0054] Preferably, the behavioral data information includes: the user's cumulative recharge amount, the user's total daily consumption amount, the user's total daily live streaming viewing time, and the user's total daily interaction count;

[0055] Determining a user's level score based on behavioral data includes: determining the user's level score based on the cumulative recharge amount, total daily consumption amount, total daily live stream viewing time, and total daily interaction count according to a preset formula;

[0056] The preset formula is:

[0057] F(x)=R(x)*a+G(x)*b+T(x)*c+C(x)*d

[0058] Where F(x) is the user's level score, R(x) is the user's cumulative recharge amount, G(x) is the user's total consumption amount for the day, T(x) is the user's total live streaming time for the day, C(x) is the user's total number of interactions for the day, and a, b, c, and d are corresponding coefficients that can be adjusted according to the actual situation, all of which are less than 1.

[0059] Preferably, the levels include a first level, a second level, and a third level, wherein the first level is the highest level; the second and third levels are not the highest levels.

[0060] Determining a user's level based on their level score includes:

[0061] Sort the grade scores;

[0062] Based on the ranking results, the users in the first group are ranked first according to their scores from highest to lowest; the users in the middle group are ranked second; and the users in the last group are ranked third.

[0063] Preferably, after determining the user's corresponding streaming type based on the relationship between the occupied bandwidth value and the bandwidth threshold, and the level data, the method further includes:

[0064] Based on a preset jitter probability, the user's streaming type is controlled to change from the current streaming type to other streaming types.

[0065] Preferably, the bandwidth threshold is the maximum value of the bandwidth threshold within a preset number of days.

[0066] To address the aforementioned technical problems, this application also provides an audio / video stream retrieval system, comprising:

[0067] The first acquisition module is used to acquire the user's level data on the current live streaming platform;

[0068] The second acquisition module is used to obtain the current bandwidth usage value of the live streaming server.

[0069] The determination module is used to determine the corresponding streaming type for a user based on the relationship between the occupied bandwidth value and the bandwidth threshold, as well as the level data.

[0070] To address the aforementioned technical problems, this application also provides a server, including a memory for storing computer programs;

[0071] A processor is used to implement the steps of the above-described audio and video stream retrieval method when executing a computer program.

[0072] To address the aforementioned technical problems, this application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the aforementioned audio / video stream retrieval method.

[0073] The audio and video stream retrieval method provided in this application includes: obtaining the user's level data on the live streaming platform and the bandwidth usage value of the live streaming server corresponding to the platform; determining the user's streaming type based on the relationship between the bandwidth usage value and the bandwidth threshold, as well as the level data; through the above method, the platform avoids the problem of high platform investment costs or long user latency caused by only providing one type of streaming to users within the platform, allowing users to be assigned different streaming types according to their own level data and the relationship between the bandwidth usage value and the bandwidth threshold, enabling users to enjoy multiple streaming services; while reducing platform costs, it ensures a good user experience.

[0074] This application also provides an audio / video stream retrieval system, server, and computer-readable access medium, which correspond to the above-described method and therefore have the same beneficial effects. Attached Figure Description

[0075] To more clearly illustrate the embodiments of this application, the accompanying drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0076] Figure 1 This is an architecture diagram corresponding to a standard real-time audio and video live streaming system.

[0077] Figure 2 This is an architecture diagram corresponding to a standard audio and video live streaming CDN pull.

[0078] Figure 3 A flowchart illustrating a method for retrieving audio and video streams provided in an embodiment of this application;

[0079] Figure 4 A flowchart illustrating the application scenario determination of an audio / video stream retrieval method provided in this application embodiment;

[0080] Figure 5 A structural diagram of an audio / video stream retrieval system provided in an embodiment of this application;

[0081] Figure 6 This is a structural diagram of a server provided in an embodiment of this application. Detailed Implementation

[0082] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the protection scope of this application.

[0083] The core of this application is to provide a method, system, server, and medium for pulling audio and video streams, mainly related to the audio and video field, and primarily used in related live streaming servers under live streaming platforms; it is used to provide users of the live streaming platform with multiple types of streaming services; avoiding the problems of high platform investment costs or low user experience caused by the live streaming platform only providing users with one type of streaming.

[0084] To enable those skilled in the art to better understand the present application, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0085] For live streaming of standard audio and video, the live streaming platform needs to allocate the type of traffic to users, enabling them to watch on the platform using that type of traffic. The streaming strategies used by the platform to allocate traffic to clients typically include: real-time audio and video retrieval, low-latency live streaming retrieval, and CDN retrieval. For example... Figure 1 A standard audio and video live streaming real-time streaming architecture diagram is given; the live streaming platform's host push device 1 directly transmits push information to the live streaming server source site 2, and the live streaming server source site 2 then directly pushes the real-time streaming to the user pull device 3. Figure 2 This document presents a standard CDN streaming architecture diagram for audio and video live streaming. The same live streaming platform's stream pusher device 1 sends streaming information to the live streaming server origin server 2. The live streaming server origin server 2 then forwards the streaming information to the CDN node server 4, which in turn pushes the CDN streaming to the user's streaming device. In this architecture, the stream pusher device 1 corresponds to each live streaming room within the platform, i.e., the device where the streamer is located, such as a computer or mobile phone; there can be multiple devices, but one is shown in the diagram for illustrative purposes. The stream pusher device 1 needs to request streaming allocation from the live streaming server origin server 2 for users within that live streaming room. The live streaming server origin server 2 is generally a backend server owned by the merchant, usually one, but if the platform is large, there can be multiple live streaming server origin servers 2, used to push real-time streaming to users. The CDN node server 4 is also a type of server used to push CDN streaming to users; there can be multiple CDN node servers 4. The user streaming device 3 is the device used by the user to watch the live stream, such as a computer or mobile phone; there can also be multiple devices, used to receive the streaming sent by the server.

[0086] Among these strategies, real-time audio and video retrieval and low-latency live streaming retrieval offer lower latency and a better user experience, but at a higher cost. CDN retrieval, on the other hand, results in higher latency and a poorer user experience, but is significantly cheaper. However, live streaming platforms typically only assign one retrieval strategy to each user—either real-time or CDN—leading to high bandwidth costs or a poor user experience. There is no combined retrieval approach that can both improve user experience and reduce platform bandwidth costs.

[0087] Therefore, in order to solve the above problems, this application provides a method for pulling audio and video streams, which assigns different streaming types to users based on some data information of users on the platform and the current bandwidth value of the live streaming server.

[0088] Figure 3A flowchart of an audio / video retrieval method provided in this application embodiment is shown. The method specifically includes:

[0089] S10: Obtain the user's level data on the current live streaming platform.

[0090] The current live streaming platform mentioned in this embodiment refers to the platform that assigns streaming types to users. This platform is not limited to the live streaming industry. If platforms in other industries also need to assign streaming types to users, they can be changed to platforms in that industry.

[0091] Level data reflects a user's importance on the platform. This level data is determined by the platform based on factors such as the user's spending or level of interaction on the platform. Specifically, level data can be tiers. The platform assigns different tiers to users based on the aforementioned information, thereby allocating different types of traffic to users according to their tiers. The level data changes due to the user's interactions or spending on the platform. Furthermore, the level data is generally stored in the live streaming platform's memory and can be directly accessed.

[0092] S11: Get the current bandwidth usage of the live streaming server.

[0093] The live streaming server manages each or some of the live streaming rooms on the aforementioned live streaming platform; the live streaming room here corresponds to the streamer push terminal device 1 of the aforementioned live streaming platform; the live streaming server corresponds to the aforementioned live streaming server source site 2, and can push real-time streams to users in the live streaming room.

[0094] The bandwidth usage value is the bandwidth corresponding to the real-time streaming pushed by the live streaming server at the current moment. Generally, the more users watching the live stream on this live streaming server, the higher the bandwidth usage value will be. Because the bandwidth cost of real-time streaming is relatively high, it is necessary to control the bandwidth cost invested by the live streaming platform in order to effectively control the bandwidth usage value.

[0095] The bandwidth usage value is calculated based on the broadcast bitrate of the streamer and the number of viewers on the live streaming server. Specifically, the bandwidth usage value is the product of the broadcast bitrate and the number of viewers.

[0096] S12: Determine the corresponding streaming type for the user based on the relationship between the occupied bandwidth value and the bandwidth threshold, as well as the level data.

[0097] The bandwidth threshold is the maximum bandwidth value corresponding to the real-time streaming pushed by the live streaming server. In this embodiment, the specific relationship between the occupied bandwidth value and the bandwidth threshold is not limited. For example, the relationship can be that of two values. If the occupied bandwidth value exceeds the bandwidth threshold, the platform needs to invest additional bandwidth costs. If the occupied bandwidth does not exceed the threshold, the bandwidth costs invested by the live streaming platform can be effectively controlled, achieving the goal of cost saving. The bandwidth threshold can be set as the maximum value of the occupied bandwidth value in historical data, or it can be the average value calculated based on the occupied bandwidth value in historical data. No specific limitation is made here.

[0098] Specifically, how to determine the corresponding streaming type for each user based on the above information? For example, when the bandwidth usage is much less than the bandwidth threshold, it means there are fewer users in the live stream during that time. In this case, user level data can be disregarded, and low-latency real-time streaming can be directly assigned to all users in the live stream. On the other hand, when the bandwidth usage is greater than the bandwidth threshold, it means there are more users in the live stream. In order to control bandwidth costs, users will be selected based on level data. Users with higher importance corresponding to the level data will be assigned real-time streaming to ensure smooth streaming for these users. Users with lower importance corresponding to the level data will be assigned CDN streaming, thereby effectively reducing the bandwidth usage and preventing it from exceeding the bandwidth threshold, thus controlling the bandwidth costs invested by the platform.

[0099] The audio and video retrieval method provided in this embodiment avoids the problems of high platform investment costs or long user latency caused by the platform using only one type of streaming for users within the platform. It allows users to be allocated different streaming types according to their own level data and the relationship between their bandwidth usage value and bandwidth threshold, enabling users to enjoy multiple streaming service types. While reducing platform costs, it ensures that users have a good user experience.

[0100] Based on the above embodiments, this embodiment, before step S10, also includes the following step: if the parameters related to the current live broadcast meet the preset conditions, proceed to step S10;

[0101] Among them, the parameters related to live streaming include at least one of the following: user level, bandwidth threshold, or live streaming server uptime;

[0102] Correspondingly, the preset conditions must include at least one of the following:

[0103] The user's level data has been updated;

[0104] Or, the bandwidth threshold changes;

[0105] Alternatively, the live streaming server may have reached the preset running time.

[0106] In this embodiment, the process can proceed to step S10 only when the parameters related to the live stream meet the aforementioned preset conditions. Changes in user level data and bandwidth thresholds refer to changes in the data judged in step S12, requiring data to be re-acquired. The live stream server's running time reaching the preset period refers to periodically adjusting the streaming type of users within the platform. The preset period is set by the live stream platform itself, for example, 30 seconds.

[0107] By setting preset conditions as described above, the user's streaming type can be changed in a timely manner. For example, when a user's level data corresponds to a low importance level, they may be assigned a high-latency CDN streaming stream. However, if the user actively interacts within the live streaming platform or makes in-app purchases, increasing the importance level of their data, they may be eligible for a low-latency real-time streaming stream, thus improving their viewing experience. Alternatively, if a live streaming room has a large number of users, resulting in high bandwidth usage on the corresponding live streaming server, some users may not be able to access real-time streaming. However, as users move between rooms, a significant number of users leave the current live streaming room, reducing the bandwidth usage and allowing users who were previously unable to access real-time streaming to do so, thus improving their viewing experience.

[0108] By setting the preset conditions in this embodiment, the user's streaming type can be effectively changed. Under the premise that the bandwidth occupied does not exceed the bandwidth threshold, the user can be allocated a low-latency streaming type, thereby improving the user experience.

[0109] As a preferred embodiment, this embodiment limits the streaming type to include real-time streaming and CDN streaming; the grade data includes: grade and grade score; step S12 includes:

[0110] If the bandwidth usage value has reached the bandwidth threshold, the user's corresponding streaming type will be determined based on the ranking result of the grade score.

[0111] If the bandwidth usage value does not reach the bandwidth threshold, the corresponding streaming type for the user will be determined based on the user's level.

[0112] The tiered data includes two indicators reflecting a user's importance to the platform: user tier and tier score. When the bandwidth usage is below the bandwidth threshold, fewer users are using real-time streaming, and the streaming type can be determined by tier, such as assigning real-time streaming to high-tier users and CDN streaming to low-tier users. However, when the bandwidth usage reaches the bandwidth threshold, too many high-tier users are using real-time streaming, and some high-tier users still haven't been assigned a streaming type. Therefore, tier alone cannot prevent the bandwidth usage from exceeding the threshold. In this case, a more specific tier score is needed to determine the streaming type, such as selecting users from highest to lowest tier score for real-time streaming until the bandwidth usage reaches the threshold, then assigning the remaining unselected users to CDN streaming.

[0113] In this embodiment, two methods for determining the user's streaming type are defined, thereby enabling a more flexible determination of the user's streaming type by selecting a level or level score based on the relationship between the occupied bandwidth value and the bandwidth threshold.

[0114] Based on the above embodiments, this embodiment defines how to determine the corresponding streaming type for a user according to their level, including:

[0115] If the level is the highest level, then the user's corresponding streaming type is determined to be real-time streaming;

[0116] If the level is not the highest level, the user's corresponding streaming type is determined based on the relationship between the occupied bandwidth value and the bandwidth threshold.

[0117] Users are categorized by level, with higher-level users classified as the highest-level users, and their streaming type directly determined as real-time streaming. Lower-level users are classified as non-highest-level users. The streaming type is further determined based on the relationship between bandwidth usage and bandwidth threshold. This embodiment divides users into two levels, but more detailed subdivisions (three or more levels) are possible, but this embodiment does not describe such subdivisions. The determination of the highest and non-highest level can be based on whether the user's recharge amount exceeds a preset amount; if it does, the user is at the highest level; otherwise, they are at a non-highest level. Alternatively, it can be based on whether the number of high-quality comments exceeds a preset number, or a combination of these factors can be considered to determine if a user is at the highest level.

[0118] In this embodiment, when a user's level reaches the highest level, real-time streaming is directly allocated to that user; this allows users who are of high importance to the platform to directly enjoy high-quality streaming services, ensuring the user experience of these users.

[0119] Based on the above embodiments, this embodiment defines how to determine the user's corresponding streaming type according to the ranking result of the level score, including:

[0120] Determine whether a user's level score is greater than a preset level score from the ranking results of the level scores;

[0121] If it is greater than 1, then the user's corresponding streaming type is determined to be real-time streaming.

[0122] If it is not greater than, then the user's corresponding streaming type is determined to be CDN streaming;

[0123] or,

[0124] The first preset number of users to be added to the real-time streaming is determined based on the relationship between the occupied bandwidth value and the bandwidth threshold.

[0125] Select a first preset number of users from the ranking results of the ranking scores in descending order;

[0126] The selected user's corresponding streaming type is determined as real-time streaming, and the other users' corresponding streaming type is determined as CDN streaming.

[0127] There are two methods for determining the streaming type of a user based on their ranking score. One method involves identifying users whose ranking score is higher than a preset score based on the ranking results. These users are assigned to real-time streaming, while those whose scores are lower are assigned to CDN streaming. The preset ranking score can be set by the live streaming platform based on historical data or determined by the proportion of each user's ranking score. The other method determines the initial preset number of users to be included in real-time streaming based on the relationship between bandwidth usage and a bandwidth threshold. This initial preset number is related to the bandwidth usage of each user, and the total bandwidth usage of this initial preset number of users does not exceed the bandwidth threshold. For example, if the bandwidth threshold is 100M, the bandwidth usage of each user is 5M, and the initial preset number is set to 20. Specifically, the selection process for the initial preset number of users is as follows: users are selected from the ranking results in descending order of their ranking scores. Users with higher ranking scores are more valuable to the live streaming platform; therefore, the selected users are assigned to real-time streaming, while the remaining users are assigned to CDN streaming.

[0128] In this embodiment, the user's streaming type is determined by the level score, which can effectively control the number of users using real-time streaming, avoid the bandwidth usage value from exceeding the bandwidth threshold, and effectively control the bandwidth cost invested by the platform.

[0129] Based on the above embodiments, the level and level score are determined by behavioral data information, wherein the user's level score is determined by behavioral data information, and the user's level is determined based on the level score.

[0130] In this embodiment, all information affecting the level data is collectively referred to as behavioral data information. This behavioral data information can correspond to information such as user recharge amount, user interaction frequency, and number of high-quality comments mentioned in the previous embodiments. Specifically, determining the level score based on the behavioral data information involves comprehensively considering the importance of each piece of information to the user on the platform to determine the level score, and then determining the level based on the level score. For example, if the level score is 100 points, and the user's recharge amount accounts for 80 points, the user's interaction frequency accounts for 10 points, and the number of high-quality comments accounts for 10 points, the user's level score is determined based on the specific values ​​of the above information. Users with a level score greater than 60 points are set as the highest-level users, and those with a score not greater than 60 points are set as non-highest-level users.

[0131] The above embodiments define how to determine a user's level score and limit the level to be obtained through the level score; that is, the user's streaming type can be determined based on both the level and the level score, thereby enabling more accurate delivery of the most suitable streaming type to each user and improving the user experience.

[0132] Based on the above embodiments, the levels are divided into a first level, a second level, and a third level; where the first level is the highest level; the second and third levels are not the highest levels; and for levels that are not the highest levels, the corresponding streaming type restriction for the user is determined according to the relationship between the occupied bandwidth value and the bandwidth threshold, including:

[0133] When the level is the second level, it is determined whether the occupied bandwidth value is less than the first preset value, where the first preset value is less than the bandwidth threshold.

[0134] If the bandwidth usage value is not less than the first preset value, then the user's corresponding streaming type is determined to be CDN streaming.

[0135] If the bandwidth usage value is less than the first preset value, then the user's corresponding streaming type is determined to be real-time streaming.

[0136] When the level is level 3, determine whether the bandwidth occupied is less than the second preset value;

[0137] If the bandwidth usage value is not less than the second preset value, then the user's corresponding streaming type is determined to be CDN streaming.

[0138] If the bandwidth usage value is less than the second preset value, then the user's corresponding streaming type is determined to be real-time streaming.

[0139] The second preset value is less than the first preset value.

[0140] This embodiment specifically defines how to determine the streaming type for non-highest-level users based on the relationship between the occupied bandwidth value and the bandwidth threshold. Both the first and second preset values ​​are less than the bandwidth threshold; the second preset value must be less than the first preset value. The first preset value can be 60% of the bandwidth threshold, and the second preset value is 20% of the bandwidth threshold. When a user is at the second level, this level of user is more important to the platform than the third-level user, so this level of user can use real-time streaming when the number of users using it is small. The third-level user is not as important to the platform, and can only use real-time streaming when the number of users using it is very small. Users who do not meet the above conditions are assigned CDN streaming.

[0141] This embodiment defines how to further determine the streaming type for non-highest level users based on the relationship between occupied bandwidth value and bandwidth threshold, so as to provide users of all levels with the opportunity to use real-time streaming, thereby improving the user experience.

[0142] Based on the above embodiments, if the bandwidth occupied by the highest-level user is not greater than the bandwidth threshold, the method further includes:

[0143] Obtain the ranking results of the level scores corresponding to users who are not at the highest level. Select a second preset number of users from the ranking results in descending order of level scores, and determine the streaming type corresponding to the users as real-time streaming. The bandwidth occupied by the highest level users and the second preset number of users shall not be greater than the bandwidth threshold.

[0144] In cases where users are categorized into highest and non-highest tiers, the bandwidth usage of the highest-tier users does not exceed the bandwidth threshold. This means that even after all the highest-tier users are allocated to real-time streaming, there is still bandwidth remaining. In this case, a second preset number of users are selected from the non-highest-tier users, and their streaming type is determined to be real-time streaming. This selection utilizes the tier scores of the non-highest-tier users, and the second preset number of users are selected from the sorted results based on their tier scores from highest to lowest. The total bandwidth usage of the highest-tier users and the second preset number of users still does not exceed the bandwidth threshold. The streaming type for the remaining users is determined to be CDN streaming.

[0145] This embodiment defines another method for determining the user's streaming type based on their level. By combining the level and level score, the bandwidth usage value is always kept high but does not exceed the bandwidth threshold, thus effectively controlling bandwidth costs.

[0146] This embodiment, as a preferred embodiment, specifies that if the occupied bandwidth value is less than a third preset value, i.e., the number of users currently using real-time streaming is too small, then it further includes: sorting the users using CDN streaming in descending order of their grade scores; selecting a third preset number of users from the sorted results in descending order, and adjusting the CDN streaming used by the users to real-time streaming; wherein, the third preset value is less than the bandwidth threshold.

[0147] The third preset value can be 10% of the bandwidth threshold; the third preset number can be 10% of the total number of users; the total bandwidth occupied by the third preset number of users determined by the above method and the original users using real-time streaming is not greater than the bandwidth threshold.

[0148] This embodiment presents a special case: if a user uses too little real-time streaming, a portion of users with higher-level scores will be selected from those using CDN streaming, and their CDN streaming will be changed to real-time streaming, thereby improving the user experience for these users.

[0149] Based on the above embodiments, another special case is defined: if the bandwidth occupied value is greater than the fourth preset value, that is, when there are too many users currently using real-time streaming, the method further includes: sorting the users using real-time streaming according to their level scores from low to high; selecting a fourth preset number of users from the sorted results from low to high, and adjusting the real-time streaming used by the users to CDN streaming; wherein, the fourth preset value is greater than the third preset value and less than the bandwidth threshold.

[0150] In this embodiment, the fourth preset value can be 30% of the peak bandwidth value, and the second preset number of users is also set to 10% of the total users. Here, users using real-time streaming are also sorted according to their level scores, and 10% of users are selected in descending order. The real-time streaming of these users is adjusted to CDN streaming. This ensures that the bandwidth occupied by the remaining users using real-time streaming is not greater than the bandwidth threshold.

[0151] This embodiment stipulates that when a user uses too much real-time streaming, users with lower level scores should be selected from those using real-time streaming based on their level scores, and their real-time streaming should be changed to CDN streaming to avoid the bandwidth usage exceeding the bandwidth threshold and reduce the platform's investment costs.

[0152] Based on the above embodiments, the behavioral data information is limited to: the user's cumulative recharge amount, the user's total daily consumption amount, the user's total daily live streaming viewing time, and the user's total daily interaction count. The determination of the user's corresponding level score through behavioral data information is limited to: determining the user's level score corresponding to the cumulative recharge amount, total daily consumption amount, total daily live streaming viewing time, and total daily interaction count according to a preset formula.

[0153] The preset formula is:

[0154] F(x)=R(x)*a+G(x)*b+T(x)*c+C(x)*d

[0155] Where F(x) is the user's level score, R(x) is the user's cumulative recharge amount, G(x) is the user's total consumption amount for the day, T(x) is the user's total live streaming time for the day, C(x) is the user's total number of interactions for the day, and a, b, c, and d are corresponding coefficients that can be adjusted according to the actual situation, all of which are less than 1.

[0156] In the preset formula, a, b, c, and d correspond to the weights of the aforementioned behavioral data information. For example, a, b, c, and d are 0.5, 0.3, 0.1, and 0.1, respectively. That is, users who recharge have a larger proportion of users, so their level scores are generally higher. This weight is usually set by the live streaming platform according to the actual situation. In addition to the information included above, if there is any other information that can reflect the importance of users to the platform, it is also within the scope of protection of this embodiment.

[0157] This embodiment defines behavioral data information and how to determine the grade score through behavioral data information; it can provide a more preferred method for determining grade scores for the platform.

[0158] Based on the above embodiments, the levels are defined as a first level, a second level, and a third level, where the first level is the highest level; the second and third levels are not the highest levels; the step of determining the user's level based on the level score is defined as follows: sorting the level scores; in the sorting results, determining the level corresponding to the first group of users as the first level according to the order of level scores from high to low; determining the level corresponding to the middle group of users as the second level; and determining the level corresponding to the last group of users as the third level.

[0159] In this embodiment, the level scores are sorted in descending order, and the level is determined according to the order of the level scores from high to low. The first part, middle part, and last part can be determined according to the proportion of users. For example, the first 20% of users in the sorted results are determined as first-level users, the last 20% of users are determined as third-level users, and the middle 60% of users are determined as second-level users. Alternatively, different level score values ​​can be set for determination. For example, users with level scores greater than 90 are determined as first-level users in the first part; users with level scores between 90 and 60 are determined as second-level users in the middle part; and users with level scores less than 60 are determined as third-level users in the last part.

[0160] This embodiment defines a method for determining user levels based on level scores, enabling the platform to determine the user's streaming type based on more judgment conditions; and assigning users more accurate streaming types, thereby improving the user experience.

[0161] Based on the above embodiment, after step S12, the method further includes: controlling the user's streaming type to change from the current streaming type to other streaming types according to a preset jitter probability.

[0162] Set the preset jitter probability to λ, which is generally set to 5%. After a user determines the streaming type, there is a probability that the user can change from their own streaming type to another streaming type. For example, if a user determines that they are using CDN streaming, but changes from CDN streaming to real-time streaming through this jitter probability, the user can change their streaming type to real-time streaming.

[0163] The jitter probability set in this embodiment can provide a certain probability for users who do not use real-time streaming to be able to access real-time streaming, thus further improving the user experience for these users.

[0164] Based on the above embodiments, the bandwidth threshold is limited to the maximum value of the bandwidth threshold within a preset number of days;

[0165] The bandwidth threshold is the maximum value of the bandwidth occupied; the preset number of days can be 7 days; the maximum value of the bandwidth occupied within 7 days is set as the bandwidth threshold. If no bandwidth occupied value greater than the bandwidth threshold appears within 7 days, the bandwidth threshold will continue to be used; if it does appear, the bandwidth occupied value exceeding the bandwidth threshold will be updated to the new bandwidth threshold.

[0166] This embodiment defines a better method for setting the bandwidth threshold, avoiding the impact on the platform or users caused by setting the bandwidth threshold too high or too low.

[0167] This application also provides an embodiment of a specific application scenario for a method of pulling audio and video streams; wherein in this embodiment, such as Figure 4As shown, the specific steps for determining the user's behavior using the above method include: S20: Query all users on the platform. S21: Determine if the user is a first-level user. S22: Determine if the user is a second-level user and their bandwidth usage is less than a first preset value. S23: Determine if the user is a third-level user and their bandwidth usage is less than a second preset value. S24: Determine if the user is using CDN streaming. S25: Determine if the user is using real-time streaming. S26: Update the bandwidth usage value. S27: Update the bandwidth threshold. S28: The user's session ends, and the next user is polled. Before steps S24 and S25, there is a probability λ to change the user's streaming type to another streaming type. In this embodiment, the first preset value and the second preset value correspond to those in the above embodiment. This method can determine the streaming type for all users. The update of the bandwidth occupied value and the bandwidth threshold is not limited to synchronous or asynchronous updates. S21, S22 and S23 correspond to the streaming types that different levels of users can be allocated under different conditions. When the conditions in the above steps are met, real-time streaming is allocated. When the conditions are not met, CDN streaming is allocated.

[0168] When real-time streaming usage is extremely high or low, users in the first, second, and third tiers are sorted in descending order. When real-time streaming usage is extremely low, a portion of users using CDN streaming are selected to use real-time streaming in the first priority order from high to low. When real-time streaming usage is extremely high, a portion of users using real-time streaming are selected to use CDN streaming in the second priority order from low to high. The specifics are as described in the above embodiments and will not be repeated here.

[0169] The application scenario of the audio and video stream retrieval method provided in this application corresponds to the above-described audio and video stream retrieval method embodiments and has the same beneficial effects.

[0170] In the above embodiments, the method for pulling audio and video streams has been described in detail. This application also provides embodiments corresponding to the audio and video stream pulling device. It should be noted that this application describes the embodiments of the device part from two perspectives: one is based on the functional module, and the other is based on the hardware.

[0171] From the perspective of functional modules, this application also provides an embodiment of an audio and video stream retrieval system, such as... Figure 5 As shown, the system includes:

[0172] The first acquisition module 30 is used to acquire the user's level data on the current live streaming platform;

[0173] The second acquisition module 31 is used to acquire the current bandwidth usage value of the live streaming server.

[0174] The determination module 32 is used to determine the corresponding streaming type of the user based on the relationship between the occupied bandwidth value and the bandwidth threshold, as well as the level data.

[0175] Since the embodiments of the system part correspond to the embodiments of the method part, the system may further include:

[0176] The judgment module is used to proceed to the step of obtaining the user's level data on the current live streaming platform if the parameters related to the current live stream meet the preset conditions.

[0177] The third acquisition module is used to acquire the sorting result of the level scores corresponding to the non-highest level users, select a second preset number of users from the sorting result according to the order of the level scores from high to low, and determine the pull stream type corresponding to the users as the real-time pull stream;

[0178] The first sorting module is used to sort users using the CDN streaming service according to their grade scores from high to low.

[0179] The first adjustment module is used to select a third preset number of users from the sorting results in descending order, and adjust the CDN streaming used by the users to the real-time streaming.

[0180] The second sorting module is used to sort users using the real-time streaming service according to their grade scores from low to high.

[0181] The second adjustment module is used to select a fourth preset number of users from the sorting results in ascending order, and adjust the real-time streaming used by the users to the CDN streaming.

[0182] The control module is used to control the user's streaming type to change from the current streaming type to other streaming types according to a preset jitter probability.

[0183] The audio and video stream retrieval system provided in this embodiment corresponds to the method described above, and therefore has the same beneficial effects as the method described above.

[0184] From a hardware perspective, this embodiment provides a server. Figure 6 A structural diagram of a server provided in another embodiment of this application is shown below. Figure 6 As shown, the server includes: a memory 20 for storing computer programs;

[0185] The processor 21 is used to implement the steps of the audio and video stream retrieval method mentioned in the above embodiments when executing a computer program.

[0186] The server provided in this embodiment may include, but is not limited to, smartphones, tablets, laptops, or desktop computers.

[0187] The processor 21 may include one or more processing cores, such as a quad-core processor or an octa-core processor. The processor 21 may be implemented using at least one of the following hardware forms: Digital Signal Processor (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). The processor 21 may also include a main processor and a coprocessor. The main processor, also known as the Central Processing Unit (CPU), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, the processor 21 may integrate a Graphics Processing Unit (GPU), which is responsible for rendering and drawing the content to be displayed on the screen. In some embodiments, the processor 21 may also include an Artificial Intelligence (AI) processor, which is used to handle computational operations related to machine learning.

[0188] The memory 20 may include one or more computer-readable storage media, which may be non-transitory. The memory 20 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In this embodiment, the memory 20 is used to store at least the following computer program 201, which, after being loaded and executed by the processor 21, is capable of implementing the relevant steps of the audio / video stream retrieval method disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 20 may also include an operating system 202 and data 203, and the storage method may be temporary or permanent storage. The operating system 202 may include Windows, Unix, Linux, etc. The data 203 may include, but is not limited to, the data included in the audio / video stream retrieval method.

[0189] In some embodiments, the server may further include a display screen 22, an input / output interface 23, a communication interface 24, a power supply 25, and a communication bus 26.

[0190] Those skilled in the art will understand that Figure 6 The structure shown does not constitute a limitation on the server and may include more or fewer components than illustrated.

[0191] The server provided in this application embodiment includes a memory and a processor. When the processor executes a program stored in the memory, it can implement the following method: an audio and video stream retrieval method.

[0192] The server provided in this embodiment corresponds to the method described above, and therefore has the same beneficial effects as the method described above.

[0193] Finally, this application also provides an embodiment corresponding to a computer-readable storage medium. The computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps described in the above method embodiments.

[0194] It is understood that if the methods in the above embodiments are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and executes all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0195] The computer-readable storage medium provided in this embodiment corresponds to the method described above, and therefore has the same beneficial effects as the method described above.

[0196] The foregoing has provided a detailed description of the audio and video stream retrieval method, system, server, and medium provided in this application. The various embodiments in the specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For the apparatus disclosed in the embodiments, since it corresponds to the method disclosed in the embodiments, the description is relatively simple; relevant parts can be referred to in the method section. It should be noted that those skilled in the art can make several improvements and modifications to this application without departing from the principles of this application, and these improvements and modifications also fall within the protection scope of the claims of this application.

[0197] It should also be noted that, in this specification, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

Claims

1. A method for retrieving audio and video streams, characterized in that, include: Obtain the user's level data on the current live streaming platform; The grade data includes: grade and grade score; Get the current bandwidth usage value of the live streaming server; The user's corresponding streaming type is determined based on the relationship between the occupied bandwidth value and the bandwidth threshold, as well as the level data; The step of determining the user's corresponding streaming type based on the relationship between the occupied bandwidth value and the bandwidth threshold, and the level data, includes: If the bandwidth occupied value has reached the bandwidth threshold, the user's corresponding streaming type is determined according to the ranking result of the level score; If the bandwidth occupied value does not reach the bandwidth threshold, the user's corresponding streaming type is determined according to the level.

2. The method for retrieving audio and video streams according to claim 1, characterized in that, Before obtaining the user's level data on the current live streaming platform, the process also includes: If the parameters related to the current live stream meet the preset conditions, proceed to the step of obtaining the user's level data on the current live stream platform; The parameters related to the live streaming include at least one of the following: user level, bandwidth threshold, or live streaming server uptime; Correspondingly, the preset conditions include at least one of the following: The user's level data has been updated; Or, the bandwidth threshold changes; Alternatively, the live streaming server may run for a preset period of time.

3. The method for retrieving audio and video streams according to claim 1, characterized in that, The streaming types include: real-time streaming and CDN streaming.

4. The method for retrieving audio and video streams according to claim 3, characterized in that, The step of determining the user's corresponding streaming type based on the level includes: If the level is the highest level, then the pull stream type corresponding to the user is determined to be the real-time pull stream; If the level is not the highest level, the streaming type corresponding to the user is determined according to the relationship between the occupied bandwidth value and the bandwidth threshold.

5. The method for retrieving audio and video streams according to claim 3, characterized in that, The process of determining the user's corresponding traffic type based on the ranking result of the grade score includes: Determine whether the user's level score is greater than a preset level score from the sorting results of the level scores; If it is greater than that, then the user's corresponding streaming type is determined to be the real-time streaming type; If it is not greater than, then the user's corresponding pull stream type is determined to be the CDN pull stream; or, The first preset number of users to be added to the real-time streaming is determined based on the relationship between the occupied bandwidth value and the bandwidth threshold. The first preset number of users are selected from the sorting results of the grade scores in descending order; The selected user's corresponding pull stream type is determined as the real-time pull stream, and the pull stream type of the remaining users is determined as the CDN pull stream.

6. The method for retrieving audio and video streams according to claim 4, characterized in that, The level and the level score are determined based on behavioral data information; Specifically, the user's level score is determined through the behavioral data information, and the user's level is determined based on the level score.

7. The method for retrieving audio and video streams according to claim 4, characterized in that, The levels include a first level, a second level, and a third level, wherein the first level is the highest level; the second level and the third level are the non-highest levels; If the level is not the highest level, then determining the user's corresponding streaming type based on the relationship between the occupied bandwidth value and the bandwidth threshold includes: When the level is the second level, it is determined whether the occupied bandwidth value is less than a first preset value, wherein the first preset value is less than the bandwidth threshold; If the bandwidth occupied value is not less than the first preset value, then the pull stream type corresponding to the user is determined to be the CDN pull stream; If the bandwidth occupied value is less than the first preset value, then the streaming type corresponding to the user is determined to be the real-time streaming; When the level is the third level, determine whether the occupied bandwidth value is less than the second preset value; If the bandwidth occupied value is not less than the second preset value, then the pull stream type corresponding to the user is determined to be the CDN pull stream; If the bandwidth occupied value is less than the second preset value, then the streaming type corresponding to the user is determined to be the real-time streaming; The second preset value is less than the first preset value.

8. The method for retrieving audio and video streams according to claim 4, characterized in that, If the bandwidth usage value corresponding to the highest-level user is not greater than the bandwidth threshold, the following is also included: Obtain the sorting results of the level scores corresponding to the non-highest level users, select a second preset number of users from the sorting results according to the order of the level scores from high to low, and determine the pull stream type corresponding to the users as the real-time pull stream; The bandwidth occupied by the highest-level user and the second preset number of users is not greater than the bandwidth threshold.

9. The method for retrieving audio and video streams according to claim 5, characterized in that, If the occupied bandwidth value is less than the third preset value, then it also includes: Users using the CDN streaming service are sorted from highest to lowest based on their grade scores; From the sorting results, select a third preset number of users in descending order, and adjust the CDN streaming used by the users to the real-time streaming; Wherein, the third preset value is less than the bandwidth threshold.

10. The method for retrieving audio and video streams according to claim 9, characterized in that, If the occupied bandwidth value is greater than the fourth preset value, then it also includes: Users of the real-time streaming service are sorted from lowest to highest based on their grade scores; From the sorting results, select a fourth preset number of users in ascending order of their ranking, and adjust the real-time streaming used by these users to the CDN streaming. The fourth preset value is greater than the third preset value and less than the bandwidth threshold.

11. The method for retrieving audio and video streams according to claim 6, characterized in that, The behavioral data information includes: the user's cumulative recharge amount, the user's total daily consumption amount, the user's total daily live stream viewing time, and the user's total daily interaction count; The step of determining the user's level score through the behavioral data information includes: determining the user's level score corresponding to the cumulative recharge amount, the total amount spent on the day, the total duration of watching live streams on the day, and the total number of interactions on the day according to a preset formula; The preset formula is as follows: ， Among them, the For the user's level score, the For the user's cumulative recharge amount, the The total amount of the user's spending that day, The total duration of the live stream watched by the user on that day, The total number of interactions for the user on that day, where a, b, c, and d are corresponding coefficients that can be adjusted according to actual circumstances, and are all less than 1.

12. The method for retrieving audio and video streams according to claim 6, characterized in that, The levels include a first level, a second level, and a third level, wherein the first level is the highest level; the second level and the third level are the non-highest levels; Determining the user's level based on the level score includes: Sort the grade scores; In the sorting results, the level corresponding to the first group of users is determined as the first level according to the order of level scores from high to low; the level corresponding to the middle group of users is determined as the second level; and the level corresponding to the last group of users is determined as the third level.

13. The method for retrieving audio and video streams according to any one of claims 1 to 12, characterized in that, After determining the user's corresponding streaming type based on the relationship between the occupied bandwidth value and the bandwidth threshold, and the level data, the method further includes: The user's streaming type is controlled to change from the current streaming type to other streaming types based on a preset jitter probability.

14. The method for retrieving audio and video streams according to claim 13, characterized in that, The bandwidth threshold is the maximum value of the bandwidth threshold within a preset number of days.

15. A system for pulling audio and video streams, characterized in that, include: The first acquisition module is used to acquire the user's level data on the current live streaming platform; The grade data includes: grade and grade score; The second acquisition module is used to obtain the current bandwidth usage value of the live streaming server. The determination module is used to determine the streaming type corresponding to the user based on the relationship between the occupied bandwidth value and the bandwidth threshold, as well as the level data; The step of determining the user's corresponding streaming type based on the relationship between the occupied bandwidth value and the bandwidth threshold, and the level data, includes: If the bandwidth occupied value has reached the bandwidth threshold, the user's corresponding streaming type is determined according to the ranking result of the level score; If the bandwidth occupied value does not reach the bandwidth threshold, the user's corresponding streaming type is determined according to the level.

16. A server, characterized in that, Includes memory used to store computer programs; A processor, configured to implement the steps of the audio / video stream retrieval method as described in any one of claims 1 to 14 when executing the computer program.

17. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the audio / video stream retrieval method as described in any one of claims 1 to 14.

Images