Resource processing method, apparatus, device, and computer medium
Patent Information
- Application Number
- CN202510446095.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-09
- Publication Date
- 2026-10-16
AI Technical Summary
[0002]相关技术中,在视频上线场景中,预测视频流量时,一般通过视频集合中的一部分视频的流量来预测视频集合的流量,功能比较单一
[0017]This application provides a solution: by acquiring first popularity information of media data to be broadcast and second popularity information of reference media data, wherein the first popularity information of the media data to be broadcast includes: popularity information of individuals related to the media data to be broadcast, and attention popularity information of the media data to be broadcast; acquiring a first traffic increment of access to multiple services after the reference media data is broadcast relative to before the broadcast, wherein the multiple services are used to provide broadcast services for the broadcast of the reference media data and the media to be broadcast; estimating a second traffic increment of access to the multiple services after the broadcast of the media data to be broadcast relative to before the broadcast, based on the first popularity information, the second popularity information, and the first traffic increment; and adjusting the resource volume corresponding to the multiple services based on the second traffic increment. The solution proposed in this application can automatically adjust the resource quantity corresponding to multiple services used to provide broadcast services for the reference media data and the media to be broadcast based on the popularity information of the reference media data, the popularity information of the media data to be played, and the traffic situation before and after the broadcast of the reference media data. This can avoid the problem of insufficient resources when the media data to be played is broadcast and reduce the failure rate of resource-related faults when the media data to be played is broadcast.
Smart Images

Figure CN122933976A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer resource allocation technology, specifically to a resource processing method, apparatus, device, and computer medium. Background Technology
[0002] In related technologies, when predicting video traffic in video streaming scenarios, the traffic of the entire video collection is typically predicted based on the traffic of a subset of videos, resulting in a relatively limited functionality. Furthermore, the lack of a plan for adjusting the amount of resources needed to support the broadcast of videos can easily lead to resource shortages during playback, resulting in a high failure rate for resource-related faults. Summary of the Invention
[0003] This application provides a resource processing method, apparatus, device, and computer medium that can avoid the problem of insufficient resources when broadcasting video and reduce the failure rate of resource-related faults during video broadcasting.
[0004] On the one hand, a resource processing method is provided, the method comprising:
[0005] The first popularity information of the media data to be broadcast and the second popularity information of the reference media data are obtained. The first popularity information of the media data to be broadcast includes: the popularity information of the people related to the media data to be broadcast, and the attention popularity information of the media data to be broadcast.
[0006] The first traffic increment of multiple services accessed after the reference media data is broadcast relative to before the broadcast of the reference media data is broadcast is obtained, wherein the multiple services are used to provide broadcast services for the broadcast of the reference media data and the media to be broadcast;
[0007] Based on the first popularity information, the second popularity information, and the first traffic increment, a second traffic increment is estimated for the access of the multiple services after the broadcast of the media data to be broadcast, relative to before the broadcast of the media data to be broadcast;
[0008] The resource amounts corresponding to the multiple services are adjusted based on the second traffic increment.
[0009] On the other hand, a resource processing apparatus is provided, the apparatus comprising:
[0010] The acquisition unit is used to acquire first popularity information of the media data to be broadcast and second popularity information of the reference media data. The first popularity information of the media data to be broadcast includes: popularity information of the people related to the media data to be broadcast, and attention popularity information of the media data to be broadcast.
[0011] The acquisition unit is further configured to acquire a first traffic increment of multiple services accessed after the reference media data is broadcast relative to before the reference media data is broadcast, wherein the multiple services are used to provide broadcast services for the broadcast of the reference media data and the media to be broadcast;
[0012] The determining unit is configured to estimate, based on the first popularity information, the second popularity information, and the first traffic increment, the second traffic increment of the access to the multiple services after the broadcast of the media data to be broadcast relative to before the broadcast of the media data to be broadcast;
[0013] The adjustment unit is used to adjust the resource quantity corresponding to the plurality of services according to the second traffic increment.
[0014] On the other hand, a computer-readable storage medium is provided that stores a computer program adapted for loading by a processor to perform the steps in the method described in any of the above embodiments.
[0015] On the other hand, a computer device is provided, the computer device including a processor and a memory, the memory storing a computer program, the processor executing the steps of the method as described in any of the above embodiments by calling the computer program stored in the memory.
[0016] On the other hand, a computer program product is provided, including computer instructions that, when executed by a processor, implement the steps in the method described in any of the above embodiments.
[0017] This application provides a solution: by acquiring first popularity information of media data to be broadcast and second popularity information of reference media data, wherein the first popularity information of the media data to be broadcast includes: popularity information of individuals related to the media data to be broadcast, and attention popularity information of the media data to be broadcast; acquiring a first traffic increment of access to multiple services after the reference media data is broadcast relative to before the broadcast, wherein the multiple services are used to provide broadcast services for the broadcast of the reference media data and the media to be broadcast; estimating a second traffic increment of access to the multiple services after the broadcast of the media data to be broadcast relative to before the broadcast, based on the first popularity information, the second popularity information, and the first traffic increment; and adjusting the resource volume corresponding to the multiple services based on the second traffic increment. The solution proposed in this application can automatically adjust the resource quantity corresponding to multiple services used to provide broadcast services for the reference media data and the media to be broadcast based on the popularity information of the reference media data, the popularity information of the media data to be played, and the traffic situation before and after the broadcast of the reference media data. This can avoid the problem of insufficient resources when the media data to be played is broadcast and reduce the failure rate of resource-related faults when the media data to be played is broadcast. Attached Figure Description
[0018] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0019] Figure 1a This is a flowchart illustrating the resource processing method provided in an embodiment of this application.
[0020] Figure 1b This is a schematic diagram illustrating the relationship between the incremental traffic volume and the diffusion ratio among some server clusters provided in an embodiment of this application.
[0021] Figure 1c This is a schematic diagram illustrating the changes in QPS / CPU value and CPU utilization of a server cluster over a period of time, as provided in an embodiment of this application.
[0022] Figure 2 This is a schematic diagram of the structure of the resource processing system provided in an embodiment of this application.
[0023] Figure 3 This is a schematic diagram of the structure of the resource processing device provided in the embodiments of this application.
[0024] Figure 4A schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation
[0025] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0026] The embodiments of this application can be applied to various scenarios such as network media, multimedia services, and big data processing.
[0027] This application provides a resource processing method, apparatus, device, and computer medium. Specifically, the resource processing method of this application can be executed by a computer device, which can be a terminal or a server. The server can be an independent physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms.
[0028] First, some of the nouns or terms that appear in the description of the embodiments of this application are explained as follows:
[0029] Popular TV series: Computers can determine whether a film or television series is a popular series based on various characteristic data they acquire. A popular TV series refers to a TV drama or web series that is currently very popular and widely discussed. These various characteristic data may include: attention data, rating data, and viewership or playback volume data. Popular TV series are characterized by high attention, good ratings, and high viewership or playback volume, among which:
[0030] High attention: Popular dramas usually have extremely high attention, with a large number of viewers actively searching for, watching and discussing these dramas. Attention data can include the total number of searches, views, and discussions by viewers.
[0031] High ratings: Popular dramas often have good word-of-mouth, with viewers giving high praise to their plot, acting, production quality, and other aspects. Rating data can include the average ratings of viewers for the plot, acting, production quality, etc.
[0032] High ratings or viewership: Popular dramas usually have high ratings or viewership, reflecting their broad audience base and popularity.
[0033] For a specific film or television series, a computer can statistically analyze various characteristic data of that series across multiple platforms to determine its performance based on these data. The computer can classify films or television series as "hot" shows if their attention data exceeds a certain threshold, their ratings are good or excellent, and their viewership or play counts exceed a certain value. These multiple platforms can include short video platforms, product recommendation platforms, and social media platforms.
[0034] Resource Adjustment: Based on the estimated traffic increase, assess the increase in resources required for each level of service, and adjust the resources required for each level of service accordingly.
[0035] Rate limiting threshold: The number of requests allowed within a certain period of time. Requests exceeding this number will be temporarily rejected or restricted.
[0036] QPS (Queries Per Second) is an important metric for measuring the processing power of a computer system, especially in the fields of databases and web services. It represents the number of queries that can be processed per second. The higher the QPS, the stronger the system's ability to process requests per unit of time.
[0037] QPS (Queries Per Second) is typically calculated based on actual performance test data. During performance testing, a certain number of users simultaneously send requests to the system, and the number of requests successfully processed by the system within a certain time period (e.g., 1 second) is recorded. This number is the QPS. QPS is one of the key metrics for measuring system performance. By comparing the QPS of different systems or configurations, the system's processing capacity and bottlenecks can be assessed.
[0038] Capacity planning: also known as resource planning, is the process of planning system resources based on QPS (Queries Per Second) during business growth or system upgrades to ensure that the system can handle the expected number of requests.
[0039] The CPU (Central Processing Unit) is the core component of a computer system, responsible for executing instructions in a program, processing data, and controlling other devices in the computer system.
[0040] The multiple services provided for broadcasting media data cover various aspects to ensure smooth delivery, efficient management, and a high-quality user experience. These services include: access layer services, caching layer services, and storage layer services.
[0041] The access layer service acts as the "portal" for the video backend service, primarily responsible for handling the interaction between the client and the backend service. Its key functions include:
[0042] Routing: Correctly forwards client requests to the appropriate backend services, ensuring that the request can successfully reach the service module that processes it.
[0043] Load balancing distributes requests across multiple backend instances to ensure high availability and performance of the system. Load balancing technology can improve the system's concurrent processing capabilities.
[0044] Authentication and access control: Verify the user's identity and control their access to system resources based on their roles and permissions. This helps ensure system security and prevent unauthorized access and operations.
[0045] Data validation and cleaning: Check whether the data sent by the client conforms to the expected format and type, remove or correct illegal data to prevent potential security risks and errors.
[0046] Protocol adaptation and data format conversion: Converting communication protocols used by different clients into formats that the backend service can understand, and converting data in formats such as JSON or XML into object structures used internally.
[0047] The caching layer service is primarily responsible for caching frequently accessed data to improve system response speed. Its key features include:
[0048] High performance: It adopts a high-performance caching system, which can quickly respond to client requests.
[0049] Data consistency: Ensure that the data in the cache is consistent with the data in the backend database to avoid data inconsistencies.
[0050] Update strategy: Set appropriate cache expiration time and update strategy to ensure that the data in the cache is always up-to-date.
[0051] The caching layer service plays a crucial role in the video backend service, as it can significantly reduce the access pressure on the backend database and improve the overall performance of the system.
[0052] The storage layer service is primarily responsible for storing and managing data such as video files and user information. Its key functions include:
[0053] Large-capacity storage: Provides large-capacity storage space to meet the storage needs of large data volumes such as video files.
[0054] High-efficiency data reading and writing: It has high-efficiency data reading and writing capabilities to meet the needs of real-time recording and playback of video data.
[0055] Data Backup and Recovery: Supports data backup and recovery functions to ensure the safety and reliability of video data. Quick recovery is possible in the event of accidental damage or loss of video data.
[0056] Data Management and Organization: Provides convenient data management and organization features, such as folders, tags, or other custom methods to classify and archive video files, enabling users to quickly locate and access the video content they need.
[0057] Storage layer services are the cornerstone of video backend services, directly impacting the system's data security and stability. Therefore, when selecting a storage layer service, multiple factors such as storage capacity, read / write performance, and data security must be considered comprehensively.
[0058] It is understood that in the specific implementation of this application, data related to user information and identity verification are involved. When the above embodiments of this application are applied to specific products or technologies, user permission, consent or authorization is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0059] In related technologies, when predicting video traffic in video streaming scenarios, the traffic of the entire video collection is typically predicted based on the traffic of a subset of videos, resulting in a relatively limited functionality. Furthermore, the lack of a plan for adjusting the amount of resources needed to support the broadcast of videos can easily lead to resource shortages during playback, resulting in a high failure rate for resource-related faults.
[0060] The proposed traffic increment calculation scheme uses the popularity of reference media data and traffic increment data to estimate the traffic increment of the media data to be broadcast, thus improving the accuracy of traffic estimation. Furthermore, based on the estimated traffic increment and the performance and request volume characteristics of each service level, resource increment assessment is performed, which ensures the stability of the broadcast of popular dramas while reducing excessive resource waste. In addition, this application proposes a dynamic traffic limiting mechanism, which can automatically adjust the traffic limiting threshold of each upstream service based on the estimated traffic increment, without requiring each upstream service to adjust it manually, thereby reducing the risk of accidental access caused by excessive upstream services.
[0061] This application provides a resource processing system, which includes multiple upstream business and service systems. The service system is used to manage multiple server clusters deployed for multiple services. The media data to be broadcast can be stored in the multiple server clusters, or it can be stored in a third-party storage space.
[0062] The aforementioned upstream business refers to the upstream business end. Multiple upstream business ends can refer to various access ends corresponding to the multiple server clusters. The access end types are classified according to the playback method. The various access ends include: access ends accessed through applications, access ends accessed through television, and access ends accessed through live broadcasts.
[0063] Optionally, the aforementioned services are used to support the broadcast of media data to be broadcast and other media data broadcast simultaneously, and the aforementioned server clusters are the accessed end. Other media data broadcast simultaneously includes media data that has been partially broadcast before the media data to be broadcast, and another part of the media data broadcast simultaneously with the media data to be broadcast. Other media data broadcast simultaneously includes reference media data.
[0064] Optionally, the aforementioned service system is used to perform:
[0065] The first popularity information of the media data to be broadcast and the second popularity information of the reference media data are obtained. The first popularity information of the media data to be broadcast includes: the popularity information of the people related to the media data to be broadcast, and the attention popularity information of the media data to be broadcast.
[0066] The first traffic increment of multiple services accessed after the reference media data is broadcast relative to before the broadcast of the reference media data is broadcast is obtained, wherein the multiple services are used to provide broadcast services for the broadcast of the reference media data and the media to be broadcast;
[0067] Based on the first popularity information, the second popularity information, and the first traffic increment, a second traffic increment is estimated for the access of the multiple services after the broadcast of the media data to be broadcast, relative to before the broadcast of the media data to be broadcast;
[0068] The resource amounts corresponding to the multiple services are adjusted based on the second traffic increment.
[0069] Optionally, the aforementioned service system can be one of the servers in the entire server cluster, or it can be a separate device independent of the entire server cluster. This application does not limit this.
[0070] Each of the aforementioned upstream services can call upon the aforementioned multiple services.
[0071] Optionally, the aforementioned upstream service terminal can be used to broadcast media data to be broadcast. Furthermore, the upstream service terminal can also be used to interact with users through a graphical user interface. Users can download and install the corresponding client from the upstream service terminal and run it, or they can run it by calling a corresponding mini-program, or they can log in to a website to view the corresponding graphical user interface, etc.
[0072] It should be noted that the order of description of the following embodiments is not intended to limit the priority of the embodiments.
[0073] The embodiments of this application provide a resource processing method, which can be executed by the aforementioned service system. Figure 1a This is a flowchart illustrating a resource processing method provided in an embodiment of this application. The method includes the following steps S201-S204:
[0074] S201. Obtain first popularity information of the media data to be broadcast and second popularity information of the reference media data. The first popularity information of the media data to be broadcast includes: popularity information of the people related to the media data to be broadcast, and attention popularity information of the media data to be broadcast.
[0075] Optionally, the aforementioned individuals may refer to actors or characters appearing in the media data to be broadcast; the popularity information can be determined by the number of reservations and comments in the media data to be broadcast.
[0076] Optionally, the popularity information of the aforementioned figures may be related to the number of fans the actors have.
[0077] Optionally, the popularity information of the most popular person can be set to 10, and the attention information of the media data with the highest attention can be set to 10. The popularity information of the aforementioned person and the attention information can both be positive integers that are no greater than 10 and greater than 0.
[0078] Optionally, the most popular person can be the most popular person among a set of preset individuals, and the media data with the highest attention can be the media data with the highest attention among a set of preset media data. The aforementioned set of preset individuals and preset media data can be set by relevant personnel, and the attention of each individual and the attention of each media data can be determined based on the acquired online data.
[0079] Accordingly, the second popularity information of the reference media data includes: popularity information of the people related to the reference media data, and attention popularity information of the reference media data.
[0080] Optionally, media data in this application may refer to video.
[0081] S202. Obtain the first traffic increment of multiple services accessed after the reference media data is broadcast relative to before the reference media data is broadcast, wherein the multiple services are used to provide broadcast services for the broadcast of the reference media data and the media to be broadcast;
[0082] The services include at least two of the following: access layer service, caching layer service, and storage layer service. The access layer service acts as the "portal" for the video backend service, primarily handling the interaction between the client and the backend service. The caching layer service is mainly responsible for caching frequently accessed data to improve system response speed. The storage layer service is primarily responsible for storing and managing data such as video files and user information.
[0083] The first traffic increment refers to the increase in the total traffic of multiple services being accessed.
[0084] Optionally, the increase in the aforementioned total traffic can be QPS.
[0085] Optionally, the aforementioned increase in total traffic may refer to the difference between the highest QPS on the day the reference media data was broadcast and the highest QPS on a historical date with a preset duration prior to the broadcast of the reference media data.
[0086] The media category in the reference media data is the same as the media category in the media data to be broadcast.
[0087] Among them, the media category can be classified according to the media broadcasting format of the media data. The media category of the media data to be broadcast can be any of the following: film and television dramas, variety shows, and live broadcasts.
[0088] S203. Based on the first popularity information, the second popularity information, and the first traffic increment, estimate the second traffic increment of the access to the multiple services after the broadcast of the media data to be broadcast, relative to before the broadcast of the media data to be broadcast.
[0089] In some optional embodiments of this application, in the aforementioned S203, estimating the second traffic increment of access to the multiple services after the broadcast of the media data to be broadcast, relative to before the broadcast of the media data to be broadcast, based on the first popularity information, the second popularity information, and the first traffic increment, includes the following steps S2031-S2032:
[0090] S2031. Determine the heat ratio between the first heat information and the second heat information;
[0091] Specifically, the ratio of the first popularity information to the second popularity information is the ratio of the first popularity information to the second popularity information.
[0092] S2032. Based on the heat ratio and the first traffic increment, determine the second traffic increment of access to the multiple services after the broadcast of the media data to be broadcast, relative to before the broadcast of the media data to be broadcast.
[0093] Optionally, the product of the heat ratio and the first flow rate increment can be used as the second flow rate increment, i.e.:
[0094] Second traffic increment = First traffic increment * Popularity ratio.
[0095] Optionally, the aforementioned popularity ratio can also be used to determine the estimated total number of views for the media data to be broadcast. Specifically, the product of the popularity ratio and the total number of views for the reference media data can be used as the estimated total number of views for the media data to be broadcast. The estimated total number of views for the media data to be broadcast and the total number of views for the reference media data can be sent to the target device for display and viewing by relevant personnel.
[0096] Optionally, when all media data in the reference media data has been played, the total number of plays for the reference media data is the total number of plays from the start of the reference media data to the completion of the playback.
[0097] Optionally, if some media data in the reference media data has not yet been played, the total number of plays for the reference media data is the total number of plays from the time the reference media data was played until the current time.
[0098] In some optional embodiments of this application, media data belonging to the same media category can be further divided into multiple media subcategories based on media content. For example, when the media category of the media data is film and television drama, the multiple media subcategories may include: palace drama, political intrigue drama, modern idol drama, etc.
[0099] Optionally, the subcategories of media data can be determined based on the tag information of the media data. The tag information of the media data may include multiple tags, which can be used to represent information such as the theme, content, and background of the media data.
[0100] Optionally, the top-ranked label in the label information of the media data can be used as the media sub-category of the media data.
[0101] In some alternative embodiments of this application, determining the second traffic increment of access to the plurality of services after the broadcast of the media data to be broadcast relative to before the broadcast of the media data to be broadcast, based on the heat ratio and the first traffic increment, includes: obtaining adjustment parameters set by relevant personnel; and using the product of the heat ratio, the adjustment parameters, and the first traffic increment as the second traffic increment of access to the plurality of services after the broadcast of the media data to be broadcast relative to before the broadcast of the media data to be broadcast.
[0102] Among them, the adjustment parameters are used to adjust the calculation parameters of the second flow increment in order to further improve the prediction accuracy of the second flow increment.
[0103] Optionally, the aforementioned adjustment parameters are determined based on the media sub-category of the media data to be broadcast and the media sub-category of the reference media data.
[0104] In some embodiments, the media subclass of the aforementioned reference media data is the same as the media subclass of the media data to be broadcast.
[0105] Optionally, the adjustment parameter can be a value greater than 0 and less than or equal to 1, with a maximum value of 1.
[0106] Optionally, when the media subcategory of the media data to be broadcast is the same as the media subcategory of the reference media data, the aforementioned adjustment parameter is set to 1. When the media subcategory of the media data to be broadcast is different from the media subcategory of the reference media data, the adjustment parameter can be a value less than 1 and greater than 0. The greater the correlation between the media subcategory of the media data to be broadcast and the media subcategory of the reference media data, the larger the adjustment parameter.
[0107] Optionally, the degree of correlation between different media subcategories can be set by relevant personnel. For example, when the media subcategory is palace drama, it has a greater correlation with Qing Dynasty drama and a smaller correlation with comedy; when the media subcategory is comedy, it has a greater correlation with comedy and a smaller correlation with political intrigue.
[0108] Preferably, the media category of the reference media data is the same as the media category of the media data to be broadcast, and the media sub-category of the reference media data is the same as the media sub-category of the media data to be broadcast.
[0109] In some optional embodiments of this application, when no media data with the same media subcategory as the media data to be broadcast is found, media data with a different media subcategory than the media data to be broadcast can be used as reference media data. For example, the media data with the highest correlation between the media subcategory and the media subcategory of the media data to be broadcast can be used as reference media data.
[0110] Optionally, the aforementioned reference media data may include media data from one media subcategory or media data from multiple media subcategories. When the reference media data includes media data from multiple media subcategories, the aforementioned first traffic increment may be the fitting result of the traffic increment of the media data from multiple media subcategories. The fitting algorithm may be: averaging, linear regression, logistic regression, etc. By introducing media data from multiple media subcategories, the accuracy of the determined second traffic increment can be improved.
[0111] S204. Adjust the resource volume corresponding to the plurality of services according to the second traffic increment.
[0112] The solution proposed in this application can estimate the second traffic increment of multiple services accessed after the broadcast of the media data to be broadcast, relative to before the broadcast of the media data to be broadcast, based on the first popularity information of the media data to be broadcast, the second popularity information of the reference media data, and the first traffic increment of the reference media data. By introducing the popularity and traffic increment of the reference media data, the determination of the second traffic increment of multiple services accessed becomes more based on evidence, improving the accuracy of the estimation of the second traffic increment of multiple services accessed. This can solve the problem of inaccurate estimation of traffic increment by humans when a film or television drama is released.
[0113] Furthermore, based on the popularity information of the reference media data, the popularity information of the media data to be played, and the traffic situation before and after the broadcast of the reference media data, the resource volume corresponding to multiple services used to provide broadcast services for the reference media data and the media to be played can be automatically adjusted, which not only ensures the stability of the film and television drama when it is released, but also improves the efficiency of resource utilization.
[0114] In some optional embodiments of this application, each of the plurality of services is deployed with multiple server clusters. In the aforementioned S204, adjusting the resource quantity corresponding to the plurality of services according to the second traffic increment includes: for each of the plurality of services, for each of the multiple server clusters deployed by the service; determining a third traffic increment corresponding to the server cluster according to the second traffic increment; and adjusting the number of servers in the server cluster according to the third traffic increment corresponding to the server cluster.
[0115] In some optional embodiments of this application, the aforementioned determination of the third traffic increment corresponding to the server cluster based on the second traffic increment includes the following S41-S42:
[0116] S41. Obtain the relationship between the traffic increment of the server cluster and the second traffic increment;
[0117] S42. Determine the third traffic increment corresponding to the server cluster based on the relationship between the traffic increment size and the second traffic increment.
[0118] Optionally, the aforementioned relationship between the magnitudes of traffic increments may include the traffic increment of the server cluster and the traffic allocation ratio of the second traffic increment information. For each server cluster, the traffic increment of the server cluster may be the product of the second traffic increment information and the traffic allocation ratio.
[0119] Optionally, the aforementioned relationship between the magnitudes of traffic increments may include the diffusion ratio between the traffic increment of the server cluster and the second traffic increment information. For each server cluster, the traffic increment of the server cluster may be the product of the second traffic increment information and the diffusion ratio.
[0120] Optionally, the traffic increment of a server cluster can also be determined by comparing the traffic increment of that server cluster with that of a server cluster with a traffic allocation ratio or diffusion ratio relationship. The traffic allocation ratio between two server clusters refers to the ratio of the traffic increments between the two server clusters, and the diffusion ratio between two server clusters also refers to the ratio of the traffic increments between the two server clusters.
[0121] Optionally, a diagram illustrating the relationship between the incremental traffic volume between certain server clusters and the diffusion ratio can be found here. Figure 1b As shown.
[0122] In some optional embodiments of this application, adjusting the number of servers in the server cluster according to the third traffic increment corresponding to the server cluster includes the following S01-S04:
[0123] S01. Obtain the single-core processing traffic value of the server cluster;
[0124] A server cluster consists of multiple servers, and each server contains one or more CPUs. The single-core processing traffic value of each server cluster is known, but different server clusters have different single-core processing traffic values.
[0125] Optionally, the single-core processing traffic value of the server cluster can be obtained by analyzing QPS and CPU data, such as... Figure 1c As shown, Figure 1c This diagram illustrates the changes in QPS / CPU and CPU utilization of a server cluster over a period of time. The QPS / CPU values of different server clusters tend to fluctuate slightly around a relatively stable value.
[0126] Optionally, the average QPS / CPU value over a preset time period can be used as the single-core processing traffic value of the server cluster.
[0127] Optionally, the QPS / CPU value collected most recently within a preset time period can be used as the single-core processing traffic value of the server cluster.
[0128] Optionally, the peak QPS / CPU value collected within a preset time period can be used as the single-core processing traffic value of the server cluster.
[0129] The single-core processing traffic value and the third traffic increment corresponding to the server cluster are used to determine the number of processor cores to be adjusted in the server cluster.
[0130] Optionally, different server clusters may have different QPS / CPU values.
[0131] S02. Based on the third traffic increment corresponding to the server cluster and the single-core processing traffic value, determine the number of processor cores to be adjusted in the server cluster;
[0132] Optionally, the ratio of the third traffic increment corresponding to the server cluster to the single-core processing traffic value can be used as the number of processor cores to be adjusted in the server cluster.
[0133] Optionally, the number of processor cores to be adjusted in the server cluster can be determined based on the third traffic increment corresponding to the server cluster and the single-core processing traffic value, which can be achieved using the following formula:
[0134] The number of processor cores to be adjusted in the server cluster = the third traffic increment corresponding to the server cluster / the single-core processing traffic value of the server cluster.
[0135] S03. Determine the number of servers to be adjusted in the server cluster based on the number of processor cores to be adjusted and the number of processor cores contained in each server in the server cluster;
[0136] Optionally, determining the number of servers to be adjusted in the server cluster based on the number of processor cores to be adjusted and the number of processor cores in each server in the server cluster includes:
[0137] The ratio of the number of processor cores to be adjusted to the number of processor cores in each server of the server cluster is determined as the number of servers to be adjusted in the server cluster.
[0138] In a server cluster, the adjusted number of servers is: (number of processor cores before adjustment + number of processor cores adjusted) / number of processor cores in each server.
[0139] S04. Adjust the number of servers in the server cluster based on the number of servers to be adjusted.
[0140] After increasing the number of servers in the server cluster by the number of servers to be adjusted, the number of servers in the server cluster becomes the sum of the original number of servers in the server cluster and the number of servers to be adjusted.
[0141] After reducing the number of servers to be adjusted from the number of servers in the server cluster, the number of servers in the server cluster is the difference between the original number of servers in the server cluster and the number of servers to be adjusted.
[0142] In some optional embodiments of this application, in S04, adjusting the number of servers in the server cluster based on the number of servers to be adjusted includes:
[0143] When the third traffic increment is positive, the number of servers in the server cluster is increased by the number of servers to be adjusted;
[0144] When the third traffic increment is negative, the number of servers in the server cluster is reduced by the number of servers to be adjusted, or no action is taken.
[0145] In some optional embodiments of this application, the aforementioned adjustment of the number of servers in the server cluster based on the number of servers to be adjusted includes:
[0146] When the traffic increment of the server cluster is positive and the current total number of cores in the server cluster is less than a first preset number, the number of servers in the server cluster is increased by the number of servers to be adjusted.
[0147] When the traffic increment of the server cluster is negative and the current total number of cores in the server cluster is greater than the second preset number, the number of servers in the server cluster is reduced by the number of servers to be adjusted.
[0148] In some optional embodiments of this application, the aforementioned adjustment of the number of servers in the server cluster based on the number of servers to be adjusted includes:
[0149] When the traffic increment of the server cluster is positive and the utilization rate of the processors in the server cluster is greater than the first preset utilization rate, the number of servers in the server cluster is increased by the number of servers to be adjusted.
[0150] When the traffic increment of the server cluster is negative and the utilization rate of the processors in the server cluster is less than the second preset utilization rate, the number of servers in the server cluster is reduced by the number of servers to be adjusted.
[0151] In some optional embodiments of this application, in the aforementioned S204, adjusting the resource quantity corresponding to the plurality of services based on the second traffic increment includes: for each of the plurality of services, for each of the plurality of server clusters deployed by the services; determining a third traffic increment corresponding to the server cluster based on the second traffic increment; and adjusting the number of processor cores in the server cluster based on the third traffic increment corresponding to the server cluster.
[0152] Optionally, the number of processor cores in the server cluster is adjusted according to the third traffic increment corresponding to the server cluster, including:
[0153] S001. Obtain the single-core processing traffic value of the server cluster;
[0154] Optionally, the average QPS / CPU value over a preset time period can be used as the single-core processing traffic value of the server cluster.
[0155] Optionally, the QPS / CPU value collected most recently within a preset time period can be used as the single-core processing traffic value of the server cluster.
[0156] S002. Based on the third traffic increment corresponding to the server cluster and the single-core processing traffic value, determine the number of processor cores to be adjusted in the server cluster;
[0157] Optionally, the ratio of the third traffic increment corresponding to the server cluster to the single-core processing traffic value can be used as the number of processor cores to be adjusted in the server cluster.
[0158] S003. Adjust the number of processors in the server cluster based on the number of processor cores to be adjusted.
[0159] In some optional embodiments of this application, in S003, adjusting the number of processors in the server cluster based on the number of processor cores to be adjusted includes:
[0160] When the third traffic increment is positive, the number of processors in the server cluster is increased by the number of processor cores to be adjusted;
[0161] When the third traffic increment is negative, the number of processors in the server cluster is reduced by the number of processor cores to be adjusted or no processing is performed.
[0162] Optionally, the number of processor cores in the server cluster can be adjusted by changing the number of servers. In this application, the number of processor cores refers to the total number of processors.
[0163] In some optional embodiments of this application, each server cluster corresponds to one access terminal type, and the multiple server clusters correspond to multiple access terminals. The access terminal types are classified according to the playback method. The multiple access terminals include: access terminals accessed through an application, access terminals accessed through a TV, and access terminals accessed through live streaming. The method further includes: determining a fourth traffic increment corresponding to each of the multiple access terminals based on the second traffic increment; adjusting the rate limiting threshold corresponding to the access terminal based on the fourth traffic increment corresponding to the access terminal; wherein the rate limiting threshold is used to limit the number of responses to access requests from the access terminal.
[0164] Optionally, the aforementioned relationship between the magnitudes of traffic increments may also include the traffic allocation ratio between the traffic increment corresponding to the access terminal and the second traffic increment information. For each access terminal, the traffic increment of the access terminal may be the product of the second traffic increment information and the traffic allocation ratio.
[0165] Optionally, the aforementioned relationship between the magnitudes of traffic increments may also include the diffusion ratio between the traffic increment of the access terminal and the second traffic increment information. For each access terminal, the traffic increment of the access terminal may be the product of the second traffic increment information and the diffusion ratio.
[0166] Optionally, adjusting the rate limiting threshold corresponding to the access terminal based on the fourth traffic increment corresponding to the access terminal may include: obtaining a preset weight value; obtaining the total traffic of the original access traffic corresponding to the access terminal and the fourth traffic increment; and using the product of the preset weight value and the total traffic as the rate limiting threshold corresponding to the access terminal. The preset weight value is greater than 1 and can be set by relevant personnel. The aforementioned total traffic is the sum of the original access traffic corresponding to the access terminal and the fourth traffic increment. The original access traffic corresponding to the access terminal is the traffic of the access terminal accessing its corresponding server cluster before the broadcast media data is broadcast.
[0167] The aforementioned second traffic increment is the sum of the traffic increments from various access terminals.
[0168] The rate limiting threshold corresponding to the access end refers to the traffic from the access end, that is, the maximum number of responses to access requests.
[0169] In some optional embodiments of this application, the method further includes the following steps S1-S2:
[0170] S1. Collect the background processing data of the media data to be broadcast during the broadcast process;
[0171] In some optional embodiments of this application, the background processing data includes at least one or more of the following information: data collection time, traffic enhancement on different dates, processor utilization, response success rate, response time for each access request, and QPS of each server cluster.
[0172] Optionally, the backend processed data can be grouped and displayed according to different server clusters.
[0173] Here, "processor" can refer to either the processor in the access layer or the processor in the cache layer.
[0174] S2. Send the background processing data to the target device so that the target device can display it.
[0175] Optionally, the target device can be a display device, such as a display screen, PC, etc.
[0176] The aforementioned backend processing data can be displayed graphically.
[0177] Through the aforementioned steps S1-S2, real-time collection and reporting of broadcast data can be achieved: during the broadcast of TV dramas, data detected in real time from multiple dimensions is automatically collected, displayed on the detection panel in real time, and broadcast after being summarized at regular intervals.
[0178] Optionally, a prompt may be sent to the target device asking whether it needs capacity expansion.
[0179] Optionally, the scaling results of each server cluster can also be displayed to the target device. The scaling results include the number of servers in the server cluster and the scaling completion time, etc.
[0180] The solution proposed in this application can predict the traffic increase of upcoming TV dramas and movies, assess the increased resource requirements of various services based on the predicted traffic increase, and then adjust service capacity and traffic limiting accordingly. Furthermore, during the broadcast of TV dramas and movies, the traffic and service performance of each online cluster can be monitored in real time, automating resource guarantee during major event operations. This improves the accuracy of traffic prediction for each service during major event operations, reduces waste caused by inaccurate resource assessment, and provides graphical visualization of monitoring data for critical services during major event operations.
[0181] Furthermore, such as Figure 2 As shown in the embodiments of this application, a resource processing system is also provided, which includes: a basic data management module, a traffic increment estimation module, a resource quantity assessment module to be adjusted module, a real-time display and reporting module for detection data, a capacity expansion module, and a traffic limiting threshold adjustment module.
[0182] The basic data management module includes a data acquisition module, a display module, and a single-core processing traffic value calculation unit. The display module shows the data collected by the data acquisition module. The data acquisition module can collect the following information: first popularity information, second popularity information, traffic of multiple services before the broadcast of reference media data, traffic of multiple services after the broadcast of reference media data, the relationship between traffic increments, the number of CPUs in each server cluster, and the QPS of each server cluster. The single-core processing traffic value calculation unit calculates the QPS / CPU value of each server cluster based on the number of CPUs and the QPS of each server cluster. Optionally, the display module also displays the trend of QPS peak changes and the number of servers in each server cluster over a certain period of time. The trend of QPS peak changes and the number of servers in each server cluster over a certain period of time can be obtained from the data acquisition module.
[0183] Optionally, the aforementioned first popularity information and second popularity information can also be calculated by other computing units, and this application does not limit this.
[0184] The traffic increment estimation module includes a traffic increment calculation unit and a traffic increment estimation unit. The traffic increment estimation unit is used to estimate, based on the first popularity information, the second popularity information, and the first traffic increment, the second traffic increment after the broadcast of the media data to be broadcast, relative to before the broadcast of the media data to be broadcast, as a second traffic increment for access to the multiple services. The traffic increment calculation unit is used to determine, based on the aforementioned traffic increment relationship and the second traffic increment, the third traffic increment corresponding to each server cluster and the fourth traffic increment corresponding to each access terminal. Optionally, relevant personnel can also adjust the second traffic increment.
[0185] The resource quantity assessment module includes a resource quantity assessment unit, which determines the number of servers to be adjusted in each server cluster based on the third-party traffic increment corresponding to each service cluster and the QPS / CPU value of each server cluster. Optionally, relevant personnel can also adjust the number of servers to be adjusted.
[0186] The real-time display and reporting module for detection data includes: a display unit for showing the number of servers to be adjusted in each server cluster, a detection data acquisition and display module, and a timed data reporting module. The detection data acquisition and display module can collect the background processing data from the aforementioned embodiments and send the background processing data to the target device for display. The timed data reporting module can schedule the sending of background processing data.
[0187] The expansion module includes an expansion control unit, which is used to expand the number of servers in each server cluster according to the number of servers to be adjusted in each server cluster, or to send instruction information to the target device to expand the number of servers in each server cluster according to the number of servers to be adjusted in each server cluster.
[0188] The rate limiting threshold adjustment module includes a rate limiting threshold adjustment unit, which is used to adjust the rate limiting threshold corresponding to each access terminal according to the fourth traffic increment corresponding to each access terminal.
[0189] about Figure 2 For specific implementation details, please refer to the foregoing content, which will not be repeated here.
[0190] The solution proposed in this application addresses the problem of inaccurate manual estimation of traffic increases during the release of films and television dramas. It ensures stability during film and television drama releases while also improving resource utilization efficiency. This application enables automated capacity expansion for services at all levels and automated adjustment of traffic limiting thresholds for upstream services, thereby improving the efficiency of ensuring stability during film and television drama releases and reducing the risk of erroneous access caused by excessive upstream services.
[0191] This application provides a solution: by acquiring first popularity information of media data to be broadcast and second popularity information of reference media data, wherein the first popularity information of the media data to be broadcast includes: popularity information of individuals related to the media data to be broadcast, and attention popularity information of the media data to be broadcast; acquiring a first traffic increment of access to multiple services after the reference media data is broadcast relative to before the broadcast, wherein the multiple services are used to provide broadcast services for the broadcast of the reference media data and the media to be broadcast; estimating a second traffic increment of access to the multiple services after the broadcast of the media data to be broadcast relative to before the broadcast, based on the first popularity information, the second popularity information, and the first traffic increment; and adjusting the resource volume corresponding to the multiple services based on the second traffic increment. The solution proposed in this application can automatically adjust the resource quantity corresponding to multiple services used to provide broadcast services for the reference media data and the media to be broadcast based on the popularity information of the reference media data, the popularity information of the media data to be played, and the traffic situation before and after the broadcast of the reference media data. This can avoid the problem of insufficient resources when the media data to be played is broadcast and reduce the failure rate of resource-related faults when the media data to be played is broadcast.
[0192] All of the above technical solutions can be combined in any way to form optional embodiments of this application, and will not be described in detail here.
[0193] To facilitate better implementation of the resource processing method of this application embodiment, this application embodiment also provides a resource processing apparatus. Please refer to [link to relevant documentation]. Figure 3 , Figure 3 This is a schematic diagram of the structure of a resource processing apparatus provided in an embodiment of this application. The resource processing apparatus includes:
[0194] The acquisition unit 31 is used to acquire first popularity information of the media data to be broadcast and second popularity information of the reference media data. The first popularity information of the media data to be broadcast includes: popularity information of the people related to the media data to be broadcast, and attention popularity information of the media data to be broadcast.
[0195] The acquisition unit 31 is further configured to acquire the first traffic increment of multiple services accessed after the reference media data is broadcast relative to before the reference media data is broadcast, wherein the multiple services are used to provide broadcast services for the broadcast of the reference media data and the media to be broadcast;
[0196] The determining unit 32 is used to estimate, based on the first popularity information, the second popularity information, and the first traffic increment, the second traffic increment of the access to the multiple services after the broadcast of the media data to be broadcast relative to before the broadcast of the media data to be broadcast;
[0197] The adjustment unit 33 is used to adjust the resource quantity corresponding to the plurality of services according to the second traffic increment.
[0198] In some optional embodiments of this application, the aforementioned device, when used to estimate a second traffic increment of access to the plurality of services after the broadcast of the media data to be broadcast, relative to before the broadcast of the media data to be broadcast, based on the first popularity information, the second popularity information, and the first traffic increment, is specifically used for:
[0199] Determine the heat ratio between the first heat information and the second heat information;
[0200] Based on the heat ratio and the first traffic increment, a second traffic increment is determined for the access of the multiple services after the broadcast of the media data to be broadcast, relative to before the broadcast of the media data to be broadcast.
[0201] In some optional embodiments of this application, each of the plurality of services is deployed with multiple server clusters. When the aforementioned apparatus is used to adjust the resource quantity corresponding to the plurality of services based on the second traffic increment, it is specifically used for:
[0202] For each of the multiple services, and for each of the multiple server clusters deployed for the services; determine the third traffic increment corresponding to the server cluster based on the second traffic increment; and adjust the number of servers in the server cluster based on the third traffic increment corresponding to the server cluster.
[0203] In some optional embodiments of this application, when the aforementioned apparatus is used to determine the third traffic increment corresponding to the server cluster based on the second traffic increment, it is specifically used for:
[0204] Obtain the relationship between the traffic increment of the server cluster and the second traffic increment;
[0205] The third traffic increment corresponding to the server cluster is determined based on the relationship between the traffic increment size and the second traffic increment.
[0206] In some optional embodiments of this application, when the aforementioned apparatus is used to adjust the number of servers in the server cluster according to the third traffic increment corresponding to the server cluster, it is specifically used for:
[0207] Obtain the single-core processing traffic value of the server cluster;
[0208] Based on the third traffic increment corresponding to the server cluster and the single-core processing traffic value, the number of processor cores to be adjusted in the server cluster is determined.
[0209] The number of servers to be adjusted in the server cluster is determined based on the number of processor cores to be adjusted and the number of processor cores contained in each server in the server cluster;
[0210] The number of servers in the server cluster is adjusted based on the number of servers to be adjusted.
[0211] In some optional embodiments of this application, when the aforementioned apparatus is used to adjust the number of servers in the server cluster based on the number of servers to be adjusted, it is specifically used for:
[0212] When the third traffic increment is positive, the number of servers in the server cluster is increased by the number of servers to be adjusted;
[0213] When the third traffic increment is negative, the number of servers in the server cluster is reduced by the number of servers to be adjusted, or no action is taken.
[0214] In some optional embodiments of this application, each server cluster corresponds to one access terminal type, and the multiple server clusters correspond to multiple access terminals. The access terminal types are classified according to the playback method. The multiple access terminals include: access terminals accessed through an application, access terminals accessed through a television, and access terminals accessed through live broadcast. The aforementioned device is further used for:
[0215] Based on the second traffic increment, determine the fourth traffic increment corresponding to each of the multiple access terminals; adjust the rate limiting threshold corresponding to the access terminal based on the fourth traffic increment corresponding to the access terminal;
[0216] The rate limiting threshold is used to limit the number of responses to access requests from the accessing client.
[0217] In some optional embodiments of this application, the aforementioned apparatus is further used for:
[0218] Collect the background processing data of the media data to be broadcast during the broadcast process;
[0219] The background processing data is sent to the target device so that the target device can display it.
[0220] Each unit of the aforementioned resource processing device can be implemented entirely or partially through software, hardware, or a combination thereof. Each unit can be embedded in or independent of the processor in a computer device in hardware form, or stored in the memory of a computer device in software form, so that the processor can invoke and execute the operations corresponding to each unit.
[0221] In this application embodiment, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.
[0222] The resource processing device can be integrated into a terminal or server that has storage and a processor and thus computing power, or it can be the terminal or server itself.
[0223] Optionally, this application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above-described method embodiments.
[0224] Figure 4 A schematic diagram of the structure of the computer device provided in the embodiments of this application, such as... Figure 4 As shown, the computer device 400 may include: a communication interface 401, a memory 402, a processor 403, and a communication bus 404. The communication interface 401, memory 402, and processor 403 communicate with each other via the communication bus 404. The communication interface 401 is used for data communication between the computer device 400 and external devices. The memory 402 can be used to store software programs and modules, and the processor 403 runs the software programs and modules stored in the memory 402, such as the software programs for the corresponding operations in the foregoing method embodiments.
[0225] Optionally, the processor 403 can invoke software programs and modules stored in the memory 402 to perform the following operations:
[0226] The first popularity information of the media data to be broadcast and the second popularity information of the reference media data are obtained. The first popularity information of the media data to be broadcast includes: the popularity information of the people related to the media data to be broadcast, and the attention popularity information of the media data to be broadcast.
[0227] The first traffic increment of multiple services accessed after the reference media data is broadcast relative to before the broadcast of the reference media data is broadcast is obtained, wherein the multiple services are used to provide broadcast services for the broadcast of the reference media data and the media to be broadcast;
[0228] Based on the first popularity information, the second popularity information, and the first traffic increment, a second traffic increment is estimated for the access of the multiple services after the broadcast of the media data to be broadcast, relative to before the broadcast of the media data to be broadcast;
[0229] The resource amounts corresponding to the multiple services are adjusted based on the second traffic increment.
[0230] This application also provides a computer-readable storage medium for storing a computer program. This computer-readable storage medium can be applied to a computer device, and the computer program causes the computer device to execute the corresponding processes in the methods described in the embodiments of this application; for brevity, these will not be elaborated further here.
[0231] This application also provides a computer program product including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the corresponding processes in the methods described in the embodiments of this application. For brevity, these details will not be elaborated further here.
[0232] This application also provides a computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the corresponding processes in the methods described in the embodiments of this application. For the sake of brevity, these details will not be elaborated further here.
[0233] It should be understood that the processor in the embodiments of this application may be an integrated circuit chip with signal processing capabilities. In implementation, the steps of the above method embodiments can be completed by integrated logic circuits in the processor's hardware or by instructions in software form. The processor described above can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly embodied in the execution of a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules can be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method.
[0234] It is understood that the memory in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDR SDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchlink DRAM (SLDRAM), and Direct Rambus RAM (DR RAM). It should be noted that the memory used in the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0235] It should be understood that the above-described memory is exemplary and not a limiting description. For example, the memory in the embodiments of this application may also be static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DR RAM), etc. That is to say, the memory in the embodiments of this application is intended to include, but is not limited to, these and any other suitable types of memory.
[0236] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0237] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.
[0238] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0239] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0240] In addition, the functional units in the embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.
[0241] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer or a server) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.
[0242] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A resource processing method, characterized in that, The method includes: The first popularity information of the media data to be broadcast and the second popularity information of the reference media data are obtained. The first popularity information of the media data to be broadcast includes: the popularity information of the people related to the media data to be broadcast, and the attention popularity information of the media data to be broadcast. The first traffic increment of multiple services accessed after the reference media data is broadcast relative to before the broadcast of the reference media data is broadcast is obtained, wherein the multiple services are used to provide broadcast services for the broadcast of the reference media data and the media to be broadcast; Based on the first popularity information, the second popularity information, and the first traffic increment, a second traffic increment is estimated for the access of the multiple services after the broadcast of the media data to be broadcast, relative to before the broadcast of the media data to be broadcast; The resource amounts corresponding to the multiple services are adjusted based on the second traffic increment.
2. The method according to claim 1, characterized in that, The step of estimating the second traffic increment of access to the multiple services after the broadcast of the media data to be broadcast, relative to before the broadcast of the media data to be broadcast, based on the first popularity information, the second popularity information, and the first traffic increment, includes: Determine the heat ratio between the first heat information and the second heat information; Based on the heat ratio and the first traffic increment, a second traffic increment is determined for the access of the multiple services after the broadcast of the media data to be broadcast, relative to before the broadcast of the media data to be broadcast.
3. The method according to claim 1, characterized in that, Each of the multiple services is deployed across multiple server clusters. The resource allocation for each of the multiple services is adjusted based on the second traffic increment, including: For each of the multiple services, and for each of the multiple server clusters deployed for the services; determine the third traffic increment corresponding to the server cluster based on the second traffic increment; and adjust the number of servers in the server cluster based on the third traffic increment corresponding to the server cluster.
4. The method according to claim 3, characterized in that, The step of determining the third traffic increment corresponding to the server cluster based on the second traffic increment includes: Obtain the relationship between the traffic increment of the server cluster and the second traffic increment; The third traffic increment corresponding to the server cluster is determined based on the relationship between the traffic increment size and the second traffic increment.
5. The method according to claim 3, characterized in that, The step of adjusting the number of servers in the server cluster based on the third traffic increment corresponding to the server cluster includes: Obtain the single-core processing traffic value of the server cluster; Based on the third traffic increment corresponding to the server cluster and the single-core processing traffic value, the number of processor cores to be adjusted in the server cluster is determined. The number of servers to be adjusted in the server cluster is determined based on the number of processor cores to be adjusted and the number of processor cores contained in each server in the server cluster; The number of servers in the server cluster is adjusted based on the number of servers to be adjusted.
6. The method according to claim 5, characterized in that, The adjustment of the number of servers in the server cluster based on the number of servers to be adjusted includes: When the third traffic increment is positive, the number of servers in the server cluster is increased by the number of servers to be adjusted; When the third traffic increment is negative, the number of servers in the server cluster is reduced by the number of servers to be adjusted, or no action is taken.
7. The method according to claim 3, characterized in that, Each server cluster corresponds to one access point type, and the multiple server clusters correspond to multiple access points. The access point types are classified according to the playback method. The multiple access points include: access points accessed through an application, access points accessed through a TV, and access points accessed through live streaming. The method further includes: Based on the second traffic increment, determine the fourth traffic increment corresponding to each of the multiple access terminals; adjust the rate limiting threshold corresponding to the access terminal based on the fourth traffic increment corresponding to the access terminal; The rate limiting threshold is used to limit the number of responses to access requests from the accessing client.
8. The method according to claim 1, characterized in that, The method further includes: Collect the background processing data of the media data to be broadcast during the broadcast process; The background processing data is sent to the target device so that the target device can display it.
9. A resource processing device, characterized in that, The device includes: The acquisition unit is used to acquire first popularity information of the media data to be broadcast and second popularity information of the reference media data. The first popularity information of the media data to be broadcast includes: popularity information of the people related to the media data to be broadcast, and attention popularity information of the media data to be broadcast. The acquisition unit is further configured to acquire a first traffic increment of multiple services accessed after the reference media data is broadcast relative to before the reference media data is broadcast, wherein the multiple services are used to provide broadcast services for the broadcast of the reference media data and the media to be broadcast; The determining unit is configured to estimate, based on the first popularity information, the second popularity information, and the first traffic increment, the second traffic increment of the access to the multiple services after the broadcast of the media data to be broadcast relative to before the broadcast of the media data to be broadcast; The adjustment unit is used to adjust the resource quantity corresponding to the plurality of services according to the second traffic increment.
10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program adapted for loading by a processor to perform the steps of the resource processing method as described in any one of claims 1-8.
11. A computer device, characterized in that, The computer device includes a processor and a memory, the memory storing a computer program, and the processor executing the steps of the resource processing method according to any one of claims 1-8 by calling the computer program stored in the memory.
12. A computer program product comprising computer instructions, characterized in that, When the computer instructions are executed by the processor, they implement the steps of the resource processing method according to any one of claims 1-8.