A content distribution network-based operation and maintenance method and system

Abstract

The application discloses a content distribution network-based operation and maintenance method and system. In the method, a pre-warning request sent by a management end is received; target data corresponding to a pre-warning type indicated by the pre-warning request is acquired from a central storage cluster according to the pre-warning type; the central storage cluster comprises a service log index and a state index data index; target service logs are stored under the service log index, and target state index data are stored under the state index data index; the target service logs and the target state index data are obtained through edge processing; a data analysis node is called to analyze and count the target data to obtain statistical indexes; the statistical indexes are compared with preset pre-warning rules to obtain comparison results; and an alarm prompt is sent when the comparison results represent that the statistical indexes exceed a threshold. In this way, the target service logs and the target state index data obtained through edge processing are collected in real time, the query range is reduced, and the efficiency of troubleshooting and the operation and maintenance efficiency of the content distribution network are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of communication, in particular to an operation and maintenance method and system based on a content delivery network. BACKGROUND

[0002] A content delivery network (CDN) is a cross-regional distributed network system composed of a large number of CDN nodes distributed in different regions. Because the content delivery network is composed of a large number of CDN nodes, and at least one edge server exists on each CDN node, a large amount of logs will inevitably be generated in the process of providing services by the content delivery network.

[0003] In the prior art, the logs of the CDN nodes are directly uploaded to a monitoring center, and then the logs are queried in the monitoring center to realize the operation and maintenance of the content delivery network. However, based on the current operation and maintenance method of the content delivery network, when a problem occurs in the edge server of the CDN node in the content delivery network, the staff cannot quickly obtain the logs of the edge server where the problem occurs, which reduces the efficiency of troubleshooting, that is, the operation and maintenance efficiency of the content delivery network in the prior art is low. SUMMARY

[0004] The present application provides an operation and maintenance method and system based on a content delivery network, which can improve the operation and maintenance efficiency of the content delivery network.

[0005] In a first aspect, the present application provides an operation and maintenance method based on a content delivery network, applied to a server, the server being in communication connection with a management end, the server including a center server and an edge server, the center server including a center storage cluster and a data analysis node, and the method including:

[0006] receiving a pre-warning request sent by the management end;

[0007] obtaining target data corresponding to a pre-warning type indicated by the pre-warning request from the center storage cluster; the center storage cluster including a business log index and a state index data index, the target business log of the edge server being stored under the business log index, and the target state index data of the edge server being stored under the state index data index; the edge server being a server located in a CDN content delivery network node; the target business log and the target state index data being obtained through edge processing;

[0008] calling the data analysis node to analyze and count the target data to obtain a statistical index;

[0009] comparing the statistical index with a preset pre-warning rule to obtain a comparison result;

[0010] When the comparison result indicates that the statistical index exceeds a threshold value, an alarm prompt is sent out.

[0011] Optionally, the target data corresponding to the pre-warning type indicated by the pre-warning request is obtained from the central storage cluster, including:

[0012] If the pre-warning type indicated by the pre-warning request is a service state pre-warning, the target service log is read from the central storage cluster.

[0013] Optionally, the target data corresponding to the pre-warning type indicated by the pre-warning request is obtained from the central storage cluster, including:

[0014] If the pre-warning type indicated by the pre-warning request is a server state pre-warning, the target state index data is read from the central storage cluster.

[0015] Optionally, the edge server includes a log agent and a server state agent, and the method further includes:

[0016] The log agent is called to collect the target service log in real time, and the target service log is sent to the central storage cluster for storage under the service log index of the collection period.

[0017] The server state agent is called to collect the target state index data in real time, and the target state index data is sent to the central storage cluster for storage under the state index data index of the collection period.

[0018] Optionally, the log agent is called to collect the target service log in real time, and the target service log is sent to the central storage cluster for storage under the service log index of the collection period, including:

[0019] The log agent is called to collect initial service log in real time.

[0020] The running status index in the initial service log is extracted; the running status index represents the running status of the service corresponding to the initial service log.

[0021] The running status index is input into a classification function to obtain a request result of a service request corresponding to the initial service log.

[0022] The target service log is generated by combining the initial service log, the running status index, the request result, and edge server configuration information; the target service log is in JSON string format.

[0023] The target business logs are sent to the business log index of the collection period in the central storage cluster for storage.

[0024] Optionally, the step of calling the server status agent to collect the target status indicator data in real time and sending the target status indicator data to the status indicator data index of the collection period to which the central storage cluster belongs for storage includes:

[0025] The server status agent is invoked to collect initial status indicator data in real time.

[0026] Based on the initial state indicator data and the edge server configuration information, the target state indicator data is generated by combining the data, and the target state indicator data is in JSON string format.

[0027] The target status indicator data is sent to the status indicator data index of the collection period to which the central storage cluster belongs for storage.

[0028] Optionally, the method further includes:

[0029] Receive query requests sent by the management terminal; the query requests include business log query requests, edge server status indicator query requests, edge server status indicator change query requests, content delivery network basic service status query requests, or content delivery network IP query requests.

[0030] Retrieve the query results corresponding to the query request from the central storage cluster.

[0031] Secondly, this application also provides an operation and maintenance method based on a content delivery network, applied to a management terminal, wherein the management terminal communicates with a server terminal; the management terminal includes an early warning module; the server terminal includes a central server and edge servers, the central server including a central storage cluster and data analysis nodes; the method includes:

[0032] The early warning module is invoked to periodically send early warning requests to the data analysis node in the server so that the data analysis node can issue an alarm when the statistical indicators representing the comparison results exceed the threshold.

[0033] The comparison result is obtained by comparing the preset warning rules and statistical indicators. The statistical indicators are obtained by analyzing and statistically analyzing the target data. The target data is the target data obtained from the central storage cluster that corresponds to the warning type indicated by the warning request.

[0034] The target service log of the edge server is stored under the service log index, and the target state indicator data of the edge server is stored under the state indicator data index; the target service log and the target state indicator data are obtained through edge processing; and the edge server is a server located at a CDN content distribution network node.

[0035] Optionally, the management end further comprises an index management module, and the method further comprises:

[0036] The index management module is invoked to manage the service log index and the state indicator data index in the center storage cluster based on preset periodic timing.

[0037] In a third aspect, the application further provides a content distribution network-based operation and maintenance system, which comprises a management end and a service end, the management end comprises a pre-warning module, the service end is in communication connection with the management end, the service end comprises a center server and an edge server, the center server comprises a center storage cluster and a data analysis node, and the edge server comprises a plurality of edge servers.

[0038] The management end is configured to invoke the pre-warning module to send a pre-warning request to the data analysis node at a timing.

[0039] The service end is configured to invoke the data analysis node to receive the pre-warning request sent by the management end.

[0040] The service end is further configured to invoke the data analysis node to acquire target data corresponding to a pre-warning type from the center storage cluster according to the pre-warning type indicated by the pre-warning request.

[0041] The center storage cluster comprises a service log index and a state indicator data index, the target service log of the edge server is stored under the service log index, and the target state indicator data of the edge server is stored under the state indicator data index; the target service log and the target state indicator data are obtained through edge processing; and the edge server is a server located at a CDN content distribution network node.

[0042] The service end is further configured to invoke the data analysis node to analyze and count the target data to obtain a statistical indicator, compare the statistical indicator with a preset pre-warning rule to obtain a comparison result, and issue an alarm prompt when the comparison result represents that the statistical indicator exceeds a threshold.

[0043] Therefore, the application has the following beneficial effects:

[0044] The application provides a content distribution network-based operation and maintenance method and system, the method is applied to a server, the server is in communication connection with a management end, the server comprises a center server and an edge server, the center server comprises a center storage cluster and a data analysis node, in the method, a warning request sent by the management end is received; target data corresponding to a warning type indicated by the warning request is acquired from the center storage cluster according to the warning type; the center storage cluster comprises a business log index and a state index data index, target business logs of the edge server are stored under the business log index, and target state index data of the edge server are stored under the state index data index; the target business logs and the target state index data are obtained through edge processing; the edge server is a server located at a CDN content distribution network node; the data analysis node is called to analyze and count the target data, and statistical indexes are obtained; the statistical indexes are compared with preset warning rules, and a comparison result is obtained; when the comparison result represents that the statistical indexes exceed a threshold value, an alarm prompt is sent. In this way, the target business logs and the target state index data of the edge server of the CDN node obtained through edge processing are collected in real time, the query range is reduced, the corresponding target business logs or target state index data are acquired according to the warning type indicated by the warning request, the business condition and the index state of the edge server on the CDN node are judged, when the edge server is abnormal, an alarm prompt is sent in time, the fault checking efficiency is improved, and the operation and maintenance efficiency of the content distribution network is improved to a certain extent. BRIEF DESCRIPTION OF DRAWINGS

[0045] In order to more clearly illustrate the technical solutions in the embodiments of the application, the drawings needed to be used in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments described in the application, and other drawings can also be obtained by those skilled in the art according to these drawings.

[0046] Figure 1 A structure schematic diagram of a content distribution network-based operation and maintenance system 1 provided in the embodiments of the application;

[0047] Figure 2 A flowchart of a content distribution network-based operation and maintenance method in the embodiments of the application;

[0048] Figure 3 A structure schematic diagram of an embodiment of a content distribution network-based operation and maintenance method in the embodiments of the application;

[0049] Figure 4 A flowchart of another embodiment of a content distribution network-based operation and maintenance method in the embodiments of the application;

[0050] Figure 5A flowchart of another embodiment of a content distribution network-based operation and maintenance method in the embodiments of the present application. DETAILED DESCRIPTION

[0051] In the description of the embodiments of the present application, the terms "first", "second", etc. are used only for the purpose of distinguishing the description, and should not be understood as indicating or implying relative importance or implying an order.

[0052] In order to make the above objectives, characteristics and advantages of the present application more apparent, comprehensible and easy to understand, the embodiments of the present application will be further described in detail below in conjunction with the drawings and specific embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, and not to limit the present application. In addition, it should be noted that, for the purpose of description, only the parts related to the present application are shown in the drawings, not all structures.

[0053] First, some of the specific terms involved in the embodiments of the present application are explained:

[0054] 1) Central storage cluster, refers to a cluster deployed on a central server, which can store a large amount of data and perform retrieval and statistics on the data. Each piece of data in the central storage cluster is stored in an index, which can be understood as a table in a database.

[0055] 2) Content distribution network, is a distributed network system that uses caching mechanism and intelligent scheduling to accelerate user access to static or dynamic resources, its purpose is to enable users to access the required resources nearby, to minimize user access delay and bandwidth occupation, and to improve user experience.

[0056] 3) Log agent, used to collect and process log data on the server.

[0057] 4) Server status agent, used to collect various performance indicators of the operating system on the server.

[0058] In the prior art, the logs of CDN nodes are generally directly uploaded to the monitoring center, and then queried in the monitoring center to realize the operation and maintenance of the content distribution network. And the query conditions that can be used in the query process are very few, and only rough query can be realized.

[0059] However, the applicant has found through research that the monitoring and operation method of the content distribution network in the prior art has the following problems:

[0060] 1) Low troubleshooting efficiency: Due to the special nature of content delivery networks (CDNs), a massive amount of logs are generated, and these logs are scattered across every server in various regional nodes. Once a problem occurs and technical personnel need to troubleshoot, it is difficult to find the necessary logs in a timely manner, and it is difficult to obtain various data indicators of the edge servers of the problematic CDN nodes, which greatly slows down the troubleshooting progress.

[0061] 2) Difficulty in fault early warning: Due to the cross-regional and distributed deployment of content delivery networks, it is difficult for operation and maintenance personnel to fully monitor the operation of the system, thus making fault early warning difficult.

[0062] 3) Delayed Fault Detection: To ensure the availability of the Content Delivery Network (CDN) service, each region's CDN nodes consist of multiple edge servers. An anomaly in one edge server often does not affect the services provided by the network. Therefore, although faults may not be detected immediately.

[0063] Based on this, this application provides an operation and maintenance method and system based on a content delivery network. This method is applied to a server-side connection, where the server communicates with a management terminal. The server-side includes a central server and edge servers. The central server includes a central storage cluster and data analysis nodes. In this method, the system receives an early warning request from the management terminal; based on the early warning type indicated in the early warning request, it retrieves target data corresponding to the early warning type from the central storage cluster; the central storage cluster includes a business log index and a status indicator data index; the business log index stores target business logs from the edge servers, and the status indicator data index stores target status indicator data from the edge servers; the target business logs and target status indicator data are obtained through edge processing; the edge servers are servers located at nodes in the CDN content delivery network; the data analysis nodes are invoked to analyze and statistically analyze the target data to obtain statistical indicators; the statistical indicators are compared with preset early warning rules to obtain comparison results; and when the comparison results indicate that the statistical indicators exceed a threshold, an alarm is issued.

[0064] In this way, by collecting target business logs and target status indicator data from the edge servers of CDN nodes in real time after edge processing, the query scope is narrowed. Based on the warning type indicated by the warning request, the corresponding target business logs or target status indicator data are obtained, enabling the judgment of the business status and indicator status of the edge servers on the CDN nodes. When it is determined that the edge server is abnormal, an alarm is issued in a timely manner, which improves the efficiency of troubleshooting and, to a certain extent, improves the operation and maintenance efficiency of the content delivery network.

[0065] To facilitate understanding of the specific implementation of the content delivery network-based operation and maintenance method provided in the embodiments of this application, the following description will be provided in conjunction with the accompanying drawings.

[0066] It should be noted that the subject implementing the operation and maintenance method based on the content distribution network can be carried in an electronic device or a functional module of an electronic device. The electronic device in the embodiment of the application can be any device capable of implementing the operation and maintenance method based on the content distribution network in the embodiment of the application, for example, a content distribution network-based operation and maintenance system.

[0067] The operation and maintenance system based on the content distribution network may, for example, be an operation and maintenance system 1 based on the content distribution network, as shown in Figure 1 The operation and maintenance system 1 based on the content distribution network includes a management end 11 and a service end 12, the management end 11 is in communication connection with the service end 12; the management end 11 includes a pre-warning module 111; the service end 12 includes a center server and an edge server, the center server includes a center storage cluster and a data analysis node:

[0068] The management end 11 is configured to call the pre-warning module to send a pre-warning request to the data analysis node at a regular time;

[0069] The service end 12 is configured to call the data analysis node to receive the pre-warning request sent by the management end;

[0070] The service end 12 is further configured to call the data analysis node to acquire target data corresponding to a pre-warning type from the center storage cluster according to the pre-warning type indicated by the pre-warning request;

[0071] The center storage cluster includes a business log index and a state index data index, the target business log of at least one edge server is stored under the business log index, and the target state index data of at least one edge server is stored under the state index data index; at least one edge server is a server located at a content distribution network (Content Delivery Network, CDN) node;

[0072] The service end 12 is further configured to call the data analysis node to analyze and count the target data to obtain a statistical index; compare the statistical index with a preset pre-warning rule to obtain a comparison result; and issue an alarm prompt when the comparison result represents that the statistical index exceeds a threshold.

[0073] In a possible implementation manner, the management end 11 further includes a query module 112;

[0074] The management end 11 is further configured to call the query module 112 to send a query request to the service end 12;

[0075] The service end 12 is further configured to receive the query request sent by the management end 11.

[0076] The service end 12 is further configured to obtain the query result corresponding to the query request from the central storage cluster.

[0077] In a possible implementation, the management end 11 further comprises an index management module 113.

[0078] The management end 11 is further configured to invoke the index management module 113 to manage the business log index and the state index data in the central storage cluster based on a preset period.

[0079] Thus, in the embodiment of the application, by deploying a log agent and a server state agent on each edge server of the system, the business log and the server state index generated by each edge server are collected in real time, the collected data are edge processed, each item of information is added to the data, and finally the data are saved to the central storage cluster. In this way, when a problem occurs and is checked, a worker can narrow the query range according to the indexes and quickly locate the problem business log, thereby improving the efficiency of checking faults.

[0080] Please refer to Figure 2 , Figure 2 A flowchart of an operation and maintenance method based on a content distribution network provided in the embodiment of the application.

[0081] In the embodiment of the application, for example, the following steps can be included:

[0082] S11, the management end 11 invokes the early warning module to send an early warning request to the data analysis node of the service end 12 at a preset period.

[0083] It should be noted that the service end 12 is in communication connection with the management end 11, the service end 12 comprises a central server and an edge server, the central server comprises a central storage cluster and a data analysis node. In the specific implementation process, the central server is in communication connection with at least one CDN node, and each CDN node in the at least one CDN node comprises at least one edge server.

[0084] S21, the service end 12 receives the early warning request sent by the management end 11.

[0085] S22, the service end 12 obtains target data corresponding to the early warning type from the central storage cluster according to the early warning type indicated by the early warning request.

[0086] It should be noted that the central storage cluster comprises a business log index and a state index data index, the target business log of the edge server is stored under the business log index, and the target state index data of the edge server is stored under the state index data index; the edge server is a server located in a CDN content distribution network node.

[0087] It should be noted that in the embodiments of the present application, the warning type indicated by the warning request is first determined, and then the target data corresponding to the warning type is obtained from the central storage cluster.

[0088] S23, the server 12 calls the data analysis node to analyze and count the target data, and obtains the statistical indicators.

[0089] In a possible implementation, S22 can include: S221, if the warning type indicated by the warning request is service state warning, reading the target service log from the central storage cluster. Then S23 can include: S231, calling the data analysis node to analyze and count the target service log, and obtaining the success rate of service request.

[0090] In a possible implementation, S22 can include: S222, if the warning type indicated by the warning request is server state warning, reading the target state indicator data from the central storage cluster. Then S23 can include: S232, calling the data analysis node to analyze and count the target state indicator data, and obtaining the indicators of the edge server.

[0091] It should be noted that the specific execution process of S221 and S222 can be referred to Figure 3 The flowchart of an embodiment of a content distribution network-based operation and maintenance method is shown in FIG. 6.

[0092] S24, the server 12 compares the statistical indicators with the preset warning rules, and obtains a comparison result.

[0093] S25, the server 12 issues an alarm prompt when the comparison result indicates that the statistical indicators exceed the threshold.

[0094] In the embodiments of the present application, the data analysis node receives the warning request and determines whether it is service state warning or server state warning. If it is service state warning, the service log data is read from the central storage cluster, and then analyzed and counted to obtain the current service request success rate and other indicators. The statistical indicators are compared with the warning rules to obtain a comparison result, and if the comparison result indicates that the statistical indicators exceed the threshold, an alarm is initiated. If it is server state warning, the target server state data is read from the central storage cluster, and then analyzed and counted to obtain the current indicators of the edge server. The statistical indicators are compared with the warning rules to obtain a comparison result, and if the comparison result indicates that the statistical indicators exceed the threshold, an alarm is initiated.

[0095] In the specific implementation process, when the comparison result indicates that the statistical indicators exceed the threshold, an alarm information can be sent to the unified alarm processing platform of the central server, and an alarm prompt is issued through the unified alarm platform.

[0096] In a possible implementation, each edge server of each CDN node needs to deploy two agents, a log agent and a server state agent, that is, the edge server includes the log agent and the server state agent, and then the method provided in the embodiment of the application can further include the following steps.

[0097] S201, calling the log agent to collect target service logs in real time, and sending the target service logs to the business log index of the collection period in the central storage cluster for storage.

[0098] S202, calling the server state agent to collect target state indicator data in real time, and sending the target state indicator data to the state indicator data index of the collection period in the central storage cluster for storage.

[0099] The collection period corresponds to a preset period, for the convenience of understanding the scheme provided in the embodiment of the application, it is assumed that the preset period is one day, and then the target state indicator data collected in real time in the collection period of 2024.11.24 should be stored in the state indicator data index of 2024.11.24.

[0100] It should be noted that the target service logs and the target state indicator data are obtained through edge processing.

[0101] In a possible implementation, S201 provided in the embodiment of the application can include the following steps.

[0102] S2011, calling the log agent to collect initial service logs in real time.

[0103] S2021, extracting a running status indicator in the initial service log; the running status indicator represents the running status of the service corresponding to the initial service log.

[0104] For example, the running status indicator can include the request IP, request time, request resource size, or request URL of the user request corresponding to the initial service log.

[0105] In the embodiment of the application, if the current running status indicator can reflect the running status of the service corresponding to the initial service log, S2013 is performed, if the current running status indicator cannot reflect the running status of the service corresponding to the initial service log, and none of the running status indicators in the initial service log can reflect the running status of the service corresponding to the initial service log, S2011 is returned to perform, if the current running status indicator cannot reflect the running status of the service corresponding to the initial service log, but there is a running status indicator in the initial service log that can reflect the running status of the service corresponding to the initial service log, S2014 is performed.

[0106] S2013, input the running status index into a classification function to obtain a request result of a service request corresponding to the initial service log.

[0107] S2014, generate a target service log according to the initial service log, the running status index, the request result, and edge server configuration information, the target service log being in a JSON string format.

[0108] The edge server configuration information can include an IP of the edge server, a CDN node to which the edge server belongs, and a role played by the edge server in the CDN node.

[0109] S2015, send the target service log to the service log index of the collection period in the central storage cluster for storage.

[0110] It should be noted that the execution process of S2011-S2015 can refer to a flowchart of another embodiment of a content distribution network-based operation and maintenance method as shown in Figure 4

[0111] In the embodiment, first, the service log agent collects initial service logs generated on the edge server in real time, extracts information from the initial service logs, inputs the extracted running status index of the edge server into a classification function to obtain a request result of a user request corresponding to the initial service log, and finally combines the initial service log, the running status index, the request result, and edge server configuration information into a JSON string, and sends the JSON string as a target service log to the central storage cluster for storage.

[0112] In a possible implementation, S202 provided in the embodiment can include:

[0113] S2021, call a server state agent to collect initial state index data in real time.

[0114] The initial state index data can include an operating system memory state, a disk storage state, a disk input / output state, an edge server running process state, or a central processing unit (CPU) state of the edge server.

[0115] S2022, combine target state index data according to the initial state index data and edge server configuration information, the target state index data being in a JSON string format.

[0116] ​The edge server configuration information can include an IP of the edge server, a CDN node to which the edge server belongs, and a role played by the edge server in the CDN node.

[0117] S2023, the target state indicator data is sent to the central storage cluster for storage under the state indicator data index of the collection period.

[0118] It should be noted that the execution process of S2021-S2023 can refer to a flowchart of another embodiment of the operation and maintenance method based on the content distribution network as shown in the figure. Figure 5

[0119] In the embodiment of the application, the server state agent collects the initial state indicator data of the edge server in real time, combines the initial state indicator data and the edge server configuration information into a JSON string, and sends the JSON string as the target state indicator data to the central storage cluster for storage.

[0120] In this way, the embodiment of the application deploys a business log agent and a server state agent on each edge server of the CDN node, the business log agent collects the initial business log generated by each edge server and performs edge processing on the initial business log (i.e., generates a target business log according to the initial business log, the running status indicator, the request result, and the edge server configuration information, and the target business log is in a JSON string format), the server state agent collects the initial state indicator data of each edge server and performs edge processing on the initial state indicator data (i.e., generates target state indicator data according to the initial state indicator data and the edge server configuration information, and the target state indicator data is in a JSON string format), and sends the collected and processed data to the central storage cluster for storage. The data processed by the edge can be used as a query condition when querying, effectively reducing the query range, and improving the operation and maintenance efficiency based on the content distribution network to a certain extent.

[0121] In addition, in the embodiment of the application, the early warning module does not assume the early warning function, but builds a data analysis node separately, and then calls the data analysis node by sending an early warning request through the management end. After receiving the early warning request, the data analysis node reads the corresponding original data from the central storage cluster, performs statistical analysis on the original data, obtains statistical indicators, and further determines whether to issue an alarm prompt according to the statistical indicators and preset early warning rules. In this way, the method of calling the data analysis node by sending a request through the management end can more flexibly set the early warning conditions and rules, which is helpful for customized early warning settings and improves the accuracy and pertinence of early warning.

[0122] In a possible implementation, the method provided by the embodiment of the application can further include: ​

[0123] S12, the management end calls the query module to send a query request to the service end.

[0124] It should be noted that the query module includes a plurality of functions, including business log query, edge server state index query, edge server state index change query, content distribution network basic service state query, and content distribution network IP query. Then, different query requests can be sent to the service end through the query module, wherein the query request includes a business log query request, an edge server state index query request, an edge server state index change query request, a content distribution network basic service state query request, or a content distribution network IP query request.

[0125] S26, the service end receives the query request sent by the management end.

[0126] S27, the query result corresponding to the query request is obtained from the center storage cluster.

[0127] It should be noted that different query requests will utilize different query conditions to query from different indexes of the center storage cluster.

[0128] The business log query refers to querying the log generated by the content distribution network during service provision; the edge server real-time state index query refers to querying various index data recorded by the edge server last time; the edge server state index change query refers to querying the change of the state of the edge server in the past period of time; the content distribution network basic service state query refers to querying the basic situation of a CDN node service, including cache hit rate, cache miss rate, request success rate, or request failure rate; and the content distribution network IP query refers to querying the IP request times or request success rate of the CDN node.

[0129] Compared with the rough query that can be achieved by the prior art, the embodiments of the present application can better help technicians to achieve content distribution network-based operation and maintenance, and improve the operation and maintenance efficiency of the content distribution network.

[0130] In a possible implementation manner, the management end further includes an index management module, and the method provided by the embodiments of the present application can further include:

[0131] S13, calling the index management module, and managing the business log index and the state index data index in the center storage cluster based on a preset period.

[0132] It should be noted that the center storage cluster will collect a large amount of edge server-related data in each preset period, and if not managed in a reasonable manner, not only will it cause a huge waste of storage space, but also will cause the management end to slow down when querying.

[0133] In the embodiments of the present application, the index management module is called to manage the service log index and the state index data index in the central storage cluster based on a preset period timing, including deleting expired indexes and creating new indexes.

[0134] In the specific implementation process, in the embodiments of the present application, the preset period is taken as an example for one day, and the management mode is that the management end calls the reserved interface in the central storage cluster to build two indexes for each CDN node for storing data on the second day at midnight on the first day, the name of the service log index is "node name-log-yyyy-MM-dd", and the name of the state index data index is "node name-server-yyyy-MM-dd", yyyy-MM-dd is the date of the second day. At the same time, the management end also reads the full index name in the central storage cluster every day, then reads the time when the index is created according to the index name, and judges whether the index is expired or not, if it is expired (for example, the index is created eight days ago, and the storage time exceeds seven days), it will be cleared.

[0135] In this way, in the embodiments of the present application, the index management module, the query module and the early warning module are constructed on the management platform of the content distribution network to manage the data index of the central storage cluster, query the data and manage the early warning rules, and improve the operation and maintenance efficiency based on the content distribution network.

[0136] From the above description of the implementation mode, those skilled in the art can clearly understand that all or part of the steps in the above embodiment method can be implemented by means of software plus a general hardware platform. Based on this understanding, the technical solutions of the present application can be embodied in the form of a software product. The computer software product can be stored in a storage medium, such as a read-only memory (English: read-only memory, ROM) / RAM, a magnetic disc, an optical disc, etc., and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server, or a network communication device such as a router) to execute the method described in each embodiment or some parts of the embodiments of the present application.

[0137] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on its differences from other embodiments. In particular, the device embodiments are basically similar to the method embodiments, so the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments. The device embodiments described above are merely illustrative. Modules described as separate components may or may not be physically separate. Components shown as modules may or may not be physical modules; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the objectives of this embodiment according to actual needs. Those skilled in the art can understand and implement this without creative effort.

[0138] The above description is merely a preferred embodiment of this application and is not intended to limit the scope of protection of this application. It should be noted that those skilled in the art can make various improvements and modifications without departing from this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. An operation and maintenance method based on a content delivery network, characterized in that, Applied to the server side, the server communicates with the management end. The server side includes a central server and edge servers. The central server includes a central storage cluster and data analysis nodes. The method includes: Receive the warning request sent by the management terminal; Based on the warning type indicated by the warning request, target data corresponding to the warning type is obtained from the central storage cluster; the central storage cluster includes a business log index and a status indicator data index, the business log index stores the target business logs of the edge server, and the status indicator data index stores the target status indicator data of the edge server; the edge server is a server located at a CDN content delivery network node; the target business logs and the target status indicator data are obtained through edge processing; The data analysis node is invoked to analyze and statistically analyze the target data to obtain statistical indicators; The statistical indicators are compared with the preset early warning rules to obtain the comparison results; When the comparison results indicate that the statistical indicator exceeds the threshold, an alarm is issued.

2. The method according to claim 1, characterized in that, The step of retrieving target data corresponding to the warning type from the central storage cluster according to the warning type indicated by the warning request includes: If the warning request indicates a business status warning, then the target business log is read from the central storage cluster.

3. The method according to claim 1, characterized in that, The step of retrieving target data corresponding to the warning type from the central storage cluster according to the warning type indicated by the warning request includes: If the warning request indicates a server status warning type, then the target status indicator data is read from the central storage cluster.

4. The method according to claim 1, characterized in that, The edge server includes a log proxy and a server state proxy, and the method further includes: The log agent is invoked to collect the target business logs in real time and send the target business logs to the business log index of the collection period in the central storage cluster for storage. The server status agent is invoked to collect the target status indicator data in real time, and the target status indicator data is sent to the status indicator data index of the collection period to be stored in the central storage cluster.

5. The method according to claim 4, characterized in that, The step of invoking the log agent to collect the target business logs in real time and sending the target business logs to the business log index of the collection period in the central storage cluster includes: The log agent is invoked to collect initial business logs in real time; Extract operational status metrics from the initial business logs; these operational status metrics characterize the operational status of the business services corresponding to the initial business logs. Input the operational status indicators into the classification function to obtain the request results of the business requests corresponding to the initial business logs; The target business log is generated by combining the initial business log, the operational status indicators, the request results, and the edge server configuration information. The target business log is in JSON string format. The target business logs are sent to the business log index of the collection period in the central storage cluster for storage.

6. The method according to claim 4, characterized in that, The step of calling the server status agent to collect the target status indicator data in real time and sending the target status indicator data to the status indicator data index of the collection period belonging to the central storage cluster includes: The server status agent is invoked to collect initial status indicator data in real time. Based on the initial state indicator data and the edge server configuration information, the target state indicator data is generated by combining the data, and the target state indicator data is in JSON string format. The target status indicator data is sent to the status indicator data index of the collection period to which the central storage cluster belongs for storage.

7. The method according to claim 1, characterized in that, The method further includes: Receive query requests sent by the management terminal; the query requests include business log query requests, edge server status indicator query requests, edge server status indicator change query requests, content delivery network basic service status query requests, or content delivery network IP query requests. Retrieve the query results corresponding to the query request from the central storage cluster.

8. An operation and maintenance method based on a content delivery network, characterized in that, It is used in the management terminal, which communicates with the server; the management terminal includes an early warning module; The server includes a central server and edge servers, and the central server includes a central storage cluster and data analysis nodes; the method includes: The early warning module is invoked to periodically send early warning requests to the data analysis node in the server so that the data analysis node can issue an alarm when the statistical indicators representing the comparison results exceed the threshold. The comparison result is obtained by comparing the preset warning rules and statistical indicators. The statistical indicators are obtained by analyzing and statistically analyzing the target data. The target data is the target data obtained from the central storage cluster that corresponds to the warning type indicated by the warning request. The business log index stores the target business logs of the edge server, and the status indicator data index stores the target status indicator data of the edge server; the edge server is a server located in a CDN content delivery network node.

9. The method according to claim 8, characterized in that, The management terminal also includes an index management module, and the method further includes: The index management module is invoked to periodically manage the business log index and the status indicator data index in the central storage cluster based on a preset period.

10. An operation and maintenance system based on a content delivery network, characterized in that, The system includes a management terminal and a server terminal. The management terminal includes an early warning module. The server terminal communicates with the management terminal. The server terminal includes a central server and edge servers. The central server includes a central storage cluster and data analysis nodes. The management terminal is used to call the early warning module to send early warning requests to the data analysis node at regular intervals; The server is used to invoke the data analysis node and receive the early warning request sent by the management terminal; The server is also used to call the data analysis node to obtain target data corresponding to the warning type from the central storage cluster according to the warning type indicated by the warning request; The central storage cluster includes a business log index and a status indicator data index. The business log index stores the target business logs of the edge servers, and the status indicator data index stores the target status indicator data of the edge servers. The edge servers are servers located at CDN content delivery network nodes. The server is also used to call the data analysis node to analyze and statistically analyze the target data to obtain statistical indicators; and to compare the statistical indicators with preset early warning rules to obtain comparison results. When the comparison results indicate that the statistical indicator exceeds the threshold, an alarm is issued.

Images