Site performance evaluation method, system and device and computer equipment
By receiving user's dial-test task configuration requests, generating and issuing dial-test task information, performing dial-test operations and feedback results, finally evaluating site performance based on dial-test results, solving the problem of low evaluation accuracy in traditional methods, realizing the Higher comprehensiveness and accuracy of assessment.
Patent Information
- Application Number
- CN202411623280.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-14
- Publication Date
- 2025-02-21
AI Technical Summary
Traditional site performance evaluation methods rely on server logs and user feedback, resulting in low evaluation accuracy and difficulty in fully reflecting the true performance of the site.
By receiving the user's dialing task configuration request, determining the dialing address, type and cycle based on the configuration information, generating dialing task information and issuing it to the dialing point, performing dialing operations and feedback the results, and finally evaluating the site based on the dialing results performance.
This method can more comprehensively simulate the network behavior of real users or external systems, improve the comprehensiveness and accuracy of site evaluation, and effectively solve the problem of poor server log timeliness.
Smart Images

Figure CN119496719A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of network monitoring technology, and in particular to a site performance evaluation method, system, device and computer equipment. Background Art
[0002] With the rapid development and popularization of Internet technology, site stability, availability and other performance have become key factors in determining user satisfaction and corporate competitiveness. Therefore, it is very important to evaluate site performance.
[0003] Traditional solutions often rely on server logs or user feedback to evaluate the performance and operating status of the site. For example, the server log of the site is retrieved, and then the server log is used to analyze whether the site has failed, the frequency of failures, etc., and finally the site performance is evaluated.
[0004] However, evaluating site performance only through server logs may not fully reflect the true situation of the site, considering the timeliness of server logs. Evaluating site performance through user feedback information will lead to highly subjective evaluation results, that is, the accuracy of traditional solutions in evaluating site performance is low. Summary of the invention
[0005] Based on this, it is necessary to provide a site performance evaluation method, system, device and computer equipment that can improve the accuracy of site evaluation in response to the above technical problems.
[0006] In a first aspect, the present application provides a site performance evaluation method. The method comprises:
[0007] Receiving a dial test task configuration request for a target site, wherein the dial test task configuration request carries dial test task configuration information;
[0008] Determine the dialing test address, dialing test type and dialing test period according to the dialing test task configuration information;
[0009] Generate dial test task information based on the dial test address, the dial test type and the dial test period, and send the dial test task information to the corresponding dial test point, so that the dial test point sends a dial test message to the dial test address based on the dial test type and the dial test period, performs a dial test operation on the target site, and obtains and feeds back a dial test result;
[0010] The dialing test result fed back by the dialing test point is obtained, and the performance of the target site is evaluated based on the dialing test result.
[0011] In a second aspect, the present application also provides a site performance evaluation system. The system includes an interconnected dialing task management platform and multiple dialing points;
[0012] The dial test task management platform is used to receive a dial test task configuration request sent by a user for a target site, the dial test task configuration request carries dial test task configuration information, parse the dial test task configuration information, obtain the dial test task information and the dial test point information associated with the dial test task information, and send the dial test task information to the dial test point matching the dial test point information;
[0013] The dial test point is used to receive the dial test task information, parse the dial test task information to obtain the dial test address, dial test type and dial test cycle, generate and send a dial test message to the dial test address according to the dial test type and dial test cycle, and obtain and feed back the dial test result to the dial test task management platform;
[0014] The dialing test task management platform is also used to evaluate the performance of the target site according to the received dialing test results.
[0015] In a third aspect, the present application also provides a site performance evaluation device. The device includes:
[0016] The data receiving module is used to receive a dialing test task configuration request for a target site, where the dialing test task configuration request carries dialing test task configuration information.
[0017] The task configuration module is used to determine the dialing test address, dialing test type and dialing test cycle according to the dialing test task configuration information.
[0018] The task delivery module is used to generate the dialing test task information based on the dialing test address, dialing test type and dialing test cycle, and deliver the dialing test task information to the corresponding dialing test point, so that the dialing test point sends the dialing test message to the dialing test address based on the dialing test type and dialing test cycle, performs the dialing test operation on the target site, and obtains and feeds back the dialing test result.
[0019] The performance evaluation module is used to obtain the dialing test results fed back by the dialing test point and evaluate the performance of the target site based on the dialing test results.
[0020] In a fourth aspect, the present application further provides a computer device, wherein the computer device comprises a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps in the above-mentioned embodiments of the site performance evaluation method are implemented.
[0021] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps in the above-mentioned embodiments of the site performance evaluation method are implemented.
[0022] In a fifth aspect, the present application further provides a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned site performance evaluation method embodiments are implemented.
[0023] The site performance evaluation method, system, device and computer equipment receive the dial test task configuration request sent by the user, and then parse the dial test address, dial test cycle, dial test type and other information according to the dial test task configuration information, and then generate the dial test task information based on the dial test address, dial test type and dial test cycle, and send the dial test task information to the corresponding dial test point, so that the dial test point sends a dial test message to the dial test address based on the dial test type and dial test cycle, performs a dial test operation on the target site, obtains and feeds back the dial test result, and finally obtains the dial test result fed back by the dial test point, and evaluates the performance of the target site based on the dial test result. Different from the traditional solution that relies on passive logging and user feedback, this solution allows users to customize the dial test task configuration information and periodically execute the dial test task, so as to more comprehensively simulate the network behavior of real users or external systems, and the obtained dial test results can reflect the performance status of the site at different time points, which can effectively solve the problem of poor timeliness of server logs, and thus improve the comprehensiveness and accuracy of site evaluation. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] Figure 1 An application environment diagram of a site performance evaluation method in one embodiment;
[0025] Figure 2 A schematic diagram of a flow chart of a site performance evaluation method in one embodiment;
[0026] Figure 3 is a flow chart of a site performance evaluation method according to another embodiment;
[0027] Figure 4 is a structural block diagram of a site performance evaluation system in one embodiment;
[0028] Figure 5 A structural block diagram of a dial-test point in an embodiment;
[0029] Figure 6 is a structural block diagram of a site performance evaluation system in another embodiment;
[0030] Figure 7 is a structural block diagram of a site performance evaluation system in a detailed embodiment;
[0031] Figure 8 is a structural block diagram of a site performance evaluation device in one embodiment;
[0032] Fig. 9FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0033] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0034] The site performance evaluation method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown in the figure, the dial test task management platform 102 communicates with the dial test point 104 through the network. Specifically, the user may send a dial test task configuration request for the target site to the dial test task management platform 102, and the dial test task configuration request carries the dial test task configuration information. The dial test task management platform 102 determines the dial test address, the dial test type and the dial test cycle according to the dial test task configuration information, and generates the dial test task information based on the dial test address, the dial test type and the dial test cycle, and sends the dial test task information to the corresponding dial test point 104. The dial test point 104 sends a dial test message to the dial test address based on the dial test type and the dial test cycle, performs a dial test operation on the target site, obtains and feeds back the dial test result to the dial test task management platform 102. The dial test task management platform 102 obtains the dial test result fed back by the dial test point, and evaluates the performance of the target site based on the dial test result.
[0035] In one embodiment, Figure 2 As shown, a site performance evaluation method is provided, which is applied to Figure 1 The dial test task management platform 102 in the example is used as an example to illustrate, including the following steps:
[0036] S100, receiving a dialing test task configuration request for a target site, where the dialing test task configuration request carries dialing test task configuration information.
[0037] Among them, dial testing refers to the process of performance testing and monitoring of sites such as networks, dial testing task management platforms or applications, and evaluates the performance, stability and reliability of sites by simulating requests from real users or external systems. A dial testing task configuration request is a request submitted by a user, and the dial testing task configuration information may include but is not limited to the site of the dial testing task, the test content of the dial testing task and other information.
[0038] Specifically, the dial test task management platform receives a dial test task configuration request sent by a user, and the request carries the dial test task configuration information, wherein the dial test task configuration information includes the address of the target site, the type of indicator to be tested, the execution cycle of the dial test operation, etc. The dial test task configuration information can be customized by the user through the terminal, and therefore can well reflect the user's testing requirements.
[0039] For example, taking the case where a user performs a dial test on a certain website, the dial test task configuration information includes the network address of the website, the test indicator type is page response time, and the execution cycle of the dial test operation is 5 minutes. This means that in subsequent dial test operations, the dial test task management platform will send a request to the network address every five minutes and record the page response time of the website.
[0040] S200: Determine a dialing test address, a dialing test type, and a dialing test period according to the dialing test task configuration information.
[0041] The dial test address refers to the network address of the site, which can be expressed in the form of a URL (Uniform Resource Locator) or an IP address. The dial test type refers to the specific indicators that the dial test operation focuses on, such as the site's response time, packet loss rate, loading speed, etc. The dial test cycle refers to the frequency at which the dial test task management platform performs the dial test operation, such as every 1 minute, every 5 minutes, etc.
[0042] Specifically, by parsing the dial test task configuration information, the specific content of the dial test operation can be clarified, including but not limited to the dial test address, dial test type and dial test cycle. If the dial test task configuration information is customized by the user for the connection quality of a certain site, the dial test address is the address of the site, the dial test type is the packet loss rate, and the dial test cycle is 1 minute.
[0043] S300: Generate dialing test task information based on the dialing test address, the dialing test type and the dialing test cycle, and send the dialing test task information to the corresponding dialing test point.
[0044] The dial test point sends a dial test message to the dial test address based on the dial test type and the dial test cycle, performs a dial test operation on the target site, obtains and feeds back the dial test result. For example, the dial test point sends a corresponding dial test message to the dial test address according to the dial test cycle, and the dial test message can be generated according to the dial test type. Specifically, the dial test message can be a test information packet generated according to the dial test type, and the dial test task management platform or the dial test point periodically sends a test information packet to the dial test address to test the performance of the target site in terms of response time, packet loss rate, etc.
[0045] Exemplarily, the dial test task management platform may send information such as the dial test address, dial test type, and dial test cycle to a specific dial test point, which generates a dial test message according to the dial test type, and then sends the dial test message to the dial test address according to the dial test cycle. After waiting for a certain period of time, the dial test result fed back by the dial test address is received, and then the dial test task management platform analyzes the dial test result to evaluate the performance of the target site.
[0046] S400: Obtain a dialing test result fed back by the dialing test point, and evaluate the performance of the target site based on the dialing test result.
[0047] The dial test result refers to the performance data obtained after the dial test point performs the dial test operation, including but not limited to the site response time, packet loss rate, page loading speed, etc. Performance evaluation refers to the analysis of the overall performance of the target site based on the dial test results, such as stability, availability and other performance indicators.
[0048] Exemplarily, the dial test task management platform analyzes and processes the dial test results, which may include the dial test results obtained after the dial test point performs the dial test operation multiple times within a period of time, so multiple performance indicators of the target site can be analyzed. For example, two dial test operations are performed on a certain site, and the dial test types are site response time and packet loss rate, respectively. Therefore, the final dial test results include the performance of the site in terms of site response time and packet loss rate. The overall performance of the site can be evaluated through statistical analysis, weighted analysis, etc. Further, after evaluating the performance of the site, a site performance report, trend chart, etc. of the target site can also be generated.
[0049] The site performance evaluation method, system, device and computer equipment receive the dial test task configuration request sent by the user, and then parse the dial test address, dial test cycle, dial test type and other information according to the dial test task configuration information, and then generate the dial test task information based on the dial test address, dial test type and dial test cycle, and send the dial test task information to the corresponding dial test point, so that the dial test point sends a dial test message to the dial test address based on the dial test type and dial test cycle, performs a dial test operation on the target site, obtains and feeds back the dial test result, and finally obtains the dial test result fed back by the dial test point, and evaluates the performance of the target site based on the dial test result. Different from the traditional solution that relies on passive logging and user feedback, this solution allows users to customize the dial test task configuration information and periodically execute the dial test task, so as to more comprehensively simulate the network behavior of real users or external systems, and the obtained dial test results can reflect the performance status of the site at different time points, which can effectively solve the problem of poor timeliness of server logs, and thus improve the comprehensiveness and accuracy of site evaluation.
[0050] In one embodiment, obtaining the dial test result fed back by the dial test point includes searching for the dial test result from a preset time series database according to the dial test task information, wherein the dial test result is uploaded to the time series database by the dial test point.
[0051] The time series database may be VictoriaMetrics, an open source high-performance time series database and monitoring system, which is specifically used to store and analyze large-scale time series data. In this embodiment, through the preset time series database, the dial test results can be stored in chronological order according to the timestamps carried by the dial test results. When the dial test task management platform searches for the dial test results in the time series database, they can search according to the dial test type, dial test cycle, dial test address, etc. in the dial test task information.
[0052] In this embodiment, the dial test results are stored in a time series database, which can improve the data storage and data query capabilities of the dial test task management platform, thereby effectively responding to frequent dial test configuration requests and a large number of dial test results.
[0053] In one embodiment, the method further includes performing aggregation calculation on the dialing test results to obtain aggregated dialing test results, and storing the aggregated dialing test results in a time series database.
[0054] Aggregate calculation is an operation to merge and summarize a large amount of data, which can be used to simplify the data volume and extract key information. Specifically, the dial test task management platform can perform real-time secondary calculation and storage on a large amount of dial test results according to preset aggregate calculation rules (referring to the algorithm or logic for processing the dial test results).
[0055] For example, the dial test result may include the response time obtained by multiple dial test operations of the target site within a certain time period. The dial test task management platform may perform aggregate calculation on the dial test result according to the preset aggregate calculation rule, which may be to calculate the average response time, maximum response time, minimum response time, etc. of the target site within a certain time period. Further, the aggregated dial test result is stored in the time series database 130. In addition, the aggregation rule may be configured in the time series database in advance. When the dial test result is stored in the time series database, the time series database automatically performs aggregate calculation on the dial test result to obtain and store the aggregated dial test result.
[0056] In this embodiment, by performing aggregation calculations on the dialing test results, important data can be effectively screened and processed from a large number of dialing test results, and a large amount of data can be streamlined into fewer important data points, which can effectively reduce the query cost of subsequent systems, improve the data processing efficiency of the system, and provide better quality data support for site performance evaluation.
[0057] In one embodiment, Figure 3 As shown, after S400, the method further includes:
[0058] S500: When the dial test result indicates that the target site performance is abnormal, an alarm message is pushed.
[0059] Among them, performance anomaly means that the detected performance indicators (such as response time, packet loss rate, loading speed, etc.) exceed the preset threshold, or other abnormal fluctuations occur, which means that the target site may have network delays, excessive load on the dial-up task management platform, or unstable connections. The alarm information may include but is not limited to the dial-up test results, specific performance indicator values of the target site, abnormal reasons, etc. The alarm information can be pushed by the dial-up task management platform to the operation and maintenance personnel or other responsible persons of the target site to remind them to take maintenance measures immediately.
[0060] For example, if the dialing test task management platform performs a dialing test operation on a certain site and detects that the response time of the site is 2 seconds, and the response time threshold for the site is 1 second, the site performance is determined to be abnormal. The dialing test task management platform randomly generates an alarm message, including the dialing test results, the response time of the site, the site address and other information, and pushes the alarm message to the designated receiving end. The alarm message is pushed in ways including but not limited to sending it to the responsible personnel via email, text message, monitoring system application push and other ways.
[0061] In this embodiment, by setting an abnormal alarm mechanism, the dialing task management platform can notify the relevant person in charge as soon as possible when detecting performance abnormalities in the target site, thereby improving the response speed to abnormal situations and improving the stability and availability of the target site.
[0062] In order to make a clearer description of the site performance evaluation method provided by the present application, the following is a specific embodiment and the attached Figure 3 To illustrate, this specific embodiment includes the following steps:
[0063] S100, receiving a dialing test task configuration request sent by a user, where the dialing test task configuration request carries dialing test task configuration information.
[0064] S200: Determine a dialing test address, a dialing test type, and a dialing test period according to the dialing test task configuration information.
[0065] S300, performing a dial test operation on a target site according to a dial test type and a dial test cycle, and obtaining a dial test result.
[0066] S400 evaluates the performance of the target site based on the dial test results.
[0067] S500: When the dial test result indicates that the target site performance is abnormal, an alarm message is pushed.
[0068] In one embodiment, a site performance evaluation system 100 is provided. Figure 4As shown, the system includes a dialing task management platform 110 and a plurality of dialing points 120 which are interconnected;
[0069] The dialing test task management platform 110 is used to receive a dialing test task configuration request sent by a user for a target site, the dialing test task configuration request carries dialing test task configuration information, parse the dialing test task configuration information, obtain the dialing test task information and the dialing test point information associated with the dialing test task information, and send the dialing test task information to the dialing test point 120 that matches the dialing test point information.
[0070] The dial test point 120 is used to receive the dial test task information, parse the dial test task information to obtain the dial test address, dial test type and dial test cycle, generate and send the dial test message to the dial test address according to the dial test type and dial test cycle, and obtain and feed back the dial test result to the dial test task management platform 110.
[0071] The dialing test task management platform 110 is also used to evaluate the performance of the target site according to the received dialing test results.
[0072] The dial test task management platform 110 is responsible for parsing the dial test task configuration information, storing the dial test task information in a connected database, such as a Mysql relational table, and sending the dial test task information to the dial test point according to the dial test task configuration information. The dial test point 120 is used to receive the dial test task information sent by the dial test task management platform 110, create a scheduled dial test task according to the dial test task information, and detect the target site by sending a dial test message at a scheduled time.
[0073] Specifically, the dial test task management platform 110 receives a dial test task configuration request from the user end, which includes the dial test task configuration information such as the user dial test address, dial test type, and dial test cycle. Further, the dial test task management platform 110 parses the dial test task configuration information to obtain the dial test task information, such as the specific address of the target site, the dial test type and the dial test cycle, and the dial test point information associated with the dial test task information. Exemplarily, the system provided by the present application may include multiple dial test points 120, which are distributed and deployed in the system, so that different network addresses and network conditions of real users can be simulated. The specific dial test point can also be defined by the user and included in the dial test task configuration information. In addition, multiple dial test points can be selected to perform the dial test operation at the same time, so as to obtain a more comprehensive dial test result. For example, if the target site that the user wants to test is a site that allows global users to access, dial test points that do not belong to multiple countries or regions can be selected to perform the dial test operation at the same time, so that the final dial test result is more comprehensive.
[0074] Further, after the dial test task management platform 110 sends the dial test task information to the associated dial test point 120, the dial test point 120 parses the dial test task information to obtain the dial test address, dial test type and dial test cycle, and then detects the target site by regularly sending a dial test message. Finally, the dial test point 120 sends the dial test result to the dial test task management platform 110, and the dial test task management platform 110 further analyzes the performance of the target site based on the dial test result. Since the analysis process has been described in detail in the above method embodiment, it will not be repeated here.
[0075] In this embodiment, an efficient, reliable and intelligent site performance evaluation system is provided. The distributed deployment of dial-up test points can collect performance data of target sites under multi-location and multi-network conditions, and can provide richer test information compared to single-point monitoring. The dial-up test task management platform can aggregate the dial-up test results collected by the distributed dial-up test points, and can realize a comprehensive and accurate evaluation of the target site performance.
[0076] In one embodiment, Figure 5 As shown, the dialing point 120 includes a task execution module 121 , and a task management module 122 , a task storage module 123 , a timing module 124 and a data reporting module 125 connected to the task execution module 121 . The task management module 122 is connected to the task storage module 123 and the timing module 124 .
[0077] The task management module 122 is used to receive the dialing test task information, store the dialing test task information in the task storage module 123 , parse the dialing test task information to obtain the dialing test cycle, generate a scheduled task according to the dialing test cycle, and send it to the timing module 124 .
[0078] The timing module 124 is used to receive a timing task and send a timing signal to the task execution module 121 according to the timing task.
[0079] The task execution module 121 is used to read and parse the dialing test task information from the task storage module 123, obtain the dialing test address and the dialing test type, generate a dialing test message according to the dialing test type, send the dialing test message to the dialing test address when receiving a timing signal, and receive the data packet fed back by the dialing test address within a preset waiting time, parse the data packet, obtain and send the dialing test response data to the data reporting module 125.
[0080] The data reporting module 125 is used to determine the dialing test result according to the dialing test response data, and send the dialing test result to the dialing test task management platform.
[0081] The dialing test points 120 are often distributed and deployed in different geographical areas and network environments, and perform the dialing test tasks for site performance through cooperation with the dialing test task management platform 110. Each dialing test point 120 includes multiple modules, and the modules are connected to each other to realize the reception, storage, timing, execution and reporting of tasks, forming a closed-loop dialing test process.
[0082] The task management module 122 is the task control center of the dialing test point 120, and is mainly responsible for receiving, storing and scheduling the dialing test tasks. Specifically, the task management module 122 receives the dialing test task information from the dialing test task management platform, including the site address, the dialing test type and the dialing test cycle, and the task management module 122 saves the dialing test task information to the task storage module 123, for example, by locally persisting the storage of the dialing test task information through go-cached, thereby realizing the local persistent storage of the dialing test task information, so that the dialing test point 120 can retrieve the dialing test task information from the task storage module 123 at any time, thereby improving the flexibility and independence of the dialing test point 120. In addition, the task management module 122 also parses the dialing test task information and determines the dialing test cycle. The dialing test cycle defines the execution frequency of the dialing test task and is a key parameter for realizing the timed execution. Therefore, the task management module 122 generates a timed task according to the parsed dialing test cycle and sends it to the timing module 124. The timed task is used to control the execution timing of the dialing test task, so that the dialing test task is performed at a predetermined frequency.
[0083] The timing module 124 is responsible for managing the timing execution of the dial test task. Specifically, the timing module 124 receives the timing task from the task management module 122. The timing task includes the periodic requirements of the dial test task and defines the execution interval of the task. Then, according to the dial test cycle parameters in the timing task, the timing module 124 periodically sends a timing signal to the task execution module 121 to instruct the task execution module 121 to execute a new round of dial test operations. For example, assuming that the dial test cycle is 5 minutes, this means that the dial test point 120 needs to send a dial test message to the dial test address every five minutes. At this time, the task management module 122 sends the timing task of "executed once every 5 minutes" to the timing module 124. According to the timing task, the timing module 124 sends a timing signal to the task execution module 121 every 5 minutes to notify the task execution module 121 to execute a dial test operation. It should be noted that the timing module 124 may not be set in each dialing test point 120, but each time the dialing test point executes a dialing test task, the task management module 122 directly creates a timer to manage the dialing test cycle through the timer.
[0084] The task execution module 121 is a core module for executing a specific dialing test task in the dialing test point 120. First, the task execution module 121 reads the pre-stored dialing test task information from the task storage module 123, and then parses the dialing test task information to obtain the dialing test address and the dialing test type. The dialing test type determines the dialing test mode of the task execution module 121. Further, the task execution module 121 generates a corresponding dialing test message according to the dialing test type, and sends the dialing test message to the dialing test address when receiving a timing signal, waits for and receives the data packet fed back by the dialing test address within a preset waiting time, and parses the data packet to obtain the dialing test response data. It should be noted that if the waiting time exceeds the preset waiting time and the task execution module 121 still does not receive the data packet feedback from the dialing address, it indicates that an abnormal situation may have occurred at the target address, such as a site crash. At this time, the task execution module 121 can push an alarm message to the data reporting module 125, and the data reporting module 125 will then report the alarm message to the dialing task management platform 110, which will notify the relevant responsible personnel to handle the abnormality as soon as possible.
[0085] The data reporting module 125 is used to feed back the dial test result to the dial test task management platform 110. Specifically, after receiving the dial test response data from the task execution module 121, the data reporting module 125 organizes and analyzes the dial test response data to generate the final dial test result. For example, the dial test response data is encapsulated into indicator data, such as response time, packet loss rate and other indicator data. The generated dial test result is reported to the dial test task management platform 110 by the data reporting module 125, so that the dial test task management platform 110 can further perform performance evaluation on the target site.
[0086] In this embodiment, the dial-up test point works together through the task management module, task storage module, timing module, task execution module and data reporting module. Each module has clear responsibilities and is interconnected and coordinated with each other, so that the system can obtain, analyze and feedback the performance data of the site in real time, realize the automation and efficient execution of the dial-up test tasks, thereby improving the accuracy and timeliness of the target site performance evaluation.
[0087] In one embodiment, the dial test message includes a Hypertext Transfer Protocol message, an Internet Control Message Protocol message, a Transmission Control Protocol message, and a User Datagram Protocol message, and the task execution module is used to perform any one of the following operations:
[0088] The first item is that when the dial test type is a hypertext transfer protocol type, a hypertext transfer protocol message is sent to the dial test address, and the dial test response time is determined according to the packet return time of the dial test address.
[0089] The second item is, when the dial test type is the Internet Packet Explorer type, sending an Internet Control Message Protocol message to the dial test address, and determining the dial test response time and packet loss rate based on the packet return time and report quantity of the dial test address.
[0090] The third item is, when the dial test type is a transmission control protocol type, sending a transmission control protocol message to the dial test address, and determining the dial test response time according to the packet return time of the dial test address.
[0091] The fourth item is that when the dial test type is a user datagram protocol type, a user datagram protocol message is sent to the dial test address, and the dial test response time is determined according to the packet return time of the dial test address.
[0092] Wherein, the dial test response data includes at least one of the dial test response time and the packet loss rate. Exemplarily, if the dial test type is HTTP (HyperText Transfer Protocol) type, the dial test point 120 may send an HTTP message to the dial test address, and according to the time of receiving the return packet information of the dial test address, the response time of the target site can be calculated, and the target address http status code can be parsed. In the case where the dial test type is Ping (Packet Internet Groper) type, the dial test point 120 may also send an icmp (Internet Control Message Protocol) message to the dial test address, and according to the return packet time and the number of return packets of the dial test address, the response time and the packet loss rate of the target site can also be calculated. In the case where the dial test type is TCP (Transmission Control Protocol) type, the dial test point 120 may also send a TCP message to the dial test address, and according to the time when the dial test point 120 first receives the return packet of the dial test address, the response time of the target site is calculated. Similarly, when the dial test type is a UDP (User Datagram Protocol) type, the dial test point 120 may send a UDP message to the dial test address to calculate the response time of the target site.
[0093] In one embodiment, Figure 6 As shown, the system 100 further includes a time series database 130 connected to the dialing test task management platform 110 and the dialing test point 120 .
[0094] The dialing test point 120 is used to upload the dialing test result to the time series database 130 .
[0095] The dialing test task management platform 110 is used to search the time series database 130 for a dialing test result that matches the dialing test task information.
[0096] Among them, the time series database 130 can be VictoriaMetrics, which is an open source high-performance time series database and monitoring system specifically used for storing and analyzing large-scale time series data. In this embodiment, it can be used to process massive indicator data from the large-scale site performance evaluation system 100 and provide fast query and analysis functions.
[0097] The time series database 130 is a database specifically used to process data stored in chronological order, and can be used to store and query data with timestamps. Specifically, the time series database 130 can be used to store the dial test results uploaded by the dial test point 120. The dial test results can carry a timestamp to represent the execution time of each dial test task, so that the dial test results can be stored in the time series database 130 according to time data, which is convenient for subsequent query.
[0098] Exemplarily, after completing a dialing test task (or performing a dialing test operation), the dialing test point 120 uploads the obtained dialing test result to the time series database 130 , and the time series database 130 stores the dialing test result in the form of a time series.
[0099] The dialing test task management platform 110 can also query and retrieve the dialing test result from the time series database in response to the user's query request. For example, after the user sends a dialing test task configuration request, he hopes to read the dialing test result corresponding to the dialing test task from the dialing test task management platform 110. Generally speaking, the query request will carry dialing test task information such as dialing test task identification, target site, time range, etc. The dialing test task management platform 110 will search the time series database 130 for the dialing test result that matches the dialing test task information.
[0100] In this embodiment, by introducing a time series database, the data storage and data query capabilities of the site performance evaluation system can be improved, so that the site performance evaluation system can effectively cope with frequent dialing tasks and a large number of dialing results. Through the time series database, the system realizes efficient management of dialing results and improves the accuracy and stability of site performance evaluation.
[0101] In one embodiment, Figure 7 As shown, the system 100 further includes a notification module 140 connected to the dialing task management platform 110 .
[0102] The dialing test task management platform 110 is used to send a notification signal carrying the dialing test result to the notification module 140 when the dialing test result indicates that the performance of the dialing test address is abnormal, and the notification signal indicates that the performance of the dialing test address is abnormal.
[0103] The notification module 140 is used to send an alarm message carrying a dialing test result to the user when receiving a notification signal.
[0104] The notification module 140 is used to send alarm information to the user quickly and accurately. Specifically, after receiving the dialing test results, the dialing test task management platform 110 analyzes the dialing test results. When it is found that the performance indicators of the target site (such as response time, packet loss rate, etc.) are abnormal, it immediately generates and sends a notification signal to the notification module. The notification signal may carry information such as the dialing test address where the abnormality occurred, the specific performance indicator value, and the time when the abnormality occurred. After receiving the notification signal, the notification module 140 will send an alarm message to the user. The alarm message may carry specific dialing test results (information such as the dialing test address where the abnormality occurred, the specific performance indicator value, and the time when the abnormality occurred). The push method of the alarm information has been explained in detail in the above method embodiment and will not be repeated here.
[0105] In this embodiment, by introducing the notification module, the site performance evaluation system's ability to respond to abnormal situations can be improved, and when performance problems are detected, the abnormal situation can be promptly transmitted to the user end, thereby improving the reliability and stability of the site performance evaluation system.
[0106] In one embodiment, the dialing test task management platform 110 is further used to perform aggregation calculation on the dialing test results in the time series database 130 to obtain aggregated dialing test results, and store the aggregated dialing test results in the time series database 130 .
[0107] The processing steps related to the aggregate calculation have been described in detail in the above method embodiment and will not be repeated here.
[0108] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0109] Based on the same inventive concept, the embodiment of the present application also provides a site performance evaluation device for implementing the site performance evaluation method involved above. The implementation solution provided by the device to solve the problem is similar to the implementation solution recorded in the above method, so the specific limitations in one or more site performance evaluation device embodiments provided below can refer to the limitations of the site performance evaluation method above, and will not be repeated here.
[0110] In one embodiment, Figure 8 As shown, a site performance evaluation device 700 is provided, including: a data receiving module 710, a task configuration module 720, a task issuing module 730 and a performance evaluation module 740, wherein:
[0111] The data receiving module 710 is used to receive a dialing test task configuration request for a target site, where the dialing test task configuration request carries dialing test task configuration information.
[0112] The task configuration module 720 is used to determine the dialing test address, dialing test type and dialing test cycle according to the dialing test task configuration information.
[0113] The task sending module 730 is used to generate dialing test task information based on the dialing test address, dialing test type and dialing test cycle, and send the dialing test task information to the corresponding dialing test point, so that the dialing test point sends a dialing test message to the dialing test address based on the dialing test type and dialing test cycle, performs a dialing test operation on the target site, and obtains and feeds back the dialing test result.
[0114] The performance evaluation module 740 is used to obtain the dialing test results fed back by the dialing test point, and evaluate the performance of the target site based on the dialing test results.
[0115] In one embodiment, the performance evaluation module 740 is further configured to search for a dialing test result from a preset time series database according to the dialing test task information, wherein the dialing test result is uploaded to the time series database by the dialing test point.
[0116] In one embodiment, the site performance evaluation device 700 is further configured to perform aggregation calculation on the dialing test results to obtain aggregated dialing test results, and store the aggregated dialing test results in a time series database.
[0117] In one embodiment, the site performance evaluation device 700 is further configured to push an alarm message when the dial test result indicates that the target site performance is abnormal.
[0118] Each module in the above-mentioned site performance evaluation device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.
[0119] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 8 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data such as dialing task configuration information. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a site performance evaluation method is implemented.
[0120] Those skilled in the art will understand that Fig. 9 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0121] In one embodiment, a computer device is provided, including a memory and a processor. The memory stores a computer program, and the processor implements the steps in the above-mentioned site performance evaluation method embodiment when executing the computer program.
[0122] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned site performance evaluation method embodiment are implemented.
[0123] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above-mentioned site performance evaluation method embodiment when executed by a processor.
[0124] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.
[0125] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.
[0126] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0127] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A site performance evaluation method, characterized in that: The method comprises: Receiving a dial test task configuration request for a target site, wherein the dial test task configuration request carries dial test task configuration information; Determine the dialing test address, dialing test type and dialing test period according to the dialing test task configuration information; Generate dial test task information based on the dial test address, the dial test type and the dial test period, and send the dial test task information to the corresponding dial test point, so that the dial test point sends a dial test message to the dial test address based on the dial test type and the dial test period, performs a dial test operation on the target site, and obtains and feeds back a dial test result; The dialing test result fed back by the dialing test point is obtained, and the performance of the target site is evaluated based on the dialing test result.
2. The method according to claim 1, characterized in that The obtaining the dialing test result fed back by the dialing test point includes: According to the dialing test task information, searching for the dialing test result from a preset time series database; The dial test result is uploaded to the timing database by the dial test point.
3. The method according to claim 2, characterized in that The method further comprises: Performing aggregation calculation on the dialing test results to obtain an aggregated dialing test result; The aggregated dial test results are stored in the time series database.
4. The method according to any one of claims 1 to 3, characterized in that: After obtaining the dial test result, the method further includes: When the dial test result indicates that the target site has abnormal performance, an alarm message is pushed.
5. A site performance evaluation system, characterized in that: The system includes a dialing test task management platform and a plurality of dialing test points connected to each other; The dial test task management platform is used to receive a dial test task configuration request sent by a user for a target site, the dial test task configuration request carries dial test task configuration information, parse the dial test task configuration information, obtain the dial test task information and the dial test point information associated with the dial test task information, and send the dial test task information to the dial test point matching the dial test point information; The dial test point is used to receive the dial test task information, parse the dial test task information to obtain the dial test address, dial test type and dial test cycle, generate and send a dial test message to the dial test address according to the dial test type and dial test cycle, and obtain and feed back the dial test result to the dial test task management platform; The dialing test task management platform is also used to evaluate the performance of the target site according to the received dialing test results.
6. The system according to claim 5, characterized in that The dial test point includes a task execution module, and a task management module, a task storage module, a timing module and a data reporting module connected to the task execution module, wherein the task management module is connected to the task storage module and the timing module; The task management module is used to receive the dialing test task information, store the dialing test task information in the task storage module, parse the dialing test task information to obtain a dialing test cycle, generate a scheduled task according to the dialing test cycle, and send it to the timing module; The timing module is used to receive the timing task and send a timing signal to the task execution module according to the timing task; The task execution module is used to read and parse the dial test task information from the task storage module, obtain the dial test address and the dial test type, generate a dial test message according to the dial test type, send the dial test message to the dial test address when receiving the timing signal, and receive the data packet fed back by the dial test address within a preset waiting time, parse the data packet, obtain and send the dial test response data to the data reporting module; The data reporting module is used to determine the dialing test result according to the dialing test response data, and send the dialing test result to the dialing test task management platform.
7. The system according to claim 6, characterized in that The dial test message includes a Hypertext Transfer Protocol message, an Internet Control Message Protocol message, a Transmission Control Protocol message, and a User Datagram Protocol message. The task execution module is used to perform any one of the following operations: The first item, when the dial test type is a hypertext transfer protocol type, sends a hypertext transfer protocol message to the dial test address, and determines the dial test response time according to the packet return time of the dial test address; The second item, when the dial test type is an Internet packet explorer type, sends an Internet control message protocol message to the dial test address, and determines the dial test response time and packet loss rate according to the packet return time and the number of reports of the dial test address; The third item, when the dial test type is a transmission control protocol type, sending a transmission control protocol message to the dial test address, and determining the dial test response time according to the packet return time of the dial test address; Item 4: When the dial test type is a user datagram protocol type, sending a user datagram protocol message to the dial test address, and determining a dial test response time according to a packet return time of the dial test address; The dial test response data includes at least one of a dial test response time and a packet loss rate.
8. The system according to any one of claims 5 to 7, characterized in that: The system also includes a notification module connected to the dialing task management platform; The dial test task management platform is used to send a notification signal carrying the dial test result to the notification module when the dial test result indicates that the performance of the dial test address is abnormal, wherein the notification signal indicates that the performance of the dial test address is abnormal; The notification module is used to send an alarm message carrying the dialing test result to the user when receiving the notification signal.
9. The system according to any one of claims 5 to 7, characterized in that: The system also includes a time series database connected to the dialing and testing task management platform and the dialing and testing point; The dial test point is used to upload the dial test result to the time series database; The dialing test task management platform is used to search the time series database for a dialing test result that matches the dialing test task information.
10. The system according to claim 9, characterized in that The dial test task management platform is further used to perform aggregation calculation on the dial test results in the time series database to obtain aggregated dial test results, and store the aggregated dial test results in the time series database.
Citation Information
Patent Citations
Website availability monitoring method, device and equipment and medium
CN109768899A
Network dial testing system and method and storage medium
CN117596198A
Network dial testing method and device, equipment and storage medium
CN117729125A
Method, system and device for determining network link quality
CN118075160A
Automatic dial testing method and device and computer equipment
CN118282889A
Cited By
Dial test data storage method, device and equipment, medium and program product
CN121255108A