Response management method, device, equipment, medium and product of edge server

Abstract

This application discloses a response management method, apparatus, device, medium, and product for an edge server. The method includes: acquiring the operating information of the edge server and request information of client requests to be processed; calculating the response time of the client requests to be processed based on the operating information and the request information; wherein the response time is the time consumed from the client sending the client request to the edge server sending the response result of the client request to be processed or sending the client request to be processed; adjusting the time when the edge server receives the client requests to be processed based on the response time, so that the effective response time of each client request to be processed received by the edge server is the same. Using the embodiments of this application can avoid different effective response times for client requests, ensuring the fairness of the effective response time of client requests.

Description

Technical Field

[0001] This application relates to the field of edge server technology, and in particular to a response management method, apparatus, device, medium and product for an edge server. Background Technology

[0002] An edge server is a server located at the edge of a network, typically closest to users, used for caching and accelerating content delivery. During edge server operation, the response time of client requests is crucial for website loading speed and user experience. However, current edge server response management neglects to manage the effective response time of client requests (i.e., the time consumed from the edge server receiving a client request to issuing a response or sending the client request), failing to achieve fair management of the effective response time of client requests received by the edge server. Summary of the Invention

[0003] This application provides a response management method, apparatus, device, medium, and product for an edge server, to solve the problem in the prior art that the management of the effective response time of client requests is neglected, and the effective response time of client requests received by the edge server cannot be fairly managed.

[0004] To achieve the above objectives, embodiments of this application provide a response management method for an edge server, comprising:

[0005] Obtain operational information of the edge server and request information of client requests to be processed;

[0006] Based on the operation information and the request information, the response time of the client request to be processed is calculated; wherein, the response time is the time consumed from the client sending the client request to the edge server sending the response result of the client request to be processed or sending the client request to be processed.

[0007] Based on the response time, the time when the edge server receives the client request to be processed is adjusted so that the effective response time for each client request to be processed received by the edge server is the same.

[0008] As an improvement to the above scheme, the operation information includes a first number of client requests within the edge server; the request information includes the receiving address of the client request to be processed and the preset receiving delay time of the client request to be processed.

[0009] As an improvement to the above solution, the step of calculating the response time of the client request to be processed based on the running information and the request information includes:

[0010] Based on the receiving address, obtain the transmission path of the client request to be processed and the distance of the transmission path;

[0011] Count the second number of clients located on the transmission path;

[0012] The response time of the client request to be processed is calculated based on the preset reception delay time, the first quantity, the distance, and the second quantity; wherein the response time is positively correlated with the preset reception delay time, the first quantity, the distance, and the second quantity, respectively.

[0013] As an improvement to the above solution, the step of calculating the response time of the client request to be processed based on the preset receiving delay time, the first quantity, the distance, and the second quantity includes:

[0014] The response time of the client request to be processed is obtained by multiplying the preset constant, the preset time conversion coefficient, the cube root of the preset reception delay time, the square of the first quantity, the distance, and the second quantity.

[0015] As an improvement to the above solution, adjusting the time when the edge server receives the client request to be processed based on the response time, so that the effective response time for each client request to be processed received by the edge server is the same, includes:

[0016] Get the set valid response time;

[0017] Subtracting the effective response time from the response time yields the receiving time of the client request to be processed, where the receiving time is the time consumed from when the client sends the client request to be processed to when the edge server receives the client request to be processed.

[0018] The timing at which the edge server receives the client request to be processed is adjusted based on the receiving time.

[0019] As an improvement to the above solution, the first quantity is calculated through the following steps:

[0020] Whenever the port ingress of the edge server detects a client request, the first quantity is incremented by 1;

[0021] Whenever the edge server's response location detects a client request, the first quantity is decremented by 1;

[0022] The first quantity is incremented by 1 each time the response location detects that the client request has disappeared;

[0023] Whenever the port exit of the edge server detects a client request, the first quantity is decremented by 1.

[0024] To achieve the above objectives, embodiments of this application also provide a response management device for an edge server, comprising:

[0025] The information acquisition module is used to acquire the operating information of the edge server and the request information of the client requests to be processed;

[0026] The calculation module is used to calculate the response time of the client request to be processed based on the running information and the request information; wherein, the response time is the time consumed from the client sending the client request to the edge server sending the response result of the client request to be processed or sending the client request to be processed.

[0027] An adjustment module is used to adjust the time when the edge server receives the client request to be processed, based on the response time, so that the effective response time of each client request to be processed received by the edge server is the same.

[0028] To achieve the above objectives, embodiments of this application also provide a response management device for an edge server, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor. When the processor executes the computer program, it implements the response management method for the edge server as described above.

[0029] To achieve the above objectives, embodiments of this application also provide a computer-readable storage medium, the computer-readable storage medium including a stored computer program; wherein, when the computer program is executed, it controls the device where the computer-readable storage medium is located to perform the response management method of the edge server as described above.

[0030] To achieve the above objectives, embodiments of this application also provide a computer program product, including a computer program / instructions, which, when executed by a processor, implement the response management method of the edge server as described above.

[0031] Compared with existing technologies, the response management method, apparatus, device, medium, and product for an edge server provided in this application embodiment acquires the operating information of the edge server and the request information of client requests to be processed; calculates the response time of the client requests to be processed based on the operating information and the request information; wherein, the response time is the time consumed from the client sending the client request to the edge server sending the response result of the client request to be processed or sending the client request to be processed; and adjusts the time when the edge server receives the client requests to be processed based on the response time, so that the effective response time of each client request received by the edge server is the same, avoiding different effective response times of client requests, ensuring the fairness of the effective response time of client requests, realizing effective and fair management of the effective response time of client requests received by the edge server, and greatly improving the response standard of the edge server. Attached Figure Description

[0032] Figure 1 This is a flowchart of a response management method for an edge server provided in an embodiment of this application;

[0033] Figure 2 This is a graph showing the relationship between response time and effective response time;

[0034] Figure 3 This is a structural block diagram of a response management device for an edge server provided in an embodiment of this application;

[0035] Figure 4 This is a structural block diagram of a response management device for an edge server provided in an embodiment of this application. Detailed Implementation

[0036] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0037] See Figure 1 , Figure 1 This is a flowchart illustrating a response management method for an edge server provided in an embodiment of this application. The response management method for the edge server includes:

[0038] S1. Obtain the operating information of the edge server and the request information of the client requests to be processed;

[0039] S2. Calculate the response time of the client request to be processed based on the running information and the request information; wherein, the response time is the time consumed from the client sending the client request to be processed to the edge server sending the response result of the client request to be processed or sending the client request to be processed.

[0040] S3. Based on the response time, adjust the time when the edge server receives the client request to be processed, so that the effective response time of each client request to be processed received by the edge server is the same.

[0041] In this embodiment, the response time of the client request to be processed is calculated based on the operation information of the edge server and the request information of the client request to be processed. Then, the time when the edge server receives the client request to be processed, that is, the time when the client request to be processed enters the edge server, is adjusted according to the response time. This ensures that the effective response time of each client request received by the edge server is the same, avoiding different effective response times for client requests, ensuring the fairness of the effective response time of client requests, and realizing effective and fair management of the effective response time of client requests received by the edge server, which greatly improves the response standard of the edge server.

[0042] Understandably, after receiving a client request to be processed, the edge server will either generate a corresponding response based on the client request or forward the client request to another location.

[0043] If the client request to be processed can generate a response result on the edge server, then the response time is the time consumed from when the client sends the client request to when the edge server sends the response result of the client request to be processed. The effective response time is the time consumed from when the edge server receives the client request to when it sends the response result of the client request to be processed.

[0044] If a client request to be processed needs to be forwarded elsewhere by the edge server, then the response time is the time consumed from when the client sends the client request to when the edge server sends the client request to be processed. The effective response time is the time consumed from when the edge server receives the client request to when it sends the client request to be processed.

[0045] In an optional embodiment, the operational information includes a first number of client requests within the edge server; the request information includes the receiving address of the client request to be processed and a preset receiving delay time for the client request to be processed.

[0046] In an optional embodiment, calculating the response time of the client request to be processed based on the running information and the request information includes:

[0047] Based on the receiving address, obtain the transmission path of the client request to be processed and the distance of the transmission path;

[0048] Count the second number of clients located on the transmission path;

[0049] The response time of the client request to be processed is calculated based on the preset reception delay time, the first quantity, the distance, and the second quantity; wherein the response time is positively correlated with the preset reception delay time, the first quantity, the distance, and the second quantity, respectively.

[0050] In this embodiment, the transmission path and distance of the client request to be processed are obtained based on the receiving address of the client request to be processed. Generally, the receiving address may or may not be within the edge server, and the transmission path is the shortest transmission path. Then, a second number of clients located on this transmission path is counted. Finally, the response time of the client request to be processed is calculated based on the preset receiving delay time, the first number, the distance, and the second number. The response time is positively correlated with the preset receiving delay time, the first number, the distance, and the second number, respectively, and the second number is generally defaulted to 1.

[0051] In an optional embodiment, calculating the response time of the client request to be processed based on the preset reception delay time, the first quantity, the distance, and the second quantity includes:

[0052] The response time of the client request to be processed is obtained by multiplying the preset constant, the preset time conversion coefficient, the cube root of the preset reception delay time, the square of the first quantity, the distance, and the second quantity.

[0053] Specifically, the response time of the client request to be processed is calculated according to the following formula:

[0054]

[0055] In the formula, C represents a preset constant, preferably 2; k represents a time conversion coefficient; z represents a preset reception delay time; j represents the first number of client requests within the edge server; l represents the distance of the transmission path of the client requests to be processed; and n represents the second number of clients located on the transmission path.

[0056] In an optional embodiment, adjusting the time at which the edge server receives the client request to be processed based on the response time, so that the effective response time for each client request to be processed received by the edge server is the same, includes:

[0057] Get the set valid response time;

[0058] Subtracting the effective response time from the response time yields the receiving time of the client request to be processed, where the receiving time is the time consumed from when the client sends the client request to be processed to when the edge server receives the client request to be processed.

[0059] The timing at which the edge server receives the client request to be processed is adjusted based on the receiving time.

[0060] In this embodiment of the application, according to T=t 响应 -t 接收 Adjust the time it takes for the edge server to receive client requests to be processed, so that the effective response time T remains constant, where T is the effective response time and t is the response time. 响应 t represents the response time for pending client requests. 接收 This is the time it takes to receive client requests that are yet to be processed.

[0061] like Figure 2 Let t1 represent the time when the client sends the pending client request, t2 represent the time when the edge server receives the pending client request, and t3 represent the time when the edge server sends the response result of the pending client request or sends the pending client request. Then T = t3 - t2, t 响应 =t3-t1,t 接收 =t2-t1. In the embodiments of this application, according to T=t 响应 -t 接收 t was calculated 接收 And then according to t 接收 Adjust t2 so that T remains constant for each pending client request.

[0062] In an optional embodiment, the first quantity is counted through the following steps:

[0063] Whenever the port ingress of the edge server detects a client request, the first quantity is incremented by 1;

[0064] Whenever the edge server's response location detects a client request, the first quantity is decremented by 1;

[0065] The first quantity is incremented by 1 each time the response location detects that the client request has disappeared;

[0066] Whenever the port exit of the edge server detects a client request, the first quantity is decremented by 1.

[0067] It is understandable that scanning units are set up at the port ingress, response location, and port egress of the edge server. Whenever the corresponding scanning unit identifies a client request, the first count of client requests within the edge server is incremented or decremented by 1.

[0068] Specifically, whenever the scanning unit at the port inlet of the edge server detects a client request, it sends a positive electrical signal to the metering unit, causing the metering unit's count value to increment by 1;

[0069] Whenever a scanning unit located at the response position of the edge server detects a client request, it sends a reverse electrical signal to the metering unit, causing the metering unit's count value to decrease by 1.

[0070] Whenever a client request is sent from the response location of the edge server, the scanning unit at the response location of the edge server detects that the client request has disappeared, sends a positive electrical signal to the metering unit, and increments the metering unit's count value by 1.

[0071] Whenever the scanning unit at the port exit of the edge server detects a client request, it sends a positive electrical signal to the metering unit, causing the metering unit's count value to decrease by 1;

[0072] The metering unit counts based on the input positive and negative electrical signals, and the count value represents the first number of client requests within the edge server.

[0073] This application provides a response management method for an edge server. It acquires the edge server's operational information and request information of pending client requests. Based on the operational information and the request information, it calculates the response time of the pending client requests. The response time is the time consumed from the client sending the pending client request to the edge server issuing a response result or issuing the pending client request itself. Based on the response time, it adjusts the time at which the edge server receives the pending client requests to ensure that the effective response time for each pending client request received by the edge server is the same. This avoids inconsistent effective response times for client requests, guarantees the fairness of the effective response times of client requests, and achieves effective and fair management of the effective response times of client requests received by the edge server, greatly improving the response standards of the edge server.

[0074] See Figure 3 , Figure 3This is a structural block diagram of a response management device 10 for an edge server provided in an embodiment of this application. The response management device 10 for the edge server includes:

[0075] The information acquisition module 11 is used to acquire the operating information of the edge server and the request information of the client requests to be processed;

[0076] The calculation module 12 is used to calculate the response time of the client request to be processed based on the running information and the request information; wherein, the response time is the time consumed from the client sending the client request to be processed to the edge server sending the response result of the client request to be processed or sending the client request to be processed.

[0077] The adjustment module 13 is used to adjust the time when the edge server receives the client request to be processed according to the response time, so that the effective response time of each client request to be processed received by the edge server is the same.

[0078] Optionally, the operation information includes a first number of client requests within the edge server; the request information includes the receiving address of the client request to be processed and the preset receiving delay time of the client request to be processed.

[0079] Optionally, the computing module 12 is further configured to:

[0080] Based on the receiving address, obtain the transmission path of the client request to be processed and the distance of the transmission path;

[0081] Count the second number of clients located on the transmission path;

[0082] The response time of the client request to be processed is calculated based on the preset reception delay time, the first quantity, the distance, and the second quantity; wherein the response time is positively correlated with the preset reception delay time, the first quantity, the distance, and the second quantity, respectively.

[0083] Optionally, the computing module 12 is further configured to:

[0084] The response time of the client request to be processed is obtained by multiplying the preset constant, the preset time conversion coefficient, the cube root of the preset reception delay time, the square of the first quantity, the distance, and the second quantity.

[0085] Optionally, the adjustment module 13 is further configured to:

[0086] Get the set valid response time;

[0087] Subtracting the effective response time from the response time yields the receiving time of the client request to be processed, where the receiving time is the time consumed from when the client sends the client request to be processed to when the edge server receives the client request to be processed.

[0088] The timing at which the edge server receives the client request to be processed is adjusted based on the receiving time.

[0089] Optionally, the information acquisition module 11 is further configured to:

[0090] Whenever the port ingress of the edge server detects a client request, the first quantity is incremented by 1;

[0091] Whenever the edge server's response location detects a client request, the first quantity is decremented by 1;

[0092] The first quantity is incremented by 1 each time the response location detects that the client request has disappeared;

[0093] Whenever the port exit of the edge server detects a client request, the first quantity is decremented by 1.

[0094] It is worth noting that the working process of each module in the edge server response management device 10 described in this application embodiment can refer to the working process of the edge server response management method described in the above embodiment, and will not be repeated here.

[0095] This application provides a response management device 10 for an edge server. It acquires the operating information of the edge server and the request information of client requests to be processed. Based on the operating information and the request information, it calculates the response time of the client requests to be processed. The response time is the time consumed from when the client sends the client request to when the edge server sends the response result or sends the client request. Based on the response time, it adjusts the time when the edge server receives the client requests to be processed, ensuring that the effective response time of each client request received by the edge server is the same. This avoids inconsistent effective response times for client requests, guarantees the fairness of the effective response times of client requests, and achieves effective and fair management of the effective response times of client requests received by the edge server, greatly improving the response standard of the edge server.

[0096] Furthermore, this application also provides a computer-readable storage medium, which includes a stored computer program; wherein, when the computer program is executed, it controls the device where the computer-readable storage medium is located to perform the response management method of the edge server as described in any of the above embodiments.

[0097] Furthermore, this application also provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements the response management method of an edge server as described in any of the above embodiments.

[0098] See Figure 4 , Figure 4 This is a structural block diagram of an edge server response management device 20 provided in an embodiment of this application. The edge server response management device 20 includes: a processor 21, a memory 22, and a computer program stored in the memory 22 and executable on the processor 21. When the processor 21 executes the computer program, it implements the steps in the above-described edge server response management method embodiment. Alternatively, when the processor 21 executes the computer program, it implements the functions of each module / unit in the above-described device embodiments.

[0099] For example, the computer program may be divided into one or more modules / units, which are stored in the memory 22 and executed by the processor 21 to complete this application. The one or more modules / units may be a series of computer program instruction segments capable of performing a specific function, which describe the execution process of the computer program in the response management device 20 of the edge server.

[0100] The response management device 20 of the edge server may include, but is not limited to, a processor 21 and a memory 22. Those skilled in the art will understand that the schematic diagram is merely an example of the response management device 20 of the edge server and does not constitute a limitation on the response management device 20 of the edge server. It may include more or fewer components than illustrated, or combine certain components, or different components. For example, the response management device 20 of the edge server may also include input / output devices, network access devices, buses, etc.

[0101] The processor 21 can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor. The processor 21 is the control center of the edge server's response management device 20, connecting all parts of the edge server's response management device 20 via various interfaces and lines.

[0102] The memory 22 can be used to store the computer programs and / or modules. The processor 21 implements various functions of the edge server's response management device 20 by running or executing the computer programs and / or modules stored in the memory 22 and calling the data stored in the memory 22. The memory 22 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the mobile phone (such as audio data, phonebook, etc.). In addition, the memory 22 may include high-speed random access memory, and may also include non-volatile memory, such as hard disk, memory, plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0103] Wherein, if the modules / units integrated into the response management device 20 of the edge server are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can also be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by the processor 21, it can implement the steps of the various method embodiments described above. Wherein, the computer program includes computer program code, which can be in the form of source code, object code, executable file, or some intermediate form, etc. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording media, USB flash drive, portable hard drive, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal, and software distribution medium, etc.

[0104] It should be noted that the device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Furthermore, in the accompanying drawings of the device embodiments provided in this application, the connection relationships between modules indicate that they have communication connections, which can be specifically implemented as one or more communication buses or signal lines. Those skilled in the art can understand and implement this without any creative effort.

[0105] The above description is the preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications are also considered to be within the scope of protection of this application.

Claims

1. A response management method of an edge server, characterized by, include: Obtain operational information of the edge server and request information of client requests to be processed; Based on the operation information and the request information, the response time of the client request to be processed is calculated; wherein, the response time is the time consumed from the client sending the client request to the edge server sending the response result of the client request to be processed or sending the client request to be processed. Based on the response time, the time when the edge server receives the client request to be processed is adjusted so that the effective response time for each client request to be processed received by the edge server is the same; wherein, the effective response time is the time consumed from the edge server receiving the client request to the time it sends out the response result of the client request to be processed, or the effective response time is the time consumed from the edge server receiving the client request to the time it sends out the client request to be processed. The operational information includes a first number of client requests within the edge server; the request information includes the receiving address of the client request to be processed and the preset receiving delay time of the client request to be processed. The step of calculating the response time of the client request to be processed based on the running information and the request information includes: Based on the receiving address, obtain the transmission path of the client request to be processed and the distance of the transmission path; Count the second number of clients located on the transmission path; The response time of the client request to be processed is calculated based on the preset reception delay time, the first quantity, the distance, and the second quantity; wherein the response time is positively correlated with the preset reception delay time, the first quantity, the distance, and the second quantity, respectively.

2. The response management method of an edge server according to claim 1, wherein, The step of calculating the response time of the client request to be processed based on the preset reception delay time, the first quantity, the distance, and the second quantity includes: The response time of the client request to be processed is obtained by multiplying the preset constant, the preset time conversion coefficient, the cube root of the preset reception delay time, the square of the first quantity, the distance, and the second quantity.

3. The response management method for an edge server as described in claim 1, characterized in that, The step of adjusting the time at which the edge server receives the client request to be processed, based on the response time, so that the effective response time for each client request to be processed received by the edge server is the same, includes: Get the set valid response time; Subtracting the effective response time from the response time yields the receiving time of the client request to be processed, where the receiving time is the time consumed from when the client sends the client request to be processed to when the edge server receives the client request to be processed. The timing at which the edge server receives the client request to be processed is adjusted based on the receiving time.

4. The response management method for an edge server as described in claim 1, characterized in that, The first quantity is calculated using the following steps: Whenever the port ingress of the edge server detects a client request, the first quantity is incremented by 1; Whenever the edge server's response location detects a client request, the first quantity is decremented by 1; The first quantity is incremented by 1 each time the response location detects that the client request has disappeared; Whenever the port exit of the edge server detects a client request, the first quantity is decremented by 1.

5. A response management device for an edge server, characterized in that, include: The information acquisition module is used to acquire the operating information of the edge server and the request information of the client requests to be processed; The calculation module is used to calculate the response time of the client request to be processed based on the running information and the request information; wherein, the response time is the time consumed from the client sending the client request to the edge server sending the response result of the client request to be processed or sending the client request to be processed. An adjustment module is used to adjust the time when the edge server receives the client request to be processed based on the response time, so that the effective response time of each client request to be processed received by the edge server is the same; wherein, the effective response time is the time consumed from the edge server receiving the client request to the time it sends the response result of the client request to be processed, or the effective response time is the time consumed from the edge server receiving the client request to the time it sends the client request to be processed. The operational information includes a first number of client requests within the edge server; the request information includes the receiving address of the client request to be processed and the preset receiving delay time of the client request to be processed. The computing module is also used for: Based on the receiving address, obtain the transmission path of the client request to be processed and the distance of the transmission path; Count the second number of clients located on the transmission path; The response time of the client request to be processed is calculated based on the preset reception delay time, the first quantity, the distance, and the second quantity; wherein the response time is positively correlated with the preset reception delay time, the first quantity, the distance, and the second quantity, respectively.

6. A response management device for an edge server, characterized in that, It includes a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor, when executing the computer program, implements the response management method of the edge server as described in any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored computer program; wherein, when the computer program is executed, it controls the device on which the computer-readable storage medium resides to perform the response management method of the edge server as described in any one of claims 1 to 4.

8. A computer program product, characterized in that, Includes a computer program / instruction that, when executed by a processor, implements the response management method of the edge server as described in any one of claims 1 to 4.

Images