User experience evaluation method and system based on multidimensional network time delay characteristics

Abstract

The invention provides a user experience evaluation method and system based on multidimensional network time delay characteristics, and belongs to the field of network performance monitoring. The method comprises the following steps: receiving an original traffic data packet from a network, then receiving an original access request of a client, and decomposing the original traffic data packet into three groups of traffic, including a DNS analysis stream, a network transmission stream and an application layer request stream; calculating a DNS response time based on the DNS resolution stream; calculating network connection time and retransmission delay based on the network transport stream; calculating server response time and data transmission time based on the application layer request stream; obtaining a multi-dimensional time index; an experience evaluation model is constructed, index parameters are set according to business scenes, a comprehensive score is calculated, and then evaluation results of user experience are graded and visually displayed. According to the method, flow analysis is accurately carried out, delay sources are subdivided, and the bottleneck positioning error is smaller than 5%; the network performance problem is accurately positioned; and a client does not need to be transformed, and the compatibility is good.

Description

Technical Field

[0001] The present invention belongs to the field of network performance monitoring, and in particular relates to a user experience evaluation method and system based on multi-dimensional network delay characteristics. Background Art

[0002] With the increasing complexity of internet services, users accessing an application typically need to go through multiple stages of network interaction, including DNS domain name resolution, TCP connection establishment, server response, data transmission, and retransmission recovery. The user's evaluation of the network experience determines whether they will become a long-term user of the current application service. Therefore, accurately evaluating the user experience can effectively reflect the user-friendliness of the application service.

[0003] In existing technologies, network monitoring systems usually only focus on a single indicator when evaluating users' network experience, such as response time, bandwidth, or packet loss rate, which cannot fully reflect the user's actual access experience. Especially in multi-layer architectures and complex network environments, fluctuations in a single indicator cannot accurately reflect whether the user's actual experience has really declined, and cannot accurately reflect the user's true experience, resulting in poor evaluation results. Summary of the Invention

[0004] In view of the above-mentioned defects or deficiencies in the prior art, the present invention aims to provide a user experience evaluation method and system based on multi-dimensional network delay characteristics. By integrating multi-dimensional network delay characteristics and based on real network traffic behavior, the method accurately reflects the user experience, thereby improving the evaluation effect. The method is suitable for service quality evaluation in scenarios such as cloud computing, content delivery networks (CDNs), and enterprise-level application services.

[0005] In order to achieve the above objectives, the embodiments of the present invention adopt the following technical solutions:

[0006] In a first aspect, an embodiment of the present invention provides a method for evaluating user experience based on multi-dimensional network delay characteristics, comprising the following steps:

[0007] Step S1, receiving original traffic data packets from the network;

[0008] Step S2: receiving the original access request from the client, and decomposing the original traffic data packet into three groups of traffic according to the access request, including DNS resolution flow, network transmission flow and application layer request flow;

[0009] Step S3, based on the DNS resolution flow, calculate the DNS response time; based on the network transmission flow, calculate the network connection time and retransmission delay; based on the application layer request flow, calculate the server response time and data transmission time; and obtain multi-dimensional time indicators;

[0010] Step S4, constructing an experience evaluation model based on multi-dimensional time indicators;

[0011] Step S5: setting parameters for each time indicator according to the business scenario, and calculating a comprehensive score using the experience evaluation model;

[0012] Step S6: grading the user experience evaluation results according to the comprehensive score, and visually displaying the comprehensive score and grade.

[0013] As a preferred embodiment of the present invention, the original access request includes a source IP, a target domain name and a protocol type.

[0014] As a preferred embodiment of the present invention, the DNS resolution flow comes from UDP port 53, the network transmission flow corresponds to the TCP / IP layer of the seven-layer model, and the application layer request flow corresponds to HTTP / HTTPS.

[0015] As a preferred embodiment of the present invention, in step S3, the DNS response time refers to the time from when the browser initiates the DNS domain name resolution request to when the target server IP address is obtained; the calculation starting point is the moment when the browser sends the DNS query request, and the calculation end point is the moment when the IP address response returned by the DNS server is received;

[0016] The network connection time refers to the TCP three-way handshake time; the calculation starts at the moment of sending the TCP SYN packet and ends at the moment of receiving the TCP ACK packet returned by the server;

[0017] The retransmission delay refers to the time it takes for the client to resend data when a data packet is lost during network transmission, including the time it takes to detect the packet loss and the time it takes to complete the retransmission. The starting point is the time when the data packet is expected to be received, and the end point is the time when the retransmitted data packet is confirmed.

[0018] The server response time refers to the time from when the client sends the HTTP request to when the server returns the first response byte; the starting point is the timestamp of the client sending the HTTP request, and the end point is the timestamp of the client receiving the first byte of the response header;

[0019] The data transmission time refers to the time from receiving the first response byte to receiving all response contents; the starting point is the time when the first response byte is received, and the end point is the time when the last response byte is received.

[0020] As a preferred embodiment of the present invention, when constructing the experience evaluation model, linear weighting, scoring function or fuzzy rules are used for construction.

[0021] As a preferred embodiment of the present invention, a linear weighted approach is adopted to construct an experience evaluation model.

[0022] As a preferred embodiment of the present invention, when the experience evaluation model is constructed in a linear weighted manner, the set parameters are the weights of the various time indicators.

[0023] As a preferred embodiment of the present invention, the formula of the experience evaluation model is as follows:

[0024] User experience time = w1 × DNS response time + w2 × connection time + w3 × server response time + w4 × data transmission time + w5 × retransmission delay (6)

[0025] In formula (6), w1, w2, w3, w4, and w5 are the weights of DNS response time, network connection time, server response time, data transmission time, and retransmission delay, respectively.

[0026] As a preferred embodiment of the present invention, the comprehensive score is also used for performance warning, capacity assessment or quality audit.

[0027] In a second aspect, an embodiment of the present invention further provides a user experience evaluation system based on multi-dimensional network delay characteristics, the system comprising: a traffic access module, a traffic decomposition module, a multi-dimensional time calculation module, an evaluation module construction module, a comprehensive scoring module and a result output module; wherein,

[0028] The traffic access module is used to receive original traffic data packets from the network;

[0029] The traffic decomposition module is used to receive the original access request from the client and decompose the original traffic data packet into three groups of traffic according to the access request, including DNS resolution flow, network transmission flow and application layer request flow;

[0030] The multi-dimensional time calculation module is used to calculate the DNS response time based on the DNS resolution flow; calculate the network connection time and retransmission delay based on the network transmission flow; calculate the server response time and data transmission time based on the application layer request flow; and obtain multi-dimensional time indicators;

[0031] The evaluation module construction module is used to build an experience evaluation model based on multi-dimensional time indicators;

[0032] The comprehensive scoring module is used to set parameters of each time indicator according to the business scenario and calculate the comprehensive score through the experience evaluation model;

[0033] The result output module is used to grade the evaluation results of the user experience according to the comprehensive score, and to visually display the comprehensive score and grade.

[0034] The technical solution provided by the embodiment of the present invention has the following beneficial effects:

[0035] The user experience evaluation method and system based on multi-dimensional network delay characteristics provided by the embodiments of the present invention can more accurately analyze traffic, segment delay sources, and locate bottlenecks with an error of less than 5%. It can also more accurately locate network performance issues. At the same time, it does not require client modification and is compatible with any terminal device based on network mirror traffic analysis.

[0036] Of course, it is not necessary to achieve all of the advantages described above simultaneously in order to implement any product or method of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0038] Figure 1 This is a flow chart of a method for evaluating user experience based on multi-dimensional network delay characteristics according to an embodiment of the present invention. DETAILED DESCRIPTION

[0039] The technical solutions in the embodiments of the present invention will be described clearly and completely below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Generally, the components of the embodiments of the present invention described and shown in the drawings herein can be arranged and designed in various different configurations. It should be noted that the embodiments of the present invention and the features in the embodiments can also be combined with each other in the absence of conflict.

[0040] It should be noted that similar reference numerals and letters represent similar items in the following figures. Therefore, once an item is defined in one figure, it does not need to be further defined or explained in subsequent figures. In the description of the present invention, the terms "first," "second," "third," "fourth," etc. are used only to distinguish the description and are not to be understood as indicating or implying relative importance.

[0041] To address the issue of user experience evaluation based on application services, an embodiment of the present invention provides a user experience evaluation method and system based on multi-dimensional network delay characteristics. By extracting and weightedly analyzing multiple key indicators such as DNS resolution time, three-way handshake time, server response time, first byte delay, data transmission delay, and retransmission delay, an experience score or level that can reflect user perception is obtained.

[0042] like Figure 1 As shown, the user experience evaluation method based on multi-dimensional network delay characteristics includes the following steps:

[0043] Step S1: Receive original traffic data packets from the network.

[0044] In this step, the original traffic data packets in the network can be received through mirroring; the received data packets serve as the input source of the entire analysis process.

[0045] Step S2: Receive the original access request from the client, and decompose the original traffic data packet into three groups of traffic according to the access request, including DNS resolution flow, network transmission flow and application layer request flow.

[0046] In this step, the original access request includes the source IP address, target domain name, and protocol type. The DNS resolution flow originates from UDP port 53. The network transport flow corresponds to the TCP / IP layer of the seven-layer model, and the application layer request flow corresponds to HTTP / HTTPS. Traffic is decomposed based on the access request, with the decomposed traffic segment being the traffic between the source IP address and the target domain name, and the decomposition is based on the protocol type.

[0047] Step S3, based on the DNS resolution flow, calculate the DNS response time; based on the network transmission flow, calculate the network connection time and retransmission delay; based on the application layer request flow, calculate the server response time and data transmission time; and obtain multi-dimensional time indicators.

[0048] In this step, the data transmission time (DNS response time) refers to the time from when the browser initiates the DNS domain name resolution request to when the target server IP address is obtained. The calculation starts at the moment the browser sends the DNS query request and ends at the moment the IP address response is received from the DNS server. The calculation formula is:

[0049] DNS response time = DNS response time - DNS request time (1)

[0050] The connection time refers to the TCP three-way handshake time. The calculation starts at the moment when the TCP SYN packet is sent (requesting to establish a connection) and ends at the moment when the TCP ACK packet returned by the server is received (the three-way handshake is completed). The formula is:

[0051] TCP connection time = SYN + ACK receiving time - SYN sending time (2)

[0052] The server response time is the time from when the client sends the HTTP request to when the server returns the first response byte. The starting point is the timestamp of the client sending the HTTP request, and the end point is the timestamp of the client receiving the first byte of the response header. The formula is:

[0053] Server response time = first byte reception time - request sending completion time (3)

[0054] The data transmission time refers to the time from receiving the first response byte to receiving all the response contents; the starting point is the time when the first response byte is received, and the end point is the time when the last response byte is received. The formula is:

[0055] Data transmission time = last byte reception time - first byte reception time (4)

[0056] Retransmission delay refers to the time it takes for a client to resend data when a packet is lost during network transmission. This includes the time it takes to detect the packet loss and the time it takes to complete the retransmission. The starting point is the time the packet is expected to be received, and the end point is the time the retransmitted packet is confirmed. The formula is as follows:

[0057] Retransmission delay = retransmission packet reception time - original packet expected arrival time (5)

[0058] This step calculates multi-dimensional time to more accurately identify network performance issues. A timestamp anchor mechanism is designed to calculate each dimension's time. Using the start time as a benchmark, each stage's completion timestamp is sequentially marked to avoid clock drift errors. This multi-dimensional time calculation also improves the accuracy of user experience evaluation.

[0059] Step S4: construct an experience evaluation model based on multi-dimensional time indicators.

[0060] In this step, the evaluation model can be constructed using linear weighting, scoring function or fuzzy rules. Preferably, this embodiment uses linear weighting to construct the evaluation model. The constructed model is as follows:

[0061] User experience time = w1 × DNS response time + w2 × connection time + w3 × server response time + w4 × data transmission time + w5 × retransmission delay (6)

[0062] In formula (6), w1, w2, w3, w4, and w5 are the weights of DNS response time, connection time, server response time, data transmission time, and retransmission delay, respectively.

[0063] Step S5: setting parameters of each time indicator according to the business scenario, and calculating the comprehensive score using the experience evaluation model.

[0064] In this step, the parameter settings for each indicator are based on the business scenario and are related to the model type being constructed. When using a linear weighted approach to construct the experience evaluation model, the parameters set include the weights of each indicator. In step S6, the user experience evaluation results are graded based on the comprehensive score. The comprehensive score and grade are visualized and used for performance alerting, capacity assessment, or quality auditing.

[0065] Based on the same idea, an embodiment of the present invention also provides a user experience evaluation system based on multi-dimensional network delay characteristics, the system includes: a traffic access module, a traffic decomposition module, a multi-dimensional time calculation module, an evaluation module construction module, a comprehensive scoring module and a result output module; wherein,

[0066] The traffic access module is used to receive original traffic data packets from the network;

[0067] The traffic decomposition module is used to receive the original access request from the client and decompose the original traffic data packet into three groups of traffic according to the access request, including DNS resolution flow, network transmission flow and application layer request flow;

[0068] The multi-dimensional time calculation module is used to calculate the DNS response time based on the DNS resolution flow; calculate the network connection time and retransmission delay based on the network transmission flow; calculate the server response time and data transmission time based on the application layer request flow; and obtain multi-dimensional time indicators;

[0069] The evaluation module construction module is used to build an experience evaluation model based on multi-dimensional time indicators;

[0070] The comprehensive scoring module is used to set parameters of each time indicator according to the business scenario and calculate the comprehensive score through the experience evaluation model;

[0071] The result output module is used to grade the evaluation results of the user experience according to the comprehensive score, and to visually display the comprehensive score and grade.

[0072] In this embodiment, each module is implemented by a processor, and a memory is appropriately added when storage is required. The processor may be, but is not limited to, a microprocessor MPU, a central processing unit (CPU), a network processor (NP), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), other programmable logic devices, discrete gates, transistor logic devices, discrete hardware components, etc. The memory may include a random access memory (RAM) or a non-volatile memory (NVM), such as at least one disk storage. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0073] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode.

[0074] It should also be noted that the user experience evaluation system based on multi-dimensional network delay characteristics described in this embodiment corresponds to the user experience evaluation method based on multi-dimensional network delay characteristics. The description and limitation of the method are also applicable to the system and will not be repeated here.

[0075] As can be seen from the above technical solutions, the user experience evaluation method and system based on multi-dimensional network delay characteristics provided by the embodiments of the present invention can more accurately analyze traffic, segment delay sources, and locate bottlenecks with an error of less than 5%. It can also more accurately locate network performance issues. At the same time, there is no need to modify the client and it is compatible with any terminal device based on network mirror traffic analysis.

[0076] The above description is only a preferred embodiment of the present invention and an explanation of the technical principles used. It is not intended to limit the scope of the invention to be protected, but merely represents a preferred embodiment of the present invention. Those skilled in the art should understand that the scope of the invention involved in the present invention is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the inventive concept. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making any creative work shall fall within the scope of protection of the present invention.

Claims

1. A user experience evaluation method based on multi-dimensional network delay characteristics, characterized in that: The steps include: Step S1, receiving original traffic data packets from the network; Step S2: receiving the original access request from the client, and decomposing the original traffic data packet into three groups of traffic according to the access request, including DNS resolution flow, network transmission flow and application layer request flow; Step S3, calculating the DNS response time based on the DNS resolution flow; Calculate network connection time and retransmission delay based on network transmission flow; Calculate server response time and data transmission time based on application layer request flow; Get multi-dimensional time indicators; Step S4, constructing an experience evaluation model based on multi-dimensional time indicators; Step S5: setting parameters for each time indicator according to the business scenario, and calculating a comprehensive score using the experience evaluation model; Step S6: grading the user experience evaluation results according to the comprehensive score, and visually displaying the comprehensive score and grade.

2. The method according to claim 1, characterized in that The original access request includes the source IP address, target domain name, and protocol type.

3. The method according to claim 1, characterized in that The DNS resolution flow comes from UDP port 53, the network transmission flow corresponds to the TCP / IP layer of the seven-layer model, and the application layer request flow corresponds to HTTP / HTTPS.

4. The method according to claim 1, wherein In step S3, the DNS response time refers to the time from when the browser initiates the DNS domain name resolution request to when the target server IP address is obtained; The calculation starts at the moment when the browser sends the DNS query request, and ends at the moment when the IP address response is received from the DNS server. The network connection time refers to the TCP three-way handshake time; the calculation starts at the moment of sending the TCP SYN packet and ends at the moment of receiving the TCP ACK packet returned by the server; The retransmission delay refers to the time it takes for the client to resend data when a data packet is lost during network transmission, including the time it takes to detect the packet loss and the time it takes to complete the retransmission. The starting point is the time when the data packet is expected to be received, and the end point is the time when the retransmitted data packet is confirmed. The server response time refers to the time from when the client sends an HTTP request to when the server returns the first response byte; The starting point is the timestamp when the client sends the HTTP request, and the ending point is the timestamp when the client receives the first byte of the response header; The data transmission time refers to the time from receiving the first response byte to receiving all response contents; the starting point is the time when the first response byte is received, and the end point is the time when the last response byte is received.

5. The method according to claim 1, wherein When building an experience evaluation model, linear weighting, scoring function or fuzzy rules are used.

6. The method according to claim 1, wherein The experience evaluation model is constructed using a linear weighted approach.

7. The method according to claim 6, characterized in that When the experience evaluation model is constructed using a linear weighted approach, the parameters set are the weights of each time indicator.

8. The method according to claim 6, characterized in that The formula of the experience evaluation model is as follows: User experience time = w1 × DNS response time + w2 × connection time + w3 × server response time + w4 × data transmission time + w5 × retransmission delay (6) In formula (6), w1, w2, w3, w4, and w5 are the weights of DNS response time, network connection time, server response time, data transmission time, and retransmission delay, respectively.

9. The method according to claim 1, characterized in that The comprehensive score is also used for performance alerting, capacity assessment, or quality auditing.

10. A user experience evaluation system based on multi-dimensional network delay characteristics, characterized in that: The system includes: a traffic access module, a traffic decomposition module, a multi-dimensional time calculation module, an evaluation module construction module, a comprehensive scoring module and a result output module; wherein, The traffic access module is used to receive original traffic data packets from the network; The traffic decomposition module is used to receive the original access request from the client and decompose the original traffic data packet into three groups of traffic according to the access request, including DNS resolution flow, network transmission flow and application layer request flow; The multi-dimensional time calculation module is used to calculate the DNS response time based on the DNS resolution flow; calculate the network connection time and retransmission delay based on the network transmission flow; calculate the server response time and data transmission time based on the application layer request flow; and obtain multi-dimensional time indicators; The evaluation module construction module is used to build an experience evaluation model based on multi-dimensional time indicators; The comprehensive scoring module is used to set parameters of each time indicator according to the business scenario and calculate the comprehensive score through the experience evaluation model; The result output module is used to grade the evaluation results of the user experience according to the comprehensive score, and to visually display the comprehensive score and grade.

Images