Business perception evaluation method and system

Abstract

The present invention provides a service perception evaluation method and system. First, the TCP code stream of the user terminal is obtained, and the service identification of the TCP code stream is performed on the TCP code stream to determine the XDR call record of the TCP session in the target service; the target service includes at least the mobile payment service; then, based on the content length information carried by the TCP code stream in the XDR call record, the start time and end time of the perception impact phase of the target service are determined; finally, based on the start time and end time of the perception impact phase, the target service is perceived and evaluated. This fills the technical gap in the perception evaluation of mobile payment services, and can provide a theoretical basis for improving users' perception of mobile payment services, thereby helping to increase the number of users. Moreover, using the TCP code stream of the mobile payment service can fully utilize resources. In addition, the TCP code stream is easy to obtain, which can improve the efficiency of evaluation.

Description

Technical Field

[0001] The present invention relates to the field of communication technologies, and in particular to a service perception evaluation method and system. Background Art

[0002] At present, with the rapid development of mobile networks and smart terminals, people are paying more attention to their perception of target services while applying them through mobile networks anytime and anywhere, such as whether the target services can be successfully applied and whether the application of the target services is smooth.

[0003] Taking mobile payment as an example, mobile payment refers to electronic payments made by mobile clients using electronic devices such as mobile phones. Mobile payment effectively connects the internet, terminal devices, and financial institutions to form a new payment system. Mobile payment not only allows for monetary payments but also covers daily expenses such as phone bills, gas, utilities, and water. The user experience of mobile payment services generally involves four parties: consumers, merchants, financial institutions, and mobile operators. Mobile operators' payment management systems provide the premise and possibilities for the entire mobile payment service, maintaining every process link and serving as a core link. Therefore, a method is needed to accurately assess mobile payment service perception from the network side, enabling network optimization and maintenance engineers to evaluate user experience and identify issues promptly. However, existing technologies lack a relevant technical solution for evaluating user perception of mobile payment services.

[0004] Therefore, there is an urgent need to provide a business perception evaluation method. Summary of the Invention

[0005] The present invention provides a service perception evaluation method and system to solve the defects in the prior art.

[0006] The present invention provides a service perception evaluation method, comprising:

[0007] Obtaining a TCP stream from a user terminal, performing service identification on the TCP stream, and determining an XDR call record for a TCP session in a target service; the target service includes at least a mobile payment service;

[0008] Determining the start time and end time of the perception impact phase of the target service based on the content length information carried by the TCP code stream in the XDR call record;

[0009] Based on the start time and the end time of the perception impact phase, a perception evaluation is performed on the target service.

[0010] According to a service perception evaluation method provided by the present invention, determining the start time and end time of the perception impact phase of the target service based on the content length information carried by the TCP code stream in the XDR call record specifically includes:

[0011] Determining the perception impact stage corresponding to the XDR call record based on content length information carried by the TCP code stream in the XDR call record;

[0012] Based on the transmission time of the TCP code stream in the XDR call record, the start time and end time of the perception impact phase corresponding to the XDR call record are determined.

[0013] According to a service perception evaluation method provided by the present invention, the perception impact stage includes the code scanning stage, payment confirmation stage and payment completion stage of the mobile payment service;

[0014] Accordingly, determining the perception impact stage corresponding to the XDR call record based on the content length information carried by the TCP code stream in the XDR call record specifically includes:

[0015] If the content length information includes the downlink content length, and the downlink content length is the first value, determining that the perception impact stage is the code scanning stage;

[0016] If the content length information satisfies a first condition or a second condition, determining that the perception impact stage is the payment confirmation stage; the first condition is that the content length information includes an upstream content length and a downstream content length, and the upstream content length and the downstream content length are within a first preset range; the second condition is that the content length information includes a downstream content length, and the downstream content length is within a second preset range;

[0017] If the content length information satisfies a third condition or a fourth condition, determining that the perception impact stage is the payment completion stage; the third condition is that the content length information includes an upstream content length and a downstream content length, and the downstream content length is within a first preset range and the upstream content length is within a second preset range; the fourth condition is that the content length information includes an upstream content length and a downstream content length, and the downstream content length is the second value and the upstream content length is the third value;

[0018] Among them, any value within the first preset range is smaller than any value within the second preset range.

[0019] According to a service perception evaluation method provided by the present invention, the user terminals include user terminals within a target area; accordingly,

[0020] The performing a perception evaluation on the target service based on the start time and the end time of the perception impact phase specifically includes:

[0021] For any user terminal, if the difference between the end time and the start time corresponding to the any user terminal is greater than a first preset delay, determining that the XDR call record of the perception impact stage corresponding to the any user terminal is a poor quality call record;

[0022] If it is determined that the ratio of the first total number of poor-quality call records corresponding to each user terminal to the second total number of XDR call records corresponding to each user terminal is greater than a preset ratio, it is determined that the target service is a poor-quality service.

[0023] According to a service perception evaluation method provided by the present invention, the perception impact stage corresponds to multiple XDR call records;

[0024] Accordingly, the determining that the XDR call record in the perception impact stage corresponding to any user terminal is a poor quality call record further includes:

[0025] Determine the wireless side delay, core side delay, uplink average RTT, and downlink average RTT corresponding to the poor quality call record;

[0026] If the core side delay is greater than the second preset delay, or the uplink average RTT is greater than the third preset delay, it is determined that the poor quality call record is caused by the core side;

[0027] If the wireless side delay is greater than the fourth preset delay, or the downlink average RTT is greater than the fifth preset delay, it is determined that the poor quality call record is caused by the wireless side.

[0028] According to a service perception evaluation method provided by the present invention, the wireless side delay is determined based on the TCP link establishment confirmation delay of the TCP code stream corresponding to the poor quality call record during TCP link establishment, and the delay from the successful TCP link establishment to the first transaction request;

[0029] The core side delay is determined based on the TCP link establishment response delay of the TCP code stream corresponding to the poor quality call record when the TCP link is established, and the delay of the first HTTP response packet.

[0030] The present invention also provides a service perception evaluation system, comprising:

[0031] An acquisition module is used to acquire a TCP stream from a user terminal, perform service identification on the TCP stream, and determine an XDR call record of a TCP session in a target service; the target service includes at least a mobile payment service;

[0032] A determination module, configured to determine the start time and end time of the perception impact phase of the target service based on the content length information carried by the TCP code stream in the XDR call record;

[0033] An evaluation module is used to perform a perception evaluation on the target service based on the start time and the end time of the perception impact phase.

[0034] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of any of the above-described service perception evaluation methods are implemented.

[0035] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which implements the steps of any of the above-mentioned service awareness evaluation methods when executed by a processor.

[0036] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the steps of any one of the above-mentioned service awareness evaluation methods are implemented.

[0037] The service perception evaluation method and system provided by the present invention first obtain the TCP code stream of the user terminal, perform service identification on the TCP code stream, and determine the XDR call record of the TCP session in the target service; the target service includes at least the mobile payment service; then, based on the content length information carried by the TCP code stream in the XDR call record, the start time and end time of the perception impact phase of the target service are determined; finally, based on the start time and end time of the perception impact phase, the target service is perceived and evaluated. This fills the technical gap in the perception evaluation of mobile payment services, and can provide a theoretical basis for improving users' perception of mobile payment services, thereby helping to increase the number of users. Moreover, the use of the TCP code stream of the mobile payment service can make full use of resources. In the process of service perception evaluation, no additional equipment is required to implement the evaluation, which can save evaluation costs. In addition, the TCP code stream is easy to obtain, which can improve the efficiency of the evaluation. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solutions in the present invention or the prior art, a brief introduction is given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0039] Figure 1 This is one of the flow charts of the service perception evaluation method provided by the present invention;

[0040] Figure 2 This is the second flow chart of the service perception evaluation method provided by the present invention;

[0041] Figure 3 This is a schematic diagram of the process of TCP protocol data transmission in the service perception evaluation method provided by the present invention;

[0042] Figure 4 It is a structural diagram of the business perception evaluation system provided by the present invention;

[0043] Figure 5 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0044] To make the objectives, technical solutions, and advantages of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts shall fall within the scope of protection of the present invention.

[0045] Figure 1 A flow chart of a service perception evaluation method provided in an embodiment of the present invention is shown in FIG. Figure 1 As shown, the method includes:

[0046] S1, obtaining a TCP code stream of a user terminal, performing service identification on the TCP code stream, and determining an XDR call record of a TCP session in a target service; the target service includes at least a mobile payment service;

[0047] S2, determining the start time and end time of the perception impact phase of the target service based on the content length information carried by the TCP code stream in the XDR call record;

[0048] S3: Performing a perception evaluation on the target service based on the start time and the end time of the perception impact phase.

[0049] Specifically, the service perception evaluation method provided in the embodiments of the present invention is performed by a server, which can be a cloud server. The server can implement a perception evaluation of target services, such as mobile payment services, from the network side. Service perception refers to the user's perception of the mobile payment service, or the user's experience with the mobile payment service. Service perception evaluation assesses user satisfaction with the mobile payment service, specifically determining whether the mobile payment service is of poor or high quality.

[0050] First, step S1 is executed to obtain the TCP stream of the user terminal, perform service identification on the TCP stream, and determine the XDR call record of the TCP session in the target service; the target service includes at least the mobile payment service. The user terminal can be any terminal device that uses the target service. The number of user terminals can be one or all user terminals in the target area, which is not specifically limited in the embodiments of the present invention. The user terminal can be a smartphone with a scanning function.

[0051] The target service may be a service that transmits data packets using the Transmission Control Protocol (TCP) and the Hypertext Transfer Protocol (HTTP), and transmits encrypted data packets. In the embodiment of the present invention, the target service may at least include a mobile payment service.

[0052] TCP is a connection-oriented, reliable, byte-stream-based transport layer communications protocol. When the application layer sends an 8-bit byte data stream to the TCP layer for transmission across the internet, the TCP layer divides the data stream into segments of appropriate lengths. The maximum segment size (MSS) is typically limited by the maximum transmission unit (MTU) of the data link layer of the network to which the computer is connected. The TCP layer then passes the data packet to the IP layer, which delivers the packet across the network to the TCP layer of the receiving entity. TCP is designed to adapt to a layered protocol hierarchy that supports multi-network applications. Pairs of processes in host computers connected to different but interconnected computer communication networks rely on TCP for reliable communication services.

[0053] HTTP is a simple request-response protocol that typically runs on top of TCP. It specifies what messages a user terminal may send to a server and what responses it may receive. After establishing a connection with a server, a client sends a request formatted as a Uniform Resource Identifier (URI), a protocol version, and the first type of Multipurpose Internet Mail Extensions (MIME) information. The MIME information includes a request modifier, client information, and possibly other content.

[0054] After receiving a request, the server responds with a corresponding message formatted as a status line containing the message's protocol version number, a success or error code, and second-level MIME information. This second-level MIME information includes server information, entity information, and possibly other content. It's understood that any server, in addition to Hypertext Markup Language (HTML) files, also has an HTTP resident program that responds to user requests. Your browser is an HTTP client, sending requests to the server. When you enter a start file or click a hyperlink in the browser, the browser sends an HTTP request to the server. This request is sent to the Uniform Resource Locator (URL) specified by the IP address. The resident program receives the request, performs the necessary operations, and then returns the requested file. During this process, data sent and received on the network is divided into one or more packets. Each packet contains: the data to be transmitted; and control information, which tells the server how to process the packet. TCP / IP determines the format of each packet.

[0055] The mobile payment process generally involves four parties: consumers, merchants, financial institutions, and mobile operators. The mobile operator's payment management system provides the premise and possibility for the entire mobile payment process. It serves as a crucial link, maintaining every step in the mobile payment process. First, the consumer signals their purchase order. This order is transmitted to the merchant's transaction management system through the wireless operator's payment management system. After receiving the consumer's purchase order, the merchant uses the wireless operator's payment management system to send the order back to the consumer's mobile terminal for confirmation. The purchase proceeds only after the consumer confirms the order; otherwise, the transaction is deemed invalid and terminated. Only after receiving the consumer's confirmation does the wireless operator's payment management system record the transaction in detail. It also issues instructions to the financial institution to clear the payment between the consumer and the merchant and notify the merchant to provide the transaction services. Finally, the merchant proactively delivers the purchased product or service.

[0056] Because all data packets transmitted during mobile payment applications are encrypted, it's impossible to obtain information about the success or failure of mobile payments. Therefore, the present invention uses the user's business behavior as a starting point. By identifying the behavioral characteristics of mobile payment actions on the user terminal, the entire payment process is comprehensively evaluated based on stream characteristics and service latency indicators. This determines whether the XDR call record generated by the TCP stream is of poor quality, and further determines the perception of the target service.

[0057] XDR (X Data Recording) is a concept that evolved from Call Data Recording (CDR). CDR is a record of key network information during a call in traditional communications networks. XDR is an extension of CDR, referring to the recording of key information about data traffic in mobile and bearer networks, also known as traffic logs. Each user session is represented by an XDR call record, with each TCP session generating an XDR call record.

[0058] In an embodiment of the present invention, after obtaining the TCP code stream from the user terminal, the server can use the POST method to make an HTTP request, perform service identification on the TCP stream of each TCP session, and determine the target service and the XDR call record of the TCP session in the target service. The HTTP post request information format can be expressed as: POST / mmtls / ***, the HOST value can be: short.pay.weixin.qq.com, and HTTP returns 200OK. It should be noted that the key content fields of POST and HOST used in the HTTP request process are not fixed values ​​and may vary.

[0059] When a user uses mobile payment services, such as WeChat Pay, a complete and successful payment process may include the mobile payment service code scanning stage, payment confirmation stage, and payment completion stage. Accordingly, the payment process will generate 5 to 6 XDR call records, which can be represented as follows:

[0060] HOST=short.pay.weixin.qq.com;

[0061] URI=http: / / short.pay.weixin.qq.com / mmtls / ***.

[0062] Then, step S2 is executed. Since XDR call records lack distinct stream characteristics and cannot be directly used for perception assessment, it is necessary to determine the start and end times of the target service's perception impact phase based on the content length information carried by the TCP stream in the XDR call record. Since latency at each stage of the mobile payment service affects perception, the perception impact phases of the mobile payment service in this embodiment of the present invention may include the code scanning phase, the payment confirmation phase, and the payment completion phase.

[0063] After each POST, the server returns a 200OK packet, which carries content-length (Content-Length) information. The content-length information may include the upstream content length and the downstream content length.

[0064] Table 1 Correspondence between various stages of mobile payment services and content length information

[0065]

[0066] Because different mobile payment service stages correspond to different content length information, embodiments of the present invention can use the content length information carried by the TCP stream to determine the mobile payment service's perceived impact stage, and furthermore, determine the start and end times of the perceived impact stage. Table 1 shows the correspondence between various mobile payment service stages and content length information.

[0067] Then, step S3 is executed to perform a perceptual evaluation of the target service based on the start and end times of the perceptual impact phase. In an embodiment of the present invention, the difference between the end and start times of each perceptual impact phase can be determined, and the target service can be perceptually evaluated based on the size of the difference, that is, whether the target service is a poor-quality service. The difference can be used to characterize the delay of the perceptual impact phase. The difference is actually the total service delay, which can be the sum of the TCP link establishment response delay, the TCP link establishment confirmation delay, the delay from the successful TCP link establishment to the first transaction request, and the delay of the last HTTP content packet.

[0068] If the difference corresponding to any perception impact stage is greater than a preset threshold, the XDR call record corresponding to that perception impact stage is a poor quality call record. Otherwise, if the difference is less than or equal to the preset threshold, the XDR call record corresponding to that perception impact stage is a good quality call record. The preset threshold can be set as needed, for example, 2 seconds.

[0069] Furthermore, it is possible to determine whether the XDR call records corresponding to each perception impact stage are poor quality call records, and to determine whether the target service is poor quality service based on the ratio of the total number of all poor quality call records to the total number of all XDR call records. The total number of all poor quality call records includes the sum of the poor quality call records corresponding to each perception impact stage.

[0070] If the ratio is greater than a specified value, the target service is determined to be of poor quality, meaning the target service has low perception and a poor user experience. If the ratio is less than or equal to the specified value, the target service is determined to be of high quality, meaning the target service has high perception and a good user experience. The specified value can be set as needed and is not specifically limited in the embodiments of the present invention.

[0071] The service perception evaluation method provided in the embodiment of the present invention first obtains the TCP code stream of the user terminal, performs service identification on the TCP code stream, and determines the XDR call record of the TCP session in the target service; the target service includes at least the mobile payment service; then, based on the content length information carried by the TCP code stream in the XDR call record, the start time and end time of the perception impact phase of the target service are determined; finally, based on the start time and end time of the perception impact phase, the target service is perceived and evaluated. This fills the technical gap in the perception evaluation of mobile payment services, and can provide a theoretical basis for improving users' perception of mobile payment services, thereby helping to increase the number of users. Moreover, the use of the TCP code stream of the mobile payment service can make full use of resources. In the process of service perception evaluation, no additional equipment is required to implement the evaluation, which can save evaluation costs. In addition, the TCP code stream is easy to obtain, which can improve the efficiency of the evaluation.

[0072] Based on the above embodiment, the service perception evaluation method provided in the embodiment of the present invention, wherein the start time and end time of the perception impact phase of the target service are determined based on the content length information carried by the TCP stream in the XDR call record, specifically includes:

[0073] Determining the perception impact stage corresponding to the XDR call record based on content length information carried by the TCP code stream in the XDR call record;

[0074] Based on the transmission time of the TCP code stream in the XDR call record, the start time and end time of the perception impact phase corresponding to the XDR call record are determined.

[0075] Specifically, in an embodiment of the present invention, when determining the start and end times of the perception impact stage, the content length information carried by the TCP code stream in the XDR call record can be obtained first, and then the perception impact stage corresponding to the XDR call record can be determined based on the correspondence between the perception impact stage and the content length information in Table 1.

[0076] After determining the perception impact stage corresponding to the XDR call record, the transmission time of the TCP code stream in the XDR call record can be obtained, and the start time and end time of the perception impact stage corresponding to the XDR call record can be determined based on the transmission time. The transmission time of the TCP code stream can include the start time of the TCP code stream and the end time of the TCP code stream. For example, for the scanning stage in the perception impact stage, the start time of the TCP code stream of the XDR call record carrying the content length information corresponding to the scanning stage is the start time of the scanning stage, and the end time of the TCP code stream of the XDR call record carrying the content length information corresponding to the scanning stage is the end time of the scanning stage.

[0077] In this embodiment of the present invention, the start and end times of the perception impact phase are determined by combining the content length information carried by the TCP stream in the XDR call record with the transmission time of the TCP stream in the XDR call record. This can make the start and end times of the perception impact phase more accurate. Furthermore, the content length information carried by the TCP stream and the transmission time of the TCP stream are both easily accessible, which can speed up the determination of the start and end times of the perception impact phase.

[0078] On the basis of the above embodiment, in the service perception evaluation method provided in the embodiment of the present invention, the perception impact stage includes the code scanning stage, payment confirmation stage and payment completion stage of the mobile payment service;

[0079] Accordingly, determining the perception impact stage corresponding to the XDR call record based on the content length information carried by the TCP code stream in the XDR call record specifically includes:

[0080] If the content length information includes the downlink content length, and the downlink content length is the first value, determining that the perception impact stage is the code scanning stage;

[0081] If the content length information satisfies a first condition or a second condition, determining that the perception impact stage is the payment confirmation stage; the first condition is that the content length information includes an upstream content length and a downstream content length, and the upstream content length and the downstream content length are within a first preset range; the second condition is that the content length information includes a downstream content length, and the downstream content length is within a second preset range;

[0082] If the content length information satisfies a third condition or a fourth condition, determining that the perception impact stage is the payment completion stage; the third condition is that the content length information includes an upstream content length and a downstream content length, and the downstream content length is within a first preset range and the upstream content length is within a second preset range; the fourth condition is that the content length information includes an upstream content length and a downstream content length, and the downstream content length is the second value and the upstream content length is the third value;

[0083] Among them, any value within the first preset range is smaller than any value within the second preset range.

[0084] Specifically, in an embodiment of the present invention, the perception impact stage corresponding to the XDR call record can be determined by judging the specific content contained in the content length information and the conditions met.

[0085] After scanning the QR code using WeChat Pay, Android and iOS user devices send a post request, and the server returns a 200OK packet containing the Content-Length parameter (the first value). Therefore, if the content length information includes the downlink content length, and the downlink content length is the first value, the perception impact phase can be directly determined to be the QR code scanning phase. In this case, the XDR record can be marked as "QR code scanning." The first value can be set as needed, for example, to 791.

[0086] After the user scans the QR code, enters the payment amount, and clicks the "Confirm Payment" button, the payment confirmation phase begins. During this phase, two HTTP (POST) streams appear consecutively, each carrying either the upstream content length or both the upstream content length and the downstream content length. Therefore, when the content length information meets the first or second condition, the perceived impact phase can be determined to be the payment confirmation phase. When the content length information meets the first condition, the XDR call record can be marked as "Confirm Payment_1," and when the content length information meets the second condition, the XDR call record can be marked as "Confirm Payment_2."

[0087] The first condition is that the content length information includes the upstream content length and the downstream content length, and the upstream content length and the downstream content length are within a first preset range. The first preset range can be set as needed, for example, it can be set to 300 < upstream content length / downstream content length < 1000. The second condition is that the content length information includes the downstream content length, and the downstream content length is within a second preset range. The second preset range can be set as needed, for example, it can be set to 1000 < downstream content length.

[0088] After the user clicks the "Confirm Payment" button and enters the payment password, the final payment completion phase is triggered when the last digit of the password is entered. During this phase, two HTTP (POST) streams appear consecutively, carrying the upstream content length and downstream content length. Therefore, when the content length information meets the third or fourth conditions, the perceived impact phase can be determined to be the payment completion phase. When the content length information meets the third condition, the XDR call record can be marked as "Payment Completed_1", and when the content length information meets the fourth condition, the XDR call record can be marked as "Payment Completed_2".

[0089] The third condition is that the content length information includes both the upstream content length and the downstream content length, and the downstream content length is within a first preset range and the upstream content length is within a second preset range, i.e., 300 < downstream content length < 1000 and upstream content length > 1000. The fourth condition is that the content length information includes both the upstream content length and the downstream content length, and the downstream content length is the second value and the upstream content length is the third value. Both the second and third values ​​can be set as needed. For example, the second value can be set to 229 and the third value can be set to 595 or 597.

[0090] In the embodiment of the present invention, by judging whether the content length information is a given value or within a preset range, the perception impact stage is determined, thereby ensuring the reliability of the determination method.

[0091] After determining the perception impact stage corresponding to the XDR call record, the start and end times of the perception impact stage can be determined based on the marking of the XDR call record and the transmission time of the TCP code stream in the XDR call record. The difference between the end time and the start time of each perception impact stage is the delay of each perception impact stage. For example:

[0092] For the code scanning stage, the code scanning delay is: code scanning delay = end time (end_time) of the TCP code stream in the XDR call record marked with code scanning – start time (start_time) of the TCP code stream in the XDR call record marked with code scanning.

[0093] For the payment confirmation phase, the payment confirmation delay is: the end time (end_time) of the TCP code stream in the XDR call record marked with payment confirmation_2 - the start time (start_time) of the TCP code stream in the XDR call record marked with payment confirmation_2.

[0094] For the payment completion stage, the payment completion delay is: the end time (end_time) of the TCP code stream in the XDR call record marked as payment completion_2 minus the start time (start_time) of the TCP code stream in the XDR call record marked as payment completion_2.

[0095] It should be noted that if there is no corresponding XDR call bill for the payment stage within 2 minutes after the XDR call bill for the code scanning stage, it is determined to be a failed payment behavior, and the XDR call bill for the payment stage is determined to be a poor quality call bill, and it is necessary to continue to determine the problem of the poor quality call bill.

[0096] On the basis of the above embodiments, in the service perception evaluation method provided in the embodiments of the present invention, the user terminals include each user terminal in the target area; accordingly,

[0097] The performing a perception evaluation on the target service based on the start time and the end time of the perception impact phase specifically includes:

[0098] For any user terminal, if the difference between the end time and the start time corresponding to the any user terminal is greater than a first preset delay, determining that the XDR call record of the perception impact stage corresponding to the any user terminal is a poor quality call record;

[0099] If it is determined that the ratio of the first total number of poor-quality call records corresponding to each user terminal to the second total number of XDR call records corresponding to each user terminal is greater than a preset ratio, it is determined that the target service is a poor-quality service.

[0100] Specifically, in the embodiment of the present invention, a perception evaluation is performed on the target service, that is, whether the target service is a low-quality service or a high-quality service. When the user terminals include all user terminals in the target area, the service perception evaluation result is the evaluation result given by all terminals in the target area.

[0101] When the user terminals include all user terminals in the target area, the server can first lock the user terminal through the user terminal ID (IMSI), and then use the TCP code stream of each user terminal to perform perception evaluation on the target service respectively, and finally summarize the perception results corresponding to each user terminal.

[0102] For any user terminal within the target area, if the difference between the end time and the start time of the perception impact phase corresponding to the user terminal is greater than a first preset delay, the XDR call record corresponding to the perception impact phase of the user terminal is determined to be a poor quality call record. Furthermore, a first total number of poor quality call records corresponding to each user terminal and a second total number of XDR call records corresponding to each user terminal can be calculated, and the ratio of the first total number to the second total number can be calculated. The perception status of the target service within the target area is determined based on the ratio. The first total number is the total number of all poor quality call records corresponding to all user terminals within the target area.

[0103] If the ratio is greater than or equal to the preset ratio, it can be determined that the perception of the target service in the target area is good, that is, the user experience is good; otherwise, it can be determined that the perception of the target service in the target area is poor, that is, the user experience is poor. The preset ratio can be set as needed and is not specifically limited in the embodiments of the present invention.

[0104] In the embodiment of the present invention, a method for judging the perception of a target service in a target area is provided, which can provide a theoretical basis for improving the perception of mobile payment services in the target area, thereby helping to increase the number of users.

[0105] On the basis of the above embodiment, in the service perception evaluation method provided in the embodiment of the present invention, the perception impact stage corresponds to multiple XDR call records;

[0106] Accordingly, the determining that the XDR call record in the perception impact stage corresponding to any user terminal is a poor quality call record further includes:

[0107] Determine the wireless side delay, core side delay, uplink average RTT, and downlink average RTT corresponding to the poor quality call record;

[0108] If the core side delay is greater than the second preset delay, or the uplink average RTT is greater than the third preset delay, it is determined that the poor quality call record is caused by the core side;

[0109] If the wireless side delay is greater than the fourth preset delay, or the downlink average RTT is greater than the fifth preset delay, it is determined that the poor quality call record is caused by the wireless side.

[0110] Specifically, in an embodiment of the present invention, each perception impact stage may correspond to multiple XDR call records, each XDR call record corresponds to a TCP session, and each TCP session contains multiple TCP code streams. On this basis, after determining that the XDR call record in the perception impact stage corresponding to any user terminal is a poor quality call record, the cause of the poor quality call record can be determined through subsequent processing. Then, the wireless side delay, core side delay, uplink average RTT and downlink average RTT corresponding to the poor quality call record can be determined. Among them, the wireless side delay refers to the delay generated by the user terminal, the core side delay refers to the delay generated by the server, the uplink average RTT refers to the average RTT generated by the data transmission process initiated by the user terminal in the poor quality call record, and the downlink average RTT refers to the average RTT generated by the data transmission process initiated by the server in the poor quality call record.

[0111] If the core-side latency is greater than the second preset latency, or the uplink average RTT is greater than the third preset latency, the XDR CDR is considered poor quality and is caused by the core side. This indicates an S1-U upstream issue or a core-side issue. The second and third preset latency can be set as needed. For example, the second and third preset latency can be set to 154ms and 200ms, respectively.

[0112] If the wireless side delay is greater than the fourth preset delay, or the downlink average RTT is greater than the fifth preset delay, the XDR CDR is determined to be of poor quality and caused by the wireless side. This indicates an S1-U downstream issue, specifically a wireless side issue. The fourth and fifth preset delays can be set as needed. For example, the fourth preset delay can be set to 232ms, and the fifth preset delay can be set to 400ms.

[0113] Otherwise, if none of the above conditions are met, and it is neither a core side problem nor a wireless side problem, then it can be determined that the XDR call record is of poor quality and is caused by the end-to-end transmission process, that is, it can be identified as an end-to-end problem.

[0114] In the embodiment of the present invention, specific values ​​of the first preset delay, the second preset delay, the third preset delay, the fourth preset delay, and the fifth preset delay may be twice the average network-wide delay during method verification.

[0115] In an embodiment of the present invention, when it is determined that the XDR call record is a poor quality call record, the wireless side delay, core side delay, uplink average RTT and downlink average RTT of the poor quality call record are first determined, and the problem is determined by comparing the wireless side delay, core side delay, uplink average RTT and downlink average RTT with the corresponding given delay. This can achieve rapid location of the problem, making it easier for users to discover and solve the problem in a timely manner.

[0116] like Figure 2 FIG. 1 is a schematic diagram of a complete process of a service perception evaluation method provided in an embodiment of the present invention, and the method includes:

[0117] 1) Obtain XDR call records for WeChat Pay services;

[0118] 2) Determine whether the message status (Messages states) of the WeChat payment service is greater than 400 or less than 0. If so, the HTTP request fails and the XDR call record is determined to be of poor quality; otherwise, execute step 3);

[0119] 3) Based on the labeling algorithm, the XDR call records for each perception impact stage of the WeChat payment service are determined and classified into XDR call records for the code scanning stage, XDR call records for the payment confirmation stage, and XDR call records for the payment completion stage. XDR call records that do not meet the labeling algorithm are discarded;

[0120] 4) A complete process of scanning, confirming payment, and completing payment is defined as one payment. If the XDR for the payment is not obtained within 2 minutes of obtaining the XDR for the scanning phase, it will be considered a failed payment.

[0121] 5) Calculate the time delay of each perception impact stage;

[0122] 6) Determine whether the delay in any perception-affected phase is greater than 2s. If so, the XDR call record in any perception-affected phase is considered to be of poor quality; otherwise, it is considered to be of high quality.

[0123] 7) For poor quality call records, in TCP establishment phase 21, the radio side delay and core side delay corresponding to the poor quality call record are determined, and a determination is made as to whether the radio side delay is greater than 232ms and whether the core side delay is greater than 154ms. If the radio side delay is greater than 232ms and the core side delay is greater than 154ms, the problem causing the poor quality call record is determined to be a core side problem and a radio side problem.

[0124] If the wireless side latency is greater than 232ms and the core side latency is less than or equal to 154ms, the problem causing the poor CDR quality is determined to be a wireless side issue.

[0125] If the wireless side latency is less than or equal to 232ms and the core side latency is greater than 154ms, the problem causing the poor CDR quality is determined to be a core-side issue.

[0126] If the wireless side latency is less than or equal to 232ms and the core side latency is less than or equal to 154ms, then in HTTP data transmission phase 22, the uplink average RTT and downlink average RTT corresponding to the poor quality call record are obtained, and a determination is made as to whether the uplink average RTT is greater than 200ms and whether the downlink average RTT is greater than 400ms. If the uplink average RTT is greater than 200ms and the downlink average RTT is greater than 400ms, it is determined that the problem causing the poor quality call record is a core side problem and a wireless side problem.

[0127] If the average uplink RTT is greater than 200ms and the average downlink RTT is less than or equal to 400ms, the problem causing the poor CDR quality is determined to be a core-side issue.

[0128] If the average uplink RTT is less than or equal to 200ms and the average downlink RTT is greater than 400ms, the problem causing the poor CDR quality is determined to be a wireless-side issue.

[0129] If the average uplink RTT is less than or equal to 200ms and the average downlink RTT is less than or equal to 400ms, it is determined that the problem causing the poor quality of the call record is an end-to-end problem.

[0130] Based on the above embodiment, in the service perception evaluation method provided in the embodiment of the present invention, the wireless side delay is determined based on the TCP link establishment confirmation delay of the TCP code stream corresponding to the poor quality call record during TCP link establishment, and the delay from the successful TCP link establishment to the first transaction request;

[0131] The core side delay is determined based on the TCP link establishment response delay of the TCP code stream corresponding to the poor quality call record when the TCP link is established, and the delay of the first HTTP response packet.

[0132] Specifically, in the embodiment of the present invention, the process of transmitting data via TCP protocol is as follows: Figure 3 As shown, SYN represents the synchronization sequence number (Synchronize Sequence Numbers), SYN.ACK represents the synchronization sequence number confirmation character (Synchronize Sequence Numbers Acknowledge character), ACK represents the confirmation character (Acknowledge character), GET represents the get request, TCP.No.1 (200OK) represents the first transaction request, TCP.No.2 represents the second transaction request, TCP.No.3 represents the third transaction request, and FIN.ACK represents the final confirmation character.

[0133] Among them, the right arrow indicates downlink, the left arrow indicates uplink, 1 indicates the TCP link establishment response delay, 2 indicates the TCP link establishment confirmation delay, 3 indicates the delay from successful TCP link establishment to the first transaction request, 4 indicates the delay from the first transaction request to its first response packet, 5 indicates the delay of the first HTTP response packet, 6 indicates the delay of the last HTTP content packet, and 7 indicates the delay of the last ACK confirmation packet.

[0134] In an embodiment of the present invention, the wireless side delay can be the sum of the TCP link establishment confirmation delay and the delay from the successful TCP link establishment to the first transaction request of the TCP code stream corresponding to the poor quality call record during TCP link establishment. The core side delay can be the sum of the TCP link establishment response delay and the first HTTP response packet delay of the TCP code stream corresponding to the poor quality call record during TCP link establishment.

[0135] To sum up, in the embodiment of the present invention, the mobile payment service is identified through the TCP code stream of the mobile payment service, and by decoding the characteristic field (Content-Length), the characteristic actions of the mobile payment service can be accurately identified: the code scanning stage, the payment confirmation stage, and the payment completion stage. By calculating the time required for the user to perform the service in each stage, the user's service perception is judged, and then the defined poor quality call record ratio is used to evaluate the user's network perception.

[0136] like Figure 4 As shown, based on the above embodiment, an embodiment of the present invention provides a service perception evaluation system, including:

[0137] An acquisition module 41 is configured to acquire a TCP stream from a user terminal, perform service identification on the TCP stream, and determine an XDR call record of a TCP session in a target service; the target service includes at least a mobile payment service;

[0138] A determination module 42 is configured to determine the start time and the end time of the perception impact phase of the target service based on the content length information carried by the TCP code stream in the XDR call record;

[0139] The evaluation module 43 is configured to perform a perception evaluation on the target service based on the start time and the end time of the perception impact phase.

[0140] On the basis of the above embodiment, in the service perception evaluation system provided in the embodiment of the present invention, the determination module is specifically configured to:

[0141] Determining the perception impact stage corresponding to the XDR call record based on content length information carried by the TCP code stream in the XDR call record;

[0142] Based on the transmission time of the TCP code stream in the XDR call record, the start time and end time of the perception impact phase corresponding to the XDR call record are determined.

[0143] On the basis of the above embodiment, in the service perception evaluation system provided in the embodiment of the present invention, the perception impact stage includes the code scanning stage, payment confirmation stage and payment completion stage of the mobile payment service;

[0144] Accordingly, the determining module is further specifically configured to:

[0145] If the content length information includes the downlink content length, and the downlink content length is the first value, determining that the perception impact stage is the code scanning stage;

[0146] If the content length information satisfies a first condition or a second condition, determining that the perception impact stage is the payment confirmation stage; the first condition is that the content length information includes an upstream content length and a downstream content length, and the upstream content length and the downstream content length are within a first preset range; the second condition is that the content length information includes a downstream content length, and the downstream content length is within a second preset range;

[0147] If the content length information satisfies a third condition or a fourth condition, determining that the perception impact stage is the payment completion stage; the third condition is that the content length information includes an upstream content length and a downstream content length, and the downstream content length is within a first preset range and the upstream content length is within a second preset range; the fourth condition is that the content length information includes an upstream content length and a downstream content length, and the downstream content length is the second value and the upstream content length is the third value;

[0148] Among them, any value within the first preset range is smaller than any value within the second preset range.

[0149] On the basis of the above embodiment, in the service perception evaluation system provided in the embodiment of the present invention, the user terminals include each user terminal in the target area; accordingly,

[0150] The evaluation module is specifically used to:

[0151] For any user terminal, if the difference between the end time and the start time corresponding to the any user terminal is greater than a first preset delay, determining that the XDR call record of the perception impact stage corresponding to the any user terminal is a poor quality call record;

[0152] If it is determined that the ratio of the first total number of poor-quality call records corresponding to each user terminal to the second total number of XDR call records corresponding to each user terminal is greater than a preset ratio, it is determined that the target service is a poor-quality service.

[0153] On the basis of the above embodiment, in the service perception evaluation system provided in the embodiment of the present invention, the perception impact stage corresponds to multiple XDR call records;

[0154] Accordingly, an analysis module is also included for:

[0155] Determine the wireless side delay, core side delay, uplink average RTT, and downlink average RTT corresponding to the poor quality call record;

[0156] If the core side delay is greater than the second preset delay, or the uplink average RTT is greater than the third preset delay, it is determined that the poor quality call record is caused by the core side;

[0157] If the wireless side delay is greater than the fourth preset delay, or the downlink average RTT is greater than the fifth preset delay, it is determined that the poor quality call record is caused by the wireless side.

[0158] Based on the above embodiment, in the service perception evaluation system provided in the embodiment of the present invention, the wireless side delay is determined based on the TCP link establishment confirmation delay of the TCP code stream corresponding to the poor quality call record during TCP link establishment, and the delay from the successful TCP link establishment to the first transaction request;

[0159] The core side delay is determined based on the TCP link establishment response delay of the TCP code stream corresponding to the poor quality call record when the TCP link is established, and the delay of the first HTTP response packet.

[0160] Specifically, the functions of each module in the business perception evaluation system provided in the embodiment of the present invention correspond one-to-one to the operating procedures of each step in the above-mentioned method embodiment, and the effects achieved are also consistent. Please refer to the above-mentioned embodiment for details, and no further details will be given in the embodiment of the present invention.

[0161] Figure 5 An example of a physical structure diagram of an electronic device is shown below. Figure 5 As shown, the electronic device may include: a processor 510, a communication interface 520, a memory 530, and a communication bus 540, wherein the processor 510, the communication interface 520, and the memory 530 communicate with each other via the communication bus 540. The processor 510 may call the logic instructions in the memory 530 to execute the service perception evaluation method provided in each of the above embodiments, which includes: obtaining a TCP code stream of a user terminal, performing service identification on the TCP code stream, and determining an XDR call record of a TCP session in a target service; the target service includes at least a mobile payment service; determining the start time and end time of the perception impact phase of the target service based on the content length information carried by the TCP code stream in the XDR call record; and performing a perception evaluation on the target service based on the start time and end time of the perception impact phase.

[0162] In addition, the logic instructions in the above-mentioned memory 530 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0163] On the other hand, the present invention also provides a computer program product, which includes a computer program, which can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the service perception evaluation method provided in the above embodiments, the method including: obtaining the TCP code stream of the user terminal, and performing service identification on the TCP code stream to determine the XDR call record of the TCP session in the target service; the target service includes at least a mobile payment service; based on the content length information carried by the TCP code stream in the XDR call record, determining the start time and end time of the perception impact phase of the target service; based on the start time and end time of the perception impact phase, performing a perception evaluation on the target service.

[0164] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the service perception evaluation method provided in the above-mentioned embodiments, the method comprising: obtaining the TCP code stream of the user terminal, and performing service identification on the TCP code stream to determine the XDR call record of the TCP session in the target service; the target service includes at least a mobile payment service; based on the content length information carried by the TCP code stream in the XDR call record, determining the start time and end time of the perception impact phase of the target service; based on the start time and end time of the perception impact phase, performing a perception evaluation on the target service.

[0165] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they may be located in one location or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0166] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, or of course, by hardware. Based on this understanding, the essence of the above technical solution or the part that contributes to the existing technology can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or certain parts of the embodiments.

[0167] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A service perception evaluation method, characterized in that: include: Obtain the TCP code stream of the user terminal, perform service identification on the TCP code stream, and determine the XDR call record of the TCP session in the target service; The target business at least includes mobile payment business; Determining, based on content length information carried by the TCP stream in the XDR call record, the start time and the end time of a perception impact phase of the target service; the perception impact phase refers to each phase of the target service in which there is a delay that affects perception of the target service; Performing a perception evaluation on the target service based on the start time and the end time of the perception impact phase; Determining the start time and end time of the perception impact phase of the target service based on the content length information carried by the TCP stream in the XDR call record specifically includes: Determining the perception impact stage corresponding to the XDR call record based on content length information carried by the TCP code stream in the XDR call record; Based on the transmission time of the TCP code stream in the XDR call record, the start time and end time of the perception impact phase corresponding to the XDR call record are determined.

2. The service perception evaluation method according to claim 1, characterized in that The perception impact stage includes the code scanning stage, payment confirmation stage and payment completion stage of the mobile payment service; Accordingly, determining the perception impact stage corresponding to the XDR call record based on the content length information carried by the TCP code stream in the XDR call record specifically includes: If the content length information includes the downlink content length, and the downlink content length is the first value, determining that the perception impact stage is the code scanning stage; If the content length information satisfies a first condition or a second condition, determining that the perception impact stage is the payment confirmation stage; the first condition is that the content length information includes an upstream content length and a downstream content length, and the upstream content length and the downstream content length are within a first preset range; the second condition is that the content length information includes a downstream content length, and the downstream content length is within a second preset range; If the content length information satisfies a third condition or a fourth condition, determining that the perception impact stage is the payment completion stage; the third condition is that the content length information includes an upstream content length and a downstream content length, and the downstream content length is within a first preset range and the upstream content length is within a second preset range; the fourth condition is that the content length information includes an upstream content length and a downstream content length, and the downstream content length is the second value and the upstream content length is the third value; Among them, any value within the first preset range is smaller than any value within the second preset range.

3. The service perception evaluation method according to any one of claims 1 to 2, characterized in that: The user terminals include each user terminal in the target area; accordingly, The performing a perception evaluation on the target service based on the start time and the end time of the perception impact phase specifically includes: For any user terminal, if the difference between the end time and the start time corresponding to the any user terminal is greater than a first preset delay, determining that the XDR call record of the perception impact stage corresponding to the any user terminal is a poor quality call record; If it is determined that the ratio of the first total number of poor-quality call records corresponding to each user terminal to the second total number of XDR call records corresponding to each user terminal is greater than a preset ratio, it is determined that the target service is a poor-quality service.

4. The service perception evaluation method according to claim 3, characterized in that: The perception impact stage corresponds to multiple XDR call records; Accordingly, the determining that the XDR call record in the perception impact stage corresponding to any user terminal is a poor quality call record further includes: Determine the wireless side delay, core side delay, uplink average RTT, and downlink average RTT corresponding to the poor quality call record; If the core side delay is greater than the second preset delay, or the uplink average RTT is greater than the third preset delay, it is determined that the poor quality call record is caused by the core side; If the wireless side delay is greater than the fourth preset delay, or the downlink average RTT is greater than the fifth preset delay, it is determined that the poor quality call record is caused by the wireless side.

5. The service perception evaluation method according to claim 4, characterized in that: The wireless side delay is determined based on the TCP link establishment confirmation delay of the TCP code stream corresponding to the poor quality call record when the TCP link is established, and the delay from the successful TCP link establishment to the first transaction request; The core side delay is determined based on the TCP link establishment response delay of the TCP code stream corresponding to the poor quality call record when the TCP link is established, and the delay of the first HTTP response packet.

6. A business perception evaluation system, characterized in that: include: An acquisition module is used to acquire a TCP stream from a user terminal, perform service identification on the TCP stream, and determine an XDR call record of a TCP session in a target service; the target service includes at least a mobile payment service; a determination module, configured to determine, based on content length information carried by the TCP stream in the XDR call record, a start time and an end time of a perception impact phase of the target service; the perception impact phase refers to each phase in the target service where there is a delay that affects perception of the target service; An evaluation module, configured to perform a perception evaluation on the target service based on the start time and the end time of the perception impact phase; The determining module is specifically configured to: Determining the perception impact stage corresponding to the XDR call record based on content length information carried by the TCP code stream in the XDR call record; Based on the transmission time of the TCP code stream in the XDR call record, the start time and end time of the perception impact phase corresponding to the XDR call record are determined.

7. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the steps of the service awareness evaluation method according to any one of claims 1 to 5 are implemented.

8. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the service awareness evaluation method according to any one of claims 1 to 5 are implemented.

9. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the service awareness evaluation method according to any one of claims 1 to 5 are implemented.

Images