Business perception evaluation method and system

Abstract

The present invention provides a service perception evaluation method and system, firstly obtaining the TCP code stream of the user terminal, and identifying whether the XDR call sheet corresponding to the TCP session in the TCP code stream carries the identification information of the target service; then determining the start time and end time of the perception impact phase of the target service according to the XDR call sheet carrying the identification information; finally, performing a perception evaluation on the target service according to the start time and end time of the perception impact phase. This fills the technical gap in the perception evaluation of the shared bicycle service, and can provide a theoretical basis for improving the user's perception of the shared bicycle service, thereby helping to increase the number of users. Moreover, by using the TCP code stream of the shared bicycle service, resources can be fully utilized. In the process of service perception evaluation, no additional equipment is required to implement the evaluation, which can save the evaluation cost. In addition, the TCP code stream is easy to obtain, which can improve the evaluation efficiency.

Description

Technical Field

[0001] The present invention relates to the field of communication technologies, and in particular to a service perception evaluation method and system. Background Art

[0002] At present, with the rapid development of mobile networks and smart terminals, people are paying more attention to the perception of target services while applying target services through mobile networks anytime and anywhere, for example, whether the target services can be successfully applied and whether the application of target services is smooth.

[0003] Taking the shared bicycle business as an example, the shared bicycle business is a time-sharing rental model and also a manifestation of a new green and environmentally friendly sharing economy. The shared bicycle business needs to rely on the bearer of the mobile network to be implemented. The various network service perception indicators of users using the shared bicycle business are the key basis for network optimization and maintenance engineers to evaluate the user's perceived experience and discover network problems in a timely manner. Therefore, a shared bicycle business perception evaluation method that can be implemented from the network side is needed. However, in the existing technology, there is no relevant technical solution to realize the evaluation of shared bicycle business perception.

[0004] Therefore, there is an urgent need to provide a business perception evaluation method. Summary of the invention

[0005] The present invention provides a service perception evaluation method and system to solve the defects in the prior art.

[0006] The present invention provides a service perception evaluation method, comprising:

[0007] Acquire a TCP code stream of a user terminal, and identify whether an XDR call record corresponding to a TCP session in the TCP code stream carries identification information of a target service, wherein the target service at least includes a shared bicycle service;

[0008] Determine the start time and end time of the perception impact phase of the target service based on the XDR call record carrying the identification information;

[0009] Based on the start time and the end time, a perceptual evaluation is performed on the target service.

[0010] According to a service perception evaluation method provided by the present invention, determining the start time and end time of the perception impact phase of the target service based on the XDR call record carrying the identification information specifically includes:

[0011] Determine the number of bytes of the upstream code stream in the XDR call record;

[0012] Determining the start time based on the number of bytes of the uplink code stream and the number of occurrences of the identification information in the XDR call record within a preset time period;

[0013] After the start time, the end time is determined based on the appearance time of the last TCP code stream carrying the identification information and having a preset length within a time window of a preset length.

[0014] According to a service perception evaluation method provided by the present invention, the determining of the start time based on the number of bytes of the uplink code stream and the number of occurrences of the identification information in the XDR call record within a preset time period specifically includes:

[0015] If the number of bytes of the uplink code stream is less than the preset number of bytes, the interference code stream in the XDR call record is removed to obtain the XDR call record to be marked;

[0016] If the number of occurrences of the identification information in the XDR call record to be marked within the preset time period is a preset number, the current time is determined as the start time.

[0017] According to a service perception evaluation method provided by the present invention, the user terminal includes each user terminal in a target area;

[0018] Accordingly, the perceptual evaluation of the target service based on the start time and the end time specifically includes:

[0019] For any user terminal, if the difference between the end time and the start time corresponding to any user terminal is greater than a first preset delay, determining that the XDR call record of the perception impact stage corresponding to any user terminal is a poor quality call record;

[0020] If it is determined that the ratio of the first total number of poor-quality call records corresponding to each user terminal to the second total number of XDR call records corresponding to each user terminal is greater than a preset ratio, it is determined that the target service is a poor-quality service.

[0021] According to a service perception evaluation method provided by the present invention, the perception impact stage corresponds to a plurality of XDR call records; accordingly,

[0022] The step of performing a perceptual evaluation on the target service based on the start time and the end time further includes:

[0023] If the evaluation result is that the target service is a poor quality service, obtaining a target XDR call record corresponding to the maximum round trip delay RTT in the perception impact stage;

[0024] Determine the wireless side delay, core side delay, uplink average RTT and downlink average RTT corresponding to the target XDR call record;

[0025] If the core side delay is greater than the second preset delay, or the uplink average RTT is greater than the third preset delay, it is determined that the target service is a poor quality service caused by the core side;

[0026] If the wireless side delay is greater than the fourth preset delay, or the downlink average RTT is greater than the fifth preset delay, it is determined that the target service is a poor quality service caused by the wireless side.

[0027] According to a service perception evaluation method provided by the present invention, the wireless side delay is determined based on the TCP link establishment confirmation delay of the TCP code stream corresponding to the target XDR call record when the TCP link is established, and the delay from the successful TCP link establishment to the first transaction request;

[0028] The core side delay is determined based on the TCP link establishment response delay of the TCP code stream corresponding to the target XDR call record during TCP link establishment, and the first HTTP response packet delay.

[0029] The present invention also provides a service perception evaluation system, comprising:

[0030] An acquisition module, used to acquire a TCP code stream of a user terminal, and identify whether an XDR call record corresponding to a TCP session in the TCP code stream carries identification information of a target service, wherein the target service at least includes a shared bicycle service;

[0031] A determination module, configured to determine the start time and the end time of the perception impact phase of the target service based on the XDR call record carrying the identification information;

[0032] An evaluation module is used to perform a perceptual evaluation on the target service based on the start time and the end time.

[0033] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of any of the above-mentioned business awareness evaluation methods are implemented.

[0034] The present invention also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above-mentioned service awareness evaluation methods are implemented.

[0035] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the steps of any of the above-mentioned service awareness evaluation methods are implemented.

[0036] The service perception evaluation method and system provided by the present invention first obtain the TCP code stream of the user terminal, and identify whether the XDR call sheet corresponding to the TCP session in the TCP code stream carries the identification information of the target service; then, according to the XDR call sheet carrying the identification information, the start time and the end time of the perception impact phase of the target service are determined; finally, according to the start time and the end time of the perception impact phase, the target service is perceived and evaluated. It fills the technical gap of the perception evaluation of the shared bicycle service, and can provide a theoretical basis for improving the user's perception of the shared bicycle service, thereby helping to increase the number of users. Moreover, by using the TCP code stream of the shared bicycle service, resources can be fully utilized. In the process of service perception evaluation, no additional equipment is required to implement the evaluation, which can save the evaluation cost. In addition, the TCP code stream is easy to obtain, which can improve the evaluation efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0038] Figure 1 This is one of the flow charts of the service perception evaluation method provided by the present invention;

[0039] Figure 2 This is the second flow chart of the service perception evaluation method provided by the present invention;

[0040] Figure 3 It is a schematic diagram of the process of transmitting data via the TCP protocol in the service perception evaluation method provided by the present invention;

[0041] Figure 4 It is a structural diagram of the business perception evaluation system provided by the present invention;

[0042] Figure 5 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0043] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0044] Figure 1 A flow chart of a service perception evaluation method provided in an embodiment of the present invention is shown in FIG. Figure 1 As shown, the method includes:

[0045] S1, obtaining a TCP code stream of a user terminal, and identifying whether an XDR call record corresponding to a TCP session in the TCP code stream carries identification information of a target service, wherein the target service at least includes a shared bicycle service;

[0046] S2, determining the start time and end time of the perception impact phase of the target service based on the XDR call record carrying the identification information;

[0047] S3: Perform a perceptual evaluation on the target service based on the start time and the end time.

[0048] Specifically, the service perception evaluation method provided in the embodiment of the present invention is executed by a server, which may be a cloud server. The server may implement the shared bicycle service perception evaluation method from the network side. Service perception refers to the user's perception when applying a certain service, that is, the user's experience of the service. Service perception evaluation is to evaluate whether the user is satisfied with the service, that is, to determine whether the service is a poor quality service or a high quality service.

[0049] First, execute step S1 to obtain the TCP code stream of the user terminal, and identify whether the XDR call record corresponding to the TCP session in the TCP code stream carries the identification information of the target service, and the target service at least includes the shared bicycle service. Among them, the user terminal can be any terminal device that uses the target service, and the number of user terminals can be one or all user terminals in the target area, which is not specifically limited in the embodiment of the present invention. The user terminal can be a smart phone with a scanning function.

[0050] The target service may be a service that transmits data using the TCP protocol. In the embodiment of the present invention, the target service may include at least a shared bicycle service, and the shared bicycle service may include the Qingju bicycle service, the Hello bicycle service, and the Meituan bicycle service, etc., which may be respectively implemented through the "Qingju Bicycle", "Hello Bicycle" and "Meituan Bicycle" and other application programs (Appl ication, APP) installed on the user terminal, or the "Qingju Bicycle", "Hello Bicycle" and "Meituan Bicycle" and other mini-programs embedded in WeChat, in combination with the cloud server to achieve communication with the bicycle. The most critical part is the process of unlocking the smart lock. Unlocking the smart lock can usually be achieved through Bluetooth, or through SMS or traffic.

[0051] Unlocking process of shared bicycle business by Bluetooth:

[0052] 1) The user terminal scans the QR code on the shared bicycle, and then the user terminal initiates an unlock request to the cloud server, which carries the bicycle information and user information. The cloud server verifies the user information and bicycle information, and then sends the authorization information to the user terminal. The bicycle information may include the ID information of the shared bicycle, and the user information may include the user's personal account information.

[0053] 2) The user terminal transmits the unlocking instruction and authorization information to the smart lock of the shared bicycle through the Bluetooth interface. The smart lock unlocks after verifying the unlocking instruction and authorization information, and notifies the user terminal of the successful unlocking information.

[0054] 3) The user terminal replies the unlocking success information to the cloud server, and the cloud server starts charging.

[0055] 4) During the user's riding process, the shared bicycle and the user terminal will report their respective GPS positioning information to the cloud server.

[0056] The Bluetooth method is used to realize the locking and returning process of the shared bicycle business:

[0057] 1) After the user locks the car, the smart lock notifies the user terminal via Bluetooth that the car is locked successfully.

[0058] 2) The user terminal then notifies the cloud server that the car has been locked successfully, and the cloud server sends the fee settlement information to the user terminal.

[0059] 3) The smart lock reports the location information after the user returns the car.

[0060] Using Bluetooth to unlock the smart lock by the user terminal can reduce the communication volume (communication charges) and power consumption of the smart lock. However, the stability and compatibility of Bluetooth cannot be fully guaranteed. Therefore, the traditional and power-consuming unlocking methods (manual password unlocking, GSM SMS or GPRS traffic unlocking) are often retained as alternatives.

[0061] Unlocking process via SMS or data traffic (with GPS function):

[0062] 1) The user terminal first scans the QR code on the shared bicycle, and then initiates an unlock request to the cloud server.

[0063] 2) The cloud server completes the verification of user information and bicycle information, and sends the unlocking command to the smart lock of the shared bicycle. After the smart lock is turned on, it replies to the cloud server that the unlocking is successful. It should be noted that when some shared bicycles report the unlocking information, the smart lock will also report the password or secret key for the next unlocking to the cloud server.

[0064] 3) The cloud server notifies the user terminal and starts billing.

[0065] 4) During the user's riding process, the shared bicycle and the user terminal will report their respective GPS positioning information to the cloud server.

[0066] The process of locking and returning the car via SMS or data traffic:

[0067] 1) After the user locks the car, the smart lock notifies the cloud server that the car has been returned successfully.

[0068] 2) The cloud server then notifies the user terminal and settles the fees.

[0069] 3) The smart lock reports the location information after the user returns the car.

[0070] The shared bicycle service uses the TCP protocol to transmit data, and the corresponding IP server address format can be IPv4 or IPv6. The service data of the shared bicycle service is encrypted and transmitted in the form of a TCP stream using the TLSv1.2 protocol. A TCP stream can include multiple TCP sessions, and each TCP session can correspond to an XDR call record, that is, a TCP session and an XDR call record have a one-to-one correspondence. Each TCP session can include multiple interactive TCP streams, referred to as interactive streams.

[0071] The identification information of the target service is used to identify the target service to distinguish it from other services. Taking Qingju Bicycle as an example, through service packet capture and data analysis by WireShark software, it can be seen that SeverName: star.xiaojukeji.com exists in the ClientHello signaling of TLSv1.2, so SeverName: star.xiaojukeji.com can be used as the identification information of Qingju Bicycle service.

[0072] If the XDR bill carries the identification information of the target service, it means that the XDR bill is the XDR bill of the target service, and the target service can be perceived and evaluated based on the XDR bill. If the XDR bill does not carry the identification information of the target service, it means that the XDR bill is not the XDR bill of the target service, and the target service cannot be perceived and evaluated based on the XDR bill.

[0073] Then, step S2 is executed to determine the start time and end time of the perception impact phase of the target service based on the XDR call record carrying the identification information. In the embodiment of the present invention, since the service perception focus of users using shared bicycles is mainly on the code scanning and unlocking phase, if the code scanning response unlocks quickly, then the perception is good, otherwise, it affects the user experience. Therefore, the perception impact phase in the embodiment of the present invention is the scanning and unlocking phase of the shared bicycle, the start time can be the time when the user starts scanning, and the end time can be the time when the smart lock of the shared bicycle is unlocked.

[0074] In the process of unlocking a Qingju bicycle, there will be multiple interactive code streams with the identification information SeverName: star.xiaojukeji.com, and these interactive code streams will form multiple XDR call records. The unlocking identification of Qingju bicycles can be performed based on these XDR call records. The complete process of unlocking and locking a Qingju bicycle is shown in Table 1. Protocol is the protocol, Source is the source address, that is, the address of the user terminal APP opened by the user or the address of the WeChat mini program, Destination is the destination address, that is, the smart lock address, Length is the length of the TCP code stream, Info is the signaling name, Server Name is the service name, that is, the identification information of the service, and Server Name Indication is the service name guidance.

[0075] Table 1 The complete process from unlocking to locking of Qingju bicycle

[0076]

[0077]

[0078] It can be seen from Table 1 that the scanning and unlocking stage is the code scanning stage, so the starting time of the scanning and unlocking stage is the starting time of the code scanning stage, which can be determined by the characteristics of the code scanning stage and the difference from the software opening stage, and the end time of the scanning and unlocking stage is the end time of the code scanning stage, which can be determined by the characteristics of the scanning stage and the difference from the car locking stage.

[0079] In the embodiment of the present invention, since the scanning and unlocking stage is a multi-stream collaborative information exchange unlocking, it is not possible to perform unlocking identification based on only one TCP code stream, and multiple TCP code streams need to be used for fitting, that is: multiple XRD bills generated by a scanning and unlocking business behavior are taken as a group, and combined analysis is performed to determine whether this business behavior has poor perception. Furthermore, determining the start time and end time of the scanning and unlocking stage through the XDR bill carrying identification information can include: first identifying the XDR bill corresponding to the scanning and unlocking stage from the XDR bill, and then determining the start time and end time of the perception impact stage of the target business through the XDR bill corresponding to the scanning and unlocking stage.

[0080] Finally, step S3 is executed to perform a perceptual evaluation on the target service according to the start time and end time of the perceptual impact phase. In the embodiment of the present invention, the difference between the end time and the start time can be determined, and the perceptual evaluation on the target service can be performed according to the size of the difference, that is, to determine whether the target service is a poor quality service.

[0081] If the target service is a poor-quality service, it means that the XDR call record corresponding to the perception impact stage is a poor-quality call record, and it can be determined that the perception of the target service is low and the user experience is poor. If the target service is a high-quality service, it means that the XDR call record corresponding to the perception impact stage is a high-quality call record, and it can be determined that the perception of the target service is high and the user experience is good.

[0082] The service perception evaluation method provided in the embodiment of the present invention first obtains the TCP code stream of the user terminal, and identifies whether the XDR call sheet corresponding to the TCP session in the TCP code stream carries the identification information of the target service; then, according to the XDR call sheet carrying the identification information, the start time and the end time of the perception impact phase of the target service are determined; finally, according to the start time and the end time of the perception impact phase, the target service is perceived and evaluated. It fills the technical gap in the perception evaluation of the shared bicycle service, and can provide a theoretical basis for improving the user's perception of the shared bicycle service, thereby helping to increase the number of users. Moreover, the use of the TCP code stream of the shared bicycle service can make full use of resources. In the process of service perception evaluation, no additional equipment is required to implement the evaluation, which can save the evaluation cost. In addition, the TCP code stream is easy to obtain, which can improve the evaluation efficiency.

[0083] On the basis of the above embodiment, the service perception evaluation method provided in the embodiment of the present invention, the determining the start time and the end time of the perception impact phase of the target service based on the XDR call record carrying the identification information, specifically includes:

[0084] Determine the number of bytes of the upstream code stream in the XDR call record;

[0085] Determining the start time based on the number of bytes of the uplink code stream and the number of occurrences of the identification information in the XDR call record within a preset time period;

[0086] After the start time, the end time is determined based on the appearance time of the last TCP code stream carrying the identification information and having a preset length within a time window of a preset length.

[0087] Specifically, in an embodiment of the present invention, when determining the start time and end time of the perception impact phase of the target service, the number of bytes of the uplink code stream in the XDR call record can be determined first. Then, based on the number of bytes of the uplink code stream and the number of occurrences of the identification information in the XDR call record within a preset time period, the start time of the perception impact phase is determined. Among them, the duration of the preset time period can be set as needed, for example, the preset time period can be set to 1s, and accordingly, the number of occurrences of the identification information in the XDR call record within the preset time period can be expressed as the number of occurrences of the identification information per unit time in the XDR call record. Here, it can be determined whether the number of bytes of the uplink code stream and the number of occurrences of the identification information in the XDR call record within the preset time period meet the requirements of the perception impact phase. If the requirements of the perception impact phase are met, the moment when the requirements are met can be determined as the start time of the perception impact phase.

[0088] After determining the start time, starting from the start time, determine the appearance time of the last TCP code stream carrying identification information and a preset length in a time window of a preset length, and determine the end time according to the appearance time. Prior to this, a downward time window T of a preset length can be established first, and then the appearance time of the last TCP code stream carrying identification information "Server Name: star.xiaojukeji.com" and a preset length in the time window of the preset length can be determined, and the appearance time can be used as the end time of the perception impact stage. Among them, the preset duration can be set as needed, for example, the preset duration can be set to 3 minutes, and this is not specifically limited in the embodiment of the present invention. The preset length can be 573. In the embodiment of the present invention, the above-mentioned appearance time can be directly used as the end time of the perception impact stage.

[0089] In the embodiment of the present invention, a specific method for determining the start time and the end time of the perception impact phase of the target service is provided, which provides a technical guarantee for the implementation of the solution.

[0090] On the basis of the above embodiment, the service perception evaluation method provided in the embodiment of the present invention, the determining of the start time based on the number of bytes of the uplink code stream and the number of occurrences of the identification information in the XDR call record within a preset time period, specifically includes:

[0091] If the number of bytes of the uplink code stream is less than the preset number of bytes, the interference code stream in the XDR call record is removed to obtain the XDR call record to be marked;

[0092] If the number of occurrences of the identification information in the XDR call record to be marked within the preset time period is a preset number, the current time is determined as the start time.

[0093] Specifically, in an embodiment of the present invention, when determining the start time of the perception impact phase of the target service, it can be determined whether the number of bytes of the uplink code stream is less than the preset number of bytes. If it is less than the preset number of bytes, the interference code stream in the XDR call record can be eliminated to obtain the XDR call record to be marked. Among them, the preset number of bytes can be set as needed, and here it can be set to a value such as 10000 bytes. The interference code stream can be a TCP code stream with a length (Length) of 240 in the XDR call record, that is, the interference code stream can be a TCP code stream carrying the identification information "Server Name: star.xiaojukeji.com" and a length of 240. After eliminating the interference code stream in the XDR call record, the XDR call record to be marked is obtained. The XDR call record to be marked indicates that it is required to use it to determine the start time and end time of the perception impact phase of the target service.

[0094] Then, if it is determined that the number of occurrences of the identification information in the XDR call record to be marked within the preset time period is a preset number, the current moment is determined to be the start time of the perception impact phase of the target service. Wherein, the preset number is greater than or equal to 4, that is, the number of occurrences of the identification information in the XDR call record to be marked within 1 second is at least 4 times, and the current moment that meets this condition can be determined as the start time of the perception impact phase of the target service.

[0095] On the basis of the above-mentioned embodiment, the service perception evaluation method provided in the embodiment of the present invention can determine that the time window ends if there are four consecutive data carrying the characteristic information "Server Name=pt-starimg.didistatic.com" within the time window of preset duration.

[0096] On the basis of the above-mentioned embodiment, in the service perception evaluation method provided in the embodiment of the present invention, the user terminal includes each user terminal in the target area;

[0097] Accordingly, the perceptual evaluation of the target service based on the start time and the end time specifically includes:

[0098] For any user terminal, if the difference between the end time and the start time corresponding to any user terminal is greater than a first preset delay, determining that the XDR call record of the perception impact stage corresponding to any user terminal is a poor quality call record;

[0099] If it is determined that the ratio of the first total number of poor-quality call records corresponding to each user terminal to the second total number of XDR call records corresponding to each user terminal is greater than a preset ratio, it is determined that the target service is a poor-quality service.

[0100] Specifically, in the embodiment of the present invention, a perception evaluation is performed on the target service, that is, it is determined whether the target service is a poor quality service or a high quality service. When the number of user terminals is one, the service perception evaluation result is the evaluation result given by the user terminal, and when the user terminals include each user terminal in the target area, the service perception evaluation result is the evaluation result given by all terminals in the target area.

[0101] When the number of user terminals is one, the difference between the end time and the start time of the perception impact phase can be determined first, and then the size relationship between the difference and the first preset delay can be compared. If the difference is greater than the first preset delay, it can be determined that the target service is a poor quality service. Among them, the first preset delay can be set as needed, for example, it can be set to 5s. It should be noted that the difference is actually the total service delay, which can be the sum of the TCP link establishment response delay, the TCP link establishment confirmation delay, the delay from TCP link establishment success to the first transaction request, and the delay of the last HTTP content packet.

[0102] When the user terminals include all user terminals in the target area, the server can first lock the user terminal through the user terminal ID (IMSI), and then use the TCP code stream of each user terminal to perceive and evaluate the target service respectively, and finally summarize the perception results corresponding to each user terminal.

[0103] For any user terminal in the target area, if the difference between the end time and the start time of the perception impact phase corresponding to the any user terminal is greater than the first preset delay, the XDR call record in the perception impact phase corresponding to the any user terminal is determined to be a poor quality call record. Further, a first total number of poor quality call records corresponding to each user terminal and a second total number of XDR call records corresponding to each user terminal can be calculated, and a ratio of the first total number to the second total number can be calculated, and the perception status of the target service in the target area can be judged according to the ratio.

[0104] If the ratio is greater than or equal to the preset ratio, it can be determined that the perception of the target service in the target area is good, that is, the user experience is good, otherwise it can be determined that the perception of the target service in the target area is poor, that is, the user experience is poor. The preset ratio can be set as needed, and this is not specifically limited in the embodiments of the present invention.

[0105] In the embodiment of the present invention, a method for judging the perception of a target service in a target area is provided, which can provide a theoretical basis for improving the perception of a shared bicycle service in the target area, thereby helping to increase the number of users.

[0106] On the basis of the above-mentioned embodiment, in the service perception evaluation method provided in the embodiment of the present invention, the perception impact stage corresponds to a plurality of XDR call records; accordingly,

[0107] The step of performing a perceptual evaluation on the target service based on the start time and the end time further includes:

[0108] If the evaluation result is that the target service is a poor quality service, obtaining a target XDR call record corresponding to the maximum round trip delay RTT in the perception impact stage;

[0109] Determine the wireless side delay, core side delay, uplink average RTT and downlink average RTT corresponding to the target XDR call record;

[0110] If the core side delay is greater than the second preset delay, or the uplink average RTT is greater than the third preset delay, it is determined that the target service is a poor quality service caused by the core side;

[0111] If the wireless side delay is greater than the fourth preset delay, or the downlink average RTT is greater than the fifth preset delay, it is determined that the target service is a poor quality service caused by the wireless side.

[0112] Specifically, in an embodiment of the present invention, the perception impact stage may correspond to multiple XDR call records, each XDR call record corresponds to a TCP session, and each TCP session contains multiple TCP code streams. On this basis, after the perception evaluation of the target service, subsequent processing can be performed according to the evaluation results. If the evaluation result is that the target service is a high-quality service, no processing is performed. If the evaluation result is that the target service is a low-quality service, the target XDR call record corresponding to the maximum round-trip time (RTT) in the perception impact stage can be further obtained. Among them, each XDR call record in the perception impact stage corresponds to a round-trip delay, and the round-trip delay of each XDR call record in the perception impact stage can be determined first, and then the XDR call record with the largest round-trip delay is selected from them, which is the target XDR call record.

[0113] Then, the wireless side delay, core side delay, uplink average RTT and downlink average RTT corresponding to the target XDR call sheet can be determined. Among them, the wireless side delay refers to the delay generated by the smart lock, the core side delay refers to the delay generated by the cloud server, the uplink average RTT refers to the average RTT generated by the data transmission process initiated by the smart lock in the target XDR call sheet, and the downlink average RTT refers to the average RTT generated by the data transmission process initiated by the cloud server in the target XDR call sheet.

[0114] If the core side delay is greater than the second preset delay, or the uplink average RTT is greater than the third preset delay, it can be determined that the target service is a poor quality service caused by the core side, that is, it can be identified as an S1-U upstream problem, a core side problem. The second preset delay and the third preset delay can be set as needed, for example, the second preset delay can be set to 154ms, and the third preset delay can be set to 200ms.

[0115] If the wireless side delay is greater than the fourth preset delay, or the downlink average RTT is greater than the fifth preset delay, it can be determined that the target service is a poor quality service caused by the wireless side, that is, it can be identified as an S1-U downstream problem, a wireless side problem. The fourth preset delay and the fifth preset delay can be set as needed, for example, the fourth preset delay can be set to 232ms, and the fifth preset delay can be set to 400ms.

[0116] Otherwise, if none of the above conditions are met, it is neither a core side problem nor a wireless side problem, then it can be determined that the poor quality of the target service is caused by the end-to-end transmission process, that is, it can be identified as an end-to-end problem.

[0117] In the embodiment of the present invention, specific values ​​of the first preset delay, the second preset delay, the third preset delay, the fourth preset delay and the fifth preset delay may be twice the average delay of each item in the entire network during method verification.

[0118] In an embodiment of the present invention, when it is determined that the target service is a poor quality service, the target XDR call record corresponding to the maximum round-trip delay RTT in the perception impact stage is first determined, and then the wireless side delay, core side delay, uplink average RTT and downlink average RTT of the target XDR call record are determined. By comparing the wireless side delay, core side delay, uplink average RTT and downlink average RTT with the corresponding given delay, the problem is determined, which can achieve rapid location of the problem, facilitating users to discover and solve the problem in a timely manner.

[0119] like Figure 2 FIG. 1 is a complete flow chart of a service perception evaluation method provided in an embodiment of the present invention, and the method includes:

[0120] 1) Obtain XDR call records for shared bicycle services;

[0121] 2) The scanning and unlocking stages of the shared bicycle business are grouped, and each group corresponds to a user terminal, or a scanning and unlocking behavior of the user terminal;

[0122] 3) Determine the total delay of each group and judge that if it is greater than 5s, the XDR call record in the group is determined to be a poor quality call record; otherwise, the XDR call record in the group is determined to be a high quality call record;

[0123] 4) When the XDR call record in the group is of poor quality, calculate the corresponding maximum RTT in the XDR call record in the group;

[0124] 5) Determine the target XDR call record corresponding to the maximum RTT;

[0125] 6) In the TCP establishment phase 21, the wireless side delay and the core side delay corresponding to the target XDR are determined, and it is judged whether the wireless side delay is greater than 232ms and whether the core side delay is greater than 154ms. If the wireless side delay is greater than 232ms and the core side delay is greater than 154ms, it is determined that the problem causing the XDR call record in the group to be a poor quality call record is a core side problem and a wireless side problem;

[0126] If the wireless side delay is greater than 232ms and the core side delay is less than or equal to 154ms, it is determined that the problem that causes the XDR call record in the group to be a poor quality call record is a wireless side problem;

[0127] If the wireless side delay is less than or equal to 232ms and the core side delay is greater than 154ms, it is determined that the problem that causes the XDR call record in the group to be a poor quality call record is a core side problem;

[0128] If the wireless side delay is less than or equal to 232ms and the core side delay is less than or equal to 154ms, then in TLS1.2 data transmission phase 22, obtain the uplink average RTT and downlink average RTT corresponding to the target XDR, and determine whether the uplink average RTT is greater than 200ms and whether the downlink average RTT is greater than 400ms. If the uplink average RTT is greater than 200ms and the downlink average RTT is greater than 400ms, it is determined that the problem that causes the XDR call record in the group to be a poor quality call record is a core side problem and a wireless side problem;

[0129] If the average uplink RTT is greater than 200ms and the average downlink RTT is less than or equal to 400ms, it is determined that the problem that causes the XDR call records in the group to be of poor quality is a core-side problem;

[0130] If the average uplink RTT is less than or equal to 200ms and the average downlink RTT is greater than 400ms, it is determined that the problem that causes the XDR call records in the group to be of poor quality is a problem on the wireless side.

[0131] If the average uplink RTT is less than or equal to 200ms and the average downlink RTT is less than or equal to 400ms, it is determined that the problem causing the XDR call records in the group to be of poor quality is an end-to-end problem.

[0132] On the basis of the above-mentioned embodiment, in the service perception evaluation method provided in the embodiment of the present invention, the wireless side delay is determined based on the TCP link establishment confirmation delay of the TCP code stream corresponding to the target XDR call record when the TCP link is established, and the delay from the successful TCP link establishment to the first transaction request;

[0133] The core side delay is determined based on the TCP link establishment response delay of the TCP code stream corresponding to the target XDR call record during TCP link establishment, and the first HTTP response packet delay.

[0134] Specifically, in the embodiment of the present invention, the process of transmitting data by TCP protocol is as follows: Figure 3 As shown, SYN represents the synchronization sequence number (Synchronize Sequence Numbers), SYN.ACK represents the synchronization sequence number confirmation character (Synchronize Sequence Numbers Acknowledge character), ACK represents the confirmation character (Acknowledge character), GET represents the get request, TCP.No.1 (200OK) represents the first transaction request, TCP.No.2 represents the second transaction request, TCP.No.3 represents the third transaction request, and FIN.ACK represents the final confirmation character.

[0135] Among them, the right arrow indicates downlink, the left arrow indicates uplink, 1 indicates the TCP link establishment response delay, 2 indicates the TCP link establishment confirmation delay, 3 indicates the delay from TCP link establishment success to the first transaction request, 4 indicates the delay from the first transaction request to its first response packet, 5 indicates the delay of the first HTTP response packet, 6 indicates the delay of the last HTTP content packet, and 7 indicates the delay of the last ACK confirmation packet.

[0136] In an embodiment of the present invention, the wireless side delay can be the sum of the TCP link establishment confirmation delay of the TCP code stream corresponding to the target XDR call record when the TCP link is established and the delay from the successful TCP link establishment to the first transaction request. The core side delay can be the sum of the TCP link establishment response delay of the TCP code stream corresponding to the target XDR call record when the TCP link is established and the delay of the first HTTP response packet.

[0137] To sum up, in the embodiment of the present invention, a service perception evaluation method is proposed through TCP code stream, and a corresponding algorithm is used to determine whether the driving time of the user is too long when using the shared bicycle service, and to determine the user's actual usage perception; it can be applied to real-time monitoring of single (multi-) user shared bicycle usage indicators, guide the implementation of relevant network optimization solutions, and ensure that users obtain good perception in real time. It can also be used for statistical analysis of single (multi-) user shared bicycle usage, and evaluate the shared bicycle service usage perception in multiple dimensions such as users or networks.

[0138] like Figure 4 As shown, based on the above embodiment, an embodiment of the present invention provides a service perception evaluation system, including:

[0139] The acquisition module 41 is used to acquire the TCP code stream of the user terminal and identify whether the XDR call record corresponding to the TCP session in the TCP code stream carries the identification information of the target service, and the target service at least includes the shared bicycle service;

[0140] A determination module 42, configured to determine a start time and an end time of a perception impact phase of the target service based on an XDR call record carrying the identification information;

[0141] The evaluation module 43 is used to perform a perceptual evaluation on the target service based on the start time and the end time.

[0142] On the basis of the above embodiments, in the service perception evaluation system provided in the embodiments of the present invention, the determination module is specifically used for:

[0143] Determine the number of bytes of the upstream code stream in the XDR call record;

[0144] Determining the start time based on the number of bytes of the uplink code stream and the number of occurrences of the identification information in the XDR call record within a preset time period;

[0145] After the start time, the end time is determined based on the appearance time of the last TCP code stream carrying the identification information and having a preset length within a time window of a preset length.

[0146] On the basis of the above embodiment, in the service perception evaluation system provided in the embodiment of the present invention, the determination module is further specifically used for:

[0147] If the number of bytes of the uplink code stream is less than the preset number of bytes, the interference code stream in the XDR call record is removed to obtain the XDR call record to be marked;

[0148] If the number of occurrences of the identification information in the XDR call record to be marked within the preset time period is a preset number, the current time is determined as the start time.

[0149] On the basis of the above embodiments, in the service perception evaluation system provided in the embodiments of the present invention, the evaluation module is specifically used for:

[0150] If the difference between the end time and the start time is greater than a first preset time delay, it is determined that the target service is a poor quality service.

[0151] On the basis of the above-mentioned embodiment, in the service perception evaluation system provided in the embodiment of the present invention, the perception impact stage corresponds to a plurality of XDR call records; accordingly, the service perception evaluation system further includes an analysis module for:

[0152] If the evaluation result is that the target service is a poor quality service, obtaining a target XDR call record corresponding to the maximum round trip delay RTT in the perception impact stage;

[0153] Determine the wireless side delay, core side delay, uplink average RTT and downlink average RTT corresponding to the target XDR call record;

[0154] If the core side delay is greater than the second preset delay, or the uplink average RTT is greater than the third preset delay, it is determined that the target service is a poor quality service caused by the core side;

[0155] If the wireless side delay is greater than the fourth preset delay, or the downlink average RTT is greater than the fifth preset delay, it is determined that the target service is a poor quality service caused by the wireless side.

[0156] On the basis of the above-mentioned embodiment, in the service perception evaluation system provided in the embodiment of the present invention, the wireless side delay is determined based on the TCP link establishment confirmation delay of the TCP code stream corresponding to the target XDR call record when the TCP link is established, and the delay from the successful TCP link establishment to the first transaction request;

[0157] The core side delay is determined based on the TCP link establishment response delay of the TCP code stream corresponding to the target XDR call record during TCP link establishment, and the first HTTP response packet delay.

[0158] Specifically, the functions of each module in the business perception evaluation system provided in the embodiment of the present invention correspond one-to-one to the operating procedures of each step in the above-mentioned method embodiment, and the effects achieved are also consistent. Please refer to the above-mentioned embodiment for details, and no further details will be given in the embodiment of the present invention.

[0159] Figure 5 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 5As shown, the electronic device may include: a processor 510, a communication interface 520, a memory 530 and a communication bus 540, wherein the processor 510, the communication interface 520 and the memory 530 communicate with each other through the communication bus 540. The processor 510 may call the logic instructions in the memory 530 to execute the service perception evaluation method provided in the above embodiments, the method comprising: obtaining the TCP code stream of the user terminal, and identifying whether the XDR call sheet corresponding to the TCP session in the TCP code stream carries the identification information of the target service, the target service at least including the shared bicycle service; based on the XDR call sheet carrying the identification information, determining the start time and end time of the perception impact phase of the target service; based on the start time and the end time, performing perception evaluation on the target service.

[0160] In addition, the logic instructions in the above-mentioned memory 530 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0161] On the other hand, the present invention also provides a computer program product, which includes a computer program, and the computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the service perception evaluation method provided in the above-mentioned embodiments, the method including: obtaining the TCP code stream of the user terminal, and identifying whether the XDR call record corresponding to the TCP session in the TCP code stream carries identification information of the target service, and the target service at least includes a shared bicycle service; based on the XDR call record carrying the identification information, determining the start time and end time of the perception impact phase of the target service; based on the start time and the end time, performing a perception evaluation on the target service.

[0162] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the service perception evaluation method provided in the above-mentioned embodiments, the method comprising: obtaining a TCP code stream of a user terminal, and identifying whether the XDR call record corresponding to the TCP session in the TCP code stream carries identification information of a target service, wherein the target service includes at least a shared bicycle service; based on the XDR call record carrying the identification information, determining the start time and end time of the perception impact phase of the target service; and based on the start time and the end time, performing a perception evaluation on the target service.

[0163] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0164] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0165] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A service perception evaluation method, characterized in that: include: Acquire a TCP code stream of a user terminal, and identify whether an XDR call record corresponding to a TCP session in the TCP code stream carries identification information of a target service, wherein the target service at least includes a shared bicycle service; Determine the start time and end time of the perception impact phase of the target service based on the XDR call record carrying the identification information; Based on the start time and the end time, performing a perceptual evaluation on the target service; The determining, based on the XDR call record carrying the identification information, the start time and the end time of the perception impact phase of the target service specifically includes: Determine the number of bytes of the upstream code stream in the XDR call record; Determining the start time based on the number of bytes of the uplink code stream and the number of occurrences of the identification information in the XDR call record within a preset time period; After the start time, the end time is determined based on the appearance time of the last TCP code stream carrying the identification information and having a preset length within a time window of a preset length; The determining the start time based on the number of bytes of the uplink code stream and the number of occurrences of the identification information in the XDR call record within a preset time period specifically includes: If the number of bytes of the uplink code stream is less than the preset number of bytes, the interference code stream in the XDR call record is removed to obtain the XDR call record to be marked; If the number of occurrences of the identification information in the XDR call record to be marked within the preset time period is a preset number, the current time is determined as the start time.

2. The service perception evaluation method according to claim 1, characterized in that: The user terminals include each user terminal in the target area; Accordingly, the perceptual evaluation of the target service based on the start time and the end time specifically includes: For any user terminal, if the difference between the end time and the start time corresponding to any user terminal is greater than a first preset delay, determining that the XDR call record of the perception impact stage corresponding to any user terminal is a poor quality call record; If it is determined that the ratio of the first total number of poor-quality call records corresponding to each user terminal to the second total number of XDR call records corresponding to each user terminal is greater than a preset ratio, it is determined that the target service is a poor-quality service.

3. The service perception evaluation method according to claim 2, characterized in that: The perception impact stage corresponds to a plurality of XDR call records; Accordingly, The step of performing a perceptual evaluation on the target service based on the start time and the end time further includes: If the evaluation result is that the target service is a poor quality service, obtaining a target XDR call record corresponding to the maximum round trip delay RTT in the perception impact stage; Determine the wireless side delay, core side delay, uplink average RTT and downlink average RTT corresponding to the target XDR call record; If the core side delay is greater than the second preset delay, or the uplink average RTT is greater than the third preset delay, it is determined that the target service is a poor quality service caused by the core side; If the wireless side delay is greater than the fourth preset delay, or the downlink average RTT is greater than the fifth preset delay, it is determined that the target service is a poor quality service caused by the wireless side.

4. The service perception evaluation method according to claim 3, characterized in that: The wireless side delay is determined based on the TCP link establishment confirmation delay of the TCP code stream corresponding to the target XDR call record when the TCP link is established, and the delay from the successful TCP link establishment to the first transaction request; The core side delay is determined based on the TCP link establishment response delay of the TCP code stream corresponding to the target XDR call record during TCP link establishment, and the first HTTP response packet delay.

5. A business perception evaluation system, characterized in that: include: An acquisition module, used to acquire a TCP code stream of a user terminal, and identify whether an XDR call record corresponding to a TCP session in the TCP code stream carries identification information of a target service, wherein the target service at least includes a shared bicycle service; A determination module, configured to determine the start time and the end time of the perception impact phase of the target service based on the XDR call record carrying the identification information; An evaluation module, configured to perform a perceptual evaluation on the target service based on the start time and the end time; The determining module is specifically used for: Determine the number of bytes of the upstream code stream in the XDR call record; Determining the start time based on the number of bytes of the uplink code stream and the number of occurrences of the identification information in the XDR call record within a preset time period; After the start time, the end time is determined based on the appearance time of the last TCP code stream carrying the identification information and having a preset length within a time window of a preset length; The determining module is further specifically used for: If the number of bytes of the uplink code stream is less than the preset number of bytes, the interference code stream in the XDR call record is removed to obtain the XDR call record to be marked; If the number of occurrences of the identification information in the XDR call record to be marked within the preset time period is a preset number, the current time is determined as the start time.

6. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the steps of the service awareness evaluation method according to any one of claims 1 to 4 are implemented.

7. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the service awareness evaluation method according to any one of claims 1 to 4 are implemented.

8. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the service awareness evaluation method according to any one of claims 1 to 4 are implemented.

Images