User network selection quality analysis method and system based on international roaming signaling

Abstract

The invention discloses a user network selection quality analysis method and system based on international roaming signaling, belongs to the technical field of communication network selection, and aims to solve the technical problem of how to efficiently and accurately analyze the network selection quality of roaming users. Comprising the following steps: collecting original signaling code stream data generated in an international roaming process in an operator network; based on the 3GPP international specification, analyzing the original signaling code stream data into a CDR call ticket of a readable text, and generating a CDR call ticket with attribute information; based on the CDR ticket and the attribute information, counting various preferred and non-preferred index data from the time dimension and the roaming direction dimension as basic indexes, and calculating a composite index based on the basic indexes to form an index system comprising the basic indexes and the composite index; and for each index in the index system, setting a threshold for the index, and automatically generating an alarm when a numerical value corresponding to the index exceeds the threshold.

Description

Technical Field

[0001] This invention relates to the field of network selection technology in communication networks, specifically to a user network selection quality analysis method and system based on international roaming signaling. Background Technology

[0002] In the telecommunications industry, operator communication networks comprise core networks, access networks, and terminals. Control plane signaling data is exchanged in real-time within the network, with the Location Update (LU) process being particularly crucial. This process involves a User Equipment (UE) reporting its current location to the network when entering a new Location Area (LA) or Routing Area (RA), ensuring the network can correctly locate the user. Simultaneously, it updates the user's location information in the Visited Location Register (VLR) and Home Location Register (HLR), enabling calls, SMS, and other services to be correctly routed to the user's current location. In international roaming scenarios, the location update process utilizes the local country operator's network. Therefore, the home operator can send interference signaling during the LU process to intervene in the user terminal's network selection, thereby ensuring the user terminal uses the roaming operator's network as desired by the home operator. This entire interference-based network selection process is also called the optimization process.

[0003] More and more business travelers and tourists have international roaming needs. Improving network quality for users while roaming and selecting high-quality, low-cost local network operators abroad require accurate analysis of the interference effects of location updates and optimization data for each roaming country and operator.

[0004] The LU process in 2G and 3G networks relies on MAP protocol data, while the LU process in 4G networks relies on Diameter protocol data. However, there is a lack of effective optimization analysis schemes for the LU process of MAP and Diameter protocols, and common analyses are limited to single signaling messages from a single user. Therefore, operators cannot understand the network selection and interference experienced by all users in roaming networks, and lack effective means to evaluate the networks of local operators abroad.

[0005] How to efficiently and accurately analyze the network selection quality of roaming users is a technical problem that needs to be solved. Summary of the Invention

[0006] The technical objective of this invention is to address the above-mentioned shortcomings by providing a method and system for analyzing the network selection quality of roaming users based on international roaming signaling, thereby solving the technical problem of how to efficiently and accurately analyze the network selection quality of roaming users.

[0007] In a first aspect, the present invention provides a user network selection quality analysis method based on international roaming signaling, comprising the following steps:

[0008] Signaling Acquisition: Collecting raw signaling stream data generated during international roaming in the operator's network. The raw signaling stream data is in binary form and includes signaling stream data of MAP protocol and Diameter protocol.

[0009] Signaling parsing: Based on 3GPP international standards, the original signaling code stream data is parsed into readable text CDR call detail records. During the parsing process, it is analyzed whether the signaling is triggered by the home operator's NTR platform of the roaming user, and the CDR call detail records are marked as whether they are triggered by NTR interference and whether they are the final record of NTR SDR or LU SDR. CDR call detail records with attribute information are generated, including NTR TDR, Normal TDR, NTR SDR and LU SDR.

[0010] Indicator Analysis: Based on CDR call detail records and attribute information, various preferred and non-priority indicator data are statistically analyzed from the time dimension and roaming direction dimension as basic indicators, and composite indicators are calculated based on the basic indicators to form an indicator system including basic indicators and composite indicators.

[0011] Indicator Alarm: For each indicator in the indicator system, a threshold is set for the indicator. When the value of the indicator exceeds the threshold, an alarm is automatically generated. The alarm guides the home operator to adjust the roaming network policy in a timely manner. The threshold includes static threshold and dynamic threshold, and the corresponding alarm includes static threshold alarm and dynamic threshold alarm events.

[0012] As a preferred method, NTR SDR is used to record a complete network optimization process. The generation rule is as follows: starting from the first NTR interference, continue to record subsequent NTR TDRs until a Normal TDR occurs or a timeout occurs, and finally output an NTR SDR record, and mark the optimization result type as success, failure or timeout.

[0013] LU SDR is used to record a complete location update process and whether the network optimization process is affected by NTR interference. The LUSDR generation rule is: starting from the first location update request, continuously record the relevant TDR until successful completion or timeout, and finally output a LU SDR record, and count the number of failures and NTR interferences in the process.

[0014] As preferred, the basic indicators include the number of GSM LU preferred requests, the number of successful GSM LU preferred requests, the number of failed GPRS LU preferred requests, and the number of timeouts for non-preferred LTE LU requests; correspondingly, the composite indicators include the GSM LU preferred network success rate, the GPRS LU preferred interference success rate, and the LTE LU non-preferred stability index.

[0015] Preferably, the static threshold is a fixed threshold used to determine whether an indicator is abnormal at a single moment.

[0016] The dynamic threshold is set based on the historical average or median, and allows for the configuration of deviation ranges to detect abnormal fluctuations in the indicator relative to historical trends.

[0017] Secondly, the present invention provides a user network selection quality analysis system based on international roaming signaling, comprising a signaling acquisition module, a signaling parsing module, an indicator analysis module, and an indicator alarm module;

[0018] The signaling acquisition module is used to perform the following: collect raw signaling stream data generated during international roaming in the operator's network. The raw signaling stream data is in binary form and includes signaling stream data of MAP protocol and Diameter protocol.

[0019] The signaling parsing module performs the following: Based on 3GPP international standards, it parses the original signaling code stream data into readable text CDR call detail records. During the parsing process, it analyzes whether the signaling is triggered by the home operator's NTR platform of the roaming user, and marks the CDR call detail records as either NTR interference triggering or the final record of NTR SDR or LU SDR. It then generates CDR call detail records with attribute information, including NTR TDR, NormalTDR, NTR SDR, and LUSDR.

[0020] The indicator analysis module is used to perform the following: Based on CDR call detail records and attribute information, it collects various preferred and non-priority indicator data from the time dimension and roaming direction dimension as basic indicators, and calculates composite indicators based on the basic indicators to form an indicator system including basic indicators and composite indicators.

[0021] The indicator alarm module is used to perform the following: For each indicator in the indicator system, a threshold is set for the indicator. When the value of the indicator exceeds the threshold, an alarm is automatically generated. The alarm guides the home operator to adjust the roaming network policy in a timely manner. The threshold includes static threshold and dynamic threshold, and the corresponding alarm includes static threshold alarm and dynamic threshold alarm events.

[0022] As a preferred method, NTR SDR is used to record a complete network optimization process. The generation rule is as follows: starting from the first NTR interference, continue to record subsequent NTR TDRs until a Normal TDR occurs or a timeout occurs, and finally output an NTR SDR record, and mark the optimization result type as success, failure or timeout.

[0023] LU SDR is used to record a complete location update process and whether the network optimization process is affected by NTR interference. The LUSDR generation rule is: starting from the first location update request, continuously record the relevant TDR until successful completion or timeout, and finally output a LU SDR record, and count the number of failures and NTR interferences in the process.

[0024] As preferred, the basic indicators include the number of GSM LU preferred requests, the number of successful GSM LU preferred requests, the number of failed GPRS LU preferred requests, and the number of timeouts for non-preferred LTE LU requests; correspondingly, the composite indicators include the GSM LU preferred network success rate, the GPRS LU preferred interference success rate, and the LTE LU non-preferred stability index.

[0025] Preferably, the static threshold is a fixed threshold used to determine whether an indicator is abnormal at a single moment.

[0026] The dynamic threshold is set based on the historical average or median, and allows for the configuration of deviation ranges to detect abnormal fluctuations in the indicator relative to historical trends.

[0027] The user network selection quality analysis method and system based on international roaming signaling of the present invention has the following advantages: Based on the signaling data of the location update process in the operator's network, it analyzes and forms interference-related CDR call detail record attributes, accurately counts the LU optimization process of roaming users, thereby creating an indicator system for the optimization process, and finally forming indicator alarms. The home operator of the roaming user can clearly understand the user's network selection situation abroad. By statistically analyzing the service indicators of the optimization process and non-optimization process in different roaming directions, it can understand the overall network access quality of roaming users, whether network interference has reached the expected target, etc., and promptly detect network problems in the roaming location. It is an effective means for operators to improve roaming network quality, resolve roaming user complaints, and optimize the selection of operators in the roaming location. Attached Figure Description

[0028] To more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0029] The invention will be further described below with reference to the accompanying drawings.

[0030] Figure 1 This is a flowchart of a user network selection quality analysis method based on international roaming signaling, as described in Example 1.

[0031] Figure 2This is a schematic diagram of the MAP protocol optimization process in a user network selection quality analysis method based on international roaming signaling, as described in Example 1.

[0032] Figure 3 This is a schematic diagram of the Diameter protocol optimization process in a user network selection quality analysis method based on international roaming signaling, as described in Example 1.

[0033] Figure 4 This is a schematic diagram of the non-optimal LUResponse structure in a user network selection quality analysis method based on international roaming signaling in Example 1;

[0034] Figure 5 This is a schematic diagram of the preferred NTR SDR process in a user network selection quality analysis method based on international roaming signaling in Example 1;

[0035] Figure 6 This is the LU state diagram in Example 1, a user network selection quality analysis method based on international roaming signaling;

[0036] Where A represents the number of LU requests, B, C, D, and E represent different LU results, and F represents the number of LUs triggered or affected by NTR. Detailed Implementation

[0037] The present invention will be further described below with reference to the accompanying drawings and specific embodiments, so that those skilled in the art can better understand and implement the present invention. However, the embodiments are not intended to limit the present invention. In the absence of conflict, the embodiments of the present invention and the technical features in the embodiments can be combined with each other.

[0038] This invention provides a method and system for analyzing the network selection quality of roaming users based on international roaming signaling, which solves the technical problem of how to efficiently and accurately analyze the network selection quality of roaming users.

[0039] Example 1:

[0040] This invention provides a user network selection quality analysis method based on international roaming signaling, such as... Figure 1 The process includes four steps: signaling acquisition, signaling parsing, indicator analysis, and indicator alarms.

[0041] Step S100 Signaling Acquisition: Collect the raw signaling code stream data generated during international roaming in the operator's network. The raw signaling code stream data is in binary form and includes signaling code stream data of MAP protocol and Diameter protocol.

[0042] like Figure 2 The preferred procedure for the MAP protocol shown is as follows:

[0043] (1) When a user logs into the VLR, a UL (login) message is sent and transmitted to the HLR via ISTP;

[0044] (2) When the preferred platform determines that the user is not allowed to access the network of this operator, the platform will send a reject (with error) message to the VLR.

[0045] like Figure 3 As shown, the optimization process of the Diameter protocol is as follows:

[0046] (1) When a user logs into the MME, he / she sends a ULR (Login Request) message to the HSS, and the HSS replies to the MME with a ULA (Login Response) message.

[0047] (2) The preferred system can terminate the user's network access request by sending a CLR (Cancel User Login) message or an IDR (Insert User Information) message (carrying virtual APN parameters), thereby guiding the user to register on the preferred network.

[0048] Step S200 Signaling Parsing: Based on 3GPP international standards, the original signaling code stream data is parsed into readable text CDR call detail records. During the parsing process, it is analyzed whether the signaling is triggered by the home operator's NTR platform of the roaming user, and the CDR call detail records are marked as whether they are triggered by NTR interference and whether they are the final record of NTR SDR or LU SDR. CDR call detail records with attribute information are generated, including NTR TDR, Normal TDR, NTR SDR and LU SDR.

[0049] Among them, NTR SDR is used to record a complete network optimization process. The generation rule is: starting from the first NTR interference, continue to record subsequent NTR TDRs until a Normal TDR occurs or a timeout occurs, and finally output an NTR SDR record, and mark the optimization result type as success, failure or timeout. LU SDR is used to record a complete location update process, whether the network optimization process is affected by NTR interference. The LU SDR generation rule is: starting from the first location update request, continue to record relevant TDRs until successful completion or timeout, and finally output an LU SDR record, and count the number of failures and NTR interferences in the process.

[0050] In this embodiment, this step involves collecting the raw bitstream from the communication network and parsing it into a CDR (Call Detail Record) for data from the MAP and Diameter protocols. This process converts the binary data into readable text-based CDR call detail record data. During parsing, four main attribute categories of the CDR call detail record are simultaneously analyzed and identified: NTR TDR, Normal TDR, NTR SDR, and LU SDR. These concepts are explained below.

[0051] NTR TDR: Call detail records generated by CLR (Cancellocation), ISD (Insert Subscriber Data), and ULR (Update location) that are interfered with by NTR platforms.

[0052] Normal TDR: Non-NTR triggered, or XDR unrelated to preference.

[0053] NTR SDR: Represents the entire process of a selection process, the last record after the selection process ends, is_ntr_sdr is set to 1, and records the relevant status during this selection process.

[0054] LU SDR: Represents a complete LU process for the user, the last record at the end of the LU process, is_lu_sdr is set to 1, and the relevant states during this LU process are also recorded.

[0055] If a roaming user's network selection is not influenced by their home carrier, it is considered a non-preferred network. A non-preferred LU TDR record itself has three possible response results, such as... Figure 4 The results shown represent success, error, and timeout, respectively.

[0056] If a roaming user's network selection is interfered with by their home carrier, this is called network preference selection. The NTR SDR preference selection process is as follows: Figure 5 As shown.

[0057] This embodiment involves NTR SDR analysis rules, which can be divided into two cases: normal and special cases, depending on the different termination conditions of NTR SDR.

[0058] ordinary:

[0059] 1.NTR reject: is_ntr_tdr=Yes(F)

[0060] 2.NTR reject: is_ntr_tdr=Yes(F)

[0061] 3.NTR reject: is_ntr_tdr=Yes(F) ......

[0063] n.is_normal_tdr=Yes&is_ntr_sdr=Yes(Succ / non-NTR failure) or is_normal_tdr=no&is_ntr_sdr=Yes(Timeout)

[0064] The explanation is as follows:

[0065] 1. The process of creating an NTR SDR begins with the first NTR interference and continues until the nth condition is met, at which point the NTR SDR is output.

[0066] 2. Classification of the nth TDR (i.e., NTR SDR) results:

[0067] (1)Succ: n TDRs (of which n-1 NTR TDRs and 1 normal TDR), 1 SDR; that is, n-1 Fs and 1 B. At this time, is_normal_tdr = Yes and is_ntr_sdr = Yes.

[0068] (2) Non-NTR failure:

[0069] (2-1) Non-NTR error: n TDRs (including n-1 NTR TDRs and 1 normal TDR), 1 SDR; that is, n-1 Fs and 1 C or E. In this case, is_normal_tdr = Yes and is_ntr_sdr = Yes.

[0070] (2-2) Non-NTR timeout: n TDRs (including n-1 NTR TDRs and 1 normal TDR), 1 SDR; that is, n-1 Fs and 1 D. At this time, is_normal_tdr = Yes and is_ntr_sdr = Yes.

[0071] (3) Timeout: n-1 TDRs (n-1 NTR TDRs), 1 SDR; that is, n-1 Fs, no normal TDRs, because the last record after the timeout is not a TDR (not a signaling stream creation, but an SDR record output by the probe according to the timer timeout). At this time, is_normal_tdr = no, is_ntr_sdr = Yes (Note: the probe's timer is 1200s).

[0072] Special case (n = 3 succ)

[0073] 1.NTR reject: is_ntr_tdr=Yes(F)

[0074] 2.NTR reject: is_ntr_tdr=Yes(F)

[0075] 3.Succ: is_ntr_tdr=Yes(B)&is_ntr_sdr=Yes

[0076] In the case of the third SUCC, there was an NTR, but the NTR failed, and the Steering process was successful.

[0077] The results were 3 TDRs, all of which were NTR TDRs, 1 SDR, 2 Fs, and 1 B.

[0078] This embodiment involves generating an NTR SDR and outputting proprietary analysis attributes in the call detail record (CDR): the analysis includes "whether it is an NTR TDR", "whether it is an NTR SDR", "start time of the NTR session", "duration of the NTR session", "number of interferences in the NTR session", "whether it is a Normal TDR", and "result of NTR cancellation of location update".

[0079] This embodiment involves LU SDR analysis rules. The LU SDR process is as follows:

[0080] 1.error / timeout: is_normal_tdr=Yes(C / D / E) or is_ntr_tdr=Yes(F)

[0081] 2.error / timeout: is_normal_tdr=Yes(C / D / E) or is_ntr_tdr=Yes(F)

[0082] 3.error / timeout: is_normal_tdr=Yes(C / D / E) or is_ntr_tdr=Yes(F) ......

[0084] n.Succ: is_normal=Yes(B)&is_lu_sdr=Yes(Succ)

[0085] Timeout: is_lu_sdr=Yes(timeout)

[0086] The process of creating an NTR SDR begins with the first NTR interference and continues until the nth condition is met, at which point the NTR SDR is output.

[0087] Classification of the nth TDR (i.e., LU SDR) result:

[0088] (1) Succ: n TDRs, 1 SDR, i.e., n-1 C / D / E / Fs, 1 B. At this time, is_normal_tdr = Yes, is_lu_sdr = Yes.

[0089] (2) Timeout: n-1 TDRs, i.e. n-1 C / D / E / Fs, no normal TDR, because the last record after the timeout is not a TDR (not a signaling stream creation, but only an SDR record output by the probe according to the timer timeout). At this time, is_normal_tdr = no, is_lu_sdr = Yes. (Note: The probe's timer is 3600s).

[0090] This embodiment involves generating LU SDRs and outputting proprietary analysis attributes in the call detail record (CDR): the analysis includes "whether it is an LUSDR", "start time of the LU session", "flow result of the LU session", "duration of the LU session", "total number of failures in the LU session", "number of NTRs in the LU session", "whether the LU session is NTR triggered", and "whether it is a Normal TDR".

[0091] Step S300 Indicator Analysis: Based on CDR call detail records and attribute information, various preferred and non-preferred indicator data are statistically analyzed from the time dimension and roaming direction dimension as basic indicators, and composite indicators are calculated based on the basic indicators to form an indicator system including basic indicators and composite indicators.

[0092] The basic indicators include the number of GSM LU preferred requests, the number of successful GSM LU preferred requests, the number of failed GPRS LU preferred requests, and the number of timeouts for non-preferred LTE LU requests. Correspondingly, the composite indicators include the success rate of GSM LU preferred network, the success rate of GPRS LU preferred interference, and the stability index of non-preferred LTE LU requests.

[0093] In this embodiment, this step utilizes the attribute information of the CDR (Call Detail Record) to statistically analyze various preferred and non-preferred indicator data based on the time dimension (5 minutes, 15 minutes, hour, day, week, month) and the roaming direction (home country, home operator, home province, roaming country, roaming operator, roaming province). Due to the large volume of user roaming data, big data technology is employed for processing. HDFS stores the CDR data, Spark serves as the computing engine for indicator data calculation, and Sqoop technology imports the aggregated indicator data into a relational database for convenient front-end querying.

[0094] Based on the CDR (Call Detail Record) attributes parsed in roaming signaling analysis, this paper focuses on building an indicator system based on interference attributes, encompassing three main categories: GSM, GPRS, and LTE. Each category includes basic indicators and composite indicators. Basic indicators refer to those derived from CDR statistics, such as "Number of GSM LU (Local Area Optimization) Requests." Composite indicators are those calculated based on basic indicators, such as "GSM LU Optimization Network Success Rate" = (Number of Successful GSM LU Optimizations + Number of GSM LU Optimization RNA Requests) / Number of GSM LU Optimization Requests * 100%.

[0095] Step S400 Indicator Alarm: For each indicator in the indicator system, a threshold is set for the indicator. When the value of the indicator exceeds the threshold, an alarm is automatically generated. The alarm guides the home operator to adjust the roaming network policy in a timely manner. The threshold includes static threshold and dynamic threshold, and the corresponding alarm includes static threshold alarm and dynamic threshold alarm events.

[0096] Among them, the static threshold is a fixed threshold used to determine whether the indicator is abnormal at a single moment; the dynamic threshold is set based on the historical average or median, and allows the deviation range to be configured, used to detect abnormal fluctuations of the indicator relative to the historical trend.

[0097] In this embodiment, after processing the obtained indicator data, alarm thresholds can be set for the indicators. Indicators exceeding the alarm thresholds will generate alarms. Alarms are divided into static threshold alarms and dynamic threshold alarms.

[0098] Static alarm thresholds are triggered when a metric in a roaming direction exceeds or falls below a fixed value. For example, an alarm might be triggered if a user roaming to Singapore has more than 100 "GSM LU Preferred Requests" and a "GSM LU Preferred Network Success Rate" of less than 98%.

[0099] Dynamic threshold alarms are triggered when a metric in a roaming direction deviates from its historical average (or median) by a certain margin. For example, an alarm is triggered if the "GSM LU Preferred Network Success Rate" for a user roaming to Singapore is less than 80% of the average "GSM LU Preferred Network Success Rate" over the past four time periods.

[0100] Through the alarm function, operators can promptly grasp the network selection status of users in a certain roaming direction.

[0101] The method in this embodiment establishes an efficient and accurate roaming signaling analysis scheme, builds an effective indicator analysis system, and generates indicator alarms in a timely manner.

[0102] Example 2:

[0103] This invention discloses a user network selection quality analysis system based on international roaming signaling, comprising a signaling acquisition module, a signaling parsing module, an indicator analysis module, and an indicator alarm module.

[0104] The signaling acquisition module is used to perform the following: collect raw signaling code stream data generated during international roaming in the operator's network. The raw signaling code stream data is in binary form and includes signaling code stream data of MAP protocol and Diameter protocol.

[0105] The optimization process for the MAP protocol is as follows:

[0106] (1) When a user logs into the VLR, a UL (login) message is sent and transmitted to the HLR via ISTP;

[0107] (2) When the preferred platform determines that the user is not allowed to access the network of this operator, the platform will send a reject (with error) message to the VLR.

[0108] The optimization process for the Diameter protocol is as follows:

[0109] (1) When a user logs into the MME, he / she sends a ULR (Login Request) message to the HSS, and the HSS replies to the MME with a ULA (Login Response) message.

[0110] (2) The preferred system can terminate the user's network access request by sending a CLR (Cancel User Login) message or an IDR (Insert User Information) message (carrying virtual APN parameters), thereby guiding the user to register on the preferred network.

[0111] The signaling parsing module performs the following: Based on 3GPP international standards, it parses the original signaling code stream data into readable text CDR call detail records. During the parsing process, it analyzes whether the signaling is triggered by the roaming user's home operator NTR platform, and marks the CDR call detail records as either NTR interference triggering or the final record of NTR SDR or LU SDR. It then generates CDR call detail records with attribute information, including NTR TDR, Normal TDR, NTR SDR, and LUSDR.

[0112] Among them, NTR SDR is used to record a complete network optimization process. The generation rule is: starting from the first NTR interference, continue to record subsequent NTR TDRs until a Normal TDR occurs or a timeout occurs, and finally output an NTR SDR record, and mark the optimization result type as success, failure or timeout. LU SDR is used to record a complete location update process, whether the network optimization process is affected by NTR interference. The LU SDR generation rule is: starting from the first location update request, continue to record relevant TDRs until successful completion or timeout, and finally output an LU SDR record, and count the number of failures and NTR interferences in the process.

[0113] In this embodiment, the module collects the raw bitstream from the communication network for MAP and Diameter protocol data. When parsing it into CDR call detail records, it converts the binary data into readable text CDR call detail record data. During the parsing process, it simultaneously analyzes and identifies four main attribute categories of the CDR call detail records: NTR TDR, Normal TDR, NTR SDR, and LU SDR. The concepts are explained below.

[0114] NTR TDR: Call detail records generated by CLR (Cancellocation), ISD (Insert Subscriber Data), and ULR (Update location) that are interfered with by NTR platforms.

[0115] Normal TDR: Non-NTR triggered, or XDR unrelated to preference.

[0116] NTR SDR: Represents the entire process of a selection process, the last record after the selection process ends, is_ntr_sdr is set to 1, and records the relevant status during this selection process.

[0117] LU SDR: Represents a complete LU process for the user, the last record at the end of the LU process, is_lu_sdr is set to 1, and the relevant states during this LU process are also recorded.

[0118] If a roaming user's network selection is not influenced by their home carrier, it is considered a non-preferred network. A non-preferred LU TDR record itself has three possible response results, such as... Figure 4 The results shown represent success, error, and timeout, respectively.

[0119] If a roaming user is interfered with by their home carrier when selecting a network, this is called preferred network selection.

[0120] This embodiment involves NTR SDR analysis rules, which can be divided into two cases: normal and special cases, depending on the different termination conditions of NTR SDR.

[0121] ordinary:

[0122] 1.NTR reject: is_ntr_tdr=Yes(F)

[0123] 2.NTR reject: is_ntr_tdr=Yes(F)

[0124] 3.NTR reject: is_ntr_tdr=Yes(F) ......

[0126] n.is_normal_tdr=Yes&is_ntr_sdr=Yes(Succ / non-NTR failure) or is_normal_tdr=no&is_ntr_sdr=Yes(Timeout)

[0127] The explanation is as follows:

[0128] 1. The process of creating an NTR SDR begins with the first NTR interference and continues until the nth condition is met, at which point the NTR SDR is output.

[0129] 2. Classification of the nth TDR (i.e., NTR SDR) results:

[0130] (1)Succ: n TDRs (of which n-1 NTR TDRs and 1 normal TDR), 1 SDR; that is, n-1 Fs and 1 B. At this time, is_normal_tdr = Yes and is_ntr_sdr = Yes.

[0131] (2) Non-NTR failure:

[0132] (2-1) Non-NTR error: n TDRs (including n-1 NTR TDRs and 1 normal TDR), 1 SDR; that is, n-1 Fs and 1 C or E. In this case, is_normal_tdr = Yes and is_ntr_sdr = Yes.

[0133] (2-2) Non-NTR timeout: n TDRs (including n-1 NTR TDRs and 1 normal TDR), 1 SDR; that is, n-1 Fs and 1 D. At this time, is_normal_tdr = Yes and is_ntr_sdr = Yes.

[0134] (3) Timeout: n-1 TDRs (n-1 NTR TDRs), 1 SDR; that is, n-1 Fs, no normal TDRs, because the last record after the timeout is not a TDR (not a signaling stream creation, but an SDR record output by the probe according to the timer timeout). At this time, is_normal_tdr = no, is_ntr_sdr = Yes (Note: the probe's timer is 1200s).

[0135] Special case (n = 3 succ)

[0136] 1.NTR reject: is_ntr_tdr=Yes(F)

[0137] 2.NTR reject: is_ntr_tdr=Yes(F)

[0138] 3.Succ: is_ntr_tdr=Yes(B)&is_ntr_sdr=Yes

[0139] In the case of the third SUCC, there was an NTR, but the NTR failed, and the Steering process was successful.

[0140] The results were 3 TDRs, all of which were NTR TDRs, 1 SDR, 2 Fs, and 1 B.

[0141] This embodiment involves generating an NTR SDR and outputting proprietary analysis attributes in the call detail record (CDR): the analysis includes "whether it is an NTR TDR", "whether it is an NTR SDR", "start time of the NTR session", "duration of the NTR session", "number of interferences in the NTR session", "whether it is a Normal TDR", and "result of NTR cancellation of location update".

[0142] This embodiment involves LU SDR analysis rules. The LU SDR process is as follows:

[0143] 1.error / timeout: is_normal_tdr=Yes(C / D / E) or is_ntr_tdr=Yes(F)

[0144] 2.error / timeout: is_normal_tdr=Yes(C / D / E) or is_ntr_tdr=Yes(F)

[0145] 3.error / timeout: is_normal_tdr=Yes(C / D / E) or is_ntr_tdr=Yes(F) ......

[0147] n.Succ: is_normal=Yes(B)&is_lu_sdr=Yes(Succ)

[0148] Timeout: is_lu_sdr=Yes(timeout)

[0149] The process of creating an NTR SDR begins with the first NTR interference and continues until the nth condition is met, at which point the NTR SDR is output.

[0150] Classification of the nth TDR (i.e., LU SDR) result:

[0151] (1) Succ: n TDRs, 1 SDR, i.e., n-1 C / D / E / Fs, 1 B. At this time, is_normal_tdr = Yes, is_lu_sdr = Yes.

[0152] (2) Timeout: n-1 TDRs, i.e. n-1 C / D / E / Fs, no normal TDR, because the last record after the timeout is not a TDR (not a signaling stream creation, but only an SDR record output by the probe according to the timer timeout). At this time, is_normal_tdr = no, is_lu_sdr = Yes. (Note: The probe's timer is 3600s).

[0153] This embodiment involves generating LU SDRs and outputting proprietary analysis attributes in the call detail record (CDR): the analysis includes "whether it is an LUSDR", "start time of the LU session", "flow result of the LU session", "duration of the LU session", "total number of failures in the LU session", "number of NTRs in the LU session", "whether the LU session is NTR triggered", and "whether it is a Normal TDR".

[0154] The indicator analysis module is used to perform the following: Based on CDR call detail records and attribute information, it collects various preferred and non-priority indicator data from the time dimension and roaming direction dimension as basic indicators, and calculates composite indicators based on the basic indicators to form an indicator system including basic indicators and composite indicators.

[0155] The basic indicators include the number of GSM LU preferred requests, the number of successful GSM LU preferred requests, the number of failed GPRS LU preferred requests, and the number of timeouts for non-preferred LTE LU requests. Correspondingly, the composite indicators include the success rate of GSM LU preferred network, the success rate of GPRS LU preferred interference, and the stability index of non-preferred LTE LU requests.

[0156] In this embodiment, this module uses the attribute information of CDR call detail records (CDRs) to perform statistical analysis of various preferred and non-preferred indicators based on time dimensions (5 minutes, 15 minutes, hours, days, weeks, and months) and roaming direction (home country, home operator, home province, roaming country, roaming operator, and roaming province). Due to the large volume of user roaming data, big data technology is employed for processing. HDFS stores the CDR CDR data, Spark serves as the computing engine for indicator calculations, and Sqoop technology imports the aggregated indicator data into a relational database for easy querying by the front-end functions.

[0157] Based on the CDR (Call Detail Record) attributes parsed in roaming signaling analysis, this paper focuses on building an indicator system based on interference attributes, encompassing three main categories: GSM, GPRS, and LTE. Each category includes basic indicators and composite indicators. Basic indicators refer to those derived from CDR statistics, such as "Number of GSM LU (Local Area Optimization) Requests." Composite indicators are those calculated based on basic indicators, such as "GSM LU Optimization Network Success Rate" = (Number of Successful GSM LU Optimizations + Number of GSM LU Optimization RNA Requests) / Number of GSM LU Optimization Requests * 100%.

[0158] The indicator alarm module is used to perform the following: For each indicator in the indicator system, a threshold is set for the indicator. When the value of the indicator exceeds the threshold, an alarm is automatically generated. The alarm guides the home operator to adjust the roaming network policy in a timely manner. The threshold includes static threshold and dynamic threshold, and the corresponding alarm includes static threshold alarm and dynamic threshold alarm events.

[0159] Among them, the static threshold is a fixed threshold used to determine whether the indicator is abnormal at a single moment; the dynamic threshold is set based on the historical average or median, and allows the deviation range to be configured, used to detect abnormal fluctuations of the indicator relative to the historical trend.

[0160] In this embodiment, after processing the obtained indicator data, alarm thresholds can be set for the indicators. Indicators exceeding the alarm thresholds will generate alarms. Alarms are divided into static threshold alarms and dynamic threshold alarms.

[0161] Static alarm thresholds are triggered when a metric in a roaming direction exceeds or falls below a fixed value. For example, an alarm might be triggered if a user roaming to Singapore has more than 100 "GSM LU Preferred Requests" and a "GSM LU Preferred Network Success Rate" of less than 98%.

[0162] Dynamic threshold alarms are triggered when a metric in a roaming direction deviates from its historical average (or median) by a certain margin. For example, an alarm is triggered if the "GSM LU Preferred Network Success Rate" for a user roaming to Singapore is less than 80% of the average "GSM LU Preferred Network Success Rate" over the past four time periods.

[0163] Through the alarm function, operators can promptly grasp the network selection status of users in a certain roaming direction.

[0164] The system in this embodiment can execute the method disclosed in Embodiment 1 to perform user network selection quality analysis during international roaming.

[0165] The above provides a detailed description of the user network selection quality analysis method and system based on international roaming signaling provided by this invention. Specific examples have been used to illustrate the principles and implementation methods of this invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of this invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this invention. Therefore, the content of this specification should not be construed as a limitation of this invention.

Claims

1. A user network selection quality analysis method based on international roaming signaling, characterized in that, Includes the following steps: Signaling Acquisition: Collecting raw signaling stream data generated during international roaming in the operator's network. The raw signaling stream data is in binary form and includes signaling stream data of MAP protocol and Diameter protocol. Signaling parsing: Based on 3GPP international standards, the original signaling code stream data is parsed into readable text CDR call detail records. During the parsing process, it is analyzed whether the signaling is triggered by the home operator's NTR platform of the roaming user, and the CDR call detail records are marked as whether they are triggered by NTR interference and whether they are the final record of NTR SDR or LU SDR. CDR call detail records with attribute information are generated, including NTR TDR, Normal TDR, NTR SDR and LU SDR. Indicator Analysis: Based on CDR call detail records and attribute information, various preferred and non-priority indicator data are statistically analyzed from the time dimension and roaming direction dimension as basic indicators, and composite indicators are calculated based on the basic indicators to form an indicator system including basic indicators and composite indicators. Indicator Alarm: For each indicator in the indicator system, a threshold is set for the indicator. When the value of the indicator exceeds the threshold, an alarm is automatically generated. The alarm guides the home operator to adjust the roaming network policy in a timely manner. The threshold includes static threshold and dynamic threshold, and the corresponding alarm includes static threshold alarm and dynamic threshold alarm events.

2. The user network selection quality analysis method based on international roaming signaling according to claim 1, characterized in that, NTR SDR is used to record a complete network optimization process. The generation rule is: starting from the first NTR interference, continue to record subsequent NTR TDRs until a Normal TDR occurs or a timeout occurs, and finally output an NTR SDR record and mark the optimization result type as success, failure or timeout. LU SDR is used to record a complete location update process and whether the network optimization process is affected by NTR interference. The LU SDR generation rule is: starting from the first location update request, continuously record the relevant TDR until successful completion or timeout, and finally output a LU SDR record, and count the number of failures and NTR interferences in the process.

3. The user network selection quality analysis method based on international roaming signaling according to claim 1, characterized in that, The basic metrics include the number of GSM LU preferred requests, the number of successful GSM LU preferred requests, the number of failed GPRS LU preferred requests, and the number of timeouts for non-preferred LTE LU requests; correspondingly, the composite metrics include the success rate of GSM LU preferred network, the success rate of GPRS LU preferred interference, and the stability index of non-preferred LTE LU requests.

4. The user network selection quality analysis method based on international roaming signaling according to claim 1, characterized in that, The static threshold is a fixed threshold used to determine whether an indicator is abnormal at a single moment. The dynamic threshold is set based on the historical average or median, and allows for the configuration of deviation ranges to detect abnormal fluctuations in the indicator relative to historical trends.

5. A user network selection quality analysis system based on international roaming signaling, characterized in that, It includes a signaling acquisition module, a signaling parsing module, an indicator analysis module, and an indicator alarm module; The signaling acquisition module is used to perform the following: collect raw signaling stream data generated during international roaming in the operator's network. The raw signaling stream data is in binary form and includes signaling stream data of MAP protocol and Diameter protocol. The signaling parsing module performs the following: Based on 3GPP international standards, it parses the original signaling code stream data into readable text CDR call detail records. During the parsing process, it analyzes whether the signaling is triggered by the home operator's NTR platform of the roaming user, and marks the CDR call detail records as either NTR interference triggering or the final record of NTR SDR or LU SDR. It then generates CDR call detail records with attribute information, including NTR TDR, NormalTDR, NTR SDR, and LU SDR. The indicator analysis module is used to perform the following: Based on CDR call detail records and attribute information, it collects various preferred and non-priority indicator data from the time dimension and roaming direction dimension as basic indicators, and calculates composite indicators based on the basic indicators to form an indicator system including basic indicators and composite indicators. The indicator alarm module is used to perform the following: For each indicator in the indicator system, a threshold is set for the indicator. When the value of the indicator exceeds the threshold, an alarm is automatically generated. The alarm guides the home operator to adjust the roaming network policy in a timely manner. The threshold includes static threshold and dynamic threshold, and the corresponding alarm includes static threshold alarm and dynamic threshold alarm events.

6. The user network selection quality analysis system based on international roaming signaling according to claim 5, characterized in that, NTR SDR is used to record a complete network optimization process. The generation rule is: starting from the first NTR interference, continue to record subsequent NTR TDRs until a Normal TDR occurs or a timeout occurs, and finally output an NTR SDR record and mark the optimization result type as success, failure or timeout. LU SDR is used to record a complete location update process and whether the network optimization process is affected by NTR interference. The LU SDR generation rule is: starting from the first location update request, continuously record the relevant TDR until successful completion or timeout, and finally output a LU SDR record, and count the number of failures and NTR interferences in the process.

7. The user network selection quality analysis system based on international roaming signaling according to claim 5, characterized in that, The basic metrics include the number of GSM LU preferred requests, the number of successful GSM LU preferred requests, the number of failed GPRS LU preferred requests, and the number of timeouts for non-preferred LTE LU requests; correspondingly, the composite metrics include the success rate of GSM LU preferred network, the success rate of GPRS LU preferred interference, and the stability index of non-preferred LTE LU requests.

8. The user network selection quality analysis system based on international roaming signaling according to claim 5, characterized in that, The static threshold is a fixed threshold used to determine whether an indicator is abnormal at a single moment. The dynamic threshold is set based on the historical average or median, and allows for the configuration of deviation ranges to detect abnormal fluctuations in the indicator relative to historical trends.

Images