Method and system for processing original code stream of XDR monitored and collected by network

By deduplication, error message extraction and desensitization of the XDR original code stream collected by network monitoring on the application server, the problem that the UI system cannot provide security information quickly is solved, and the effective processing of the XDR original code stream is achieved, improving the User experience and data security.

CN118972121APending Publication Date: 2024-11-15BEIJING ZHONGCHUANG TELECOM TEST CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411047301.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-01
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

The prior art is difficult to effectively process the XDR original code stream collected by network monitoring, resulting in the UI system being unable to quickly provide safe and reliable information, affecting the user experience.

Method used

By deduplication, error message extraction and desensitization of the original code stream on the application server, duplicate messages are removed, key error information is extracted, and user identity and location information is desensitized to generate a clear and intuitive original code stream data.

Benefits of technology

It realizes rapid deduplication and error code extraction of XDR original code streams, protects key information, prevents information leakage, and improves the friendliness of data presentation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118972121A_ABST
    Figure CN118972121A_ABST
Patent Text Reader

Abstract

The invention relates to an original code stream processing method and system for network monitoring and acquisition of XDR. The method belongs to the technical field of communication networks, and comprises the following steps: an acquisition side analyzes and synthesizes an XDR record and then stores an original code stream in an original code stream storage device; the method comprises the following steps: when a UI end obtains original code stream decoding presentation, the UI end initiates a request to an original code stream storage device, and the original code stream storage device sends an original code stream to an application server; the application server receives each frame of original message sent by the original code stream storage device, and performs de-duplication, error message extraction and desensitization processing on the original message; and the application server normalizes complete original code streams corresponding to the XDR records and then sends the complete original code streams to the UI end in batches. The method is applied to network monitoring for collected data analysis and service interaction analysis scenes, the original code stream of the XDR of multiple interfaces is analyzed, key information deduplication and error message extraction and desensitization can be rapidly provided, safe and reliable information is provided for UI application presentation, and the use perception of a UI system is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of communication networks, and in particular relates to a method and system for processing original code streams of XDR collected by network monitoring. Background Art

[0002] XDR (Extended Detection and Response) is a network security tool that is mainly used to detect and respond to threats. By processing network monitoring and collecting XDR, providing safe and reliable information for UI application presentation, improving the perception of UI system usage has become a demand. Summary of the invention

[0003] In view of the above analysis, the present invention aims to disclose a method and system for processing the original code stream of XDR collected by network monitoring, which is applied to the scenarios of network monitoring for data collection analysis and business interaction analysis. It can parse the original code stream of XDR of multiple interfaces, and can quickly provide key information deduplication, error message extraction and desensitization, and provide safe and reliable information for UI application presentation, so as to enhance the usage perception of UI system.

[0004] The present invention discloses a method for processing an original code stream of XDR collected by network monitoring, comprising:

[0005] Step S101: After parsing and synthesizing the XDR record, the acquisition side stores the original bitstream in an original bitstream storage device;

[0006] Step S102: When the UI terminal obtains the original code stream for decoding and presentation, the UI terminal initiates a request to the original code stream storage device, and the original code stream storage device sends the original code stream to the application server;

[0007] Step S103: the application server receives each frame of the original message sent by the original code stream storage device, performs deduplication, error message extraction and desensitization processing on the original message;

[0008] Among them, deduplication processing is used to eliminate duplicate original messages; error message extraction processing is used to extract error codes from multiple top-level protocols of the original message and fill in key error information annotations; desensitization processing is used to desensitize the user identity and location information parsed from the original message;

[0009] Step S104: After the application server has sorted out the complete original code stream corresponding to the XDR record, it sends it to the UI end in batches.

[0010] Further, step S103 includes:

[0011] 1) De-duplication is performed on each frame of the original message of the original code stream received by the application server within a set time range, and the de-duplication original message frame is retained in the memory of the application server;

[0012] 2) Extract the top-level protocols including DIMAETER, SIP, and S1AP from each original message frame after deduplication in the memory; extract and mark error messages from the extracted multiple top-level protocol information;

[0013] 3) While extracting error messages, perform regular matching on the decoded interpretation of each frame of the original message protocol after deduplication in the memory, and desensitize the user identity and location information including MSISDN, IMSI, IMEI, LAC, CI.

[0014] Furthermore, the deduplication processing method includes:

[0015] 1) The application server performs time sorting on multiple original message data frames received from the original code stream;

[0016] 2) for multiple original message data frames within a set time interval, the consistency comparison of the message contents is performed one by one for multiple times to determine the repeated original message data frames;

[0017] 3) For the repeated original message data frames, the data frame with the earliest retention time is retained in the memory of the application server, and other original message data frames with the same message content are discarded.

[0018] Furthermore, the error message extraction method comprises:

[0019] 1) When extracting error messages in the DIAMETER protocol, match the protocol error code ID or the string information including UNASSIGNED in the decoded interpretation in a case-insensitive manner and then mark it;

[0020] 3) When extracting error messages from the SIP protocol, match the error code ID or the string information including BADREQUEST in the decoded interpretation in a case-insensitive manner and then mark it;

[0021] 2) When extracting error messages in the S1AP protocol, character string information including HANDOVER FAILURE interpreted by the protocol decoding is matched case-insensitively and then marked;

[0022] 4) Extract error messages from other upper layer protocols by referring to steps 1) to 3), match them and mark them;

[0023] 5) Add a marked error mark or a non-error mark to the original message decoding information of the corresponding protocol.

[0024] Furthermore, the desensitization treatment method comprises:

[0025] 1) Desensitize or encrypt the user identity including MSISDN, IMSI, and IMEI parsed from the original message;

[0026] The desensitization method is to replace the user identity characters with insensitive characters; the encryption method is to encrypt with an encryption key generated by an autonomous generation method;

[0027] 2) Desensitize or encrypt the user location information including LAC and CI parsed from the original message;

[0028] The desensitization method is to replace the user identity characters with insensitive characters; the encryption method is to encrypt with an encryption key generated by an autonomous generation method;

[0029] 3) Desensitize or encrypt specific information including APN parsed from the original message;

[0030] The desensitizing method is to replace the user identity characters with insensitive characters; the encryption method uses encryption keys generated by autonomous generation methods for encryption.

[0031] The present invention also discloses an original code stream processing system for network monitoring and collecting XDR, comprising: an original code stream storage device, an application server and a UI terminal;

[0032] The original code stream storage device is used to store the original code stream obtained by the acquisition side after parsing and synthesizing the XDR record;

[0033] The UI end is used to initiate a request to obtain the original code stream decoding and presentation from the original code stream storage device; receive the complete original code stream sent by the application server;

[0034] The application server is used to receive each frame of the original message sent by the original message storage device when the original message is obtained and decoded and presented on the UI side, perform deduplication, error message extraction and desensitization processing on the original message, and regularize the complete original message corresponding to the XDR record, and then send it to the UI side in batches;

[0035] Among them, deduplication processing is used to eliminate duplicate original messages; error message extraction processing is used to extract error codes from multiple top-level protocols of the original message and fill in key error information annotations; and desensitization processing is used to desensitize the user identity and location information parsed from the original message.

[0036] Further, the application server includes: a first processing module, a second processing module, a third processing module and a fourth processing module;

[0037] The first processing module is used to perform deduplication processing on each frame of the original message of the original code stream received by the application server within a set time range, and retain the deduplicated original message frame in the memory of the application server;

[0038] The second processing module is used to extract the top layer protocols including DIMAETER, SIP, and S1AP from each frame of the original message after deduplication in the memory; extract and mark the error messages of the extracted multiple top layer protocol information;

[0039] The third processing module is used to perform regular matching on the decoded interpretation of each frame of the original message protocol after deduplication in the memory while extracting the error message, and perform desensitization processing on the user identity and location information including MSISDN, IMSI, IMEI, LAC, CI;

[0040] The fourth processing module is used to organize the processed message protocol in the memory into a complete original code stream corresponding to the XDR record, and send it to the UI end in batches.

[0041] Furthermore, the deduplication processing method executed in the first processing module includes:

[0042] 1) The application server performs time sorting on multiple original message data frames received from the original code stream;

[0043] 2) for multiple original message data frames within a set time interval, the consistency comparison of the message contents is performed one by one for multiple times to determine the repeated original message data frames;

[0044] 3) For the repeated original message data frames, the data frame with the earliest retention time is retained in the memory of the application server, and other original message data frames with the same message content are discarded.

[0045] Furthermore, the error message extraction method executed in the second processing module includes:

[0046] 1) When extracting error messages in the DIAMETER protocol, match the protocol error code ID or the string information including UNASSIGNED in the decoded interpretation in a case-insensitive manner and then mark it;

[0047] 3) When extracting error messages from the SIP protocol, match the error code ID or the string information including BADREQUEST in the decoded interpretation in a case-insensitive manner and then mark it;

[0048] 2) When extracting error messages in the S1AP protocol, character string information including HANDOVER FAILURE interpreted by the protocol decoding is matched case-insensitively and then marked;

[0049] 4) When extracting error messages from other upper layer protocols in the manner of steps 1) to 3), match and mark them;

[0050] 5) Add a marked error mark or a non-error mark to the original message decoding information of the corresponding protocol.

[0051] Furthermore, the desensitization processing method executed in the third processing module includes:

[0052] 1) Desensitize or encrypt the user identity including MSISDN, IMSI, and IMEI parsed from the original message;

[0053] The desensitization method is to replace the user identity characters with insensitive characters; the encryption method is to encrypt with an encryption key generated by an autonomous generation method;

[0054] 2) Desensitize or encrypt the user location information including LAC and CI parsed from the original message;

[0055] The desensitization method is to replace the user identity characters with insensitive characters; the encryption method is to encrypt with an encryption key generated by an autonomous generation method;

[0056] 3) Desensitize or encrypt specific information including APN parsed from the original message;

[0057] The desensitizing method is to replace the user identity characters with insensitive characters; the encryption method uses encryption keys generated by autonomous generation methods for encryption.

[0058] The present invention can achieve the following beneficial effects:

[0059] 1. Protect key identity information and location information in the original bitstream by including self-generated encryption keys, thus preventing information leakage;

[0060] 2. Accurately extract error codes for different protocols in the original bitstream, and be able to clearly and intuitively perceive whether there are abnormalities in the original bitstream;

[0061] 3. According to the time interval setting of the original code stream data frame, the repeated original code stream data can be removed to achieve a friendly data presentation effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] The drawings are only for the purpose of illustrating particular embodiments and are not to be considered limiting of the present invention. Like reference symbols denote like components throughout the drawings.

[0063] Figure 1A flow chart of a method for processing an original code stream of XDR collected by network monitoring in an embodiment of the present invention;

[0064] Figure 2 The figure is a schematic diagram showing the connection components of the original code stream processing system for network monitoring and collecting XDR in an embodiment of the present invention. DETAILED DESCRIPTION

[0065] The preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings, wherein the accompanying drawings constitute a part of this application and are used to illustrate the principles of the present invention together with the embodiments of the present invention.

[0066] Embodiment 1

[0067] An embodiment of the present invention discloses a method for processing the original code stream of XDR collected by network monitoring, such as Figure 1 As shown, including:

[0068] Step S101: After parsing and synthesizing the XDR record, the acquisition side stores the original bitstream in an original bitstream storage device;

[0069] Step S102: When the UI terminal obtains the original code stream for decoding and presentation, the UI terminal initiates a request to the original code stream storage device, and the original code stream storage device sends the original code stream to the application server;

[0070] Step S103: the application server receives each frame of the original message sent by the original code stream storage device, performs deduplication, error message extraction and desensitization processing on the original message;

[0071] Among them, deduplication processing is used to eliminate duplicate original messages; error message extraction processing is used to extract error codes from multiple top-level protocols of the original message and fill in key error information annotations; desensitization processing is used to desensitize the user identity and location information parsed from the original message;

[0072] Step S104: After the application server has sorted out the complete original code stream corresponding to the XDR record, it sends it to the UI end in batches.

[0073] Specifically, in step S101, the acquisition side stores the original bitstream in a specific format after parsing and synthesizing the XDR record;

[0074] The collection side parses and synthesizes XDR records for 2G, 3G, 4G, 5G and 4 / 5G networks; the specific formats include: pcap format, .pcapng format, or custom .dat format. The original code stream content is determined according to the content of the upper layer protocol in the actual business.

[0075] Specifically, in step S102, when the UI end obtains the original code stream for decoding and presentation, the UI end initiates a request to the original code stream storage device and waits for the original message to be returned to the application server end for processing.

[0076] Specifically, step S103 includes:

[0077] 1) De-duplication is performed on each frame of the original message of the original code stream received by the application server within a set time range, and the de-duplication original message frame is retained in the memory of the application server;

[0078] By retaining the deduplicated original message frames in the memory of the application server, the data is obtained in the memory during the secondary processing of the original message data, and the original code stream is no longer requested, which improves the data processing efficiency. The size of the reserved memory space can be reasonably set according to the amount of cached original message data.

[0079] The data collected by operators between different network elements may have millimeter-level differences due to transmission reasons, so the time range limit is generally set at milliseconds and can be adjusted according to time conditions.

[0080] 2) Extract the top-level protocols including DIMAETER, SIP, and S1AP from each original message frame after deduplication in the memory; extract and mark error messages from the extracted multiple top-level protocol information;

[0081] 3) While extracting error messages, perform regular matching on the decoded interpretation of each frame of the original message protocol after deduplication in the memory, and desensitize the user identity and location information including MSISDN, IMSI, IMEI, LAC, CI.

[0082] More specifically, the deduplication processing method includes:

[0083] 1) The application server performs time sorting on multiple original message data frames received from the original code stream;

[0084] 2) for multiple original message data frames within a set time interval, the consistency comparison of the message contents is performed one by one for multiple times to determine the repeated original message data frames;

[0085] When determining the repeated original message data frame, generate an MD5 hash value for the data frame, then compare the MD5 hash values ​​repeatedly within a limited time range, and determine the data frames with the same hash value as duplicate frames.

[0086] 3) For the repeated original message data frames, the data frame with the earliest retention time is retained in the memory of the application server, and other original message data frames with the same message content are discarded.

[0087] More specifically, the error message extraction method comprises:

[0088] 1) When extracting error messages in the DIAMETER protocol, match the error code ID (such as >2002) or the decoded string information including UNASSIGNED in a case-insensitive manner and then mark it;

[0089] 3) When extracting error messages from the SIP protocol, match them case-insensitively based on the protocol error code ID (such as >= 400) or the decoded and interpreted string information including BAD REQUEST, and then mark them;

[0090] 2) When extracting error messages in the S1AP protocol, character string information including HANDOVER FAILURE interpreted by the protocol decoding is matched case-insensitively and then marked;

[0091] 4) Extract error messages from other upper layer protocols by referring to steps 1) to 3), match them and mark them;

[0092] 5) Add a marked error mark or a non-error mark to the original message decoding information of the corresponding protocol.

[0093] In a preferred embodiment, an error message is marked as "1" and a non-error message is marked as "0".

[0094] More specifically, the desensitization treatment method comprises:

[0095] 1) Desensitize or encrypt the user identity including MSISDN, IMSI, and IMEI parsed from the original message;

[0096] The desensitization method is to replace the user identity characters with insensitive characters; the encryption method is to encrypt with an encryption key generated by an autonomous generation method;

[0097] 2) Desensitize or encrypt the user location information including LAC and CI parsed from the original message;

[0098] The desensitization method is to replace the user identity characters with insensitive characters; the encryption method is to encrypt with an encryption key generated by an autonomous generation method;

[0099] 3) Desensitize or encrypt specific information including APN parsed from the original message;

[0100] The desensitizing method is to replace the user identity characters with insensitive characters; the encryption method uses encryption keys generated by autonomous generation methods for encryption.

[0101] In the preferred solution, when desensitizing or encrypting, the desensitizing method can be to add "*" processing, and can support customized presentation method of adding "*"; encryption method, as long as it can be encrypted and decrypted normally, no special requirements are made.

[0102] Specifically, in step S104, the application server deduplicates the original message, extracts error messages, and performs desensitization processing to regularize the complete original code stream corresponding to the XDR record, and then sends it to the UI end in batches to achieve a quick response effect.

[0103] In summary, the original code stream processing method for network monitoring and collection of XDR disclosed in this embodiment protects the key identity information and location information in the original code stream by including an autonomously generated encryption key, thereby preventing information leakage; the error codes for different protocols in the original code stream are accurately extracted, and it is possible to clearly and intuitively perceive whether there are abnormal conditions in the original code stream; according to the time interval setting of the original code stream data frame, repeated original code stream data can be removed to achieve a friendly data presentation effect.

[0104] Embodiment 2

[0105] An embodiment of the present invention discloses a raw code stream processing system for collecting XDR through network monitoring, such as Figure 2 As shown, it includes: original code stream storage device, application server and UI end;

[0106] The original code stream storage device is used to store the original code stream obtained by the acquisition side after parsing and synthesizing the XDR record;

[0107] The UI end is used to initiate a request to obtain the original code stream decoding and presentation from the original code stream storage device; receive the complete original code stream sent by the application server;

[0108] The application server is used to receive each frame of the original message sent by the original message storage device when the original message is obtained and decoded and presented on the UI side, perform deduplication, error message extraction and desensitization processing on the original message, and regularize the complete original message corresponding to the XDR record, and then send it to the UI side in batches;

[0109] Among them, deduplication processing is used to eliminate duplicate original messages; error message extraction processing is used to extract error codes from multiple top-level protocols of the original message and fill in key error information annotations; and desensitization processing is used to desensitize the user identity and location information parsed from the original message.

[0110] Specifically, the acquisition side stores the original code stream in the original code stream storage device after parsing and synthesizing the XDR record; wherein the acquisition side parses and synthesizes the XDR record for 2G, 3G, 4G, 5G and 4 / 5G networks.

[0111] Specifically, the application server includes: a first processing module, a second processing module, a third processing module and a fourth processing module;

[0112] The first processing module is used to perform deduplication processing on each frame of the original message of the original code stream received by the application server within a set time range, and retain the deduplicated original message frame in the memory of the application server;

[0113] The second processing module is used to extract the top layer protocols including DIMAETER, SIP, and S1AP from each frame of the original message after deduplication in the memory; extract and mark the error messages of the extracted multiple top layer protocol information;

[0114] The third processing module is used to perform regular matching on the decoded interpretation of each frame of the original message protocol after deduplication in the memory while extracting the error message, and perform desensitization processing on the user identity and location information including MSISDN, IMSI, IMEI, LAC, CI;

[0115] The fourth processing module is used to organize the processed message protocol in the memory into a complete original code stream corresponding to the XDR record, and send it to the UI end in batches.

[0116] More specifically, the deduplication processing method executed in the first processing module includes:

[0117] 1) The application server performs time sorting on multiple original message data frames received from the original code stream;

[0118] 2) for multiple original message data frames within a set time interval, the consistency comparison of the message contents is performed one by one for multiple times to determine the repeated original message data frames;

[0119] 3) For the repeated original message data frames, the data frame with the earliest retention time is retained in the memory of the application server, and other original message data frames with the same message content are discarded.

[0120] More specifically, the error message extraction method executed in the second processing module includes:

[0121] 1) When extracting error messages in the DIAMETER protocol, match the protocol error code ID or the string information including UNASSIGNED in the decoded interpretation in a case-insensitive manner and then mark it;

[0122] 3) When extracting error messages from the SIP protocol, match the error code ID or the string information including BADREQUEST in the decoded interpretation in a case-insensitive manner and then mark it;

[0123] 2) When extracting error messages in the S1AP protocol, character string information including HANDOVER FAILURE interpreted by the protocol decoding is matched case-insensitively and then marked;

[0124] 4) When extracting error messages from other upper layer protocols in the manner of steps 1) to 3), match and mark them;

[0125] 5) Add a marked error mark or a non-error mark to the original message decoding information of the corresponding protocol.

[0126] In a preferred embodiment, an error message is marked as "1" and a non-error message is marked as "0".

[0127] More specifically, the desensitization processing method performed in the third processing module includes:

[0128] 1) Desensitize or encrypt the user identity including MSISDN, IMSI, and IMEI parsed from the original message;

[0129] The desensitization method is to replace the user identity characters with insensitive characters; the encryption method is to encrypt with an encryption key generated by an autonomous generation method;

[0130] 2) Desensitize or encrypt the user location information including LAC and CI parsed from the original message;

[0131] The desensitization method is to replace the user identity characters with insensitive characters; the encryption method is to encrypt with an encryption key generated by an autonomous generation method;

[0132] 3) Desensitize or encrypt specific information including APN parsed from the original message;

[0133] The desensitizing method is to replace the user identity characters with insensitive characters; the encryption method uses encryption keys generated by autonomous generation methods for encryption.

[0134] In the preferred solution, when desensitizing or encrypting, the desensitizing method can be to add "*" processing, and can support customized presentation method of adding "*"; encryption method, as long as it can be encrypted and decrypted normally, no special requirements are made.

[0135] In summary, the original code stream processing system for network monitoring and collecting XDR disclosed in this embodiment protects key identity information and location information in the original code stream by including an autonomously generated encryption key, thereby preventing information leakage; the error codes for different protocols in the original code stream are accurately extracted, and it is possible to clearly and intuitively perceive whether there are abnormalities in the original code stream; according to the time interval setting of the original code stream data frame, repeated original code stream data can be removed to achieve a friendly data presentation effect.

[0136] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily conceived by any technician familiar with the technical field within the technical scope disclosed by the present invention should be covered within the protection scope of the present invention.

Claims

1. A method for processing the original code stream of XDR collected by network monitoring, It is characterized in that include: Step S101: After parsing and synthesizing the XDR record, the acquisition side stores the original bitstream in an original bitstream storage device; Step S102: When the UI terminal obtains the original code stream for decoding and presentation, the UI terminal initiates a request to the original code stream storage device, and the original code stream storage device sends the original code stream to the application server; Step S103: the application server receives each frame of the original message sent by the original code stream storage device, performs deduplication, error message extraction and desensitization processing on the original message; Among them, deduplication processing is used to eliminate duplicate original messages; error message extraction processing is used to extract error codes from multiple top-level protocols of the original message and fill in key error information annotations; desensitization processing is used to desensitize the user identity and location information parsed from the original message; Step S104: After the application server has sorted out the complete original code stream corresponding to the XDR record, it sends it to the UI end in batches.

2. The original code stream processing method for collecting XDR by network monitoring according to claim 1, It is characterized in that Step S103 includes: 1) De-duplication is performed on each frame of the original message of the original code stream received by the application server within a set time range, and the de-duplication original message frame is retained in the memory of the application server; 2) Extract the top-level protocols including DIMAETER, SIP, and S1AP from each original message frame after deduplication in the memory; extract and mark error messages from the extracted multiple top-level protocol information; 3) While extracting error messages, perform regular matching on the decoded interpretation of each frame of the original message protocol after deduplication in the memory, and desensitize the user identity and location information including MSISDN, IMSI, IMEI, LAC, CI.

3. The original code stream processing method for collecting XDR by network monitoring according to claim 2, It is characterized in that The deduplication processing method comprises: 1) The application server performs time sorting on multiple original message data frames received from the original code stream; 2) for multiple original message data frames within a set time interval, the consistency comparison of the message contents is performed one by one for multiple times to determine the repeated original message data frames; 3) For the repeated original message data frames, the data frame with the earliest retention time is retained in the memory of the application server, and other original message data frames with the same message content are discarded.

4. The original code stream processing method for collecting XDR by network monitoring according to claim 3, It is characterized in that The error message extraction method comprises: 1) When extracting error messages in the DIAMETER protocol, match the protocol error code ID or the string information including UNASSIGNED in the decoded interpretation in a case-insensitive manner and then mark it; 3) When extracting error messages from the SIP protocol, match the error code ID or the string information including BAD REQUEST in the decoded interpretation in a case-insensitive manner and then mark it; 2) When extracting error messages in the S1AP protocol, character string information including HANDOVER FAILURE interpreted by the protocol decoding is matched case-insensitively and then marked; 4) Extract error messages from other upper layer protocols by referring to steps 1) to 3), match them and mark them; 5) Add a marked error mark or a non-error mark to the original message decoding information of the corresponding protocol.

5. The original code stream processing method for collecting XDR by network monitoring according to claim 2, It is characterized in that The desensitization treatment method comprises: 1) Desensitize or encrypt the user identity including MSISDN, IMSI, and IMEI parsed from the original message; The desensitization method is to replace the user identity characters with insensitive characters; the encryption method is to encrypt with an encryption key generated by an autonomous generation method; 2) Desensitize or encrypt the user location information including LAC and CI parsed from the original message; The desensitization method is to replace the user identity characters with insensitive characters; the encryption method is to encrypt with an encryption key generated by an autonomous generation method; 3) Desensitize or encrypt specific information including APN parsed from the original message; The desensitizing method is to replace the user identity characters with insensitive characters; the encryption method uses encryption keys generated by autonomous generation methods for encryption.

6. A network monitoring and collection XDR raw stream processing system, It is characterized in that include: Original stream storage device, application server and UI end; The original code stream storage device is used to store the original code stream obtained by the acquisition side after parsing and synthesizing the XDR record; The UI end is used to initiate a request to obtain the original code stream decoding and presentation from the original code stream storage device; Receiving the complete original code stream sent by the application server; The application server is used to receive each frame of the original message sent by the original message storage device when the original message is obtained and decoded and presented on the UI side, perform deduplication, error message extraction and desensitization processing on the original message, and regularize the complete original message corresponding to the XDR record, and then send it to the UI side in batches; Among them, deduplication processing eliminates duplicate original messages; error message extraction processing extracts error codes from multiple top-level protocols of the original message and fills in key error information annotations; Desensitization is performed on the user identity and location information parsed from the original message.

7. The original code stream processing system for network monitoring and collecting XDR according to claim 6, It is characterized in that The application server comprises: a first processing module, a second processing module, a third processing module and a fourth processing module; The first processing module is used to perform deduplication processing on each frame of the original message of the original code stream received by the application server within a set time range, and retain the deduplicated original message frame in the memory of the application server; The second processing module is used to extract the top layer protocols including DIMAETER, SIP, and S1AP from each frame of the original message after deduplication in the memory; extract and mark the error messages of the extracted multiple top layer protocol information; The third processing module is used to perform regular matching on the decoded interpretation of each frame of the original message protocol after deduplication in the memory while extracting the error message, and perform desensitization processing on the user identity and location information including MSISDN, IMSI, IMEI, LAC, CI; The fourth processing module is used to organize the processed message protocol in the memory into a complete original code stream corresponding to the XDR record, and send it to the UI end in batches.

8. The original code stream processing system for network monitoring and collecting XDR according to claim 7, It is characterized in that The deduplication processing method executed in the first processing module includes: 1) The application server performs time sorting on multiple original message data frames received from the original code stream; 2) for multiple original message data frames within a set time interval, the consistency comparison of the message contents is performed one by one for multiple times to determine the repeated original message data frames; 3) For the repeated original message data frames, the data frame with the earliest retention time is retained in the memory of the application server, and other original message data frames with the same message content are discarded.

9. The original code stream processing system for network monitoring and collecting XDR according to claim 7, It is characterized in that The error message extraction method executed in the second processing module includes: 1) When extracting error messages in the DIAMETER protocol, match the protocol error code ID or the string information including UNASSIGNED in the decoded interpretation in a case-insensitive manner and then mark it; 3) When extracting error messages from the SIP protocol, match the error code ID or the string information including BAD REQUEST in the decoded interpretation in a case-insensitive manner and then mark it; 2) When extracting error messages in the S1AP protocol, character string information including HANDOVER FAILURE interpreted by the protocol decoding is matched case-insensitively and then marked; 4) When extracting error messages from other upper layer protocols in the manner of steps 1) to 3), match and mark them; 5) Add a marked error mark or a non-error mark to the original message decoding information of the corresponding protocol.

10. The original code stream processing system for network monitoring and collecting XDR according to claim 7, It is characterized in that The desensitization processing method executed in the third processing module includes: 1) Desensitize or encrypt the user identity including MSISDN, IMSI, and IMEI parsed from the original message; The desensitization method is to replace the user identity characters with insensitive characters; the encryption method is to encrypt with an encryption key generated by an autonomous generation method; 2) Desensitize or encrypt the user location information including LAC and CI parsed from the original message; The desensitization method is to replace the user identity characters with insensitive characters; the encryption method is to encrypt with an encryption key generated by an autonomous generation method; 3) Desensitize or encrypt specific information including APN parsed from the original message; The desensitizing method is to replace the user identity characters with insensitive characters; the encryption method uses encryption keys generated by autonomous generation methods for encryption.