Method and device for generating UE-level wireless snapshot based on MDT data and medium
By collecting, analyzing, filtering and backfilling MDT data, UE-level wireless snapshot data is generated, the problem of large amount of MME and MDT data is solved, the efficiency and accuracy of wireless bounded positioning analysis is improved, and real-time and accuracy are met. sexual needs.
Patent Information
- Application Number
- CN202411284852.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-13
- Publication Date
- 2025-01-14
AI Technical Summary
In the prior art, the amount of data of MME and MDT is huge, and it is difficult to meet the real-time and accuracy requirements of wireless bounded positioning analysis, and traditional data association methods are difficult to handle user complaints and perception problems.
By generating UE-level wireless snapshots based on MDT data, including data acquisition, parsing, filtering, cleaning and field backfill, UE-level wireless snapshot unique identifiers, and query or add new records in the memory hash table, periodically gathering and generation UE-level wireless snapshot data for wireless bounded positioning analysis.
It improves data processing efficiency and positioning accuracy during wireless bounded positioning analysis, meets the real-time and accuracy requirements of upper-level application queries, and reduces the system burden.
Smart Images

Figure CN119311639A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer technology, and in particular to a method, device and medium for generating a UE-level wireless snapshot based on MDT data. Background Art
[0002] MDT (Minimization of Drive-Test) technology aims to obtain drive test data through measurement reports, thereby replacing the traditional manual drive test method. MDT data is large in scale, but its data value is high. At present, there is a wide range of application needs. In the process of wireless delimitation and positioning analysis of user complaints and perception problems, user complaint information needs to obtain user temporary identification from MME (Mobility Management Entity), and combine mobile data MDT information to generate comprehensive wireless analysis data. However, due to the huge amount of data in MME and MDT, traditional data association methods are difficult to meet the real-time and accuracy requirements of upper-level application queries. Summary of the invention
[0003] The present invention provides a method, device and medium for generating UE-level wireless snapshot based on MDT data, so as to solve the problems existing in the prior art, improve the data processing efficiency and positioning accuracy during wireless delimitation positioning analysis, and meet the real-time and accuracy requirements of upper-layer application queries.
[0004] To achieve the above object, an embodiment of the present invention provides a method for generating a UE-level wireless snapshot based on MDT data, including:
[0005] Acquire the MDT data sampling point record file according to the preset interval time and perform data analysis to obtain unified first MDT sampling point record data;
[0006] Performing data filtering, data cleaning, and field backfilling processing on the first MDT sampling point record data to obtain second MDT sampling point record data;
[0007] Generate a UE-level wireless snapshot unique identifier according to the second MDT sampling point record data, query or add a wireless snapshot record in the memory hash table, calculate the sampling point data of each indicator in the wireless snapshot record and update the memory hash table, and periodically aggregate and generate UE-level wireless snapshot data for wireless delimitation positioning analysis.
[0008] As an improvement of the above solution, after the periodic aggregation generates UE-level wireless snapshot data for wireless delimited positioning analysis, it also includes:
[0009] A corresponding packet header identifier is added to the UE-level wireless snapshot data and pushed to the Kafka system or saved in a file format for use by an upper-layer application system.
[0010] As an improvement of the above solution, the step of acquiring the MDT data sampling point record file according to the preset interval time and performing data parsing to obtain the unified first MDT sampling point record data includes:
[0011] Log in to the MDT file server through SFTP according to the preset interval and download the MDT data sampling point record file;
[0012] Scan the local directory of files to be parsed, and if the MDT data sampling point record file is found, determine the compression format according to the file suffix name, decompress the MDT data sampling point record file, and extract the sampling point data file in the target format;
[0013] Matching the information of the equipment manufacturer according to the file name characteristics of the sampling point data file to obtain a matching result;
[0014] If the matching result is a normal match, the selected field information of the sampling point data file is parsed according to the field feature matching of the equipment manufacturer, and unified first MDT sampling point record data is generated.
[0015] As an improvement of the above solution, the step of performing data filtering, data cleaning and field backfilling processing on the first MDT sampling point record data to obtain the second MDT sampling point record data includes:
[0016] If the first MDT sampling point record data contains data with missing key fields, data values exceeding the range, data format errors, or data type errors, the data is considered invalid data and is filtered;
[0017] Extracting longitude and latitude data from the first MDT sampling point record data, if the longitude and latitude data exceeds the collection position range, the longitude and latitude data is abnormal longitude and latitude data and is filtered;
[0018] If there is a null value field in the first MDT sampling point record data, format the null value field and fill it with a default value according to the data type and the field value range;
[0019] Extracting sampling point data cell information from the first MDT sampling point record data to match the cell working parameter information and backfilling the cell working parameter field;
[0020] After the above data processing, the first MDT sampling point record data is processed to obtain the second MDT sampling point record data.
[0021] As an improvement of the above solution, the method of generating a UE-level wireless snapshot unique identifier according to the second MDT sampling point record data and querying or adding a wireless snapshot record in a memory hash table, calculating the sampling point data of each indicator in the wireless snapshot record and updating the memory hash table, and periodically aggregating and generating UE-level wireless snapshot data for wireless delimited positioning analysis includes:
[0022] Extracting and combining the unique identification key fields in the second MDT sampling point record data to generate a UE-level wireless snapshot unique identification;
[0023] According to the UE-level wireless snapshot unique identifier, query whether there is a wireless snapshot record containing the UE-level wireless snapshot unique identifier in the wireless snapshot data memory hash table, and if not, add a wireless snapshot record to the memory hash table;
[0024] Accumulate and count the number of sampling points of the fields RSRQ, RSRP and PHR in the memory hash table respectively, compare the longitude and latitude information of each sampling point and retain the last longitude and latitude information, calculate the maximum and minimum values of the fields RSRQ, RSRP and PHR respectively, and calculate the number of weak coverage sampling points, the number of low RSRQ sampling points and the number of low PHR sampling points respectively;
[0025] Update the unique identification data value content of the memory hash table;
[0026] It is determined whether the timer reaches a preset period. If so, the wireless snapshot records in the memory hash table are aggregated to generate UE-level wireless snapshot data, and the memory hash table is cleared; otherwise, the above process is repeated.
[0027] As an improvement of the above solution, the preset period is 5 minutes.
[0028] As an improvement of the above solution, the unique identification key fields include time, cell ID, UE temporary identity, MME pool code and mobility management entity.
[0029] As an improvement of the above solution, the weak coverage sampling point refers to a sampling point where the RSRP does not exceed a preset RSRP threshold; wherein the preset RSRP threshold is set to -100dBm by default;
[0030] The low RSRQ sampling point number refers to the sampling point where the RSRQ does not exceed the preset RSRQ threshold; wherein the preset RSRQ threshold is set to -15dBm by default;
[0031] The low PHR sampling points refer to sampling points where the PHR does not exceed a preset PHR threshold; wherein the preset PHR threshold is set to 0 by default.
[0032] To achieve the above object, an embodiment of the present invention further provides a device for generating a UE-level wireless snapshot based on MDT data, including:
[0033] A data acquisition and analysis module, used to obtain the MDT data sampling point record file according to a preset interval time and perform data analysis to obtain unified first MDT sampling point record data;
[0034] A data cleaning and backfilling module, configured to perform data filtering, data cleaning and field backfilling processing on the first MDT sampling point record data to obtain second MDT sampling point record data;
[0035] The wireless snapshot record aggregation output module is used to generate a UE-level wireless snapshot unique identifier according to the second MDT sampling point record data and query or add a wireless snapshot record in the memory hash table, calculate the sampling point data of each indicator in the wireless snapshot record and update the memory hash table, and periodically aggregate to generate UE-level wireless snapshot data for wireless delimitation positioning analysis.
[0036] To achieve the above objectives, an embodiment of the present invention further provides a computer device, including a processor, a memory, and a computer program stored in the memory and configured to be executed by the processor, wherein the processor implements the above method for generating a UE-level wireless snapshot based on MDT data when executing the computer program.
[0037] To achieve the above-mentioned purpose, an embodiment of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored computer program; wherein, when the computer program is running, the device where the computer-readable storage medium is located controls to execute the above-mentioned method for generating a UE-level wireless snapshot based on MDT data.
[0038] To achieve the above object, an embodiment of the present invention further provides a computer program product, which includes a computer program; wherein the computer program controls the device where the program product is located to execute the above method for generating a UE-level wireless snapshot based on MDT data when running.
[0039] The implementation of the embodiments of the present invention has the following beneficial effects:
[0040] The method, device and medium for generating UE-level wireless snapshot based on MDT data provided by the embodiment of the present invention obtain unified first MDT sampling point record data by acquiring MDT data sampling point record files according to preset intervals and performing data analysis; performing data filtering, data cleaning and field backfilling processing on the first MDT sampling point record data to obtain second MDT sampling point record data; generating a UE-level wireless snapshot unique identifier according to the second MDT sampling point record data and querying or adding a wireless snapshot record in a memory hash table, calculating the sampling point data of each indicator in the wireless snapshot record and updating the memory hash table, periodically aggregating and generating UE-level wireless snapshot data for wireless delimitation positioning analysis, thereby improving data processing efficiency and positioning accuracy during wireless delimitation positioning analysis, and meeting the real-time and accuracy requirements of upper-layer application queries. BRIEF DESCRIPTION OF THE DRAWINGS
[0041] Figure 1 is a flow chart of a method for generating a UE-level wireless snapshot based on MDT data provided by an embodiment of the present invention;
[0042] Figure 2 It is a structural block diagram of a device for generating a UE-level wireless snapshot based on MDT data provided by an embodiment of the present invention;
[0043] Figure 3 It is a structural block diagram of a computer device provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0044] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0045] In the description of the present invention, it should be noted that the step numbers in the text are only for the convenience of explaining the specific embodiments and do not serve to limit the order in which the steps are executed. The terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features.
[0046] See also Figure 1 , Figure 1 : is a flowchart of a method for generating a UE-level wireless snapshot based on MDT data provided by an embodiment of the present invention. The method for generating a UE-level wireless snapshot based on MDT data includes steps S1 to S3, which are specifically as follows:
[0047] S1. Obtaining the MDT data sampling point record file according to a preset interval and performing data analysis to obtain unified first MDT sampling point record data;
[0048] S2. Perform data filtering, data cleaning, and field backfilling processing on the first MDT sampling point record data to obtain second MDT sampling point record data;
[0049] S3. Generate a UE-level wireless snapshot unique identifier according to the second MDT sampling point record data, query or add a wireless snapshot record in the memory hash table, calculate the sampling point data of each indicator in the wireless snapshot record and update the memory hash table, and periodically aggregate and generate UE-level wireless snapshot data for wireless delimitation positioning analysis.
[0050] It can be understood that the MDT sampling point data includes 4G / 5G MDT sampling point data.
[0051] In the embodiment of the present invention, the timeliness, completeness and accuracy of the data recorded at the MDT sampling point are ensured by regular collection, analysis, filtering, cleaning and backfilling; the data aggregation method is optimized by the UE-level wireless snapshot unique identification and periodic aggregation, and the reduced UE-level wireless snapshot data is generated, so that in the process of wireless delimited positioning analysis, the temporary identification of the complaining user is obtained by using the MME data, and the relevant wireless indicators are queried and obtained in the UE-level wireless snapshot data, which can improve the data processing efficiency and positioning accuracy, effectively reduce the system burden, and meet the real-time and accuracy requirements of the upper-layer application query.
[0052] In an optional embodiment, the acquiring the MDT data sampling point record file according to the preset interval time and performing data parsing to obtain the unified first MDT sampling point record data includes:
[0053] Log in to the MDT file server through SFTP according to the preset interval and download the MDT data sampling point record file;
[0054] Scan the local directory of files to be parsed, and if the MDT data sampling point record file is found, determine the compression format according to the file suffix name, decompress the MDT data sampling point record file, and extract the sampling point data file in the target format;
[0055] Matching the information of the equipment manufacturer according to the file name characteristics of the sampling point data file to obtain a matching result;
[0056] If the matching result is a normal match, the selected field information of the sampling point data file is parsed according to the field feature matching of the equipment manufacturer, and unified first MDT sampling point record data is generated.
[0057] It is understandable that the preset interval time is 30 seconds.
[0058] The MDT data sampling point record file obtained by downloading is a compressed file, and the compression format includes zip and tar.gz.
[0059] The target format includes a CSV (Comma-Separated Values) file format.
[0060] The equipment manufacturers include but are not limited to Huawei, ZTE, Ericsson and Nokia.
[0061] The field characteristics include field order and field number. Since the field order and field number of different equipment manufacturers are not completely consistent, it is necessary to match and parse the selected field information of the sampling point data file according to the field characteristics of the equipment manufacturer.
[0062] The selected field information includes but is not limited to data extraction time, longitude and latitude, and neighboring areas.
[0063] In the embodiment of the present invention, unified MDT sampling point record data is generated by periodically downloading, decompressing and parsing, which is beneficial to subsequent data processing.
[0064] Exemplarily, the MDT file server is logged in via SFTP (Secure File Transfer Protocol) every 30 seconds to download the MDT data sampling point record file. The local file directory to be parsed is scanned to determine whether there is a compressed file of the MDT data sampling point record file. If the compressed file is scanned, the compression format is determined according to the file suffix name. The compression format includes: zip, tar.gz and other formats. The sampling point data file in the target format of CSV format is decompressed and extracted. According to the file name characteristics of the sampling point data file, it is determined whether it can match the equipment manufacturer information such as Huawei, ZTE, Ericsson and Nokia. If it can match normally, the data extraction time, longitude and latitude and neighboring area field information of the sampling point data file are parsed according to the field characteristics of the equipment manufacturer, and a unified first MDT sampling point record data is generated.
[0065] In an optional embodiment, the performing data filtering, data cleaning and field backfilling processing on the first MDT sampling point record data to obtain the second MDT sampling point record data includes:
[0066] If the first MDT sampling point record data contains data with missing key fields, data values exceeding the range, data format errors, or data type errors, the data is considered invalid data and is filtered;
[0067] Extracting longitude and latitude data from the first MDT sampling point record data, if the longitude and latitude data exceeds the collection position range, the longitude and latitude data is abnormal longitude and latitude data and is filtered;
[0068] If there is a null value field in the first MDT sampling point record data, format the null value field and fill it with a default value according to the data type and the field value range;
[0069] Extracting sampling point data cell information from the first MDT sampling point record data to match the cell working parameter information and backfilling the cell working parameter field;
[0070] After the above data processing, the first MDT sampling point record data is processed to obtain the second MDT sampling point record data.
[0071] It is understandable that the backfilled field information includes the city ID and the longitude and latitude of the cell.
[0072] In the embodiment of the present invention, invalid and abnormal data are first filtered to ensure the validity of the recorded data; then the empty value fields are backfilled to ensure the integrity of each recorded data; finally, the cell engineering parameter fields are backfilled to ensure that the data remains consistent between different records. That is, the quality of the recorded data at the sampling point is improved by data filtering, cleaning and backfilling, providing a reliable data basis for subsequent analysis.
[0073] Exemplarily, it is determined whether there is data with missing key fields, data values exceeding the range, data format errors or data types errors in the first MDT sampling point record data. If so, the data is invalid data and filtered until the first MDT sampling point record data does not contain invalid data. Longitude and latitude data are extracted from the first MDT sampling point record data, and it is determined whether the longitude and latitude data exceeds the collection position range. If so, the longitude and latitude data are abnormal longitude and latitude data and filtered until the first MDT sampling point record data does not contain abnormal longitude and latitude data. If there is a null value field in the first MDT sampling point record data, the null value field is formatted and filled with a default value according to the data type and field value range; the sampling point data cell information is extracted from the first MDT sampling point record data to match the cell engineering parameter information and the cell engineering parameter field is backfilled. After the above data filtering, data cleaning and field backfilling processing of the first MDT sampling point record data, the second MDT sampling point record data is obtained.
[0074] In an optional embodiment, the generating a UE-level wireless snapshot unique identifier according to the second MDT sampling point record data and querying or adding a wireless snapshot record in a memory hash table, calculating the sampling point data of each indicator in the wireless snapshot record and updating the memory hash table, and periodically aggregating and generating UE-level wireless snapshot data for wireless delimited positioning analysis includes:
[0075] Extracting and combining the unique identification key fields in the second MDT sampling point record data to generate a UE-level wireless snapshot unique identification;
[0076] According to the UE-level wireless snapshot unique identifier, query whether there is a wireless snapshot record containing the UE-level wireless snapshot unique identifier in the wireless snapshot data memory hash table, and if not, add a wireless snapshot record to the memory hash table;
[0077] Accumulate and count the number of sampling points of the fields RSRQ, RSRP and PHR in the memory hash table respectively, compare the longitude and latitude information of each sampling point and retain the last longitude and latitude information, calculate the maximum and minimum values of the fields RSRQ, RSRP and PHR respectively, and calculate the number of weak coverage sampling points, the number of low RSRQ sampling points and the number of low PHR sampling points respectively;
[0078] Update the unique identification data value content of the memory hash table;
[0079] It is determined whether the timer reaches a preset period. If so, the wireless snapshot records in the memory hash table are aggregated to generate UE-level wireless snapshot data, and the memory hash table is cleared; otherwise, the above process is repeated.
[0080] It is understandable that the comparison of the latitude and longitude information of each sampling point and the retention of the last longitude and longitude information is because the sampling point data is mixed with records with and without longitude and longitude information, so it is necessary to judge each record and record the last record information.
[0081] In an embodiment of the present invention, a UE-level wireless snapshot unique identifier is generated by extracting key fields, and a query is made in a memory hash table to see whether a corresponding record exists. If not, a new record is added; fields involved in wireless snapshot data indicators are accumulated, maximum and minimum values are taken, and statistics are performed under preset conditions according to the sampling point record data, and the calculated data is used for analysis of upper-layer applications, for example, network fault problems are discovered in advance through quality analysis of PHR indicators; after each calculation, the wireless snapshot data field value corresponding to the unique identifier will change, and the corresponding unique identifier data value content needs to be updated according to the change; finally, UE-level wireless snapshot data is generated by aggregation according to a preset period for wireless delimitation and positioning analysis, which can optimize the data aggregation method, improve data processing efficiency, and meet the needs of rapid response.
[0082] In an optional embodiment, the preset period is 5 minutes.
[0083] In the embodiment of the present invention, by aggregating the key statistical fields of the MDT sampling points at a time granularity of every 5 minutes and generating UE-level wireless snapshot data, the amount of data can be significantly reduced, thereby effectively reducing the storage amount of the target analysis data, thereby improving the data analysis, calculation and processing speed, and meeting the real-time requirements of upper-layer application queries.
[0084] In an optional embodiment, the unique identification key fields include time, cell ID, UE temporary identity, MME pool code and mobility management entity.
[0085] In the embodiment of the present invention, "time + cell ID (CGI) + UE temporary identity (MME S1AP UE ID) + MME pool code (MMEGI) + mobile management entity (MMEC)" is used as the UE-level wireless snapshot unique identifier to generate MDT indicator records, and UE-level wireless snapshot data is aggregated at a time granularity of every 5 minutes, which can provide more accurate and targeted analysis data and support more accurate positioning and tracking. This unique unique identification method allows upper-layer applications to have higher flexibility when using these indicator records, so that data analysis can be more in line with actual needs, thereby achieving more efficient decision support.
[0086] Exemplarily, the unique identification key field includes time, cell ID (CGI), UE temporary identity (MMES1AP UE ID), MME pool code (MMEGI) and mobile management entity (MMEC), and the data sample of the unique identification key field is shown in Table 1.
[0087] Table 1 Data sample of unique identification key fields
[0088] time Cell ID MME S1AP UE ID MMEGI MMEC 202406011220 4600-00-10023-xx 1234567xxx 1034xx 923xx 202406011210 4600-00-10024-xx … … … 202406011205 4600-00-10025-xx … … …
[0089] The logical algorithm for aggregating and generating UE-level wireless snapshot data is as follows:
[0090] Extract the unique identification key field in the second MDT sampling point record data, and generate a UE-level (User Equipment) wireless snapshot unique identifier of "time + cell ID (CGI) + UE temporary identity identifier (MME S1AP UE ID) + MME pool code (MMEGI) + mobile management entity (MMEC)". Query the wireless snapshot data memory hash table according to the UE-level wireless snapshot unique identifier to determine whether there is a wireless snapshot record containing the UE-level wireless snapshot unique identifier in the memory hash table; if not, add a wireless snapshot record to the memory hash table. Accumulate and count the number of sampling points of the fields RSRQ (Reference Signal Receiving Qualit), RSRP (Reference Signal Receiving Power), and PHR (Power Headroom Report) in the memory hash table respectively, compare the longitude and latitude information of each sampling point and retain the last longitude and latitude information, calculate the maximum and minimum values of the fields RSRQ, RSRP, and PHR respectively; calculate the number of weak coverage sampling points, low RSRQ sampling points, and low PHR sampling points respectively. Update the unique identification data value content of the memory hash table. Determine whether the timer has reached the preset period (5 minutes). If so, aggregate the wireless snapshot records in the memory hash table, generate UE-level wireless snapshot data, and clear the memory hash table; otherwise, repeat the above process.
[0091] In an optional embodiment, the weak coverage sampling point refers to a sampling point where the RSRP does not exceed a preset RSRP threshold; wherein the preset RSRP threshold is set to -100 dBm by default;
[0092] The low RSRQ sampling point number refers to the sampling point where the RSRQ does not exceed the preset RSRQ threshold; wherein the preset RSRQ threshold is set to -15dBm by default;
[0093] The low PHR sampling points refer to sampling points where the PHR does not exceed a preset PHR threshold; wherein the preset PHR threshold is set to 0 by default.
[0094] In an optional embodiment, after the periodic aggregation generates UE-level wireless snapshot data for wireless delimited positioning analysis, the method further includes:
[0095] A corresponding packet header identifier is added to the UE-level wireless snapshot data and pushed to the Kafka system or saved in a file format for use by an upper-layer application system.
[0096] In the embodiment of the present invention, UE-level wireless snapshot data is generated according to the MDT sampling point data and pushed to the Kafka system in real time after adding the corresponding packet header identifier, so as to ensure the real-time data connection of the upper application system.
[0097] Exemplarily, a corresponding packet header identifier is added to the aggregated UE-level wireless snapshot data and pushed to the Kafka system or saved in a file format for use by an upper-layer application system.
[0098] The method for generating a UE-level wireless snapshot based on MDT data provided by an embodiment of the present invention obtains a unified first MDT sampling point record data by acquiring an MDT data sampling point record file according to a preset interval time and performing data parsing; performs data filtering, data cleaning and field backfilling processing on the first MDT sampling point record data to obtain a second MDT sampling point record data; generates a UE-level wireless snapshot unique identifier according to the second MDT sampling point record data, queries or adds a wireless snapshot record in a memory hash table, calculates the sampling point data of each indicator in the wireless snapshot record and updates the memory hash table, and periodically aggregates and generates UE-level wireless snapshot data for wireless delimitation positioning analysis, thereby improving data processing efficiency and positioning accuracy during wireless delimitation positioning analysis, and meeting the real-time and accuracy requirements of upper-layer application queries.
[0099] See also Figure 2 , Figure 2 1 is a structural block diagram of an apparatus 10 for generating a UE-level wireless snapshot based on MDT data provided by an embodiment of the present invention. The apparatus 10 for generating a UE-level wireless snapshot based on MDT data includes:
[0100] The data acquisition and analysis module 11 is used to obtain the MDT data sampling point record file according to the preset interval time and perform data analysis to obtain unified first MDT sampling point record data;
[0101] A data cleaning and backfilling module 12, configured to perform data filtering, data cleaning and field backfilling processing on the first MDT sampling point record data to obtain second MDT sampling point record data;
[0102] The data aggregation generation module 13 is used to generate a UE-level wireless snapshot unique identifier according to the second MDT sampling point record data and query or add a wireless snapshot record in the memory hash table, calculate the sampling point data of each indicator in the wireless snapshot record and update the memory hash table, and periodically aggregate and generate UE-level wireless snapshot data for wireless delimitation positioning analysis.
[0103] Optionally, the device 10 for generating a UE-level wireless snapshot based on MDT data further includes:
[0104] The data output module 14 is used to add a corresponding packet header identifier to the UE-level wireless snapshot data and push it to the Kafka system or save it in a file format for use by an upper-layer application system.
[0105] Optionally, the data collection and analysis module 11 is further used for:
[0106] Log in to the MDT file server through SFTP according to the preset interval and download the MDT data sampling point record file;
[0107] Scan the local directory of files to be parsed, and if the MDT data sampling point record file is found, determine the compression format according to the file suffix name, decompress the MDT data sampling point record file, and extract the sampling point data file in the target format;
[0108] Matching the information of the equipment manufacturer according to the file name characteristics of the sampling point data file to obtain a matching result;
[0109] If the matching result is a normal match, the selected field information of the sampling point data file is parsed according to the field feature matching of the equipment manufacturer, and unified first MDT sampling point record data is generated.
[0110] Optionally, the data cleaning and backfilling module 12 is further used for:
[0111] If the first MDT sampling point record data contains data with missing key fields, data values exceeding the range, data format errors, or data type errors, the data is considered invalid data and is filtered;
[0112] Extracting longitude and latitude data from the first MDT sampling point record data, if the longitude and latitude data exceeds the collection position range, the longitude and latitude data is abnormal longitude and latitude data and is filtered;
[0113] If there is a null value field in the first MDT sampling point record data, format the null value field and fill it with a default value according to the data type and the field value range;
[0114] Extracting sampling point data cell information from the first MDT sampling point record data to match the cell working parameter information and backfilling the cell working parameter field;
[0115] After the above data processing, the first MDT sampling point record data is processed to obtain the second MDT sampling point record data.
[0116] Optionally, the data aggregation generation module 13 is further used for:
[0117] Extracting and combining the unique identification key fields in the second MDT sampling point record data to generate a UE-level wireless snapshot unique identification;
[0118] According to the UE-level wireless snapshot unique identifier, query whether there is a wireless snapshot record containing the UE-level wireless snapshot unique identifier in the wireless snapshot data memory hash table, and if not, add a wireless snapshot record to the memory hash table;
[0119] Accumulate and count the number of sampling points of the fields RSRQ, RSRP and PHR in the memory hash table respectively, compare the longitude and latitude information of each sampling point and retain the last longitude and latitude information, calculate the maximum and minimum values of the fields RSRQ, RSRP and PHR respectively, and calculate the number of weak coverage sampling points, the number of low RSRQ sampling points and the number of low PHR sampling points respectively;
[0120] Update the unique identification data value content of the memory hash table;
[0121] It is determined whether the timer reaches a preset period. If so, the wireless snapshot records in the memory hash table are aggregated to generate UE-level wireless snapshot data, and the memory hash table is cleared; otherwise, the above process is repeated.
[0122] Optionally, the preset period is 5 minutes.
[0123] Optionally, the unique identification key fields include time, cell ID, UE temporary identity, MME pool code and mobility management entity.
[0124] Optionally, the weak coverage sampling point refers to a sampling point where the RSRP does not exceed a preset RSRP threshold; wherein the preset RSRP threshold is set to -100 dBm by default;
[0125] The low RSRQ sampling point number refers to the sampling point where the RSRQ does not exceed the preset RSRQ threshold; wherein the preset RSRQ threshold is set to -15dBm by default;
[0126] The low PHR sampling points refer to sampling points where the PHR does not exceed a preset PHR threshold; wherein the preset PHR threshold is set to 0 by default.
[0127] It is worth noting that the working process of each module in the apparatus 10 for generating a UE-level wireless snapshot based on MDT data described in the embodiment of the present invention can refer to the working process of the method for generating a UE-level wireless snapshot based on MDT data described in the above embodiment, which will not be repeated here.
[0128] The device for generating a UE-level wireless snapshot based on MDT data provided by an embodiment of the present invention obtains a unified first MDT sampling point record data by acquiring an MDT data sampling point record file according to a preset interval time and performing data parsing; performs data filtering, data cleaning and field backfilling processing on the first MDT sampling point record data to obtain a second MDT sampling point record data; generates a UE-level wireless snapshot unique identifier according to the second MDT sampling point record data, queries or adds a wireless snapshot record in a memory hash table, calculates the sampling point data of each indicator in the wireless snapshot record and updates the memory hash table, and periodically aggregates and generates UE-level wireless snapshot data for wireless delimitation positioning analysis, thereby improving data processing efficiency and positioning accuracy during wireless delimitation positioning analysis, and meeting the real-time and accuracy requirements of upper-layer application queries.
[0129] In addition, an embodiment of the present invention further provides a computer-readable storage medium, which includes a stored computer program; wherein the computer program controls the device where the computer-readable storage medium is located to execute the above-mentioned method for generating a UE-level wireless snapshot based on MDT data when running.
[0130] An embodiment of the present invention further provides a computer program product, which includes a computer program; wherein the computer program, when running, controls the device where the computer program product is located to execute the above-mentioned method for generating a UE-level wireless snapshot based on MDT data.
[0131] See also Figure 3 , Figure 3 1 is a structural block diagram of a computer device 20 provided in an embodiment of the present invention, wherein the computer device 20 includes: a processor 21, a memory 22, and a computer program stored in the memory 22 and executable on the processor 21. When the processor 21 executes the computer program, the steps in the above-mentioned method embodiment for generating a UE-level wireless snapshot based on MDT data are implemented. Alternatively, when the processor 21 executes the computer program, the functions of each module / unit in the above-mentioned device embodiments are implemented.
[0132] Exemplarily, the computer program may be divided into one or more modules / units, which are stored in the memory 22 and executed by the processor 21 to implement the present invention. The one or more modules / units may be a series of computer program instruction segments capable of implementing specific functions, which are used to describe the execution process of the computer program in the computer device 20.
[0133] The computer device 20 may include, but is not limited to, a processor 21 and a memory 22. Those skilled in the art will appreciate that the schematic diagram is merely an example of the computer device 20 and does not limit the computer device 20. The computer device 20 may include more or fewer components than shown in the figure, or may combine certain components, or different components. For example, the computer device 20 may also include input and output devices, network access devices, buses, etc.
[0134] The processor 21 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc. The processor 21 is the control center of the computer device 20, and uses various interfaces and lines to connect various parts of the entire computer device 20.
[0135] The memory 22 can be used to store the computer program and / or module. The processor 21 implements various functions of the computer device 20 by running or executing the computer program and / or module stored in the memory 22 and calling the data stored in the memory 22. The memory 22 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 22 can include a high-speed random access memory, and can also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0136] Wherein, if the module / unit integrated in the computer device 20 is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor 21. Wherein, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form, etc. The computer-readable medium can include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), electric carrier signal, telecommunication signal and software distribution medium, etc.
[0137] The above is a preferred embodiment of the present invention. It should be pointed out that a person skilled in the art can make several improvements and modifications without departing from the principle of the present invention. These improvements and modifications are also considered to be within the scope of protection of the present invention.
Claims
1. A method for generating a UE-level wireless snapshot based on MDT data, characterized in that: include: Acquire the MDT data sampling point record file according to the preset interval time and perform data analysis to obtain unified first MDT sampling point record data; Performing data filtering, data cleaning, and field backfilling processing on the first MDT sampling point record data to obtain second MDT sampling point record data; Generate a UE-level wireless snapshot unique identifier according to the second MDT sampling point record data, query or add a wireless snapshot record in the memory hash table, calculate the sampling point data of each indicator in the wireless snapshot record and update the memory hash table, and periodically aggregate and generate UE-level wireless snapshot data for wireless delimitation positioning analysis.
2. The method for generating a UE-level wireless snapshot based on MDT data according to claim 1, characterized in that: After the periodic aggregation generates UE-level wireless snapshot data for wireless delimited positioning analysis, the method further includes: A corresponding packet header identifier is added to the UE-level wireless snapshot data and pushed to the Kafka system or saved in a file format for use by an upper-layer application system.
3. The method for generating a UE-level wireless snapshot based on MDT data according to claim 1, characterized in that: The step of acquiring the MDT data sampling point record file according to the preset interval time and performing data analysis to obtain unified first MDT sampling point record data includes: Log in to the MDT file server through SFTP according to the preset interval and download the MDT data sampling point record file; Scan the local directory of files to be parsed, and if the MDT data sampling point record file is found, determine the compression format according to the file suffix name, decompress the MDT data sampling point record file, and extract the sampling point data file in the target format; Matching the information of the equipment manufacturer according to the file name characteristics of the sampling point data file to obtain a matching result; If the matching result is a normal match, the selected field information of the sampling point data file is parsed according to the field feature matching of the equipment manufacturer, and unified first MDT sampling point record data is generated.
4. The method for generating a UE-level wireless snapshot based on MDT data according to claim 1, characterized in that: The performing data filtering, data cleaning and field backfilling processing on the first MDT sampling point record data to obtain the second MDT sampling point record data includes: If the first MDT sampling point record data contains data with missing key fields, data values exceeding the range, data format errors, or data type errors, the data is considered invalid data and is filtered; Extracting longitude and latitude data from the first MDT sampling point record data, if the longitude and latitude data exceeds the collection position range, the longitude and latitude data is abnormal longitude and latitude data and is filtered; If there is a null value field in the first MDT sampling point record data, format the null value field and fill it with a default value according to the data type and the field value range; Extracting sampling point data cell information from the first MDT sampling point record data to match the cell working parameter information and backfilling the cell working parameter field; After the above data processing, the first MDT sampling point record data is processed to obtain the second MDT sampling point record data.
5. The method for generating a UE-level wireless snapshot based on MDT data according to claim 1, characterized in that: The method of generating a UE-level wireless snapshot unique identifier according to the second MDT sampling point record data and querying or adding a wireless snapshot record in a memory hash table, calculating the sampling point data of each indicator in the wireless snapshot record and updating the memory hash table, and periodically aggregating and generating UE-level wireless snapshot data for wireless delimitation positioning analysis includes: Extracting and combining the unique identification key fields in the second MDT sampling point record data to generate a UE-level wireless snapshot unique identification; According to the UE-level wireless snapshot unique identifier, query whether there is a wireless snapshot record containing the UE-level wireless snapshot unique identifier in the wireless snapshot data memory hash table, and if not, add a wireless snapshot record to the memory hash table; Accumulate and count the number of sampling points of the fields RSRQ, RSRP and PHR in the memory hash table respectively, compare the longitude and latitude information of each sampling point and retain the last longitude and latitude information, calculate the maximum and minimum values of the fields RSRQ, RSRP and PHR respectively, and calculate the number of weak coverage sampling points, the number of low RSRQ sampling points and the number of low PHR sampling points respectively; Update the unique identification data value content of the memory hash table; It is determined whether the timer reaches a preset period. If so, the wireless snapshot records in the memory hash table are aggregated to generate UE-level wireless snapshot data, and the memory hash table is cleared; otherwise, the above process is repeated.
6. The method for generating a UE-level wireless snapshot based on MDT data according to claim 5, characterized in that: The preset period is 5 minutes.
7. The method for generating a UE-level wireless snapshot based on MDT data according to claim 6, characterized in that: The unique identification key fields include time, cell ID, UE temporary identity, MME pool code and mobility management entity.
8. The method for generating a UE-level wireless snapshot based on MDT data according to claim 4, characterized in that: The weak coverage sampling point refers to a sampling point where the RSRP does not exceed a preset RSRP threshold; wherein the preset RSRP threshold is set to -100dBm by default; The low RSRQ sampling point number refers to the sampling point where the RSRQ does not exceed the preset RSRQ threshold; wherein the preset RSRQ threshold is set to -15dBm by default; The low PHR sampling points refer to sampling points where the PHR does not exceed a preset PHR threshold; wherein the preset PHR threshold is set to 0 by default.
9. A device for generating a UE-level wireless snapshot based on MDT data, characterized in that: include: A data acquisition and analysis module, used to obtain the MDT data sampling point record file according to a preset interval time and perform data analysis to obtain unified first MDT sampling point record data; A data cleaning and backfilling module, configured to perform data filtering, data cleaning and field backfilling processing on the first MDT sampling point record data to obtain second MDT sampling point record data; A data aggregation generation module is used to generate a UE-level wireless snapshot unique identifier according to the second MDT sampling point record data and query or add a wireless snapshot record in the memory hash table, calculate the sampling point data of each indicator in the wireless snapshot record and update the memory hash table, and periodically aggregate and generate UE-level wireless snapshot data for wireless delimitation positioning analysis.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored computer program; wherein, when the computer program is run, it controls the device where the computer-readable storage medium is located to execute the method for generating a UE-level wireless snapshot based on MDT data according to any one of claims 1 to 8.