Network data quality alarm method, device and equipment and storage medium

Abstract

The application provides a network data quality alarm method and device, equipment and a storage medium. The method comprises the following steps: acquiring full network data of a communication system in real time, and storing the full network data in a big data cluster; extracting all the stored full network data from the big data cluster as target full network data according to a preset time interval; acquiring a storage path of the target full network data, and acquiring storage information of the target full network data according to the storage path; calculating a real-time index of the target full network data according to the storage information of the target full network data; acquiring target fields of each piece of storage data of the target full network data; comparing the target fields of each piece of storage data with prestored data to obtain an accuracy index of the target full network data; and outputting alarm information according to the real-time index and the accuracy index, so that the quality index of network data with a large amount of data can be audited.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of communication, in particular to a network data quality alarm method and device, equipment and storage medium. BACKGROUND

[0002] In a communication system, the data quality of network data of the communication system is audited and alarmed to find problems in the network data and perform alarm processing, which can provide important guarantee for troubleshooting unstable factors in the operation of the communication system.

[0003] At present, in the traditional technology, the network signaling of several network signals in an individual time period is usually alarmed. However, this analysis method cannot audit and alarm the quality indicators of network data with a large amount of data.

[0004] Therefore, there is an urgent need for a network data quality alarm method that can audit and alarm the quality indicators of network data with a large amount of data. SUMMARY

[0005] The present application provides a network data quality alarm method, device, equipment and storage medium, which can audit and alarm the quality indicators of network data with a large amount of data and output alarm information.

[0006] In a first aspect, the present application provides a network data quality alarm method, comprising:

[0007] Real-time acquisition of full network data of a communication system, and storage of the full network data in a big data cluster;

[0008] Extracting all stored full network data from the big data cluster as target full network data according to a preset time interval;

[0009] Obtaining the storage path of the target full network data, and obtaining the storage information of the target full network data according to the storage path; and calculating the real-time indicator of the target full network data according to the storage information of the target full network data;

[0010] Obtaining the target field of each piece of storage data of the target full network data; and obtaining the accuracy indicator of the target full network data by comparing the target field of each piece of storage data with pre-stored data;

[0011] Outputting the alarm information of the full network data according to the real-time indicator and the accuracy indicator.

[0012] In a possible design, the storage path of the target full-amount network data is acquired, and storage information of the target full-amount network data is acquired according to the storage path; and the real-time index of the target full-amount network data is calculated according to the storage information of the target full-amount network data, including: acquiring a storage path of a storage table in which the target full-amount network data is stored, wherein the storage table includes each piece of storage data constituting the target full-amount network data; traversing the storage capacity and the last modification time of each piece of storage data in the storage table in the storage path; and calculating the real-time index of the target full-amount network data according to the storage capacity and the last modification time of each piece of storage data.

[0013] In a possible design, the calculation formula of the real-time index of the target full-amount network data according to the storage capacity and the last modification time of each piece of storage data is as follows:

[0014]

[0015] wherein, Delay is the real-time index; storage is the storage capacity of the storage data; time modify is the last modification time of the storage data; and time zone is the time partition to which the storage data belongs.

[0016] In a possible design, the target field includes a mapping relationship between a mobile user integrated service digital number and an international mobile user identification code; the pre-stored data is a dim table; and the accuracy index of the target full-amount network data is obtained by comparing the target field of each piece of storage data with the pre-stored data, including: acquiring the mobile user integrated service digital number of each piece of storage data, querying the international mobile user identification code corresponding to the mobile user integrated service digital number in the dim table according to the mobile user integrated service digital number; if the international mobile user identification code corresponding to the mobile user integrated service digital number in the dim table is consistent with the international mobile user identification code in the mapping relationship, the storage data is determined to be accurate data; and the accuracy index of the target full-amount network data is calculated according to the number of accurate data records in all storage data.

[0017] In a possible design, the calculation formula of the accuracy index of the target full-amount network data according to the number of accurate data records in all storage data is as follows:

[0018]

[0019] wherein, Accuracy is the accuracy index; count(record indim) is the number of accurate data records in all stored data; count(record) is the total number of records of all stored data.

[0020] In a possible design, the outputting of the alarm information of the full-amount network data according to the real-time index and the accuracy index comprises: if the real-time index exceeds a first preset index threshold and / or the accuracy index exceeds a second preset index threshold, sending the alarm information to a maintenance terminal of a management personnel in a preset communication mode.

[0021] In a possible design, before the outputting of the alarm information of the full-amount network data according to the real-time index and the accuracy index, the method further comprises:

[0022] The real-time index and the accuracy index of the target full-amount network data are displayed in a visual interface.

[0023] In a second aspect, the present application provides a network data quality alarm device, comprising:

[0024] An acquisition module is configured to acquire full-amount network data of a communication system in real time and store the full-amount network data in a big data cluster.

[0025] An extraction module is configured to extract all stored full-amount network data from the big data cluster as target full-amount network data according to a preset time interval.

[0026] A real-time index module is configured to acquire a storage path of the target full-amount network data, acquire storage information of the target full-amount network data according to the storage path, and calculate a real-time index of the target full-amount network data according to the storage information of the target full-amount network data.

[0027] An accuracy index module is configured to acquire a target field of each piece of storage data of the target full-amount network data, compare the target field of each piece of storage data with pre-stored data, and obtain an accuracy index of the target full-amount network data.

[0028] An alarm output module is configured to output alarm information of the full-amount network data according to the real-time index and the accuracy index.

[0029] In a third aspect, the present application provides a service device, comprising at least one processor and a memory.

[0030] The memory stores computer execution instructions.

[0031] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the network data quality alarm method as described in the first aspect and various possible designs of the first aspect.

[0032] In a fourth aspect, the present application provides a computer storage medium, wherein the computer storage medium stores computer-executable instructions, and when a processor executes the computer-executable instructions, the network data quality alarm method as described in the first aspect and various possible designs of the first aspect is implemented.

[0033] The network data quality alarm method, device, equipment and storage medium provided by the present application can extract target full network data to be analyzed from real-time stored full network data according to a preset time interval; calculate a real-time index by using storage information of the target full network data; calculate an accuracy index by using a target field of each piece of storage data of the target full network data; and perform alarm processing according to the real-time index and the accuracy index. The quality index of network data with a huge amount of data can be audited and alarm processed, and the processing efficiency is high. BRIEF DESCRIPTION OF DRAWINGS

[0034] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed in the embodiment or prior art description will be briefly introduced. Obviously, the drawings in the following description are some embodiments of the present application, and those skilled in the art can also obtain other drawings according to these drawings without creative labor.

[0035] Figure 1 FIG. 1 is a schematic diagram of an application scenario of the network data quality alarm method provided by the embodiments of the present application;

[0036] Figure 2 FIG. 2 is a schematic diagram of the network data quality alarm method provided by the embodiments of the present application;

[0037] Figure 3 FIG. 3 is a schematic diagram of the structure of the network data quality alarm device provided by the embodiments of the present application;

[0038] Figure 4 FIG. 4 is a schematic diagram of the hardware structure of the service equipment provided by the embodiments of the present application. DETAILED DESCRIPTION

[0039] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

[0040] With the continuous development of communication technology, the scale of network system expands rapidly, so that the network data of the communication system presents the characteristics of huge data volume and various types. The network data of the communication system is directly related to the efficient and stable operation of the communication system, and plays an important role in the operation and maintenance of the network system. The quality indicators of the network data mainly involve the timeliness and accuracy of the network data. Therefore, auditing and alarm processing of the data quality of the network data of the communication system can find problems existing in the network data and perform alarm processing, which can find unstable factors for the operation of the communication system.

[0041] The present application provides a network data quality alarm method, which can audit and alarm process the quality indicators of network data with huge data volume. The technical concept is as follows: extracting target full network data to be analyzed from real-time stored full network data according to a preset time interval; calculating a real-time indicator using the storage information of the target full network data; calculating an accuracy indicator using the target fields of each piece of storage data of the target full network data; and performing alarm processing according to the real-time indicator and the accuracy indicator.

[0042] Figure 1 is the application scenario diagram of the network data quality alarm method provided by the embodiments of the present application. As shown in Figure 1 , it includes a communication system 101, a service device 102 and a maintenance terminal 103.

[0043] Among them, the communication system 101 can be a communication system of a mobile communication network. Optionally, the communication system 101 can be a communication system of a 4G or 5G mobile communication network.

[0044] Among them, the service device 102 can be a server or a cluster composed of multiple servers.

[0045] The terminal 103 can be any form of terminal device. The terminal device involved in the present application can be a wireless terminal or a wired terminal. The wireless terminal can be a device that provides voice and / or other service data connectivity to a user, a handheld device with wireless connection function, or other processing devices connected to a wireless modem. The wireless terminal can communicate with one or more core network devices through a radio access network (RAN). The wireless terminal can be a mobile terminal, such as a mobile phone (or "cell" phone) and a computer with a mobile terminal, for example, a portable, pocket, handheld, built-in computer or vehicle-mounted mobile device that exchanges voice and / or data with a radio access network. For another example, the wireless terminal can also be a personal communication service (PCS) phone, a cordless phone, a session initiation protocol (SIP) phone, a wireless local loop (WLL) station, a personal digital assistant (PDA), and the like. The wireless terminal can also be referred to as a system, a subscriber unit, a subscriber station, a mobile station, a mobile, a remote station, a remote terminal, an access terminal, a user terminal, a user agent, a user device or user equipment, without limitation.

[0046] Figure 2 The network data quality alarm method provided by the embodiment of the present application is shown in the flowchart. The execution subject of the embodiment can be the service device shown in the embodiment, or other computer devices that can realize similar functions, which are not particularly limited in the embodiment. As shown in the embodiment, the method comprises the following steps. Figure 1 The execution subject of the embodiment can be the service device shown in the embodiment, or other computer devices that can realize similar functions, which are not particularly limited in the embodiment. As shown in the embodiment, the method comprises the following steps. Figure 2 The method comprises the following steps.

[0047] S201: Real-time acquisition of full network data of the communication system, and storage of the full network data to a big data cluster.

[0048] In the embodiment, the original message transmitted by Kafka and the calculation result obtained by real-time calculation of the Flink task are taken as the full network data.

[0049] In the embodiment, the full network data is stored in the hive database of the data cluster.

[0050] In the embodiment, the full network data is stored in the hive database of the data cluster by the preconfigured program hive-jdbc-3.1.0.jar.

[0051] S202: Extract all the stored full network data from the big data cluster as target full network data according to a preset time interval.

[0052] In the embodiment, the preset time interval can be 10 minutes, 5 minutes or 1 minute. Specifically, the shell program can be preconfigured to start the extraction of all the stored full network data at the preset time interval.

[0053] S203: Obtain the storage path of the target full network data, and obtain the storage information of the target full network data according to the storage path; and calculate the real-time index of the target full network data according to the storage information of the target full network data.

[0054] Specifically, the storage path of the target full network data is obtained, and the storage information of the target full network data is obtained according to the storage path; and the real-time index of the target full network data is calculated according to the storage information of the target full network data, including:

[0055] Step 203a: Obtain the storage path of the storage table storing the target full network data, wherein the storage table includes each piece of storage data constituting the target full network data.

[0056] In the embodiment, the storage table storing the target full network data is a hive table, and the storage path of the hive table, i.e., the hdfs file path, is obtained. Hdsf, which stands for hadoop distributed file system, is a distributed file system.

[0057] Step 203b: Traverse the storage capacity and last modification time of each piece of storage data in the storage table in the storage path.

[0058] In the embodiment, the storage capacity and last modification time of each piece of storage data in the hdfs file path are traversed.

[0059] In the embodiment, the storage capacity and last modification time of each piece of storage data in the hdfs file path are traversed.

[0060] Step 203c: Calculate the real-time index of the target full network data according to the storage capacity and last modification time of each piece of storage data.

[0061] The real-time index of the target full network data is calculated according to the storage capacity and the last modification time of each piece of stored data, and the calculation formula is:

[0062]

[0063] In the formula, Delay is the real-time index; storage is the storage capacity of the stored data; time modify is the last modification time of the stored data; time zone is the time partition to which the stored data belongs.

[0064] In this embodiment, the last modification time of each piece of stored data is subtracted from the time partition to which the stored data belongs to obtain a time delay difference; the products of the storage capacity of each piece of stored data and the time delay difference are summed up; and the average time delay time of the target full network data in the time partition is obtained by dividing the sum of the products of the storage capacity of each piece of stored data and the time delay difference by the sum of the storage capacities of the stored data, as the real-time index.

[0065] For example, the example hive table name is hive_table, and the storage path of the corresponding target full network data is: hdfs: / / node01:9000 / user / dbname.db / hive_table. For the hour partition of the time partition March 20, 2022, 9:00, the corresponding target full network data storage path is: hdfs: / / node01:9000 / user / dbname.db / hive_table / hour=09. If there are three files under this folder, the last modification times are as follows (Table 1):

[0066] Hdfs file name Storage capacity storage Last modification time timemodify File1 500 Bytes 2022-03-20 09:50 File2 600 Bytes 2022-03-20 10:10 File3 700 Bytes 2022-03-20 10:20

[0067] The average time delay time (real-time index) of the time partition is calculated as follows:

[0068]

[0069] S204: Obtain the target field of each piece of stored data of the target full network data; and compare the target field of each piece of stored data with the pre-stored data to obtain the accuracy index of the target full network data.

[0070] Specifically, the target field includes the mapping relationship between the mobile user comprehensive service digital number and the international mobile user identification code; the pre-stored data is a dimension dim table; and correspondingly, step S204 specifically includes:

[0071] Step 204a: Obtain the mobile subscriber integrated service digital number of each piece of stored data, and query the international mobile subscriber identity corresponding to the mobile subscriber integrated service digital number in the dim table according to the mobile subscriber integrated service digital number.

[0072] Step 204b: If the international mobile subscriber identity corresponding to the mobile subscriber integrated service digital number in the dim table is consistent with the international mobile subscriber identity in the mapping relationship, it is determined that the stored data is accurate data.

[0073] Step 204c: According to the number of accurate data in all stored data, the accuracy index of the target full network data is calculated.

[0074] Wherein, according to the number of accurate data in all stored data, the accuracy index of the target full network data is calculated, and the calculation formula is:

[0075]

[0076] In the formula, Accuracy is the accuracy index; count(record indim ) is the number of accurate data in all stored data; and count(record) is the total number of all stored data.

[0077] Exemplarily, the example hive table name is hive_table, the total number of records is 10000, and the accurate relationship judgment condition of the mobile phone number msisdn and the international mobile subscriber identity imsi in each piece of data is: whether the imsi data in the dim table is equal to the imsi of the data through the msisdn, if yes, the data is accurate, otherwise the data is inaccurate.

[0078] When the total number of records judged as accurate data is 9998, the accuracy of the table is calculated as:

[0079]

[0080] S205: According to the real-time index and the accuracy index, output the alarm information of the full network data.

[0081] Specifically, if the real-time index exceeds the first preset index threshold, and / or the accuracy index exceeds the second preset index threshold, the alarm information is sent to the maintenance terminal of the management personnel in a preset communication mode.

[0082] In this embodiment, the alarm information is generated and notified to the management personnel by short message and / or email.

[0083] From the above description, the target full network data to be analyzed is extracted from the real-time stored full network data according to a preset time interval; the real-time index is calculated by using the storage information of the target full network data; the accuracy index is calculated by using the target field of each piece of storage data of the target full network data; and the alarm processing is performed according to the real-time index and the accuracy index; the quality index of the network data with a huge data volume can be audited and alarm processed, and the processing efficiency is high.

[0084] In an optional embodiment of the present application, before the alarm information of the full network data is output according to the real-time index and the accuracy index in step S205, the following step is further included:

[0085] S206: The real-time index and the accuracy index of the target full network data are displayed on a visual interface.

[0086] In the embodiment, the visual interface is constructed based on a Grafana framework.

[0087] In the embodiment, the first preset index threshold and the second preset index threshold, and the data administrator and the contact information thereof are pre-configured through the visual interface. When the real-time index exceeds the first preset index threshold, and / or the accuracy index exceeds the second preset index threshold, an alarm email or an SMS is sent to the corresponding administrator through a webhook technology.

[0088] From the above description, the real-time index and the accuracy index are displayed on the visual interface, so as to facilitate the administrator to view.

[0089] Figure 3 A structural schematic diagram of a network data quality alarm device provided by the embodiment of the present application is shown in FIG. 1. Figure 3 As shown in the figure, the network data quality alarm device includes an acquisition module 301, an extraction module 302, a real-time index module 303, an accuracy index module 304, and an alarm output module 305.

[0090] The acquisition module 301 is configured to acquire full network data of a communication system in real time, and store the full network data in a big data cluster.

[0091] The extraction module 302 is configured to extract all the stored full network data from the big data cluster as target full network data according to a preset time interval.

[0092] The real-time index module 303 is configured to acquire a storage path of the target full network data, and acquire storage information of the target full network data according to the storage path; and calculate a real-time index of the target full network data according to the storage information of the target full network data.

[0093] The accuracy index module 304 is configured to obtain a target field of each piece of stored data of the target full network data; and compare the target field of each piece of stored data with pre-stored data to obtain an accuracy index of the target full network data.

[0094] The alarm output module 305 is configured to output alarm information of the full network data according to the real-time index and the accuracy index.

[0095] The apparatus provided in the embodiment can be used to execute the technical solutions of the method embodiments, and has similar implementation principles and technical effects, which will not be described here again in the embodiment.

[0096] In a possible design, the real-time index module 303 is specifically configured to obtain a storage path of a storage table storing the target full network data, where the storage table includes each piece of stored data constituting the target full network data; traverse storage capacity and last modification time of each piece of stored data in the storage table in the storage path; and calculate the real-time index of the target full network data according to the storage capacity and the last modification time of each piece of stored data.

[0097] In a possible design, the target field includes a mapping relationship between a mobile user integrated service digital number and an international mobile subscriber identity; the pre-stored data is a dim table; and the accuracy index module 304 is specifically configured to obtain the mobile user integrated service digital number of each piece of stored data, query the international mobile subscriber identity corresponding to the mobile user integrated service digital number in the dim table according to the mobile user integrated service digital number, and determine that the stored data is accurate data if the international mobile subscriber identity corresponding to the mobile user integrated service digital number in the dim table is consistent with the international mobile subscriber identity in the mapping relationship; and calculate the accuracy index of the target full network data according to the number of accurate data records in all stored data.

[0098] In a possible design, the alarm output module 305 is specifically configured to send the alarm information to a maintenance terminal of a manager in a preset communication mode if the real-time index exceeds a first preset index threshold and / or the accuracy index exceeds a second preset index threshold.

[0099] In a possible design, the apparatus further includes a visualization module configured to display the real-time index and the accuracy index of the target full network data on a visual interface.

[0100] The apparatus provided in the embodiment can be used to execute the technical solutions of the method embodiments, and has similar implementation principles and technical effects, which will not be described here again in the embodiment.

[0101] Figure 4 A hardware structure schematic diagram of a service device provided in the embodiment is shown in the figure. The service device in the embodiment includes a processor 401 and a memory 402. Figure 4

[0102] The memory 402 is configured to store computer-executable instructions.

[0103] The processor 401 is configured to execute the computer-executable instructions stored in the memory, so as to implement each step performed by the service device in the above embodiment. For details, refer to the related description in the method embodiment.

[0104] Optionally, the memory 402 can be independent or integrated with the processor 401.

[0105] When the memory 402 is independent, the service device further includes a bus 403 configured to connect the memory 402 and the processor 401.

[0106] The embodiment of the present application further provides a computer storage medium, which stores computer-executable instructions. When the processor executes the computer-executable instructions, the network data quality alarm method is implemented.

[0107] The embodiment of the present application further provides a computer program product, which includes a computer program. When the computer program is executed by the processor, the network data quality alarm method is implemented. The embodiment of the present application further provides a computer program product, which includes a computer program. When the computer program is executed by the processor, the network data quality alarm method is implemented.

[0108] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other manners. For example, the above-described device embodiments are merely schematic, and the division of the modules is merely a logical function division, and there can be another division manner in actual implementation. For example, a plurality of modules or features can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections can be indirect couplings or communication connections through some interfaces, devices or modules, and can be electrical, mechanical or other forms.

[0109] The modules illustrated as separate components can or can not be physically separate, and the components illustrated as modules can or can not be physical units, i.e., can be located in one place, or can be distributed on a plurality of network units. Some or all of the modules can be selected according to actual needs to implement the present embodiment.​

[0110] In addition, each functional module in each embodiment of the present application can be integrated in one processing unit, or each module can be physically present alone, or two or more modules can be integrated in one unit. The above-mentioned modules can be realized in the form of hardware or in the form of hardware and software function modules.

[0111] The integrated modules realized in the form of software function modules can be stored in a computer readable storage medium. The software function modules are stored in a storage medium, including a plurality of instructions for causing a computer device server (which can be a personal computer, a server, or a network device, etc.) or a processor to execute part of the steps of the method described in each embodiment of the present application.

[0112] It should be understood that the above-mentioned processor can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), etc. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the application can be directly embodied as hardware processor execution or executed by a combination of hardware and software modules in the processor.

[0113] The memory can include a high-speed RAM memory, and can also include a non-volatile storage NVM, for example at least one disk memory, and can also be a U disk, a mobile hard disk, a read-only memory, a magnetic disk or an optical disk, etc.

[0114] The bus can be an industry standard architecture (ISA) bus, a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For the convenience of representation, the bus in the drawings of the present application does not limit to only one bus or one type of bus.

[0115] The aforementioned storage medium can be realized by any type of volatile or nonvolatile storage devices or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic storage, a flash memory, a magnetic disk or an optical disk. The storage medium can be any available medium that can be accessed by a general or special purpose computer.

[0116] An exemplary storage medium is coupled to the processor so that the processor can read information from, and write information to, the storage medium. Of course, the storage medium can be a part of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC). Of course, the processor and the storage medium can exist as discrete components in the electronic device or host device.

[0117] Those skilled in the art can understand that all or part of the steps of the above-mentioned method embodiments can be completed by relevant hardware of program instructions. The aforementioned program can be stored in a computer readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and various storage media that can store program codes.

[0118] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions recorded in the above embodiments, or make equivalent replacement for part or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for network data quality alarm, characterized in that, include: The system acquires all network data from the communication system in real time and stores the all network data in a big data cluster. Extract all stored full network data from the big data cluster at preset time intervals as target full network data; Obtain the storage path of the target full network data, and obtain the storage information of the target full network data based on the storage path; Based on the storage information of the target full network data, the real-time index of the target full network data is calculated; Obtain the target fields of each stored data item in the target full network data; The accuracy index of the target full network data is obtained by comparing the target fields of each stored data with the pre-stored data. Based on the real-time performance index and the accuracy index, output alarm information for the full network data; The process of obtaining the storage path of the target full network data and calculating the real-time performance index of the target full network data includes: Obtain the storage path of the storage table that stores the target full network data, wherein the storage table includes each piece of stored data that makes up the target full network data; Iterate through the storage capacity and last modification time of each piece of stored data in the storage table within the storage path; Calculate the real-time performance index of the target full network data based on the storage capacity and last modification time of each piece of stored data; The formula for calculating the real-time performance index of the target full network data based on the storage capacity and last modification time of each piece of stored data is as follows: In the formula, For real-time indicators; Storage capacity for storing data; The last modification time of the stored data; The time partition to which the stored data belongs; The target field includes the mapping relationship between the mobile user's integrated service number and the International Mobile Subscriber Identity Registry (IMR); the pre-stored data is the dimension table dim; the accuracy indicators for obtaining the target full network data include: Obtain the China Mobile Integrated Service Number (CSN) for each piece of stored data, and query the International Mobile Subscriber Identity (IMI) corresponding to the CSN in the dim table based on the CSN. If the International Mobile Subscriber Identity (IMSI) corresponding to the mobile user integrated service number in the dim table matches the IMSI in the mapping relationship, then the stored data is determined to be accurate data. The accuracy index of the target full network data is calculated based on the number of records of accurate data in all stored data.

2. The method according to claim 1, characterized in that, The formula for calculating the accuracy index of the target full network data based on the number of accurate data records in all stored data is as follows: In the formula, For accuracy indicators; The number of records containing accurate data in all stored data; This represents the total number of records containing all stored data.

3. The method according to claim 1, characterized in that, The step of outputting alarm information for the full network data based on the real-time performance indicator and the accuracy indicator includes: If the real-time performance indicator exceeds the first preset threshold, and / or the accuracy indicator exceeds the second preset threshold, the alarm information will be sent to the maintenance terminal of the administrator according to the preset communication method.

4. The method according to claim 1, characterized in that, Before outputting the alarm information for the full network data based on the real-time performance index and the accuracy index, the method further includes: The real-time performance and accuracy metrics of the target full network data are displayed in a visual interface.

5. A network data quality alarm device, characterized in that, include: The acquisition module is used to acquire the full network data of the communication system in real time and store the full network data in a big data cluster. The extraction module is used to extract all stored full network data from the big data cluster at preset time intervals as target full network data. The real-time performance indicator module is used to obtain the storage path of the target full network data and obtain the storage information of the target full network data based on the storage path. Based on the storage information of the target full network data, the real-time index of the target full network data is calculated; The accuracy indicator module is used to obtain the target fields of each stored data in the target full network data; The accuracy index of the target full network data is obtained by comparing the target fields of each stored data with the pre-stored data. An alarm output module is used to output alarm information of the full network data based on the real-time performance index and the accuracy index. The real-time performance indicator module is specifically used for: Obtain the storage path of the storage table that stores the target full network data, wherein the storage table includes each piece of stored data that makes up the target full network data; Iterate through the storage capacity and last modification time of each piece of stored data in the storage table within the storage path; Calculate the real-time performance index of the target full network data based on the storage capacity and last modification time of each piece of stored data; The formula for calculating the real-time performance index of the target full network data based on the storage capacity and last modification time of each piece of stored data is as follows: In the formula, For real-time indicators; Storage capacity for storing data; The last modification time of the stored data; The time partition to which the stored data belongs; The target field includes the mapping relationship between the mobile user integrated service number and the international mobile subscriber identification number; the pre-stored data is the dimension table dim; The accuracy indicator module is specifically used for: Obtain the China Mobile Integrated Service Number (CSN) for each piece of stored data, and query the International Mobile Subscriber Identity (IMI) corresponding to the CSN in the dim table based on the CSN. If the International Mobile Subscriber Identity (IMSI) corresponding to the mobile user integrated service number in the dim table matches the IMSI in the mapping relationship, then the stored data is determined to be accurate data. The accuracy index of the target full network data is calculated based on the number of records of accurate data in all stored data.

6. A service device, characterized in that, include: At least one processor and memory; The memory stores computer-executed instructions; The at least one processor executes computer execution instructions stored in the memory, causing the at least one processor to perform the network data quality alarm method as described in any one of claims 1 to 4.

7. A computer storage medium, characterized in that, The computer storage medium stores computer execution instructions, and when the processor executes the computer execution instructions, it implements the network data quality alarm method as described in any one of claims 1 to 4.

Images