Index data processing method and system, electronic device and readable storage medium

By collecting and processing business data in real time in the number portable system and transmitting it to the blockchain platform, the stability and reliability problems of data collection and storage in the existing technology are solved, and the accuracy of NP systems is achieved Real-time data acquisition and traceability avoid data loss and system impact.

CN115484590BActive Publication Date: 2024-11-26CHINA MOBILE INFORMATION TECHNOLOGY CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110668232.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-06-16
Publication Date
2024-11-26
Estimated Expiration
2041-06-16

AI Technical Summary

Technical Problem

The prior art cannot realize zero intrusion of NP system business data by data acquisition programs and reliability of data storage without affecting the stable operation of the monitored system, especially when the FTP host is down or disk space failure may cause data. Lost issue.

Method used

The network-wide monitoring system and the number portable system jointly set the indicator monitoring frequency, use the third-party plug-in Debezium to collect business data in real time, and write it to the Kafka message queue for real-time processing and storage, and then the indicator data is in file form Transfer to the blockchain platform to achieve data traceability and security.

Benefits of technology

It realizes quasi-real-time data collection and storage of NP service systems, shortens problem perception time, improves problem processing efficiency, and avoids data loss, ensuring stable system operation and data traceability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115484590B_ABST
    Figure CN115484590B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention provides an indicator data processing method and system, an electronic device and a readable storage medium, wherein the method includes: based on the indicator monitoring frequency jointly set by the whole network monitoring system and the number portability system, real-time collection of the service data of the number portability system; after processing the service data of the number portability system, storing the formed indicator data; transmitting the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of files. The embodiment of the present invention uploads the generated number portability system configuration file, indicator definition information and statistical data to the blockchain platform, realizes the traceability of NP business system problems and the status tracking of the whole process of generating and monitoring the whole network monitoring indicator file, and solves the support of the whole network monitoring system for the number portability business operation data monitoring indicators.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of number portability, and in particular to an indicator data processing method and system, an electronic device and a readable storage medium. Background Art

[0002] The information of ported numbers is stored in the distributed database of ported numbers. Monitoring indicators refer to the categories of data used to monitor the service system. For example, for the ported service system, the data used to monitor the service system includes three categories: system request volume, request failure volume, and request success rate. These three types of data are used as three indicators, namely system request volume, request failure volume, and request success rate. Indicator data is the value of a certain monitoring indicator. For example, if there are 80 requests for business, then the monitoring indicator is the request volume, and the indicator data of the monitoring indicator is 80. Indicator configuration refers to configuring relevant information for each indicator, such as configuring the encoding of the indicator, the calculation properties of the indicator, such as whether it is a quantity calculation or a rate calculation.

[0003] The existing scheme discloses obtaining multiple monitoring dimensions associated with each monitoring business, and at least one pair of monitoring indicator data including an indicator name and an indicator value; converting multiple monitoring dimensions into multiple row keyword mapping values ​​of the same length; combining monitoring time with multiple row keyword mapping values ​​as row keywords, and setting the monitoring time at a fixed time position in the row keywords; storing monitoring indicators in a distributed database with the row keywords as indexes. And the cloud platform obtains the monitoring data corresponding to each monitoring indicator information and writes it into the monitoring data detail table in the distributed database Hbase; when it is determined that the storage load of the cluster server storing the monitoring data detail table exceeds the preset load threshold, a technical solution of adding a cluster server for storing the monitoring data detail table is provided.

[0004] However, these technical solutions cannot achieve the headquarters NP system, without affecting the stable operation of the monitored system, by actively outputting statistical results through the system, with N as the collection interval, and obtaining core business statistical results data within N minutes each time, so that the whole network monitoring can obtain system operation data information offline. It is impossible to achieve zero intrusion of the data collection program on the NP system business data, and it is impossible to prevent data loss caused by problems such as FTP host crashes and disk space failures.

[0005] In the prior art, the business processing of collected data needs to be bundled with the business system (i.e. the monitored system), which has the following problems:

[0006] First, if there is a problem with the data collection business and it needs to be repaired, the business system needs to be modified and improved. In this way, although the problem lies in the data collection business, it also affects the business system;

[0007] Secondly, putting the data collection business and the business system together, even if the data collection business runs smoothly and normally without any problems, it will consume part of the system resources and have a certain impact on the performance of the business system.

[0008] Thirdly, the collected data files are stored on the FTP host. If data transmission is required, the permissions of the FTP host need to be opened. Then the system will also face security issues caused by opening the FTP host permissions. Summary of the invention

[0009] The present invention provides an indicator data processing method and system, an electronic device and a readable storage medium, which are used to solve the technical defects existing in the prior art.

[0010] The present invention provides an indicator data processing method, comprising:

[0011] Based on the indicator monitoring frequency jointly set by the whole network monitoring system and the number portability system, the service data of the number portability system is collected in real time;

[0012] After processing the service data of the number porting system, the generated index data is stored;

[0013] The number portability system configuration file, indicator definition information and statistical data generated based on the indicator data are transmitted to the blockchain platform in the form of files.

[0014] According to the indicator data processing method of the embodiment of the present invention, the real-time collection of service data of the number portability system specifically includes:

[0015] A third-party plug-in Debezium is used to establish a Kafka connection and process the monitoring data binlog in real time, so as to realize the real-time collection of the business data of the number portability system and write the collected business data into the Kafka message queue in real time.

[0016] According to the indicator data processing method of the embodiment of the present invention, after processing the service data of the number porting system, storing the formed indicator data includes:

[0017] By real-time monitoring of the kafka, the indicator metadata Record data is obtained, the indicator data is formed by cleaning, assembling and converting the Record data, and the indicator data is written into the search engine to realize the storage of the indicator data.

[0018] According to the indicator data processing method of the embodiment of the present invention, the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data are transmitted to the blockchain platform in the form of a file, including:

[0019] Build blockchain data on-chain request service based on blockchain application private key;

[0020] Based on the file, generate a HASH value corresponding to the file to be uploaded to the chain;

[0021] Based on the blockchain data on-chain request service and the HASH value corresponding to the file, the corresponding file is transferred to the blockchain platform using the number portability system, and a data consensus is reached.

[0022] According to the indicator data processing method of the embodiment of the present invention, after transmitting the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of a file, it also includes:

[0023] The whole network monitoring system is used to obtain the HASH value corresponding to the file, and the data is obtained from the blockchain platform.

[0024] According to the indicator data processing method of the embodiment of the present invention, after transmitting the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of a file, it also includes:

[0025] Obtain the account and account private key of the blockchain platform, construct a token request structure for obtaining blockchain upload, and the blockchain platform gateway verifies the user information, generates token data and returns it.

[0026] According to the indicator data processing method of the embodiment of the present invention, after transmitting the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of a file, it also includes:

[0027] Back up the files to the backup directory and delete the files in the transfer directory;

[0028] Based on the preset strategy, the files in the backup directory are cleaned up regularly.

[0029] An indicator data processing system, comprising:

[0030] A data collection module, used to collect service data of the number portability system in real time based on the indicator monitoring frequency jointly set by the whole network monitoring system and the number portability system;

[0031] A data storage module, used for storing the index data formed after processing the service data of the number portability system;

[0032] The blockchain data transmission module is used to transmit the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of files.

[0033] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of any of the above-mentioned index data processing methods are implemented.

[0034] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of any of the above-mentioned indicator data processing methods are implemented.

[0035] The embodiment of the present invention collects the service data of the number portability system in real time based on the indicator monitoring frequency jointly set by the whole network monitoring system and the number portability system, so that the indicator data of the whole network monitoring is quasi-real time, which shortens the perception time of the problem; in the embodiment of the present invention, the generated number portability system configuration file, indicator definition information and statistical data are uploaded to the blockchain platform, which realizes the traceability of NP business system problems and the status tracking of the whole process of generating and monitoring the whole network monitoring indicator file, and solves the support of the whole network monitoring system for the number portability business operation data monitoring indicators. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0037] Figure 1 It is a flowchart of an indicator data processing method provided by an embodiment of the present invention;

[0038] Figure 2 It is a schematic diagram of a process of uploading a data file to a blockchain platform in an indicator data processing method provided by an embodiment of the present invention;

[0039] Figure 3 is a schematic diagram of an indicator data processing system provided by an embodiment of the present invention;

[0040] Figure 4 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0041] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0042] The embodiment of the present invention discloses a method for processing index data. Figure 1 ,include:

[0043] S1. Based on the indicator monitoring frequency jointly set by the whole network monitoring system and the number portability (i.e., NP) system, real-time collection of service data of the number portability system is performed;

[0044] The indicator monitoring frequency is generally agreed upon by the number portability system and the whole network monitoring system, and can be set as needed, for example, it can be set to once every 15 minutes or half an hour. The business data of the number portability system is regularly collected in real time according to the indicator monitoring frequency. The whole network monitoring system refers to a mobile whole network monitoring system. Because the data collection program in the embodiment of the present invention is an independent program, it runs independently and has no impact on the business system, so the data collection program and the NP system are completely decoupled. Since data collection is real-time, the timeliness of the whole network monitoring data is improved. The headquarters NP system is realized by actively outputting statistical results through the system without affecting the stable operation of the monitored system, with N as the collection interval, and obtaining the core business statistical result data within N minutes each time, so that the whole network monitoring obtains system operation data information offline; the data collection program in the embodiment of the present invention is an independent program, which runs independently and has no impact on the business system.

[0045] S2. After processing the service data of the number porting system, the generated index data is stored;

[0046] The processed index data is written into the search engine for storage. Because the data collected in the embodiment of the present invention is the binlog log of MySQL, and the data is cleaned and converted, rather than directly using business data, the embodiment of the present invention achieves zero intrusion of the data collection program into the business data of the NP system.

[0047] S3. Transmit the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of files.

[0048] Configuration file: Indicator configuration refers to configuring relevant information for each indicator, such as the encoding of the configuration indicator, the calculation properties of the indicator, such as whether it is a quantity calculation or a rate calculation, etc.

[0049] Formulate indicator definition information: According to the dimensions of business monitoring of global monitoring, formulate detailed monitoring indicator details, including: indicator name, indicator code, monitoring object code, business name, business code and other information.

[0050] Statistical data: According to the needs of data statistics business, the index data of the Xiezhuan search engine is queried regularly, and the corresponding aggregate calculation is performed according to the business rules. For example, the business volume, business success rate, average time for NP to process business within the specified time, and business that has timed out are calculated. The statistics of Xiezhuan data's full network monitoring indicators shorten the perception time of business problems and improve the efficiency of problem handling.

[0051] The number portability system configuration files, indicator definition information and statistical data are transmitted to the blockchain platform in the form of files; combined with the blockchain platform, the data is stored on the blockchain platform, which effectively solves the problem of data loss caused by disk failure in the traditional disk. The traceability of NP business system problems is achieved. The data statistics calculation tasks and data file upload tasks in the embodiment of the present invention realize the status tracking of the entire process of generating monitoring index files for the entire network.

[0052] The embodiment of the present invention collects the service data of the number portability system in real time based on the indicator monitoring frequency jointly set by the whole network monitoring system and the number portability system, so that the indicator data of the whole network monitoring is quasi-real-time, which shortens the perception time of the problem; in the embodiment of the present invention, the generated number portability system configuration file, indicator definition information and statistical data are uploaded to the blockchain platform, so that the traceability of NP business system problems is realized. And the status tracking of the entire process of generating monitoring indicator files for the entire network solves the support of the entire network monitoring system for the monitoring indicators of the operation data of the number portability service.

[0053] According to the indicator data processing method of the embodiment of the present invention, the real-time collection of service data of the number portability system specifically includes:

[0054] A third-party plug-in Debezium is used to establish a Kafka connection and process the monitoring data binlog in real time, so as to realize the real-time collection of the business data of the number portability system and write the collected business data into the Kafka message queue in real time.

[0055] According to the indicator data processing method of the embodiment of the present invention, after processing the service data of the number porting system, storing the formed indicator data includes:

[0056] By real-time monitoring of the kafka, the indicator metadata Record data is obtained, the indicator data is formed by cleaning, assembling and converting the Record data, and the indicator data is written into the search engine to realize the storage of the indicator data.

[0057] The specific operations of cleaning and converting data are as follows: For example, the NP system generates a piece of business data, but when the monitoring system obtains this data, what is needed is not this business data, but to determine whether the business data is processed successfully or failed based on this business data. At this time, the business data needs to be cleaned and converted into indicator data.

[0058] According to the indicator data processing method of the embodiment of the present invention, the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data are transmitted to the blockchain platform in the form of a file, including:

[0059] Build blockchain data on-chain request service based on blockchain application private key;

[0060] Based on the file, generate a HASH value corresponding to the file to be uploaded to the chain;

[0061] Based on the blockchain data on-chain request service and the HASH value corresponding to the file, the corresponding file is transmitted to the blockchain platform using the number portability system, and a data consensus is reached, that is, the blockchain data transmission process is realized.

[0062] According to the indicator data processing method of the embodiment of the present invention, after transmitting the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of a file, it also includes:

[0063] The whole network monitoring system is used to obtain the HASH value corresponding to the file, and the data is obtained from the blockchain platform.

[0064] According to the indicator data processing method of the embodiment of the present invention, after transmitting the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of a file, it also includes:

[0065] Obtain the account and account private key of the blockchain platform, construct a token request structure for obtaining blockchain upload, and the blockchain platform gateway verifies the user information, generates token data and returns it. The above is the process of obtaining blockchain platform services.

[0066] According to the indicator data processing method of the embodiment of the present invention, after transmitting the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of a file, it also includes:

[0067] Back up the files to the backup directory and delete the files in the transfer directory;

[0068] Based on the preset strategy, the files in the backup directory are cleaned up regularly.

[0069] In a specific embodiment, the process of the indicator data processing method of the present invention is as follows:

[0070] Collect the monitoring data of the Xiezhuan indicators in real time and store them in the Xiezhuan database; enable the monitoring data binlog. The monitoring data binlog is a binary log, which records all changes on the database and saves it in binary form on the disk. It can be used to view the database change history, database incremental backup and recovery, and MySQL replication.

[0071] Start the data transfer message queue Kafka.

[0072] Start the Kafka producer that carries the data message queue.

[0073] Use the third-party tool Debezium to establish KafkaConnect to process monitoring data binlog in real time.

[0074] Start the Kafka consumer that carries the data message queue.

[0075] Use Kafka consumers to obtain message records, clean, assemble, and convert the data to form indicator data, and write the indicator data into the search engine.

[0076] Start the scheduled task of calculating the monitoring index data of the whole network: according to the needs of data statistics business, regularly query the index data in the search engine, and perform corresponding aggregation calculations according to business rules. For example, calculate the business volume, business success rate, average time for NP to process business within the specified time, and business that processes timeouts, etc. After calculating the index data, all statistical data are obtained.

[0077] Obtain network-wide monitoring indicator data from the search engine based on business.

[0078] Generate CSV (comma separated value) files for the monitoring indicator data of the entire network at set intervals.

[0079] The transfer system builds a blockchain data on-chain request service based on the blockchain application private key, i.e. user information.

[0080] The transfer system generates the corresponding HASH value of the data to be uploaded to the chain.

[0081] The corresponding data files are transferred to the blockchain platform by requesting the system data to be uploaded to the chain, and a data consensus is reached.

[0082] Start the scheduled task of cleaning up historical backup files.

[0083] The business data in the embodiment of the present invention is written into the database in real time, so the binlog log generated by writing into the database is also real-time, and the data source of the indicator statistics of the whole network monitoring is the binlog log generated by the database, so the indicator statistics of the whole network monitoring are quasi-real-time. Since the indicator statistics of the whole network monitoring are quasi-real-time, when a problem occurs in the system, the problem can be discovered in the first time, thereby shortening the time to perceive the problem.

[0084] See also Figure 2 , Figure 2 The following is a schematic diagram of uploading data files to the blockchain platform, downloading files to a third-party system, and a more specific process of processing files after the data is downloaded from the blockchain, including:

[0085] Step 101, start a monitoring indicator data file task;

[0086] Step 102: Execute the monitoring indicator data statistics calculation task;

[0087] Step 103: Obtain monitoring indicator data and generate a CSV file;

[0088] Step 104: Upload the file to the blockchain platform;

[0089] Step 105, start the file data uplink transmission task;

[0090] Step 106: Execute the file data chain transmission task and transmit the data to the blockchain platform;

[0091] Step 107: Back up the files to the backup directory and delete the files in the transfer directory;

[0092] Step 108: Clean up files in the backup directory regularly and strategically.

[0093] The embodiment of the present invention discloses an indicator data processing system, see Figure 3 ,include:

[0094] The data collection module 10 is used to collect the service data of the number portability system in real time based on the indicator monitoring frequency jointly set by the whole network monitoring system and the number portability system;

[0095] The indicator monitoring frequency is generally agreed upon by the number portability system and the whole network monitoring system, and can be set as needed, for example, it can be set to once every 15 minutes or half an hour. The business data of the number portability system is regularly collected in real time according to the indicator monitoring frequency. The whole network monitoring system refers to a mobile whole network monitoring system. Because the data collection program in the embodiment of the present invention is an independent program, it runs independently and has no impact on the business system, so the data collection program and the NP system are completely decoupled. Since data collection is real-time, the timeliness of the whole network monitoring data is improved. The headquarters NP system is realized by actively outputting statistical results through the system without affecting the stable operation of the monitored system, with N as the collection interval, and obtaining the core business statistical result data within N minutes each time, so that the whole network monitoring obtains system operation data information offline; the data collection program in the embodiment of the present invention is an independent program, which runs independently and has no impact on the business system.

[0096] A data storage module 20, for storing the index data formed after processing the service data of the number porting system;

[0097] The processed index data is written into the search engine for storage. Because the data collected in the embodiment of the present invention is the binlog log of MySQL, and the data is cleaned and converted, rather than directly using business data, the embodiment of the present invention achieves zero intrusion of the data collection program into the business data of the NP system.

[0098] The blockchain data transmission module 30 is used to transmit the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of files.

[0099] Configuration file: Indicator configuration refers to configuring relevant information for each indicator, such as the encoding of the configuration indicator, the calculation properties of the indicator, such as whether it is a quantity calculation or a rate calculation, etc.

[0100] Preferably, the index data processing system, the data acquisition module 10 is specifically used for:

[0101] A third-party plug-in Debezium is used to establish a Kafka connection and process the monitoring data binlog in real time, so as to realize the real-time collection of the business data of the number portability system and write the collected business data into the Kafka message queue in real time.

[0102] Preferably, in the indicator data processing system, the data storage module 20 is used for:

[0103] By real-time monitoring of the kafka, the indicator metadata Record data is obtained, the indicator data is formed by cleaning, assembling and converting the Record data, and the indicator data is written into the search engine to realize the storage of the indicator data.

[0104] Preferably, in the indicator data processing system, the blockchain data transmission module 30 is used to:

[0105] Build blockchain data on-chain request service based on blockchain application private key;

[0106] Based on the file, generate a HASH value corresponding to the file to be uploaded to the chain;

[0107] Based on the blockchain data on-chain request service and the HASH value corresponding to the file, the corresponding file is transferred to the blockchain platform using the number portability system, and a data consensus is reached.

[0108] Preferably, the indicator data processing system further comprises a file acquisition module, and the file acquisition module is used to:

[0109] The whole network monitoring system is used to obtain the HASH value corresponding to the file, and the data is obtained from the blockchain platform.

[0110] Preferably, the indicator data processing system further comprises a service acquisition module, and the service acquisition module is used to:

[0111] Obtain the account and account private key of the blockchain platform, construct a token request structure for obtaining blockchain upload, and the blockchain platform gateway verifies the user information, generates token data and returns it.

[0112] Preferably, the indicator data processing system further comprises a file updating module, and the file updating module is used to:

[0113] Back up the files to the backup directory and delete the files in the transfer directory;

[0114] Based on the preset strategy, the files in the backup directory are cleaned up regularly.

[0115] Figure 4An example of a physical structure diagram of an electronic device is shown, and the electronic device may include: a processor 310, a communication interface 320, a memory 330, and a communication bus 340, wherein the processor 310, the communication interface 320, and the memory 330 communicate with each other through the communication bus 340. The processor 310 may call the logic instructions in the memory 330 to execute an indicator data processing method, and the method includes:

[0116] S1. Based on the indicator monitoring frequency jointly set by the whole network monitoring system and the number portability system, real-time collection of service data of the number portability system is performed;

[0117] S2. After processing the service data of the number porting system, the generated index data is stored;

[0118] S3. Transmit the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of files.

[0119] In addition, the logic instructions in the above-mentioned memory can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0120] On the other hand, the present invention further provides a computer program product, the computer program product comprising a computer program stored on a non-transitory computer-readable storage medium, the computer program comprising program instructions, and when the program instructions are executed by a computer, the computer can execute an indicator data processing method, the method comprising:

[0121] S1. Based on the indicator monitoring frequency jointly set by the whole network monitoring system and the number portability system, real-time collection of service data of the number portability system is performed;

[0122] S2. After processing the service data of the number porting system, the generated index data is stored;

[0123] S3. Transmit the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of files.

[0124] In another aspect, the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, an indicator data processing method is implemented, the method comprising:

[0125] S1. Based on the indicator monitoring frequency jointly set by the whole network monitoring system and the number portability system, real-time collection of service data of the number portability system is performed;

[0126] S2. After processing the service data of the number porting system, the generated index data is stored;

[0127] S3. Transmit the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of files.

[0128] The system embodiment described above is merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art may understand and implement it without creative work.

[0129] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0130] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for processing index data, characterized in that: include: Based on the indicator monitoring frequency jointly set by the whole network monitoring system and the number portability system, the service data of the number portability system is collected in real time; After processing the service data of the number portability system, the generated index data is stored; Transmitting the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of files; The real-time collection of service data of the number portability system specifically includes: A third-party plug-in Debezium is used to establish a Kafka connection and process the monitoring data binlog in real time, so as to realize the real-time collection of the business data of the number portability system and write the collected business data into the Kafka message queue in real time.

2. The indicator data processing method according to claim 1, characterized in that: After processing the service data of the number porting system, storing the formed indicator data includes: By real-time monitoring of the kafka, the indicator metadata Record data is obtained, the indicator data is formed by cleaning, assembling and converting the Record data, and the indicator data is written into the search engine to realize the storage of the indicator data.

3. The indicator data processing method according to claim 2, characterized in that: The transmitting of the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of a file includes: Build blockchain data on-chain request service based on blockchain application private key; Based on the file, generate a HASH value corresponding to the file to be uploaded to the chain; Based on the blockchain data on-chain request service and the HASH value corresponding to the file, the corresponding file is transferred to the blockchain platform using the number portability system, and a data consensus is reached.

4. The indicator data processing method according to claim 3, characterized in that: After the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data are transmitted to the blockchain platform in the form of a file, it also includes: The whole network monitoring system is used to obtain the HASH value corresponding to the file, and the data is obtained from the blockchain platform.

5. The index data processing method according to claim 3, characterized in that: After the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data are transmitted to the blockchain platform in the form of a file, it also includes: Obtain the account and account private key of the blockchain platform, construct a token request structure for obtaining blockchain upload, and the blockchain platform gateway verifies the user information, generates token data and returns it.

6. The index data processing method according to claim 3, characterized in that: After the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data are transmitted to the blockchain platform in the form of a file, it also includes: Back up the files to the backup directory and delete the files in the transfer directory; Based on the preset strategy, the files in the backup directory are cleaned up regularly.

7. An indicator data processing system, characterized in that: include: A data collection module, used to collect service data of the number portability system in real time based on the indicator monitoring frequency jointly set by the whole network monitoring system and the number portability system; A data storage module, used for storing the index data formed after processing the service data of the number portability system; A blockchain data transmission module, used to transmit the number portability system configuration file, indicator definition information and statistical data generated based on the indicator data to the blockchain platform in the form of files; The real-time collection of service data of the number portability system specifically includes: A third-party plug-in Debezium is used to establish a Kafka connection and process the monitoring data binlog in real time, so as to realize the real-time collection of the business data of the number portability system and write the collected business data into the Kafka message queue in real time.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the steps of the indicator data processing method according to any one of claims 1 to 6 are implemented.

9. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the indicator data processing method according to any one of claims 1 to 6 are implemented.