A nuclear power metadata storage management method and system

Abstract

A nuclear power metadata storage management method and system are used to record and manage metadata generated during the operation of nuclear power data transmission, wherein the acquisition metadata at least includes the name of the measuring point, the acquisition time period, and the corresponding amount of collected data in the acquisition time period, wherein the amount of collected data is used to characterize the total amount of collected data on the specified date of the measuring point; the transmission metadata is used to characterize the data information recorded in the transmission process, including the task name, the transmission cycle, and the total number of folders and the total number of files transmitted within the transmission cycle; the storage metadata at least includes the name of the measuring point, the writing time period, and the corresponding amount of written data in the writing time period, wherein the amount of written data is used to characterize the total amount of written data stored in the center side of the measuring point on the specified date; the metadata processing module obtains the above-mentioned various types of metadata and then analyzes them to achieve the location of the problem link and the statistics of massive nuclear power time series data.

Description

Technical Field

[0001] The present invention belongs to the technical field of nuclear power data processing, and in particular relates to a nuclear power metadata storage management method and system. Background Art

[0002] The edge side of the nuclear power industrial Internet platform accesses and stores massive time series data of the power plant. According to the characteristics of nuclear power data business, time series data can be divided into real-time data and historical data. In the process of transmitting real-time data and historical data from the edge side to the center side, the problem of incomplete and unreliable data is often encountered. Among them, real-time data has the characteristics of real-time and short-term caching. In the full data link of implementing real-time data access based on the nuclear power industrial Internet platform, data collection, data caching, data distribution, data storage and other processes are involved. In the process of real-time data transmission, there may be program errors, network interruptions, system upgrades and other uncertain factors that cause real-time data access interruptions. In addition, when data transmission fails, there are still problems that the system cannot automatically trace errors and data compensation. Historical data has the characteristics of large data volume and large time span. Due to the long historical transmission link and many data flow links, the data finally stored in the nuclear power industrial Internet platform is incomplete. Due to the long transmission link and many data flow links, it is currently impossible to effectively locate and analyze the problem links in time. Summary of the invention

[0003] In view of this, it is necessary to provide a nuclear power metadata storage management method and system to solve the problem of locating the link in the process of data transmission from the edge side to the center side.

[0004] The present invention provides a nuclear power metadata storage management method, which is used to record and manage various metadata generated during the operation of nuclear power data transmission and to process various metadata, wherein the metadata includes acquisition metadata, transmission metadata and storage metadata;

[0005] The acquisition metadata is generated based on historical data acquisition log records and / or real-time data acquisition log records, and each of the storage metadata at least includes a measuring point name, a writing time period, and a writing data volume corresponding to the writing time period, wherein the writing data volume is used to characterize the total amount of writing data stored at the measuring point on the center side on a specified date;

[0006] The transmission metadata is generated based on the transmission log record of each historical data transmission from the edge side to the center side. The transmission metadata is used to characterize the data information recorded during the transmission process. The transmission metadata at least includes the task name, the transmission period, and the total number of folders and files transmitted during the transmission period.

[0007] The storage metadata is generated based on each write record of real-time data and historical data written to the target database, and each storage metadata includes at least a measuring point name, a writing time period, and the amount of written data corresponding to the writing time period, wherein the amount of written data is used to characterize the total amount of written data stored at the measuring point on the center side on a specified date.

[0008] Preferably, each piece of the collected metadata stores the amount of collected data for a specified measuring point in one year, and the collected metadata includes the measuring point name, year, and the amount of collected data for the whole year, and all the collected data amounts corresponding to the specified year are stored in the collection metadata in chronological order.

[0009] Preferably, each storage metadata stores the amount of written data for a specified measuring point in one year, and the storage metadata includes the measuring point name, year, and the amount of written data for the whole year, wherein the amount of written data corresponding to the specified year is stored in the storage metadata in chronological order.

[0010] Preferably, the amount of collected data or written data corresponding to a specified year is converted into data in a specified base and then stored in the storage metadata in chronological order.

[0011] Preferably, processing the various metadata includes performing problem link location analysis based on the metadata, and the problem link location analysis includes the following steps:

[0012] S1 obtains the time range and measurement point range of the data to be located;

[0013] S2, for each measuring point within the measuring point range, respectively finding the corresponding collected data volume, file volume and written data volume from the collected metadata, the transmission metadata and the storage metadata based on the time range;

[0014] S3 determines whether a corresponding file exists based on the value of each collected data volume and written data volume. If the value is not 0, it is determined that the file exists, and the corresponding total amount of collected files and the total amount of stored files are obtained after aggregation;

[0015] S4 compares the total amount of collected files, the total amount of stored files, and the file amount. If one of the sets of quantities is different, it is determined that there is a problem in the corresponding link.

[0016] or

[0017] S1' obtains the time range and measuring point range of the data to be located;

[0018] S2′, for each measuring point within the measuring point range, respectively finding the corresponding measuring point name and the number of folders from the acquisition metadata, transmission metadata and storage metadata;

[0019] S3' counts the number of measuring point names found in the collection metadata and the storage metadata to obtain the total number of corresponding collection folders and the total number of storage folders, wherein if the corresponding measuring point name is found, it is determined that the corresponding folder exists;

[0020] S4' compares the total amount of collected folders, the total amount of stored folders and the amount of files. If one of the groups of quantities is different, it is determined that there is a problem in the corresponding link.

[0021] Furthermore, in the step S4', if the value of the total amount of collected files or the total amount of stored files is different, it also includes: for each measuring point, comparing the amount of written data and the amount of collected data on the corresponding date within the specified time range, if it is judged that the two are inconsistent, it is judged that there is a problem in the nuclear power data transmission operation process on the corresponding date.

[0022] Preferably, the metadata also includes archiving metadata, which is generated based on the archiving record of each historical data in the transit database being archived to the archiving database, and each of the archiving metadata includes at least the archive file name, archive file size, archive file path, archive time and the task to which it belongs.

[0023] Furthermore, processing the various metadata to locate the problem link includes the following steps:

[0024] A. Obtain the time range and measurement point range of the data to be located;

[0025] B. for each measuring point within the measuring point range, finding the corresponding archive file path from the archive metadata based on the time range, and downloading the corresponding archive data from the archive database based on the archive file path; at the same time, finding the corresponding written data volume from the storage metadata based on the time range;

[0026] C. counting the amount of archived data based on the archived data, and comparing the amount of archived data with the amount of written data;

[0027] If C1 and C2 are equal, it is judged that there may be problems in the acquisition link and the transmission link; then

[0028] C11, for each measuring point within the measuring point range, respectively finding the corresponding collected data volume and file volume from the collected metadata and the transmitted metadata based on the time range;

[0029] C12 determines whether there is a corresponding file based on the value of each collected data volume and written data volume. If the value is not 0, it is determined that the file exists, and the corresponding total amount of collected files and the total amount of stored files are obtained after aggregation;

[0030] C13 compares the total amount of collected files, the total amount of stored files, and the file amount. If one of the sets of quantities is different, it is determined that there is a problem in the corresponding link.

[0031] or

[0032] C11′ for each measuring point within the measuring point range, respectively finding the corresponding measuring point name and the number of folders from the acquisition metadata, transmission metadata and storage metadata based on the time range;

[0033] C12' counts the number of measuring point names found in the acquisition metadata and the storage metadata to obtain the corresponding total amount of acquisition folders and the total amount of storage folders, wherein if the corresponding measuring point name is found, it is determined that the corresponding folder exists;

[0034] C13' compares the total amount of collected folders, the total amount of stored folders and the amount of files. If one of the groups of quantities is different, it is determined that there is a problem in the corresponding link.

[0035] C2 If the amount of archived data is greater than the amount of written data, it is determined that there is a problem in the writing process.

[0036] Furthermore, processing of each type of metadata includes performing asset analysis based on the archived metadata, and the asset analysis includes obtaining a task name, obtaining an archived file path from the corresponding archived metadata based on the task name, and downloading corresponding data from the archived database based on the archived file path to perform asset analysis.

[0037] Preferably, processing the metadata of each type further includes performing periodic analysis based on the metadata, and the periodic analysis includes one or more combinations of the following:

[0038] For the collection metadata, after obtaining the measuring point name and the query time period, the collection records of the corresponding collection metadata are obtained based on the measuring point name and the query time period and displayed, including displaying the daily collection status of the measuring point, or displaying the collection status of the measured points by year; or, using the collection metadata to count the data source distribution of the collected data;

[0039] Or, for storage metadata, after obtaining the measuring point name and the query time period, the corresponding storage metadata is obtained based on the measuring point name and the query time period and the record of the measuring point stored in the target database is displayed;

[0040] Or, for the transmission metadata, after obtaining the task name, the corresponding transmission metadata is obtained based on the task name to display the total number of folders and the total number of files stored therein.

[0041] Preferably, the metadata also includes measurement point metadata, which is used for the management of measurement point metadata in the source database on the edge side and the target database on the center side, wherein the measurement point metadata at least includes the measurement point name, power plant, unit, system, system code, equipment name and equipment code.

[0042] The present invention also provides a nuclear power metadata storage management system, which is used to record and manage metadata generated during the operation of nuclear power data transmission, including a collection metadata management module, a transmission metadata management module, a storage metadata management module and a metadata processing module;

[0043] The acquisition metadata management module includes a first acquisition metadata generation unit, a second acquisition metadata generation unit and an acquisition metadata storage unit, wherein the first acquisition metadata generation unit is used to generate acquisition metadata based on historical data acquisition log records; the second acquisition metadata generation unit is used to generate acquisition metadata based on real-time data acquisition log records, and each of the stored metadata at least includes a measuring point name, a writing time period, and a writing data volume corresponding to the writing time period, wherein the writing data volume is used to characterize the total amount of writing data stored at the measuring point on the center side on a specified date; the acquisition metadata storage unit is respectively connected to the first acquisition metadata generation unit and the second acquisition metadata generation unit in communication, and is used to receive and store the acquisition metadata;

[0044] The transmission metadata management module includes a transmission metadata generation unit and a transmission metadata storage unit. The transmission metadata generation unit is used to generate transmission metadata based on the transmission log record of each historical data transmission from the edge side to the center side. The transmission metadata is used to characterize the data information recorded during the transmission process. The transmission metadata at least includes the task name, the transmission period, and the total number of folders and the total number of files transmitted during the transmission period; the transmission metadata storage unit is used to receive and store the transmission metadata;

[0045] The storage metadata management module includes a storage metadata generation unit and a storage metadata storage unit. The storage metadata generation unit is used to generate storage metadata based on each write record of real-time data and historical data written to the target database. Each storage metadata at least includes a measuring point name, a writing time period, and the amount of written data corresponding to the writing time period, wherein the amount of written data is used to characterize the total amount of written data stored in the center side of the measuring point on a specified date; the storage metadata storage unit is communicatively connected to the storage metadata generation unit, and is used to receive and store the storage metadata.

[0046] The metadata processing module is respectively connected to the collection metadata management module, the transmission metadata management module, and the storage metadata management module to obtain the collection metadata, the transmission metadata, and the storage metadata and then process the various metadata.

[0047] Compared with the prior art, the present invention has the following beneficial effects: a nuclear power metadata storage method and system shown in the present invention respectively sets collection metadata, transmission metadata, storage metadata and archiving metadata for the entire process of massive nuclear power data collection from the edge side to the center side. First, when locating the problem link of the specified time range and measurement point range, the corresponding collection metadata, transmission metadata, storage metadata and archiving metadata are compared. If the record of one link is different from that of other links, it can be judged that there is a problem in the corresponding link, and the problem link can be located conveniently and quickly; second, it can also be based on periodic analysis of various types of metadata. On the one hand, it can obtain and display various states in the nuclear power data transmission operation process, and on the other hand, it also makes metadata monitoring and management more systematic and automated; third, it can also obtain specified historical data from the archive database based on the archive metadata for asset analysis without exporting it from the target database, which improves the efficiency of obtaining historical data and does not affect the normal data writing work to the target database;

[0048] In addition, the nuclear power metadata storage method and system shown in the present invention also defines different data attribute information and storage structures for different metadata. Through the coordination of metadata data attributes and storage structures, it is possible to quickly find and analyze the required metadata from massive metadata, thereby further improving the efficiency of the above-mentioned problem link positioning, periodic analysis and asset analysis work. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0050] Figure 1 It is a flow chart of an embodiment of locating a problem link in a nuclear power metadata storage management method of the present invention;

[0051] Figure 2 A flowchart of another embodiment of locating a problem link in a nuclear power metadata storage management method of the present invention;

[0052] Figure 3 It is a structural schematic diagram of an embodiment of a nuclear power metadata storage management system of the present invention. DETAILED DESCRIPTION

[0053] The preferred embodiments of the present invention are described in detail below in conjunction with the accompanying drawings, wherein the accompanying drawings constitute a part of this application and are used together with the embodiments of the present invention to illustrate the principles of the present invention, but are not used to limit the scope of the present invention.

[0054] Embodiment 1

[0055] Real-time data storage is characterized by a large amount of data. Historical data has the characteristics of a large time span and high requirements for data quality within a continuous interval. At the same time, due to the long transmission link and many data flow links, when problems occur in one or more links, positioning and tracking cannot be performed.

[0056] A nuclear power metadata storage management method shown in this embodiment is used to record and manage various types of metadata generated during the operation of nuclear power data transmission and process various types of metadata, wherein the metadata includes acquisition metadata, transmission metadata and storage metadata; the acquisition metadata is generated based on historical data acquisition log records and / or real-time data acquisition log records, and each storage metadata at least includes a measurement point name, a write time period, and a write data volume corresponding to the write time period, wherein the write data volume is used to characterize the total amount of write data stored in the center side of the measurement point on a specified date; the transmission metadata is generated based on the transmission log record of each historical data transmission from the edge side to the center side, and the transmission metadata is used to characterize the data information recorded in the transmission process, and the transmission metadata at least includes a task name, a transmission period, and the total number of folders and the total number of files transmitted in the transmission period; the storage metadata is generated based on each write record of real-time data and historical data written to the target database, and each storage metadata at least includes a measurement point name, a write time period, and a write data volume corresponding to the write time period, wherein the write data volume is used to characterize the total amount of write data stored in the center side of the measurement point on a specified date.

[0057] A nuclear power metadata storage management method shown in the present invention can conveniently and quickly locate problem links, obtain and display various states in the nuclear power data transmission operation process, and perform nuclear power asset analysis by recording and managing various metadata generated during the operation of nuclear power data transmission and processing each type of metadata.

[0058] Among them, a nuclear power metadata storage management method shown in the present invention, when it is determined that the historical data of a certain section is incomplete, the acquisition metadata, transmission metadata and storage metadata of the corresponding interval segment are obtained, and then the records of each metadata are compared. If one of the records is different from the other metadata, it can be determined that the possibility of a problem in this link is the greatest. Specifically, if Figure 1 and Figure 2As shown, processing various types of metadata to perform problem link location analysis based on the metadata includes the following steps:

[0059] S1 obtains the time range and measurement point range of the data to be located;

[0060] S2, for each measuring point within the measuring point range, respectively finding the corresponding collected data volume, file volume and written data volume from the collected metadata, the transmission metadata and the storage metadata based on the time range;

[0061] S3 determines whether a corresponding file exists based on the value of each collected data volume and written data volume. If the value is not 0, it is determined that the file exists, and the corresponding total amount of collected files and the total amount of stored files are obtained after aggregation;

[0062] S4 compares the total amount of collected files, the total amount of stored files, and the file amount. If one of the sets of quantities is different, it is determined that there is a problem in the corresponding link.

[0063] or

[0064] S1' obtains the time range and measuring point range of the data to be located;

[0065] S2′, for each measuring point within the measuring point range, respectively finding the corresponding measuring point name and the number of folders from the acquisition metadata, transmission metadata and storage metadata;

[0066] S3' counts the number of measuring point names found in the collection metadata and the storage metadata to obtain the total number of corresponding collection folders and the total number of storage folders, wherein if the corresponding measuring point name is found, it is determined that the corresponding folder exists;

[0067] S4' compares the total amount of collected folders, the total amount of stored folders and the amount of files. If one of the groups of quantities is different, it is determined that there is a problem in the corresponding link.

[0068] In this embodiment, for the transmission metadata, either the number of folders or the number of files can be compared to compare the processes in the same task. Furthermore, when comparing the number of files, since the amount of collected data and the amount of written data are obtained, in the step S4', when it is judged that the value of the total amount of collected files or the total amount of stored files is different, it also includes: for each measuring point, the amount of written data and the amount of collected data of the corresponding date within the specified time range are compared respectively. If it is judged that the two are inconsistent, it is judged that there is a problem in the nuclear power data transmission operation process on the corresponding date, thereby more accurately locating the link.

[0069] A nuclear power metadata storage management method shown in the present invention can also obtain and display various states in the nuclear power data transmission operation process by periodically analyzing the collected metadata, transmitted metadata, and stored metadata, wherein the collected metadata can obtain at least the following information: all measuring points, which measuring points have been collected, the collection progress of the collected measuring points, etc.; the transmission metadata can obtain at least the following information of the transmission process: which data have been transmitted, the degree of transmission completion; the storage metadata can obtain at least the following information: all measuring points, which measuring points have been written to the target database, and the writing progress of each writing process; specifically, in this embodiment, for the collected metadata, after obtaining the measuring point name and the query time period, the collection record of the corresponding collected metadata is obtained based on the measuring point name and the query time period and displayed, including displaying the collection situation of the measuring point every day, or displaying the collection status of the collected measuring points by year.

[0070] For storage metadata, after obtaining the measuring point name and the query time period, the corresponding storage metadata is obtained based on the measuring point name and the query time period and the records stored in the target database of the measuring point are displayed.

[0071] For the transmission metadata, after obtaining the task name, the corresponding transmission metadata is obtained based on the task name to display the total number of folders and the total number of files stored therein.

[0072] For the archived metadata, after obtaining the task name, the corresponding archived data is obtained based on the task name to view the collected data packets or download the specified source data packets to the local server.

[0073] In addition, the collected metadata can be used to count the distribution of data sources of the collected data.

[0074] The following describes a nuclear power metadata storage management method shown in the present invention in conjunction with the specific process of nuclear power data transmission operation.

[0075] During the data collection process, the collector on the edge side will record the amount of data collected Qn for each measuring point on that day, and the corresponding collection log will also record the total amount of data collected per day Qn for each measuring point, such as 2019-10-01, 100; 2019-10-02 50; due to the existence of multiple measuring points and a large collection time span, although the amount of collected data for a specified time period of each measuring point can be obtained based on the collection metadata for subsequent analysis, the amount of collected data is large. When it is necessary to obtain the amount of collected data for a specified time and a specified measuring point range for analysis, it takes a lot of time to find all the information. As a preferred solution, in this embodiment, each of the collection metadata stores the amount of collected data for a specified measuring point in one year, and the collection metadata includes the measuring point name, year, and the amount of collected data for the whole year, wherein each of the collected data corresponding to the specified year is converted into a specified binary data and stored in the collection metadata in chronological order, as shown in Table 1. In this embodiment, for the name ZS 02 For the measuring point 20ZAS-EP-ET101A-26, all the collected data in 2019 are stored in chronological order, where the collected data of adjacent days are separated by commas, and X represents that there is no data on that day. At the same time, in order to further reduce the storage space, each collected data corresponding to the specified year is converted into hexadecimal data and stored in the collection metadata in chronological order.

[0076] Measuring point name time data ZS-0220ZAS-EP-ET101A-26 2019 3A,X,31C,A2,X,X,X,…

[0077] Table 1 Collection metadata storage format

[0078] With this arrangement, on the one hand, more collection metadata can be stored in the same storage space. More importantly, when locating problem links or performing periodic analysis and obtaining collection metadata within a specified time range, since each collection data volume is stored in the order of year and date, the required collection data volume can be quickly obtained based on the measurement point name and time range for subsequent analysis and use. Compared with the original traversal method of obtaining the required collection data volume, the retrieval efficiency is greatly improved.

[0079] After data collection, the edge side will send the data to the transit module on the center side. During this process, a transmission log will be generated. In this embodiment, transmission metadata is generated based on the transmission log to record data information of the transmission process, as shown in Table 2. The transmission metadata includes the task name, the transmission period, and the total number of folders and files transmitted during the transmission period.

[0080]

[0081] Table 2 Transmission metadata storage format

[0082] After the data arrives at the transfer module, it is necessary to store all the data in the transfer module into the target database through the import module. In order to effectively supervise the process, the storage metadata is designed in a nuclear power metadata storage management method shown in the present invention. As mentioned above, although the storage metadata records all the written data volumes during the import process, there are many measurement points and a large time range, so there are also a lot of data. When analysis is required based on the storage metadata, it is impossible to find the required written data volume from the many data in a timely and fast manner.

[0083] As a preferred solution, in this embodiment, each storage metadata stores the amount of written data of a specified measuring point for one year, wherein the amount of written data corresponding to the specified year is converted into specified base data and stored in the storage metadata in chronological order. As shown in Table 3, in this embodiment, for the measuring point named ZS 0220ZAS-EP-ET101A-26, all the written data in 2019 are also converted into decimal or hexadecimal data respectively and stored in the storage metadata in chronological order, wherein the amount of written data for each day is separated by a comma, and 0 represents no data.

[0084] Measuring point name time data ZS-0220ZAS-EP-ET101A-26 2019 58,0,796,162,0,0,0,…

[0085] Table 3 Storage metadata storage format

[0086] In addition, considering that the acquisition rate on the edge side is affected by various factors, resulting in a slow acquisition rate, and the data storage space on the edge side is insufficient, after the data arrives at the transfer module, the collected data is also cached and archived historically to prevent data loss due to abnormal reasons caused by data writing or transmission failure, including setting up an archive database, the archive database and the transfer database are communicated and connected for archiving and storing the confirmed historical data of the transfer database, so as to upload the data files received by the center side to the archive server according to the date format. The archived file data is classified and organized by measuring points and periods, and a query service for historical data is provided. Correspondingly, as a preferred solution, the nuclear power metadata storage management method also includes archiving metadata, which is generated based on the archive record of each historical data in the transfer database archived to the archive database, as shown in Table 4 below, and each of the archive metadata includes at least the archive file name, archive file size, archive file path, archive time, and the task to which it belongs.

[0087]

[0088] Table 4 Archive metadata storage format

[0089] By setting up archiving metadata, a nuclear power metadata storage management method shown in the present invention can also achieve asset analysis and further precise positioning of problem links.

[0090] When it is necessary to perform analysis and calculation based on historical data, the storage path of the corresponding data in the archive database can be directly obtained based on the archive metadata, and then the corresponding data can be downloaded for analysis without exporting the corresponding data from the target database. The data stored in the target database is mostly hot data, that is, medium- and short-term data. When it is necessary to obtain specified historical data for asset analysis, if the real data is downloaded directly from the target database, the amount of data is too large, and it takes a lot of time to obtain and download all the data, which may also affect the normal data writing process of the target database. Therefore, this application performs asset analysis based on the archive metadata, and the asset analysis includes obtaining the task name, obtaining the archive file path from the corresponding archive metadata based on the task name, and downloading the corresponding data from the archive database based on the archive file path for asset analysis. With this setting, it is possible to obtain the information required for asset statistics in less time, and it will not affect the normal operation of the target database.

[0091] At the same time, the problem link can be located more conveniently and quickly based on the archived metadata. Specifically, a nuclear power metadata storage management method shown in the present application, when locating the problem link, the problem link is checked from the back to the front, specifically including the following steps:

[0092] A. Obtain the time range and measurement point range of the data to be located;

[0093] B. for each measuring point within the measuring point range, finding the corresponding archive file path from the archive metadata based on the time range, and downloading the corresponding archive data from the archive database based on the archive file path; at the same time, finding the corresponding written data volume from the storage metadata based on the time range;

[0094] C. counting the amount of archived data based on the archived data, and comparing the amount of archived data with the amount of written data;

[0095] If C1 and C2 are equal, it is judged that there may be problems in the acquisition link and the transmission link; then

[0096] C11, for each measuring point within the measuring point range, respectively finding the corresponding collected data volume and file volume from the collected metadata and the transmitted metadata based on the time range;

[0097] C12 determines whether there is a corresponding file based on the value of each collected data volume and written data volume. If the value is not 0, it is determined that the file exists, and the corresponding total amount of collected files and the total amount of stored files are obtained after aggregation;

[0098] C13 compares the total amount of collected files, the total amount of stored files, and the file amount. If one of the sets of quantities is different, it is determined that there is a problem in the corresponding link.

[0099] or

[0100] C11′ for each measuring point within the measuring point range, respectively finding the corresponding measuring point name and the number of folders from the acquisition metadata, transmission metadata and storage metadata;

[0101] C12' counts the number of measuring point names found in the acquisition metadata and the storage metadata to obtain the corresponding total amount of acquisition folders and the total amount of storage folders, wherein if the corresponding measuring point name is found, it is determined that the corresponding folder exists;

[0102] C13' compares the total amount of collected folders, the total amount of stored folders and the amount of files. If one of the groups of quantities is different, it is determined that there is a problem in the corresponding link.

[0103] C2 If the archived data volume is larger than the written data volume, it is judged that there is a problem in the writing process, that is, there may be a problem of duplicate writing. In addition, the archived data volume is usually not smaller than the written data volume, so it is not analyzed here.

[0104] Through the above method, when locating the problem link in the nuclear power data transmission process, firstly, based on the comparison between the archived metadata and the stored metadata, it can be confirmed whether the problem link is at the front end or the back end. If it is at the front end, that is, the acquisition link and the transmission link, then further compare the acquisition metadata, transmission metadata and storage metadata to locate the problem link; if it is at the back end, the specific link is located based on the archived metadata and the written metadata, which can further improve the efficiency of locating the problem link. Of course, it is also possible to directly obtain the acquisition metadata, transmission metadata, storage metadata and archived metadata based on the time range and the measurement point range for comparison, so as to locate the problem link.

[0105] Embodiment 2

[0106] See also Figure 3 The present invention also provides a nuclear power metadata storage management system 100, which is used to record and manage metadata generated during the operation of nuclear power data transmission, including a collection metadata management module 10, a transmission metadata management module 20, a storage metadata management module 30 and a metadata processing module 40.

[0107] The acquisition metadata management module 10 includes a first acquisition metadata generation unit 11, a second acquisition metadata generation unit 12 and an acquisition metadata storage unit 13. The first acquisition metadata generation unit 11 is used to generate acquisition metadata based on historical data acquisition log records; the second acquisition metadata generation unit 12 is used to generate acquisition metadata based on real-time data acquisition log records. Each of the stored metadata at least includes a measuring point name, a writing time period, and a writing data volume corresponding to the writing time period, wherein the writing data volume is used to represent the total amount of writing data stored at the measuring point on the center side on a specified date; the acquisition metadata storage unit 13 is respectively connected to the first acquisition metadata generation unit 11 and the second acquisition metadata generation unit 12 for receiving and storing the acquisition metadata;

[0108] The transmission metadata management module 20 includes a transmission metadata generation unit 21 and a transmission metadata storage unit 22. The transmission metadata generation unit 21 is used to generate transmission metadata based on the transmission log record of each historical data transmission from the edge side to the center side. The transmission metadata is used to characterize the data information recorded during the transmission process. The transmission metadata at least includes the task name, the transmission period, and the total number of folders and the total number of files transmitted during the transmission period; the transmission metadata storage unit 22 is used to receive and store the transmission metadata;

[0109] The storage metadata management module 30 includes a storage metadata generation unit 31 and a storage metadata storage unit 32. The storage metadata generation unit 31 is used to generate storage metadata based on each write record of real-time data and historical data written to the target database. Each storage metadata at least includes a measuring point name, a writing time period, and the amount of written data corresponding to the writing time period, wherein the amount of written data is used to characterize the total amount of written data stored at the measuring point on the center side on a specified date; the storage metadata storage unit 32 is communicatively connected to the storage metadata generation unit 31, and is used to receive and store the storage metadata.

[0110] The metadata processing module 40 is respectively connected to the collection metadata management module 10, the transmission metadata management module 20, and the storage metadata management module 30 to obtain the collection metadata, transmission metadata, and storage metadata and then process the various metadata.

[0111] A nuclear power metadata storage management system 100 shown in the present invention records and manages metadata records generated by all operations of the system during the high-reliability transmission process of cloud-edge collaboration. Various types of metadata are saved by category and a reading interface is provided for the metadata processing module 40 to perform data analysis. By processing various types of metadata, the link where the problem occurs can be quickly located, and the problem of complete and reliable migration of historical data can be solved; at the same time, various states of the nuclear power data transmission operation process can be obtained and displayed by periodic analysis of various types of metadata. Specifically, a nuclear power metadata storage management system 100 shown in the present invention respectively designs collection metadata, storage metadata and transmission metadata for each link in the high-reliability transmission process, and sets different storage formats for each type of metadata. When locating the subsequent problem, when it is necessary to determine that the historical data of a certain section is incomplete, the collection metadata, transmission metadata and storage metadata of the corresponding interval are obtained, and then the records of each metadata are compared. If one of the records is different from the other metadata, it can be determined that the possibility of the problem in this link is the greatest. It is also possible to obtain the process of each link of the system by further statistics of different types of metadata as needed, so as to timely grasp the various states of the nuclear power data transmission operation process.

[0112] During the data collection process, the collector on the edge side will record the amount of data collected Qn for each measuring point on that day, and the corresponding collection log will also record the amount of data collected Qn for each measuring point every day, such as 2019-10-01, 100; 2019-10-02 50; due to the existence of multiple measuring points and the large collection time span, although the amount of data collected in the specified time period of each measuring point can be obtained based on the collection metadata for subsequent analysis, the amount of collected data is large. When it is necessary to obtain the amount of data collected in the specified time and the specified measuring point range for analysis, it takes a lot of time to find all the information. As a preferred solution, in this embodiment, each of the collection metadata stores the amount of data collected for a specified measuring point in one year. The collection metadata includes the name of the measuring point, the year, and the amount of data collected throughout the year. Each amount of data collected represents the actual amount of data collected on one day of the measuring point. After each of the collected data corresponding to the specified year is converted into a specified binary data, it is stored in the collection metadata in chronological order, as shown in Table 1. In this embodiment, for the name ZS 02 For the measuring point 20ZAS-EP-ET101A-26, all the collected data in 2019 are stored in chronological order, where the collected data of adjacent days are separated by commas, and X represents that there is no data on that day. At the same time, in order to further reduce the storage space, each collected data corresponding to the specified year is converted into hexadecimal or decimal data and stored in the collected metadata in chronological order.

[0113] After data collection, the edge side will send the data to the transit module on the center side. During this process, a transmission log will be generated. In this embodiment, transmission metadata is generated based on the transmission log to record data information of the transmission process, as shown in Table 2. The transmission metadata includes the task name, the transmission period, and the total number of folders and files transmitted during the transmission period.

[0114] After the data arrives at the transfer module, it is necessary to store all the data in the transfer module into the target database through the import module. In order to effectively supervise the process, the storage metadata is designed in a nuclear power metadata storage management system 100 shown in the present invention. As mentioned above, although the storage metadata records the total amount of written data in the import process, there are many measuring points and a large time range, so there are also a lot of data. When it is necessary to analyze based on the storage metadata, it is impossible to find the required amount of written data from the many data in a timely and fast manner. As a preferred solution, in this embodiment, each storage metadata stores the amount of written data of a specified measuring point for one year, and the amount of written data corresponding to the specified year is converted into the specified base data and stored in the storage metadata in chronological order. As shown in Table 2, in this embodiment, for the measuring point named ZS 0220ZAS-EP-ET101A-26, all the written data in 2019 are also converted into decimal or hexadecimal data respectively and stored in the storage metadata in chronological order, where the amount of written data for each day is separated by commas, and 0 represents no data.

[0115] In addition, considering that the acquisition rate of the edge side is affected by various factors, resulting in a slow acquisition rate, and the data storage space on the edge side is insufficient, after the data arrives at the transfer module, the collected data is also cached and archived historically to prevent data loss due to abnormal reasons caused by data writing or transmission failure, including setting an archive database, the archive database is connected to the transfer database for archiving and storing the confirmed historical data of the transfer database, so as to upload the data files received by the center side to the archive server according to the date format. The archived file data is classified and sorted according to the measurement point and period, and a query service for historical data is provided. Correspondingly, as a preferred solution, the nuclear power metadata storage management system 100 also includes an archive metadata management module 50, the archive metadata management module 50 includes an archive metadata generation unit 51 and an archive metadata storage unit 52, the archive metadata generation unit 51 is used to generate corresponding archive metadata based on the archive record of each historical data in the transfer database, each of the archive metadata at least includes the archive file name, the archive file size, the archive time and the task to which it belongs; the archive metadata storage unit 52 is connected to the archive metadata generation unit 51 for receiving and storing each of the archive metadata. With this setting, when you need to query the historical data, you can directly query the archived metadata without exporting the corresponding data from the target database.

[0116] The metadata processing module 40 is respectively connected to the collection metadata management module 10, the transmission metadata management module 20, and the storage metadata management module 30 to obtain the collection metadata, transmission metadata, and storage metadata, and then periodically analyze the various metadata to generate collection reports and comparison reports. In addition, the metadata processing module 40 is also connected to the archiving metadata management module 50 to obtain the archiving metadata and then process it.

[0117] (1) When it is necessary to locate the problem link, if the location is based on the collection metadata, transmission metadata, storage metadata, and archiving metadata, the following steps are included:

[0118] A. Obtain the time range and measurement point range of the data to be located;

[0119] B. for each measuring point within the measuring point range, finding the corresponding archive file path from the archive metadata based on the time range, and downloading the corresponding archive data from the archive database based on the archive file path; at the same time, finding the corresponding written data volume from the storage metadata based on the time range;

[0120] C. counting the amount of archived data based on the archived data, and comparing the amount of archived data with the amount of written data;

[0121] If C1 and C2 are equal, it is judged that there may be problems in the acquisition link and the transmission link; then

[0122] C11, for each measuring point within the measuring point range, respectively finding the corresponding collected data volume and file volume from the collected metadata and the transmitted metadata based on the time range;

[0123] C12 determines whether there is a corresponding file based on the value of each collected data volume and written data volume. If the value is not 0, it is determined that the file exists, and the corresponding total amount of collected files and the total amount of stored files are obtained after aggregation;

[0124] C13 compares the total amount of collected files, the total amount of stored files, and the file amount. If one of the sets of quantities is different, it is determined that there is a problem in the corresponding link.

[0125] or

[0126] C11′ for each measuring point within the measuring point range, respectively finding the corresponding measuring point name and the number of folders from the acquisition metadata, transmission metadata and storage metadata;

[0127] C12' counts the number of measuring point names found in the acquisition metadata and the storage metadata to obtain the corresponding total amount of acquisition folders and the total amount of storage folders, wherein if the corresponding measuring point name is found, it is determined that the corresponding folder exists;

[0128] C13' compares the total amount of collected folders, the total amount of stored folders and the amount of files. If one of the groups of quantities is different, it is determined that there is a problem in the corresponding link.

[0129] C2 If the amount of archived data is greater than the amount of written data, it is determined that there is a problem in the writing process.

[0130] (2) If positioning is performed based on the collected metadata, the transmitted metadata, and the stored metadata, the following steps are included:

[0131] S1 obtains the time range and measurement point range of the data to be located;

[0132] S2, for each measuring point within the measuring point range, respectively finding the corresponding collected data volume, file volume and written data volume from the collected metadata, the transmission metadata and the storage metadata based on the time range;

[0133] S3 determines whether a corresponding file exists based on the value of each collected data volume and written data volume. If the value is not 0, it is determined that the file exists, and the corresponding total amount of collected files and the total amount of stored files are obtained after aggregation;

[0134] S4 compares the total amount of collected files, the total amount of stored files, and the file amount. If one of the sets of quantities is different, it is determined that there is a problem in the corresponding link.

[0135] or

[0136] S1' obtains the time range and measuring point range of the data to be located;

[0137] S2′, for each measuring point within the measuring point range, respectively finding the corresponding measuring point name and the number of folders from the acquisition metadata, transmission metadata and storage metadata;

[0138] S3' counts the number of measuring point names found in the collection metadata and the storage metadata to obtain the total number of corresponding collection folders and the total number of storage folders, wherein if the corresponding measuring point name is found, it is determined that the corresponding folder exists;

[0139] S4' compares the total amount of collected folders, the total amount of stored folders and the amount of files. If one of the groups of quantities is different, it is determined that there is a problem in the corresponding link.

[0140] (3) When analysis and calculation based on historical data is required, the archived metadata can be directly called without exporting the corresponding data from the target database; it is necessary to obtain the specified metadata to find the corresponding archived historical file for asset analysis; specifically, the following steps are included: obtaining the task name, obtaining the archived file path from the corresponding archived metadata based on the task name, and downloading the corresponding data from the archived database based on the archived file path for asset analysis.

[0141] (4) When it is necessary to obtain the operating status of each link, for the collection metadata, after obtaining the measuring point name and the query time period, the collection records of the corresponding collection metadata are obtained based on the measuring point name and the query time period and displayed, including displaying the daily collection status of the measuring point, or displaying the collection status of the measured point by year. For the storage metadata, after obtaining the measuring point name and the query time period, the corresponding storage metadata is obtained based on the measuring point name and the query time period and the records of the measuring point stored in the target database are displayed. For the transmission metadata, after obtaining the task name, the corresponding transmission metadata is obtained based on the task name to display the total number of folders and the total number of files stored therein. For the archiving metadata, after obtaining the task name, the corresponding archiving data is obtained based on the task name to view the collected data packets or download the specified source data packets to the local server. In addition, the collection metadata can also be used to count the data source distribution of the collected data.

[0142] As a preferred solution, the nuclear power metadata storage management system 100 further includes a measurement point metadata management module 60, which is used to manage the measurement point metadata in the source database of the edge side and the target database of the center side, wherein the measurement point metadata at least includes the measurement point name, power plant, unit, system, system code, equipment name and equipment code. In the process of collecting data from the edge side and transmitting it to the center side, due to the different data storage formats of different edge sides, the stored information is also different. In order to facilitate the unified management of data collection and storage, the measurement point metadata management module 60 is designed to record the name and format information of each measurement point. When collecting data, the measurement point metadata management module 60 is first called to obtain the information of the specified measurement point, and then the collection and transmission of the specified measurement point are performed to avoid the collector being unable to collect and transmit data of the specified measurement point due to the uncertainty of the information.

[0143] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily conceived by any technician familiar with the technical field within the technical scope disclosed in the present invention should be covered by the present invention.

Claims

1. A method for storing and managing nuclear power metadata, characterized in that: Used to record and manage various metadata generated during the operation of nuclear power data transmission and process various metadata, wherein the metadata includes acquisition metadata, transmission metadata and storage metadata; The collection metadata is generated based on historical data collection log records and / or real-time data collection log records, and each collection metadata includes at least a measuring point name, a collection time period, and a corresponding amount of collected data in the collection time period, wherein each amount of collected data is used to represent the total amount of collected data on a specified date of the measuring point; The transmission metadata is generated based on the transmission log record of each historical data transmission from the edge side to the center side. The transmission metadata is used to characterize the data information recorded during the transmission process. The transmission metadata at least includes the task name, the transmission period, and the total number of folders and files transmitted during the transmission period. The storage metadata is generated based on each write record of real-time data and historical data written to the target database, and each storage metadata at least includes a measuring point name, a writing time period, and a writing data volume corresponding to the writing time period, wherein the writing data volume is used to characterize the total amount of writing data stored at the measuring point on the center side on a specified date; Processing the various metadata includes performing problem link location analysis based on the metadata, and the problem link location analysis includes the following steps: S1 obtains the time range and measurement point range of the data to be located; S2, for each measuring point within the measuring point range, respectively finding the corresponding collected data volume, file volume and written data volume from the collected metadata, the transmission metadata and the storage metadata based on the time range; S3 determines whether a corresponding file exists based on the value of each collected data volume and written data volume. If the value is not 0, it is determined that the file exists, and the corresponding total amount of collected files and the total amount of stored files are obtained after aggregation; S4 compares the total amount of collected files, the total amount of stored files, and the file amount. If one of the sets of numbers is different, it is determined that there is a problem in the corresponding link; or S1' obtains the time range and measuring point range of the data to be located; S2′, for each measuring point within the measuring point range, respectively finding the corresponding measuring point name and the number of folders from the acquisition metadata, transmission metadata and storage metadata; S3' counts the number of measuring point names found in the collection metadata and the storage metadata to obtain the total number of corresponding collection folders and the total number of storage folders, wherein if the corresponding measuring point name is found, it is determined that the corresponding folder exists; S4' compares the total amount of collected folders, the total amount of stored folders and the amount of files. If one of the numbers is different, it is determined that there is a problem in the corresponding link; The metadata also includes archiving metadata, which is generated based on the archiving record of each historical data in the transit database being archived to the archiving database. Each of the archiving metadata at least includes the archive file name, archive file size, archive file path, archive time, and the task to which it belongs. Processing each type of metadata to locate the problem link includes the following steps: A. Obtain the time range and measurement point range of the data to be located; B. for each measuring point within the measuring point range, finding the corresponding archive file path from the archive metadata based on the time range, and downloading the corresponding archive data from the archive database based on the archive file path; at the same time, finding the corresponding written data volume from the storage metadata based on the time range; C. counting the amount of archived data based on the archived data, and comparing the amount of archived data with the amount of written data; If C1 and C2 are equal, it is judged that there may be problems in the acquisition link and the transmission link; then C11, for each measuring point within the measuring point range, respectively finding the corresponding collected data volume and file volume from the collected metadata and the transmitted metadata based on the time range; C12 determines whether there is a corresponding file based on the value of each collected data volume and written data volume. If the value is not 0, it is determined that the file exists, and the corresponding total amount of collected files and the total amount of stored files are obtained after aggregation; C13 compares the total amount of collected files, the total amount of stored files, and the file amount. If one of the sets of numbers is different, it is determined that there is a problem in the corresponding link; or C11′ for each measuring point within the measuring point range, respectively finding the corresponding measuring point name and the number of folders from the acquisition metadata, transmission metadata and storage metadata based on the time range; C12' counts the number of measuring point names found in the acquisition metadata and the storage metadata to obtain the total number of corresponding acquisition folders and the total number of storage folders, wherein if the corresponding measuring point name is found, it is determined that the corresponding folder exists; C13' compares the total amount of collected folders, the total amount of stored folders and the amount of files. If one of the sets of quantities is different, it is determined that there is a problem in the corresponding link; C2 If the amount of archived data is greater than the amount of written data, it is determined that there is a problem in the writing process.

2. A nuclear power metadata storage management method according to claim 1, characterized in that: Each piece of the collected metadata stores the amount of collected data for a specified measuring point in one year, wherein all the collected data amounts corresponding to the specified year are sequentially stored in the collected metadata in chronological order.

3. A nuclear power metadata storage management method according to claim 2, characterized in that: Each piece of storage metadata stores the amount of written data for a specified measurement point in one year, wherein the amount of written data corresponding to the specified year is stored in the storage metadata in chronological order.

4. A nuclear power metadata storage management method according to claim 3, characterized in that: The amount of collected data or written data corresponding to the specified year is converted into data in a specified base and then stored in the storage metadata in chronological order.

5. A nuclear power metadata storage management method according to claim 1, characterized in that: In the step S4', if the value of the total amount of collected files or the total amount of stored files is different, it also includes: for each measuring point, comparing the amount of written data and the amount of collected data on the corresponding date within the specified time range, if it is judged that the two are inconsistent, it is judged that there is a problem in the nuclear power data transmission operation process on the corresponding date.

6. A nuclear power metadata storage management method according to claim 1, characterized in that: Processing each type of metadata includes performing asset analysis based on the archived metadata, and the asset analysis includes obtaining a task name, obtaining an archived file path from the corresponding archived metadata based on the task name, and downloading corresponding data from the archived database based on the archived file path to perform asset analysis.

7. A nuclear power metadata storage management method according to claim 1, characterized in that: Processing the various metadata further includes performing periodic analysis based on the metadata, wherein the periodic analysis includes one or more of the following combinations: For the collection metadata, after obtaining the measuring point name and the query time period, the collection records of the corresponding collection metadata are obtained based on the measuring point name and the query time period and displayed, including displaying the collection status of the measuring point every day, or displaying the collection status of the measured points by year; Or, use the collected metadata to count the data source distribution of the collected data; Or, for storage metadata, after obtaining the measuring point name and the query time period, the corresponding storage metadata is obtained based on the measuring point name and the query time period and the record of the measuring point stored in the target database is displayed; Or, for the transmission metadata, after obtaining the task name, the corresponding transmission metadata is obtained based on the task name to display the total number of folders and the total number of files stored therein.

8. A nuclear power metadata storage management method according to claim 1, characterized in that: The metadata also includes measurement point metadata, which is used to manage the measurement point metadata in the source database on the edge side and the target database on the center side, wherein the measurement point metadata at least includes the measurement point name, power plant, unit, system, system code, equipment name and equipment code.

9. A nuclear power metadata storage management system, characterized in that: Used to record and manage metadata generated during the operation of nuclear power data transmission, including acquisition metadata management module, transmission metadata management module, storage metadata management module and metadata processing module; The acquisition metadata management module includes a first acquisition metadata generation unit, a second acquisition metadata generation unit and an acquisition metadata storage unit, wherein the first acquisition metadata generation unit is used to generate acquisition metadata based on historical data acquisition log records; The second acquisition metadata generation unit is used to generate acquisition metadata based on the real-time data acquisition log record, and each storage metadata at least includes a measuring point name, a writing time period, and a writing data volume corresponding to the writing time period, wherein the writing data volume is used to characterize the total amount of writing data stored in the center side at the measuring point on a specified date; the acquisition metadata storage unit is respectively connected to the first acquisition metadata generation unit and the second acquisition metadata generation unit for receiving and storing the acquisition metadata; The transmission metadata management module includes a transmission metadata generation unit and a transmission metadata storage unit. The transmission metadata generation unit is used to generate transmission metadata based on the transmission log record of each historical data transmission from the edge side to the center side. The transmission metadata is used to characterize the data information recorded during the transmission process. The transmission metadata at least includes the task name, the transmission period, and the total number of folders and the total number of files transmitted during the transmission period; the transmission metadata storage unit is used to receive and store the transmission metadata; The storage metadata management module includes a storage metadata generation unit and a storage metadata storage unit. The storage metadata generation unit is used to generate storage metadata based on each write record of real-time data and historical data written to the target database. Each storage metadata at least includes a measuring point name, a writing time period, and a writing data volume corresponding to the writing time period, wherein the writing data volume is used to characterize the total amount of writing data stored at the measuring point on the center side on a specified date. The storage metadata storage unit is communicatively connected with the storage metadata generation unit to receive and store the storage metadata. The metadata processing module is respectively connected to the acquisition metadata management module, the transmission metadata management module, and the storage metadata management module to obtain the acquisition metadata, the transmission metadata, and the storage metadata and then process the various metadata; Processing the various metadata includes performing problem link location analysis based on the metadata, and the problem link location analysis includes the following steps: S1 obtains the time range and measurement point range of the data to be located; S2, for each measuring point within the measuring point range, respectively finding the corresponding collected data volume, file volume and written data volume from the collected metadata, the transmission metadata and the storage metadata based on the time range; S3 determines whether a corresponding file exists based on the value of each collected data volume and written data volume. If the value is not 0, it is determined that the file exists, and the corresponding total amount of collected files and the total amount of stored files are obtained after aggregation; S4 compares the total amount of collected files, the total amount of stored files, and the file amount. If one of the sets of numbers is different, it is determined that there is a problem in the corresponding link; or S1' obtains the time range and measuring point range of the data to be located; S2′, for each measuring point within the measuring point range, respectively finding the corresponding measuring point name and the number of folders from the acquisition metadata, transmission metadata and storage metadata; S3' counts the number of measuring point names found in the collection metadata and the storage metadata to obtain the total number of corresponding collection folders and the total number of storage folders, wherein if the corresponding measuring point name is found, it is determined that the corresponding folder exists; S4' compares the total amount of collected folders, the total amount of stored folders and the amount of files. If one of the numbers is different, it is determined that there is a problem in the corresponding link; The metadata also includes archiving metadata, which is generated based on the archiving record of each historical data in the transit database being archived to the archiving database. Each of the archiving metadata at least includes the archive file name, archive file size, archive file path, archive time, and the task to which it belongs. Processing each type of metadata to locate the problem link includes the following steps: A. Obtain the time range and measurement point range of the data to be located; B. for each measuring point within the measuring point range, finding the corresponding archive file path from the archive metadata based on the time range, and downloading the corresponding archive data from the archive database based on the archive file path; at the same time, finding the corresponding written data volume from the storage metadata based on the time range; C. counting the amount of archived data based on the archived data, and comparing the amount of archived data with the amount of written data; If C1 and C2 are equal, it is judged that there may be problems in the acquisition link and the transmission link; then C11, for each measuring point within the measuring point range, respectively finding the corresponding collected data volume and file volume from the collected metadata and the transmitted metadata based on the time range; C12 determines whether there is a corresponding file based on the value of each collected data volume and written data volume. If the value is not 0, it is determined that the file exists, and the corresponding total amount of collected files and the total amount of stored files are obtained after aggregation; C13 compares the total amount of collected files, the total amount of stored files, and the file amount. If one of the sets of numbers is different, it is determined that there is a problem in the corresponding link; or C11′ for each measuring point within the measuring point range, respectively finding the corresponding measuring point name and the number of folders from the acquisition metadata, transmission metadata and storage metadata based on the time range; C12' counts the number of measuring point names found in the acquisition metadata and the storage metadata to obtain the corresponding total amount of acquisition folders and the total amount of storage folders, wherein if the corresponding measuring point name is found, it is determined that the corresponding folder exists; C13' compares the total amount of collected folders, the total amount of stored folders and the amount of files. If one of the sets of quantities is different, it is determined that there is a problem in the corresponding link; C2 If the amount of archived data is greater than the amount of written data, it is determined that there is a problem in the writing process.

Images