Metrological verification data tracing and safety management system based on block chain technology

Abstract

The invention discloses a metrological verification data traceability and security management system based on a block chain technology, which comprises a data acquisition and preprocessing module based on a system architecture, a block chain storage and management module and a data traceability and security verification module, and is characterized in that the data acquisition and preprocessing module is composed of a data acquisition module and a data preprocessing module; the data acquisition module is integrated on metering equipment and consists of a plurality of sensors and a data processing unit, and the data preprocessing module is deployed on edge computing equipment and is connected with the data acquisition module through a high-speed network. Compared with the prior art, the method has the advantages that the data security is high; data tracing is convenient; the data processing efficiency is high; and the data readability and availability are high.

Description

Technical Field

[0001] The present invention relates to the field of metrology and verification data management, and specifically refers to a metrology and verification data traceability and security management system based on blockchain technology. Background Art

[0002] In the current field of metrology and verification, data collection, processing, storage and management face many challenges. Traditional metrology and verification data management systems usually adopt centralized storage methods, which have problems such as data being easily tampered with and insufficient security. At the same time, the data tracing process is cumbersome and it is difficult to ensure the authenticity and integrity of the data.

[0003] For example, the patent number CN118796946A, entitled "A Blockchain-based Measurement and Verification Data Management Method and System", was applied for by State Grid Fujian Electric Power Co., Ltd. and others. Although the patent proposes a blockchain-based measurement and verification data management method and realizes the secure storage and transmission of data, the data processing efficiency and the convenience of data tracing still need to be improved. In particular, the patent does not fully utilize the advantages of edge computing devices in the data preprocessing stage, resulting in insufficient efficiency in data transmission and processing. At the same time, in terms of data tracing, users still need to go through a complex query process to obtain the required data, which is not convenient enough.

[0004] Another example is the patent number CN116049693B, entitled "A method for managing metrological verification data based on medical equipment", which was applied for by the Jinan Metrology Verification and Testing Institute. Although the patent proposes an effective management method for the metrological verification data of medical equipment, it is insufficient in terms of data security and tamper-proofness. Since blockchain technology is not used, the data storage method of this patent is still at risk of being maliciously attacked or tampered by internal personnel. In addition, the patent does not achieve full traceability in terms of data traceability, and cannot meet users' high requirements for data authenticity and integrity. Summary of the invention

[0005] The technical problems to be solved by the present invention are: 1) Insufficient data security: Traditional database systems usually adopt a centralized storage method, and data is easily attacked by malicious attacks or tampered by internal personnel, resulting in damage to the authenticity and credibility of the data. In addition, these systems lack effective encryption and verification mechanisms, and data is easily stolen or leaked during transmission and storage; 2) Data tracing is difficult: The data tracing process of traditional database systems is cumbersome and error-prone. Since data is usually stored in multiple different data sources, manual query of multiple data sources is required to achieve full traceability of data, which is not only time-consuming and labor-intensive, but also error-prone and cannot ensure the full traceability of data; 3) Low data processing efficiency: Traditional database systems are prone to performance bottlenecks when processing large amounts of data. Especially in the field of metrology and verification, due to the wide variety and large amount of data that need to be collected and processed, traditional database systems often cannot meet the requirements of real-time and accuracy.

[0006] In order to solve the above technical problems, the technical solution provided by the present invention is: a metrology verification data traceability and security management system based on blockchain technology, including a data acquisition and preprocessing module based on the system architecture, a blockchain storage and management module, and a data traceability and security verification module. The data acquisition and preprocessing module is composed of a data acquisition module and a data preprocessing module. The data acquisition module is integrated on the metrology equipment and consists of multiple sensors and a data processing unit. The data preprocessing module is deployed on the edge computing device and is connected to the data acquisition module through a high-speed network.

[0007] The blockchain storage and management module consists of a data uploading module and an on-chain data management module. The data uploading module is responsible for uploading the pre-processed data to the blockchain network, while the on-chain data management module is responsible for data management on the blockchain network.

[0008] The data traceability and security verification module consists of a data traceability module and a security verification module. The data traceability module is responsible for realizing the full traceability function of the data, while the security verification module is responsible for the authenticity verification and integrity check of the data.

[0009] Furthermore, the data acquisition module is responsible for real-time collection of various parameters of the metering equipment, including temperature, pressure, and flow, to ensure the originality and integrity of the data; the data preprocessing module cleans, aggregates, and compresses the collected data to reduce the amount of data and improve the efficiency of data transmission and storage, while encrypting the data to ensure the confidentiality and integrity of the data.

[0010] Furthermore, the data acquisition module is connected to the metering device through the built-in interface of the metering device or the external sensor interface to obtain data in real time; the data preprocessing module transmits and receives data with the data acquisition module through a high-speed network, preprocesses and encrypts the received data, and then transmits it to the blockchain storage and management module.

[0011] Furthermore, the data chain module uploads the pre-processed and encrypted data to the blockchain network through the API interface, using the distributed storage and immutability of the blockchain to ensure the security and credibility of the data. At the same time, a hybrid consensus mechanism is used to improve the security and efficiency of the blockchain network. On-chain data management module: manages data on the blockchain network, including data storage, retrieval and update, and realizes automated data management through smart contracts to ensure data compliance and consistency.

[0012] Furthermore, the data on-chain module and the data preprocessing module transmit and receive data through a high-speed network; the on-chain data management module interacts with other nodes in the blockchain network to realize distributed storage and management of data. At the same time, the on-chain data management module also interacts with the data traceability and security verification module to provide data retrieval and verification services.

[0013] Furthermore, the data tracing module uses the traceability of blockchain to achieve full traceability of data through on-chain data records. Users submit data query requests through the visualization unit, and the system obtains relevant metadata information from the blockchain and displays it to the user; the security verification module is responsible for data authenticity verification and integrity verification. It ensures the authenticity of the data by comparing on-chain data with actual data, and uses blockchain encryption technology to decrypt and process the data to ensure data readability and availability.

[0014] Furthermore, the data tracing module and the security verification module transmit and receive data through the internal interface. At the same time, the data tracing module interacts with the user interface, receives the user's query request and displays the query results; the security verification module interacts with the blockchain storage and management module to obtain on-chain data for verification and comparison.

[0015] Compared with the prior art, the advantages of the present invention are: 1) High data security: the distributed storage and tamper-proof nature of blockchain technology are adopted to ensure the security and credibility of data, and effectively prevent data from being maliciously attacked or tampered by internal personnel; 2) Convenient data tracing: the traceability of blockchain is utilized to realize the whole process traceability of data. Users only need to submit query requests through the visualization unit to quickly obtain relevant metadata information; 3) High data processing efficiency: the data preprocessing module cleans, aggregates and compresses the collected data for preprocessing, reduces the amount of data, and improves the efficiency of data transmission and storage; 4) High data readability and availability: the security verification module ensures the authenticity of the data by comparing the on-chain data with the actual data, and uses the encryption technology of blockchain to decrypt and process the data to ensure the readability and availability of the data. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1It is a schematic diagram of the architecture of the patent name of this invention. DETAILED DESCRIPTION

[0017] The present invention is further described in detail below in conjunction with the accompanying drawings.

[0018] Embodiment 1

[0019] like Figure 1 As shown in the figure, this system mainly includes three parts: data collection and preprocessing module, blockchain storage and management module, and data traceability and security verification module. Specifically:

[0020] (1) Data acquisition and preprocessing module

[0021] (1.1) Data acquisition module: This module is responsible for real-time data acquisition through multiple sensors on the metering equipment to ensure the originality and integrity of the data. The collected data includes but is not limited to key metering parameters such as temperature, pressure, and flow. Multiple sensors include temperature sensors, pressure sensors, flow sensors, etc., which can collect various metering parameters in real time.

[0022] (1.2) Data preprocessing module: This module preprocesses the collected data based on edge computing devices, including data cleaning, data aggregation and data compression, to reduce the amount of data and improve the efficiency of data transmission and storage. The preprocessed data is encrypted through a secure communication protocol to ensure the confidentiality and integrity of the data. Edge computing devices use low-power, high-performance processors to achieve fast data processing and encryption.

[0023] (2) Blockchain storage and management module

[0024] (2.1) Data upload module: This module uploads the pre-processed and encrypted data to the blockchain network through the API interface, and uses the distributed storage and immutability of the blockchain to ensure the security and credibility of the data. A hybrid consensus mechanism is used in the chain upload process to improve the security and efficiency of the blockchain network. Hybrid consensus mechanisms include proof of work (PoW) and proof of stake (PoS), which can be flexibly selected according to actual needs to improve the security and efficiency of the blockchain network.

[0025] (2.2) On-chain data management module: This module is responsible for managing data on the blockchain network, including data storage, retrieval, and update operations. Smart contracts are used to automate data management and ensure data compliance and consistency.

[0026] (3) Data traceability and security verification module

[0027] (3.1) Data tracing module: This module uses the traceability of blockchain to achieve full data tracing through on-chain data records, including data collection time, collection location, processing process and other information. Users can submit data query requests through the visualization unit, and the system obtains relevant metadata information from the blockchain and displays it to the user. The visualization unit uses a graphical interface to intuitively display the data tracing process and related information.

[0028] (3.2) Security Verification Module: This module is responsible for data authenticity verification and integrity check. It ensures the authenticity of data by comparing the on-chain data with the actual data. At the same time, it uses blockchain encryption technology to decrypt and process data to ensure data readability and availability. Encryption technology uses advanced encryption algorithms to ensure the confidentiality and integrity of data during transmission and storage.

[0029] Embodiment 2

[0030] Based on the first embodiment, Figure 1 As shown, the overall workflow of the system is:

[0031] (1) Data collection: Multiple sensors on the metering equipment (such as temperature sensors, pressure sensors, flow sensors, etc.) collect various metering parameters in real time to ensure the originality and integrity of the data. The data is collected and organized through the built-in system or external interface of the metering equipment.

[0032] (2) Data preprocessing: The collected data is preprocessed on the edge computing device, including data cleaning (removing invalid or redundant data), data aggregation (merging similar or related data), and data compression (reducing the amount of data to improve transmission and storage efficiency). The preprocessed data is encrypted through a secure communication protocol (such as HTTPS, TLS, etc.) to ensure the confidentiality and integrity of the data.

[0033] (3) Data upload: The pre-processed and encrypted data is uploaded to the blockchain network through the API interface. The distributed storage and immutability of the blockchain are used to ensure the security and credibility of the data. A hybrid consensus mechanism (such as proof of work PoW and proof of stake PoS) is used in the chain process to improve the security and efficiency of the blockchain network.

[0034] (4) On-chain data management: Data management on the blockchain network, including data storage, retrieval, and update operations. Automated data management is achieved through smart contracts to ensure data compliance and consistency. Smart contracts can be automatically executed according to preset conditions, such as data storage rules, access rights, etc.

[0035] (5) Data tracing: When data tracing is needed, users can submit data query requests through visualization units (such as web interfaces, mobile applications, etc.). The system obtains relevant metadata information (such as data collection time, collection location, processing process, etc.) from the blockchain and displays it to users. Users can understand the source and flow of data through this information.

[0036] (6) Security Verification: When the authenticity of data needs to be verified, the system ensures the authenticity of the data by comparing the on-chain data with the actual data. The data is decrypted and processed using blockchain encryption technology to ensure the readability and availability of the data. If the data is found to be tampered with or inconsistent, the system will issue a warning and take appropriate measures.

[0037] The overall working principle of the system: (1) Decentralized storage: Data no longer relies on a single centralized storage node, but is distributed across multiple nodes. No node can unilaterally tamper with the data, ensuring the authenticity and integrity of the data. (2) Immutability: Each block in the blockchain contains the hash value of the previous block, forming a chain structure. If someone attempts to tamper with the data in a block, its hash value will be destroyed, and the hash values ​​of all subsequent blocks will also be affected, which will be detected by the system. (3) Traceability: Through the chain structure of the blockchain, the source and flow of data can be traced. Users can submit query requests through the visualization unit, and the system obtains relevant information from the blockchain based on the request and displays it to the user. (4) Smart contracts: Smart contracts are automated contracts executed on the blockchain, which can be automatically executed according to preset conditions. Through smart contracts, functions such as automated data management and access rights control can be realized.

[0038] Embodiment 3

[0039] Based on the first embodiment, Figure 1 As shown, the functions of the data preprocessing module mainly include data cleaning, aggregation and compression, and encryption processing. Data cleaning checks for outliers, missing values, or duplicate values ​​in the data and processes them to ensure the accuracy and consistency of the data. Algorithm steps:

[0040] (1) Check missing values: For each data point, check whether it is a missing value (NaN or None). Missing value processing strategy: delete missing values ​​or fill in missing values ​​(such as using mean, median, mode, etc.).

[0041] (2) Check for outliers: Calculate the statistics of the data (such as mean, standard deviation) and identify outliers based on the 3σ principle (or other statistical methods).

[0042] (3) Outlier processing strategy: delete outliers or correct outliers (such as using the average of neighboring values).

[0043] (4) Check for duplicate values: Use hash functions or unique identifiers to detect duplicate data and delete duplicate data.

[0044] The execution code is given below:

[0045] import numpy as np

[0046] import pandas as pd

[0047] #Assume that df is a DataFrame containing measurement data

[0048] # Check and handle missing values

[0049] df.fillna(df.mean(), inplace=True)#Fill missing values ​​with mean

[0050] # Check and handle outliers

[0051] mean = df.mean()

[0052] std = df.std()

[0053] df = df[(np.abs(df-mean) <= 3*std).all(axis = 1)] # delete outliers outside 3σ

[0054] # Check and remove duplicate values

[0055] df.drop_duplicates(inplace=True)

[0056] Data aggregation refers to merging multiple data points into one or more higher-level data points to reduce the amount of data. Algorithm steps: (1) Select an aggregation function: such as sum, average, maximum, minimum, etc. (2) Apply an aggregation function: Apply an aggregation function on a specified dimension (such as time, space).

[0057] The execution code is given below:

[0058] #Assume that df is a DataFrame containing time series data, 'time' is the time column, and 'value' is the measurement value column

[0059] #Aggregate data by time window (such as daily)

[0060] df.set_index('time',inplace=True)

[0061] df_aggregated = df.resample('D').mean() #average value for each day

[0062] Data compression refers to reducing the amount of data by reducing the redundancy or complexity of the data. Select Huffman coding or LZW compression algorithm and apply the compression algorithm to compress the preprocessed data.

[0063] Data encryption is to ensure the confidentiality and integrity of data. The pre-processed data needs to be encrypted through a secure communication protocol. Algorithm steps:

[0064] (1) Select an encryption algorithm: AES (Advanced Encryption Standard), RSA, etc.

[0065] (2) Generate key: Generate encryption key using a secure random number generator.

[0066] (3) Encrypted data: Encrypt data using encryption algorithms and keys.

[0067] (4) Transmit encrypted data: Transmit encrypted data through secure communication protocols (such as HTTPS and TLS).

[0068] The execution code is given below:

[0069] from cryptography.hazmat.primitives.ciphers import Cipher,algorithms,modes

[0070] from cryptography.hazmat.primitives importpadding

[0071] from cryptography.hazmat.backends import default_backend

[0072] import os

[0073] #Generate key and initialization vector (IV)

[0074] key = os.urandom(32) # AES-256 key

[0075] iv = os.urandom(16) #AES block size is 16 bytes

[0076] #Assume data_to_encrypt is preprocessed data (byte string)

[0077] #Pad the data to fit the AES block size

[0078] padder=padding.PKCS7(algorithms.AES.block_size).padder()

[0079] padded_data=padder.update(data_to_encrypt)+padder.finalize()

[0080] #Create an AES encryptor

[0081] cipher=Cipher(algorithms.AES(key),modes.CBC(iv),backend=default_backend())

[0082] encryptor=cipher.encryptor()

[0083] #Encrypted data

[0084] encrypted_data=encryptor.update(padded_data)+encryptor.finalize()

[0085] #At this time, encrypted_data is the encrypted data, which can be transmitted through secure protocols such as HTTPS / TLS

[0086] Embodiment 4

[0087] Based on the first embodiment, Figure 1 As shown in the figure, the data traceability module realizes the full traceability of data through on-chain data records, including data collection time, collection location, processing process and other information. This information is usually stored on the blockchain in the form of metadata and is associated with the actual measurement data. Algorithm steps:

[0088] (1) Metadata generation: During the data collection and processing process, metadata is generated containing information such as the collection time, collection location, and processing process.

[0089] (2) Metadata on-chain: Metadata is stored on-chain in the form of blockchain transactions to ensure that the data cannot be tampered with.

[0090] (3) Data tracing: When users need to trace data, they can obtain the complete historical information of the data by querying the metadata records on the blockchain.

[0091] The execution code is given below:

[0092]

[0093] The security verification module ensures the authenticity of the data by comparing the on-chain data with the actual data. This usually involves mechanisms such as data hash value comparison or digital signature verification. Algorithm steps:

[0094] (1) Data hash value calculation: During data collection and processing, the hash value of the data is calculated and stored on the chain. The hash value calculation uses the hash function:

[0095] hash_value=H(data)

[0096] (2) Calculation of the hash value of the actual data: When the user needs to verify the data, the hash value of the actual data is recalculated.

[0097] (3) Hash value comparison: Compare the hash value of the actual data with the hash value stored on the chain. If they match, the data is authentic and valid. Hash value comparison is to check whether the two hash values ​​are equal:

[0098] is_valid=(hash_value_on_chain==hash_value_of_actual_data)

[0099] The execution code is given below:

[0100] importhashlib

[0101] #Assume data_on_chain is the data stored on the chain (byte string), data_actual is the actual data (byte string)

[0102] #Calculate the hash value of the data on the chain

[0103] hash_value_on_chain=hashlib.sha256(data_on_chain).hexdigest()

[0104] #Calculate the hash value of the actual data

[0105] hash_value_of_actual_data=hashlib.sha256(data_actual).hexdigest()

[0106] #Compare hash values

[0107] is_valid=(hash_value_on_chain==hash_value_of_actual_data)

[0108] print(f"Data is valid:{is_valid}")

[0109] The above shows and describes the basic principles and main features of the present invention and the advantages of the invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention to be protected. The scope of protection of the present invention is defined by the attached claims and their equivalents.

Claims

1. The metrology verification data traceability and security management system based on blockchain technology includes a data acquisition and preprocessing module based on the system architecture, a blockchain storage and management module, and a data traceability and security verification module, which is characterized by: The data acquisition and preprocessing module is composed of a data acquisition module and a data preprocessing module. The data acquisition module is integrated on the metering equipment and consists of multiple sensors and a data processing unit. The data preprocessing module is deployed on the edge computing device and is connected to the data acquisition module through a high-speed network. The blockchain storage and management module is composed of a data chain module and an on-chain data management module. The data chain module is responsible for uploading the pre-processed data to the blockchain network, and the on-chain data management module is responsible for data management on the blockchain network. The data tracing and security verification module is composed of a data tracing module and a security verification module. The data tracing module is responsible for realizing the full-process tracing function of the data, and the security verification module is responsible for the authenticity verification and integrity check of the data.

2. The metrology verification data traceability and security management system based on blockchain technology according to claim 1 is characterized by: The data acquisition module is responsible for real-time collection of various parameters of the metering equipment, including temperature, pressure, and flow, to ensure the originality and integrity of the data; the data preprocessing module cleans, aggregates, and compresses the collected data to reduce the amount of data, improve the efficiency of data transmission and storage, and encrypts the data to ensure the confidentiality and integrity of the data.

3. The metrology verification data traceability and security management system based on blockchain technology according to claim 1 is characterized by: The data acquisition module is connected to the metering device through the built-in interface of the metering device or the external sensor interface to obtain data in real time; the data preprocessing module transmits and receives data with the data acquisition module through a high-speed network, preprocesses and encrypts the received data, and then transmits it to the blockchain storage and management module.

4. The metrology verification data traceability and security management system based on blockchain technology according to claim 1 is characterized by: The data on-chain module uploads the preprocessed and encrypted data to the blockchain network through the API interface, using the distributed storage and immutability of the blockchain to ensure the security and credibility of the data. At the same time, a hybrid consensus mechanism is used to improve the security and efficiency of the blockchain network. The on-chain data management module manages data on the blockchain network, including data storage, retrieval and update, and realizes automated data management through smart contracts to ensure data compliance and consistency.

5. The metrology verification data traceability and safety management system based on blockchain technology according to claim 1 is characterized by: The data on-chain module and the data preprocessing module transmit and receive data through a high-speed network; the on-chain data management module interacts with other nodes in the blockchain network to realize distributed storage and management of data. At the same time, the on-chain data management module also interacts with the data tracing and security verification module to provide data retrieval and verification services.

6. The metrology verification data traceability and security management system based on blockchain technology according to claim 1 is characterized by: The data tracing module uses the traceability of blockchain to achieve full traceability of data through on-chain data records. Users submit data query requests through the visualization unit, and the system obtains relevant metadata information from the blockchain and displays it to the user; the security verification module is responsible for data authenticity verification and integrity verification, ensuring the authenticity of the data by comparing on-chain data with actual data, and using blockchain encryption technology to decrypt and process the data to ensure data readability and availability.

7. The metrology verification data traceability and security management system based on blockchain technology according to claim 1 is characterized by: The data tracing module and the security verification module transmit and receive data through an internal interface. At the same time, the data tracing module interacts with the user interface, receives the user's query request and displays the query result; the security verification module interacts with the blockchain storage and management module to obtain the on-chain data for verification and comparison.

Images