Blockchain-based method and system for remote big data acquisition and secure transmission

Abstract

The present invention relates to the technical field of data transmission, and, in particular, to a blockchain-based method for remote big data acquisition and secure transmission. Acquisition and transmission steps comprise: S1. determining a type of data acquisition and selecting an appropriate acquisition tool; S2. writing a script for the data acquisition and preprocessing acquired data; S3. storing the acquired data and placing same into a storage system for storage; and S4. by means of establishing a secure tunnel by means of a VPN between the storage system and the interior of a computer at the other end, a user passing facial authentication when performing data transmission. According to the present invention, data transmission is performed by means of an established VPN tunnel, and the face of the user is authenticated before and after the transmission, so that it can be ensured that the data transmission is an operation of a technician, and lawbreakers are prevented from operating to transmit data. In a transmission process, the transmitted data is encrypted to prevent the data from being intercepted during transmission, thereby resulting in better use prospects.

Description

Remote big data collection and secure transmission method and system based on blockchain Technical Field

[0001] The present invention belongs to the field of data transmission technology, and specifically relates to a remote big data collection and secure transmission method and system based on blockchain. Background Art

[0002] Blockchain is a decentralized distributed ledger with block chain storage, immutability, security and reliability. It combines distributed storage, peer-to-peer transmission, consensus mechanism, cryptography and other technologies to record transactions and information through a growing data block chain to ensure data security and transparency. Blockchain originated from Bitcoin and was originally proposed by Satoshi Nakamoto in 2008. As the underlying technology of Bitcoin, from the early days of the Bitcoin network, blockchain has gradually evolved into a global technology, attracting global attention and investment. Subsequently, the emergence of a new generation of blockchain platforms such as Ethereum has further expanded its application areas. The characteristics of blockchain include decentralization, immutability, transparency, security and programmability. Each data block is linked to the previous block to form a continuous chain, which ensures the integrity of the transaction history. Smart contract technology makes blockchain programmable and supports a wider range of applications. Data transmission is the communication process of transmitting data from one place to another. The data transmission system usually consists of a transmission channel and The data transmission system is composed of data circuit termination devices at both ends of the channel. In some cases, it also includes multiplexing devices at both ends of the channel. The transmission channel can be a dedicated communication channel or provided by a data exchange network, a telephone exchange network or other types of switching networks. The input and output devices of the data transmission system are terminals or computers, collectively referred to as data terminal equipment. The data information it sends is generally a combination of letters, numbers and symbols. In order to transmit this information, each letter, number or symbol must be represented by a binary code. Data transmission is the communication process of transmitting data from one place to another. However, with the rapid development of computer big data, the amount of computer data transmission has increased. When collecting and transmitting data in the blockchain, there is no more secure way to transmit data. The transmitted data is easily leaked, resulting in data loss and causing serious damage to the blockchain. In this regard, we propose a remote big data collection and secure transmission method and system based on blockchain. Technical issues

[0003] In response to the shortcomings of the existing technology, the present invention provides a blockchain-based remote big data collection and secure transmission method and system to solve the above technical problems. Technical Solutions

[0004] To achieve the above objectives, the present invention provides the following technical solution: a remote big data collection and secure transmission method based on blockchain, wherein the collection and transmission steps are as follows:

[0005] S1. Determine the type of data collection and select the appropriate collection tool;

[0006] S2. Write a script for data collection and pre-process the collected data;

[0007] S3. Storing the collected data in a storage system for preservation;

[0008] S4. A secure tunnel is established between the storage system and the computer at the other end through VPN. When data is transmitted, the user confirms the transmission through facial authentication.

[0009] S5. Encrypt the transmitted data by using quantum cryptography, and transmit the encrypted data through the established VPN tunnel to the computer at the other end;

[0010] S6. The user passes facial authentication again, decrypts the encrypted data, and obtains the collected data.

[0011] Preferably, the data types collected in step S1 include transaction data, block data, and network status data, and the selected collection tools include Python-based Web3.py and Web3.js libraries for obtaining data from Ethereum blockchain nodes or blockchain networks.

[0012] Preferably, the data preprocessing in step S2 includes data cleaning, data conversion, and data integration. The data cleaning step is to detect and analyze the data to obtain quality problems in the data, define cleaning rules based on the quality problems found in the data analysis, use a clustering algorithm to clean the data, execute the cleaning plan, and perform cleaning operations on the problems in the data;

[0013] The data conversion step is to convert the format of the cleaned data. After the conversion, verification is performed to ensure that the converted format is accurate.

[0014] The data integration step is to merge the converted data into a unified data set and store the data.

[0015] Prior to this, the steps for establishing a VPN secure tunnel in step S4 are to select a point-to-point tunnel according to needs, use the L2TP tunnel protocol, set corresponding VPN tunnel policies and security rules in the firewall, use the OpenVPN tunnel tool to create it, isolate the public network from the internal network, install the VPN client software on the other computer, and set up the relevant configuration files, which include the IP address, user name and password, use the VPN client software to connect to the created VPN tunnel for interactive data transmission.

[0016] Prior to this, the facial authentication method in step S4 is to log in to the client by inputting the account information in advance, enter the user's facial information, and continuously turn the head to completely enter the head information into the computer. The facial authentication method is based on the feature face method for facial recognition, and recognizes the face by projecting the face image into the image space of the standard face and comparing their projections.

[0017] First, the eigenface method assumes T is the processing image matrix, each column corresponds to an image after subtracting the mean image, then the variance matrix is ​​S=TT, and the eigenvalue decomposition of S is:

[0018] Among them TT t For a large matrix, use the following eigenvalue decomposition: Multiplying both sides of the equation by T yields:

[0019] If ui is TT t is a feature vector of S, then vi=Tui is a feature vector of S. Assuming that our training set has 300 images of 100×100 pixels, then TT t It is a 300×300 matrix, which is easier to handle than the original 10000×10000 covariance matrix.

[0020] Prioritize, in step S5, the quantum encryption method establishes a quantum channel between the sending end and the establishing end. The quantum channel is an optical fiber. The sending end sends some random quanta to the receiving end. The quanta are measured during the transmission process. The receiving end also sends random quanta to the sending end. The sending end and the receiving end jointly generate a key. The receiving end and the sending end convert the state of the photon into 0 or 1, and repeat the steps continuously to obtain a common key of n. The receiving end and the sending end encrypt and decrypt the key information.

[0021] Preferentially, to create a keyframe, a photon is allowed to pass through a 0 or 1 slit in a linear or diagonal polarizer while recording different directions. For each injected bit, a filter is randomly selected to detect and write both the polarization direction and the bit value.

[0022] He did not specify which pattern is used to receive individual photons, however, whether each photon has a bit of 0 or 1. Photons delete photons that are not observed in the correct pattern, while photons observed in the correct pattern are the key input into the algorithm that encrypts or decrypts the message.

[0023] Preferably, in step S4, when establishing the VPN tunnel, the VPN client and the VPN server perform authentication and key negotiation. If the authentication is successful, a secure communication channel will be established between the VPN client and the VPN server for encrypting and transmitting data.

[0024] The blockchain-based remote big data collection and secure transmission system includes a computer, collection scripts, a storage system, a VPN security tunnel, a facial recognition system, and an encryption system. The collection script is written inside the computer, the storage system is used to store the collected data, the facial recognition system is used to authenticate users, and the encryption system is used to encrypt the data. Beneficial effects

[0025] Compared with the prior art, the present invention has the following beneficial effects:

[0026] The present invention transmits data through an established VPN tunnel and authenticates the user's face before and after the transmission, thereby ensuring that the data transmission is performed by technical personnel and blocking illegal operations on the transmitted data. During the transmission process, the transmitted data is encrypted to prevent the data from being intercepted during the transmission process, bringing better usage prospects. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] FIG1 is a framework diagram of the secure transmission steps of the present invention. Modes for Carrying Out the Invention

[0028] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0029] The present invention provides a technical solution: a remote big data collection and secure transmission method based on blockchain, the collection and transmission steps are as follows:

[0030] S1. Determine the type of data collection and select the appropriate collection tool;

[0031] S2. Write a script for data collection and pre-process the collected data;

[0032] S3. Storing the collected data in a storage system for preservation;

[0033] S4. A secure tunnel is established between the storage system and the computer at the other end through VPN. When data is transmitted, the user confirms the transmission through facial authentication.

[0034] S5. Encrypt the transmitted data by using quantum cryptography, and transmit the encrypted data through the established VPN tunnel to the computer at the other end;

[0035] S6. The user passes facial authentication again, decrypts the encrypted data, and obtains the collected data.

[0036] Furthermore, the data types collected in step S1 include transaction data, block data, and network status data. The selected collection tools include the Python-based Web3.py and Web3.js libraries, which are used to obtain data from Ethereum blockchain nodes or blockchain networks.

[0037] Furthermore, the data preprocessing in step S2 includes data cleaning, data conversion, and data integration. The data cleaning step is to detect and analyze the data to obtain quality problems in the data. Based on the quality problems found in the data analysis, cleaning rules are defined, clustering algorithms are used to clean the data, and cleaning solutions are executed to clean the problems in the data.

[0038] The data conversion step is to convert the format of the cleaned data. After the conversion, verification is performed to ensure that the converted format is accurate.

[0039] The data integration step is to merge the converted data into a unified data set and store the data.

[0040] Furthermore, the VPN secure tunnel establishment step in step S4 is to select a point-to-point tunnel according to needs, use the L2TP tunnel protocol, set the corresponding VPN tunnel policy and security rules in the firewall, use the OpenVPN tunnel tool to create it, isolate the public network from the internal network, install the VPN client software on the other end computer, and set the relevant configuration file, which includes the IP address, user name and password, and use the VPN client software to connect to the created VPN tunnel for interactive data transmission;

[0041] L2TP is a connection-based protocol that includes session establishment tunneling;

[0042] Establish a control connection for the tunnel;

[0043] An L2TP tunnel is established between an LAC and an LNS and consists of a control connection and at least one L2TP session. Multiple L2TP tunnels can be established between a pair of LACs and LNSs.

[0044] Although an L2TP session is also established between the LAC and LNS, L2TP can send PPP frames through the tunnel only after the tunnel is established normally. The dialogue and call are one-to-one corresponding, and the call status is maintained by the LAC and LNS. Multiple sessions can be established in the L2TP tunnel.

[0045] Furthermore, in step S4, the facial authentication method logs into the client by inputting the account information in advance, enters the user's facial information, and continuously turns the head to completely enter the head information into the computer. The facial authentication method performs facial recognition based on the feature face method, and recognizes the face by projecting the face image into the image space of the standard face and comparing their projections.

[0046] Furthermore, the eigenface method assumes T is the processing image matrix, each column corresponds to an image after subtracting the mean image, then the variance matrix is ​​S=TT, and the eigenvalue of S is decomposed into: Among them TT t For a large matrix, use the following eigenvalue decomposition: Multiplying both sides of the equation by T yields: If ui is TT t is a feature vector of S, then vi=Tui is a feature vector of S. Assuming that our training set has 300 images of 100×100 pixels, then TT t It is a 300×300 matrix, which is easier to handle than the original 10000×10000 covariance matrix.

[0047] Furthermore, in step S5, the quantum encryption method establishes a quantum channel between the sending end and the establishing end. The quantum channel is an optical fiber. The sending end sends some random quanta to the receiving end. The quanta are measured during the transmission process. The receiving end also sends random quanta to the sending end. The sending end and the receiving end jointly generate a key. The receiving end and the sending end convert the state of the photon to 0 or 1. The steps are repeated continuously to obtain a common key of n. The receiving end and the sending end encrypt and decrypt the key information.

[0048] Quantum encryption provides extremely high security. Since quantum states cannot be cloned, attackers cannot steal keys or information. In addition, when quantum states are eavesdropped or interfered with, their state changes, so the attacker can detect the attack by detecting the change in the quantum state.

[0049] Secondly, quantum encryption provides perfect confidentiality. Since the quantum state is unmeasurable during transmission, attackers cannot obtain any information from it. Even if attackers can steal the key or quantum state, they cannot obtain any useful information because the quantum state information will be immediately destroyed after being stolen or interfered with.

[0050] Finally, quantum encryption provides a guarantee for future network security. Since quantum encryption utilizes basic physical principles, it will not be threatened by future computing technologies. Even if new computing technologies such as quantum computers emerge in the future, quantum encryption can still provide high-intensity protection.

[0051] Furthermore, to create keyframes, photons are allowed to pass through 0 or 1 slits in a linear or diagonal polarizer while recording different directions. For each injected bit, a filter is randomly selected to detect and write the polarization direction and bit value.

[0052] He did not specify which pattern is used to receive individual photons, however, whether each photon has a bit of 0 or 1. Photons delete photons that are not observed in the correct pattern, while photons observed in the correct pattern are the key input into the algorithm that encrypts or decrypts the message.

[0053] Furthermore, in step S4, when establishing the VPN tunnel, the VPN client and the VPN server perform authentication and key negotiation. If the authentication is successful, a secure communication channel will be established between the VPN client and the VPN server for encrypting and transmitting data.

[0054] The blockchain-based remote big data collection and secure transmission system includes a computer, collection scripts, a storage system, a VPN security tunnel, a facial recognition system, and an encryption system. The collection script is written inside the computer, the storage system is used to store the collected data, the facial recognition system is used to authenticate users, and the encryption system is used to encrypt the data.

[0055] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus.

[0056] While embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions, and variations may be made to these embodiments without departing from the principles and spirit of the invention, and that the scope of the invention is defined by the appended claims and their equivalents.

Claims

1. A remote big data collection and secure transmission method based on blockchain, characterized in that: The steps of collection and transmission are: S1. Determine the type of data collection and select the appropriate collection tool; S2, write a script for data collection and pre-process the collected data; S3, storing the collected data and placing it in a storage system for preservation; S4, by establishing a secure tunnel through VPN between the storage system and the computer at the other end, when data is transmitted, the user confirms the transmission through facial authentication; S5. Encrypt the transmitted data by using quantum encryption, and transmit the encrypted data through the established VPN tunnel to the computer at the other end; S6. The user passes facial authentication again, decrypts the encrypted data, and obtains the collected data.

2. The remote big data collection and secure transmission method based on blockchain according to claim 1 is characterized in that: The data types collected in step S1 include transaction data, block data and network status data. The selected collection tools include Python-based Web3.py and Web3.js libraries, which are used to obtain data from Ethereum blockchain nodes or blockchain networks.

3. The remote big data collection and secure transmission method based on blockchain according to claim 1 is characterized in that: The data preprocessing in step S2 includes data cleaning, data conversion and data integration. The data cleaning step is to detect and analyze the data to obtain quality problems in the data. According to the quality problems in the data analysis, the cleaning rules are defined, the clustering algorithm is used to clean the data, the cleaning plan is executed, and the problems in the data are cleaned; The data conversion step is to convert the format of the cleaned data. After the conversion, verification is performed to ensure that the converted format is accurate. The data integration step is to uniformly merge and integrate the converted data into a unified data set and store the data.

4. The remote big data collection and secure transmission method based on blockchain according to claim 1 is characterized in that: The steps for establishing a VPN security tunnel in step S4 are to select a point-to-point tunnel according to needs, use the L2TP tunnel protocol, set the corresponding VPN tunnel policy and security rules in the firewall, use the OpenVPN tunnel tool to create it, isolate the public network from the internal network, install the VPN client software on the other computer, and set up the relevant configuration files. The configuration files include the IP address, user name and password, and use the VPN client software to connect to the created VPN tunnel for interactive data transmission.

5. The remote big data collection and secure transmission method based on blockchain according to claim 1 is characterized in that: In step S4, the facial authentication method logs into the client by inputting the account information in advance, enters the user's facial information, and constantly turns the head to completely enter the head information into the computer. The facial authentication method performs facial recognition based on the feature face method, and recognizes the face by projecting the face image into the image space of the standard face and comparing their projections.

6. The remote big data collection and secure transmission method based on blockchain according to claim 5 is characterized in that: Eigenface method Let T be the processing image matrix, each column corresponds to an image after subtracting the mean image, then the variance matrix is ​​S=TT, and the eigenvalue of S is decomposed into: TT t For a large matrix, use the following eigenvalue decomposition: Multiplying both sides of the equation by T yields: If ui is TT t is a feature vector of S, then vi=Tui is a feature vector of S. Assuming that our training set has 300 images of 100×100 pixels, then TT t is a 300×300 matrix, which is easier to handle than the original 10000×10000 covariance matrix.

7. The remote big data collection and secure transmission method based on blockchain according to claim 1 is characterized in that: In step S5, the quantum encryption method establishes a quantum channel between the sending end and the establishing end. The quantum channel is an optical fiber. The sending end sends some random quanta to the receiving end. The quanta are measured during the transmission process. The receiving end also sends random quanta to the sending end. The sending end and the receiving end jointly generate a key. The receiving end and the sending end convert the state of the photon into 0 or 1, and repeat the steps to obtain a common key of n. The receiving end and the sending end encrypt and decrypt the key information.

8. The remote big data collection and secure transmission method based on blockchain according to claim 7 is characterized in that: To create a keyframe, photons are allowed to pass through either a 0 or 1 slit in a linear or diagonal polarizer, recording different directions simultaneously. For each injected bit, a filter is randomly selected to detect and write both the polarization direction and the bit value. He did not specify which pattern is used to receive individual photons, however, whether each photon's bit is a 0 or a 1, and the photons delete photons that are not observed in the correct pattern, while photons observed in the correct pattern are the key input into the algorithm that encrypts or decrypts the message.

9. The remote big data collection and secure transmission method based on blockchain according to claim 1 is characterized in that: In step S4, when establishing the VPN tunnel, the VPN client and the VPN server perform identity authentication and key negotiation. If the identity authentication is successful, a secure communication channel will be established between the VPN client and the VPN server for encryption and transmission of data.

10. A remote big data collection and secure transmission system based on blockchain, characterized by: The system includes a computer, a collection script, a storage system, a VPN security tunnel, a facial recognition system and an encryption system. The collection script is written inside the computer, the storage system is used to store the collected data, the facial recognition system is used to authenticate the user, and the encryption system is used to encrypt the data.

Images