A Big Data Analysis Method, Device and System Based on Blockchain

Abstract

The present invention discloses a big data analysis method, device and system based on blockchain. The device includes a request upload unit, a log recording unit and a decryption analysis unit. The system includes a big data analysis platform and a blockchain. By encrypting and decentralizing the storage of requests input by users, and decentralizing the storage of transaction data to the blockchain, the method, device and system improve the security and stability of big data analysis; further, the method, device and system also receive the transaction information included in the record retrieval request input by the user, retrieve associated transaction data, and parse the position information of the ciphertext data requested to be retrieved from the transaction data to obtain the ciphertext data, thereby realizing the traceability of requests and transactions.

Description

Technical Field

[0001] The present invention relates to the field of big data analysis based on blockchain, and relates to a big data analysis method, device and system based on blockchain. Background Art

[0002] With the development of Internet technology, more and more user data is stored on the server as portraits or in its entirety. However, the network security situation continues to deteriorate, and various malicious network behaviors, whether within enterprises or between enterprises, are threatening user information security and data security. Even worse, malicious behaviors targeting enterprises are causing the leakage or random analysis of high-value and highly sensitive data information of enterprises, resulting in the inability to protect data security and user / customer privacy.

[0003] In the prior art, although the data has great value, data analysis and mining generally do not perform encrypted storage and transmission, but instead clean the data before big data analysis. A common example is Hadoop, which is a tool for storing and analyzing massive amounts of data. For sensitive information in the data, this part of the data is generally cleaned. A common method is to replace certain sensitive information or characters with other characters through a certain algorithm. For example, "admin" will be replaced with "a*d*m".

[0004] However, the prior art still has the following defects: 1. Data is generally stored in plaintext, the server is centralized, there is no strict filtering or permission review mechanism, it is vulnerable to hacker attacks or unauthorized use by service providers without the consent of users, and the logs of data read by applications are incomplete and can be tampered with, which is unreliable in protecting information; 2. There is no way to trace the source after information is obtained, which also seriously affects the development of information protection work.

[0005] Therefore, there is a need for a big data analysis method, device and system based on blockchain to solve the above problems existing in the prior art. Summary of the Invention

[0006] Aiming at the existing above technical problems, the purpose of the present invention is to provide a big data analysis method, device and system based on blockchain to improve the security of big data analysis.

[0007] The present invention provides a big data analysis method based on blockchain, including: obtaining an access request input by a user, encrypting the access request to generate ciphertext data, and uploading the ciphertext data to the blockchain; the access request includes first data that the user requests to access; after receiving response information sent by the blockchain according to the ciphertext data, verifying the user's access permission, and when the verification passes, constructing transaction data according to the access request and the access permission, and uploading the transaction data to the blockchain; obtaining the first data sent by the blockchain according to the transaction data, and decrypting and analyzing the first data.

[0008] In one embodiment, the big data analysis method further includes: obtaining a record retrieval request input by a first user, sending the record retrieval request to the blockchain, and receiving first ciphertext data sent by the blockchain according to the record retrieval request; decrypting and analyzing the first ciphertext data and displaying it to the first user.

[0009] In one embodiment, the first ciphertext data sent by the blockchain according to the record retrieval request is specifically: the record retrieval request includes transaction information requested to be retrieved, and the blockchain retrieves associated first transaction data according to the transaction information; parsing the first transaction data to obtain the position information of the first ciphertext data in the blockchain, and obtaining the first ciphertext data according to the position information.

[0010] In one embodiment, the response information includes first positioning information of the ciphertext data in the blockchain, storage status, and the hash value of the ciphertext data.

[0011] In one embodiment, the transaction data includes the first positioning information, preset identity information, transaction IP positioning, and transaction time.

[0012] The present invention also provides a big data analysis device based on blockchain. The big data analysis device includes a request upload unit, a log recording unit, and a decryption and analysis unit. Among them, the request upload unit is used to obtain an access request input by a user, encrypt the access request to generate ciphertext data, and upload the ciphertext data to the blockchain; the access request includes first data that the user requests to access; the log recording unit is used to verify the user's access permission after receiving response information sent by the blockchain according to the ciphertext data, and when the verification passes, construct transaction data according to the access request and the access permission, and upload the transaction data to the blockchain; the decryption and analysis unit is used to obtain the first data sent by the blockchain according to the transaction data, and decrypt and analyze the first data.

[0013] In one embodiment, the big data analysis device further includes a record retrieval unit, and the record retrieval unit is configured to: obtain a record retrieval request input by a first user, send the record retrieval request to the blockchain, and receive first ciphertext data sent by the blockchain according to the record retrieval request; decrypt and analyze the first ciphertext data and display it to the first user.

[0014] The present invention also provides a big data analysis system based on a blockchain. The big data analysis system includes a big data analysis platform and a blockchain. The big data analysis platform is communicatively connected to the blockchain. Among them, the big data analysis platform is used to execute the big data analysis method based on the blockchain as described above.

[0015] In one embodiment, the big data analysis platform includes an analysis module and a client. Among them, the client is configured to obtain an access request input by a user, encrypt the access request to generate ciphertext data, and upload the ciphertext data to the blockchain; the access request includes first data that the user requests to access; and, after receiving response information sent by the blockchain according to the ciphertext data, verify the user's access permission, and when the verification passes, construct transaction data according to the access request and the access permission, and upload the transaction data to the blockchain; the analysis module is configured to obtain the first data sent by the blockchain according to the transaction data, and decrypt and analyze the first data.

[0016] In one embodiment, the blockchain is used to store the first data, the ciphertext data, and the transaction data.

[0017] Compared with the prior art, the embodiments of the present invention have the following beneficial effects:

[0018] The present invention provides a big data analysis method, device, and system based on a blockchain. By encrypting and decentralizing the storage of requests input by users, and decentralizing the storage of transaction data to the blockchain, the method, device, and system improve the security and stability of big data analysis.

[0019] Furthermore, the big data analysis method, device, and system based on the blockchain provided by the present invention also receive transaction information included in the record retrieval request input by the user, retrieve associated transaction data, and parse the position information of the ciphertext data requested to be retrieved from the transaction data to obtain the ciphertext data, thereby realizing the traceability of requests and transactions. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The present invention will be further described and illustrated below in conjunction with the accompanying drawings of the specification, where:

[0021] Figure 1The flowchart of an embodiment of a big data analysis method based on blockchain according to the present invention is shown;

[0022] Figure 2 The flowchart of another embodiment of a big data analysis method based on blockchain according to the present invention is shown;

[0023] Figure 3 The structural diagram of an embodiment of a big data analysis device based on blockchain according to the present invention is shown;

[0024] Figure 4 The structural diagram of an embodiment of a big data analysis system based on blockchain according to the present invention is shown. Detailed implementation manners

[0025] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention. Specific embodiment one

[0027] The present invention first provides a big data analysis method based on blockchain. Figure 1 The flowchart of an embodiment of a big data analysis method based on blockchain according to the present invention is shown. As Figure 1 shown, the method includes the following steps:

[0028] S1: Obtain the access request input by the user, encrypt the access request to generate ciphertext data, and upload the ciphertext data to the blockchain.

[0029] The access request includes the first data that the user requests to access, and the first data is the data that is pre-stored on the blockchain and can be accessed. In one embodiment, when uploading the ciphertext data to the blockchain, the blockchain will verify the identity of the uploader. Only when the verification is passed, the blockchain will receive and store the ciphertext data. Subsequently, the blockchain will send the first location information, storage status, and hash value of the ciphertext data in the blockchain as response information to the uploader to feedback the storage situation of the ciphertext data on the blockchain.

[0030] S2: After receiving the response information sent by the blockchain according to the ciphertext data, verify the access permission of the user. When the verification is passed, construct transaction data according to the access request and the access permission, and upload the transaction data to the blockchain.

[0031] The response information includes the first positioning information of the ciphertext data in the blockchain, the storage status, and the hash value of the ciphertext data; the transaction data includes the first positioning information, the preset identity information, the transaction IP positioning, and the transaction time.

[0032] S3: Obtain the first data sent by the blockchain according to the transaction data, and decrypt and analyze the first data.

[0033] In one embodiment, after decrypting and analyzing the first data, the data result after decryption and analysis needs to be sent to the blockchain for storage. Subsequently, the user who requests access can view the data result through the blockchain. In one embodiment, after decrypting and analyzing the first data, the data result after decryption and analysis is directly sent to the user who requests access for display, and the instruction is executed after the user further gives an instruction (for example, storage, download, upload, and charting).

[0034] In one embodiment, the encryption and decryption methods in the whole process are symmetric encryption.

[0035] The present invention provides a big data analysis method based on blockchain. By encrypting and decentralizing the storage of the request input by the user, and decentralizing the storage of the transaction data to the blockchain, the method improves the security and stability of big data analysis. Specific Embodiment Two

[0037] Furthermore, this embodiment also provides another embodiment of a big data analysis method based on blockchain. As Figure 2 shown, the method includes the following steps:

[0038] A1: Obtain the access request input by the user, encrypt the access request to generate ciphertext data, and upload the ciphertext data to the blockchain.

[0039] The access request includes the first data that the user requests to access. In one embodiment, when uploading the ciphertext data to the blockchain, the blockchain will verify the identity of the uploader. Only when the verification is passed, the blockchain will receive and store the ciphertext data. Subsequently, the blockchain sends the first positioning information, the storage status, and the hash value of the ciphertext data in the blockchain as response information to the uploader to feedback the storage situation of the ciphertext data on the blockchain.

[0040] A2: After receiving the response information sent by the blockchain according to the ciphertext data, verify the access permission of the user. When the verification is passed, construct transaction data according to the access request and the access permission, and upload the transaction data to the blockchain.

[0041] The response information includes the first positioning information of the ciphertext data in the blockchain, the storage status, and the hash value of the ciphertext data; the transaction data includes the first positioning information, preset identity information, transaction IP positioning, and transaction time.

[0042] A3: Obtain the first data sent by the blockchain according to the transaction data, and decrypt and analyze the first data.

[0043] In one embodiment, after decrypting and analyzing the first data, it is also necessary to send the data result after decryption analysis to the blockchain for storage. Subsequently, the user who requests access can view the data result through the blockchain. In one embodiment, after decrypting and analyzing the first data, directly send the data result after decryption analysis to the user who requests access for display, and execute the instruction (such as storage, download, upload, and charting) after the user further gives an instruction.

[0044] A4: Obtain a record retrieval request input by the first user, send the record retrieval request to the blockchain, and receive the first ciphertext data sent by the blockchain according to the record retrieval request.

[0045] The first ciphertext data sent by the blockchain according to the record retrieval request is specifically: the record retrieval request includes the transaction information to be retrieved, the blockchain retrieves the associated first transaction data according to the transaction information; parse the first transaction data to obtain the position information of the first ciphertext data in the blockchain, and obtain the first ciphertext data according to the position information.

[0046] A5: Decrypt and analyze the first ciphertext data and display it to the first user.

[0047] The present invention provides a big data analysis method based on blockchain. By encrypting and decentralizing the storage of the request input by the user, and decentralizing the storage of transaction data to the blockchain, this method, device, and system improve the security and stability of big data analysis; further, the big data analysis method based on blockchain provided by the present invention also receives the transaction information included in the record retrieval request input by the user, retrieves the associated transaction data, and parses the position information of the ciphertext data to be retrieved from the transaction data to obtain the ciphertext data, thereby realizing the traceability of requests and transactions. Specific Embodiment Three

[0049] In addition to the above method, the present invention also provides a big data analysis device based on blockchain. Figure 3 Shows a structural diagram of an embodiment of a big data analysis device based on blockchain according to the present invention. AsFigure 3 As shown in Figure 3 , the big data analysis device includes a request upload unit 101, a log recording unit 102, and a decryption and analysis unit 103.

[0050] The request upload unit 101 is configured to obtain an access request input by a user, encrypt the access request to generate ciphertext data, and upload the ciphertext data to the blockchain. The access request includes first data that the user requests to access.

[0051] The log recording unit 102 is configured to, after receiving response information sent by the blockchain according to the ciphertext data, verify the user's access permission, and when the verification passes, construct transaction data based on the access request and the access permission, and upload the transaction data to the blockchain. The log recording unit 102 is further configured to receive the response information sent by the blockchain according to the ciphertext data. In one embodiment, the transaction data includes the first location information, preset identity information, transaction IP location, and transaction time.

[0052] The decryption and analysis unit 103 is configured to obtain the first data sent by the blockchain according to the transaction data, and decrypt and analyze the first data.

[0053] In one embodiment, the big data analysis device 10 further includes a record retrieval unit 104. The record retrieval unit 104 is configured to obtain a record retrieval request input by a first user, send the record retrieval request to the blockchain, and receive first ciphertext data sent by the blockchain according to the record retrieval request; decrypt and analyze the first ciphertext data and display it to the first user.

[0054] When big data analysis needs to be performed based on the blockchain, first, the request upload unit 101 obtains an access request input by a user, encrypts the access request to generate ciphertext data, and uploads the ciphertext data to the blockchain; subsequently, the log recording unit 102 receives the response information sent by the blockchain according to the ciphertext data, and after receiving the response information sent by the blockchain according to the ciphertext data, verifies the user's access permission, and when the verification passes, constructs transaction data based on the access request and the access permission, and uploads the transaction data to the blockchain; then, the decryption and analysis unit 103 obtains the first data sent by the blockchain according to the transaction data, and decrypts and analyzes the first data. When access records need to be retrieved, the record retrieval unit 104 obtains a record retrieval request input by a first user, sends the record retrieval request to the blockchain, and receives first ciphertext data sent by the blockchain according to the record retrieval request; decrypts and analyzes the first ciphertext data and displays it to the first user.

[0055] The present invention provides a big data analysis device based on blockchain, which encrypts and decentralizes the storage of requests input by users, and decentralizes the storage of transaction data to the blockchain. This method, device and system improve the security and stability of big data analysis; further, the big data analysis device based on blockchain provided by the present invention also receives the transaction information included in the record retrieval request input by the user, retrieves associated transaction data, and parses the position information of the ciphertext data requested to be retrieved from the transaction data to obtain the ciphertext data, thereby realizing the traceability of requests and transactions. Specific Embodiment Four

[0057] In addition to the above methods and devices, the present invention also provides a big data analysis system based on blockchain. Figure 4 The structure diagram of an embodiment of a big data analysis system based on blockchain according to the present invention is shown. The big data analysis system includes a big data analysis platform 1 and a blockchain 2, and the big data analysis platform 1 is communicatively connected to the blockchain 2. Among them, the big data analysis platform 1 is used to execute the big data analysis method based on blockchain as described above.

[0058] In one embodiment, the big data analysis platform 1 includes an analysis module 11 and a client 12.

[0059] Among them, the client 12 is used to obtain the access request input by the user, encrypt the access request to generate ciphertext data, and upload the ciphertext data to the blockchain 2; and, after receiving the response information sent by the blockchain 2 according to the ciphertext data, verify the user's access permission, and when the verification passes, construct transaction data according to the access request and the access permission, and upload the transaction data to the blockchain 2.

[0060] The analysis module 11 is used to obtain the first data sent by the blockchain 2 according to the transaction data, and decrypt and analyze the first data.

[0061] In one embodiment, the blockchain 2 is used to store the first data, the ciphertext data and the transaction data. Among them, the first data is a pre-stored large data set.

[0062] In one embodiment, the client 12 is further used to obtain the record retrieval request input by the first user, send the record retrieval request to the blockchain 2, and receive the first ciphertext data sent by the blockchain 2 according to the record retrieval request; decrypt and analyze the first ciphertext data and display it to the first user.

[0063] When big data analysis is required based on Blockchain 2, the client 12 obtains the access request input by the user, encrypts the access request to generate ciphertext data, and uploads the ciphertext data to Blockchain 2; after receiving the ciphertext data, Blockchain 2 stores the ciphertext data, obtains the location information, storage status, and hash value of the ciphertext data, and sends the location information, storage status, and hash value of the ciphertext data as response information to the client 12; after receiving the response information, the client 12 verifies the user's access permission by verifying the user's identity information (e.g., ID or user key), and when the verification passes, constructs transaction data according to the access request and the access permission, and uploads the transaction data to Blockchain 2; after receiving the transaction data, Blockchain 2 sends the first data requested by the user to the analysis module 11; the analysis module 11 decrypts and analyzes the first data to obtain a data result, and sends the decrypted and analyzed data result to Blockchain 2 for storage, and the client 12 can view the data result through Blockchain 2. When access records need to be retrieved, the client 12 is also used to obtain the record retrieval request input by the first user and send the record retrieval request to Blockchain 2; Blockchain 2 receives the record retrieval request (the record retrieval request includes the transaction information to be retrieved), and retrieves the associated first transaction data according to the transaction information; subsequently, Blockchain 2 parses the first transaction data to obtain the location information of the first ciphertext data in the blockchain, and obtains the first ciphertext data according to the location information; after receiving the first ciphertext data, the client 12 decrypts and analyzes the first ciphertext data and displays it to the first user.

[0064] The present invention provides a big data analysis system based on blockchain. By encrypting and decentralizing the storage of the requests input by users, and decentralizing the storage of transaction data to the blockchain, this method, device, and system improve the security and stability of big data analysis; further, the big data analysis system based on blockchain provided by the present invention also receives the transaction information included in the record retrieval request input by the user, retrieves the associated transaction data, and parses the location information of the ciphertext data to be retrieved from the transaction data to obtain the ciphertext data, thereby realizing the traceability of requests and transactions.

[0065] The specific embodiments described above further elaborate on the purpose, technical solutions, and beneficial effects of the present invention. It should be understood that the above are only specific embodiments of the present invention and are not used to limit the protection scope of the present invention. In particular, it is pointed out that for those skilled in the art, any modifications, equivalent replacements, improvements, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A big data analysis method based on blockchain, characterized in that, it includes: Obtain an access request input by a user, encrypt the access request to generate ciphertext data, and upload the ciphertext data to the blockchain; The access request includes first data that the user requests to access; the blockchain verifies the identity of the uploader, and when the verification is passed, the blockchain receives and stores the ciphertext data; After receiving the response information sent by the blockchain according to the ciphertext data, verify the user's access permission, and when the verification is passed, construct transaction data according to the access request and the access permission, and upload the transaction data to the blockchain; the response information includes the first positioning information, storage status and hash value of the ciphertext data in the blockchain; Obtain the first data sent by the blockchain according to the transaction data, and decrypt and analyze the first data; It also includes obtaining a record retrieval request input by a first user, sending the record retrieval request to the blockchain, and receiving the first ciphertext data sent by the blockchain according to the record retrieval request; decrypting and analyzing the first ciphertext data and displaying it to the first user. Specifically, the record retrieval request includes transaction information requested to be retrieved, and the blockchain retrieves associated first transaction data according to the transaction information; parse the first transaction data to obtain the position information of the first ciphertext data in the blockchain, and obtain the first ciphertext data according to the position information.

2. The big data analysis method based on blockchain according to claim 1, characterized in that, The transaction data includes the first positioning information, preset identity information, transaction IP positioning and transaction time.

3. A big data analysis device based on blockchain, characterized in that, The big data analysis device includes a request upload unit, a log record unit and a decryption analysis unit, wherein, The request upload unit is used to obtain an access request input by a user, encrypt the access request to generate ciphertext data, and upload the ciphertext data to the blockchain; the access request includes first data that the user requests to access; the blockchain verifies the identity of the uploader, and when the verification is passed, the blockchain receives and stores the ciphertext data; The log record unit is used to verify the user's access permission after receiving the response information sent by the blockchain according to the ciphertext data, and when the verification is passed, construct transaction data according to the access request and the access permission, and upload the transaction data to the blockchain; the response information includes the first positioning information, storage status and hash value of the ciphertext data in the blockchain; The decryption analysis unit is used to obtain the first data sent by the blockchain according to the transaction data, and decrypt and analyze the first data; It further includes a record retrieval unit, and the record retrieval unit is used to: obtain a record retrieval request input by a first user, send the record retrieval request to the blockchain, and receive first ciphertext data sent by the blockchain according to the record retrieval request; decrypt and analyze the first ciphertext data and display it to the first user. Specifically, the record retrieval request includes transaction information for which retrieval is requested, and the blockchain retrieves associated first transaction data according to the transaction information; parse the first transaction data to obtain the position information of the first ciphertext data in the blockchain, and obtain the first ciphertext data according to the position information.

4. A big data analysis system based on a blockchain, characterized in that the big data analysis system includes a big data analysis platform and a blockchain, and the big data analysis platform is communicatively connected to the blockchain. Among them, the big data analysis platform is used to execute the big data analysis method based on the blockchain according to any one of claims 1-2.

5. The big data analysis system based on the blockchain according to claim 4, characterized in that the big data analysis platform includes an analysis module and a client, where the client is used to obtain an access request input by a user, encrypt the access request to generate ciphertext data, and upload the ciphertext data to the blockchain; the access request includes first data that the user requests to access; and, after receiving response information sent by the blockchain according to the ciphertext data, verify the user's access permission, and when the verification passes, construct transaction data according to the access request and the access permission, and upload the transaction data to the blockchain; the analysis module is used to obtain the first data sent by the blockchain according to the transaction data, and decrypt and analyze the first data.

6. The big data analysis system based on the blockchain according to claim 5, characterized in that the blockchain is used to store the first data, the ciphertext data, and the transaction data.

Images