A method and device for non-structured data evidence preservation

Abstract

The application discloses a kind of unstructured data evidence storage method and device, the method includes: in response to the request instruction of terminal sending, compress the unstructured data with the public key of the block node, obtain unstructured data compression package, carry out hash operation to the unstructured data compression package, obtain hash value, based on the generation time of the unstructured data compression package, the attribute information of the unstructured data and the storage address of the public key, generate the identifier of the unstructured data, and with the hash value form the voucher of the unstructured data, store the voucher and the unstructured data compression package in block chain and store evidence.

Description

Technical Field

[0001] This application relates to the field of blockchain technology, and more specifically, to a method and apparatus for storing unstructured data. Background Technology

[0002] With the continuous development of information technology, information security has become increasingly important. All kinds of data require security protection. Currently, blockchain technology offers a high level of security for data storage and retrieval. The information stored in each block is linked together in chronological order. Modifying information in the blockchain requires the consent of more than half of the nodes, and all nodes must be modified. Therefore, it features data that is difficult to tamper with and is decentralized. For unstructured data with irregular or incomplete structures, theoretically, direct storage on the blockchain would lead to severely low read / write and query efficiency. Therefore, the current approach is to perform a hash operation on the unstructured data, then save the hash value as text within the block, and store the unstructured data outside the block.

[0003] However, current practices under blockchain technology do not store unstructured data within the blockchain, failing to fully leverage the distributed storage capabilities of the blockchain. Because unstructured data is stored outside the blockchain, blockchain service nodes frequently interact with application servers and storage servers, severely reducing the processing efficiency of unstructured data storage.

[0004] How to store unstructured data on the blockchain is an issue that needs attention. Summary of the Invention

[0005] In view of the above problems, this application is proposed to provide a method and apparatus for storing unstructured data, so as to realize the storage of unstructured data on the blockchain.

[0006] To achieve the above objectives, the following specific solutions are proposed:

[0007] A method for storing unstructured data includes:

[0008] In response to a request from a terminal to store unstructured data, the unstructured data is compressed using the public key of the block node to obtain a compressed unstructured data package.

[0009] Perform a hash operation on the unstructured data compressed package to obtain a hash value;

[0010] Based on the generation time of the unstructured data compressed package, the attribute information of the unstructured data, and the storage address of the public key, an identifier for the unstructured data is generated, and together with the hash value, a credential for the unstructured data is formed.

[0011] The credentials and the unstructured data compressed package are stored in the blockchain for evidence preservation.

[0012] Optionally, the credentials and the unstructured data compressed package are stored as evidence in the relevant blockchain, including:

[0013] The credentials and the unstructured data compressed package are stored in the blockchain to which the block node belongs;

[0014] After successfully storing the credential and the unstructured data compressed package, a notification message indicating that the unstructured data compressed package has been stored is sent to the terminal.

[0015] Optionally, after storing the credentials and the unstructured data compressed package in the blockchain to which the block node belongs, the method further includes:

[0016] Determine whether the credential exists in the blockchain;

[0017] If not, return to the step of storing the credential and the unstructured data compressed package in the blockchain;

[0018] If so, proceed with the step of sending a notification message to the terminal indicating that the unstructured data compressed package has been stored.

[0019] Optionally, the method further includes:

[0020] The credential is sent to the terminal so that the terminal can download the unstructured data compressed package corresponding to the credential from the blockchain.

[0021] Optionally, a hash operation is performed on the unstructured data compressed package to obtain a hash value, including:

[0022] Perform a hash operation on the unstructured data compressed package to obtain an initial hash value;

[0023] The initial hash value is merged with the random string to obtain the intermediate string;

[0024] Perform a hash operation on the intermediate string to obtain the final hash value.

[0025] Optionally, the attribute information of the unstructured data is the named field of the unstructured data.

[0026] An apparatus for storing unstructured data, applied to a block node, comprising:

[0027] A data compression unit is used to respond to a request instruction sent by the terminal to store unstructured data, and to compress the unstructured data using the public key of the block node to obtain an unstructured data compressed package.

[0028] A hash operation unit is used to perform hash operations on the unstructured data compressed package to obtain a hash value;

[0029] The identifier generation unit is used to generate an identifier for the unstructured data based on the generation time of the unstructured data compressed package, the attribute information of the unstructured data, and the storage address of the public key, and to form a credential for the unstructured data together with the hash value.

[0030] The data storage unit is used to store the certificate and the unstructured data compressed package in the blockchain.

[0031] Optionally, the data storage unit includes:

[0032] A data storage unit is used to store the credentials and the unstructured data compressed package in the blockchain to which the block node belongs;

[0033] The notification message sending unit is used to send a notification message to the terminal indicating that the unstructured data compressed package has been successfully stored after the credential and the unstructured data compressed package have been successfully stored.

[0034] Optionally, the device may also include:

[0035] The credential determination unit is used to determine whether the credential exists in the blockchain after the data storage unit stores the credential and the unstructured data compressed package in the blockchain to which the block node belongs. If not, it returns to the processing steps of the data storage unit; if yes, it executes the processing steps of the prompt information sending unit.

[0036] Optionally, the device may also include:

[0037] A credential sending unit is used to send the credential to the terminal so that the terminal can download the unstructured data compressed package corresponding to the credential from the blockchain.

[0038] Optionally, the hash operation unit includes:

[0039] The first hash operation subunit is used to perform hash operations on the unstructured data compressed package to obtain an initial hash value;

[0040] The second hash operation subunit is used to merge the initial hash value with a random string to obtain an intermediate string;

[0041] The third hash operation subunit is used to perform a hash operation on the intermediate string to obtain the final hash value.

[0042] By employing the aforementioned technical solution, this application can construct a certificate for unstructured data using an identifier jointly determined by the time the compressed package is generated during the compression of unstructured data, the address of the public key used for encryption and compression, and the information of the unstructured data, along with a hash value obtained by hashing the unstructured data compressed package. This certificate, along with the unstructured data compressed package, is then stored on the blockchain, achieving both the storage of unstructured data and the proof of its storage. It is evident that by storing unstructured data on the blockchain, frequent interactions between blockchain service nodes, application servers, and storage servers are avoided, thus optimizing the processing efficiency of unstructured data notarization. Attached Figure Description

[0043] Various other advantages and benefits will become apparent to those skilled in the art upon reading the following detailed description of preferred embodiments. The accompanying drawings are for illustrative purposes only and are not intended to limit the scope of this application. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings:

[0044] Figure 1 A schematic diagram illustrating a process for unstructured data storage provided in an embodiment of this application;

[0045] Figure 2 A schematic diagram illustrating a verification process for unstructured data storage provided in this application embodiment;

[0046] Figure 3 A schematic diagram of an apparatus for storing unstructured data provided in an embodiment of this application;

[0047] Figure 4 This is a schematic diagram of the structure of an unstructured data storage device provided in an embodiment of this application. Detailed Implementation

[0048] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0049] The proposed solution can be implemented based on a terminal with data processing capabilities, such as a computer, server, or cloud platform.

[0050] Next, combined Figure 1 The method for storing unstructured data in this application may include the following steps:

[0051] Step S110: In response to the terminal's request instruction to store unstructured data, compress the unstructured data using the public key of the block node to obtain an unstructured data compressed package.

[0052] Specifically, unstructured data can be sent from the terminal to the block node. When the terminal has a need to store unstructured data, it can generate a request instruction to store unstructured data and send it to the block node. The request instruction to store unstructured data can include unstructured data.

[0053] Understandably, each node in a blockchain needs to ensure the security and confidentiality of data storage. Therefore, when storing unstructured data, encryption and compression methods can be used, asymmetric cryptography can be employed, and the public key of the local blockchain node can be used to encrypt and compress the unstructured data for decompression using the private key corresponding to the public key.

[0054] Step S120: Perform a hash operation on the unstructured data compressed package to obtain a hash value.

[0055] Specifically, the SHA-256 algorithm can be used for hashing. The hash value can represent the reference value of the unstructured data compressed package, but the unstructured data compressed package cannot be obtained through the hash value.

[0056] Step S130: Based on the generation time of the unstructured data compressed package, the attribute information of the unstructured data, and the storage address of the public key, generate an identifier for the unstructured data, and combine it with the hash value to form a certificate for the unstructured data.

[0057] Among them, unstructured attribute information can be named fields of unstructured data.

[0058] Specifically, partial fields of the generation time information of the unstructured data compressed package, partial fields of the naming field of the unstructured data, and partial fields of the storage address of the public key can be extracted separately, and the extracted fields can be reassembled into the identifier of the unstructured data.

[0059] The method for extracting information fields can be to extract information by using a preset first character interval distance, which can be customized. The extracted fields can be recombined by arranging each character in each of the aforementioned partial fields according to a preset second character interval distance, resulting in an identifier for the unstructured data after arranging the characters in each partial field. The preset second character interval distance can be the number of extracted information items.

[0060] Step S140: Store the certificate and the unstructured data compressed package in the blockchain.

[0061] Specifically, the process of compressing the unstructured data package and storing the certificate can be done in parallel to improve processing efficiency.

[0062] The method for storing unstructured data provided in this embodiment can form a certificate for unstructured data using an identifier jointly determined by the time the compressed package is generated during compression, the address of the public key used for encryption and compression, and the information of the unstructured data, as well as a hash value obtained by hashing the unstructured data compressed package. The certificate and the unstructured data compressed package are then stored in the blockchain, achieving both the storage of unstructured data and the proof of its storage. It is evident that by storing unstructured data in the blockchain, frequent interactions between blockchain service nodes, application servers, and storage servers are avoided, thus optimizing the processing efficiency of unstructured data storage.

[0063] In some embodiments of this application, the process of storing the certificate and the unstructured data compressed package in the blockchain as evidence in step S140 is described. This process may include:

[0064] S141. Store the credential and the unstructured data compressed package in the blockchain to which the block node belongs.

[0065] Specifically, the unstructured data compressed package can be stored in the storage data chain of the blockchain to realize the storage of unstructured data, and the certificate can be stored in the proof data chain of the blockchain to realize the storage of the referential mark of the unstructured data.

[0066] S142. After successfully storing the credential and the unstructured data compressed package, send a notification message to the terminal indicating that the unstructured data compressed package has been stored.

[0067] It is understandable that when a terminal requests the storage of unstructured data from a block node in the blockchain, and the unstructured data is successfully stored, a message indicating successful storage needs to be sent to the terminal. Therefore, a notification message indicating that the unstructured data compressed package has been stored can be sent to the terminal.

[0068] The method for storing unstructured data provided in this embodiment can store unstructured data compressed packages and corresponding credentials in parallel on two data chains of the blockchain, realizing the storage and notarization of unstructured data. After confirming successful storage of unstructured data, a successful storage prompt message is sent to the terminal, realizing feedback to the terminal that requested the storage.

[0069] Considering that during the storage of credentials, factors such as network instability may cause storage failure, and the storage of unstructured data compressed packages may also fail, based on this, in some embodiments of this application, after step S141 of the above embodiments, storing the credentials and the unstructured data compressed packages in the blockchain to which the block node belongs, the success of the credential storage can be verified, such as... Figure 2 As shown, the method for unstructured data notarization in this embodiment may include:

[0070] Step S210: In response to the terminal's request instruction to store unstructured data, compress the unstructured data using the public key of the block node to obtain an unstructured data compressed package.

[0071] Step S220: Perform a hash operation on the unstructured data compressed package to obtain a hash value.

[0072] Step S230: Based on the generation time of the unstructured data compressed package, the attribute information of the unstructured data, and the storage address of the public key, generate an identifier for the unstructured data, and combine it with the hash value to form a certificate for the unstructured data.

[0073] Step S240: Store the credential and the unstructured data compressed package in the blockchain to which the block node belongs.

[0074] The steps S210-S230 described above correspond one-to-one with steps S110-S130 in the previous embodiment, and step S240 corresponds one-to-one with step S141 in the previous embodiment. For details, please refer to the above description, which will not be repeated here.

[0075] Step S250: Determine whether a credential exists in the blockchain. If not, return to step S240; if yes, proceed to step S260.

[0076] Specifically, the hash value and identifier in the credential can be queried in the blockchain to determine if there is a matching hash value and identifier in the blockchain, in order to determine whether the unstructured data compressed package and credential have been successfully stored.

[0077] If the credential does not exist in the blockchain, it means that storing the credential and unstructured data compressed package in the blockchain has failed, and the credential and unstructured data compressed package can be stored in the blockchain again.

[0078] Understandably, after each time the credentials and unstructured data compressed package is stored on the blockchain, in order to verify whether the storage process is successful, if the storage fails, the process returns to step S240 and then checks again.

[0079] Step S260: Send a notification message to the terminal indicating that the unstructured data compressed package has been stored.

[0080] Specifically, if a certificate exists in the blockchain, it indicates that the certificate and unstructured data compressed package have been stored in the blockchain, and a prompt message indicating that the unstructured data compressed package has been stored can be sent to the terminal.

[0081] The method for storing unstructured data provided in this embodiment can verify whether the storage was successful after storing the credentials and the compressed package of unstructured data, so as to ensure that the storage of unstructured data is not affected by factors such as network instability, thus effectively improving the efficiency of storing unstructured data.

[0082] Considering that the terminal needs to download unstructured data compressed packages stored in the blockchain, it is necessary to provide the terminal with credentials to download the unstructured data. Based on this, in some embodiments of this application, credentials can be sent to the terminal so that the terminal can download the unstructured data compressed package corresponding to the credentials from the blockchain.

[0083] Specifically, the credentials can be sent to the terminal after obtaining credentials for unstructured data.

[0084] It is understandable that the premise for a terminal to download an unstructured data compressed package from the blockchain is that the blockchain contains the certificate and the unstructured data compressed package corresponding to the certificate. Therefore, after receiving a prompt message that the unstructured data compressed package has been stored, the terminal can download the unstructured data compressed package corresponding to the certificate from the blockchain based on the certificate.

[0085] In some embodiments of this application, to enhance the immutability of data stored in the blockchain, multiple hash operations can be performed on the data that the blockchain needs to store. Based on this, the process of performing a hash operation on the unstructured data compressed package to obtain a hash value in step S120 above is described. This process may include:

[0086] S1. Perform a hash operation on the unstructured data compressed package to obtain an initial hash value.

[0087] Specifically, the initial hash value can represent the result of hashing the unstructured data compressed package once. The unstructured data compressed package cannot be obtained or cracked through the initial hash value.

[0088] S2. Combine the initial hash value with the random string to obtain the intermediate string.

[0089] Understandably, by performing hash operations on unstructured data compressed packages, the initial hash value can be further refined to enhance the confidentiality and security of the stored data.

[0090] S3. Perform a hash operation on the intermediate string to obtain the final hash value.

[0091] It is understandable that after obtaining a highly confidential and secure intermediate string, a hash operation is performed on it to make the final hash value even more confidential and secure.

[0092] Specifically, the intermediate string cannot be obtained or cracked through the final hash value, and therefore the unstructured data compressed package cannot be obtained or cracked through the final hash value.

[0093] The method for storing unstructured data provided in this embodiment can perform multiple hashing processes on unstructured data compressed packages that need to be stored in the blockchain to obtain hash values. These hash values ​​have high confidentiality and high security for the unstructured data compressed packages, and can improve the immutability of data stored in the blockchain.

[0094] The apparatus for implementing unstructured data storage provided in the embodiments of this application will be described below. The apparatus for implementing unstructured data storage described below can be referred to in correspondence with the method for implementing unstructured data storage described above.

[0095] See Figure 3 , Figure 3 This is a schematic diagram of a device for storing unstructured data, as disclosed in an embodiment of this application.

[0096] like Figure 3 As shown, the device may include:

[0097] The data compression unit 11 is used to respond to the request instruction sent by the terminal to store unstructured data, and to compress the unstructured data with the public key of the block node to obtain an unstructured data compressed package.

[0098] The hash operation unit 12 is used to perform hash operations on the unstructured data compressed package to obtain a hash value;

[0099] The identifier generation unit 13 is used to generate an identifier for the unstructured data based on the generation time of the unstructured data compressed package, the attribute information of the unstructured data, and the storage address of the public key, and to form a credential for the unstructured data together with the hash value.

[0100] The data storage unit 14 is used to store the certificate and the unstructured data compressed package in the blockchain.

[0101] Optionally, the data storage unit 14 includes:

[0102] A data storage unit is used to store the credentials and the unstructured data compressed package in the blockchain to which the block node belongs;

[0103] The notification message sending unit is used to send a notification message to the terminal indicating that the unstructured data compressed package has been successfully stored after the credential and the unstructured data compressed package have been successfully stored.

[0104] Optionally, the device may also include:

[0105] The credential determination unit is used to determine whether the credential exists in the blockchain after the data storage unit stores the credential and the unstructured data compressed package in the blockchain to which the block node belongs. If not, it returns to the processing steps of the data storage unit; if yes, it executes the processing steps of the prompt information sending unit.

[0106] Optionally, the device may also include:

[0107] A credential sending unit is used to send the credential to the terminal so that the terminal can download the unstructured data compressed package corresponding to the credential from the blockchain.

[0108] Optionally, the hash operation unit 12 includes:

[0109] The first hash operation subunit is used to perform hash operations on the unstructured data compressed package to obtain an initial hash value;

[0110] The second hash operation subunit is used to merge the initial hash value with a random string to obtain an intermediate string;

[0111] The third hash operation subunit is used to perform a hash operation on the intermediate string to obtain the final hash value.

[0112] The unstructured data storage device provided in this application embodiment can be applied to unstructured data storage devices, such as terminals: mobile phones, computers, etc. Optionally, Figure 4 The hardware structure block diagram for unstructured data notarization is shown below. Figure 4 The hardware structure of an unstructured data storage device may include: at least one processor 1, at least one communication interface 2, at least one memory 3, and at least one communication bus 4.

[0113] In this embodiment of the application, the number of processor 1, communication interface 2, memory 3, and communication bus 4 is at least one, and processor 1, communication interface 2, and memory 3 communicate with each other through communication bus 4;

[0114] Processor 1 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention.

[0115] Memory 3 may include high-speed RAM, and may also include non-volatile memory, such as at least one disk storage device;

[0116] The memory stores a program, which the processor can call. The program is used for:

[0117] In response to a request from a terminal to store unstructured data, the unstructured data is compressed using the public key of the block node to obtain a compressed unstructured data package.

[0118] Perform a hash operation on the unstructured data compressed package to obtain a hash value;

[0119] Based on the generation time of the unstructured data compressed package, the attribute information of the unstructured data, and the storage address of the public key, an identifier for the unstructured data is generated, and together with the hash value, a credential for the unstructured data is formed.

[0120] The credentials and the unstructured data compressed package are stored in the blockchain for evidence preservation.

[0121] Optionally, the refined and extended functions of the program can be found in the description above.

[0122] This application embodiment also provides a storage medium that can store a program suitable for execution by a processor, the program being used for:

[0123] In response to a request from a terminal to store unstructured data, the unstructured data is compressed using the public key of the block node to obtain a compressed unstructured data package.

[0124] Perform a hash operation on the unstructured data compressed package to obtain a hash value;

[0125] Based on the generation time of the unstructured data compressed package, the attribute information of the unstructured data, and the storage address of the public key, an identifier for the unstructured data is generated, and together with the hash value, a credential for the unstructured data is formed.

[0126] The credentials and the unstructured data compressed package are stored in the blockchain for evidence preservation.

[0127] Optionally, the refined and extended functions of the program can be found in the description above.

[0128] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0129] The various embodiments in this specification are described in a progressive manner. Each embodiment focuses on the differences from other embodiments. The various embodiments can be combined as needed, and the same or similar parts can be referred to each other.

[0130] The above description of the disclosed embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for non-structured data evidence storage, characterized in that, Applied to a block node, comprising: In response to a request instruction for storing unstructured data sent by a terminal, compressing the unstructured data with a public key of the block node to obtain an unstructured data compression package; Performing a hash operation on the unstructured data compression package to obtain a hash value; Based on the generation time of the unstructured data compression package, the attribute information of the unstructured data, and the storage address of the public key, generating an identifier of the unstructured data, and composing a credential of the unstructured data with the hash value; Storing the credential and the unstructured data compression package in a block chain.

2. The method of claim 1, wherein, Storing the credential and the unstructured data compression package in the block chain to which the block node belongs, comprising: Storing the credential and the unstructured data compression package in the block chain to which the block node belongs; After successfully storing the credential and the unstructured data compression package, sending a prompt information to the terminal that the unstructured data compression package has been stored.

3. The method of claim 2, wherein, After storing the credential and the unstructured data compression package in the block chain to which the block node belongs, further comprising: Determine whether the credential exists in the block chain; If not, return to the step of storing the credential and the unstructured data compression package in the block chain; If yes, execute the step of sending a prompt information to the terminal that the unstructured data compression package has been stored.

4. The method of claim 1, wherein, Further comprising: Sending the credential to the terminal, so that the terminal downloads the unstructured data compression package corresponding to the credential from the block chain.

5. The method of claim 1, wherein, Performing a hash operation on the unstructured data compression package to obtain a hash value, comprising: Performing a hash operation on the unstructured data compression package to obtain an initial hash value; Merging the initial hash value with a random string to obtain an intermediate string; Performing a hash operation on the intermediate string to obtain a final hash value.

6. The method of claim 1, wherein, The attribute information of the unstructured data is the naming field of the unstructured data.

7. An apparatus for storing unstructured data, characterized in that, Applied to a block node, comprising: A data compression unit for responding to a request instruction for storing unstructured data sent by a terminal, compressing the unstructured data with a public key of the block node to obtain an unstructured data compression package; A hash operation unit for performing a hash operation on the unstructured data compression package to obtain a hash value; An identifier generation unit for generating an identifier of the unstructured data based on the generation time of the unstructured data compression package, the attribute information of the unstructured data, and the storage address of the public key, and composing a credential of the unstructured data with the hash value; A data storage unit for storing the credential and the unstructured data compression package in a block chain.

8. The apparatus of claim 7, wherein, The data storage unit, comprising: A data storage unit for storing the credential and the unstructured data compression package in the block chain to which the block node belongs; A prompt information sending unit for sending a prompt information to the terminal that the unstructured data compression package has been successfully stored after successfully storing the credential and the unstructured data compression package.

9. The apparatus of claim 8, wherein, Further comprising: The credential judging unit is configured to, after the data storing unit stores the credential and the unstructured data compression package in the blockchain to which the block node belongs, judge whether the credential exists in the blockchain, and if not, return to execute the processing step of the data storing unit, and if yes, execute the processing step of the prompt information sending unit.

10. The apparatus of claim 7, wherein, Further comprising: The credential sending unit is configured to send the credential to the terminal, so that the terminal downloads the unstructured data compression package corresponding to the credential from the blockchain.

Images