Efficient Threshold Storage of Data Objects

By dividing data objects into slices and distributing them across blockchain peers using an Efficient Threshold Scheme, the challenges of centralized databases and traditional blockchain storage are addressed, achieving secure, efficient, and cost-effective decentralized storage.

JP7592089B2Active Publication Date: 2024-11-29INTERNATIONAL BUSINESS MACHINE CORPORATION
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2022532698
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-12-05
Filing Date
2020-11-16
Publication Date
2024-11-29
Estimated Expiration
2040-11-16

AI Technical Summary

Technical Problem

Centralized databases face issues with single points of failure, network dependency, and limited access, while traditional blockchain storage of large data objects relies on off-chain storage, compromising security and efficiency.

Method used

Divide data objects into slices, hash them, and distribute these slices across multiple blockchain peers, ensuring each peer stores only a portion, with a configurable number of slices required to reconstruct the object, using an Efficient Threshold Scheme (ETS) for secure and decentralized storage.

Benefits of technology

Enables secure, efficient, and cost-effective storage of large data objects on a blockchain without requiring each peer to store the entire object, reducing network bandwidth and storage costs, while maintaining privacy and access control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007592089000001
    Figure 0007592089000001
  • Figure 0007592089000002
    Figure 0007592089000002
  • Figure 0007592089000003
    Figure 0007592089000003
Patent Text Reader

Abstract

Exemplary operations may include one or more of: dividing the data object into a plurality of portions; hashing the data object to generate a hashed data object and hashing the plurality of portions to generate a plurality of hashed portions; generating a plurality of slices, each slice including the hashed data object and a different hashed portion; and distributing the plurality of slices across a plurality of blockchain peers, respectively.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] This application relates generally to storing data on a blockchain, and more particularly to dividing large data objects into slices and distributing the slices across multiple blockchain peers. [Background technology]

[0002] A centralized database maintains data in one location, stored in a single database (e.g., a database server). This location is often a central computer, e.g., a desktop central processing unit (CPU), a server CPU, or a mainframe computer. Information stored in a centralized database is usually accessible from several different locations. Several users or client workstations can work simultaneously using the centralized database, e.g., based on a client / server configuration. Because of the single location, a centralized database is easier to manage, maintain, and control, especially for security purposes. Within a centralized database, data redundancy is minimized, since the single storage location of all data also means that a particular set of data only contains one primary record.

[0003] However, centralized databases have significant drawbacks. For example, if fault tolerance is not considered, a centralized database has a single point of failure. Thus, in the event of a hardware failure (e.g., failure of hardware, firmware, or software, or a combination thereof), all data in the database is lost and all users' work is interrupted. In addition, centralized databases are highly dependent on network connectivity. As a result, slower connections increase the time required for each database access. Another drawback is the creation of a bottleneck in the event of high traffic to the centralized database due to its single location. Furthermore, centralized databases provide limited access to data, since only one copy of the data is maintained by the database.

[0004] In recent years, organizations have turned to blockchain as a means to securely store data that can be accessed from multiple locations without being restricted by a central entity. In a blockchain network, peers are responsible for collectively managing and storing data on the blockchain. In traditional blockchains, each peer stores a copy of the data object, thereby achieving redundancy without the need for a central storage device. For larger data files, peers can store a hash of the data object on the blockchain while storing the actual data object in off-chain storage. However, this storage process breaks the security of the blockchain by relying on an external entity (off-chain storage) to store the data. Therefore, a solution is needed that overcomes these drawbacks and limitations. Summary of the Invention

[0005] One example embodiment provides a system including a processor configured to perform one or more of: dividing a data object into a plurality of portions; hashing the data object to generate a hashed data object and hashing the plurality of portions to generate a plurality of hashed portions; and generating a plurality of slices, each slice including the hashed data object and a different respective hashed portion; and a network interface configured to distribute the plurality of slices across a plurality of blockchain peers, respectively.

[0006] Another example embodiment provides a method that includes one or more of: dividing a data object into a plurality of portions; hashing the data object to generate a hashed data object and hashing the plurality of portions to generate a plurality of hashed portions; generating a plurality of slices, each slice including the hashed data object and a different respective hashed portion; and distributing the plurality of slices across a plurality of blockchain peers, respectively.

[0007] A further example embodiment provides a non-transitory computer readable medium including instructions that, when read by a processor, cause the processor to perform one or more of: splitting a data object into a plurality of portions; hashing the data object to generate a hashed data object and hashing the plurality of portions to generate a plurality of hashed portions; generating a plurality of slices, each slice including the hashed data object and a different respective hashed portion; and distributing the plurality of slices across a plurality of blockchain peers, respectively. [Brief description of the drawings]

[0008] [Figure 1]FIG. 1 illustrates a blockchain network for storing data objects in slices according to an example embodiment. [Figure 2A] FIG. 1 illustrates a blockchain architecture configuration according to an example embodiment. [Figure 2B] FIG. 1 illustrates a blockchain transaction flow according to an example embodiment. [Figure 3A] FIG. 1 illustrates a permissioned blockchain network according to an example embodiment. [Figure 3B] FIG. 1 illustrates another permissioned blockchain network, according to an example embodiment. [Figure 3C] FIG. 1 illustrates a permissionless blockchain network according to an example embodiment. [Figure 4A] FIG. 1 illustrates a process for converting a data object into slices according to an example embodiment. [Figure 4B] FIG. 1 illustrates a process for reconstructing a data object from slices and validating the data object according to an example embodiment. [Diagram 5] FIG. 1 illustrates a method for storing slices of a data object on a blockchain according to an example embodiment. [Figure 6A] FIG. 1 illustrates an example system configured to perform one or more operations described herein, in accordance with an example embodiment. [Figure 6B] FIG. 1 illustrates another exemplary system configured to perform one or more operations described herein, in accordance with example embodiments. [Figure 6C] FIG. 1 illustrates yet another exemplary system configured to utilize smart contracts in accordance with an example embodiment. [Figure 6D] FIG. 1 illustrates yet another exemplary system configured to utilize blockchain, according to an example embodiment. [Figure 7A]FIG. 1 illustrates the process of a new block being added to a distributed ledger according to an example embodiment. [Figure 7B] 11A-11C are diagrams illustrating the data contents of a new data block according to an example embodiment. [Figure 7C] FIG. 1 illustrates a block chain for digital content, according to an example embodiment. [Figure 7D] FIG. 2 illustrates a block diagram that may represent the structure of a block in a blockchain, according to an example embodiment. [Figure 8A] FIG. 1 illustrates an exemplary blockchain for storing machine learning (artificial intelligence) data, according to an example embodiment. [Figure 8B] FIG. 1 illustrates an exemplary quantum secure blockchain, according to an example embodiment. [Figure 9] FIG. 1 illustrates an exemplary system that supports one or more of the example embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] It will be readily understood that the components herein, as generally described and illustrated in the Figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of at least one embodiment of a method, apparatus, non-transitory computer-readable medium, and system, as depicted in the accompanying Figures, is not intended to limit the scope of the present application as claimed, but is merely representative of selected embodiments.

[0010] Features, structures, or characteristics described throughout this specification may be combined or eliminated in any suitable manner in one or more embodiments. For example, the use of the phrase "example embodiment," "some embodiments," or other similar language throughout this specification refers to the fact that certain features, structures, or characteristics described in connection with an embodiment may be included in at least one embodiment. Thus, the appearances of the phrase "example embodiment," "some embodiments," "other embodiments," or other similar language throughout this specification do not necessarily all refer to the same group of embodiments, and the described features, structures, or characteristics may be combined or eliminated in any suitable manner in one or more embodiments. Additionally, in each figure, any connection between elements may permit one-way or two-way communication, or both, even if the connection shown is a one-way or two-way arrow. Also, any devices shown in the figures may be different devices. For example, where a mobile device is shown transmitting information, a wired device may also be used to transmit the information.

[0011] In addition, although the term "message" may be used in describing the embodiments, the application may apply to many types of networks and data. Further, although particular types of connections, messages, and signaling may be shown in the example embodiments, the application is not limited to the particular types of connections, messages, and signaling.

[0012] Example embodiments provide methods, systems, components, non-transitory computer-readable media, devices, and / or networks for dividing large data objects into slices and storing the slices across a group of blockchain peers in a blockchain network.

[0013] In one embodiment, the present application utilizes a distributed database (such as a blockchain), which is a distributed storage system that includes multiple nodes that communicate with each other. A distributed database includes an append-only immutable data structure, similar to a distributed ledger, in which records can be maintained among mutually untrusted parties. The untrusted parties are referred to herein as peers or peer nodes. Each peer maintains a copy of the database record, and no single peer can modify the database record without reaching a consensus among the distributed peers. For example, peers may run a consensus protocol to verify the validity of blockchain stored transactions, group those stored transactions into blocks, and build a hash chain on the blocks. This process forms a ledger by ordering the stored transactions, as necessary, for consistency. In various embodiments, permissioned or permissionless blockchains or both may be used. Public or permissionless blockchains allow anyone to participate without specific identification. Public blockchains include native cryptocurrencies and can use consensus based on various protocols, such as Proof of Work (PoW). Permissioned blockchain databases, on the other hand, provide secure interactions within a group of entities that share a common goal but do not fully trust each other, such as businesses exchanging funds, goods, or information.

[0014] The present application may utilize a blockchain that operates on arbitrary programmable logic, called a "smart contract" or "chaincode," that is tailored to the distributed storage method. In some cases, there may be a specialized chaincode for managing functions and parameters, called a system chaincode. Applications may further utilize smart contracts, which are trusted distributed applications that leverage the tamper-proof properties of the blockchain database and the underlying agreement between nodes, called a signature or signature policy. Blockchain transactions associated with this application may be "signed" before being committed to the blockchain, while transactions that are not signed are ignored. The signature policy allows the chaincode to specify the signers of the transaction in the form of a set of peer nodes required for signing. When a client sends a transaction to a peer specified in the signature policy, a transaction is executed to verify the validity of the transaction. After validation, the transaction moves to an ordering phase, where a consensus protocol is used to generate an ordered sequence of signed transactions grouped into blocks.

[0015] The present application may utilize nodes, which are the communicating entities of a blockchain system. A "node" may perform a logical function in the sense that multiple nodes of different types may run on the same physical server. Nodes are grouped in trusted domains and associated with logical entities that control them in various ways. Nodes may include various types, such as client or submit client nodes, which submit transaction calls to signers (e.g., peers) and broadcast transaction proposals to an ordering service (e.g., ordering node). Another type of node is a peer node, which can receive client submitted transactions, commit transactions, and maintain the ledger state and copy of blockchain transactions. Peers may also have the role of signers, but this is not a requirement. An ordering service node or ordering node is a node that performs communication services for all nodes and enforces delivery guarantees, such as broadcasting to each of the peer nodes in the system when committing transactions and when modifying the blockchain world state (another name for the initial blockchain transaction, which usually contains control and configuration information).

[0016] The application may utilize a ledger, which is an ordered, tamper-proof record of all state transitions of a blockchain. State transitions may result from chaincode invocations (i.e., transactions) submitted by participating parties (e.g., client nodes, ordering nodes, signer nodes, peer nodes, etc.). Each participating party (e.g., peer node) may maintain a copy of the ledger. A transaction may result in a set of key-value pairs of assets being committed to the ledger as one or more operands (e.g., create, update, delete, etc.). The ledger includes a blockchain (also called a chain) that is used to store immutable, ordered records in blocks. The ledger also includes a state database that maintains the current state of the blockchain.

[0017] The application may utilize a chain, which is a transaction log structured as hash-linked blocks, where each block contains a sequence of N transactions, where N is greater than or equal to 1. The block header contains a hash of the block's transactions, and a hash of the previous block's header. In this way, all transactions in the ledger may be ordered and cryptographically linked together. Thus, the ledger data cannot be tampered with without breaking the hash links. The hash of the most recently added block of the blockchain represents all transactions on the chain that occurred before it, allowing all peer nodes to be assured that they are in a consistent and trustworthy state. The chain may be stored in the file systems of the peer nodes (i.e., locally, attached storage, cloud, etc.), which efficiently supports the append-only nature of blockchain workloads.

[0018] The current state of the immutable ledger represents the latest values ​​of all keys contained in the chain's transaction log. The current state is sometimes called the world state, as it represents the most recent key values ​​known to the channel. Chaincode invocations execute transactions against data in the current state of the ledger. To make those chaincode interactions efficient, the most recent key values ​​may be stored in a state database. The state database may simply be an indexed view into the chain's transaction log, and therefore may be regenerated from the chain at any time. The state database may be automatically restored (and generated, if necessary) at peer node startup and before any transactions are received.

[0019] Entries in a blockchain ledger (e.g., a permissioned blockchain) are highly available and resilient to denial-of-service attacks as long as a quorum of members is not compromised. This achieves security without relying on any centralized source of information for the information stored on the chain. However, ledgers are limited in the amount of data they can store, since performance is related to the size of the chain. In addition, because the ledger is fully replicated, the total cost of storage is based on the number of network members replicating the ledger times the total amount of data in all entries. In addition, the total network bandwidth required to add an entry is a function of the amount of data sent to each member. Therefore, it is impractical to store large objects, such as high-resolution medical images, videos, audio, or detailed technical designs, in blockchain entries.

[0020] Furthermore, ledger entries are publicly available to anyone with access to any of the blockchain peers (members). Thus, if a blockchain peer is compromised, the contents of all ledger entries are visible to an attacker. It is possible to store encrypted information in the ledger, but this adds key management complexity. A centralized key management solution is simple, but results in a single point of control and attack. The alternative, using secret sharing, is secure against single point attacks and removes the centralized source of information, but causes the added complexity of an external solution for key management.

[0021] To date, most systems attempting to address the problem of storing large objects on the blockchain rely on external storage or off-chain associated databases. For example, Hyperledger Fabric includes an associated database that provides more storage for large objects. Some of the drawbacks of this option include the total storage requirement, which is proportional to the sum of the sizes of all off-chain objects multiplied by the number of members in the network. There is also a total network bandwidth cost that is a function of the size of the off-chain objects multiplied by the number of members. In addition to the cost of storage, there is also an additional need for each member to provide and manage off-chain storage. Furthermore, this option offers no control over a member's ability to see the contents of off-chain objects, since all information is visible to all network members, just like information on the ledger.

[0022] Embodiment examples overcome the drawbacks of these conventional systems by enabling large storage objects to be stored on the blockchain without each peer needing to store the entire copy of the large data object. Instead, the data object is split into slices, and these slices are distributed across all peers and stored in each peer's blockchain ledger. For example, the data object may be split into N slices, and any k of the N slices can be used to reconstruct the data object (where k < N). In this example, each peer within the group may store different slices of the data object in the ledger. By doing so, off-chain storage is not required, thus eliminating the need to manage off-chain storage. Furthermore, since a subset of peers (e.g., k out of N peers) must provide slices before the data object can be recovered, access rights to large data objects can be managed / regulated. Thus, even if an attacker obtains access rights to the ledger through a blockchain peer member, the attacker cannot view / recover the data object. Instead, for the attacker to be able to access the data object, the attacker must obtain access rights to the ledgers of k blockchain peer members.

[0023] In addition, since each peer stores only each slice of the data object, the complete data object is not exposed to the blockchain peers (member organizations), thus providing the ability to protect the data object from visibility even among the participants of the blockchain itself. For any entity (member or non-member) to obtain access rights to the entire data object, the entity must receive a constant number of slices. Furthermore, such access rights are traced through the blockchain, ensuring confidentiality and privacy.

[0024] Example embodiments integrate an Efficient Threshold Scheme (ETS) for storing large objects in a blockchain with the guarantees of the blockchain, providing the benefits of ETS for storage management. For example, ETS may include an algorithm that encodes an input (data object) in a configurable number of “N” parts or pieces (referred to herein as slices), where a configurable number of at least “k” unique slices are required to determine the input, (k<=N). The total size of the K slices is approximately equal to the size of the input. If one possesses fewer than K slices, it is difficult (e.g., computationally expensive or infeasible) to determine anything about the contents of the input. Examples of ETS include, but are not limited to, All or Nothing Transform-Reed Solomon (AONT-RS). Another example is Secret Sharing Made Short (SSMS), a computationally secure secret sharing scheme.

[0025] In the examples herein, a client / peer may use the ETS algorithm to generate N slices from a data object in such a way that the data object can later be reconstructed from the K slices. The client may distribute the N slices among different nodes in the network, with each node receiving a different slice. The main object in the blockchain may contain a hash of the object and a hash of all the slices. To retrieve the object, a peer or client needs to receive slices from any of the K nodes in the network. The signature policy also depends on the K peers. Example embodiments provide a unique storage process to keep large objects on the same node-chain as the blockchain without requiring each node to store a copy of the entire object. The system uses storage efficiently without duplicating large objects while also providing control over where slices are stored and which peers retrieved what data. The advantage of this system is that the total network bandwidth is independent of the number of network members, since each member stores each slice instead of storing the entire data object (over the network) in off-chain storage.

[0026] It would be impossible to implement this solution in a traditional database. To implement the solution herein, at least k members of the network need to participate and provide k different storage locations, which is not possible in a traditional database (which includes one centralized storage location). The example embodiment solves the problem of how to securely and cost-effectively store large data objects in a distributed manner in a blockchain. Furthermore, instead of storing the entire object on each node, different slices are stored on each node.

[0027] Some of the advantages of the solution provided herein include allowing large objects to be stored in a permissioned blockchain without requiring the use of a shared (off-chain) data store or cryptographic keys, while still preserving the privacy properties of the blockchain. Storing slices instead of entire data objects allows for more efficient storage and bandwidth usage. Furthermore, large objects can be managed across different organizations, to the same requirements as other blockchain objects. Full access is provided to all authorized peers, with limited bandwidth and storage usage. However, each peer cannot see the object; instead, peers must cooperate to reconstruct the data object. This prevents an attacker from gaining access to an object through a single peer.

[0028] FIG. 1 illustrates a blockchain network 100 for storing a data object 10 in slices 10a-10f according to an example embodiment. Referring to FIG. 1, a client 110 uploads the data object 10 to the blockchain network 100, which includes multiple blockchain peers 121-126. In this example, the client 110 divides the data object 10 into multiple portions. The number of portions created may be based on the number of blockchain peers in the blockchain network 100. Specifically, there are six blockchain peers (N=6). Thus, the client 110 may divide the data object 10 into six corresponding portions. Further, the client 110 may generate six corresponding slices 10a-10f that include the six corresponding portions of the data object 10. Furthermore, the slices 10a-10f may include a hash of the data object 10 as well as a hash of each slice. The slices 10a-10f may be distributed to the blockchain peers 121-126.

[0029] If a peer fails, reboots, reconnects, etc., a slice can be recreated if there are at least k active peers that contain the slice. If a peer reboots or reconnects after a loss of communication with the network, it processes the missing blocks and detects if any slices from the data object are missing. If slices are missing, the peer can request the slices from the client 110. As another example, a peer, client 110, or another entity can retrieve enough slices (e.g., k slices) from other peers using a newly defined slice retrieval application programming interface (API). The records can then be reconstructed and the missing slices can be regenerated and provided to the rebooted / reconnected peer.

[0030] Additionally, example embodiments modify the manner in which the storage object 10 is signed by the blockchain network 100. In a traditional permissioned blockchain, a subset of peers is selected (e.g., by a client) to first sign the transaction before it is sent to an ordering node to be committed to the blockchain. In this process, each of the signing nodes validates the entire transaction. In contrast, in example embodiments, each blockchain peer may sign each slice rather than the entire stored transaction. In FIG. 1, for example, each of the blockchain peers 121-126 may sign each slice 10a-10f as it receives each slice. Here, the blockchain peers 121-126 may store the slices 10a-10f while also running a simulation of each slice for signing purposes. The results may be returned to the client 110. If the client receives successful signatures from at least k of the N blockchain peers 121-126, the data object 10 is successfully signed. Further, the client may package these signatures, along with the hash value of the data object and the hash of the slice, into a proposal and send the storage proposal to the ordering node, which can verify the package and then provide the storage proposal to the blockchain peers 121-126 for storage in the blockchain.

[0031] As a result, the signing process can be combined with the storing process or can be split into slices similarly to the storing process. Thus, even if one or more peers are unable to sign a slice (e.g., abnormal, disconnected, etc.), the data object can still be successfully signed as long as k peers can sign each slice.

[0032] FIG. 2A illustrates a blockchain architecture configuration 200 according to an example embodiment. With reference to FIG. 2A, the blockchain architecture 200 may include certain blockchain elements (e.g., a group of blockchain nodes 202). The blockchain nodes 202 may include one or more nodes 204-210 (four of these nodes are shown merely by way of example). These nodes participate in a number of activities, such as adding and validating blockchain transactions (agreements). One or more of the blockchain nodes 204-210 may sign transactions based on a signature policy and provide an ordering service for all blockchain nodes in the architecture 200. A blockchain node may initiate a blockchain authentication and attempt to write to the blockchain's immutable ledger stored in the blockchain layer 216, and a copy of this write may also be stored in the underlying physical infrastructure 214. A blockchain configuration may include one or more applications 224 linked to application programming interfaces (APIs) 222 to access and execute stored program / application code 220 (e.g., chaincode, smart contracts, etc.), which can be created according to customized configurations required by participants, maintain their own state, control their own assets, and receive external information. A blockchain configuration can be installed on all blockchain nodes 204-210 by deploying it as a transaction and adding it to the distributed ledger.

[0033] The blockchain base or platform 212 may include various layers of blockchain data, services (e.g., cryptographic trust services, virtual execution environments, etc.), and an underlying physical computer infrastructure that may be used to receive and store new transactions and provide access to auditors seeking access to data entries. The blockchain layer 216 may expose interfaces that provide access to the virtual execution environments necessary to process and enlist program code into the physical infrastructure 214. The cryptographic trust services 218 may be used to verify transactions, such as asset exchange transactions, and keep information private.

[0034] The blockchain architecture of FIG. 2A may process and execute program / application code 220 through one or more interfaces and services exposed by the blockchain platform 212. The code 220 may control assets of the blockchain. For example, the code 220 may store and transfer data and may be executed by the nodes 204-210 in the form of associated chaincode including smart contracts and conditions or other code elements subject to execution. As a non-limiting example, smart contracts may be created to perform reminders, updates, or changes, other notifications subject to updates, or combinations thereof. The smart contracts themselves may be used to identify authorization and access requirements and rules associated with use of the ledger. For example, read data 226 may be processed by one or more processing entities (e.g., virtual machines) included in the blockchain layer 216 to generate processing results that are written to the blockchain, including write data 228. The physical infrastructure 214 may be utilized to retrieve any of the data or information described herein.

[0035] Using high-level application and programming languages, smart contracts may be created and then written into blocks in the blockchain. Smart contracts may include executable code that is registered, stored, and / or replicated in the blockchain (e.g., a distributed network of blockchain peers). A transaction is the execution of smart contract code that may be executed in response to a condition associated with the smart contract being satisfied. Execution of a smart contract may trigger trusted changes to the state of the digital blockchain ledger. Changes to the blockchain ledger caused by the execution of a smart contract may be automatically replicated across the distributed network of blockchain peers via one or more consensus protocols.

[0036] A smart contract may write data to the blockchain in the form of key-value pairs. Additionally, smart contract code can read values ​​stored in the blockchain and use them in the operation of the application. Smart contract code can write the output of various logical operations to the blockchain. This code may be used to create temporary data structures in a virtual machine or other computing platform. Data written to the blockchain may become public and / or be kept private and encrypted. The temporary data used / generated by the smart contract is kept in memory by the provided execution environment and deleted after the data required for the blockchain has been identified.

[0037] The chaincode may include a code interpretation of the smart contract along with additional functionality. As described herein, the chaincode may be program code deployed on a computing network and executed together and validated by chain validators during a consensus process. The chaincode receives the hash and retrieves the hash from the blockchain associated with the data template created by use of the previously stored feature extractor. If the hash of the hash identifier and the hash created from the stored identifier template data match, the chaincode sends the authorization key to the requested service. The chaincode may write data associated with the cryptographic details to the blockchain.

[0038] FIG. 2B illustrates an example of a blockchain transaction flow 250 between nodes of a blockchain, according to an example embodiment. With reference to FIG. 2B, this transaction flow may include a transaction proposal 291 including a slice of a data object sent by a client node 260 to signing peer nodes 281-283. According to various embodiments, each of the different slices may be stored by only one of each signing peer node 281-283. The signing peer nodes 281-283 may execute / simulate each slice and verify against the hash of the slice as well as verify the client's signature. The output may include the results of the chaincode, a set of versions of the keys / values ​​that were read into the chaincode (the read set), and a set of keys / values ​​that were written into the chaincode (the write set). Each of the signing peer nodes 281-283 may send a proposal response 292 back to the client 260 along with a signature if approved. Here, the proposal response 292 may only be for each slice sent to its respective signing peer node, rather than the entire data object. The client 260 assembles the signatures of at least k slices (N>k), the hash of the data object, and the hashes of the slices into a transaction payload 293 and broadcasts it to the ordering service node 284. The ordering service node 284 then distributes the ordered transaction as a block on the channel to all peers 281-283. Before committing it to the blockchain, each peer 281-283 may verify the validity of the transaction. For example, a peer may check the signature policy to ensure that the correct allocation of the specified peer has signed the result and authenticated the signature on the transaction payload 293.

[0039] Referring again to FIG. 2B, at 290, the client node 260 slices the data object and at 291 sends a request including the different slices to the signer peer nodes 281-283. The client 260 may include an application utilizing a supported software development kit (SDK), which utilizes available APIs to generate a transaction proposal. Additionally, the client 260 may include software for slicing the data object into multiple N slices, where any k of the N slices are required to reconstruct the data object. The proposal is a request to invoke a chaincode function so that data can be read from and / or written to the ledger (i.e., writing new key-value pairs for assets). The SDK may act as a shim to package the transaction proposal into a suitably designed format (e.g., protocol buffers via remote procedure call (RPC)), receive the client's cryptographic credentials, and generate a unique signature for the transaction proposal.

[0040] In response, at 292, the signing peer nodes 281-283 may verify that (a) the transaction proposal is properly formed, (b) the transaction has not already been submitted in the past (replay attack protection), (c) the signature is valid, and (d) the submitter (in the example, client 260) has been given the proper authority to perform the proposed operation on that channel. Additionally, at 292, the signing peer nodes 281-283 may store each slice in the blockchain ledger and, if successfully verified, return a signature response for each slice. Here, an identification of the successful verification and storage of the slice, along with the signature of the signing peer nodes 281-283, is returned as a proposal response 292 to the SDK of the client 260, which parses the payload for use by the application. This process may be repeated by at least k signing peer nodes such that sufficient signing peer nodes reach agreement on the different slices of the data object.

[0041] In response, the client 260 application checks / verifies the signing peer's signature and compares the proposal response to determine if the proposal response is the same. If the chaincode simply queried the ledger, the application checks the query response and typically does not submit the transaction to the ordering node service 284. If the client application is attempting to submit a transaction to the ordering node service 284 to update the ledger, the application determines if the specified signature policy has been satisfied (i.e., whether at least the required k nodes have signed the slice) prior to submission. The architecture ensures that even if the application chooses not to check the response or otherwise forwards an unsigned transaction, the signature policy is still enforced by the peer and maintained in the commit validation phase.

[0042] After successful validation, in step 293, the client 260 assembles the signatures (e.g., at least k distinct slices) into a transaction and broadcasts the transaction proposal and transaction response in a transaction message to the ordering node 284. The transaction may include a proof that the slices were verified, stored with the signatures of the signing peers and the channel ID. The transaction proposal may include a hash of the data object and a hash of the slices. The ordering node 284 does not need to inspect the entire contents of the transaction to perform its operation; instead, the ordering node 284 may simply receive transactions from all channels in the network, order them chronologically by channel, and create a block of transactions for each channel.

[0043] The block of transactions is distributed from the ordering node 284 to all peer nodes 281-283 on the channel. The transactions 294 in the block are validated to ensure that any signature policies are satisfied and to ensure that there have been no changes to the ledger state with respect to the variables in the read set since the read set was generated by the execution of the transaction. The transactions in the block are tagged as being valid or invalid. Further, in step 295, each peer node 281-283 adds the block to the channel's chain and, for each valid transaction, the write set is committed to the current state database. Events are published to inform the client application that the transaction (invocation) has been immutably added to the chain and to inform whether the transaction has been validated or invalidated.

[0044] FIG. 3A illustrates an example of a permissioned blockchain network 300, which features a distributed, decentralized, peer-to-peer architecture. In this example, a blockchain user 302 may initiate a transaction to a permissioned blockchain 304. In this example, the transaction may be a deploy, invoke, or query, and may be issued via a client-side application utilizing an SDK, directly via an API, etc. The network may provide access to regulators 306, such as auditors. A blockchain network operator 308 manages member permissions, such as registering regulators 306 as “auditors” and blockchain users 302 as “clients.” Auditors may be limited to only querying the ledger, while clients may be given permission to deploy, invoke, and query certain types of chaincode.

[0045] A blockchain developer 310 can write chaincode and client-side applications. Through an interface, the blockchain developer 310 can directly deploy the chaincode to the network. To include authentication information from traditional data sources 312 in the chaincode, the developer 310 can use an out-of-band connection to access the data. In this example, a blockchain user 302 connects to the permissioned blockchain 304 through a peer node 314. Before initiating any transactions, the peer node 314 obtains a certificate of the user's registration and transaction from a certificate authority 316 that manages the user's roles and permissions. In some cases, blockchain users must possess their digital certificates to execute transactions on the permissioned blockchain 304. On the other hand, users seeking to utilize chaincode may need to verify their user's authentication information on traditional data sources 312. To verify the user's authorization, the chaincode can use an out-of-band connection to this data through a traditional processing platform 318.

[0046] FIG. 3B illustrates another example of a permissioned blockchain network 320, which features a distributed, decentralized, peer-to-peer architecture. In this example, a blockchain user 322 may submit a transaction to the permissioned blockchain 324. In this example, the transaction may be a deploy, invoke, or query, and may be issued via a client-side application utilizing an SDK, directly via an API, etc. The network may provide access to regulators 326, such as auditors. A blockchain network operator 328 manages member permissions, such as registering regulators 326 as “auditors” and blockchain users 322 as “clients.” Auditors may be limited to only querying the ledger, while clients may be given permission to deploy, invoke, and query certain types of chaincode.

[0047] A blockchain developer 330 writes the chaincode and client-side applications. Through an interface, the blockchain developer 330 can deploy the chaincode directly to the network. To include authentication information from traditional data sources 332 in the chaincode, the developer 330 can use an out-of-band connection to access the data. In this example, a blockchain user 322 connects to the network through a peer node 334. The peer node 334 obtains a certificate of the user's registration and transaction from a certificate authority 336 before initiating any transactions. In some cases, blockchain users must possess their digital certificates to execute transactions on the permissioned blockchain 324. On the other hand, users seeking to utilize the chaincode may need to verify their user's authentication information on traditional data sources 332. To verify the user's authorization, the chaincode can use an out-of-band connection to this data through a traditional processing platform 338.

[0048] In some embodiments, the blockchain herein may be a permissionless blockchain. In contrast to a permissioned blockchain, which requires permission to participate, anyone can participate in a permissionless blockchain. For example, to participate in a permissionless blockchain, a user may create a personal address and begin interacting with the network by submitting transactions, thus adding entries to the ledger. Additionally, any participant may choose to run a node on the system and adopt a mining protocol to help validate transactions.

[0049] FIG. 3C illustrates a process 350 of a transaction being processed by a permissionless blockchain 352 that includes multiple nodes 354. A sender 356 wishes to transmit a payment or other form of value (e.g., a deed, medical record, contract, goods, services, or any other asset that can be encapsulated in a digital record) to a receiver 358 via the permissionless blockchain 352. In one embodiment, the sender device 356 and the receiver device 358 may each have a digital wallet (associated with the blockchain 352) that provides user interface controls and display of transaction parameters. In response, the transaction is broadcast to the nodes 354 throughout the blockchain 352. Depending on the network parameters of the blockchain 352, the nodes validate (360) the transaction based on rules (which may be predefined or dynamically assigned) established by the creator of the permissionless blockchain 352. For example, this validation may include verifying the identities of the parties involved, etc. The transaction may be validated immediately, or the transaction may be placed in a queue with other transactions and node 354 determines whether the transaction is valid based on a set of network rules.

[0050] Within the structure 362, valid transactions are formed into blocks and sealed using a lock (hash). This process may be performed between nodes 354 by mining nodes. Mining nodes may utilize additional software to, among other things, mine and create blocks of the permissionless blockchain 352. Each block may be identified by a hash (e.g., a 256-bit number) created using an algorithm agreed upon by the network. Each block may contain a header, a pointer or reference to the hash of the header of the previous block in the chain, and a group of valid transactions. The reference to the hash of the previous block is associated with the creation of a secure, independent chain of blocks.

[0051] Before a block can be added to the blockchain, it must be validated. Validation of a permissionless blockchain 352 may involve Proof of Work (PoW), which is the solution to a puzzle derived from the block's header. Another process for validating a block, not shown in the example of FIG. 3C, is Proof of Stake. Unlike Proof of Work, where an algorithm rewards miners for solving a mathematical problem, in Proof of Stake, the creators of new blocks are selected in a deterministic way depending on their wealth (also defined as "stake"). Similar proofs are then performed by the selected nodes.

[0052] In mining 364, nodes attempt to solve a block by making incremental changes to one variable until the solution meets a network-wide target. This creates a proof of work, thereby guaranteeing a correct answer. In other words, a possible solution must prove that computational resources were expended in solving the problem. In some types of permissionless blockchains, miners may be rewarded with value (e.g., coins) for successfully mining a block.

[0053] Here, the PoW process makes it extremely difficult to modify the blockchain with block changes, since an attacker must modify all subsequent blocks to accept a change to one block. Furthermore, as new blocks are mined, the difficulty of modifying a block increases, and the number of subsequent blocks increases. At distribution 366, the successfully validated block is distributed throughout the permissionless blockchain 352, and all nodes 354 add the block to the majority chain, which is an auditable ledger of the permissionless blockchain 352. Furthermore, the value in the transaction submitted by the sender 356 is deposited or otherwise transferred to the digital wallet of the receiving device 358.

[0054] FIG. 4A illustrates a process 400A for converting a data object into slices, according to an example embodiment, where process 400A may be performed by a client node, or the like. Referring to FIG. 4A, a data object to be stored in the blockchain is encrypted to create an encrypted data object 410. The encrypted data object 410 may be split into slices 420. In addition to the data object, the client may add additional data 412 to provide resilience against loss, where the additional data may yield the additional slices 420. The additional data 412 ensures that there is redundancy in the data, both between slices and if one or more slices are later lost or corrupted. In some embodiments, m slices are created from splitting the object into m equal sized parts, and an extra k slices are provided for resilience against slice loss due to failure, or loss of slices due to malicious members of the network, etc., where N=m+k.

[0055] Each slice 420 may contain both common and unique content. In the example of Figure 4A, the content of slice 3 is shown. Here, the common content includes a hash 422 of the data object, which can be used for subsequent verification of the reconstructed data object. The unique content includes a hash 424 of each slice, as well as the encrypted slice content 426 (e.g., each portion of the encrypted data object 410).

[0056] In this way, an Efficient Threshold Scheme (ETS) may be integrated with the blockchain. Here, the system may generate N slices from a data object, with each slice including its hash and a hash of the entire object. The slices may be stored by the blockchain peers during the signing process, and the slices may be validated against the hash. This ensures that only transactions that include k+c<=n slices are signed. The data object and slices may be encrypted using a random key, which may be provided by secret sharing along with the slices. Thus, reconstructing the data object may require k active peers to obtain each slice. Otherwise, the key will not be able to decrypt the encrypted data.

[0057] In this example, blockchain peers (members) are uniquely numbered from 1 to N, where N is the number of peers that are members of the network. When a new entry in the ledger containing a large data object is proposed, the client (proposer) may apply ETS to the data object and generate N slices, where any k slices (e.g., a constant number of slices) may be required to reconstruct the data object. In addition, for each slice, the proposer generates an Integrity Check Value (ICV) for the slice. In the example of FIG. 4A, the ICV is the hash value 422 of the data object and the hash 424 of the slice. It should also be appreciated that the ICV may be any kind of data item that can be tested to match any portion of the data and to verify to a high degree of certainty whether the ICV matches the relevant portion of the data on which it was calculated. Other examples of ICVs include message authentication codes, checksums, hash values ​​(digests), digital signatures, cyclic redundancy checks, etc.

[0058] According to various embodiments, each proposed slice may include (1) an ICV for the entire data object, and (2) an ICV for each of the N slices, in addition to any information the proposer wants to include in the slice. Each member receives a proposed entry (a portion of the data and a hash) that corresponds to the member's index. Adding an entry to the chain works similarly to any other blockchain. During the signing process, a node stores the slice, verifies that the ICV in the blockchain transaction matches the received slice, and then signs the transaction.

[0059] In addition to the modifications mentioned above for adding entries to the chain, the system may require blockchain peers to implement a new API to retrieve slices of data from each other. This API would receive an identifier for an object (or a slice of an object) and, if permitted, would return the corresponding slice of the object stored by that network member. The system may implement retrieval outside the API and the blockchain. As another example, the system may add a transaction to the ledger requesting that the entire record be provided to the member, thereby creating a tracking mechanism for all members who have retrieved the record. With this extension, the slice would be provided to the member only after this transaction has been added to the blockchain.

[0060] Additionally, the encryption key used to encrypt the data object may be split (e.g., by a client) into partial keys and then distributed among blockchain peers. In this case, each peer may have access to only a partial key, rather than the entire encryption key. Then, during the reconstruction process, a peer may provide a portion of the encryption key. If a sufficient portion of the encryption key is recovered, the data object may be decrypted.

[0061] FIG. 4B illustrates a process 400B for reconstructing a data object from slices and validating the data object according to an example embodiment. With reference to FIG. 4B, four of the slices are available. In other words, the blockchain peer storing slices 2 and 5 is unavailable, making only slices 1, 3, 4, and 6 available. In this example, four of the six meet the required minimum (e.g., k=4). Thus, the blockchain peer 430 can retrieve four slices from each peer holding such slices using the newly defined slice retrieval API. Furthermore, the peer 430 can reconstruct the data object from the four slices (slices 1, 3, 4, and 6) to generate a reconstructed data object 432.

[0062] Peer 430 may retrieve a previously stored hash value of the data object from any of the blockchain peers holding slices 1, 3, 4, and 6. In this example, peer 430 may generate a corresponding hash of reconstructed data object 432 using the shared hash function to generate hashed data object 434. Additionally, peer 430 may verify that the value of hashed data object 434 is the same as the retrieved hash value of the data object. If it is the same, peer 430 knows that reconstructed data object 432 is valid. If it is not the same, the peer may ignore it and attempt to retrieve the data object if other slices / peers exist.

[0063] FIG. 5 illustrates a method 500 of storing a slice of a data object in a blockchain according to an example embodiment. Referring to FIG. 5, at 510, the method may include splitting the data object into multiple parts. The parts may be smaller objects (e.g., sub-objects) of the original data object. Examples of data objects include audio files, documents, videos, images, etc. In some embodiments, the smaller parts may each have the same size or different sizes. In some embodiments, the splitting may include splitting the data object into N parts corresponding to N blockchain peers, and reconstruction of the data object may be performed using any k of the N parts, where k is less than N. In some embodiments, the splitting may include adding k additional parts of the data for resilience to loss to generate the N parts. For example, m of the parts may be generated based on the data object, and k parts may be added for resilience to loss. In this example, m+k may be equal to N.

[0064] At 520, the method may include hashing the data object to generate a hashed data object and hashing the multiple portions to generate multiple hashed portions, where the hashed data object may represent a verification value that may be used to later verify the reconstructed data object. At 530, the method may include generating multiple slices, each slice including the hashed data object and a respective different hashed portion. Further, at 540, the method may include distributing each of the multiple slices across a plurality of blockchain peers.

[0065] In some embodiments, distributing may include assigning an index in the range of 1 to N to each of the N blockchain peers, and distributing the N slices to the N peers based on the assigned indexes. In some embodiments, the method may include encrypting the slices using an encryption key shared among the blockchain peers. In this example, the encryption key may be split into partial keys (portions of the key) and distributed, similar to the data object, such that each peer has access to a partial key rather than the entire key. In some embodiments, the method further includes retrieving a subset of the slices from among the subset of blockchain peers in response to a request for the data object, and reconstructing the data object from the hashed portions included in the subset of slices.

[0066] In some embodiments, the method may further include verifying the reconstructed data object based on a hashed data object stored in one of the retrieved slices, where the hashed data object may be extracted from one of the retrieved slices. The verification may include, for example, generating a hash of the reconstructed data object and comparing the hash to the hashed data object to verify that they are the same. If not, the reconstructed data object is incomplete. In some embodiments, the retrieval of the subset of slices is performed by a slice retrieval application programming interface (API) running on the subset of blockchain peers.

[0067] FIG. 6A illustrates an example system 600 including a physical infrastructure 610 configured to perform various operations according to example embodiments. With reference to FIG. 6A, the physical infrastructure 610 includes a module 612 and a module 614. The module 614 includes a blockchain 620 and a smart contract 630 (which may be present in the blockchain 620) that may perform any of the operational steps 608 (within the module 612) included in any of the example embodiments. The steps / operations 608 may include one or more of the embodiments described or illustrated in the figures and may represent information written or read, outputted, or written from one or more smart contracts 630 and / or the blockchain 620. The physical infrastructure 610, the module 612, and the module 614 may include one or more computers, servers, processors, memories, or wireless communication devices, or combinations thereof. Additionally, the module 612 and the module 614 may be the same module.

[0068] FIG. 6B illustrates another exemplary system 640 configured to perform various operations according to example embodiments. Referring to FIG. 6B, the system 640 includes modules 612 and 614. Module 614 includes a blockchain 620 and a smart contract 630 (which may reside in the blockchain 620) that may perform any of the operational steps 608 (in module 612) included in any of the example embodiments. The steps / operations 608 may include one or more of the embodiments described or illustrated in the figures and may represent information written or read, outputted, or written from one or more smart contracts 630 and / or blockchain 620. The physical infrastructure 610, module 612, and module 614 may include one or more computers, servers, processors, memories, or wireless communication devices, or combinations thereof. Additionally, module 612 and module 614 may be the same module.

[0069] FIG. 6C illustrates an exemplary system configured to utilize an intermediary server configured to configure smart contracts between contracting parties and enforce the terms of the smart contracts on a blockchain, according to an example embodiment. With reference to FIG. 6C, configuration 650 may represent a communication session, an asset transfer session, or a process or procedure operated by a smart contract 630 that explicitly identifies one or more user devices 652 and / or 656. The execution, operation, and results of the execution of the smart contract may be managed by a server 654. The contents of the smart contract 630 may require digital signatures by one or more of the entities 652 and 656 that are participants in the smart contract transaction. The results of the execution of the smart contract may be written to the blockchain 620 as a blockchain transaction. The smart contract 630 resides on the blockchain 620, which may reside on one or more computers, servers, processors, memories, and / or wireless communication devices.

[0070] FIG. 6D illustrates a system 660 including a blockchain, according to an example embodiment. Referring to the example of FIG. 6D, an application programming interface (API) gateway 662 provides a common interface for accessing the logic (e.g., smart contracts 630 or other chaincode) and data (e.g., distributed ledger, etc.) of the blockchain. In this example, the API gateway 662 is a common interface for performing transactions (calls, queries, etc.) on the blockchain by connecting one or more entities 652 and 656 to blockchain peers (i.e., servers 654). Here, the servers 654 are peer components of the blockchain network that hold copies of the world state and the distributed ledger, which allow clients 652 and 656 to query data about the world state and submit transactions to the blockchain network, which executes the smart contracts 630 according to the smart contracts 630 and signing policies.

[0071] The foregoing embodiments may be implemented in hardware, in a computer program executed by a processor, in firmware, or in a combination thereof. The computer program may be embodied in a computer-readable medium, such as a storage medium. For example, the computer program may be present in a random access memory (RAM), a flash memory, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a register, a hard disk, a removable disk, a compact disk read-only memory (CD-ROM), or any other form of storage medium known in the art.

[0072] An exemplary storage medium may be coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an application specific integrated circuit (ASIC). In the alternative, the processor and the storage medium may reside as discrete components.

[0073] FIG. 7A illustrates a process 700 of a new block being added to the distributed ledger 720 according to an example embodiment, and FIG. 7B illustrates the contents of a new data block structure 730 of the blockchain according to an example embodiment. With reference to FIG. 7A, a client (not shown) may submit a transaction to blockchain nodes 711, 712, or 713, or a combination thereof. A client may be an instruction received from any source to specify an action on the blockchain 720. As an example, a client may be an application acting on behalf of a requester, such as a device, person, or entity, proposing a blockchain transaction. Multiple blockchain peers (e.g., blockchain nodes 711, 712, and 713) may maintain a copy of the blockchain network state and the distributed ledger 720. Various types of blockchain nodes / peers may exist in a blockchain network, including signing peers that simulate and sign transactions proposed by clients, and commit peers that verify the signatures, validate the transactions, and commit the transactions to the distributed ledger 720. In this example, blockchain nodes 711, 712, and 713 may perform the role of signer nodes, committer nodes, or both.

[0074] The distributed ledger 720 includes a blockchain that stores immutable ordered records in blocks, and a state database 724 (current world state) that maintains the current state of the blockchain 722. There may be one distributed ledger 720 per channel, with each peer maintaining its own copy of the distributed ledger 720 for each channel in which it is a member. The blockchain 722 is a transaction log structured as hash-linked blocks, with each block containing a sequence of N transactions. A block may include various components, such as those shown in FIG. 7B. Block links (illustrated by arrows in FIG. 7A) may be generated by adding a hash of the previous block's header into the block header of the current block. In this way, all transactions on the blockchain 722 are ordered and cryptographically linked together, preventing tampering with the blockchain data without breaking the hash links. Furthermore, because of these links, the most recent block in the blockchain 722 represents all transactions that came before it. The blockchain 722 may be stored in the file system (local or attached storage) of a peer that supports additional dedicated blockchain workloads.

[0075] The current state of the blockchain 722 and distributed ledger 720 may be stored in a state database 724, where the current state data represents the latest values ​​of all keys ever included in the on-chain transaction log of the blockchain 722. Chaincode invocations execute transactions against the current state in the state database 724. To make those chaincode interactions highly efficient, the latest values ​​of all keys are stored in the state database 724. The state database 724 may contain an indexed view into the blockchain 722 transaction log, and therefore may be regenerated off-chain at any time. The state database 724 may be automatically restored (or generated if necessary) at peer startup and before transactions are received.

[0076] A signing node receives transactions from clients and signs the transactions based on the simulation results. The signing node holds a smart contract that simulates the transaction proposal. When the signing node signs a transaction, it generates a signature for the transaction, which is a signed response from the signing node to the client application indicating the signature of the simulated transaction. The way in which the transaction is signed depends on a signature policy that may be specified in the chaincode. An example of a signature policy is "a majority of the signing peers must sign the transaction." Different channels may have different signature policies. The signed transaction is forwarded by the client application to the ordering service 710.

[0077] The ordering service 710 receives signed transactions, orders them into blocks, and distributes the blocks to committing peers. For example, the ordering service 710 may start a new block when a transaction threshold is reached, a timer times out, or another condition. In the example of FIG. 7A, blockchain node 712 is a committing peer that receives a new data block 730 of new data for storage in the blockchain 720. The first block in a blockchain may be called a genesis block, which contains information about the blockchain, the members of the blockchain, the stored data, etc.

[0078] The ordering service 710 may consist of a cluster of ordering nodes. The ordering service 710 does not process transactions, smart contracts, or maintain a shared ledger. Rather, the ordering service 710 may receive signed transactions and specify the order in which those transactions are committed to the distributed ledger 720. The architecture of the blockchain network may be designed such that a particular implementation of "ordering" (e.g., Solo, Kafka, BFT, etc.) is a pluggable component.

[0079] Transactions are written to the distributed ledger 720 in a consistent order. The order of transactions is established to ensure that updates to the state database 724 are valid when transactions are committed to the network. Unlike cryptocurrency blockchain systems (e.g., Bitcoin) where ordering occurs through solving cryptographic puzzles or through mining, in this example, the participants in the distributed ledger 720 may choose the ordering mechanism that best suits their network.

[0080] The ordering service 710 may initialize a new data block 730, which may be broadcast to the committing peers (e.g., blockchain nodes 711, 712, and 713). In response, each committing peer may verify the validity of the transaction in the new data block 730 by checking to ensure that the read set and write set still match the current world state in the state database 724. In particular, the committing peer may determine whether the read data that existed when the signer simulated the transaction is identical to the current world state in the state database 724. If the committing peer verifies the validity of the transaction, the transaction is written to the blockchain 722 of the distributed ledger 720, and the state database 724 is updated with the write data from the read / write set. If a transaction fails, i.e., a commit peer detects that its read / write set does not match the current world state in state database 724, the transactions ordered in the block are still included in the block but are marked as invalid and state database 724 is not updated.

[0081] With reference to FIG. 7B, a new data block 730 (also referred to as a data block) stored in the blockchain 722 of the distributed ledger 720 may include multiple data segments, such as a block header 740, block data 750, and block metadata 760. It should be understood that the various illustrated blocks and their contents, such as the new data block 730 and its contents illustrated in FIG. 7B, are examples only and are not intended to limit the scope of the example embodiments. The new data block 730 may store transaction information for N (e.g., 1, 10, 100, 500, 1000, 2000, 3000, etc.) transactions in the block data 750. The new data block 730 may include a link to a previous block (e.g., on the blockchain 722 of FIG. 7A) in the block header 740. In particular, the block header 740 may include a hash of the header of the previous block. The block header 740 may include a unique block number for the new data block 730, a hash of the block data 750, etc. The block numbers for the new data block 730 are unique and may be assigned in various orders, such as a progressive / consecutive order starting from 0.

[0082] The block data 750 may store transaction information for each transaction recorded in the new data block 730. For example, the transaction data may include one or more of the following: transaction type, version, timestamp, distributed ledger 720 channel ID, transaction ID, epoch, payload visibility, chaincode path (deploy transaction), chaincode name, chaincode version, inputs (chaincode and function), client (creator) identification such as public key and certificate, client signature, signer identification, signer signature, proposal hash, chaincode event, response status, namespace, write set (e.g., list of keys and versions read by transaction), write set (e.g., list of keys and values), start key, end key, list of keys, Merkle tree query summary, etc. Transaction data may be stored for each of the N transactions.

[0083] According to various embodiments, the block data 750 may store slice data 752, which includes a slice of data among multiple slices of a data object. The slice data 752 may include a portion of the original data object, a hash of the data object, a hash of the slice, etc. The slice data 752 includes one or more of the steps, features, processes, or operations, or combinations thereof, described or illustrated herein. Accordingly, the slice data 752 may be stored in an immutable log of blocks on the distributed ledger 720 of the blockchain 722. Some of the advantages of storing the slice data 752 in the blockchain are reflected in various embodiments disclosed and illustrated herein. Although in FIG. 7B the slice data 752 is illustrated in the block data 750, the slice data 752 may also be in the block header 740 or the block metadata 760.

[0084] Block metadata 760 may store multiple fields of metadata (e.g., as a byte array, etc.). The metadata fields may include a signature at the time of block creation, a reference to the last constituent block, a transaction filter that identifies valid and invalid transactions in the block, the last persistent offset of the ordering service that ordered the block, etc. The signature, last constituent block, and ordering node metadata may be added by the ordering service 710. Meanwhile, the committer of the block (e.g., blockchain node 712) may add valid / invalid information based on signature policy, validation of read / write sets, etc. The transaction filter may include a byte array of size equal to the number of transactions in the block data 750, and a validation code that identifies whether the transaction was valid / invalid. In some embodiments, not shown in FIG. 7B, block metadata 760 may store metadata for the recommended smart contracts therein.

[0085] FIG. 7C illustrates an embodiment of a blockchain 770 for digital content, according to embodiments described herein. Digital content may include one or more files and associated information. These files may include media, images, video, audio, text, links, graphics, animations, web pages, documents, or other forms of digital content. The immutable, append-only characteristics of blockchain serve as a safeguard to protect the integrity, validity, and authenticity of digital content, making blockchain appropriate for use in legal proceedings where admissibility rules apply, or in other settings where evidence is considered or the presentation and use of digital information is otherwise subject. In this case, the digital content may be referred to as digital evidence.

[0086] A blockchain may be formed in a variety of ways. In one embodiment, digital content may be contained in and accessed from the blockchain itself. For example, each block of the blockchain may store a hash value of the reference information (e.g., header, value, etc.) along with the associated digital content. The hash value and the associated digital content may then be encrypted together. Thus, the digital content of each block may be accessed by decrypting each block in the blockchain, and the hash value of each block may be used as a basis to reference the previous block. This may be shown as follows: Block 1 Block 2 ····Block N Hash value 1 Hash value 2 Hash value N Digital Content 1 Digital Content 2 Digital Content N

[0087] In one embodiment, the digital content may not be included in the blockchain. For example, the blockchain may store an encrypted hash of the contents of each block that does not contain digital content. The digital content may be stored in a separate storage area or memory address in association with the hash value of the original file. The other storage area may be the same storage device used to store the blockchain, or may be a different storage area or a separate relational database. The digital content of each block may be referenced or accessed by obtaining or querying the hash value of the block in question and then searching the storage area for the hash value stored that corresponds to the actual digital content. This operation may be performed, for example, by a database gatekeeper. This may be shown as follows: Blockchain Storage Area Hash value of block 1 Hash value of block 1...Contents · · · · · · Hash value of block N Hash value of block N... contents

[0088] In the example embodiment of FIG. 7C , a blockchain 770 comprises multiple blocks 7781, 7782, ... 778 that are cryptographically linked in an ordered sequence. N , where N >= 1. Blocks 7781, 7782, ... 778 N The encryption used to link the ciphers may be either multiple keyed or unkeyed hash functions. In one embodiment, blocks 7781, 7782, ... 778 N are subjected to a hash function (where n is 256 or another number) that generates an n-bit alphanumeric output from the input based on the information in the block. Examples of such hash functions include, but are not limited to, SHA-type (SHA stands for Secured Hash Algorithm) algorithms, the Merkle-Dangard algorithm, the HAIFA algorithm, the Merkle Tree algorithm, nonce-based algorithms, and non-collision resistant PRF algorithms. In another embodiment, blocks 7781, 7782, ...778 N may be cryptographically linked by a function different from the hash function. For illustrative purposes, the following description is given with reference to a hash function (eg, SHA-2).

[0089] Blocks 7781, 7782, ... 778 in the blockchain N Each of the files includes a header, a version of the file, and a value. The header and value vary from block to block as a result of hashing in the blockchain. In one embodiment, the value may be included in the header. As described in more detail below, the version of the file may be the original file or a different version of the original file.

[0090] The first block 7781 in a blockchain is called the genesis block and contains a header 7721, an original file 7741, and an initial value 7761. The hashing scheme used for the genesis block (and in fact for all subsequent blocks) may vary. For example, all of the information in the first block 7781 may be hashed together at the same time, or each or part of the information in the first block 7781 may be hashed separately, and then a hash of the separately hashed parts may be performed.

[0091] The header 7721 may include one or more initial parameters, which may include, for example, a version number, a timestamp, a nonce, route information, difficulty, consensus protocol, duration, media format, source, descriptive keywords, or other information associated with the original file 7741 or the blockchain or both, or a combination thereof. The header 7721 may be generated automatically (e.g., by blockchain network management software) or manually by a participant of the blockchain. Other blocks 7782-778 in the blockchain N Unlike headers in the 7721 block, the header in the genesis block does not reference a previous block, because there is simply no previous block.

[0092] The original file 7741 in the genesis block may be, for example, data captured by a device, with or without processing prior to inclusion in the blockchain. The original file 7741 may be received from a device, media source, or node through an interface of the system. The original file 7741 may be associated with metadata, which may be generated, for example, by a user, device, or system processor, either manually or automatically. The metadata may be included in the first block 7781 in association with the original file 7741.

[0093] The value 7761 in the genesis block is an initial value generated based on one or more unique attributes of the original file 7741. In one embodiment, the one or more unique attributes may include a hash value of the original file 7741, metadata of the original file 7741, and other information associated with the file. In one implementation, the initial value 7761 may be based on the following unique attributes: 1) The hash value calculated for the original file by HA-2 2) Calling device ID 3) The start timestamp of the original file 4) The initial storage location of the original file 5) The blockchain network member ID of the software that currently controls the original file and associated metadata

[0094] Other blocks in the blockchain: 7782 to 778 N Each block also contains a header, a file, and a value. However, unlike the first block 7721, the headers 7722 to 7723 in the other blocks N Each of the remaining blocks contains the hash value of the immediately preceding block, which may simply be a hash of the previous block's header, or may be a hash value of the entire previous block. By including the hash value of the preceding block in each of the remaining blocks, a block-by-block trace can be performed back from the Nth block to the genesis block (and associated original file), as indicated by arrow 780, establishing an auditable and immutable evidential chain of custody.

[0095] Headers 7722 to 772 in other blocks N Each of the may generally include other information (e.g., a version number, a timestamp, a nonce, root information, difficulty, consensus protocol, or other parameters or information associated with the corresponding file or blockchain or both, or a combination thereof).

[0096] Files 7742 to 774 in other blocks N may be the same as the original file in the genesis block or may be a modified version of the original file, depending, for example, on the type of processing performed. The type of processing performed may vary from block to block. Processing may include any modification of the file in the preceding block, such as, for example, editing information or otherwise changing the content of information, removing information from the file, or adding information to the file.

[0097] Additionally or alternatively, processing may include simply copying a file from a previous block, changing the storage location of the file, analyzing a file from one or more previous blocks, moving a file from one storage or memory location to another storage or memory location, or performing operations on the file and / or associated metadata on the blockchain. Processing including analyzing a file may include, for example, adding, including, or otherwise associating various analyses, statistics, or other information associated with the file.

[0098] Other blocks in other blocks 7762~776 N The value contained in each of the blocks is unique and different as a result of the operations that were performed. For example, the value in any one block corresponds to an updated version of the value in the previous block. This update is reflected in the hash of the block to which the value was assigned. The value of a block thus provides an indication of what operations were performed in the block, and also makes it possible to trace the blockchain back to the original file. This tracing confirms the evidential integrity of the file throughout the blockchain.

[0099] For example, consider the case where a portion of a file in a previous block is edited, blocked, or pixelated to protect the identity of a person indicated in the file. In this case, the block containing the edited file will include metadata associated with the edited file, such as how the edit was performed, who performed the edit, a timestamp when the edit occurred, etc. This metadata may be hashed to form a value. Because the metadata of the block is different from the information hashed to form the value in the previous block, the values ​​are different from each other and may be recovered when decrypted.

[0100] In one embodiment, the value of the previous block may be updated (e.g., a new hash value may be calculated) to form the value of the current block if any one or more of the following occurs: The new hash value, in this example embodiment, may be calculated by hashing all or part of the information set forth below: a) A new SHA-2 computed hash value whenever the file is processed in any way (e.g., when the file is edited, copied, modified, accessed, or any other action is performed on it). b) The new storage location of the file c) Identified new metadata associated with the file. d) Transfer of access or control of a file from one blockchain participant to another blockchain participant

[0101] FIG. 7D illustrates an embodiment of a block that may represent the structure of a block in a blockchain 790, according to one example embodiment. i ) is header 772 i , File 774 i , and the value 776 i Contains:

[0102] Header 772 iis the previous block (block i-1 ) and additional reference information, which may be any type of information (e.g., header information containing references, properties, parameters, etc.). Every block references the hash of the previous block, except of course for the genesis block. The hash of the previous block may simply be a hash of the header in the previous block, or it may be a hash of all or part of the information in the previous block, including files and metadata.

[0103] File 774 i contains multiple data, such as Data1, Data2, ..., DataN, in turn. The data are tagged with metadata (Metadata1, Metadata2, ..., MetadataN) that describe the content and / or characteristics associated with the data. For example, the metadata for each data may include information to indicate a timestamp of the data, keywords indicative of the process of the data, people or other content depicted in the data, or other characteristics that establish the validity and content of the file as a whole and that can be particularly useful for using digital evidence, for example as described in connection with the embodiments described below, or a combination thereof. In addition to the metadata, each data may include a reference to the previous data (Reference1, Reference2, ..., Reference3, ..., Reference4, ...) to prevent tampering, gaps in the file, and successive references throughout the file. N ) may be tagged.

[0104] After metadata is assigned to data (e.g., via a smart contract), it cannot be changed without changing the hash, which can be easily identified as invalid. Thus, the metadata creates a data log of information that may be accessed for use by participants in the blockchain.

[0105] Value 776 iis a hash value or other value calculated based on any of the types of information previously described. For example, i ), the value of that block may be updated to reflect the operation performed on that block (e.g., a new hash value, a new storage location, new metadata for the associated file, control or access transfer, an identifier, or other operation or added information). Although the values ​​in each block are shown as being separate from the metadata of the file and header data, in alternative embodiments the values ​​may be based in part or in whole on this metadata.

[0106] At any point after the blockchain 770 is formed, an immutable evidence-based copy of the file may be obtained by querying the blockchain for the transaction history of values ​​across blocks. This query or trace procedure may begin by decrypting the value of the last included block (e.g., the last (Nth) block), and then continue to decrypt the values ​​of other blocks until the genesis block is reached and the original file is recovered. Decryption may further include decrypting the header and file and associated metadata at each block.

[0107] Decryption is performed based on the type of encryption performed on each block. This decryption may involve the use of a private key, a public key, or a public and private key pair. For example, if asymmetric encryption is used, a blockchain participant or a processor in the network may generate a public and private key pair using a predefined algorithm. The public and private keys are related to each other by some mathematical relationship. The public key may be distributed publicly to serve as an address (e.g., an IP address or a home address) for receiving messages from other users. The private key is kept secret and is used to digitally sign messages sent to other blockchain participants. The signature is included in the message so that the recipient can verify it using the sender's public key. In this way, the recipient can be sure that only the sender could have sent this message.

[0108] Generating a key pair is similar to creating an account on the blockchain, but in reality, there is no need to register anywhere. Also, every transaction performed on the blockchain is digitally signed by the sender using a private key. This signature ensures that only the account owner can track and process files on the blockchain (if within the scope of their permissions, as determined by the smart contract).

[0109] 8A and 8B illustrate additional use cases for blockchain that may be incorporated and used herein. In particular, FIG. 8A illustrates an example 800 of a blockchain 810 storing machine learning (artificial intelligence) data. Machine learning relies on large amounts of historical data (or training data) to build predictive models for accurate predictions on new data. Machine learning software (e.g., neural networks, etc.) can sift through millions of records to discover often non-intuitive patterns.

[0110] In the example of FIG. 8A, a host platform 820 builds and deploys machine learning models for predictive monitoring of assets 830, where the host platform 820 may be a cloud platform, an industrial server, a web server, a personal computer, a user device, etc. The assets 830 may be any type of asset (e.g., machinery or equipment, etc.), such as an aircraft, a locomotive, a turbine, a medical device, an oil and gas device, a boat, a ship, a vehicle, etc. As another example, the assets 830 may be intangible assets, such as stocks, currencies, digital coins, insurance, etc.

[0111] The blockchain 810 may be used to significantly improve both the machine learning model training process 802 and the prediction process 804 based on the trained machine learning model. For example, in 802, historical data may be stored on the blockchain 810 by the asset 830 itself (or through an intermediary not shown) rather than requiring a data scientist / technologist or other user to collect the data. This can significantly reduce the collection time required by the host platform 820 when performing training of the predictive model. For example, smart contracts can be used to transfer data directly and reliably from its original location straight to the blockchain 810. The smart contracts can send data directly from the asset to the individual who uses the data to build the machine learning model by using the blockchain 810 to ensure the security and ownership of the collected data. This allows for the sharing of data between the assets 830.

[0112] The collected data may be stored in the blockchain 810 based on a consensus mechanism. The consensus mechanism controls (authorized nodes) to ensure that the data being recorded is verified and accurate. The recorded data is time-stamped, cryptographically signed, and immutable. Thus, the recorded data is auditable, transparent, and secure. By adding IoT devices that write directly to the blockchain, it is possible to increase the frequency and accuracy with which data is recorded in certain cases (i.e., in the case of supply chain, healthcare, logistics, etc.).

[0113] Additionally, training the machine learning model on the collected data may require a series of refinements and tests by the host platform 820. Each refinement and test may be based on additional data or data not previously considered to help expand the knowledge of the machine learning model. At 802, the different training and testing steps (and associated data) may be stored in the blockchain 810 by the host platform 820. Each refinement of the machine learning model (e.g., changes in variables, weights, etc.) may be stored in the blockchain 810. This provides verifiable proof of how the model was trained and what data was used to train the model. Additionally, when the host platform 820 achieves a final trained model, the resulting model may be stored in the blockchain 810.

[0114] After the model is trained, it may be deployed into a live environment and predictions / decisions may be made based on the execution of the final trained machine learning model. For example, at 804, the machine learning model may be used for condition-based maintenance (CBM) for assets such as aircraft, wind turbines, medical machines, etc. In this example, data fed back from the asset 830 may be input into the machine learning model and used to make event predictions such as failure events, error codes, etc. Decisions made by the execution of the machine learning model on the host platform 820 may be stored on the blockchain 810 to provide auditable / verifiable proof. As one non-limiting example, the machine learning model may predict a future outage / failure on a part of the asset 830 and create an alert or notification to replace the part. The data behind this decision may be stored on the blockchain 810 by the host platform 820. In one embodiment, the features and / or operations described and / or illustrated herein may occur on or with respect to the blockchain 810.

[0115] New transactions in the blockchain can be collected together in a new block and added to an existing hash value. This hash value is then encrypted to produce a new hash for the new block. This new hash is added to the next list of transactions as they are encrypted, and so on. The result is a chain of blocks, each containing the hash values ​​of all the blocks that preceded it. The computers that store these blocks periodically compare the hash values ​​of the blocks to make sure they are all in agreement. Any computers that are not in agreement discard the offending record. This method is good at guaranteeing that the blockchain is tamper-proof, but it is not perfect.

[0116] One way to rig the system is for a malicious user to modify the list of transactions in a way that does not change the hash. This can be done by a brute force attack, in other words by modifying the record, encrypting the result, and checking if the hash value is the same. If the hash value is not the same, it tries again and again until it finds a matching hash. The security of the blockchain is based on the idea that a normal computer can only perform this kind of brute force attack over totally impractical timescales, such as the age of the universe. Quantum computers, by contrast, are very fast (thousands of times faster) and therefore pose a very large threat.

[0117] FIG. 8B shows an example 850 of a quantum secure blockchain 852 that implements quantum key distribution (QKD) to protect against quantum computing attacks. In this example, blockchain users can verify each other's identities using QKD, which uses quantum particles such as photons to transmit information that cannot be copied by an eavesdropper without being corrupted. In this way, senders and receivers can verify each other's identities via the blockchain.

[0118] In the example of FIG. 8B, there are four users (854, 856, 858, and 860). Each pair of users can share a secret key 862 (i.e., QKD) between themselves. Since there are four nodes in this example, there are six pairs of nodes, and therefore, QKD AB , QKD AC , QKD AD , QKD BC , QKD BD , and QKD CDSix different private keys 862 are used, including 100 and 150. Each pair can create QKD by using quantum particles such as photons to transmit information that cannot be copied by an eavesdropper without being corrupted. In this way, pairs of users can verify each other's identities.

[0119] The operation of the blockchain 852 is based on two steps: (i) the creation of a transaction, and (ii) the construction of a block that collects new transactions. New transactions may be created in the same way as in a traditional blockchain network. Each transaction may contain information about the sender, the recipient, the time of creation, the amount (or value) to be transferred, a list of reference transactions that justify the sender having funds for the operation, etc. This transaction record is then sent to all other nodes and entered into the pool of unconfirmed transactions. Now, two parties (i.e., a pair of users among 854-860) authenticate the transaction by providing a shared secret key 862 (QKD). This quantum signature is attached to every transaction, making it extremely difficult to tamper with. Each node checks the transaction entry with respect to its local copy of the blockchain 852 and verifies that each transaction has sufficient funds. However, the transaction is not yet confirmed.

[0120] Rather than performing a traditional mining process on a block, a broadcast protocol may be used to create blocks in a distributed manner. At a predefined time period (e.g., seconds, minutes, hours, etc.), the network may apply the broadcast protocol to any unconfirmed transactions, thereby achieving Byzantine consensus (agreement) on the correct version of the transaction. For example, each node may possess a private value (that particular node's transaction data). At the first time, the nodes send the private value to each other. Then, the nodes communicate the information they received from other nodes last time. Now, the authentic node can create a complete set of transactions in a new block. This new block can be added to the blockchain 852. In one embodiment, the features and / or operations described and / or illustrated herein may occur in or with respect to the blockchain 852.

[0121] 9 illustrates an exemplary system 900 supporting one or more of the example embodiments described and / or illustrated herein. The system 900 includes a computer system / server 902 that can operate in numerous other general purpose or special purpose computing system environments or configurations. Examples of well-known computing systems, environments, or configurations that may be suitable for use with the computer system / server 902 include, but are not limited to, personal computer systems, server computer systems, thin clients, thick clients, handheld or laptop devices, multiprocessor systems, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputer systems, mainframe computer systems, and distributed cloud computing environments that include any of these systems or devices.

[0122] The computer system / server 902 may be described in the general context of computer system executable instructions, such as program modules being executed by the computer system. Typically, program modules may include routines, programs, objects, components, logic, data structures, etc. that perform particular tasks or implement particular abstract data types. The computer system / server 902 may be executed in a distributed cloud computing environment where tasks are performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules may be located in both local and remote computer system storage media, including memory storage devices.

[0123] 9, a computer system / server 902 in a cloud computing node 900 is shown in the form of a general purpose computing device. Components of the computer system / server 902 may include, but are not limited to, one or more processors or processing units 904, a system memory 906, and a bus coupling various system components including the system memory 906 to the processor 904.

[0124] A bus may represent one or more of any of a number of types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures, including, by way of example only, Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnects (PCI) bus.

[0125] The computer system / server 902 typically includes a variety of computer system readable media. Such media may be any available media accessible by the computer system / server 902, including volatile and non-volatile media, removable and non-removable media. The system memory 906, in one embodiment, implements the flow diagrams of the other figures. The system memory 906 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 910 and / or cache memory 912. The computer system / server 902 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, a storage system 914 may be provided for reading from and writing to a non-removable, non-volatile magnetic medium (not shown, typically referred to as a "hard drive"). Although not shown, a magnetic disk drive for reading from and writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from and writing to a removable, non-volatile optical disk, such as a CD-ROM, DVD-ROM, or other optical media, may be provided. In such an example, each may be connected to the bus by one or more data media interfaces. As shown and described in more detail below, memory 906 may include at least one program product comprising a set of (e.g., at least one) program modules configured to perform the functions of various embodiments of the present application.

[0126] For example, programs / utilities 916 including a set of (at least one) program modules 918 may be stored in memory 906, including, but not limited to, an operating system, one or more application programs, other program modules, and program data. Each of the operating system, one or more application programs, other program modules, and program data or a combination thereof may include an implementation of a network environment. The program modules 918 typically perform the functions and / or methods of the various embodiments of the present application described herein.

[0127] As will be appreciated by one of ordinary skill in the art, aspects of the present application may be embodied as a system, method, or computer program product. Accordingly, aspects of the present application may take the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, microcode, etc.), or an embodiment combining software and hardware aspects, all of which may be referred to generally herein as a "circuit," "module," or "system." Additionally, aspects of the present application may take the form of a computer program product embodied in one or more computer readable medium(s) having computer readable program code embodied therein.

[0128] The computer system / server 902 may also communicate with one or more external devices 920, such as a keyboard, pointing device, display 922, one or more devices that allow a user to interact with the computer system / server 902, or any device that allows the computer system / server 902 to communicate with one or more other computing devices (e.g., network cards, modems, etc.), or combinations thereof. Such communication may occur through an I / O interface 924. Additionally, the computer system / server 902 may communicate with one or more networks, such as a local area network (LAN), a general wide area network (WAN), or a public network (e.g., the Internet), or combinations thereof, through a network adapter 926. As shown, the network adapter 926 communicates with other components of the computer system / server 902 through a bus. It should be understood that other hardware and / or software components, not shown, may be used with the computer system / server 902. Examples include, but are not limited to, microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data archive storage systems.

[0129] Although at least one example embodiment of the system, method, and non-transitory computer-readable medium has been illustrated in the accompanying drawings and described in the foregoing detailed description, it will be understood that the present application is not limited to the disclosed embodiments, but may be subject to numerous rearrangements, modifications, and substitutions, as illustrated and defined by the following claims. For example, the functions of the various illustrated systems may be performed by one or more of the modules or components described herein, or in a distributed architecture, and may include pairs of transmitters, receivers, or both. For example, all or a portion of the functions performed by individual modules may be performed by one or more of those modules. Furthermore, the functions described herein may be performed at various times, with respect to various events, within or outside the modules or components. Also, information transmitted between the various modules may be transmitted between the modules via at least one of a data network, the Internet, a voice network, an Internet Protocol network, a wireless device, a wired device, or via multiple protocols, or a combination thereof. Additionally, a message sent or received by any of the modules may be sent or received directly, via one or more of the other modules, or both.

[0130] Those skilled in the art will appreciate that the "system" may be embodied as a personal computer, a server, a console, a personal digital assistant (PDA), a mobile phone, a tablet computing device, a smartphone, or any other suitable computing device or combination of devices. Presenting the foregoing functions performed by the "system" is in no way intended to limit the scope of this application, but rather to provide one example of many embodiments. Indeed, the methods, systems, and apparatus disclosed herein may be implemented in a local or distributed fashion consistent with computing technology.

[0131] It should be noted that some of the features of the systems described herein have been presented as modules to more particularly emphasize their implementation independence. For example, a module may be implemented as a hardware circuit comprising custom very large-scale integration (VLSI) circuits or gate arrays, off-the-shelf semiconductors such as logic chips, transistors, or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices, graphics processing units, etc.

[0132] The modules may be implemented at least partially in software for execution by various types of processors. For example, an identified unit of executable code may comprise one or more physical or logical blocks of computer instructions, which may be organized as, for example, an object, a procedure, or a function. Nevertheless, the executableness of the identified modules need not be physically located together, but may include heterogeneous instructions stored in different locations, which, when logically combined together, comprise a module and achieve the stated purpose of the module. Furthermore, the modules may be stored on a computer-readable medium, which may be, for example, a hard disk drive, a flash device, a random access memory (RAM), a tape, or any other medium used to store data.

[0133] In practice, a module of executable code can be a single instruction, or many instructions, and may be distributed across several different code segments, among different programs, and across multiple memory devices. Similarly, operational data may be identified and depicted herein within modules, and may be embodied in any suitable form and organized within any suitable type of data structure. Operational data may be collected as a single data set or may be distributed across different locations, including different storage devices, and may exist, at least in part, as merely electronic signals over a system or network.

[0134] It will be readily understood that the components of the present application, as generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations, and thus, the detailed description of the embodiments is not intended to limit the scope of the present application as claimed, but merely represents selected embodiments of the present application.

[0135] Those skilled in the art will readily appreciate that it is possible to practice the foregoing using steps in an order other than that disclosed, or using hardware elements other than those in the disclosed configurations, or both. Thus, while the application has been described based on these preferred embodiments, it will be apparent to those skilled in the art that certain modifications, variations, and alternative constructions will be apparent.

[0136] While preferred embodiments of the present application have been described, it should be understood that the described embodiments are merely examples, and that the scope of this application, when considered along with the full scope of equivalents and modifications thereto (e.g., protocols, hardware devices, software platforms, etc.), is to be defined solely by the appended claims.

Claims

1. Dividing a data object into a number of parts; hashing the data object to generate a hashed data object and hashing the portions to generate a plurality of hashed portions; generating a plurality of slices, each slice including the hashed data object and a different hashed portion; A processor configured to execute a processor that divides the data object into N parts corresponding to N blockchain peers, and reconstruction of the data object can be performed using any k of the N parts, where k is less than N; and a network interface configured to distribute the plurality of slices across a plurality of blockchain peers, respectively.

2. 2. The apparatus of claim 1, wherein the processor is further configured to: assign an index in a range of 1 to N to each of the N blockchain peers; and control the network interface to distribute N slices to the N blockchain peers based on the assigned indexes.

3. 2. The apparatus of claim 1, wherein the processor is configured to divide the data object into m equal-sized portions and, for resilience to loss, add k additional portions of data to generate the N portions.

4. 2. The apparatus of claim 1, wherein the processor is further configured to encrypt the plurality of slices using an encryption key, and wherein only a portion of the encryption key is held by each of the blockchain peers such that no single blockchain peer stores the encryption key in its entirety.

5. 2. The apparatus of claim 1, wherein the processor is configured to: retrieve a subset of slices from the subset of blockchain peers in response to a request for the data object; and reconstruct the data object from hashed portions included in the subset of slices.

6. 6. The apparatus of claim 5, wherein the processor is further configured to verify the reconstructed data object based on the hashed data object stored in one of the retrieved slices.

7. 6. The apparatus of claim 5, wherein the processor is configured to retrieve the subset of slices through a slice-retrieval application programming interface (API) executing on the subset of the blockchain peers.

8. Dividing a data object into a number of parts; hashing the data object to generate a hashed data object and hashing the portions to generate a plurality of hashed portions; generating a plurality of slices, each slice including the hashed data object and a different hashed portion; and distributing the plurality of slices across a plurality of blockchain peers, respectively, comprising: The method, wherein the dividing includes dividing the data object into N portions corresponding to N blockchain peers, and reconstruction of the data object can be performed using any k of the N portions, where k is less than N.

9. 9. The method of claim 8, wherein the distributing comprises: assigning an index in a range from 1 to N to each of the N blockchain peers; and distributing N slices to the N blockchain peers based on the assigned indexes.

10. 9. The method of claim 8, wherein the splitting comprises splitting the data object into m equal sized portions and adding k additional portions of data for resilience to loss to generate the N portions.

11. 10. The method of claim 8, further comprising encrypting the plurality of slices using an encryption key, wherein only a portion of the encryption key is held by each of the blockchain peers such that no single blockchain peer stores the encryption key in its entirety.

12. 10. The method of claim 8, further comprising retrieving a subset of slices from the subset of blockchain peers in response to a request for the data object, and reconstructing the data object from hashed portions included in the subset of slices.

13. 13. The method of claim 12, further comprising verifying the reconstructed data object based on the hashed data object stored in one of the retrieved slices.

14. 13. The method of claim 12, wherein retrieving the subset of slices is performed by a slice-retrieval application programming interface (API) running on the subset of blockchain peers.

15. A computer program product for causing a computer to carry out the steps of the method according to any one of claims 8 to 14.

16. A non-transitory computer readable medium having recorded thereon the computer program of claim 15.

Citation Information

Patent Citations

  • Network distributed duplication exclusion file storage system

    JP2018190227A

  • Ultra-secure blockchain-based electronic information transfer system

    US10114969B1

  • Shared secret-based blockchain storage

    WO2019072298A2