Blockchain Schema-Based Data Pruning for Storage Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Centralized data storage platforms face challenges in efficiently managing and securing large volumes of data while maintaining data integrity and accessibility, particularly in reducing storage needs while ensuring data validity and security.
Innovation Solution
A system that receives a pruned data structure from a client, comprising fields and hash values, identifies the schema, validates the structure, and commits it to a blockchain, reducing data storage by using hash values instead of actual content, ensuring data integrity and security through decentralized storage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If actual data content is stored on the blockchain, then data integrity and accessibility are maintained, but storage requirements and costs increase significantly
Solution Approach 1:
The patent extracts only the essential structural information and schema definitions from the full data content, storing these pruned representations on the blockchain instead of the complete data. This allows the blockchain to verify data existence and structure without storing the actual content, dramatically reducing storage requirements while maintaining integrity through schema validation.
Solution Approach 2:
The patent introduces schema validation as an intermediary mechanism between data creation and blockchain storage. The schema acts as a mediator that defines the structure and constraints of data, allowing the system to store and verify structural information without storing the actual data content. This intermediary enables data existence proof without data duplication.
2Ease of operation
If data is stored on a centralized platform, then data management and security control are simplified, but data redundancy increases and single-point failures occur
Solution Approach 1:
The patent segments data storage into two distinct components: schema definitions and data content. The schema (structural information) is stored on the decentralized blockchain, while the actual data content is stored separately by clients. This segmentation eliminates the need for centralized data management while reducing redundancy, as only the schema is replicated across the blockchain network rather than the entire data content.
Solution Approach 2:
The patent transitions from storing data in a single centralized dimension to a multi-dimensional approach where schema information is stored across multiple blockchain nodes while data content is stored locally. This dimensional separation allows decentralized data management without requiring duplication of all data, as each node only stores the schema rather than complete data copies.
3Manufacturing precision
If schema validation is performed on all data structures, then data quality and consistency are improved, but processing time and system complexity increase
Solution Approach 1:
The patent performs schema validation as a preliminary action before data is submitted to the blockchain. By validating data structure and schema compliance in advance, the system ensures data quality is established beforehand, allowing the blockchain to simply verify the validation result rather than performing complex validation during blockchain processing. This preliminary validation reduces the computational burden on the blockchain network.
Data Source
AI summary
An example operation may include one or more of receiving, from a client, a pruned data structure that comprises a plurality of fields and a plurality of hash values, respectively, identifying a schema associated with the pruned data structure, determining whether the pruned data structure is a valid based on the plurality of fields in the data structure and the identified schema associated with the client, and in response to a determination that the pruned data structure is valid, committing the pruned data structure to a blockchain.