Distributed File Block Storage for Secure Data Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data-sharing systems face challenges in efficiently searching and securing technological documents due to complexity in indexing, limited transmission speed, and vulnerability to data loss or theft, especially when all documents are stored in a single host.
Innovation Solution
The method involves dividing files into blocks, duplicating and distributing these blocks across multiple data hosts, ensuring each host has incomplete portions, and using a block distribution table to efficiently retrieve and reassemble files while protecting against unauthorized access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If all shared documents are stored in a single data host, then data access is simplified, but transmission speed is limited and data security is compromised
Solution Approach 1:
The patent divides the file into multiple blocks and distributes them across multiple data hosts. Each block is further duplicated and stored on different hosts, ensuring that no single host contains the complete file. This segmentation resolves the contradiction by maintaining data security through distribution while enabling efficient access through parallel retrieval of blocks from multiple hosts.
2Device complexity
If all shared documents are stored in a single data host, then data management is simplified, but the system is vulnerable to data loss and hacking
Solution Approach 1:
By segmenting the file into blocks and distributing them across multiple hosts with redundant copies, the system prevents single-point failures. Even if some hosts fail or are compromised, the complete file can be reconstructed from remaining blocks on other hosts, thus mitigating data loss and hacking risks.
Solution Approach 2:
The patent implements redundant copying of file blocks before distribution. Each block is duplicated and stored on multiple hosts in advance, creating a cushion against potential data loss or security breaches. This prior cushioning ensures that the system can withstand host failures or attacks without losing the complete file.
3Reliability
If files are divided and distributed across multiple data hosts, then data security is improved, but data retrieval complexity increases
Solution Approach 1:
The patent employs a feedback mechanism where a collecting host receives a file-reading request, issues collecting requests to multiple data hosts, and aggregates the returned blocks. The system tracks which blocks have been retrieved and continues requesting blocks until the complete file is reassembled, providing automated feedback-driven retrieval that manages complexity.
Solution Approach 2:
The collecting host acts as an intermediary that coordinates between the user host and multiple data hosts. It manages the complex retrieval process by issuing requests, receiving blocks, and assembling the complete file, thereby shielding the user from the underlying complexity of distributed data retrieval.
4Productivity
If files are divided into blocks and distributed across multiple hosts, then search efficiency is improved, but system complexity increases
Solution Approach 1:
Dividing the file into blocks and distributing them across multiple hosts enables parallel search operations. When searching for specific content, the system can query multiple hosts simultaneously for relevant blocks, significantly improving search efficiency compared to sequential searching in a centralized system.
Solution Approach 2:
The patent stores redundant copies of file blocks across multiple hosts beyond the minimum required for reconstruction. This excessive action ensures that search operations can be performed in parallel across multiple hosts with available blocks, improving search efficiency while the redundancy provides a buffer against data loss.
Data Source
AI summary
A data distributing and accessing method for sharing a file via a network system includes steps of: dividing the file into a plurality of blocks; distributing the blocks in a plurality of data hosts interconnected via the network system; one of the data hosts receiving a file-reading request from a user host and issuing collecting requests to other data hosts to collect the blocks from the data hosts; and transferring the collected blocks from the data hosts to the user host to be combined into the file.