Secret Sharing Storage for Small-File Compression and Fragment Distribution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In secret sharing storage systems, storing small-capacity files results in surplus sectors due to fragment files being smaller than sector size, leading to increased disk usage.
Innovation Solution
Compress multiple files into one file at a predetermined compression rate before uploading to a secret sharing storage, then divide and distribute the compressed file into fragment files across multiple servers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If small-capacity files are stored directly in secret sharing storage, then data security is maintained, but disk usage increases due to surplus sectors
Solution Approach 1:
The system performs preliminary compression on multiple small files before they are uploaded to the secret sharing storage. By compressing files in advance on the client side, the system reduces the total data volume that needs to be fragmented and stored, thereby minimizing the surplus sector problem while maintaining data security through subsequent secret sharing encryption
Solution Approach 2:
The system merges multiple small-capacity files into a single compressed file before storage. This consolidation approach allows the data to be fragmented into fewer, larger fragment files that better utilize disk sectors, reducing the surplus space wasted when fragment files are smaller than sector size
2Manufacturing precision
If multiple small files are uploaded individually to secret sharing storage, then file integrity is maintained, but storage efficiency decreases due to sector surplus
Solution Approach 1:
The system performs preliminary compression on multiple small files before they are uploaded to the secret sharing storage. By compressing files in advance on the client side, the system reduces the total data volume that needs to be fragmented and stored, thereby minimizing the surplus sector problem while maintaining data security through subsequent secret sharing encryption
Solution Approach 2:
The system merges multiple small-capacity files into a single compressed file before storage. This consolidation approach allows the data to be fragmented into fewer, larger fragment files that better utilize disk sectors, reducing the surplus space wasted when fragment files are smaller than sector size
Data Source
AI summary
A processing system includes: a client that uploads a file to be stored; and a secret sharing storage that stores fragment files obtained by dividing the uploaded file in a distributed manner across a plurality of storage servers, in which the client includes a backup unit that compresses a plurality of files to be stored into one file at a predetermined compression rate and then uploads the compressed file, and the secret sharing storage includes: the plurality of storage servers; and a distribution server that encrypts the compressed file, and then divides the compressed file into fragment files and stores the fragment files in a distributed manner across the plurality of storage servers.


