File Storage and Retrieval via Compressed Archive Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Large-scale data storage systems often provide rapid access and retrieval, which is not necessary in all applications, leading to potential cost savings in scenarios where data access is infrequent, such as in the medical industry for storing images and videos associated with patient records.
Innovation Solution
A system that compresses files into archives with generated indices for efficient storage and retrieval, allowing for adjustable archive sizes to balance storage costs and retrieval time, enabling files to be stored in a smaller footprint with acceptable retrieval times.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If files are stored in compressed archives, then storage costs are reduced, but retrieval time increases
Solution Approach 1:
The patent divides files into multiple segments and stores them in a distributed file system. Each segment can be independently retrieved and reassembled, allowing parallel processing and reducing overall retrieval time while maintaining compression efficiency.
Solution Approach 2:
The system pre-generates and stores metadata about file segments, including their locations and checksums. This preliminary organization allows the retrieval process to quickly locate and access required segments without scanning the entire compressed archive, significantly reducing retrieval time.
2Speed
If rapid access is provided in storage systems, then retrieval speed is improved, but storage costs increase
Solution Approach 1:
The patent implements different storage strategies for different data characteristics. Frequently accessed files are stored with less compression or in faster storage media, while infrequently accessed files use higher compression ratios. This localized optimization balances retrieval speed and storage efficiency based on actual access patterns.
Solution Approach 2:
The system dynamically adjusts compression parameters and storage allocation based on file access patterns. Files that are accessed frequently have their compression level reduced or are replicated across multiple nodes for faster access, while rarely accessed files maintain high compression. This adaptive parameter adjustment resolves the contradiction between speed and storage efficiency.
3Quantity of substance
If files are compressed into smaller archives, then storage efficiency is improved, but system complexity increases
Solution Approach 1:
The patent implements automated metadata generation and segment tracking systems that self-manage the compression and organization process. The system automatically generates checksums, tracks segment locations, and manages decompression without requiring manual intervention, reducing the operational complexity despite the technical sophistication of the compression system.
Data Source
AI summary
The present invention relates to a system and method configured to store and retrieve files and, specifically, to a system and method for encoding files, such as image files or video files, into compressed archive and then later retrieving the files from the compressed archive in response to user requests.