Partial File Storage Segmentation for Cloud Resource Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current cloud storage systems inefficiently manage large files, leading to unnecessary resource consumption due to lack of effective storage technologies for balancing access and storage, particularly for files with varying access frequencies.
Innovation Solution
Implementing a storage service that divides large files into rapid access and slow access portions, where the rapid access portion is stored in a high-speed storage system and the slow access portion is stored in a low-speed storage system, allowing for efficient retrieval and resource conservation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If large files are stored entirely in rapid access storage systems, then delivery speed is improved, but storage resource consumption increases
Solution Approach 1:
The patent divides large files into segments based on access frequency: hot data (frequently accessed) is stored in rapid access storage systems while cold data (seldom accessed) is stored in slow access storage systems. This segmentation allows the system to optimize both delivery speed for frequently accessed portions and resource consumption for rarely accessed portions.
Solution Approach 2:
Different portions of the same file are stored with different quality characteristics - the hot data portion is stored in high-performance rapid access storage for fast delivery, while the cold data portion is stored in lower-performance slow access storage for resource efficiency. This local quality differentiation resolves the contradiction between speed and resource consumption.
2Quantity of substance
If large files are stored entirely in slow access storage systems, then storage resource consumption is reduced, but delivery speed deteriorates
Solution Approach 1:
By segmenting files into hot and cold data portions, the system ensures that only the necessary hot data portion is stored in rapid access storage, minimizing resource consumption while maintaining adequate delivery speed for the critical portions that need fast access.
Solution Approach 2:
The system applies partial action by storing only the hot data portion in rapid access storage rather than the entire file, which is sufficient to maintain delivery speed for frequently accessed content while avoiding the excessive resource consumption that would result from storing the complete file in fast storage.
3Reliability
If cloud storage providers allocate sufficient rapid access storage resources for all large files, then access performance is improved, but system complexity increases
Solution Approach 1:
The system automatically segments files based on access patterns, eliminating the need for manual configuration or complex resource allocation policies. This automated segmentation simplifies system management while maintaining consistent access performance for hot data.
Solution Approach 2:
The storage system performs self-service by automatically analyzing access patterns and routing data to appropriate storage tiers without requiring external intervention or complex management overhead. This self-service capability reduces system complexity while maintaining access performance.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Variety of approaches to provide partial storage of large files in distinct storage systems are described. A storage service initiates operations to provide storage of large files by determining a rapid access portion and a slow access portion of a file. The rapid access portion of the file is stored in a rapid access storage system and the slow access portion of the file (or an entirety of the file) is stored in a slow access storage system. In response to an access request to the file, the rapid access portion of the file is provided from the rapid access storage system. Next, the slow access portion of the file is retrieved from the slow access storage system to be provided while providing the rapid access portion of the file.