Hierarchical Storage System for Latency and Cost Trade-offs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current storage systems, particularly hard disk storage, face latency issues in delivering multimedia content, while solid-state disks are costly for storing large amounts of data, necessitating a more efficient hierarchical storage solution.
Innovation Solution
A hierarchical storage system comprising solid-state disks, hard disks, and tape storage, where contents are classified based on inquiry frequency and transmission rate, with a distribution and buffering policy to dynamically store, retrieve, and manage data across these storage types, optimizing access speed and cost-effectiveness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If hard disk storage is used to store massive contents, then storage capacity is improved, but access speed deteriorates due to latency
Solution Approach 1:
The storage system is segmented into multiple hierarchical levels: solid state disks for high-speed access, hard disks for bulk storage, and tape storage for archival. This segmentation allows different types of storage media to be used for different purposes, resolving the contradiction between capacity and access speed by providing fast access for frequently accessed data while maintaining large capacity for bulk storage.
Solution Approach 2:
The system adds a hierarchical dimension to storage architecture, organizing storage media by performance and cost characteristics. This dimensional organization creates a multi-layered storage hierarchy where data can be placed at different levels based on access requirements, thereby achieving both high capacity and acceptable access speeds through strategic data placement.
2Speed
If solid state disk is used to reduce access latency, then access speed is improved, but storage cost deteriorates due to high cost
Solution Approach 1:
Different storage media with different quality characteristics are assigned to different locations in the hierarchy. Solid state disks provide high-speed local quality for frequently accessed data, while hard disks and tape storage provide cost-effective quality for less frequently accessed data. This local quality differentiation resolves the contradiction by providing high performance only where needed rather than uniformly across all storage.
Solution Approach 2:
The system changes the parameters of storage media selection based on data characteristics and access patterns. By dynamically adjusting which storage medium is used for which data based on parameters like access frequency and performance requirements, the system achieves optimal balance between speed and cost, avoiding the need to use expensive solid state disks for all data.
3Productivity
If contents are distributed across multiple storage types, then access efficiency is improved, but system complexity deteriorates
Solution Approach 1:
The control server is designed with multi-functionality to handle diverse storage operations across different media types. It can classify data, determine optimal storage locations, manage data transfer between hierarchy levels, and retrieve data from any storage medium. This universal control mechanism simplifies the overall system complexity by providing a single intelligent controller that manages all the complexity rather than requiring complex coordination between multiple independent systems.
Data Source
AI summary
Provided is a method of distributedly storing an individual content in a hierarchical storage system including a solid state storage having a plurality of solid state disks, a hard disk storage having a plurality of hard disks, and a tape storage. The method may include determining a target content to store and an inquiry frequency and a required minimum transmission rate of the target content upon receipt of a request message from a client device, classifying the target content as at least one of a low demanded content, a normal demanded content, a high demanded content, a low transmission rate content, a normal transmission rate content, and a high transmission rate content based on the inquiry frequency and the required minimum transmission rate of the target content, and distributedly storing the target content through at least one of the solid state storage, the hard disk storage, and the tape storage based on the classification result and a distribution and buffering policy.