Hard Disk Module Storage Layout for Distributed Resource Utilization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing distributed storage systems fail to fully utilize storage resources due to storage being performed at the granularity of storage nodes, leading to inefficiencies in resource and computing capacity utilization.
Innovation Solution
Storage is performed at the granularity of hard disk modules, where each module includes an interface module and a hard disk, allowing for communication with multiple storage nodes, thereby fully utilizing storage and computing resources.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored in a distributed manner across multiple storage devices, then data security and reliability are improved, but data access time and system complexity increase
Solution Approach 1:
The system pre-calculates and stores metadata information including data distribution locations, access paths, and security parameters before actual data access occurs. This preliminary preparation enables faster data retrieval while maintaining distributed storage security requirements.
Solution Approach 2:
A centralized management module acts as an intermediary between access requests and distributed storage devices. This module coordinates data access, manages security credentials, and optimizes retrieval paths, reducing the time penalty typically associated with distributed storage systems.
2Reliability
If data is encrypted and stored in distributed storage devices, then data security is improved, but data processing speed and system complexity increase
Solution Approach 1:
The system extracts encryption key management and security protocol handling from individual storage devices and centralizes them in a dedicated management module. This separation reduces the complexity burden on each storage device while maintaining overall system security.
Solution Approach 2:
The management module implements universal security protocols and encryption standards that work across all distributed storage devices. This multi-functional approach consolidates security management capabilities, reducing overall system complexity despite enhanced security requirements.
3Quantity of substance
If data is stored in distributed storage devices, then storage capacity is expanded, but data management complexity and access overhead increase
Solution Approach 1:
The management module implements feedback mechanisms that continuously monitor storage device status, capacity utilization, and access patterns. This feedback enables dynamic optimization of data distribution and access strategies, simplifying management of expanded storage capacities.
Solution Approach 2:
The system segments data management functions into distinct modules: metadata management, access control, data distribution, and monitoring. This segmentation makes managing large distributed storage systems more tractable by dividing complex management tasks into manageable components.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
This application discloses a data storage method, a data reading method, and an apparatus in a storage system, and the system, and belongs to the field of information technologies. The method includes: A first device generates N check units for M data units, where M and N are both positive integers, and M + N = K. The first device stores the K units in K hard disk modules in the storage system, where the K units include the M data units and the N check units. Each of the K hard disk modules stores one of the K units. Each hard disk module includes an interface module and a hard disk, and the interface module communicates with the hard disk. In this application, storage resources in the storage system can be fully utilized.