File-Level Array Storage Controller for Distributed Data Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Centralized data storage in distributed systems is complex and costly for enterprises, requiring extensive maintenance and recovery processes, especially for file and installation failures, which can be burdensome and inefficient.
Innovation Solution
A processor-based storage controller with file-level array storage logic that logically containerizes data across virtual storage containers and migrates units to physical devices, using rotating parity for redundancy, allowing for efficient data management and recovery without requiring extensive enterprise involvement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If centralized data storage is used in distributed systems, then data management control is centralized and consistent, but system complexity and maintenance cost increase significantly
Solution Approach 1:
The patent introduces a storage controller as an intermediary component between the host system and physical storage devices. The controller abstracts storage management functions, handling data distribution, parity calculation, and device coordination centrally within the storage subsystem rather than requiring enterprise-level system complexity. This mediator approach maintains centralized control for reliability while isolating complexity to the storage controller layer.
Solution Approach 2:
The storage controller implements self-service capabilities by automatically performing data distribution across multiple devices, calculating and managing parity information for fault tolerance, and coordinating recovery operations. The system monitors its own health status and initiates recovery procedures without requiring external enterprise intervention, thereby reducing maintenance burden while maintaining centralized control.
2Reliability
If extensive maintenance and recovery processes are implemented for storage failures, then data protection is improved, but operational burden and time requirements increase
Solution Approach 1:
The patent implements preliminary action by pre-distributing data across multiple storage devices and pre-calculating parity information before failures occur. The storage controller continuously maintains redundant data copies and parity information in ready states, so when failures happen, recovery can immediately begin using the pre-positioned redundant data without requiring time-consuming data reconstruction or manual intervention.
Solution Approach 2:
The storage controller automatically detects storage device failures and initiates recovery procedures without requiring enterprise owner participation. The system self-monitors device health, identifies failures, and autonomously reconstructs lost data using parity information and remaining healthy devices, significantly reducing both the operational burden and time required for recovery compared to manual processes.
3Adaptability or versatility
If data is stored on removable physical storage devices, then storage flexibility and portability are improved, but data security and protection from device failure become more challenging
Solution Approach 1:
The patent applies segmentation by dividing data into multiple segments and distributing them across several removable storage devices. Each device stores only a portion of the total data along with relevant parity information. This segmentation approach maintains the flexibility of removable devices while enhancing protection, because the loss or failure of any single device does not result in complete data loss - the controller can reconstruct the full dataset from remaining segments and parity information.
Solution Approach 2:
The patent implements local quality by placing different types of data with different protection requirements on different storage devices. Critical data segments are distributed across multiple devices with redundant parity information, while less critical data may be stored with different redundancy levels. The storage controller applies differentiated protection strategies locally to different data segments and devices, optimizing both flexibility and reliability according to specific data requirements.
Data Source
AI summary
An apparatus and associated methodology contemplating an apparatus having a processor-based storage controller. A nontransient, tangible computer memory is configured to store a data file. Computer instructions are stored in the computer memory defining file-level array storage logic that is configured to be executed by the controller to logically containerize the data file in a file-level data set across a plurality of virtual storage containers, and to concurrently flush the virtual storage containers by migrating units of the file-level data set to a plurality of physical storage devices.