Storage Layout Metadata Refresh for Shared-Controller I/O
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data storage architectures with a one-to-one controller arrangement face challenges in scalability, redundancy, and efficiency due to the need for hardware upgrades, increased costs, and single-point failures, limiting compute power and parallelization of input/output operations.
Innovation Solution
Implementing a shared-everything architecture with multiple controllers accessing a unified storage pool, allowing dynamic updates to configuration layout metadata through locking and unlocking mechanisms to manage storage device changes, ensuring consistent I/O operations across controllers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a one-to-one controller architecture is used where each controller accesses a specific subset of storage devices, then the system structure is simple and easy to manage, but scalability is limited and hardware upgrades require adding or replacing associated storage devices which increases cost and time
Solution Approach 1:
The patent implements a shared-everything architecture where any controller can access any storage device in the environment, breaking the one-to-one mapping constraint. This universal access model allows controllers to function across multiple storage subsets, enabling seamless scalability and hardware replacement without the limitations of dedicated controller-storage pairings
2Productivity
If a one-to-one controller architecture is used, then the controller manages its dedicated storage devices efficiently, but compute power and I/O efficiency are limited because operations cannot be parallelized among multiple controllers
Solution Approach 1:
The patent merges the access rights of multiple controllers to the same storage devices by implementing a shared-everything architecture. This allows multiple controllers to simultaneously access and operate on the same storage resources, enabling parallelization of I/O operations and significantly improving overall system throughput and compute power utilization
3Reliability
If redundancy groups with parity disks are implemented in a one-to-one architecture, then redundancy is improved, but when a controller or associated storage device fails, the entire portion of the data storage environment becomes unavailable until recovery operations are performed
Solution Approach 1:
The patent introduces a metadata-driven intermediary layer that decouples controller failure from storage unavailability. When a controller fails, other controllers can continue accessing storage devices by retrieving updated layout metadata from the storage devices themselves, enabling failover and maintaining system availability while preserving redundancy benefits
4Reliability
If storage devices are organized into redundancy groups with shared metadata in a one-to-one architecture, then redundancy is provided, but the storage devices of a given group still fail together when issues occur due to single controller scheme dependency
Solution Approach 1:
The patent segments the metadata management function from the controller and distributes it across multiple controllers in the shared-everything architecture. This segmentation breaks the single point of failure, allowing individual controllers to fail while others continue managing storage devices independently, thereby reducing correlated failures within redundancy groups
Data Source
AI summary
The disclosure describes systems, devices, and methods for managing data storage environments. In an example implementation, a method of operating a controller in a data storage environment is provided. In performing the method, the controller identifies a change to a layout of drives in the data storage environment, and in response to identifying the change, takes a lock on instances of layout metadata stored on the drives. The controller then updates the instances of the layout metadata to reflect the change to the layout and releases the lock.