Consistency Group Snapshots Through Control-Plane Orchestration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems face inefficiencies and high costs due to the reliance on centralized storage arrays, which require extensive infrastructure, are prone to errors, and lack flexibility in managing distributed resources, leading to suboptimal performance and maintenance challenges.
Innovation Solution
A decentralized data storage system utilizing unexploited Direct Attached Storage (DAS) resources across multiple servers, managed by an orchestrator that orchestrates storage stack components and standard OS components, enabling efficient data management and redundancy without the need for a dedicated storage array.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If centralized storage arrays are used to provide data storage and backup capabilities, then data storage and management services can be provided, but extensive infrastructure and computing capacity are required, increasing cost and complexity
Solution Approach 1:
The patent segments the centralized storage array into distributed storage components across multiple servers. Each server manages its own storage locally (Direct Attached Storage), eliminating the need for a centralized storage array and its associated complex infrastructure. This segmentation reduces overall system complexity while maintaining data storage reliability through distribution.
Solution Approach 2:
The patent implements self-service by allowing each server to manage its own storage independently without requiring centralized storage array services. The servers autonomously handle storage operations, reducing the infrastructure needed for centralized management and lowering overall system complexity while maintaining reliable data storage capabilities.
2Ease of operation
If centralized storage arrays are used to provide storage services, then data management functions can be consolidated, but the system becomes more prone to errors and maintenance challenges
Solution Approach 1:
By segmenting storage management from centralized to distributed, the patent reduces the single point of failure and error propagation that occurs in centralized systems. Each server independently manages its storage, reducing system-wide error impact and improving reliability while maintaining ease of operation through local autonomy.
3Reliability
If dedicated storage array hardware is used, then storage services can be provided with specialized capabilities, but flexibility in managing distributed resources is reduced
Solution Approach 1:
The patent makes servers universal by enabling them to perform both compute and storage functions through Direct Attached Storage. This eliminates the need for dedicated storage array hardware, providing flexibility in managing distributed resources while maintaining storage service reliability through the universal capabilities of standard servers.
4Quantity of substance
If storage arrays use multiple drives in a collection, then large data storage capacity can be achieved, but significant computing capacity and metadata infrastructure are required
Solution Approach 1:
The patent segments the metadata management function from the storage capacity function. Each server independently manages its own storage metadata locally, eliminating the need for extensive centralized metadata infrastructure. This allows achieving large storage capacity through distributed drives while significantly reducing metadata infrastructure complexity.
Data Source
AI summary
A data storage method and system comprising: at least two servers that comprise a storage volume and configured to run an operating system designated to host data accessible and exposable over a data plane (DP) network, at least one orchestrator configured to interact with each of said servers and designated to control a control plane (CP) of said DP network, wherein each server is configured to manage its own DP components, wherein the orchestrator is configured to utilize the CP in order to take at least one consistency group snapshot, and further configured to manage an suspension and resumption in order to provide a consistent snapshotting of the volumes in a particular point in time.