Data Backup for Ephemeral Storage Shutdown
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud-based data storage systems using ephemeral storage resources face data loss when shut down, as these resources are non-persistent and not saved during instance termination, leading to costs associated with high-performance storage devices being underutilized.
Innovation Solution
A method and system for managing data on shutdown of a data storage system by storing configuration data and backing up data associated with non-persistent logical storage resources to a backup storage system, allowing for data restoration upon system restart, thereby enabling temporary shutdown without data loss and reducing costs by utilizing cheaper storage resources during inactive periods.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If ephemeral storage resources are used to reduce costs during inactive periods, then storage costs are reduced, but data is lost when the system is shut down
Solution Approach 1:
The system performs preliminary actions by storing configuration data and initiating data backup processes before the shutdown occurs. This ensures that data is preserved in advance, allowing the system to shut down and use cheaper storage resources without risking data loss.
Solution Approach 2:
The system creates copies of data from ephemeral storage resources and stores them in persistent backup storage. This copying mechanism allows the original data to be preserved even when the ephemeral storage is cleared during shutdown, enabling cost optimization without data loss.
2Reliability
If configuration data is stored to enable system restart, then data availability is improved, but system complexity increases
Solution Approach 1:
The system extracts configuration data and unique identifiers from the complex virtual storage layer and stores them separately in a simplified manner. This extraction approach maintains data availability while reducing the complexity of the restart process by separating critical information from the overall system state.
3Reliability
If data backup process is implemented to preserve data, then data integrity is improved, but processing time increases
Solution Approach 1:
The backup process is initiated as a preliminary action during the shutdown sequence, utilizing idle time when the system is transitioning to inactive state. This approach preserves data integrity while minimizing the impact on operational time, as the backup occurs during the inevitable shutdown period.
Data Source
AI summary
Techniques are provided to manage data on shutdown of a data storage system. For example, a method comprises initiating a process to shut down a data storage system which comprises storage devices that store data associated with one or more non-persistent logical storage resources of a virtual storage layer which is configured by the data storage system. In response to initiating the process to shut down the data storage system, the method comprises: storing configuration data associated with the virtual storage layer, the configuration data comprising unique identifiers associated with the one or more non-persistent logical storage resources; and performing a data backup process to persistently store a copy of the data associated with the one or more non-persistent logical storage resources to a backup storage system.