Backup and Restore of Arbitrary Data Files
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional backup systems for secret or parameter stores cannot upload arbitrary data files from file systems for backup and restoration, limiting their ability to protect and restore critical data, especially in scenarios where full data protection solutions are prohibitive due to cost, complexity, or operational constraints.
Innovation Solution
A method and system for backing up and restoring data in object/key-value storage systems by compressing, splitting, encoding, and naming data files, using a parameter store that allows secure storage and retrieval of data files, including generating header files with identifying information and using hash-based naming to ensure data integrity and identification.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional backup systems store all data received for backup, then data availability is improved, but the ability to backup specific critical data files is lost
Solution Approach 1:
The backup system segments data into individual files and selectively backs up only critical files identified through scanning and classification mechanisms, rather than backing up all data indiscriminately. This allows the system to maintain reliability for critical data while reducing overall data volume managed.
Solution Approach 2:
The system extracts and identifies critical data files from the broader data set through scanning mechanisms, then extracts only these critical files for specialized backup handling. This separation allows selective backup of important data while ignoring less critical data.
2Reliability
If traditional data protection solutions are implemented, then data protection capability is improved, but cost and complexity increase
Solution Approach 1:
The parameter store serves multiple functions: it acts as a backup destination, a data classification system, an integrity verification mechanism through hashing, and a retrieval interface. This multi-functionality reduces the need for separate specialized systems, thereby reducing overall complexity while maintaining protection capability.
Solution Approach 2:
The system performs self-service through automated scanning, classification, and selection of critical files. The hashing and encoding mechanisms automatically verify integrity without manual intervention. This automation reduces operational complexity while maintaining robust protection.
3Productivity
If data files are stored without compression and encoding, then storage speed is improved, but data integrity and identification capability deteriorate
Solution Approach 1:
The system performs compression and encoding operations during the backup process itself, before data is stored in the parameter store. Hashing is calculated in advance to enable future integrity verification. These preliminary actions ensure data integrity is built into the storage process rather than added as a separate verification step.
Data Source
AI summary
A method, a system, and a computer program product for performing backup of data files in a parameter store. One or more data files in a plurality of data files are received for backup and storage in a parameter store. The data files are received from one or more file systems. One or more compressed data files corresponding to the received data files are generated. Using the compressed data files, one or more portions of the compressed data files are generated. The portions of the compressed data files are encoded by assigning a predetermined file name to each portion of the compressed data files. Each assigned predetermined file name has at least one common sequence of characters identifying the received data files. The encoded portions of the compressed data files are stored in the parameter store.