Standardized Data Representation for Non-Snappable Sources
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data management systems (DMS) often fail to provide data protection and observation services for non-snappable data sources, particularly in nascent cloud environments, due to the significant time and effort required to establish snapshot support, leading to an increasing quantity of unprotected data sources.
Innovation Solution
The DMS is configured with an application that provides a widely-applicable mechanism for obtaining data from non-snappable sources and extends data observation techniques to these sources using a standardized data format, enabling non-snapshot data protection and observation services.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If snapshot support is established for non-snappable data sources, then data protection coverage is improved, but development time and engineering effort increase significantly
Solution Approach 1:
The patent creates a standardized data representation format that copies essential data characteristics from diverse non-snappable sources into a uniform structure. This allows the DMS to work with replicated data representations rather than developing source-specific snapshot mechanisms, significantly reducing development time while maintaining data protection capabilities
Solution Approach 2:
The patent segments the data protection process into two independent components: (1) data extraction and standardization layer that handles source-specific variations, and (2) universal data management layer that operates on standardized representations. This segmentation allows the core DMS to remain unchanged while supporting new data sources through standardized interfaces
2Reliability
If snapshot support is established for each new data source, then data protection capability is improved, but device complexity increases
Solution Approach 1:
The patent implements a universal standardized data representation format that can represent data from multiple different non-snappable sources using a single unified structure. This multi-functional approach allows the DMS to handle diverse data sources without requiring source-specific processing logic, thereby reducing system complexity
Solution Approach 2:
The patent introduces a standardized data representation format as an intermediary layer between diverse non-snappable data sources and the DMS core functionality. This intermediary translates various source formats into a universal structure, eliminating the need for complex source-specific integration code in the DMS
3Reliability
If snapshot support is established for additional data sources, then data protection scope is improved, but ease of manufacture deteriorates
Solution Approach 1:
The patent changes the fundamental parameter of data representation from source-specific binary formats to a standardized structured format with defined schemas. This parameter change enables automated parsing and processing, significantly improving ease of implementation when adding new data sources while expanding protection scope
Data Source
AI summary
Methods, systems, and devices for data management are described. One or more requests to apply data observation to one or more data sources may be received via an interface. Whether snapshots are supported for the one or more data sources may be determined. A first, snapshot-supported data source may be stored at a first data storage as a snapshot and a representation of the second, snapshot-unsupported data source may be stored at a second data storage. First data may be extracted from the snapshot and second data may be extracted from the representation of the second data source such that a first data observation procedure may be applied to the first data and a second data observation procedure may be applied to the second data. Results of the data observation procedures may be reported via an interface.