Variable Instance Data Object Storage for Secondary Media
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data protection techniques that store only a single instance of data objects in secondary storage can lead to unrecoverable data if the media fails, and recovering multiple copies from tape can be slow and difficult, posing risks to data integrity and accessibility.
Innovation Solution
A system and method for storing a variable number of instances of data objects in secondary storage, allowing for 1 to N-1 instances to be stored, using a secondary storage computing device that determines the number of instances based on storage policies and existing instances, ensuring data redundancy and efficient storage use.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If single instance storage techniques are used to minimize storage space, then storage efficiency is improved, but data recovery reliability deteriorates because a single media failure can cause complete data loss
Solution Approach 1:
The patent applies local quality by making the storage system heterogeneous: frequently accessed unique data objects are stored as single instances on high-performance storage media, while non-unique data objects are stored with multiple copies on redundant media. This local differentiation optimizes both storage efficiency and data recovery reliability based on the specific characteristics of each data object.
Solution Approach 2:
The system dynamically determines the number of instances to store for each data object based on uniqueness analysis, access frequency, and storage policy. The storage system adapts its redundancy level for different data objects rather than applying a static redundancy policy, allowing optimal balance between storage efficiency and recovery reliability.
2Reliability
If multiple copies of data objects are stored on tape to mitigate data loss risk, then data recovery reliability is improved, but recovery speed deteriorates due to slow tape access
Solution Approach 1:
The patent segments the storage system into multiple tiers: fast-access storage for single-instance unique data objects and tape storage for redundant copies of non-unique data objects. This segmentation allows the system to provide both high recovery speed for critical data and high recovery reliability through redundant copies, avoiding the need to retrieve all copies from slow tape media.
3Reliability
If conventional data protection techniques store N instances of each data object in secondary copy, then data recovery reliability is improved, but storage efficiency deteriorates because secondary copies are as large as primary data
Solution Approach 1:
The patent extracts the redundancy requirement from the overall storage system and applies it selectively only to non-unique data objects. By taking out the redundancy need from unique data objects and applying it only where necessary for non-unique objects, the system achieves data recovery reliability while minimizing storage space consumption in secondary copies.
Data Source
AI summary
Described are systems and methods for storing a variable number of instances of data objects (e.g., 1, 2, 3, or up to N−1 instances, where N is the number of instances of the data object included in primary data) in secondary storage across a data storage network. In some examples, a system for storing a variable number of instances of data objects includes, one or more computing devices storing a set of data objects and multiple storage devices distinct from the one or more computing devices. Each of the multiple storage devices is configured to store at least a single instance of a data object. The system also includes a database configured to store information associated with the data objects. This information includes substantially unique identifiers for the data objects and, for each of the data objects, a number of instances of the data object stored on the multiple storage devices.