Storage Scanning via Shared Data Unit Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional scanning tools in storage systems are inefficient due to scanning shared data units multiple times, as they lack visibility into the underlying space-reduced data structure, leading to redundant scanning operations.
Innovation Solution
Providing information about shared data units to scanning tools, allowing them to operate more efficiently by scanning shared data units only once and prioritizing them over unshared units, thereby optimizing the scanning process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If scanning tools examine data in logical objects without visibility into underlying data units, then scanning operation is simple to implement, but scanning efficiency deteriorates due to redundant scanning of shared data units
Solution Approach 1:
The patent introduces an intermediary mechanism (mapping layer or metadata structure) that bridges the scanning tool and the underlying data units. This intermediary provides scanning tools with visibility into shared data units through mapping relationships, enabling efficient scanning without direct complexity of managing low-level storage structures. The mapping layer abstracts the complexity while enabling optimized scanning operations.
Solution Approach 2:
The patent performs preliminary actions by pre-establishing mapping relationships between logical objects and their underlying data units before scanning operations. This preliminary mapping information is made available to scanning tools, allowing them to understand which data units are shared and scan them only once, rather than scanning the same data multiple times through different logical objects.
2Loss of time
If scanning tools scan all data units without knowing sharing relationships, then scanning implementation is straightforward, but time is wasted due to repeated scanning of identical data units
Solution Approach 1:
The mapping layer serves as an intermediary that provides scanning tools with knowledge of data sharing relationships without exposing the full complexity of the underlying data structure. This intermediary enables time-saving by allowing scanning tools to identify and skip already-scanned shared data units while maintaining a relatively simple scanning interface.
Solution Approach 2:
The patent implements feedback mechanisms where scanning tools receive information about which data units have already been scanned and their sharing relationships. This feedback allows the scanning tool to avoid redundant scanning operations, significantly reducing scanning time while the feedback infrastructure manages the complexity of tracking shared data units.
3Productivity
If redundant data elimination is implemented transparently, then storage space is reduced, but scanning tools cannot access sharing information to optimize their operations
Solution Approach 1:
The mapping layer acts as an intermediary that preserves the transparency of redundant data elimination while providing scanning tools with the necessary information about data sharing. This intermediary enables scanning tools to adapt to the RDE structure by providing mapping relationships that show which data units are shared, allowing optimized scanning without breaking the transparency of the RDE system.
Solution Approach 2:
The mapping layer provides multi-functionality by serving both the redundant data elimination system and the scanning tools. It maintains the transparency required for RDE while simultaneously providing the sharing information needed for optimized scanning. This universal structure allows the same mapping infrastructure to support both data reduction and efficient scanning operations.
Data Source
AI summary
Embodiments are directed to methods and apparatus for making available to at least one scanning tool, information about at least one data unit shared among multiple storage objects of a plurality of storage objects stored on a storage system. The at least one scanning tool can use the information to influence at least one scanning operation on the at least some of the plurality of storage objects. Embodiments may be implemented in a computer system comprising at least one application program, at least one mapping layer that makes available to the at least one application program a plurality of storage objects, and a storage system that stores data in each of the plurality of storage objects in one or more data units. The at least one computer system further comprises the at least one scanning tool that performs the at least one scanning operation on at least some of the plurality of storage objects, and at least one redundant data elimination tool that eliminates at least some redundant data by sharing at least one of the data units among multiple storage objects.