Validity Map Tracking Overwritten Data Portions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In network computing and storage, tracking and managing multiple parts of data uploads and determining whether a data portion has been overwritten during archival processes are challenging, leading to potential inconsistencies and inefficiencies in data retrieval and storage.
Innovation Solution
A validity map is used to track whether a stored data portion has been overwritten by an overwriting data portion, employing a bitmap with bits indicating the status of each data portion, allowing for efficient storage and retrieval by distinguishing between valid and overwritten data in both authoritative and cache storage systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is archived in multiple parts with redundancy techniques, then data reliability is improved, but tracking and managing each part becomes more complex
Solution Approach 1:
The patent segments the tracking mechanism into two distinct components: a validity map that tracks whether each data part has been overwritten, and a parts map that tracks the physical location of each data part. This segmentation allows the system to independently manage overwrite status and location information, simplifying the overall tracking complexity while maintaining reliability across multiple data parts
Solution Approach 2:
The patent introduces intermediary data structures (validity map and parts map) that act as mediators between the raw data parts and the archival storage system. These intermediary structures absorb the complexity of tracking multiple data parts, providing a simplified interface for managing data reliability without requiring direct complex tracking of each individual data part
2Reliability
If the system checks whether data portions are overwritten before retrieval, then data integrity is improved, but retrieval time increases
Solution Approach 1:
The patent performs preliminary actions by maintaining validity map and parts map information in advance during data upload and overwrite operations. When a retrieval request occurs, the system has already prepared the tracking information, allowing it to quickly determine whether data parts have been overwritten without performing complex checks at retrieval time, thus preserving data integrity while minimizing retrieval time
3Speed
If the system stores data in both cache and authoritative storage, then data retrieval speed is improved, but consistency management becomes more difficult
Solution Approach 1:
The patent applies local quality by having different validity indicators for different storage locations. The validity map tracks overwrite status separately for cache storage and authoritative storage, allowing the system to optimize retrieval by checking the appropriate validity indicator for the specific storage location being accessed, thereby maintaining consistency while enabling fast retrieval from cache when applicable
Data Source
AI summary
A method and apparatus is disclosed for utilizing a validity map to indicate whether an overwriting data portion of user data is received. In the method and apparatus, a plurality of data portions of user data are received, whereby each data portion of the plurality of data portion may overwrite another data portion. A validity map may be utilized to indicate whether a data portion is an overwriting data portion. The validity map may be utilized for retrieving the data portion instead of the data portion being replaced.