Key Value Store Progress Verification for Storage Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems face challenges in efficiently managing changing data property values and storage system parameters in real-time, particularly in large-scale distributed storage systems, where maintaining accurate and timely information about storage capacity is crucial for effective storage allocation and management.
Innovation Solution
A novel log configuration and operations management system using a key data store with progress values to track and verify storage management processes, allowing for efficient calculation and reporting of storage properties without the limitations of existing solutions, including sharding and timestamp-based tracking to manage storage operations across multiple shards.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If a metadata database or key value store is used to provide scalable log storage, then storage capacity and scalability are improved, but processing overhead for property logging and calculation increases
Solution Approach 1:
The patent segments storage management processes into multiple independent processes (e.g., replication, garbage collection, compaction) that can execute in parallel. Each process maintains its own progress tracking mechanism, allowing them to operate concurrently without blocking each other, thus reducing processing overhead while maintaining accurate property logging in the scalable key-value store
2Measurement precision
If storage system parameters are updated in real-time, then accuracy and timeliness of information are improved, but system complexity and processing requirements increase
Solution Approach 1:
The patent implements feedback mechanisms where storage management processes continuously monitor and report their progress through timestamps and progress values. This feedback loop enables real-time tracking of process completion status, allowing the system to accurately reflect current storage capacity without requiring complex real-time calculations or updates, thus maintaining accuracy while managing complexity
3Productivity
If multiple storage management processes execute concurrently, then productivity and responsiveness are improved, but coordination complexity and potential conflicts increase
Solution Approach 1:
The patent introduces dynamic progress tracking where each storage management process maintains its own progress value and timestamp. This dynamic mechanism allows processes to independently track their state and coordinate implicitly through progress verification, eliminating the need for complex inter-process communication and coordination protocols while maintaining high productivity through concurrent execution
Data Source
AI summary
Example storage systems and methods provide data storage management using a key data store with progress values. A key data store includes a set of key data entries that each include a key value associated with a storage operation and a timestamp corresponding to a creation time of the key data entry. Storage management processes are executed on the set of key data entries and progress values for the storage management processes are tracked using the timestamps of the key data entries to manage the relative progress of the storage management processes.