Instance Catalog Mediator for Virtual Storage Operations
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current storage systems for virtual computing instances (VCIs) face inefficiencies in data management, particularly in performing operations on large datasets, as they often require direct access to extensive data structures, leading to increased operation times and complexities in managing versions and ownership.
Innovation Solution
The proposed solution involves a storage system architecture that utilizes packfiles, instance catalogs, streams, and packfile indexes, allowing operations to be performed indirectly by modifying metadata in the instance catalog, which reduces operation time and enhances data management by providing immutable object support and efficient ownership management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If direct access to extensive data structures is used for data operations, then data management capability is maintained, but operation time increases and complexity increases
Solution Approach 1:
The patent introduces an instance catalog as an intermediary data structure between the storage system and the data structures. Instead of directly accessing extensive data structures, operations are performed on the instance catalog which contains references and metadata about the data. This mediator approach reduces operation time by avoiding direct traversal of large data structures while maintaining the necessary data management capabilities through the catalog's indexing and reference mechanisms.
2Ease of operation
If direct access to data structures is used, then data operations can be performed, but managing versions and ownership becomes complex
Solution Approach 1:
The patent segments the data management functionality by separating version information and ownership metadata from the main data structures. The instance catalog is divided into distinct sections that track versions, ownership, and access rights independently. This segmentation allows versioning and ownership management to be handled through simple catalog updates rather than complex data structure manipulations, making the system easier to operate while reducing overall complexity.
3Reliability
If immutable object support is provided, then data management is improved, but direct access to packfiles is restricted
Solution Approach 1:
The instance catalog serves as an intermediary layer that provides reliable data management through immutable object support while maintaining ease of operation. The catalog stores references to packfiles and tracks version history, allowing users to access data through the catalog's simplified interface rather than directly accessing the packfile structure. This intermediary approach ensures data integrity through immutability while keeping the user interface simple and easy to operate.
Data Source
AI summary
The present disclosure is related to methods, systems, and machine-readable media for modifying an instance catalog to perform operation. A storage system can include a plurality of packfiles that store data. The storage system can include a plurality of streams that include a plurality of hashes that identify the plurality of packfiles. The storage system can include an instance catalog that includes an identification of the plurality of streams. The storage system can include an operation engine to perform a number of operations on the plurality of packfiles by modifying the instance catalog using the identification of the plurality of streams.