Data File Stubs for Middleware-Free Storage Migration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data management systems for migrating data from primary to secondary storage rely on stateful middleware, which introduces additional failure points, scalability issues, and high administration costs due to centralized management and staging processes.
Innovation Solution
A data management system utilizing virtual hierarchical storage management without stateful middleware, employing data file stubs with meta data for direct data transfer and centralized management with distributed execution, allowing seamless access and efficient movement between storage systems without intermediate failures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If stateful middleware is used for data migration, then data can be managed and migrated between storage systems, but system reliability decreases due to additional failure points and complexity increases
Solution Approach 1:
The patent extracts and eliminates the stateful middleware layer from the data migration architecture. By removing this intermediate layer, the system achieves direct data transfer between primary and secondary storage, thereby improving reliability by eliminating the associated failure points while maintaining data migration functionality through stub-based referencing mechanisms.
Solution Approach 2:
The patent uses data stubs as copies that reference actual data locations. These stubs store metadata about data files without requiring stateful middleware to manage the actual data transfer. The stubs themselves can be copied and moved independently, enabling data management without the reliability issues of stateful middleware.
2Adaptability or versatility
If stateful middleware is used for data migration, then data can be transferred between storage systems, but device complexity increases due to additional layers and processes
Solution Approach 1:
The patent removes the complex stateful middleware layer and replaces it with a simplified stub-based system. Stubs are simple data structures containing metadata about data files, eliminating the need for complex state management, session tracking, and intermediate processing layers while maintaining data transfer capability.
Solution Approach 2:
The patent introduces data stubs as simple intermediaries between data locations. These stubs act as lightweight references that point to actual data files without requiring complex middleware to manage the relationships. The stubs themselves are the intermediaries, not a complex system managing intermediaries.
3Adaptability or versatility
If centralized management with login models is used, then data can be managed across multiple systems, but ease of operation decreases due to high administration overhead
Solution Approach 1:
The patent implements self-service through distributed agents that autonomously manage data migration tasks. Each agent operates independently with its own stubs and metadata, eliminating the need for centralized login and management. The system manages itself through local stub references and direct data transfer, dramatically reducing administration overhead while maintaining multi-system capability.
4Adaptability or versatility
If staged data transfer processes are used, then data can be migrated safely, but loss of information increases due to potential failures in intermediate processes
Solution Approach 1:
The patent eliminates the staged intermediate transfer process by implementing direct data transfer from primary to secondary storage. Stubs are created before migration and updated after migration, removing the vulnerable intermediate staging area where data could be lost or corrupted while maintaining safety through stub-based tracking and verification.
Data Source
AI summary
A data management system for managing the storage of data on primary and secondary storage from a primary information source having original file content to be stored including: a data file stub stored on primary storage; a data file stored on secondary storage; and wherein: the data file stub comprises original file meta data and additional stub meta data relevant to the data file; the data file comprises the original file content and additional file meta data relevant to the data file stub; the additional stub meta data includes location and information relevant to locate and recover the data file; the additional file meta data includes information relevant to the location and content of the stub; the additional stub meta data and additional file meta data being so formed and arranged that the data to be stored may be accessed without stateful middleware.