Mainframe Backup to Object Storage via Chunked Parallel Transmission
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mainframe computers face challenges in backing up data due to the limitations of traditional tape-based systems, including space requirements, slow data retrieval, manual handling, and the need for maintaining outdated tape drive technology, while object storage systems offer advantages like data replication and distribution that are not fully utilized.
Innovation Solution
A method and system for backing up mainframe data sets onto object storage systems by splitting data into chunks of predetermined size, using sender threads to transmit these chunks via an object storage API, and creating a mapping object for tracking, allowing for dynamic chunk size adjustment and parallel processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If tapes are used for storing large amounts of computer data, then data storage capacity is improved, but data retrieval speed deteriorates (takes minutes compared to milliseconds in disks)
Solution Approach 1:
The patent segments large data sets into smaller chunks that can be stored and retrieved more efficiently. By dividing the data storage into manageable segments, the system can retrieve specific portions faster without requiring sequential access through entire tape volumes, thus improving retrieval speed while maintaining storage capacity.
Solution Approach 2:
The patent replaces the mechanical tape drive system with an electronic data storage and retrieval system. By eliminating the need for physical tape movement and mechanical reel operations, the system achieves faster data access speeds comparable to disk systems while maintaining the cost-effectiveness and storage density of tape-based solutions.
2Use of energy by stationary object
If tapes are used for backup storage, then energy consumption is reduced (environmentally friendly), but physical space requirements increase
Solution Approach 1:
The patent transitions from two-dimensional tape storage to a multi-dimensional electronic storage architecture. By organizing data in hierarchical levels and utilizing cloud-based distributed storage, the system reduces local physical space requirements while maintaining energy efficiency through intelligent data placement and retrieval strategies.
3Reliability
If manual tape handling operations are performed, then data security is improved, but operational complexity increases
Solution Approach 1:
The patent implements automated backup and restoration processes that eliminate manual tape handling operations. The system automatically manages data segmentation, storage, retrieval, and restoration without requiring physical intervention, thereby reducing operational complexity while maintaining security through controlled access protocols and audit trails.
4Speed
If tape drive technology is upgraded, then data retrieval speed is improved, but system complexity and maintenance requirements increase
Solution Approach 1:
The patent replaces mechanical tape drive upgrades with an electronic storage architecture that achieves high retrieval speeds without complex mechanical components. By using software-based data management and electronic storage media, the system attains fast data access while minimizing maintenance requirements and system complexity.
Data Source
AI summary
Methods, system and computer program product for backup and restore mainframe data onto an object storage, the methods comprising a backup operation and a restore operation, the backup operation comprising: receiving a request for backing up a data set; splitting the data set into chunks, each chunk having a predetermined size; creating a mapping object; repeating for each chunk: allocating a sender thread to the chunk; transmitting using an object storage API, the chunk having the predetermined size as an object, to the object storage by the sender thread; and updating the mapping object with details of the chunk; subject to the data set being fully split and no more chunks to be transmitted, transmitting the mapping object to the object storage by the sender thread; and writing an identifier of the data set and meta data of the mapping object to a database.