Hierarchical Data Storage System Scalable Tape Library Management

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Tape-based data storage systems face inefficiencies due to the high time required for mounting and unmounting tape cartridges, leading to decreased tape drive utilization and increased data access waiting times, especially in large systems with multiple tape libraries where centralized management becomes unscalable.

Innovation Solution

A hierarchical data storage system is implemented, where global configuration information is stored and accessed efficiently across nodes and tape libraries, allowing for optimized migration and recall of data using a distributed approach with reverse-hierarchy mapping and inode-based routing, reducing the need for frequent cartridge mounts and improving resource management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If tape cartridges are frequently mounted and unmounted to access different data, then data accessibility is improved, but tape drive utilization decreases and access waiting time increases

Engineering Contradiction:

Improvedata accessibilityVSAvoidtape drive utilization

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

The system performs preliminary actions by pre-positioning tape cartridges in the tape library based on predicted access patterns and migration schedules. The configuration information stored in memory includes advance planning of cartridge movements, allowing the system to prepare cartridges before they are actually needed, thereby reducing frequent mount/unmount operations during actual data access.

Inventive Principle:

Principle #10Preliminary action

2Adaptability or versatility

If tape cartridges are mounted and unmounted frequently, then data access flexibility is improved, but system throughput decreases

Engineering Contradiction:

Improvedata access flexibilityVSAvoidsystem throughput

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

Inventive Principle:

Principle #10Preliminary action

3Ease of operation

If centralized management is used in large tape storage systems, then resource coordination is improved, but scalability decreases

Engineering Contradiction:

Improveresource coordinationVSAvoidsystem scalability

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The system segments the centralized management functionality by distributing configuration information storage to local memory at each node. Each node maintains its own configuration data about tape libraries and cartridges, eliminating the need for a single centralized management point while preserving coordination capabilities. This segmentation enables the system to scale to large configurations without overwhelming a central controller.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system transitions from a vertical centralized management hierarchy to a horizontal distributed architecture where configuration information is replicated across multiple nodes. This dimensional change allows any node to participate in management operations, improving both scalability and fault tolerance while maintaining resource coordination through shared configuration data.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

4Measurement precision

If repositioning within tape cartridge is performed, then data location accuracy is improved, but access time increases

Engineering Contradiction:

Improvedata location accuracyVSAvoidaccess time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary repositioning actions by using the stored configuration information to anticipate which data will be accessed next and pre-positioning the tape cartridge to the appropriate location. This allows the physical tape to be ready before the actual access request is processed, eliminating repositioning delays during critical data access operations.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS10162527B2Scalable and efficient access to and management of data and resources in a tiered data storage system

Publication Date: 2018.12.25 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

A system according to one embodiment includes a processor and logic integrated with and/or executable by the processor. The logic is configured to cause the processor to store hierarchically-organized global configuration information for each node and each tape library resource in a storage cluster to at least one memory accessible by each node of the storage cluster. The storage cluster includes at least one tape library. Also, the logic is configured to cause the processor to migrate data to and/or recall data from a tape cartridge pool within a tape library, using the hierarchically-organized global configuration information and via a node which has access to the tape cartridge pool, in response to receiving a migration and/or recall request at any node of the storage cluster. Other systems, methods, and computer program products for management of data and resources in a tiered data storage system are described in more embodiments.