HSM File Migration via Application-Specific Timeout Tables

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In hierarchical storage systems, files recalled by asynchronous copy operations are not migrated back to secondary storage promptly, leading to increased access frequency and potential storage capacity issues, as existing methods do not differentiate between file migrations triggered by asynchronous copy and other applications.

Innovation Solution

A method that uses a timeout table to manage user IDs and elapsed times to re-migrate files recalled by asynchronous copy operations as soon as possible, by setting specific timeout values for each user ID and resetting timers upon access, ensuring timely migration without affecting files accessed by other applications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If files are recalled from secondary storage to primary storage, then file accessibility is improved, but storage capacity efficiency deteriorates due to increased primary storage usage

Engineering Contradiction:
Improvefile accessibilityVSAvoidprimary storage capacity
Core Design Contradiction:
SpeedVSVolume of stationary object

Solution Approach 1:

The patent implements dynamic migration timing based on application behavior patterns. Files are not immediately migrated back to secondary storage upon recall, but rather after detecting that the specific application has finished accessing them. This dynamic approach optimizes the balance between file accessibility and storage capacity efficiency by keeping files in primary storage only as long as needed.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system monitors application access patterns and uses this feedback to determine migration timing. By tracking whether a specific application has completed its access to recalled files, the system makes informed decisions about when to migrate files back to secondary storage, thereby optimizing storage resource utilization.

Inventive Principle:
Principle #23Feedback

2Volume of stationary object

If files recalled by asynchronous copy are immediately migrated back to secondary storage, then storage capacity efficiency is improved, but file accessibility deteriorates during the migration process

Engineering Contradiction:
Improvesecondary storage capacity utilizationVSAvoidfile accessibility during migration
Core Design Contradiction:
Volume of stationary objectVSSpeed

Solution Approach 1:

The system performs preliminary monitoring of application access behavior before initiating migration. By detecting that the specific application has already finished accessing the file, the system ensures that migration occurs at the optimal moment when immediate re-access is unlikely, thus maintaining storage efficiency without compromising accessibility.

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If all recalled files are treated uniformly for migration, then system complexity is reduced, but storage optimization deteriorates due to inability to differentiate access patterns

Engineering Contradiction:
Improvemigration management complexityVSAvoidstorage capacity efficiency
Core Design Contradiction:
Device complexityVSVolume of stationary object

Solution Approach 1:

The patent applies different migration strategies based on the specific application's access patterns. Files accessed by specific applications are monitored and migrated based on that application's behavior, while other files follow different rules. This localized approach optimizes storage capacity efficiency by tailoring migration timing to actual access needs.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system changes the migration parameter (timing) based on the application identity. By identifying specific applications and adjusting migration behavior accordingly, the system achieves better storage optimization without requiring fundamentally different migration mechanisms, thus balancing complexity and efficiency.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10013206B2Automated migration of file recalled by specific application
Publication Date: 2018.07.03 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10013206B2 patent drawing
  • US10013206B2 patent drawing
  • US10013206B2 patent drawing

AI summary

In a hierarchical storage memory (HSM), a file recalled by a specific application is migrated as soon as possible after completion of the application process. Specifically, the effective UID of a specific process is preregistered on an HSM client. After a recall operation is performed on a certain file from the user ID, when there is no access from the UID to the file for a given length of time, the file is migrated. This prevents files premigrated by access from any application other than the specific one from being handled in the same way, resolving a disadvantageous problem caused when these (premigrated) files are not desired to be migrated preferentially.