Storage Controller Metadata Bypass for Unallocated Data Units

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In data processing environments, existing storage systems lack efficient mechanisms for storage controllers to differentiate between allocated and unallocated data units within a storage volume, leading to unnecessary data processing and reduced efficiency during operations like volume-level copying.

Innovation Solution

Implementing data unit classification techniques that allow storage controllers to read metadata from storage unit data structures, classify data units as either allocated to data sets or unallocated, and selectively process only the allocated units containing client data or metadata, thereby bypassing unallocated or empty units.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all tracks allocated to a volume are copied during volume-level copying operations, then data loss prevention is ensured, but processing time and system resources are wasted on unallocated or empty tracks

Engineering Contradiction:
Improvedata loss preventionVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the storage volume into individual data unit entries, each with allocation status metadata. The storage controller processes each entry independently, identifying allocated versus unallocated units. This segmentation enables selective copying of only allocated data units, preventing waste of processing time on empty tracks while maintaining data loss prevention for all allocated units.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary classification of data units by reading metadata from the volume table of contents before executing the copying operation. This preliminary action identifies which tracks are allocated and contain data, allowing the system to prepare a filtered list of tracks to be copied, thereby avoiding unnecessary processing of unallocated tracks during the actual copying phase.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If volume-level copying operations process all tracks in a volume, then complete data protection is achieved, but system efficiency and processing speed are reduced

Engineering Contradiction:
Improvedata protection completenessVSAvoidsystem efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent extracts allocation status information from the volume table of contents metadata for each data unit entry. By taking out and utilizing this metadata, the system identifies and extracts only the allocated tracks that contain data, separating them from unallocated tracks. This extraction enables the copying operation to process only necessary data units, improving system efficiency while maintaining complete data protection for all allocated units.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of performing excessive action by copying all tracks in the volume, the patent applies partial action by copying only the subset of tracks that are allocated and contain data. This partial copying approach, guided by metadata classification, reduces processing overhead and improves productivity while ensuring complete data protection for all allocated units.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If metadata from the volume table of contents is made accessible to the storage controller, then selective data processing is enabled, but system complexity increases

Engineering Contradiction:
Improveselective data processing capabilityVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent makes the volume table of contents metadata structure universal by enabling the storage controller to read and interpret allocation status information directly from it. This multi-functional use of existing metadata, already present in the storage system, allows the controller to perform selective data processing without requiring separate classification structures, thereby improving productivity while minimizing increases in system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10168959B2Metadata-based bypassing in a controller
Publication Date: 2019.01.01 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10168959B2 patent drawing
  • US10168959B2 patent drawing
  • US10168959B2 patent drawing

AI summary

Provided are a computer program product, system, and method for data unit classification in accordance with one embodiment of the present description, in which in response to a data processing command, a storage controller classifies data units of a storage unit as either allocated to a data set or as unallocated to any data set. If allocated to a data set, the storage controller can further classify data set-allocated data units as either containing client data or metadata or as empty. In accordance with one aspect of the present description, the storage controller may bypass data processing of the data units which have not been allocated to any data set or otherwise do not contain client data or metadata. Other aspects of data unit classification in accordance with the present description are described.