Storage Chunk Reclamation via Metadata Version Comparison

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing storage systems face inefficiencies in managing chunks and objects due to complex operational processes that can lead to incorrect reclamation of chunks still referenced by objects, resulting in reduced efficiency and reliability.

Innovation Solution

A method that compares metadata versions directly to determine differences and manage chunks based on these differences, eliminating the need to check consistency between journals and metadata caches, thereby streamlining the reclamation process.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If complex operational processes are used to manage chunks and objects, then comprehensive control is achieved, but the risk of incorrect reclamation increases and efficiency decreases

Engineering Contradiction:
Improvechunk reclamation accuracyVSAvoidoperational process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the essential information needed for chunk reclamation decision-making by directly comparing metadata versions. Instead of using complex multi-step operational processes, the solution isolates the critical difference determination between metadata versions, removing unnecessary intermediate steps and reducing operational complexity while maintaining reclamation accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent inverts the traditional approach by directly comparing metadata versions to determine chunk reclamation, rather than following complex operational processes. This inversion simplifies the workflow by starting with the end goal (determining reclamation needs) and working backward through direct metadata comparison, eliminating the need for intricate intermediate operational steps.

Inventive Principle:
Principle #13The other way round (Inversion)

2Reliability

If comprehensive checks are performed between journals and metadata caches, then consistency is ensured, but processing overhead increases and efficiency decreases

Engineering Contradiction:
Improvedata consistencyVSAvoidreclamation processing efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent applies preliminary action by directly comparing metadata versions before initiating reclamation processes. This approach ensures consistency is checked upfront through version comparison, eliminating the need for subsequent comprehensive consistency checks between journals and metadata caches, thereby improving processing efficiency while maintaining data integrity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses partial action by performing only the essential metadata version comparison needed for reclamation decisions, rather than executing exhaustive consistency checks across all journal and metadata cache contents. This selective approach maintains necessary data consistency while significantly reducing processing overhead and improving reclamation efficiency.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If traditional chunk management methods are used, then existing systems are maintained, but resource allocation efficiency decreases

Engineering Contradiction:
Improveresource allocation efficiencyVSAvoidcompatibility with existing systems
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent applies universality by designing a metadata version comparison mechanism that can be integrated into existing storage systems while improving resource allocation efficiency. The solution maintains compatibility with existing chunk management frameworks through standardized metadata interfaces, allowing the system to serve multiple functions: maintaining legacy system compatibility while implementing efficient version-based reclamation for improved resource allocation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11093389B2Method, apparatus, and computer program product for managing storage system
Publication Date: 2021.08.17 EMC IP HLDG CO LLC
  • US11093389B2 patent drawing
  • US11093389B2 patent drawing
  • US11093389B2 patent drawing

AI summary

Storage system management is provided. Metadata in a first version at a first time point of the storage system is obtained, here the metadata in the first version describes reference relations between at least one data block in a chunk included in the storage system and at least one object stored in the storage system at the first time point. Metadata in a second version at a second time point of the storage system is obtained, the second time point being after the first time point. The chunk included in the storage system is managed based on a determined difference between the metadata in the first version and the metadata in the second version. By means of the technical solution of the present disclosure, chunks in the storage system may be managed more effectively, and the chunk reclaiming efficiency may be increased.