Hypervisor Interfaces for Thinly-Provisioned Storage Reclamation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing virtualization technologies face storage inefficiencies due to 'stale' data blocks in thinly-provisioned virtual disks and LUNs, which are not timely released back to storage arrays, leading to reduced storage space utilization and inefficiencies.

Innovation Solution

System software interfaces are provided to enable discovery of thinly-provisioned LUNs and virtual disks, allowing for offloading and storage space reclamation through methods like live migration and snapshot creation, ensuring efficient management of storage resources during near-full and out-of-space conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If thin provisioning is implemented to dynamically allocate physical storage space, then storage space utilization is improved, but storage inefficiencies occur due to accumulation of stale data blocks that are not timely released

Engineering Contradiction:
Improvestorage space utilizationVSAvoidstorage efficiency
Core Design Contradiction:
Quantity of substanceVSLoss of energy

Solution Approach 1:

The system performs preliminary actions by proactively detecting near-full conditions and out-of-space conditions before complete storage exhaustion occurs. The hypervisor monitors storage metrics and initiates offloading operations (live migration, snapshot creation) or error handling procedures in advance, preventing storage inefficiencies from developing and ensuring continuous optimal storage utilization.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If virtualization software allocates all physical disk space at virtual disk creation, then storage availability is improved, but storage inefficiencies occur due to unallocated empty data blocks

Engineering Contradiction:
Improvestorage availabilityVSAvoidstorage space utilization
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The system transitions from static storage allocation (all-or-nothing at creation) to dynamic allocation. The hypervisor continuously monitors storage conditions and adjusts allocation in real-time based on actual needs, enabling storage space to be allocated when required and released when no longer needed, thus optimizing both availability and utilization.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the allocation parameter from fixed (100% at creation) to variable (based on actual usage and storage conditions). By monitoring storage metrics and adjusting allocation dynamically, the system optimizes the balance between storage availability and utilization efficiency.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If guest operating system deletes files, then data management is improved, but storage inefficiencies occur because freed data blocks are not released back to LUN

Engineering Contradiction:
Improvedata managementVSAvoidstorage space utilization
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The system implements feedback mechanisms where the hypervisor continuously monitors storage conditions and storage metrics. When files are deleted in the guest OS, the feedback loop detects the freed space and triggers appropriate actions to release and reallocate these blocks, ensuring storage space utilization reflects actual usage and preventing accumulation of stale data.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9285993B2Error handling methods for virtualized computer systems employing space-optimized block devices
Publication Date: 2016.03.15 VMWARE INC
  • US9285993B2 patent drawing
  • US9285993B2 patent drawing
  • US9285993B2 patent drawing

AI summary

Interfaces to storage devices that employ storage space optimization technologies, such as thin provisioning, are configured to enable the benefits gained from such technologies to be sustained. Such an interface may be provided in a hypervisor of a virtualized computer system to enable the hypervisor to discover features of a logical unit number (LUN), such as whether or not the LUN is thinly provisioned, and also in a virtual machine (VM) of the virtualized computer system to enable the VM to discover features of a virtual disk, such as whether or not the virtual disk is thinly provisioned. The discovery of these features enables better management of the LUN during near full and out-of-space conditions.