Event-Based VM Swap Notification via Interposed Notifier

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems rely on CPU-intensive polling to monitor swapping activity, leading to performance degradation due to delayed notifications and increased CPU consumption, which hinders timely reaction to memory changes in virtual machines.

Innovation Solution

Implementing an event-based notification mechanism that allows user-space applications to receive immediate notifications of swapping activity exceeding predefined thresholds, reducing CPU consumption and cache interference by interposing on swap operations and using a swap notifier to detect and report swapping activity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If CPU-intensive polling is used to monitor swapping activity, then monitoring coverage is comprehensive, but CPU consumption increases and notification delay occurs

Engineering Contradiction:
Improvemonitoring coverageVSAvoidCPU consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent introduces a swap notifier as an intermediary component that sits between the swapping mechanism and user-space applications. This notifier receives swap events directly from the kernel and forwards them to applications, eliminating the need for applications to perform CPU-intensive polling while ensuring comprehensive monitoring coverage through direct event notification.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If CPU-intensive polling is used to monitor swapping activity, then monitoring coverage is comprehensive, but notification delay increases

Engineering Contradiction:
Improvemonitoring coverageVSAvoidnotification delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary action by having applications register their interest in swap events in advance with the swap notifier. The notifier then proactively pushes notifications to registered applications as soon as swap events occur, eliminating the delay inherent in polling approaches where applications must wait for their next scheduled check.

Inventive Principle:
Principle #10Preliminary action

3Use of energy by moving object

If event-based notification mechanism is implemented, then CPU consumption is reduced, but system complexity increases

Engineering Contradiction:
ImproveCPU consumptionVSAvoidsystem complexity
Core Design Contradiction:
Use of energy by moving objectVSDevice complexity

Solution Approach 1:

The swap notifier is designed as a universal component that can serve multiple user-space applications simultaneously through a single notification mechanism. It handles various swap event types (swap in, swap out, threshold crossings) and can notify multiple applications with different threshold configurations, reducing overall system complexity compared to implementing separate monitoring mechanisms for each application.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11816498B2Early event-based notification for VM swapping
Publication Date: 2023.11.14 NUTANIX INC
  • US11816498B2 patent drawing
  • US11816498B2 patent drawing
  • US11816498B2 patent drawing

AI summary

Various embodiments disclosed herein are related to a non-transitory computer readable storage medium. In some embodiments, the medium includes instructions stored thereon that, when executed by a processor, cause the processor to receive, from a user-space application, a request to detect swapping activity satisfying a threshold condition, detect the swapping activity satisfying the threshold condition, and, in response to occurrence of the threshold condition, send a response that indicates that the swapping activity satisfies the threshold condition.