Overlay Optimizer Commit Handling via Cache Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The static size of the overlay in Windows write filters leads to system reboots when full, degrading user experience and potentially leaving insufficient RAM for applications, and existing overlay management techniques can cause commit or commit-delete operations to fail when files are moved to an overlay cache.

Innovation Solution

Implementing an overlay optimizer with upper and lower filter instances to manage file commit and commit-delete operations by moving files from the write filter's overlay to an overlay cache, ensuring operations complete successfully by obtaining handles to files stored in the cache and modifying processing to accommodate moved files.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the overlay size is increased to prevent reboots, then system stability is improved, but available RAM for applications decreases

Engineering Contradiction:
Improvesystem stabilityVSAvoidavailable RAM
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The overlay management functionality is divided into two separate filter instances: an upper instance that manages file movement to overlay cache, and a lower instance that handles commit operations. This segmentation allows each instance to specialize in specific tasks, enabling the system to maintain larger effective overlay capacity without proportionally increasing RAM consumption.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

An overlay cache is introduced as an intermediary storage layer between the write filter's overlay and the protected volume. Files are moved to this cache before being committed, allowing the system to effectively increase overlay capacity without directly increasing the overlay's RAM footprint, thus resolving the contradiction between stability and available memory.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If files are moved to overlay cache to optimize performance, then overlay efficiency is improved, but commit operations fail when files are not found in overlay

Engineering Contradiction:
Improveoverlay efficiencyVSAvoidcommit operation success
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The filter is segmented into upper and lower instances with distinct responsibilities. The upper instance handles file movement to cache, while the lower instance handles commit operations. This segmentation allows the lower instance to be aware of files in the cache and properly handle commit operations for those files, preventing operation failures.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The lower filter instance receives feedback from the upper instance about which files have been moved to the overlay cache. This feedback mechanism allows the lower instance to adjust its behavior accordingly, ensuring that commit operations can successfully locate and process files regardless of whether they reside in the overlay or the cache.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If the overlay size is set to maximum to prevent reboots, then system availability is improved, but the system may not have enough RAM to run multiple applications

Engineering Contradiction:
Improvesystem availabilityVSAvoidRAM capacity
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The overlay cache serves as an intermediary that extends the effective overlay capacity beyond the physical overlay's RAM size. By moving files to this cache before commits, the system can maintain high availability without requiring the overlay to occupy all available RAM, thus allowing multiple applications to run simultaneously.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3834104B1Handling file commit and commit-delete operations in an overlay optimizer
Publication Date: 2023.09.06 DELL PROD LP
  • EP3834104B1 patent drawingFigure 1
  • EP3834104B1 patent drawingFigure 2
  • EP3834104B1 patent drawingFigure 3

AI summary

File commit and commit-delete operations can be successfully completed in environments that employ an overlay optimizer to enhance the performance of a write filter. The overlay optimizer can be structured into upper and lower instances relative to the write filter. The upper instance can cause files to be moved from the write filter's overlay into an overlay cache to thereby optimize the performance of the overlay. To prevent the failure of commit and commit-delete operations that target files that have been moved to the overlay cache, the lower instance can be configured to detect when the write filter is attempting to perform a commit or commit-delete operation and can modify the processing of such operations to cause them to be completed successfully even though the files targeted by the operations do not exist in the write filter's overlay.