Backup Agent Scheduling Storage Devices Using Telemetry Clusters

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current storage management systems face inefficiencies in scheduling backup operations due to unpredictable workload patterns, leading to potential data loss, unavailability, and increased latency, as they lack a method to predict and optimize backup initiation times based on storage device usage.

Innovation Solution

A method involving a backup agent that obtains storage device telemetry entries, normalizes them, performs pairwise evaluations to form initial clusters, re-evaluates these clusters to update backup policies, and schedules backup operations during predicted low usage periods, thereby optimizing backup timing and reducing workload bottlenecks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If backup operations are scheduled without considering storage device usage patterns, then backup simplicity is maintained, but data loss risk and latency increase due to unpredictable workload patterns

Engineering Contradiction:

Improvedata loss riskVSAvoidbackup scheduling complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The system implements feedback by continuously monitoring storage device telemetry data (usage patterns, workload metrics) and using this information to dynamically adjust backup scheduling decisions. The backup agent evaluates current device states and modifies backup timing accordingly, creating a closed-loop control system that reduces data loss risk while adapting to changing conditions.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The backup system performs self-service by automatically analyzing its own operational data and making scheduling decisions without external intervention. The backup agent autonomously evaluates telemetry entries, determines optimal backup windows, and executes scheduling adjustments based on observed device usage patterns, eliminating the need for manual configuration while improving reliability.

Inventive Principle:

Principle #25Self-service

2Productivity

If backup operations are performed during high usage periods, then backup speed and resource availability are improved, but latency and system performance degradation increase

Engineering Contradiction:

Improvebackup operation speedVSAvoidbackup latency

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The backup scheduling system transitions from static to dynamic operation by continuously adapting backup timing based on real-time telemetry data. The system monitors device usage patterns and dynamically adjusts backup schedules to execute during optimal windows, balancing backup productivity with minimal impact on system performance and latency.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system changes operational parameters by adjusting backup timing and scheduling based on evaluated telemetry metrics. Instead of fixed schedules, the backup agent modifies execution parameters (timing, frequency, resource allocation) according to observed device states, optimizing the balance between backup speed and system latency.

Inventive Principle:

Principle #35Parameter changes

3Productivity

If traditional cleaning policies are used on storage device pools, then storage management simplicity is maintained, but efficiency and resource utilization worsen due to inability to predict optimal backup initiation times

Engineering Contradiction:

Improvestorage management efficiencyVSAvoidpolicy management complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The system replaces traditional mechanical cleaning policies with an intelligent, data-driven backup scheduling mechanism. Instead of relying on fixed, predetermined cleaning schedules, the backup agent uses telemetry analysis and pattern recognition to dynamically determine optimal backup initiation times, substituting rigid mechanical rules with adaptive intelligent control.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The backup agent acts as an intermediary between raw telemetry data and backup scheduling decisions. It processes and evaluates usage patterns, translates them into scheduling parameters, and mediates between device usage requirements and backup operational needs, enabling efficient storage management without direct manual intervention.

Inventive Principle:

Principle #24Intermediary (Mediator)

Data Source

PatentUS11360862B2System and method for managing backup operations of storage devices in a backup storage system using cluster evaluations based on usage telemetry

Publication Date: 2022.06.14 EMC IP HLDG CO LLC

AI summary

A method for managing storage devices includes obtaining a storage device cluster request, and in response to the storage device cluster request: obtaining a set of storage device telemetry entries associated with a plurality of storage devices, performing a telemetry normalization on the storage device telemetry entries to obtain a set of normalized entries, performing a pairwise evaluation on the set of normalized entries to obtain a set of initial storage device clusters, wherein a storage device cluster in the set of initial storage device clusters comprises a portion of the plurality of storage devices, performing a cluster re-evaluation on the set of initial storage device cluster groups to obtain a set of updated storage device clusters, updating a backup policy based on the set of updated storage device cluster groups, and performing a backup operation on a storage device based on the backup policy.