Dependency-Based Workflow Scheduling for Storage Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional storage systems face issues with coordinating primary backup, replication, and cloud tier operations, leading to failures, resource wastage, and performance degradation due to the lack of dependency-based scheduling, resulting in incomplete backups and inefficient resource utilization.
Innovation Solution
A dependency-based scheduling mechanism is introduced, where workflows that depend on parent workflows are only scheduled after the parent workflow is terminated, eliminating the need for manual timing specifications and reducing resource consumption by avoiding unnecessary scans and caching.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple workflows (backup, replication, cloud tier) are executed concurrently without dependency coordination, then system productivity increases, but workflow reliability deteriorates due to failures and incomplete backups
Solution Approach 1:
The patent applies preliminary action by establishing workflow dependency relationships before execution. The system pre-defines parent-child relationships between workflows (backup, replication, cloud tier) and uses these predefined dependencies to control execution order, ensuring that child workflows only execute after their parent workflows complete successfully, thereby preventing failures while maintaining productivity
Solution Approach 2:
The patent implements dynamics by making the workflow scheduling mechanism adaptive. The system dynamically adjusts workflow execution based on real-time dependency evaluation and completion status. The scheduling module continuously monitors workflow progress and automatically triggers dependent workflows when conditions are met, enabling flexible coordination without manual intervention
2Manufacturing precision
If manual timing specifications are required for workflow scheduling, then scheduling precision improves, but device complexity increases
Solution Approach 1:
The patent applies self-service by enabling workflows to automatically trigger dependent workflows based on their completion status. The scheduling module autonomously evaluates dependency relationships and initiates child workflows without requiring manual timing specifications or user intervention, thereby reducing device complexity while maintaining precise scheduling control
Solution Approach 2:
The patent implements feedback by creating a closed-loop control system. The scheduling module continuously monitors workflow completion status and uses this feedback information to determine when to trigger dependent workflows. This feedback mechanism ensures precise scheduling automatically, eliminating the need for manual timing configuration while maintaining control precision
3Use of energy by moving object
If workflows are scheduled without dependency checking, then resource usage decreases, but productivity deteriorates due to unnecessary scans and caching
Solution Approach 1:
The patent applies preliminary action by pre-establishing workflow dependency relationships and using them to guide execution. The system proactively determines which workflows should execute based on completed parent workflows, avoiding unnecessary scans and caching operations. This preliminary dependency evaluation optimizes resource usage while maintaining high productivity through targeted workflow execution
Data Source
AI summary
Embodiments of the present disclosure provide a data backup method, an electronic device and a computer program product. The method provided includes creating a workflow related to a data source, the workflow being configured to generate a copy of the data source or to replicate the copy of the data source to a remote device. The method further includes identifying a dependency of the workflow, the dependency indicating whether the workflow depends on at least one additional workflow related to the data source. The method further includes scheduling the workflow based at least on the identified dependency. According to the embodiments of the present disclosure, by use of a dependency-based scheduling mechanism, the performance of a storage system can be improved, and consumption of resources such as a storage and an internal memory can be reduced.