Workflow Status Output for Distributed Processing Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In distributed information processing systems, errors during workflow execution can lead to inconsistencies in processing statuses, causing unintended re-execution of tasks when the system is restarted, resulting in incomplete or failed processing.
Innovation Solution
A distributed information processing system comprising a manager, memory, processors, processing request storage, and result storage, which outputs task statuses based on storage data to prevent re-execution of tasks that were already completed or failed, ensuring accurate workflow resumption upon error detection or system restart.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the system is restarted after an error occurs during workflow execution, then the system can resume processing, but tasks that were already completed or failed may be incorrectly re-executed due to status inconsistencies
Solution Approach 1:
The system performs preliminary actions by storing the execution status of each task in the processing result storage before any potential system restart. When the system restarts, this pre-stored status information is used to determine which tasks should not be re-executed, preventing the loss of processing status information and ensuring workflow execution accuracy.
Solution Approach 2:
The output unit provides feedback by outputting information about the execution status of tasks based on the storage status of the processing request storage and processing result storage. This feedback mechanism ensures that the system is aware of which tasks have been completed or failed, preventing incorrect re-execution after a restart and maintaining reliable workflow processing.
2Reliability
If the system stores and checks processing status information for all tasks, then re-execution errors are prevented, but the system complexity increases due to distributed storage and status checking mechanisms
Solution Approach 1:
The system segments the storage of processing status information by dividing it between the processing request storage (which stores task requests) and the processing result storage (which stores execution results). This segmentation allows the system to track task status accurately without requiring a single complex centralized storage mechanism, thus reducing overall system complexity while maintaining reliability.
Data Source
AI summary
An information processing system is proposed. A manager manages a workflow defined by combining units of processing and generates a job to execute the workflow. A memory provides the manager to store a status of each unit of processing according to the job. Plural processors each executes a corresponding unit of processing. A processing request storage provides the manager to store a unit of processing as an execution request. A processing result storage provides each processor to store a processing result of a corresponding unit of processing after extracting the unit of processing from the processing request storage and executing the unit of processing. At a predetermined timing or when the information processing system is restarted after an occurrence of an error, an output unit outputs information indicating a status of a corresponding unit of processing, based on storage statuses of the processing request storage and the processing result storage.