Workflow Job Synchronization via Meta-Job Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current workflow management systems lack flexibility in processing related jobs, as they often require all jobs in a group to be processed according to a common job type, leading to inflexible handling and reprocessing of entire groups when one job encounters an error.
Innovation Solution
The system allows for each job in a group to be processed independently according to its unique job type while maintaining synchronization through meta-job processing, enabling concurrent and sequential processing of related jobs, ensuring they are completed in the original order.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Stability of the object's composition
If all jobs in a group are processed according to a common job type to maintain group synchronization, then job group coherence is improved, but individual job processing flexibility deteriorates
Solution Approach 1:
The patent segments the job processing into two independent layers: individual job processing (with unique job types and parameters) and group-level synchronization (with meta-job actions). This allows each job to be processed independently according to its specific requirements while maintaining group coherence through synchronization points and meta-job actions that operate at the group level without constraining individual job processing flexibility.
Solution Approach 2:
The patent introduces meta-jobs as an intermediary layer between individual jobs and the workflow manager. Meta-jobs contain synchronization actions that coordinate group processing without directly controlling individual job execution. This intermediary enables group-level coherence while preserving individual job flexibility, as the meta-job acts as a mediator that synchronizes jobs without imposing rigid common processing rules on each individual job.
2Adaptability or versatility
If jobs are processed independently according to unique job types to maximize flexibility, then individual job adaptability is improved, but job ordering synchronization deteriorates
Solution Approach 1:
The patent establishes synchronization points and meta-job actions in advance as part of the workflow definition. These preliminary synchronization mechanisms are built into the workflow structure before execution, allowing jobs to process independently according to their unique job types while automatically maintaining ordering synchronization. The pre-defined synchronization points ensure that jobs are coordinated at critical stages without constraining their independent processing flexibility.
Solution Approach 2:
The patent implements a feedback mechanism where the workflow manager monitors job processing progress and enforces synchronization rules based on meta-job definitions. When jobs reach synchronization points, the system provides feedback to coordinate their progression, ensuring original order maintenance. This feedback-based approach allows independent job processing while dynamically maintaining synchronization, as the system adjusts job progression based on real-time status and predefined synchronization requirements.
3Reliability
If the entire job group is reprocessed when one job encounters an error, then error handling consistency is improved, but processing efficiency deteriorates
Solution Approach 1:
The patent extracts the error handling logic from the rigid all-or-nothing group reprocessing approach. Instead of reprocessing the entire job group when one job fails, the system isolates the erroneous job and allows successful jobs to continue or be reprocessed independently. This extraction of error-affected jobs from the group enables selective reprocessing, maintaining error handling consistency for failed jobs while preserving processing efficiency by avoiding unnecessary reprocessing of successful jobs.
Solution Approach 2:
The patent changes the error handling parameter from binary (reprocess all or none) to granular (reprocess only affected jobs). By modifying the error handling approach to identify and target only the specific job that encountered an error, the system maintains reliability through consistent error handling while dramatically improving productivity. This parameter change enables the workflow manager to adjust processing based on actual error conditions rather than applying a blanket reprocessing rule to the entire group.
Data Source
AI summary
Methods and systems for improved workflow management for a related group of jobs. A group of related jobs are received from a job source and are processed independently and in accordance with an associated job type for each job. The jobs may be processed and reprocessed independent of all other jobs in the group and may be processed substantially concurrently or in parallel. A group workflow manager assures synchronization of the jobs to generate the expected order in the output. The synchronization is defined by synchronization actions processed as part of the workflow processing. The synchronization actions may be defined in the job type of each job, or in a group job type, or defined by user interaction.