Dynamic Processing Module Adjustment for Workflow Queue Bottlenecks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional workflow management systems are limited in processing work items from multiple queues simultaneously, leading to inequitable processing time and potential delays in business processes due to fixed processing threads and capacity, where queues with fewer items may be overlooked while those with more items monopolize processing time.
Innovation Solution
A system that dynamically adjusts the number of processing modules based on actual processing load and threshold levels, assigning retrieval priorities to queues and allocating processing capacity accordingly to ensure equitable processing across all queues, thereby preventing delays in business processes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single processing thread processes work items from multiple queues sequentially, then the system structure is simple, but queues with fewer work items receive inequitable processing time and business processes experience delays
Solution Approach 1:
The system divides the processing function into multiple independent processing threads, with each thread assigned to handle work items from a specific queue. This segmentation allows concurrent processing of multiple queues simultaneously, ensuring that queues with fewer work items receive equitable processing time while maintaining system simplicity through modular thread design.
2Productivity
If multiple processing threads are assigned to different queues, then processing capacity increases, but some threads operate at minimal capacity while others operate at maximum capacity
Solution Approach 1:
The system implements dynamic processing capacity allocation where processing threads can be selectively activated or deactivated based on actual processing load. The processor monitors queue depths and work item volumes, dynamically adjusting the number of active processing threads to match demand. This ensures all processing threads operate at optimal capacity levels, preventing both underutilization and overload while maintaining high productivity.
3Stability of the object's composition
If processing capacity is fixed, then system stability is maintained, but the system cannot adapt to varying processing loads and queues with more items monopolize processing time
Solution Approach 1:
The system changes the parameter of processing capacity from a fixed value to a dynamically adjustable parameter. The processor monitors processing load metrics such as queue depth and work item volume, and selectively adjusts the number of active processing threads based on these measurements. This allows the system to maintain stability through controlled adjustments while adapting to varying loads, ensuring processing efficiency is optimized without compromising system stability.
Data Source
AI summary
Systems and methods improve the equitable distribution the processing capacity of a computing device processing work items retrieved from multiple queues in a workflow system. A retrieval priority is determined for each of the plurality of queues and work items are retrieved from each of the multiple queues according to the retrieval priority. The retrieved work items are then stored in a central data structure. Multiple processing components process the work items stored in the central data structure. The number of processing components is selectively adjusted to maximize efficiency.