Message Queue Coordination for Workload-Aware Campaign Routing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing messaging systems struggle with high volume message processing, leading to reduced throughput and increased risk of service disruptions due to inadequate coordination and management of queues, especially in distributed computing environments.
Innovation Solution
A queue coordination data store is utilized to facilitate coordination among message consumers and producers, allowing for dynamic reservation and selection of message queues based on workload and campaign-specific criteria, ensuring optimized throughput and preservation of message ordering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a shared queue pool is used to queue and process all messages, then uniform throughput is achieved, but message ordering is not preserved and system-wide service disruptions are introduced
Solution Approach 1:
The patent segments the shared queue pool into multiple isolated queue pools, each dedicated to specific campaigns or message types. This segmentation allows individual queue failures to be contained within specific pools rather than affecting the entire system, thereby maintaining high throughput while reducing system-wide service disruption risk.
2Reliability
If allocated queuing is used to allocate queueing resources individually to units, then system-wide service disruptions are isolated, but throughput efficiency is reduced
Solution Approach 1:
The patent implements dynamic resource allocation where queue pools can be dynamically created, merged, or deleted based on campaign requirements. The system can allocate more queue resources to high-throughput requirements and fewer to low-priority campaigns, optimizing overall throughput while maintaining isolation capabilities when needed.
3Productivity
If queue resources are dynamically allocated based on workload, then throughput is optimized, but system complexity increases
Solution Approach 1:
The patent introduces a coordination service as an intermediary layer between message producers and queue pools. This coordination service handles the complex tasks of workload assessment, queue selection, and resource allocation, simplifying the interface for individual components while enabling optimized throughput through coordinated resource management.
Data Source
AI summary
Improved messaging systems are disclosed. Embodiments allow message producers to access or create producer reservations in a queue coordination data store corresponding to a campaign. The producer reservations reflect a workload and a campaign aspect. A message producer can apply a usage strategy in resource selection which may optimize selection of queueing resources considering existing work volume for those message queues or aspects of the campaign. Message consumers may select message queues from which to consume messages using data in the queue coordination data store. A message consumer may apply a usage strategy in resource selection which may optimize selection of queueing resources considering existing work volume for those message queues or aspects of the campaign.


