Message Broker Cluster Connection Distribution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Message-oriented middleware systems face limitations in handling concurrent connections, leading to broker overload and failures, which result in undesirable delays and resource consumption.
Innovation Solution
A broker-based messaging system dynamically establishes connections between software applications and a cluster of message brokers using connection distribution heuristics, distributing connections among multiple brokers to prevent overload and ensure reliable message transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a software application establishes multiple concurrent connections with a single broker to communicate with multiple software applications, then the communication capability and interoperability are improved, but the broker becomes overloaded and enters into a fault state
Solution Approach 1:
The system segments the broker functionality into multiple broker instances distributed across a network. Instead of one broker handling all connections, the workload is divided among several brokers, each managing a subset of connections. This segmentation prevents any single broker from becoming overloaded while maintaining comprehensive communication capability.
Solution Approach 2:
The patent introduces a connection manager as an intermediary component that dynamically assigns client connections to appropriate broker instances. This mediator balances the load by directing connections to brokers with available capacity, preventing overload on any single broker while ensuring all communication needs are met.
2Reliability
If a broker handles a limited number of concurrent connections to maintain stability, then the system reliability is improved, but the productivity and message transmission capacity are reduced
Solution Approach 1:
The system merges multiple broker instances into a coordinated cluster that functions as a unified message transmission system. Each broker maintains stable, limited connections, but the combined capacity of all brokers provides high overall message transmission capacity. The brokers work together to handle large volumes of messages without any single broker becoming overloaded.
Solution Approach 2:
The patent transitions from a single-dimension architecture (one broker handling all connections) to a multi-dimensional architecture where connections are distributed across multiple brokers in a network. This dimensional change allows the system to scale capacity by adding more brokers without increasing the connection burden on any single broker, thereby maintaining both stability and high productivity.
3Device complexity
If a single broker is used to simplify the system architecture, then the device complexity is reduced, but the scalability and performance are limited
Solution Approach 1:
The patent creates a universal broker cluster architecture where multiple brokers provide the same message brokering functionality. This multi-functional setup allows the system to scale by adding identical broker instances, each capable of handling connections independently. The universal design maintains simplicity while enabling scalability through replication of functional units.
Solution Approach 2:
The system changes the parameter of broker quantity from one to multiple, transforming the architecture from a single-point system to a distributed system. This parameter change enables scalability while the standardized interface and connection management protocols maintain architectural simplicity, allowing easy addition of brokers without increasing overall system complexity.
Data Source
AI summary
An exemplary method includes a broker-based messaging system detecting a request provided by a software application for the software application to connect to any one of a plurality of brokers included in a cluster of brokers, dynamically identifying, in response to the request and in accordance with a connection distribution heuristic, a broker included in the cluster of brokers and that is available for connection to the software application, and attempting to establish a connection between the software application and the broker. Corresponding methods and systems are also disclosed.