Server Client Segregation for Publish-Subscribe Load Balancing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In publish/subscribe environments, servers face excessive loads due to unbatched and randomly distributed client messages, leading to processing delays and inefficiencies, especially when handling clients with varying activity levels and different networking infrastructures.
Innovation Solution
A method for segregating clients into activity categories based on their messaging frequency, allowing high activity clients to be batched and processed more efficiently, while low activity clients are handled differently, and implementing ping reply batching to reduce server load.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If servers handle all client messages individually in real-time, then message delivery timeliness is improved, but server processing load increases excessively
Solution Approach 1:
The patent merges multiple individual message processing operations into batched processing. Clients are categorized into high-activity and low-activity groups, and messages from these groups are batched together and processed in bulk rather than individually. This combining of operations reduces the overhead per message and improves server processing efficiency while maintaining acceptable delivery timeliness.
Solution Approach 2:
The patent implements periodic batch processing where servers collect messages over a time period and then process them in batches at scheduled intervals. This periodic action allows the server to handle multiple messages efficiently in single processing cycles, reducing the continuous processing load while still delivering messages in a timely manner through the batching mechanism.
2Ease of operation
If servers process messages from all clients uniformly, then service fairness is improved, but processing efficiency decreases due to varying client activity levels
Solution Approach 1:
The patent applies local quality by treating different client groups differently based on their activity characteristics. High-activity clients and low-activity clients are segregated into separate categories, and each category receives tailored processing treatment. This allows the server to optimize processing for each group's specific needs rather than applying a uniform approach, thereby improving overall efficiency while maintaining fairness through differentiated service quality.
Solution Approach 2:
The patent segments the client base into distinct activity categories (high-activity and low-activity clients). This segmentation allows the server to apply different processing strategies to different segments, such as batched processing for high-activity clients and standard processing for low-activity clients. The segmentation enables efficient resource allocation and processing optimization without compromising service fairness across all clients.
3Measurement precision
If ping replies are sent individually to each client, then connection monitoring accuracy is improved, but network traffic and processing overhead increase
Solution Approach 1:
The patent merges individual ping reply operations into batched operations. Instead of sending ping replies to each client separately, the system collects ping requests and processes them in batches, combining multiple monitoring operations into single network transactions. This reduces the total volume of network traffic while maintaining connection monitoring accuracy through the batched verification process.
Data Source
AI summary
Embodiments for server connection optimization in a persistently connected publish/subscribe environment are provided. A computer assigns an initial activity category for a client. The computer logs, into a log file, one or more select operations of a connection between a client and a first server. The computer calculates a ratio of a number of the select operations to a check time of the first server, wherein the check time is a period of time that has elapsed since a previous review of logged data. The computer sets a second activity category for the client based on a look-up of the ratio in a schedule of ratio ranges in a control file, wherein the second activity category is not the initial activity category. The computer transfers the client from the first server to a second server, in response to setting the second activity category.