Batch Processing System for Application Server Overload Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems that process large volumes of data operations on servers often lead to server overload and crashes, resulting in slow performance and an undesirable user experience due to the need for individual processing of each operation.
Innovation Solution
A method for evaluating a plurality of expressions in batch mode, where expressions are prepared in a blocked state, partitioned, and dispatched as a single batch processing call to the application server, reducing the number of processing requests and increasing server efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If individual processing calls are used for each operation, then processing accuracy is maintained, but server performance deteriorates and processing time increases
Solution Approach 1:
The patent combines multiple individual processing calls into a single batch processing call. The system groups multiple data objects that require processing and sends them together in one request to the server, rather than sending separate requests for each object. This merging approach maintains processing accuracy while significantly improving server performance by reducing the total number of requests and minimizing server overhead.
2Reliability
If individual processing calls are used for each operation, then processing completeness is ensured, but processing time increases and user experience deteriorates
Solution Approach 1:
The system merges multiple processing operations into a single batch call, ensuring that all data objects are processed completely while reducing the cumulative processing time. By grouping operations and executing them in one batch, the system maintains processing completeness without the sequential delays associated with individual calls.
Solution Approach 2:
The batch processing approach enables continuous processing of multiple data objects in a single uninterrupted operation. Instead of stopping and restarting for each individual call, the server processes the entire batch continuously, significantly reducing total processing latency and improving user experience.
3Quantity of substance
If large volumes of individual calls are sent to the server, then all operations are processed, but server overload occurs and system stability decreases
Solution Approach 1:
The system merges multiple individual calls into a single batch processing call, allowing a large volume of operations to be processed without overloading the server. By consolidating requests, the system maintains high throughput while preserving server stability and preventing crashes that would result from handling numerous individual calls sequentially.
Data Source
AI summary
A batching module that prepares a plurality of blocked expressions for batch evaluation. The plurality of blocked expressions comprises a plurality of expressions in a blocked state. The batching module divides the plurality of blocked expressions into one or more partitions. For each particular partition of the one or more partitions, a single batch processing call is dispatched to an application server to perform a batch evaluation.