IMDG Request Prioritizer for Multi-tenant Performance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current In-Memory Data Grid (IMDG) systems in cloud computing environments face performance degradation due to the lack of effective prioritization of data retrieval requests from multiple applications, leading to deadlocks and adverse impacts on application performance.
Innovation Solution
An IMDG server with a request prioritizer processor that determines and manages the priority of competing data retrieval requests based on various factors such as predetermined priorities, request frequency, peak usage times, and explicit client requests, ensuring that higher priority applications receive data first and limiting data transmission during high loads.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data retrieval requests from multiple applications are processed without prioritization in an IMDG system, then the system maintains simplicity in request handling, but application performance deteriorates due to deadlocks and competing requests
Solution Approach 1:
The patent applies preliminary action by determining the priority of each application request before the actual data retrieval operation begins. The request prioritizer component assigns priority levels to requests from different applications in advance, ensuring that when multiple requests compete for the same data, the system can immediately execute them in the correct priority order without performance degradation or deadlocks.
2Productivity
If simultaneous requests from multiple competing applications are processed in FIFO order, then the system maintains simplicity in request processing, but the performance of critical applications deteriorates due to longer wait times
Solution Approach 1:
The patent applies local quality by treating different application requests differently based on their specific priority requirements. Instead of applying a uniform FIFO processing rule to all requests, the system assigns different priority levels to different applications or request types, allowing critical applications to receive preferential treatment and be processed faster, while non-critical applications follow standard processing.
3Ease of operation
If all data retrieval requests are serviced without prioritization, then the system maintains ease of operation, but the customer experience deteriorates due to inconsistent response times for different applications
Solution Approach 1:
The patent introduces an intermediary component called the request prioritizer that sits between the applications and the IMDG data structure. This intermediary automatically determines request priorities based on pre-configured rules and application identities, transparently managing the complexity of prioritization without requiring changes to the applications themselves or complicating the overall system operation.
Data Source
AI summary
An in-memory data grid (IMDG) server includes an i/o interface for transmitting and receiving data over a network. A random access memory (RAM) is configured with the IMDG which stores plural different data sets that may be requested for retrieval by applications that can connect to the IMDG server through the network. A processor receives requests for retrieval of data from the IMDG data sets, and sends the requested data to the requesting application. The IMDG server also includes a request prioritizer that determines, when two or more applications, which are competing applications that defined as having requests co-pending at the IMDG server to retrieve one or more of the data sets, which of the competing applications has the highest priority relative to the other competing applications. The request prioritizer causes a data set requested by the application with the highest priority to be handled before requests from the applications.