Memory Controller Token Rate Control for Bus Bandwidth
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing information processing technologies face inefficiencies in bus bandwidth utilization during parallel task processing, leading to latency and hindered real-time responses due to the need for token-based access control, which can introduce delays and overhead.
Innovation Solution
An information processing apparatus and method that dynamically control access requests by designating priority requester units and adjusting token generation rates based on the accumulation of access requests in a command queue, allowing for adaptive and efficient use of bus bandwidths, even exceeding initial bandwidth rates when requests are low, to reduce latency and overhead.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If token-based access control is implemented to manage bus bandwidth allocation, then bus bandwidth utilization is improved, but processing latency increases due to token acquisition delays
Solution Approach 1:
The patent implements dynamic token generation rates that adapt to system conditions. The token generation rate is adjusted based on the accumulation of access requests in the command queue, allowing the system to increase token generation when bandwidth is needed and reduce it when the queue is full, thereby optimizing both bandwidth utilization and latency
Solution Approach 2:
The patent employs feedback mechanisms where the issuance rate control part monitors the command queue depth and adjusts token generation rates accordingly. This closed-loop control allows the system to respond to changing bandwidth requirements and minimize latency by generating tokens at optimal rates based on actual system state
2Speed
If token generation rates are increased to reduce latency, then processing speed is improved, but bus bandwidth allocation control is worsened leading to potential overload
Solution Approach 1:
The patent changes the parameter of token generation rate dynamically based on command queue depth. By adjusting this single parameter in response to system conditions, the system achieves both high processing speed when needed and proper bandwidth control, avoiding the complexity of multiple control mechanisms
3Productivity
If strict token-based rate control is applied to all requester units, then bus bandwidth allocation is optimized, but real-time response capability is degraded
Solution Approach 1:
The patent applies different control qualities to different situations. When the command queue depth is below a threshold, tokens are generated at higher rates or skipped entirely to ensure real-time response. When the queue is full, strict rate control is applied to optimize bandwidth allocation. This local differentiation of control strictness resolves the contradiction
Data Source
AI summary
Requestors issue access requests to a memory controller. The access requests issued are accumulated in a command queue of the memory controller. When the amount of access requests accumulated in the command queue is smaller than or equal to a threshold, a free pass (FP) is granted to specified requesters. When issuing access requests, requesters request and acquire tokens before issuing the access requests if they have no FP granted. If the requesters have an FP, they simply issue the access requests.