Dynamic Memory Controller Read-Write Ratio Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional memory controllers in integrated circuits face efficiency degradation due to mismatched read-write ratios and require tuning for specific memory traffic patterns, which is challenging, especially in reconfigurable integrated circuits like programmable logic devices.

Innovation Solution

Implementing a memory controller that dynamically adapts to changing memory traffic conditions by adjusting the read-write ratio and using a finite state machine to schedule read and write transactions, allowing for real-time updates of burst thresholds based on incoming traffic patterns.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If a fixed read-write major mode is used to schedule memory transactions, then bus turnaround time is reduced, but memory subsystem efficiency degrades when traffic patterns differ from the tuned ratio

Engineering Contradiction:
Improvebus turnaround timeVSAvoidmemory subsystem efficiency
Core Design Contradiction:
Loss of timeVSProductivity

Solution Approach 1:

The patent implements a dynamic read-write ratio adjustment mechanism that transitions from a fixed scheduling mode to an adaptive one. The system continuously monitors actual memory traffic patterns and automatically adjusts the read-write ratio parameters to match observed behavior, allowing the scheduler to maintain optimal performance across varying workloads without manual retuning.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system incorporates feedback loops that monitor memory traffic characteristics and use this information to adjust the read-write major mode parameters. By comparing actual traffic patterns against the current scheduling configuration and making real-time adjustments, the system resolves the contradiction between fixed scheduling benefits and adaptive efficiency requirements.

Inventive Principle:
Principle #23Feedback

2Productivity

If the read-write ratio is tuned for specific memory traffic patterns, then optimum performance is achieved for those patterns, but adaptability to other traffic patterns deteriorates

Engineering Contradiction:
Improvememory performanceVSAvoidadaptability to traffic patterns
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent transforms the static, hand-tuned read-write ratio into a dynamic parameter that automatically adapts to different traffic patterns. The system learns from actual memory access behavior and adjusts scheduling parameters accordingly, eliminating the need for application-specific tuning while maintaining optimal performance across diverse workloads.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the read-write ratio parameters based on observed traffic characteristics rather than using fixed values. By monitoring actual memory transaction patterns and adjusting the scheduling parameters accordingly, the system achieves both optimized performance and broad adaptability without requiring manual configuration for each application type.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If manual tuning of memory controller parameters is performed, then optimum performance for specific traffic patterns is achieved, but device complexity and development time increase

Engineering Contradiction:
Improvememory performanceVSAvoidtuning complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements self-service functionality where the memory controller automatically monitors its own traffic patterns and adjusts scheduling parameters without external intervention. This eliminates the need for manual tuning by application developers while maintaining optimal performance, thereby reducing development complexity and time-to-market.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses feedback mechanisms to automatically adjust parameters based on observed performance and traffic patterns. This closed-loop approach replaces manual tuning processes, allowing the memory controller to optimize itself for each application context without requiring developer expertise in memory subsystem tuning.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11188255B2Dynamic major mode for efficient memory traffic control
Publication Date: 2021.11.30 ALTERA CORP
  • US11188255B2 patent drawing
  • US11188255B2 patent drawing
  • US11188255B2 patent drawing

AI summary

An integrated circuit may include a memory controller circuit for communicating with an off-chip memory device. The memory controller is operable in a read-write major mode that is capable of dynamically adapting to any memory traffic pattern, which results in improved memory scheduling efficiency across different user applications. The memory controller may include at least a write command queue, a read command queue, an arbiter, and a command scheduler. The command scheduler may monitor a write command count, a read command count, a write stall count, and a read stall count to determine whether to dynamically adjust a read burst threshold setting and a write burst threshold setting.