Memory Controller Access Scheme Optimization for Faster Random Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing memory access schemes, particularly for non-volatile data memories like flash memory, suffer from inefficiencies in random access performance due to physical properties, caching predictability, interleaving, resolution of logical to physical addresses, and interaction overhead, leading to suboptimal access times and increased power consumption.

Innovation Solution

A method and memory controller optimize access schemes by receiving an access scenario from the host, modifying address mapping and timing to create an optimized sequence of physical memory accesses, reducing unnecessary operations and enhancing performance, lifetime, and power efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If random access is used to allow flexible data retrieval from any memory location, then adaptability is improved, but access time increases significantly compared to sequential access

Engineering Contradiction:
Improveaccess flexibilityVSAvoidaccess time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The memory controller performs preliminary actions by preloading data from upcoming read accesses into an internal buffer before the host actually requests it. This 'read ahead' mechanism anticipates future access needs and prepares data in advance, reducing the time penalty of random access while maintaining access flexibility.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adapts the access scheme based on the specific access scenario. The memory controller analyzes the access pattern and modifies the access scheme in real-time, transitioning between sequential and random access strategies optimally, thereby reducing access time while preserving adaptability.

Inventive Principle:
Principle #15Dynamics

2Productivity

If read ahead is used to preload data for anticipated read accesses, then productivity is improved for predicted access patterns, but device complexity increases due to buffer management requirements

Engineering Contradiction:
Improveaccess performanceVSAvoidcontroller complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The memory controller performs self-service by autonomously analyzing access scenarios and optimizing access schemes without external intervention. It automatically manages buffer allocation, determines preload amounts, and adjusts access strategies based on observed patterns, reducing the need for complex external control mechanisms.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system changes operational parameters dynamically, including buffer size, preload amount, and access timing, based on the specific access scenario. This parameter adaptation allows the system to achieve high productivity for predicted patterns while keeping the base device complexity manageable through configurable rather than hardwired complexity.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If multiple memory media are used with interleaving to speed up accesses, then productivity is improved, but device complexity increases due to address mapping requirements

Engineering Contradiction:
Improveaccess throughputVSAvoidaddress mapping complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The memory controller implements a universal address mapping mechanism that handles multiple memory media interchangeably. The same control logic and mapping algorithms work across different media configurations, achieving high throughput through interleaved access while avoiding the need for media-specific complex mapping schemes.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The address mapping is performed dynamically based on the current access scenario and media availability. The controller adaptively distributes accesses across multiple media, adjusting the mapping in real-time to optimize throughput while keeping the mapping logic itself relatively simple through dynamic rather than static complexity.

Inventive Principle:
Principle #15Dynamics

4Adaptability or versatility

If address mapping from logical to physical addresses is performed for each access, then adaptability is improved, but loss of time increases due to mapping overhead

Engineering Contradiction:
Improveaddress flexibilityVSAvoidmapping overhead time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The memory controller performs address mapping in advance as part of the access scenario optimization process. By precomputing and storing the optimized access scheme with resolved physical addresses, the system eliminates the need for time-consuming mapping operations during actual data access, reducing mapping overhead while preserving address flexibility through the optimization phase.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12399815B2Method and memory controller for optimizing an access scheme for memory access of a host to a data memory
Publication Date: 2025.08.26 HYPERSTONE GMBH
  • US12399815B2 patent drawing
  • US12399815B2 patent drawing
  • US12399815B2 patent drawing

AI summary

Systems and methods are provided for optimizing an access scheme for memory accesses by a host to a data memory managed by a memory controller with one or more memory media. An access scenario communicated by the host is received by the memory controller, An optimized access scheme is determined that defines a specific sequence of physical memory accesses to the data memory to be executed by the memory controller to implement the access scenario. The optimization shortens a total access time for the access scenario, by modifying a memory access by means of a shift of a respective physical memory area to be addressed thereby in relation to an address mapping and/or by means of a temporal advancement of the respective memory access. Access information defining the optimized access scheme is then stored to allow it to subsequently be automatically executed in response to a call.