Memory Pipeline Controller for NVM Timing Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current processor pipelining techniques are not optimized for memory devices, leading to inefficiencies in memory access and operation, as they do not specifically address the unique timing and operational requirements of memory-based data flows.

Innovation Solution

A memory pipeline is introduced that includes a command queue and a pipeline monitor/controller block to dynamically adjust instruction issuance rates based on critical timing elements, optimizing data flow processes such as decoding, sensing, and error correction, thereby optimizing memory access and reducing back-to-back random access times.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If processor-based pipeline techniques are used in memory devices, then instruction execution throughput is improved, but memory access timing and operational requirements are not optimized

Engineering Contradiction:
Improveinstruction execution throughputVSAvoidmemory access timing optimization
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The pipeline is divided into distinct stages (fetch, decode, execute, write-back) that are specifically optimized for memory operations. Each stage handles specific memory-related tasks, allowing parallel processing of multiple memory access operations simultaneously while maintaining proper timing relationships.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The pipeline controller dynamically adjusts the timing and pacing of instruction flow through different pipeline stages based on memory access patterns and critical timing requirements. This allows the system to optimize for different memory operation types (sequential vs. random access) while maintaining high throughput.

Inventive Principle:
Principle #15Dynamics

2Productivity

If memory operations are executed sequentially, then timing control is simplified, but memory access speed and system performance deteriorate

Engineering Contradiction:
Improvememory access speedVSAvoidpipeline control structure
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

Instructions are fetched and decoded in advance before they are needed for execution. The pipeline controller prepares multiple instructions simultaneously at different pipeline stages, so that when a memory operation is required, the data is already ready, significantly reducing access latency.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

A pipeline controller acts as an intermediary that coordinates the flow of instructions through multiple pipeline stages. It manages the complexity of parallel operations by inserting appropriate delays, synchronizing data flow, and ensuring that memory operations are executed at optimal times without requiring complex timing logic in the underlying memory hardware.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If critical timing elements are prioritized for fastest execution, then memory pipeline efficiency is improved, but non-critical operations may be delayed

Engineering Contradiction:
Improvecritical operation timingVSAvoidnon-critical operation completion
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

Different pipeline stages and operations are assigned different priority levels based on their criticality. Critical memory operations (such as sense amplification and data latching) are given highest priority with dedicated timing slots, while less critical operations (such as control signal generation) can be delayed or executed in parallel without impacting overall system timing.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS8516181B1Memory devices having data flow pipelining
Publication Date: 2013.08.20 MICRON TECHNOLOGY INC
  • US8516181B1 patent drawing
  • US8516181B1 patent drawing
  • US8516181B1 patent drawing

AI summary

A memory device having a pipeline monitor and control block to issue a memory pipeline with process flows specific to NVM operation to optimize system performance.