Memory Controller Data Routing by Importance Level

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing memory systems do not efficiently differentiate between important and unimportant data when transferring them to memory devices, leading to slower execution of critical commands.

Innovation Solution

A memory apparatus with a controller that assigns an importance level to write requests based on data type and hierarchy, then transfers data to memory devices with varying write latencies accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If data is transferred to memory devices without differentiation based on importance, then memory resource utilization is simplified, but execution speed of critical commands deteriorates

Engineering Contradiction:
Improveexecution speed of critical commandsVSAvoidmemory management complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent segments memory devices into different tiers based on write latency characteristics (first memory device with higher write latency, second memory device with lower write latency). The controller segments data into important and unimportant categories, directing important data to the second memory device and unimportant data to the first memory device, thereby achieving differentiated speed performance without requiring a completely complex memory architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by assigning different importance levels to different data based on their characteristics (e.g., safety-related data marked as important, infotainment data marked as unimportant). This allows critical commands to be stored in the faster second memory device while less critical data resides in the first memory device, optimizing execution speed for critical operations without uniformly increasing complexity across all memory operations.

Inventive Principle:
Principle #3Local quality

2Productivity

If all data is transferred to the same memory device, then memory management is simpler, but overall system productivity deteriorates

Engineering Contradiction:
Improvesystem productivityVSAvoiddata transfer management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements dynamic data placement by continuously evaluating the importance level of incoming data and routing it to appropriate memory devices. The controller dynamically adjusts data placement decisions based on real-time assessment of data characteristics and memory device status, thereby improving overall system productivity through adaptive resource allocation rather than static memory management.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The controller acts as an intermediary between the host system and memory devices, intelligently routing data based on importance levels. This intermediary function manages the complexity of differentiated data transfer by centralizing decision-making logic in the controller, which evaluates data importance and selects appropriate memory devices, thereby improving productivity without requiring complex changes to the overall system architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If important data is prioritized for transfer to low-latency memory, then execution speed of critical commands improves, but memory resource utilization efficiency may worsen

Engineering Contradiction:
Improvereliability of critical command executionVSAvoidmemory resource utilization efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent extracts important data from the general data stream and directs it specifically to the second memory device with lower write latency. By separating important data (such as safety-critical vehicle commands) from unimportant data (such as infotainment or logging data), the system ensures reliable and fast execution of critical commands while maintaining efficient utilization of both memory devices through appropriate workload distribution.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12292843B2Transferring data to a memory device based on importance
Publication Date: 2025.05.06 MICRON TECHNOLOGY INC
  • US12292843B2 patent drawing
  • US12292843B2 patent drawing
  • US12292843B2 patent drawing

AI summary

Systems, apparatuses, and methods related to transferring data to a memory device based on importance are described. A memory apparatus includes a first memory device, a second memory device having a lower write latency than the first memory device, and a controller coupled to the first memory device and second memory device via a compute express link (CXL) interface. The controller is configured to assign an importance level to a write request based on data associated with the write request, a hierarchy of importance levels for different data types, and the second memory device having a lower write latency than the first memory device. The controller is further configured to transfer the data to the first memory device in response to the assigned importance level having a first value and transfer the data to the second memory device in response to the assigned importance level having a second value.