Near-Memory Controller Mode Switching for Memory Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing computational demands of electronic devices pose challenges in efficiently allocating high-capacity and high-speed memory resources, particularly due to limited resources and the need for optimized memory channel control to enhance processing speed, reduce power consumption, and support various memory layers.

Innovation Solution

The implementation of a system-on-chip (SoC) with near-memory and far-memory controllers, allowing memory channels to operate in multiple modes, with the near-memory device supporting both cache and main memory operations based on mode settings, and the far-memory device providing additional storage capacity with independent control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If a high-capacity memory device is allocated for all calculations/computations, then the storage capacity is improved, but the resource allocation efficiency deteriorates due to limited electronic device resources

Engineering Contradiction:
Improvememory capacityVSAvoidresource allocation efficiency
Core Design Contradiction:
Quantity of substanceVSProductivity

Solution Approach 1:

The memory system is segmented into multiple independent memory channels (first memory channel, second memory channel) that can be independently controlled and configured. Each channel can operate in different modes (cache mode, main memory mode) based on specific computational needs, allowing efficient resource allocation without sacrificing overall capacity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The memory channels are designed to dynamically change their operation modes based on computational requirements. The first memory channel can switch between cache mode and main memory mode through mode register write commands, enabling the system to adapt resource allocation to varying computational demands in real-time.

Inventive Principle:
Principle #15Dynamics

2Device complexity

If memory channels are controlled with fixed modes, then the device complexity is reduced, but the adaptability to different calculation types deteriorates

Engineering Contradiction:
Improvememory control complexityVSAvoidmemory mode adaptability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The memory channels utilize mode register write (MRW) commands to change operational parameters such as cache line size, timing parameters, and memory mode configuration. This allows the same hardware to support multiple operation modes (cache mode, main memory mode) by simply changing register values without modifying the physical structure or control logic complexity.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If a single memory controller manages all memory channels, then the device complexity is reduced, but the processing speed deteriorates due to resource bottlenecks

Engineering Contradiction:
Improvecontroller structure complexityVSAvoiddata processing speed
Core Design Contradiction:
Device complexityVSSpeed

Solution Approach 1:

The memory controller is segmented into multiple independent controllers (first memory controller, second memory controller) that can independently manage different memory channels. This parallel control structure eliminates bottlenecks by allowing simultaneous operation of multiple memory channels without interference, thereby increasing overall data processing speed while maintaining relatively simple individual controller designs.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11790963B2Electronic device including near-memory supporting mode setting, and method of operating the same
Publication Date: 2023.10.17 SAMSUNG ELECTRONICS CO LTD
  • US11790963B2 patent drawing
  • US11790963B2 patent drawing
  • US11790963B2 patent drawing

AI summary

An electronic device includes: a system-on-chip (SoC) including a processor, a near-memory controller controlled by the processor, and a far-memory controller controlled by the processor; a near-memory device including a first memory channel configured to communicate with the near-memory controller and operate in a first mode of a plurality of modes, and a second memory channel configured to communicate with the near-memory controller and operate in a second mode different from the first mode from among the plurality of modes; and a far-memory device configured to communicate with the far-memory controller. The first memory channel is further configured to, based on a command from the near-memory controller, change an operation mode from the first mode to the second mode.