Aggregated Memory Banks for Scalable Power Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current shared memory architectures face challenges in achieving high scalability and low power consumption while maintaining high performance, particularly due to frequency constraints and underutilization of memory bandwidth caused by read conflict issues and uneven write operations in dual-port solutions.

Innovation Solution

A system utilizing an aggregated memory element with multiple single-ported memory banks, managed by a memory controller and scoreboarding component, which allows for simultaneous read and write operations by prioritizing read access and using overflow memory banks to manage conflicts, effectively emulating a multi-ported RAM without the size and complexity limitations of true dual-ported RAMs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If a single bank of memory is operated at very high speeds, then memory bandwidth is maximized, but frequency constraints associated with manufacturing processes are exceeded

Engineering Contradiction:
Improvememory operating frequencyVSAvoidmanufacturing process feasibility
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The memory system is divided into multiple banks (first bank, second bank, etc.) that can operate independently at lower frequencies. This segmentation allows the system to achieve high overall bandwidth without requiring each individual bank to operate at excessively high frequencies that would exceed manufacturing process capabilities.

Inventive Principle:
Principle #1Segmentation

2Reliability

If dual-port solutions are used to reduce frequency, then manufacturing feasibility is improved, but silicon area consumption increases

Engineering Contradiction:
Improvemanufacturing process feasibilityVSAvoidsilicon area
Core Design Contradiction:
ReliabilityVSArea of stationary object

Solution Approach 1:

Instead of using a single dual-ported memory block that would consume twice the area, the system segments memory into multiple single-ported banks. This allows the same functionality to be achieved with smaller individual memory blocks, reducing total silicon area consumption while maintaining manufacturing feasibility through lower operating frequencies.

Inventive Principle:
Principle #1Segmentation

3Reliability

If multiple banks are used to reduce frequency constraints, then manufacturing feasibility is improved, but read conflict issues cause underutilization of memory bandwidth

Engineering Contradiction:
Improvemanufacturing process feasibilityVSAvoidmemory bandwidth utilization
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system implements dynamic arbitration and prioritization mechanisms that adaptively manage read and write operations across multiple banks. The arbitration logic dynamically assigns access rights to banks based on operational needs, preventing read conflicts and ensuring optimal bandwidth utilization while maintaining the benefits of multiple banks at lower frequencies.

Inventive Principle:
Principle #15Dynamics

4Ease of operation

If true dual-ported RAM is used, then simultaneous read and write operations are enabled, but RAM size and complexity increase linearly

Engineering Contradiction:
Improvesimultaneous read/write capabilityVSAvoidRAM structure complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system achieves simultaneous read and write capabilities by segmenting memory into multiple banks with independent control. Rather than using a single complex dual-ported RAM structure, multiple simpler single-ported banks are coordinated through arbitration logic, achieving the same functionality with reduced individual component complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple single-ported memory banks are merged to function as a unified multi-ported memory system. The arbitration and prioritization mechanisms merge the operations of individual banks into a coordinated system that provides simultaneous read and write access, achieving dual-ported functionality without requiring true dual-ported RAM hardware.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS8385148B2Scalable, dynamic power management scheme for switching architectures utilizing multiple banks
Publication Date: 2013.02.26 AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE LTD
  • US8385148B2 patent drawing
  • US8385148B2 patent drawing
  • US8385148B2 patent drawing

AI summary

According to one general aspect, a method may include receiving data from a network device. In some embodiments, the method may include writing the data to a memory bank that is part of a plurality of at least single-ported memory banks that have been grouped to act as a single at least dual-ported aggregated memory element. In various embodiments, the method may include monitoring the usage of the plurality of memory banks. In one embodiment, the method may include, based upon a predefined set of criteria, placing a memory bank that meets the predefined criteria in a low-power mode.