Multibank Coherence Controller for Concurrent Shared Memory Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Multi-core systems face coherency issues due to multiple processing cores accessing shared memory addresses, leading to operational inefficiencies and potential data inconsistencies.

Innovation Solution

The implementation of a multi-core shared memory controller (MSMC) that includes a snoop filter bank, a cache tag bank, and a memory bank, connected through coherent slave interfaces and an external memory master interface, to manage and maintain memory coherency across processor packages.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If software cache maintenance operations are used to provide coherency, then coherency can be maintained, but operational efficiency deteriorates (slow operations, excessive operational time consumption)

Engineering Contradiction:
Improvememory coherencyVSAvoidoperational efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent replaces software-based cache maintenance operations with a hardware-based coherency controller that automatically monitors and manages cache coherency. The coherency controller includes snoop filter banks, cache tag banks, and memory banks that operate in parallel to detect and resolve coherency issues without software intervention, thereby maintaining reliability while dramatically improving operational efficiency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a coherency controller as an intermediary component between processing cores and memory devices. This intermediary automatically handles coherency management by intercepting memory requests, checking cache states, and coordinating data access across multiple cores, eliminating the need for inefficient software-based coherency maintenance while preserving data consistency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If multiple processing cores access shared memory addresses simultaneously, then processing parallelism is improved, but coherency issues arise (data inconsistencies)

Engineering Contradiction:
Improveprocessing parallelismVSAvoiddata coherency
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent implements a feedback mechanism where the coherency controller continuously monitors cache access patterns and memory requests from multiple processing cores. When coherency violations are detected through snoop operations, the controller automatically initiates corrective actions such as cache line invalidation or data synchronization, providing real-time feedback that maintains data coherency while allowing parallel processing to continue.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent employs preliminary action by having the coherency controller proactively check cache states and predict potential coherency conflicts before they occur. The snoop filter banks pre-screen memory requests against cached data, and the controller preemptively resolves coherency issues by coordinating data transfers or invalidating stale cache entries before inconsistent data can be accessed, thus maintaining reliability without hindering parallelism.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250181238A1Multicore, multibank, fully concurrent coherence controller
Publication Date: 2025.06.05 TEXAS INSTRUMENTS INC
  • US20250181238A1 patent drawing
  • US20250181238A1 patent drawing
  • US20250181238A1 patent drawing

AI summary

A system includes a multi-core shared memory controller (MSMC). The MSMC includes a snoop filter bank, a cache tag bank, and a memory bank. The cache tag bank is connected to both the snoop filter bank and the memory bank. The MSMC further includes a first coherent slave interface connected to a data path that is connected to the snoop filter bank. The MSMC further includes a second coherent slave interface connected to the data path that is connected to the snoop filter bank. The MSMC further includes an external memory master interface connected to the cache tag bank and the memory bank. The system further includes a first processor package connected to the first coherent slave interface and a second processor package connected to the second coherent slave interface. The system further includes an external memory device connected to the external memory master interface.