Translation Buffer Invalidation via Context-Specific Signals

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In data processing systems, address translation data distribution leads to coherency management issues that can constrain processing performance, as existing mechanisms for managing coherency may slow down operations.

Innovation Solution

The implementation of translation buffer invalidation signals that specify a given address translation context, allowing for targeted and efficient invalidation of address translation data in distributed translation buffers, ensuring consistency without unnecessary data removal or transaction aborts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If address translation data is distributed throughout the system in local translation buffers, then processing speed is improved due to local availability, but coherency management complexity increases

Engineering Contradiction:
Improveprocessing speedVSAvoidcoherency management complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The system divides address translation data into segments stored in multiple local translation buffers distributed throughout the system, each serving its local processing element. This segmentation enables fast local access while the coherency management system tracks and manages the distributed segments through context identifiers and invalidation signals.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces coherency management mechanisms as intermediaries that mediate between distributed translation buffers. These intermediaries use context identifiers (VMID, ASID) to track which buffers hold valid translation data for given contexts, and broadcast invalidation signals when translations need to be updated, thus managing the complexity of distributed coherency.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If existing coherency management mechanisms are used to manage distributed address translation data, then data consistency is maintained, but processing performance is constrained

Engineering Contradiction:
Improvedata consistencyVSAvoidprocessing performance
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system performs preliminary actions by pre-establishing context identifiers (VMID, ASID) in translation buffers before address translation operations. When coherency updates are needed, invalidation signals carrying these context identifiers are broadcast in advance, allowing translation buffers to proactively invalidate their entries without waiting for actual translation requests, thus maintaining consistency without blocking performance.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes the parameter space for coherency management by introducing context-specific identifiers (VMID, ASID) rather than using global invalidation flags. This allows translation buffers to selectively invalidate only those entries relevant to the given context, reducing unnecessary invalidations and maintaining high processing performance while ensuring data consistency for active contexts.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If translation buffer invalidation signals are broadcast to all translation buffers, then address translation coherence is ensured, but unnecessary data flushes and transaction aborts occur

Engineering Contradiction:
Improveaddress translation coherenceVSAvoidtime lost to unnecessary flushes and aborts
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system applies local quality by making translation buffer invalidation selective rather than universal. Each translation buffer compares the context identifier in the invalidation signal with its own stored context identifier, and only invalidates entries if they match. This localized validation ensures coherence for the specific context while avoiding unnecessary flushes and transaction aborts in buffers handling different contexts.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements partial action by broadcasting invalidation signals with specific context identifiers to all translation buffers, but only having those buffers act on the signal if their context matches. This approach is more comprehensive than targeted invalidation (as it reaches all buffers) but less destructive than universal invalidation, achieving the right balance between ensuring coherence and minimizing performance impact.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11615032B2Address translation data invalidation
Publication Date: 2023.03.28 ARM LTD
  • US11615032B2 patent drawing
  • US11615032B2 patent drawing
  • US11615032B2 patent drawing

AI summary

A data processing system (2) including one or more transaction buffers (16, 18, 20) storing address translation data executes translation buffer invalidation instructions TLBI within respective address translation contexts VMID, ASID, X. Translation buffer invalidation signals generated as a consequence of execution of the translation buffer invalidation instructions are broadcast to respective translation buffers and include signals which specify the address translation context of the translation buffer invalidation instruction that was executed. This address translation context specified within the translation buffer invalidation signals is used to gate whether or not those translation buffer invalidation signals when received by translation buffers which are potential targets for the invalidation are or are not flushed. The address translation context data provided within the translation buffer invalidation signals may also be used to control whether or not local memory transactions for a local transactional memory access are or are not aborted upon receipt of the translation buffer invalidation signals.