Age-Based Miss Replay Shared Resource Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Designing and building systems that efficiently access and utilize shared resources, such as memory, is complex and resource-intensive, particularly due to differences in storage capacity and access speeds across various memory types, and errors can occur during virtual to physical memory space translation.

Innovation Solution

A shared resource management system that includes multiple engines and a shared resource management unit, which handles multiple outstanding hit, miss, and miss under miss requests, utilizing age-based request processing to efficiently manage memory access and translate virtual addresses to physical addresses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional virtual to physical memory space translation is used, then memory access can be performed, but errors or faults occur when translation map or physical page is not resident

Engineering Contradiction:
Improvetranslation accuracyVSAvoidtranslation management complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a translation pre-check mechanism that validates the presence and correctness of translation map entries and physical pages before performing the actual translation operation. This preliminary validation prevents faults from occurring during translation, thereby improving reliability without significantly increasing the complexity of the translation process itself.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If multiple memory types with different storage capacities and access speeds are used, then storage capacity and speed requirements can be met, but coordinating access to shared resources becomes highly complex and resource intensive

Engineering Contradiction:
Improvememory access efficiencyVSAvoidaccess coordination complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent creates a universal shared resource management interface that handles multiple memory types through a unified access protocol. This interface abstracts the differences between various memory types, allowing them to be accessed through the same mechanism while maintaining their individual characteristics, thereby reducing access coordination complexity while preserving memory access efficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces a shared resource management unit that acts as an intermediary between processing engines and multiple memory types. This intermediary translates and coordinates access requests, managing the complexity of coordinating access to shared resources while maintaining high productivity for memory operations.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Speed

If fast access memory with small storage capacity is used, then access speed is improved, but storage capacity is limited

Engineering Contradiction:
Improvememory access speedVSAvoidstorage capacity
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent implements a nested memory hierarchy where fast access memory and bulk storage memory are organized in layers. The shared resource management unit intelligently nests data structures across these layers, placing frequently accessed data in fast memory while maintaining capacity for larger datasets in bulk storage, thereby achieving both high speed and adequate storage capacity.

Inventive Principle:
Principle #7Nested doll (Nesting)

Data Source

PatentUS8533425B1Age based miss replay system and method
Publication Date: 2013.09.10 NVIDIA CORP
  • US8533425B1 patent drawing
  • US8533425B1 patent drawing
  • US8533425B1 patent drawing

AI summary

A shared resource management system and method are described. In one embodiment, a shared resource management system facilitates age based miss replay. In one exemplary implementation, a shared resource management system includes a plurality of engines, and a shared resource a shared resource management unit. The plurality of engines perform processing. The shared resource supports the processing. The shared resource management unit handles multiple outstanding miss requests.