Context Specifier Override for Memory Access Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computing systems face inefficiencies in memory access due to the tradeoff between storage capacity and access speed, where fast memories have limited capacity and large-capacity memories have slow access speeds, and existing virtual and physical address translation methods do not effectively optimize performance across different memory types.

Innovation Solution

The method involves overriding attributes in the page table data structure and translation lookaside buffer (TLB) using a context specifier to directly translate virtual addresses to physical addresses, bypassing traditional page table and TLB mappings, thereby optimizing memory access by allowing context-specific overrides and eliminating the need for TLB hits and page table walks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If traditional page table and TLB translation methods are used, then address translation is performed according to standard virtual memory protocols, but memory access latency increases and performance is reduced due to the need for TLB hits and page table walks

Engineering Contradiction:
Improvememory access latencyVSAvoidmemory access efficiency
Core Design Contradiction:
Loss of timeVSProductivity

Solution Approach 1:

The patent extracts the address translation process from the traditional page table and TLB hierarchy by introducing context specifiers that directly override translation attributes. This allows the system to bypass the conventional translation path and achieve faster memory access without requiring TLB hits or page table walks, directly resolving the latency vs. efficiency contradiction

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies preliminary action by pre-configuring context specifiers with translation attributes before memory access occurs. These context specifiers contain pre-determined override values for page table attributes, allowing the system to immediately apply optimized translation parameters without real-time computation, thereby reducing access latency while maintaining translation accuracy

Inventive Principle:
Principle #10Preliminary action

2Productivity

If context specifiers with override attributes are implemented, then memory access performance is optimized by bypassing traditional translation mechanisms, but system complexity increases due to the need for context specifier management

Engineering Contradiction:
Improvememory access efficiencyVSAvoidtranslation system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies universality by designing context specifiers as multi-functional structures that serve both as address translation identifiers and as carriers for override attributes. This single structure performs multiple functions (context identification, attribute storage, and translation control), reducing the need for separate management mechanisms and thereby limiting the increase in system complexity while achieving improved memory access efficiency

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS8359454B2Memory access techniques providing for override of page table attributes
Publication Date: 2013.01.22 NVIDIA CORP
  • US8359454B2 patent drawing
  • US8359454B2 patent drawing
  • US8359454B2 patent drawing

AI summary

A memory access technique, in accordance with one embodiment of the present invention, includes selectively overriding attributes contained in a translation lookaside buffer or page table data structure with attributes contained in a context specifier.