Translation Lookaside Buffer Spatial Locality Entry Merging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The address translation process in computing systems with virtual memory introduces additional delays due to the need for memory translation, which can be mitigated but at the cost of increased system cost and power consumption with larger translation lookaside buffers (TLBs).

Innovation Solution

A TLB system that includes a content addressable memory (CAM) and random access memory (RAM) to efficiently compare virtual addresses to existing entries, adding new entries when matches are not found, and replacing existing entries to maintain optimal performance and reduce power consumption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If the translation lookaside buffer size is increased to reduce translation delays, then memory access speed is improved, but system cost and power consumption increase

Engineering Contradiction:
Improvememory access speedVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The patent segments the translation lookaside buffer into multiple sets, where each set contains a limited number of entries. This segmentation allows the system to maintain multiple smaller buffers instead of one large buffer, reducing the power consumption of any single buffer while collectively providing the same translation capacity. The processor can selectively activate only the necessary sets based on access patterns, further optimizing power usage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic management of TLB entries through replacement policies that actively monitor and replace least recently used entries. This dynamic approach ensures that the TLB maintains only the most relevant translation entries, optimizing the use of limited buffer resources and reducing the overall buffer size needed, thereby lowering power consumption while maintaining translation speed.

Inventive Principle:
Principle #15Dynamics

2Speed

If the translation lookaside buffer size is increased to reduce translation delays, then memory access speed is improved, but system cost increases

Engineering Contradiction:
Improvememory access speedVSAvoidsystem cost
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

By dividing the TLB into multiple smaller sets, the patent reduces the complexity of managing a single large buffer. Each set can be independently managed with simpler control logic, reducing the overall system complexity and cost. The segmented structure also allows for more efficient hardware implementation with reduced interconnect requirements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements a partial action approach by maintaining only the necessary number of translation entries in the TLB at any given time, rather than provisioning for all possible translations. The replacement policy ensures that entries are kept only as long as they are needed, allowing the system to use a smaller, more cost-effective buffer size while still achieving fast translation for active memory accesses.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If translation entries are maintained for multiple pages to improve prefetching, then memory access efficiency is improved, but the number of entries required increases

Engineering Contradiction:
Improvememory access efficiencyVSAvoidnumber of entries
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent merges multiple page translation entries into single TLB entries by storing base physical addresses for multiple pages that share the same virtual address prefix. This consolidation allows the TLB to service multiple page translation requests with a single entry, improving memory access efficiency for prefetching operations while significantly reducing the total number of entries required in the buffer.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9785574B2Translation lookaside buffer that employs spacial locality
Publication Date: 2017.10.10 ORACLE INT CORP
  • US9785574B2 patent drawing
  • US9785574B2 patent drawing
  • US9785574B2 patent drawing

AI summary

A system may include a memory that includes a plurality of pages, a processor, and a translation lookaside buffer (TLB) that includes a plurality of entries. The processor may be configured to access data from a subset of the plurality of pages dependent upon a first virtual address. The TLB may be configured to compare the first virtual address to respective address information included in each entry of the plurality of entries. The TLB may be further configured to add a new entry to the plurality of entries in response to a determination that the first virtual address fails to match the respective address information included in each entry of the plurality of entries. The new entry may include address information corresponding to at least two pages of the subset of the plurality pages.