Dynamic TLB Management for Variable Page Sizes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing memory management systems in processing systems are limited by their static or hardware-restricted implementation of multiple page sizes, which restricts versatility and increases costs, while also experiencing performance issues due to fixed page sizes that do not adapt to dynamic memory needs.

Innovation Solution

A processing system with memory management software that updates translation lookaside buffers based on missed virtual addresses, using separate TLBs for different page sizes, allowing for dynamic adjustment and caching of page table entries with varying page sizes to enhance translation efficiency and reduce TLB misses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple page sizes are implemented using hardware, then translation efficiency is improved, but device complexity and cost increase significantly

Engineering Contradiction:
Improvetranslation efficiencyVSAvoidhardware complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces the traditional hardware-based TLB multiplication approach with a software-based memory management system. Instead of using multiple hardware TLBs with different characteristics for different page sizes, the invention uses a single TLB combined with software algorithms that dynamically manage page table entries and simulate multiple TLB behaviors through software-controlled caching and translation strategies.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent implements a universal memory management approach where a single memory management system handles multiple page sizes dynamically. The system uses a unified TLB that can be software-configured to support different page sizes through dynamic page table entry management, eliminating the need for separate dedicated TLBs for each page size category.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If fixed page sizes are used, then hardware implementation is simplified, but adaptability to dynamic memory needs is reduced

Engineering Contradiction:
Improveadaptability to memory needsVSAvoidsystem flexibility
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic page size management where the memory management system can adaptively adjust page size handling based on actual memory access patterns and system needs. The system dynamically creates and manages page table entries for different page sizes and uses software-controlled TLB updates to optimize translation performance for varying memory requirements without hardware reconfiguration.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of page size from fixed hardware-defined values to dynamically adjustable parameters controlled by software. The memory management system can modify which page sizes are active, how many page table entries are created, and how TLB updates are prioritized based on real-time system demands, enabling flexible adaptation to different memory access patterns.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If large page sizes are used, then TLB misses are reduced, but memory access granularity control is reduced

Engineering Contradiction:
ImproveTLB hit rateVSAvoidmemory access granularity
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent segments the memory management approach by creating multiple page table entry structures with different granularity levels. The system maintains the ability to create fine-grained page tables for precise memory control when needed, while also maintaining a simplified large-page mode for high TLB hit rates. The software manager dynamically selects which segmentation level to use based on access patterns, combining the benefits of both fine-grained control and coarse-grained efficiency.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS7793070B2Processing system implementing multiple page size memory organization with multiple translation lookaside buffers having differing characteristics
Publication Date: 2010.09.07 MALIKIE INNOVATIONS LTD
  • US7793070B2 patent drawing
  • US7793070B2 patent drawing
  • US7793070B2 patent drawing

AI summary

A processing system includes memory management software responsive to a translation lookaside buffer miss. The memory management software updates translation lookaside buffer information based on one or more missed virtual addresses. Entries of a first translation lookaside buffer are updated by the memory management software with information corresponding to the missed virtual addresses if memory page size information for the missed virtual addresses meet a first criterion. Entries of a second translation lookaside buffer are updated by the memory management software with information corresponding to the missed virtual addresses if memory page size information for the missed virtual addresses meet a second criterion. The first and second criterion may correspond to first and second memory page sizes supported by the respective translation lookaside buffers.