Hybrid Hierarchical Cache Split Eviction Coordination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current graphics processing systems face limitations in efficiently processing graphics data due to reliance on fixed function computational units and lack of parallel processing capabilities, especially in handling complex graphics operations like tessellation and texture mapping.

Innovation Solution

The implementation of a graphics processing unit (GPU) with a parallel processor architecture that includes a scheduler, processing clusters, and memory crossbar, enabling parallel processing of graphics operations through SIMT architectures and dedicated circuitry for efficient command execution.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If fixed function computational units are used for graphics processing, then device complexity is reduced and ease of manufacture is improved, but adaptability and versatility are limited

Engineering Contradiction:
Improveease of manufactureVSAvoidadaptability
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent implements a unified functional unit that can perform multiple graphics operations (tessellation, texture mapping, rasterization, etc.) through programmable instructions rather than dedicated hardware for each function. This allows a single computational unit to replace multiple fixed-function units, improving adaptability while maintaining manufacturing simplicity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Productivity

If parallel processing capabilities are added to handle complex graphics operations, then productivity and processing speed are improved, but device complexity increases

Engineering Contradiction:
Improveprocessing efficiencyVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the graphics processing system into multiple functional units that can operate in parallel, each handling specific graphics operations. By segmenting the processing tasks and distributing them across multiple units with shared resources, the system achieves high parallel processing capability without proportionally increasing overall system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent combines multiple graphics processing functions (tessellation, texture mapping, rasterization, depth testing) into a unified architectural framework where functional units share common resources such as memory interfaces, control logic, and data pathways. This merging approach enables parallel processing of complex graphics operations while avoiding the complexity of completely separate dedicated hardware for each function.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If more processing clusters are added to increase parallel processing capacity, then productivity is improved, but device complexity and manufacturing difficulty increase

Engineering Contradiction:
Improveparallel processing capacityVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent employs identical or similar functional unit designs that can be replicated and configured in different numbers to match processing requirements. Each functional unit is designed to be universally applicable for multiple graphics operations, allowing the system to scale productivity by adding more of the same modular unit rather than designing increasingly complex heterogeneous systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11263152B2Replacement policies for a hybrid hierarchical cache
Publication Date: 2022.03.01 INTEL CORP
  • US11263152B2 patent drawing
  • US11263152B2 patent drawing
  • US11263152B2 patent drawing

AI summary

A hybrid hierarchical cache is implemented at the same level in the access pipeline, to get the faster access behavior of a smaller cache and, at the same time, a higher hit rate at lower power for a larger cache, in some embodiments. A split cache at the same level in the access pipeline includes two caches that work together. In the hybrid, split, low level cache (e.g., L1) evictions are coordinated locally between the two L1 portions, and on a miss to both L1 portions, a line is allocated from a larger L2 cache to the smallest L1 cache.