TCAM Power Budget Pre-processing for Dynamic Current Amortization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Large capacity ternary content addressable memory (TCAM) systems in network devices face high dynamic power consumption and thermal management issues due to increased data traffic, leading to excessive power dissipation and secondary packaging problems.

Innovation Solution

Implementing a power budget aware pre-processing system that intelligently pipelines lookup requests, splitting them across different memory blocks of the TCAM to reduce instantaneous current demand and dynamic power consumption, allowing lookups to complete within a single clock cycle while minimizing performance impact.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If large capacity TCAM is implemented to handle larger data traffic volumes, then productivity is improved, but power consumption and thermal management become worse

Engineering Contradiction:
Improvedata traffic handling capacityVSAvoiddynamic power consumption
Core Design Contradiction:
ProductivityVSUse of energy by stationary object

Solution Approach 1:

The TCAM is divided into multiple blocks that can be independently activated. The controller selectively activates only the necessary blocks based on the lookup request, reducing the total number of search lines active at any given time. This segmentation allows the system to handle large capacity requirements while reducing power consumption by not activating all blocks simultaneously.

Inventive Principle:
Principle #1Segmentation

2Productivity

If large capacity TCAM is implemented to handle larger data traffic volumes, then productivity is improved, but thermal management becomes worse

Engineering Contradiction:
Improvedata traffic handling capacityVSAvoidthermal management
Core Design Contradiction:
ProductivityVSTemperature

Solution Approach 1:

By segmenting the TCAM into blocks and activating only necessary portions, the system reduces overall power dissipation and heat generation, improving thermal management while maintaining high productivity.

Inventive Principle:
Principle #1Segmentation

3Speed

If precharging match lines for all memory blocks is performed, then lookup speed is improved, but instantaneous current demand becomes worse

Engineering Contradiction:
Improvelookup speedVSAvoidinstantaneous current demand
Core Design Contradiction:
SpeedVSPower

Solution Approach 1:

The system segments the memory blocks into multiple groups and precharges match lines for only the active blocks rather than all blocks. This reduces the instantaneous current demand while maintaining fast lookup speeds for the active portions of the memory.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs precharging in periodic cycles, charging match lines for active blocks before lookup operations. This periodic precharging approach ensures fast lookup speeds when needed while limiting instantaneous current demand to manageable levels.

Inventive Principle:
Principle #19Periodic action

4Reliability

If all memory blocks are activated for lookup, then lookup completeness is improved, but voltage swings become worse

Engineering Contradiction:
Improvelookup completenessVSAvoidvoltage swings
Core Design Contradiction:
ReliabilityVSStress or pressure

Solution Approach 1:

The TCAM is segmented into blocks that can be independently activated. The controller activates only the necessary blocks for a given lookup request, reducing voltage swings while maintaining lookup completeness through selective activation of relevant blocks.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentEP3703057B1Amortizing dissipated power and current demand in a ternary content addressable memory
Publication Date: 2024.10.23 PALO ALTO NETWORKS INC
  • EP3703057B1 patent drawingFigure 1
  • EP3703057B1 patent drawingFigure 2
  • EP3703057B1 patent drawingFigure 3

AI summary

To use larger capacity TCAMs while avoiding various packaging and power management issues of TCAMs, pre-processing can be performed on TCAM lookup requests to intelligently pipeline lookup requests according to a defined power budget that is based on TCAM and power supply specifications. Dividing lookup requests based on a power budget smooths the instantaneous current demand and dynamic power demand. This intelligent pre-processing of lookup requests allows lookup requests that satisfy a power budget based threshold to still complete within a single clock cycle while nominally reducing performance for those lookup requests that would not satisfy the power budget based threshold. When a lookup request will not satisfy the power budget based threshold, the lookup request is split into searches targeting different memory blocks of the TCAM