Forwarding Database Cache for Packet Processing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current networking systems face performance bottlenecks due to the inefficiencies in cache systems, where cache misses lead to slower data retrieval from main storage, impacting overall system speed and scalability.

Innovation Solution

A forwarding database cache system that prioritizes searching a cache for packet address information before resorting to a main database, allowing for faster packet forwarding by storing a subset of searchable information in cache and the complete data in main memory, with options for separate or shared physical memory configurations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If a cache system is used to store forwarding database information, then packet forwarding speed is improved, but system complexity increases due to cache management overhead

Engineering Contradiction:
Improvepacket forwarding speedVSAvoidcache management complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The forwarding database is segmented into two parts: a cache portion for frequently accessed entries and a main database portion for complete storage. This segmentation allows fast lookup for common packets while maintaining comprehensive routing information, resolving the contradiction between speed and complexity by organizing data access patterns spatially

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The cache is pre-populated with frequently accessed forwarding database entries before packet arrival. This preliminary action ensures that common lookup operations can be performed rapidly without traversing the entire main database, improving packet forwarding speed while the cache structure manages complexity through pre-computed organization

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the cache stores a complete copy of the forwarding database, then cache hit rate increases, but memory usage and cost increase

Engineering Contradiction:
Improvecache hit rateVSAvoidmemory usage
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

Different portions of the forwarding database are stored in different locations: frequently accessed entries are placed in the cache with faster access characteristics, while less frequently accessed entries remain in the main database. This local quality differentiation optimizes cache hit rate for critical paths without requiring the cache to store the entire database, thus managing memory usage efficiently

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The most frequently accessed forwarding database entries are extracted from the main database and placed in the cache. This extraction strategy increases cache hit rate for common operations while the cache size remains proportional only to the frequency-accessible subset, not the entire database, thereby controlling memory usage

Inventive Principle:
Principle #2Taking out (Extraction)

3Productivity

If the cache is searched first for every packet, then forwarding speed improves for cached packets, but processing overhead increases for cache misses

Engineering Contradiction:
Improveforwarding throughputVSAvoidlookup time for cache misses
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The cache structure is designed to be dynamically adaptive, adjusting its content based on observed packet patterns. Frequently accessed entries are automatically maintained in the cache, while the system can adapt to changing traffic patterns. This dynamics ensures that the cache remains optimized for current traffic conditions, improving overall throughput while minimizing cache miss penalties through intelligent content management

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10419571B2Packet processor forwarding database cache
Publication Date: 2019.09.17 MARVELL ASIA PTE LTD
  • US10419571B2 patent drawing
  • US10419571B2 patent drawing
  • US10419571B2 patent drawing

AI summary

A forwarding database cache system is described herein. The forwarding database cache system includes a main forwarding database and one or more forwarding database caches. When a packet is received, the cache is searched first for information such as address information, and if found, then the packet is forwarded to the appropriate destination. If the address information is not found in the cache, then the main forwarding database is searched, and the packet is forwarded to the appropriate destination based on the information in the main forwarding database.