CAM Record Compression for High-Capacity Network Packet Search

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current network communication systems face inefficiencies in storing and searching large numbers of network packets due to the need to store and compare extensive amounts of data, which can lead to increased storage requirements and processing complexities.

Innovation Solution

The implementation of a content addressable memory (CAM) system that compresses data by identifying and storing similar bit values in a single sample record, allowing for rapid searches and reducing the amount of data stored, while maintaining the ability to perform priority resolution and handle various network protocols.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If data is stored in traditional memory structures, then storage capacity is sufficient, but storage requirements increase and processing complexity increases

Engineering Contradiction:

Improvestorage capacityVSAvoidprocessing complexity

Core Design Contradiction:

Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent merges multiple identical or similar records into a single compressed representation by identifying common bit patterns across records. Instead of storing each record separately, the system combines shared data portions into one storage unit, reducing overall storage requirements and simplifying processing operations.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The compressed record structure serves multiple functions simultaneously: it stores data compactly, enables efficient searching through pattern matching, and maintains the ability to reconstruct individual records when needed. This multi-functionality resolves the contradiction by making the storage system both space-efficient and operationally simple.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Measurement precision

If all records are stored individually in CAM, then search accuracy is maintained, but storage requirements increase

Engineering Contradiction:

Improvesearch accuracyVSAvoidstorage requirements

Core Design Contradiction:

Measurement precisionVSQuantity of substance

Solution Approach 1:

Multiple records with identical or similar bit patterns are merged into a single compressed record representation. This merging reduces storage requirements while preserving the ability to perform accurate searches by matching patterns against the compressed data structure.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

Instead of storing redundant copies of identical record portions, the system creates a single master copy of the common data and references it across multiple records. This copying approach maintains search accuracy while eliminating duplicate storage.

Inventive Principle:

Principle #26Copying

3Quantity of substance

If compression is applied to reduce storage, then storage requirements decrease, but device complexity increases

Engineering Contradiction:

Improvestorage requirementsVSAvoidcompression algorithm complexity

Core Design Contradiction:

Quantity of substanceVSDevice complexity

Solution Approach 1:

The compression process is segmented into distinct phases: identification of similar bit patterns, creation of compressed representations, and storage of metadata for reconstruction. This segmentation simplifies the overall complexity by breaking down the compression task into manageable, independent steps.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system performs preliminary analysis to identify common bit patterns across records before compression occurs. By pre-identifying which data portions are identical or similar, the system simplifies the subsequent compression process and avoids complex real-time analysis during storage operations.

Inventive Principle:

Principle #10Preliminary action

4Speed

If uncompressed records are searched, then search speed is maintained, but energy consumption increases

Engineering Contradiction:

Improvesearch speedVSAvoidenergy consumption

Core Design Contradiction:

SpeedVSUse of energy by moving object

Solution Approach 1:

Multiple records are merged into a single compressed representation, reducing the total number of records that need to be searched. This merging maintains search speed by enabling pattern matching against the compressed structure while reducing energy consumption through fewer comparison operations.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS9262312B1Apparatus and methods to compress data in a network device and perform content addressable memory (CAM) processing

Publication Date: 2016.02.16 CORIGINE ELECTRONICS TECH CO LTD

AI summary

The present disclosure describes systems and techniques relating to processing of network communications. According to an aspect of the described systems and techniques, a network device includes a content addressable memory (CAM); and processing circuitry configured to receive records to be stored in the CAM, compare the records to identify similar bit values at respective bit positions of at least a portion of the records, store in the CAM the similar bit values in a single sample record corresponding to the portion of the records, store in the CAM remaining non-similar bit values of the portion of the records, thereby compressing the portion of the records stored in the CAM, store in the CAM one or more remaining records of the received records not included in the portion of the records, and search the CAM including the compressed portion of the records and the one or more remaining records.