Duplicate Packet Detection Using Hash Signatures and Timestamps

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Network analyzers face challenges in accurately determining duplicate packets across multiple ports, leading to erroneous statistics and high memory and processing requirements, especially as network speeds increase.

Innovation Solution

A method and apparatus that utilize hash calculations and a fast lookup table to identify and discard duplicate packets by comparing unique signatures and timestamps, minimizing execution time and memory usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If copies of each packet are stored and compared to determine duplicates, then duplicate detection accuracy is improved, but memory requirements and processing cycles increase significantly

Engineering Contradiction:
Improveduplicate detection accuracyVSAvoidmemory requirements
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential identifying features of packets (source/destination IP addresses, ports, protocol type) to create a packet signature, rather than storing complete packet copies. This signature-based approach maintains duplicate detection accuracy while dramatically reducing memory requirements from storing entire packets to storing only key identifying fields.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transforms the packet comparison problem from comparing entire packet contents to comparing extracted parameter tuples (source IP, destination IP, source port, destination port, protocol). This parameter extraction and transformation reduces the data volume requiring storage and comparison while preserving the ability to identify duplicates.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If copies of each packet are stored and compared to determine duplicates, then duplicate detection accuracy is improved, but processing cycles increase significantly

Engineering Contradiction:
Improveduplicate detection accuracyVSAvoidprocessing cycles
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts only the essential identifying features of packets (source/destination IP addresses, ports, protocol type) to create a packet signature, rather than storing complete packet copies. This signature-based approach maintains duplicate detection accuracy while dramatically reducing memory requirements from storing entire packets to storing only key identifying fields.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transforms the packet comparison problem from comparing entire packet contents to comparing extracted parameter tuples (source IP, destination IP, source port, destination port, protocol). This parameter extraction and transformation reduces the data volume requiring storage and comparison while preserving the ability to identify duplicates.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If network analyzer operates at higher network speeds, then productivity is improved, but memory and processing requirements increase

Engineering Contradiction:
Improvenetwork analysis speedVSAvoidmemory requirements
Core Design Contradiction:
ProductivityVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential identifying features of packets (source/destination IP addresses, ports, protocol type) to create a packet signature, rather than storing complete packet copies. This signature-based approach maintains duplicate detection accuracy while dramatically reducing memory requirements from storing entire packets to storing only key identifying fields.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by performing duplicate detection on only the essential packet parameters rather than analyzing complete packet contents. This selective processing approach provides sufficient duplicate detection capability for high-speed operation without the computational overhead of full packet analysis.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS8089869B2Method and apparatus of duplicate packet detection and discard
Publication Date: 2012.01.03 STANLEY ELECTRIC CO LTD
  • US8089869B2 patent drawing
  • US8089869B2 patent drawing
  • US8089869B2 patent drawing

AI summary

Duplicate packet detection and discard employs hash values and time stamps of received packet data, wherein the hash value is employed as an index to a table, and if data at a table entry has a time stamp near a time of the packet data, a duplicate is determined.