Network Request Tag Hashing for Latency Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The addition of tags to requests in data centers leads to delays and overhead as the size and number of tags increase, affecting the processing efficiency of network resource allocation and utilization.

Innovation Solution

Determining a representative value for a set of tags through hashing or compression operations, allowing requests to be processed more expeditedly and enabling the reconstruction of original tag sets for reporting purposes, while reducing latency and overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If tags are added to requests for monitoring usage along business dimensions, then reporting accuracy and business dimension tracking are improved, but processing latency and overhead increase

Engineering Contradiction:
Improvereporting accuracyVSAvoidprocessing latency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the tag processing into two distinct phases: (1) During request processing, only the hash value of the tag set is computed and attached to the request for efficient routing, while the original tags are stored separately in a data structure indexed by the hash value. (2) During reporting, the original tags are retrieved using the hash value as an index. This segmentation allows request processing to proceed quickly with minimal overhead while preserving complete tag information for accurate reporting.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a hash value as an intermediary between the original tag set and the request processing system. The hash value serves as a compact representation that can be efficiently processed during request handling, while the full tag set is preserved in a separate data structure. This intermediary enables the system to work with a simplified representation during critical processing paths while maintaining complete information for reporting purposes.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If the number and size of tags increase to track more applications and services, then monitoring capability and reporting detail are improved, but processing overhead and delays increase

Engineering Contradiction:
Improvemonitoring capabilityVSAvoidprocessing efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent transforms the tag set into a different parameter form - specifically, it computes a hash value from the original tags. This parameter transformation reduces the size and complexity of the data that must be processed during request handling, while the original tag set is preserved in an indexed data structure. The hash value provides a compact, fixed-size representation that can be efficiently processed even when the original tag sets are large and varied in composition.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If original tag sets are preserved for reporting purposes, then reporting accuracy is improved, but memory usage and storage overhead increase

Engineering Contradiction:
Improvereporting accuracyVSAvoidmemory usage
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent performs preliminary organization of the tag data by storing it in an indexed data structure where the hash value serves as the index key. This preliminary action allows the system to efficiently retrieve only the specific tag sets needed for reporting by using the hash value as an index, rather than storing and searching through all possible tag sets. The indexing structure optimizes memory usage by enabling direct access to the required data.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8990398B1Systems and methods for processing requests for network resources
Publication Date: 2015.03.24 AMAZON TECH INC
  • US8990398B1 patent drawing
  • US8990398B1 patent drawing
  • US8990398B1 patent drawing

AI summary

Systems and methods for processing requests associated with network resources and/or virtualization services are provided. A request associated with one or more network resources may be received, and a set of one or more tags associated with the request may be identified. A representative value for the set of one or more tags may then be determined utilizing, for example, a hashing operation or a compression function. The representative value may be associated with a request prior to the request being processed by at least one network server. Subsequently, the set of one or more tags may reconstructed based at least in part upon the representative value in order to facilitate the generation of one or more reports, such as billing reports or resource usage reports.