Normalized Caching System for Service Request Parameter Standardization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing caching systems are inefficient in handling duplicate and non-identical data requests, leading to increased costs due to unnecessary transmissions and resource utilization, as they rely on exact matching of request parameters.

Innovation Solution

A normalized caching system that normalizes request parameters, such as addresses and timestamps, to generate a standardized request, allowing for cache hits even with parameter variations, thereby reducing the need for repeated service queries and enhancing cache hit rates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If exact matching of request parameters is used for cache lookup, then cache accuracy is ensured, but cache hit rate decreases

Engineering Contradiction:
Improvecache accuracyVSAvoidcache hit rate
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent transforms request parameters by normalizing their formats (e.g., standardizing date formats, trimming whitespace, converting case) before using them as cache keys. This parameter transformation allows semantically equivalent requests with different formatting to map to the same cache entry, improving cache hit rate while maintaining accuracy through controlled transformation rules

Inventive Principle:
Principle #35Parameter changes

2Reliability

If duplicate requests are processed without caching, then service consistency is maintained, but resource costs increase

Engineering Contradiction:
Improveservice consistencyVSAvoidresource costs
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The system performs preliminary normalization of request parameters before cache lookup, preparing the request in advance to match potential cached entries. This preliminary transformation enables the cache to effectively identify and serve duplicate or semantically equivalent requests, reducing resource costs while maintaining service consistency through the deterministic normalization process

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10146831B2Parameter normalization for improved cache hit rate
Publication Date: 2018.12.04 AMAZON TECH INC
  • US10146831B2 patent drawing
  • US10146831B2 patent drawing
  • US10146831B2 patent drawing

AI summary

A normalized caching system is configured to modify one or more parameters of a service request to generate a “normalized” service request, causing the service to return a normalized response. The normalized response is typically useful for servicing a wider range of subsequent requests than is a non-normalized response. Thus, a wider range of subsequent service requests can be serviced from the cache, without the need to send such service requests to the service.