Dynamic Cache Freshness Check via Link Status

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional disk-based caching techniques for accelerating network traffic over wide area networks (WANs) face issues such as high memory consumption, inaccurate freshness values leading to stale data transmission, and security risks due to unauthenticated proxy servers, while existing prefetching methods do not significantly improve performance and can exacerbate delays.

Innovation Solution

The solution involves a multi-tiered caching system that optimizes storage based on object size, improves cache efficiency by reducing cache misses and validation requests, and enhances security by authenticating user requests before serving cached objects, along with techniques like protocol acceleration, domain name resolution acceleration, and compression improvements to accelerate HTTP and CIFS protocols.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If traditional disk-based caching techniques are used to accelerate network traffic, then network traffic acceleration is achieved, but memory consumption increases significantly

Engineering Contradiction:
Improvenetwork traffic accelerationVSAvoidmemory consumption
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The cache index is divided into multiple segments or partitions, allowing the memory footprint to be distributed and managed more efficiently. This segmentation enables the system to handle large cache capacities without requiring proportionally large amounts of contiguous memory, thus resolving the contradiction between acceleration performance and memory consumption.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a hierarchical or multi-dimensional cache structure that moves beyond traditional flat indexing. By organizing cache data in multiple dimensions (e.g., hierarchical levels, distributed partitions), the system achieves high-speed access without linearly increasing memory requirements, effectively resolving the speed-memory tradeoff.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If freshness values are used to determine cache validity, then cache transmission efficiency is improved, but data accuracy deteriorates due to stale information

Engineering Contradiction:
Improvecache transmission efficiencyVSAvoiddata accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system implements feedback mechanisms where cache validity is continuously verified through validation protocols and status checks. This feedback loop ensures that freshness values are accurately maintained and updated, preventing stale data transmission while preserving cache transmission efficiency. The feedback mechanism allows the system to distinguish between truly fresh and stale data.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent employs preliminary validation actions before data is served from the cache. By performing freshness verification and validity checks in advance (preliminarily), the system ensures data accuracy is maintained without compromising transmission efficiency during actual data delivery. This preliminary action prevents stale data from being transmitted in the first place.

Inventive Principle:
Principle #10Preliminary action

3Loss of time

If proxy servers are deployed to reduce WAN delays, then network response time is improved, but security reliability deteriorates due to unauthenticated access

Engineering Contradiction:
ImproveWAN response timeVSAvoidsecurity reliability
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent introduces an intermediary authentication layer between the proxy server and cached data. This intermediary mechanism verifies user credentials and authorization before allowing access to cached objects, thus maintaining security reliability while preserving the time-saving benefits of proxy caching. The intermediary acts as a security gatekeeper that does not significantly impact response time.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Reliability

If prefetching is used to pre-load objects, then cache availability is improved, but network bandwidth consumption increases due to contention

Engineering Contradiction:
Improvecache availabilityVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The system implements selective prefetching where only certain objects or cache entries are pre-loaded based on predicted usage patterns and priority levels. This partial action approach ensures that prefetching operations are performed only when necessary and beneficial, reducing unnecessary network bandwidth consumption while maintaining adequate cache availability for critical data.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS8037126B2Systems and methods of dynamically checking freshness of cached objects based on link status
Publication Date: 2011.10.11 CITRIX SYSTEMS INC
  • US8037126B2 patent drawing
  • US8037126B2 patent drawing
  • US8037126B2 patent drawing

AI summary

The present solution provides a variety of techniques for accelerating and optimizing network traffic, such as HTTP based network traffic. The solution described herein provides techniques in the areas of proxy caching, protocol acceleration, domain name resolution acceleration as well as compression improvements. In some cases, the present solution provides various prefetching and/or prefreshening techniques to improve intermediary or proxy caching, such as HTTP proxy caching. In other cases, the present solution provides techniques for accelerating a protocol by improving the efficiency of obtaining and servicing data from an originating server to server to clients. In another cases, the present solution accelerates domain name resolution more quickly. As every HTTP access starts with a URL that includes a hostname that must be resolved via domain name resolution into an IP address, the present solution helps accelerate HTTP access. In some cases, the present solution improves compression techniques by prefetching non-cacheable and cacheable content to use for compressing network traffic, such as HTTP. The acceleration and optimization techniques described herein may be deployed on the client as a client agent or as part of a browser, as well as on any type and form of intermediary device, such as an appliance, proxying device or any type of interception caching and/or proxying device.