Obfuscating HTTP URLs to Block Bot Random Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing protocols for accessing resources are vulnerable to unauthorized access by malicious entities or bots, which can lead to the exposure of sensitive information, as they fail to provide adequate protection against random access attempts.

Innovation Solution

Implementing a system and method that involves a device intermediary between clients and servers, which obfuscates URLs in responses by removing path or directory structure information, and uses client identifiers to validate requests, ensuring only valid requests are processed by the server.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If URL information is provided in clear form in HTTP responses, then clients can access resources easily, but malicious entities and bots can obtain directory structure information and perform unauthorized random access

Engineering Contradiction:
Improveclient access to resourcesVSAvoidunauthorized access by bots
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The patent introduces an intermediary component (ADC - Application Delivery Controller) that sits between the web server and clients. This intermediary obfuscates URL information in HTTP responses by replacing it with randomized strings, preventing bots from obtaining directory structure information while still allowing legitimate clients to access resources through the intermediary's guidance

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the form of URL information from clear, structured paths to randomized, obfuscated strings. By transforming the representation of resource locations and removing directory structure information, the system maintains functionality for legitimate users while depriving bots of the structural information they need for random access attacks

Inventive Principle:
Principle #35Parameter changes

2Reliability

If protective mechanisms are configured at points of entry, then authorized users can access resources, but the system fails to provide adequate protection against random access attempts by attackers

Engineering Contradiction:
Improveprotection against unauthorized accessVSAvoidprotective mechanism complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies protective measures in advance by obfuscating URL information in all HTTP responses before they reach clients. This preliminary action ensures that even if bots attempt random access, the directory structure information is already hidden, providing proactive protection rather than reactive blocking

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The ADC acts as a smart intermediary that provides intelligence-based protection. It analyzes and obfuscates URL information selectively, maintaining protection against random access while preserving legitimate user experience, thereby achieving reliable security without excessive system complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

3Object-affected harmful factors

If all URL information is obfuscated to prevent bot access, then security is improved, but legitimate clients may experience difficulty navigating to resources

Engineering Contradiction:
Improvebot access preventionVSAvoidclient resource navigation
Core Design Contradiction:
Object-affected harmful factorsVSEase of operation

Solution Approach 1:

The patent applies different treatments to different types of clients. Legitimate clients receive guidance through the intermediary's session management and cookie-based tracking, while bots receive only obfuscated URLs. This localized quality ensures that security obfuscation does not hinder legitimate users who have established trusted sessions

Inventive Principle:
Principle #3Local quality

4Reliability

If directory structure information is removed from URLs, then bots cannot perform random access, but the system requires additional processing to maintain session state

Engineering Contradiction:
Improveprotection against random accessVSAvoidsession management overhead
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent uses cookie-based session management where the ADC copies and tracks session state information client-side. This allows the system to maintain session continuity without storing extensive state information on the server, reducing memory overhead while providing robust protection against random access attempts

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11956219B2Systems and methods to detect and prevent bots from random access by randomized HTTP URLs in real time in distributed systems
Publication Date: 2024.04.09 CITRIX SYSTEMS INC
  • US11956219B2 patent drawing
  • US11956219B2 patent drawing
  • US11956219B2 patent drawing

AI summary

Described embodiments provide systems and methods for preventing unauthorized access of information from a resource. A device intermediary between a client and a server in a session can receive a first request from the client that includes a first uniform resource locator (URL) of the server. The device may receive a response from the server that includes a second URL. The device may update the response by including a client identifier for the session in a set-cookie field, obfuscating the second URL into a string, and replacing the second URL in the response with the string. The device may receive a second request that includes a candidate client identifier, and a third URL. The device may determine whether the second request is valid, by at least one of: matching the candidate client identifier with the client identifier, and determining whether the second URL is recoverable using the third URL.