Delayed Content Serving via Reconnaissance Code

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Web server systems face challenges in distinguishing between legitimate and illegitimate requests, as fraudsters use botnets and scraping activities to intercept sensitive information, leading to security risks and load issues, necessitating effective methods to differentiate human-controlled from bot-controlled client devices.

Innovation Solution

A computer-implemented method is introduced that serves reconnaissance code to client devices to determine their control type, with follow-up content served based on the determination, including CAPTCHA tests for ambiguous cases, and polymorphic transformations to secure content, all managed by a separate security intermediary system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If reconnaissance code is served to all clients to determine control type, then security accuracy is improved, but processing load and response time increase

Engineering Contradiction:
Improvesecurity accuracyVSAvoidprocessing throughput
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system applies reconnaissance code selectively rather than universally. It serves the code only to clients that exhibit suspicious behavior patterns or fail initial heuristic checks, while allowing clearly legitimate traffic to pass through without the overhead of full reconnaissance. This partial application maintains high security accuracy for suspicious traffic while preserving processing throughput for normal traffic.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The security verification process is segmented into multiple stages: initial heuristic filtering, selective reconnaissance code deployment, and follow-up verification. By dividing the verification process into segments applied at different thresholds, the system achieves high security accuracy for suspicious clients while minimizing the processing load on overall system throughput.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If follow-up content is served immediately, then user experience is improved, but security verification completeness deteriorates

Engineering Contradiction:
Improveuser experienceVSAvoidsecurity verification completeness
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system performs preliminary security verification using reconnaissance code and behavioral analysis before serving follow-up content. This preliminary action ensures that security verification is completed in advance, allowing legitimate content to be served immediately to verified users while blocking suspicious traffic before it can access protected resources.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements periodic verification where follow-up content delivery is interspersed with additional verification checks. Rather than serving all content at once, the system delivers content in periodic batches with verification checkpoints, ensuring both user experience through progressive delivery and security through continuous verification.

Inventive Principle:
Principle #19Periodic action

3Measurement precision

If CAPTCHA tests are administered to all clients, then bot detection accuracy is improved, but processing time and user frustration increase

Engineering Contradiction:
Improvebot detection accuracyVSAvoidverification time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system applies CAPTCHA tests locally to specific high-risk scenarios rather than universally. CAPTCHAs are administered only to clients that exhibit bot-like behavior patterns, such as unusually high request rates, suspicious user agents, or failed authentication attempts. This localized application maintains high bot detection accuracy while minimizing time loss for legitimate users.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically adjusts the threshold parameters for triggering CAPTCHA challenges based on traffic patterns, time of day, and risk assessment. By changing these parameters adaptively, the system maintains high detection accuracy for bots while reducing the frequency of CAPTCHA challenges to legitimate users, thereby minimizing overall verification time loss.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11070557B2Delayed serving of protected content
Publication Date: 2021.07.20 SHAPE SECURITY INC
  • US11070557B2 patent drawing
  • US11070557B2 patent drawing
  • US11070557B2 patent drawing

AI summary

Techniques are described for delayed serving of protected content. A request has been made by a client computing device for a requested resource comprising a first portion and a second portion that is initially withheld from the client computing device. First content comprising the first portion of the requested resource and reconnaissance code is served for execution on the client computing device. When executed at the client computing device, the reconnaissance code gathers data at the client computing device that indicates whether the client computing device is human-controlled or bot-controlled. The data gathered by the reconnaissance code is received. Based on the data, it is determined that the client computing device is not bot-controlled. In response to determining that the client computing device is not bot-controlled, the second portion of the requested resource is served to the client computing device.