Web Site Link Protection via Decoy and Authenticated Links
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Web sites face challenges in distinguishing between legitimate requests and malicious attacks from bots, which can lead to unauthorized data collection and various cyber threats, while also needing to allow access for legitimate users and search engines.
Innovation Solution
A server security system intercepts page requests, generates protected links and decoy links, and determines whether to respond with the target page or a decoy page, using state-based or stateless intermediaries to authenticate requests and prevent unauthorized access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the web site blocks all automated requests to prevent bot attacks, then security against malicious bots is improved, but legitimate search engine crawlers and automated users are also blocked
Solution Approach 1:
The patent introduces an intermediary component (browser automation detector) that sits between the web server and incoming requests. This intermediary analyzes requests to determine if they originate from automated bots or legitimate users, allowing the system to differentiate between malicious and benign automated traffic. The intermediary uses various detection techniques including analyzing request patterns, headers, and behavior characteristics to make authentication decisions, thus resolving the contradiction by allowing legitimate automation while blocking malicious bots.
2Reliability
If the web site implements comprehensive bot detection and authentication mechanisms, then protection against data scraping is improved, but system complexity and processing overhead increase
Solution Approach 1:
The patent segments the bot detection and authentication process into multiple independent components and layers. The detection mechanism is divided into separate modules that analyze different aspects of requests (headers, patterns, behavior) independently. This segmentation allows the system to implement comprehensive protection without creating a monolithic complex system, as each segment can be developed, maintained, and optimized separately, reducing overall system complexity while maintaining robust protection.
3Object-affected harmful factors
If the web site uses aggressive bot blocking strategies, then prevention of unauthorized data collection is improved, but user experience and legitimate access are degraded
Solution Approach 1:
The patent applies different quality levels of protection to different parts of the web site and different types of users. Rather than uniformly blocking all automated requests, the system analyzes each request locally and applies appropriate authentication measures based on the specific bot type, request pattern, and target resource. Legitimate users experience minimal interference, while malicious bots encounter targeted blocking, thus maintaining ease of operation for legitimate users while preventing unauthorized data collection.
Data Source
AI summary
In an embodiment, a method comprises intercepting, using a server computer, a first set of instructions that define a user interface and a plurality of links, wherein each link in the plurality of links is associated with a target page, and the plurality of links includes a first link; determining that the first link, which references a first target page, is protected; in response to determining the first link is protected: generating a first protected link that is different than the first link and includes first data that authenticates a first request that has been generated based on the first protected link and that references the first target page; and generating a first decoy link that includes second data that references a first decoy page and not the first target page; rendering a second set of instructions comprising the first protected link and the first decoy link, but not the first link, and which is configured to cause a first client computer to present the first protected link in the user interface and hide the first decoy link from the user interface; sending the second set of instructions to the first client computer.