Browsing History Generation via Network Interception
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for collecting and processing browsing history face challenges, particularly in accessing browser data due to restrictions and encryption, and fail to accurately record individual webpage elements within the browser history.
Innovation Solution
A system that generates a browsing history by collecting and analyzing web requests and responses, using a web browser analyzer to identify candidate parent webpages based on reference counts and thresholds, without directly accessing browser application files, utilizing a virtual private network server or proxy to capture and process HTTP data.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If browser history is collected by directly accessing browser application files, then complete browsing history can be obtained, but access restrictions and encryption prevent direct access to browser data
Solution Approach 1:
The patent uses a Virtual Private Network (VPN) server as an intermediary to capture HTTP data between the web browser and the internet. Instead of directly accessing protected browser files, the system routes browser traffic through the VPN server which records and analyzes the data, thereby bypassing access restrictions and encryption without requiring direct browser file access
Solution Approach 2:
The patent replaces the mechanical approach of directly accessing and reading browser database files with a network-level interception method. By capturing HTTP requests and responses at the network layer through VPN or proxy techniques, the system obtains browsing history information without needing to penetrate browser security mechanisms
2Loss of information
If all web requests are recorded in browser history, then complete browsing data is captured, but individual webpage elements cannot be distinguished from parent webpages
Solution Approach 1:
The patent segments web requests into two categories: parent webpage requests and child element requests. By analyzing the structure of HTTP requests and using reference counting techniques, the system identifies which requests correspond to complete webpages versus individual elements within webpages, allowing precise differentiation and accurate parent webpage identification in the browsing history
Solution Approach 2:
The patent employs reference counting where each web request is analyzed to determine how many other requests reference it. Parent webpages typically have fewer references compared to child elements that may be referenced multiple times across different contexts. This feedback mechanism allows the system to distinguish parent webpages from child elements and filter the browsing history accordingly
3Loss of information
If client-side monitoring is used to track user activities, then detailed browsing behavior can be monitored, but server-side tracking is needed to track and count served webpages
Solution Approach 1:
The patent implements a dual-function system that operates both as client-side monitoring (capturing browser HTTP data through VPN) and server-side tracking (recording and analyzing web requests at the network level). This multi-functional approach allows the same system to gather detailed user activity information while also tracking served webpages, eliminating the need for separate client and server monitoring implementations
Data Source
AI summary
Methods and apparatus to collect and process browsing history are disclosed. One disclosed method of collecting browsing history includes collecting a plurality of web requests, and for a web request in the plurality of web requests, determining a count indicating a number of other ones of the plurality of web requests that include a referrer identifying the web request. The method also includes when the count meets a threshold, indicating that the web request is a parent web request.