Domain Popularity Scoring via DNS Traffic and Web Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for monitoring and ranking internet traffic are limited in their ability to provide holistic views of user activity, as they often rely on selected samples or ISP data, which restricts the accuracy and comprehensiveness of traffic rankings, especially in distinguishing between user-oriented and machine-oriented traffic.
Innovation Solution
The proposed solution utilizes DNS traffic data from authoritative name servers, combined with information from associated web sites, to calculate traffic scores by aggregating and weighting different types of DNS queries and web page data, allowing for more accurate domain rankings.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional traffic monitoring services are used to calculate traffic scores, then the monitoring process is simplified, but the accuracy and comprehensiveness of traffic rankings deteriorate due to limitations in distinguishing user-oriented and machine-oriented traffic
Solution Approach 1:
The patent segments traffic monitoring into multiple components: DNS query collection from authoritative name servers, web server log analysis, and separate user-oriented versus machine-oriented traffic classification. This segmentation allows each component to specialize in specific aspects of traffic analysis, improving overall measurement precision without requiring a single monolithic complex system.
Solution Approach 2:
The patent introduces DNS authoritative name servers as intermediaries that provide detailed query information between end users and the traffic monitoring system. These intermediaries capture granular DNS resolution data that reveals the nature of traffic (user-oriented vs machine-oriented) without requiring direct access to end-user devices or complex analysis at the monitoring endpoint.
2Quantity of substance
If selected samples or ISP data are used for traffic monitoring, then the monitoring cost is reduced, but the comprehensiveness and accuracy of traffic rankings deteriorate
Solution Approach 1:
The patent makes DNS authoritative name servers serve multiple functions: they continue their primary DNS resolution role while simultaneously collecting detailed query information for traffic analysis. This multi-functionality allows the system to gather comprehensive traffic data from a universal point in the network infrastructure without requiring separate dedicated monitoring systems or sampling approaches.
3Measurement precision
If detailed DNS query information is collected from authoritative name servers, then the accuracy of distinguishing user-oriented and machine-oriented traffic is improved, but the data processing complexity increases
Solution Approach 1:
The patent performs preliminary classification of DNS queries at the authoritative name server level, where query information is collected and initially processed. By performing this classification action at the data source rather than later during centralized analysis, the system reduces the complexity of subsequent data processing while maintaining high accuracy in distinguishing traffic types.
Data Source
AI summary
Systems and methods for scoring a domain including analyzing counter data and information obtained from a web site associated with the domain. Methods may include receiving requests to resolve the domain at an authoritative domain resolution server. A counter may be incremented for the domain based on the received requests. Information may be obtained from a web page associated with the domain. For example, obtaining information from the web page may include obtaining quantitative, qualitative, and/or functional information from the web page, such as link information, a status of network links corresponding to the link information, and associated ratios. The status of link information may include searching for functional details and/or results, such as, domain redirections, domain errors, mirror content, and commonly linked sites. A score may be calculated for the domain based upon the counter data and the information obtained from the web page associated with the domain.