A Domain Name Hierarchical Structure Detection Method Based on Link Analysis

Abstract

The invention discloses a domain name hierarchical structure detection method based on link analysis, which includes: performing data crawling on the initial URL and tracking links for deep distributed crawling to obtain the domain name set and domain name link relationship of the organization to be analyzed; The organization's domain name collection and domain name link relationship construct a link network directed graph, use the link network directed graph to perform clustering calculations, obtain the clustering results, and calculate the importance of each node in the link directed graph; use the clustering results and link The importance of each node in the directed graph weights the directed graph edge of the link network directed graph to obtain a weighted directed graph; uses the shortest path algorithm to calculate the node affiliation on the weighted directed graph to obtain the organization to be analyzed Domain name affiliation tree structure. The invention has higher data crawling efficiency and domain name collection coverage; while ensuring the high efficiency of structure extraction, the invention also greatly improves the accuracy of domain name affiliation detection.

Description

technical field [0001] The invention belongs to the technical field of Internet applications, and more specifically relates to a domain name hierarchical structure detection method based on link analysis. Background technique [0002] With the rapid development of the Internet, more and more organizations build their own portals on the Internet, and the scale of the organization's Web site and the number of domain names of its sub-organizations are also growing explosively. Although it provides necessary support and convenience for people's daily life, it is difficult to have an intuitive understanding of the relationship between its Web site or domain name, and it is difficult to find the organization mode and law of domain name. Therefore, there is a need for a method that can conduct targeted analysis of the organization's domain name site, discover the domain name list of each sub-organization, and detect and analyze the affiliation of the organization whose domain name ...

AI Technical Summary

Problems solved by technology

[0005] In view of the above defects or improvement needs of the prior art, the present invention provides a domain name hierarchical structure detection method based on link analysis, thereby solving the problem that the prior art cannot well reflect the affiliation and hierarchical tree structure between domain names, resulting in Uncertain parent-child relationship in hierarchical extraction and technical problems in domain name organization allocation errors

Images