Domain name data acquisition method based on Web

Abstract

The invention discloses a domain name data acquisition method based on Web. According to the scheme, a domain name data acquisition system composed of a Web service detection module, a Web page acquisition module, a page resolution domain name extraction module and a domain name and IP address set mapping module is constructed; the Web service detection module scans the IPv4 unicast address spacethrough 80 and 443 ports by adopting a network scanning tool, and establishes an IPv4 address list with open 80 and 443 ports; the Web page acquisition module sends a webpage request according to theport number and the IPv4 address list, acquires page information and establishes a page content database; the page resolution domain name extraction module extracts each link of each page in the pagecontent database, extracts a domain name and establishes a domain name database; the domain name and IP address set mapping module sends a domain name resolution request to a domain name service system to obtain each domain name and a corresponding IP address set in a domain name database. According to the invention, efficient acquisition of global website domain names can be realized, the flow overhead is reduced, and the domain name data acquisition breadth and efficiency are improved.

Description

technical field [0001] The invention relates to the technical field of computer networks, in particular to a domain name data acquisition method. Background technique [0002] Domain name data is a special resource that can be used as an important data asset of some Internet companies, security companies, and some industry departments in the country to support and play an important role in network service guarantee and security guarantee. [0003] However, the Internet's Domain Name System (DNS, Domain Name System) is a system of hierarchical, domain-specific and decentralized management. Domain name data is distributed in more than one million authoritative domain name servers, and is managed and managed by many organizations or institutions separately. relevant part. These authoritative servers usually do not allow domain name data transfer permissions. There are also domain name registrars on the Internet that are convenient for users to apply for domain names, and they...

AI Technical Summary

Problems solved by technology

[0010] The technical problem to be solved by the present invention is to provide a method for obtaining domain name data based on the Web, which solves the problem of large traffic overhead, difficulty in deployment and implementation, and narrow coverage of existing domain name data acquisition methods. A small part of the data problem, improve the ability to obtain domain name data

Images