Internet spatial data search system and method

Abstract

The invention discloses an Internet spatial data search system and method. The system comprises a detection module, a grasp module, a cleaning module, a storage module, a search module and middleware,wherein the detection module is used for detecting surviving equipment and host in the Internet, and the grasp module is used for acquiring data information of the surviving equipment and host; the cleaning module is used for cleaning the data information; the storage module is used for saving the cleaned data information to a database; the search module is used for searching the data informationof the equipment or host from the database; the middleware connects the storage module and the search module, and the middleware is used for synchronizing the data information in the storage module into the search module. The provided Internet spatial data search system and method can improve the storage and search reading efficiency of the search system.

Description

technical field [0001] The invention relates to the field of Internet data search, in particular to a search system and method for Internet space data. Background technique [0002] There are countless hosts and terminal devices in the Internet space. Although they generate huge amounts of data information every day, users cannot effectively grasp them. We can grab these data and store them in the database, and build a search system To complete the search for these data information, which is convenient for users to use. [0003] Most of the existing search systems use the crawler method to crawl data, but most of them directly import the data into the search server to realize the function of searching data. However, because the data storage structure and the search structure of the search system in the prior art are not clear, blockages are likely to occur. In addition, due to the low degree of correlation between hosts of different data types in the Internet, the amount o...

AI Technical Summary

Problems solved by technology

However, due to the unclear data storage structure and search structure of the search system in the prior art, it is easy to cause blockage

In addition, due to the low degree of correlation between hosts of different data types in the Internet, the amount of data obtained by using the crawler framework will be far smaller than the actual amount of data, and the deviation is too large

Images