Network information monitoring and analyzing system

Abstract

The invention relates to a network information monitoring and analyzing system and belongs to the field of network informatization. According to the features of the most widely-used HTML (Hypertext markup language) webpage information, and on the basis of deeply analyzing and researching the network information processing technologies such as information collecting, preprocessing and automatic sorting, the invention designs and develops a network information monitoring and analyzing system based on information field, aiming at the defects in the current information collecting technology, and the invention also realizes the function of directionally and automatically collecting useful information of professional field from multiple portal websites and specialized websites in real time through internet. The working process is as follows: (1) URLs, anchor texts and web pages are collected by a network information collecting subsystem, and the collected web pages are cleaned; (2) web pages in the system can be sorted by an intelligent analyzing and sorting subsystem, and garbage information is filtered according to thresholds; and (3) an automatic summarizing and retrieving subsystem finishes the functions of searching in the website and automatically generating a report.

Description

technical field [0001] The invention relates to a network information monitoring and analysis system, which belongs to the field of network informatization. Background technique [0002] Since the birth of the Internet, the Internet has developed into a huge global information warehouse with nearly 100 million users and hundreds of millions of pages, and its information capacity is still growing exponentially. Obtaining information from the Internet has become the main method and important means for individuals to acquire knowledge, and it has also become an important way for enterprises to obtain intelligence. However, in the face of the vast amount of network information, traditional methods such as manual collection and processing are no longer competent. [0003] To this end, a lot of research has been done in the field of information search at home and abroad, and a variety of search engines have been developed, such as Baidu, Google, Yahoo, Lycos and so on. To some ex...

AI Technical Summary

Problems solved by technology

To some extent, these search engines have improved the efficiency and speed of search, but there are still great limitations, most prominently in the following aspects: First, due to the use of full-text search or keyword search, The retrieval mechanism based on literals causes a deviation between the actual retrieval results and the user's needs, that is, the retrieval returns too little "useful" information and too much "garbage" information, which is called the problem of Rich Data Poor Information; secondly, web search engines need to In the face of a wide range of knowledge fields, and lack of sufficient background knowledge for a particular field, a large number of irrelevant web pages are searched, but few web pages with greater relevance; finally, the retrieval speed and efficiency are too low, and The timeliness and authority of the information cannot be guaranteed. The above shortcomings are very serious and even fatal weaknesses in information collection.