Crawler analysis platform based on government affair big data

Abstract

The invention discloses a crawler analysis platform based on government affair big data, which supports distributed collaborative capture and visual capture of data, intelligently analyzes user behaviors and quickly screens out data required by a user, and the distributed collaborative capture can greatly improve the processing capacity of the system as long as enough clusters are carried out. Themethod intelligently analyzes and screens the data, supports a user to define a data screening rule, analyzes data screening behaviors of the user, and enables screening to be more accurate. The platform provides rich and efficient data processing capability, various custom rules, intelligent behavior analysis capability and the like, helps enterprises to collect various needed government affairdata, completes interaction and feedback between users and government affairs at the same time, forms a data closed loop, and enables the government affair data not to be difficult to connect any more.

Description

technical field [0001] The invention relates to the technical field of big data platforms, in particular to a crawler analysis platform based on government big data. Background technique [0002] Although big data technology is very popular now, my country's big data industry is still in its infancy, and the development of the industrial chain is not mature. After the establishment of the big data industrial park, there may not be enough companies to settle in, and a complete big data ecosystem cannot be formed. [0003] There are security and hidden dangers in the existing big data application technology. The main content: First, the threats to big data are often referred to as security issues. When big data technologies, systems and applications accumulate a lot of value, they will inevitably become attacked Second, the problems and side effects brought about by the excessive abuse of big data are typically the leakage of personal privacy, as well as the leakage of commer...

AI Technical Summary

Problems solved by technology

[0003] There are security and hidden dangers in the existing big data application technology. The main content: First, the threats to big data are often referred to as security issues. When big data technologies, systems and applications accumulate a lot of value, they will inevitably become attacked. Second, the problems and side effects brought about by the excessive abuse of big data are typically the leakage of personal privacy, as well as the leakage of commercial secrets and state secrets brought about by big data analysis capabilities; third, the mind and consciousness security questions on

Images