Multi-tenant oriented SaaS public opinion monitoring system and method

Abstract

The invention relates to a multi-tenant oriented SaaS public opinion monitoring system and method.The multi-tenant oriented SaaS public opinion monitoring system comprises a data acquisition and storage module and a data analysis module based on a parallel processing framework.The data acquisition and storage module conducts real-time monitoring on specified websites including news, blogs and bulletin board systems on the basis of a Nutch open-source framework, finds and downloads the full-text information of latest web pages and automatically extracts links in the web pages to access, capture and store other web pages to a database, and the storage of huge amounts of acquired public opinion data is achieved by adopting an HBase distributed storage technology; the data analysis module adopts a Single-Pass based improved algorithm to find hot topics on the basis of a parallel computing framework and conducts matching between the found hot topics and service demand descriptions preset by users item by item so as to achieve screening and filtering of mass data for the users.The multi-tenant oriented SaaS public opinion monitoring system embodies good extensibility on the aspects of multiple data sources, multiple tenants and the like.

Description

technical field [0001] The invention relates to the field of public opinion monitoring, in particular to a multi-tenant-oriented SaaS public opinion monitoring system and method. Background technique [0002] In 2015, the penetration rate of Internet users in China will reach 50%. With the continuous increase of Internet users, the number of speeches will also show an explosive growth trend. In order to detect bad information in speech in time and control the development trend of online speech, public opinion monitoring has become the actual demand of the government and large enterprises. However, massive media data and heterogeneous information content have brought great challenges to public opinion monitoring: [0003] 1. The design of traditional public opinion systems mostly adopts a stand-alone model, which is mainly for monitoring a single field. With the emergence of data and the changeable data structure, the existing public opinion monitoring system is difficult t...

AI Technical Summary

Problems solved by technology

With the emergence of data and the changeable data structure, the existing public opinion monitoring system is difficult to meet the real-time acquisition of massive data and the monitoring of multiple fields at the same time. The traditional stand-alone system shows scalability in the face of huge multi-source data. And other issues

[0004] 2. The current public opinion monitoring system is based on a certain type of specific algorithm, which may require multiple algorithms for analysis to meet a specific user requirement

It is difficult for the existing system to handle and expand the needs of different users, or for new tasks and functions

Images