Visual data processing method of Web terminal based on big data technology

Abstract

The invention discloses a visual data processing method of a Web terminal based on the big data technology. The method comprises the following steps: S1, data search: a full-text search engine based on lucene and distributed multi-user capability is realized by utilizing lassiticsearch; S2, data visualization: utilizing echarts to realize ten-million-level data visualization rendering capability;S3, data mining and data storage: concurrently accessing the data in real time by a third-party interface; S4, high concurrent processing and a nosql data a nosql database redis, and a data structure server stored in a memory; S5, automatic early warning: short message early warning is provided through a third platform, and mail early warning is realized through javamail; and S6, the Nginx and file server is an HTTP and reverse proxy web server with high performance of the nginx. According to the big data technology-based visual data processing method for the Web end, information data canbe captured in the whole network. The automatic early warning and the data visualization are realized. Data can be well analyzed and counted, and the working efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a web-side visualized data processing method based on big data technology. Background technique [0002] Public opinion refers to the occurrence, development and change of intermediary social events in a certain social space, and the public as the main body has an opinion on the social managers, enterprises, individuals and other organizations as the object, as well as their political, social, moral, etc. The social attitude generated and held by the orientation of the aspects, the social public opinion is mapped to the Internet environment to generate network public opinion, with the vigorous development and application of the Internet on a global scale, the information data in the Internet environment is also at a geometric progression speed In today's era of big data, it not only brings challenges to the related work of network public opinion, but also brings opportuni...

AI Technical Summary

Problems solved by technology

[0002] Public opinion refers to the occurrence, development and change of intermediary social events in a certain social space, and the public as the main body has an opinion on the social managers, enterprises, individuals and other organizations as the object, as well as their political, social, moral, etc. The social attitude generated and held by the orientation of the aspects, the social public opinion is mapped to the Internet environment to generate network public opinion, with the vigorous development and application of the Internet on a global scale, the information data in the Internet environment is also at a geometric ...

Images