Visual data processing method of Web terminal based on big data technology

Abstract

The invention discloses a visual data processing method of a Web terminal based on the big data technology. The method comprises the following steps: S1, data search: a full-text search engine based on lucene and distributed multi-user capability is realized by utilizing lassiticsearch; S2, data visualization: utilizing echarts to realize ten-million-level data visualization rendering capability;S3, data mining and data storage: concurrently accessing the data in real time by a third-party interface; S4, high concurrent processing and a nosql data a nosql database redis, and a data structure server stored in a memory; S5, automatic early warning: short message early warning is provided through a third platform, and mail early warning is realized through javamail; and S6, the Nginx and file server is an HTTP and reverse proxy web server with high performance of the nginx. According to the big data technology-based visual data processing method for the Web end, information data canbe captured in the whole network. The automatic early warning and the data visualization are realized. Data can be well analyzed and counted, and the working efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a web-side visualized data processing method based on big data technology. Background technique [0002] Public opinion refers to the occurrence, development and change of intermediary social events in a certain social space, and the public as the main body has an opinion on the social managers, enterprises, individuals and other organizations as the object, as well as their political, social, moral, etc. The social attitude generated and held by the orientation of the aspects, the social public opinion is mapped to the Internet environment to generate network public opinion, with the vigorous development and application of the Internet on a global scale, the information data in the Internet environment is also at a geometric progression speed In today's era of big data, it not only brings challenges to the related work of network public opinion, but also brings opportuni...

AI Technical Summary

Problems solved by technology

[0002] Public opinion refers to the occurrence, development and change of intermediary social events in a certain social space, and the public as the main body has an opinion on the social managers, enterprises, individuals and other organizations as the object, as well as their political, social, moral, etc. The social attitude generated and held by the orientation of the aspects, the social public opinion is mapped to the Internet environment to generate network public opinion, with the vigorous development and application of the Internet on a global scale, the information data in the Internet environment is also at a geometric progression speed In today's era of big data, it not only brings challenges to the related work of network public opinion, but also brings opportunities. Big data has become a sharp tool for public opinion research. At the same time, there is a closedness between data. The disconnection of the relationship will make it difficult for us to make statistics when sorting out data, and it is also impossible to provide real-time early warning for sensitive news early warning. Traditional data tracking, collection and analysis methods have been unable to cope with this, which puts forward higher technical means for data analysis. requirements

Images