Realization method and apparatus for data real-time collection and visualization

Abstract

Embodiments of the invention provide a realization method and apparatus for data real-time collection and visualization. The method comprises the steps of collecting data of multiple data sources in apreset time period according to a preset condition, thereby obtaining to-be-displayed original data; converting and adapting a data format of the to-be-displayed original data to a first data formatwhich can be directly used for visualization display, thereby obtaining data in a unified format; according to preset configuration, realizing visualization of the data in the unified format; and optionally, according to a preset alarming condition, regularly obtaining to-be-monitored original data from a pre-monitored data source, and if the to-be-monitored original data is abnormal, performing real-time alarming. All platforms can display the data indiscriminatingly; display can be performed on not only a gorgeous data big screen but also other small and medium-sized screen devices; and dueto design of a data monitoring alarming unit, business data exception can be timely discovered, thereby assisting an access party to discover the problem as early as possible.

Description

technical field [0001] The present invention relates to a method and device for realizing real-time data collection and visualization, in particular to a method and device for real-time data collection and visualization display on the whole platform. Background technique [0002] In the current Internet environment, the demographic dividend is disappearing, digesting existing users to increase the conversion rate, and data-based refined operations have become the key battlefield for business survival and development. Data refinement operation relies on the construction of relevant links such as data collection, processing and analysis, display, feedback, etc., to produce efficient and intuitive data displayed on multiple platforms. [0003] In the existing technology, it is mainly realized by integrating Elasticsearch, Logstash, and Kibana (ELK) for log processing and display. Elasticsearch is an open source distributed search engine. Its characteristics are: distributed, ze...

AI Technical Summary

Problems solved by technology

[0005] In the process of realizing the present invention, the inventor found at least the following problems in the prior art: in the solution of integrated log data processing and display, the display form is monotonous, does not meet the needs of diversified display of data on a large screen, and does not support service-level abnormal alarms; Focus on data visualization, flexible display of data visualization implementation plan, focus on large-screen display of data, not compatible with mobile devices, do not pay attention to data sources, do not have data collection, abnormal alarm and other functions

Images