Commercial system based on data analysis management
A commercial system and data analysis technology, applied in the field of data processing, can solve problems such as low efficiency and achieve the effect of improving efficiency and avoiding failures
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment 1
[0024] A commercial system based on data analysis management, using the distributed service framework Dubbo, including a full link log module, using Candao Sleuth to mark links in the code, collecting logs through Flume, and sending them to the Kafka message queue for buffering , Logstash consumes logs from Kafka and inserts them into Elasticsearch for full-link log storage and query.
[0025] The invention can input keywords in the log background, easily query all relevant logs, and can check the entire link log according to the log ID, which greatly improves the efficiency and has better practicability.
Embodiment 2
[0027] This embodiment is optimized on the basis of embodiment 1, such as figure 2 As shown, the log flows to ELK for log storage, analysis and display, for maintenance personnel to search for useful information in real time in massive log data; The current operating status of the system, and monitoring and early warning processing; all logs are entered into the distributed file system HDFS, and the system performance of the previous day is regularly analyzed every morning, so as to make reference to the overall performance trend and performance optimization of the system.
[0028] Other parts of this embodiment are the same as those of Embodiment 1, so details are not repeated here.
Embodiment 3
[0030] This embodiment is optimized on the basis of Embodiment 1 or 2, and also includes a real-time early warning module, which performs real-time short message and email early warning according to configured rules through SparkStreaming real-time stream calculation. It also includes a performance analysis module, through Hadoop big data processing, regularly analyzes daily logs, and calculates the daily performance of the system.
[0031] Other parts of this embodiment are the same as those of Embodiment 1 or 2, so details are not repeated here.
PUM
Login to View More Abstract
Description
Claims
Application Information
Login to View More 

