Spark-based application software running log collection and service processing system and method

A technology for running logs and application software, applied in the field of log big data, which can solve problems such as unprocessed logs and difficulty in meeting users' needs for accurate log data, and achieve the effect of improving efficiency

Inactive Publication Date: 2018-08-14
WUHAN UNIV
View PDF3 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, most of these software only tend to collect logs, and the collected logs have no sub

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Spark-based application software running log collection and service processing system and method
  • Spark-based application software running log collection and service processing system and method
  • Spark-based application software running log collection and service processing system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] In order to facilitate those of ordinary skill in the art to understand and implement the present invention, the present invention will be described in further detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the implementation examples described here are only used to illustrate and explain the present invention, and are not intended to limit this invention.

[0041] Such as figure 1 As shown in the figure, it can be seen from the figure that when the original log data on each sub-node is generated, it will be passed to the collector through the Agent on the current sub-node. Here, each Agent consists of three parts: source, channel, and sink. The source is Data source, channel is the channel for data transmission, and sink is used to transmit data to a designated place. The three are triggered and coordinated through events. When the Collector receives the data, it will aggregate the data to generate a larger The...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a Spark-based application software running log collection and service processing system and a method thereof, and provides log services for different resources at different levels, wherein the log services include a log collection service of a log data resource layer, a log data storage service of a log data service layer, and a user acquiring log data service of a log data application layer. After collecting the original data through the log collection service of the log data resource layer, the original data is pushed to the log data service layer for preprocessing the log data, the data is then stored by the log data storage service, and finally the log data service is provided to the user at the log data application layer. The invention may realize the collection of log data by using a distributed collection strategy, defines a multi-level data storage structure to store the log data, and provides a log data query service to the user, so that the user obtains useful application software to run the log data, and the efficiency of fault diagnosis is improved by the obtained log.

Description

technical field [0001] The invention belongs to the field of log big data, and in particular relates to the collection and service processing of application software running logs. Background technique [0002] In information system applications, every operation will leave a trace, which is the log. Each log file is composed of log records, and each log record describes a single event. In a complete information system, the log system is a very important functional component. It can record all the behaviors generated by the system and express them according to a certain specification. Logs record necessary and valuable information for activities related to IT resources such as servers, workstations, firewalls, and application software. The recording of these information is very important for system monitoring, query, security audit, and fault diagnosis. [0003] Most of the existing large-scale software is developed by multiple people, or uses software from multiple sources,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30H04L12/24
CPCG06F16/1815H04L41/069H04L41/5041
Inventor 应时程国力张骁张威李宇航贾向阳
Owner WUHAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap