Big data log analysis method and system based on Spring framework

A big data and log technology, applied in the field of information security, can solve the problems of missing log archiving, management, and WEB services that cannot make unified alarm management, risk early warning, and cannot be predicted in advance and deal with problems in a timely manner, so as to ensure accuracy and consistent effect

Pending Publication Date: 2021-08-20
联通(江苏)产业互联网有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Not only is the function of log archiving and management missing, but also unified alarm management and risk warning cannot be made for each WEB service; neither developers nor operation and maintenance personnel can accurately locate various problems on services and servers, nor can they There is no way to efficiently search the log content to quickly locate the problem; at the same time, it is impossible to predict a

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data log analysis method and system based on Spring framework
  • Big data log analysis method and system based on Spring framework
  • Big data log analysis method and system based on Spring framework

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0066] The present invention is described in further detail in connection with the technical solutions of the present invention, and the embodiments of the present invention will be described in connection with the embodiments and drawings of the present invention, but the embodiments of the present invention are not limited thereto.

[0067] like Figure 1 - Figure 5 As shown, the method and system of a large data log analysis based on the Spring frame is provided in this embodiment, a method of large data log analysis based on a Spring frame, which includes the following steps:

[0068] Step 1: Log Unified Collection, in different Spring frames, add logback dependence in the POM file, and create a new logback.xml file in the resources directory of each service;

[0069] Step 2: logStash data into the ES, add a new trace-logging.conf file below the logStash config directory, save the real-time log into the ES, follow-up to flow through FLINK;

[0070] Step 3: Flume Data HDFS, crea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a big data log analysis method and system based on Spring frameworks, and belongs to the technical field of information security, and the method comprises the following steps: uniformly collecting logs, in different Spring frameworks, newly adding logback dependency in a POM file, and meanwhile, newly establishing a logback.xml file under a resource directory of each service. According to the invention, a unified management platform is provided for internal WEB services of different Spring frameworks; the data is analyzed and mined from offline and real-time dimensions, so that the accuracy and consistency of the data are ensured; and the functions of searching time, service names, log levels and keywords are provided, so that development, operation and maintenance personnel can quickly position the production environment.

Description

technical field [0001] The invention relates to a method and system for big data log analysis based on a Spring framework, and belongs to the technical field of information security. Background technique [0002] In today's complex and diverse enterprise WEB services, not only the various service frameworks of Spring MVC, Spring Boot, and Spring Cloud are integrated, but also the logging methods are varied and varied. Not only is the function of log archiving and management missing, but also unified alarm management and risk warning cannot be made for each WEB service; neither developers nor operation and maintenance personnel can accurately locate various problems on services and servers, nor can they There is no way to efficiently search the log content to quickly locate the problem; at the same time, it is impossible to predict and deal with the problem in time, which greatly affects the customer's perception experience, so a centralized, independent, log information coll...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/18G06F16/182G06F16/2458
CPCG06F16/1815G06F16/182G06F16/2465
Inventor 徐敏
Owner 联通(江苏)产业互联网有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap