Log processing method and device based on docker container

A processing method and log technology, applied in the computer field, can solve problems such as a large amount of logs, and achieve the effects of saving input expenses, simple operation and maintenance, and saving hardware resources

Pending Publication Date: 2020-02-28
CITIC PHOENIX HARBOR SUPPLY CHAIN MANAGEMENT CO LTD
View PDF4 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This results in a particularly large amount of logs. In the face of massive log data, issues such as resource limitations, performance, security, and high availability need to be considered. How to quickly, efficiently, and safely deploy a log analysis system is an urgent issue.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log processing method and device based on docker container
  • Log processing method and device based on docker container
  • Log processing method and device based on docker container

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0061] Before introducing the embodiments of the present invention, first briefly introduce the nouns involved in the embodiments of the present invention. Docker is an open source application container engine, based on the Go language and open source in accordance with the Apache2.0 protocol. Docker allows developers to package their application...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a log processing method and device based on a docker container, and the method comprises the steps: deploying a filebeat at each host machine needing to collect log data through employing a docker container, and enabling the filebeat to be used for log data collection; generating kafka and zookeeper cluster configuration files in a host machine, and performing deployment by adopting docker container deployment so as to perform log data transmission; generating an elk cluster configuration file in a host machine, and adopting docker container deploymentfor log data processing and display; and generating an nginx configuration file in the host machine, and performing deployment by adopting the docker container for log data access control. According to the embodiment of the invention, standalone cluster deployment based on the docker container is realized, so that the investment and expenditure of physical machines are saved, and the whole processing process becomes simple and efficient.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a docker container-based log processing method and device. Background technique [0002] For general log analysis scenarios: directly in the log file (in the Liunx environment) grep, awk, tail, and less can get the information you want. However, in large-scale scenarios, this method is inefficient, and problems include how to archive too many logs, what to do if the text search is too slow, and how to query in multiple dimensions. Centralized log management is required, with log collection and aggregation on all servers. A common solution is to establish a centralized log collection system to collect, manage, and access logs on all nodes in a unified manner. [0003] ELK provides a complete set of solutions, all of which are open source software, which can be used in conjunction with each other, perfectly connected, and efficiently meet the applications of many occasi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/455G06F16/17G06F16/18G06F11/30G06F9/445
CPCG06F9/45558G06F16/1815G06F16/1734G06F11/3065G06F9/44505G06F2009/4557
Inventor 杜明岩李硕王海英
Owner CITIC PHOENIX HARBOR SUPPLY CHAIN MANAGEMENT CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products