Unlock instant, AI-driven research and patent intelligence for your innovation.

Method for automatically updating configuration file configured with fluentd

A configuration file, configuration update technology, applied in the field of cloud computing, can solve problems such as reducing workload and frequent changes

Active Publication Date: 2021-06-08
SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD
View PDF9 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In order to solve the above technical problems, the present invention provides a kubernetes environment monitoring crd (the crd in this article is called FluentdConfig CRD) creation and deletion events to realize automatic update of fluentd configuration A method of files, which solves the problem of frequently changing fluentd configuration files in a complex and changeable environment, and supports automatic addition or deletion of corresponding configurations, thereby greatly reducing the risks caused by manual operations and greatly reducing the workload

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for automatically updating configuration file configured with fluentd
  • Method for automatically updating configuration file configured with fluentd
  • Method for automatically updating configuration file configured with fluentd

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0064] Example 1: Only name and expression are provided, and only pod logs are collected at this time

[0065] 1).apiVersion:lma.inspur.com / v1alpha1

[0066] 2). kind: FluentdConfig

[0067] 3). metadata:

[0068] 4).name:fcs

[0069] 5).namespace:monitoring

[0070] 6).#spec:

[0071] 7).#deploymentName:fcs-path-monitoring-test1

[0072] 8). body:

[0073] 9).name:fcs#The index name saved to es

[0074] 10). expression: some regexp str

[0075] 2. Customize Fluent Config

[0076] If there is a need for a high degree of freedom of configuration, it can be achieved by adding the complete configuration to this field, and the content of this section will be completely appended to the fluentd configuration.

[0077] 3. Name+expression+CustomizeFluentdConfig

[0078] If you want to collect k8s container logs and other service logs, you can configure all three fields, or you can create two FluentdConfig CRs. One FluentdConfig CR is name+expression, and the other is customi...

example 2

[0079] Example 2: All three fields are provided

[0080] 1).apiVersion:lma.inspur.com / v1alpha1

[0081] 2). kind: FluentdConfig

[0082] 3). metadata:

[0083] 4).name:fcs

[0084] 5).namespace:monitoring

[0085] 6).#spec:

[0086] 7).#deploymentName:fcs-path-monitoring-test1

[0087] 8). body:

[0088] 9).name:fcs#The index name saved to es

[0089] 10). expression: some regexp str

[0090] 11).customizeFluentdConfig:|-

[0091] 12).

[0092] 13).@type rewrite_tag_filter

[0093] 14).

[0094] 15).key container_name

[0095] 16).pattern / user-container /

[0096] 17).tag pod.fcs

[0097] 18).

[0098] 19).

[0099] 20).key container_name

[0100] 21). pattern.

[0101] 22).tag pod.cks

[0102] twenty three).

[0103] twenty four).

[0104] 25).

[0105] 26).

[0106] 27).@type parser

[0107] 28).key_name Payload

[0108] 29).

[0109] 30).@type json

[0110] 31).

[0111] 32).

[0112] Function

[0113] · Listen to the crea...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method for automatically updating a configuration file configured with fluentd, which belongs to the field of cloud computing, and is characterized in that crd creation and deletion events are monitored based on a kubernetes environment, and automatic addition and deletion of fluentd basic configuration parameters are opened or closed, so that application logs are dynamically collected, dynamic storage is realized, and the fluentd configuration file is automatically updated. And finally, flexible management of the log platform is realized.

Description

technical field [0001] The invention relates to the field of cloud computing, in particular to a method for automatically updating a configuration file configured with fluentd. Background technique [0002] As kubernetes becomes more and more active, more and more cloud-native applications are added to kubernetes. Cluster monitoring and log collection continue to pose various challenges. In the past, the overall environment for log collection was relatively straightforward, with limited static physical servers and virtual machines. , and a limited number of monitoring metrics. However, with the wide application of container technology and microservice architecture, the number of resource entities to collect logs has increased sharply, and the uncertainty has become stronger and stronger. Higher requirements are put forward for the flexibility and scalability of the system, especially when used with a coordinator such as kubernetes, resource changes are more diverse, and it ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F11/30G06F9/445
CPCG06F11/3093G06F11/3065G06F11/3006G06F9/44505
Inventor 白洋洋江燕于沈课李珂蔡卫卫
Owner SHANDONG LANGCHAO YUNTOU INFORMATION TECH CO LTD