Monitoring platform and implementation method for unified configuration management thereof

Abstract

The invention relates to a monitoring platform and an implementation method for unified configuration management of the monitoring platform, and belongs to the technical field of power equipment control. According to the method, a cluster comprising a plurality of servers is deployed, a unified configuration management tool is configured in one server, and an acquisition module is configured in each server, so that data interaction between each server and a data center in the cluster is realized; a server imports configuration information content related to each business service into a data center in a form of a configuration template through a unified configuration management tool, and when the business service is started, each business service transmits a configuration path and a name of the business service to a corresponding configuration acquisition module; and the configuration acquisition module acquires the configuration information content from the data center according to the configuration path and the name so as to realize unified management of the configuration information content of each business service. The problem that in the prior art, maintenance of configuration information content depends on proxy services on all the servers, so that loads of the servers are increased, and reliability is poor is solved.

Description

Technical Field

[0001] The present invention relates to a monitoring platform and a method for realizing unified configuration management thereof, belonging to the technical field of power equipment control. Background Art

[0002] For the monitoring platform, the premise of normal operation is the normal operation of platform services and real-time update of information, and the normal operation of platform services depends on the real-time and accurate configuration information.

[0003] Traditional service monitoring platforms read configuration information by reading configuration files on local servers. For platform systems deployed in clusters, in order to ensure the uniformity of configuration files on cluster servers, if configuration information needs to be changed during daily operation and maintenance, the corresponding configuration information needs to be modified on all servers in the cluster. For monitoring platform systems, the configuration workload is large and the technical requirements for operation and maintenance personnel are high. In addition, operation and maintenance personnel need to modify the configuration information of all servers, and negligence or omissions are inevitable in their work.

[0004] In order to unify management and reduce the workload of operation and maintenance, the existing technology realizes unified management of configuration information by setting up a proxy service on the cluster server, regularly scanning the local configuration information through the proxy service, and uploading it to the management module. The management module verifies the uploaded configuration information and issues configuration update commands. However, this method relies on the normal operation of the deployed proxy service. If the proxy service is abnormal, the configuration information cannot be maintained normally, which may cause abnormal operation of the monitoring platform and lead to serious accidents. In addition, due to the deployment of the proxy service, this method also causes the problem of increased server load. Summary of the Invention

[0005] The purpose of the present invention is to provide a monitoring platform and a method for implementing unified configuration management thereof, so as to solve the problem in the prior art that the maintenance of configuration information content depends on the proxy service on each server, resulting in increased server load and poor reliability.

[0006] To achieve the above object, the solution of the present invention includes:

[0007] A method for implementing unified configuration management of a monitoring platform of the present invention comprises the following steps:

[0008] 1) The deployment consists of n server clusters, one of which is configured with a unified configuration management tool. Each server interacts with the data center in the cluster. The server uses the unified configuration management tool to import business service-related configuration information into the data center in the form of configuration templates.

[0009] 2) When a business service in the server is started, each business service passes its configuration path and name to its corresponding configuration acquisition module. The configuration acquisition module obtains the configuration information content from the data center based on the configuration path and name, and provides it to the business service for use. The business service configuration path and name refer to the location where the configuration information related to the business service is stored in the data center and the name of the stored file, respectively.

[0010] Furthermore, if the obtained configuration information content contains a reference, the configuration acquisition module will obtain the reference content from the data center according to the reference name and specified path in the configuration information content, instantiate the configuration reference content, and return it to the business service; otherwise, the configuration acquisition module will read the configuration information content for use by the business service.

[0011] Furthermore, the configuration template includes a first general configuration template, a second general configuration template and a special configuration template. The first general configuration template is the same for all servers in the cluster and does not need to be configured according to different monitoring systems; the second general configuration template is the same for all servers in the cluster but contains the server IP or machine name that needs to be configured; the special configuration template has different configuration contents for different servers in the cluster.

[0012] Furthermore, the configuration information content of the first general configuration template does not contain references; the configuration information content of the second general configuration template and the configuration information content of the dedicated configuration template contain references.

[0013] Furthermore, the interaction between the configuration acquisition module and the data center adopts a subscription service method to subscribe to the configuration information content of the specified path. If the configuration information content of the specified path in the data center changes, the cluster's service center will notify the configuration acquisition module. After receiving the notification, the configuration acquisition module will call back the changed configuration information content to the business service to update the configuration information content of the business service in real time.

[0014] Furthermore, the configuration acquisition module also includes a configuration information processing module, an interface for obtaining configuration information, and a subscription callback interface. The configuration information processing module obtains the configuration path, name, and subscription tag from the business service through the configuration information acquisition interface, and receives configuration / subscription / change notifications from the data center. When the configuration information content of the subscription-specified path changes, the change notification is sent to the subscription callback interface, and the subscription callback interface sends the change notification and the changed configuration information content to the business service.

[0015] Furthermore, the unified configuration management tool is used to parse, modify and maintain the configuration information content.

[0016] Furthermore, when the unified configuration management tool on any server modifies the configuration information content, the configuration information on other servers is synchronously updated.

[0017] A monitoring platform is configured using any of the above methods for implementing unified configuration management of a monitoring platform.

[0018] The beneficial effects of the present invention are as follows: as an improved invention, the present invention realizes data interaction between each server and the data center in the cluster by deploying a cluster including multiple servers, configuring a unified configuration management tool in one of the servers, and configuring an acquisition module in each server. In order to achieve strong consistency of configuration, after the cluster is deployed, the server imports the configuration information content related to each business service into the data center in the form of a configuration template through the unified configuration management tool. When the business service of the server is started, each business service passes its configuration path and name to its corresponding configuration acquisition module. The configuration acquisition module obtains the configuration information content from the data center according to the configuration path and name, so as to realize unified management of the configuration information content of each business service. Therefore, the present invention solves the problem in the prior art that the maintenance of configuration information content depends on the proxy service on each server, resulting in increased server load and poor reliability. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 This is an architecture diagram of a unified configuration management system for a monitoring platform based on Consul in an embodiment of the present invention;

[0020] Figure 2 It is the schematic diagram of the configuration acquisition module. DETAILED DESCRIPTION

[0021] In order to make the objectives, technical solutions and advantages of the present invention more clear, the present invention is described in detail below in detail with reference to the accompanying drawings and embodiments.

[0022] The idea of ​​the present invention is to set up a configuration template that can store configuration information content in the data center. When the business service is started, the configuration acquisition module uses the configuration path and name to obtain the configuration information content from the data center to achieve unified management of the configuration information content of each business service.

[0023] An embodiment of a method for implementing unified configuration management of a monitoring platform:

[0024] The present invention can be implemented based on a consul cluster, or the consul cluster can be replaced with a Redis cluster by making adaptive modifications to the specific data processing part. The following description will be made using a consul cluster as an example.

[0025] like Figure 1As shown in the figure, the unified configuration management system architecture diagram of the monitoring platform in this embodiment mainly includes a consul cluster containing n servers, one of which is configured with a unified configuration management tool and n business services. Each server interacts with the consul data center in the consul cluster to achieve a single source of business service access configuration information on all servers in the cluster. In order to achieve strong configuration consistency, after the consul cluster is deployed, the server imports the configuration information related to each business service into the consul data center in the form of a configuration template through the unified configuration management tool.

[0026] The function of the unified configuration management tool is to import and maintain the configuration template content in the consul data center. It is only used when modifications are needed, and the tool can be modified on any server in the cluster, and the modified content will be synchronized to the data center, so the tool does not need to be deployed on all servers. Each business service corresponds to a configuration acquisition module. When the business service in the server is started, each business service module passes its configuration path and name to its corresponding configuration acquisition module. The configuration acquisition module obtains the required configuration information content from the consul data center based on the configuration path and name, and provides the configuration information content to the business service for its use. The business service configuration path and name here refer to the location where the configuration information related to the business service is stored in the consul data center and the name of the stored file, respectively. The configuration information content is previously imported into the consul data center by the unified configuration management tool in the form of a configuration template.

[0027] In fact, the combination of the business service configuration file path and name determines the storage location of the corresponding configuration file content in the consul data center. According to the storage location of the consul data center, the corresponding configuration file template content can be obtained. After instantiating the reference information contained in the template content, the actual content of the configuration file can be obtained. The concepts of templates and references are introduced mainly to handle the situation where the content of the same configuration file is different on different servers. The instantiation process will instantiate the corresponding reference content according to the corresponding server name.

[0028] In this embodiment, there are three types of configuration templates after the consul cluster is deployed: (1) General configuration template (also called first general configuration template): all servers in the cluster are the same and do not need to be configured according to different monitoring systems; (2) General configuration template (also called second general configuration template): all servers in the cluster are the same but contain the server IP or machine name that needs to be configured; (3) Special configuration template: different servers in the cluster have different configuration contents.

[0029] In the above configuration template, if it is the first general configuration template, the configuration information content can be directly obtained by the configuration acquisition module and provided to the business service for use; if it is the second general configuration template or a dedicated configuration template, the content of different parts is processed by reference to achieve the universality of the template configuration.

[0030] Specifically, after the configuration acquisition module obtains the configuration information content in the consul data center according to the configuration path and name, the configuration information content is parsed through the configuration information processing logic. If the obtained configuration information content does not contain a reference, the configuration information content is returned to the business service module; otherwise, if the obtained configuration information content contains a reference, the configuration acquisition module obtains the reference content from the consul data center according to the reference name and specified path in the configuration information content, instantiates the configuration content, and then returns it to the business service module.

[0031] In order to proactively notify the business service module when the configuration information of a business service in the consul data center changes, the configuration acquisition module also provides a business service subscription function.

[0032] Specifically, the business service subscription function is used for the business service module to subscribe to the configuration information content of the specified path. If the configuration information content of the specified path in the consul data center changes, the consul service center of the consul cluster will immediately notify the configuration acquisition module. After receiving the notification, the configuration acquisition module will call back the changed configuration information content to the business service to update the configuration information content of the business service in real time, so that the configuration information modification can take effect online without restarting the service, effectively improving the reliability and stability of the monitoring platform system.

[0033] In summary, the configuration acquisition module plays an important role in the monitoring platform. It needs to be loaded by each business service. On the one hand, each business service needs to read its configuration information content through this module. When obtaining the configuration information content, it is also necessary to parse whether the configuration information content contains references. By setting references in different environments, the uniformity of configuration templates is achieved. Different monitoring systems instantiate the configuration information content applicable to specific servers according to the reference content and notify specific business services, reducing the entity configuration files and increasing the security of configuration information. On the other hand, the module supports business service subscription functions. By setting real-time monitoring of configuration information content, the business service can be notified of the latest configuration content in real time when the configuration information specified by the business service in the consul data center changes, and online updates after configuration information changes are achieved, avoiding the problem that the configuration information needs to be restarted to take effect after modification.

[0034] Specifically, the schematic diagram of the configuration acquisition module is as follows: Figure 2As shown, it includes a configuration information processing module, an interface for obtaining configuration information, and a subscription callback interface.

[0035] When the business service starts, the configuration information (configuration path and name) specified by the service can be obtained by calling the configuration information acquisition interface provided by this module. It also supports setting whether to subscribe to the configuration information (if subscribed, set the subscription tag); the configuration information processing module obtains the configuration information and subscription tag through the configuration information acquisition interface on the one hand, and obtains the configuration / subscription / change notification of the consul data center on the other hand, and sends the change notification to the subscription callback interface when the configuration information content of the subscription specified path changes; the subscription callback interface is used to send change notifications to the business processing module.

[0036] In this embodiment, the unified configuration management tool can display annotations on the configuration information, implement content parsing of the configuration information, and visually modify and maintain it, and limit the modification permissions of operation and maintenance personnel. In addition, the unified configuration management tool can also be used on any server in the cluster. Operation and maintenance personnel can synchronize and update the configuration information on all servers through the unified configuration management tool on any server, thereby increasing the convenience of maintenance.

[0037] Example of monitoring platform:

[0038] The monitoring platform of the present invention is configured using the above-mentioned method for implementing unified configuration management of a monitoring platform. This method has been clearly introduced in the method embodiment and will not be repeated here.

Claims

1. A method for implementing unified configuration management of a monitoring platform, characterized in that: The steps include: 1) The deployment consists of n server clusters, one of which is configured with a unified configuration management tool. Each server interacts with the data center in the cluster. The server uses the unified configuration management tool to import business service-related configuration information into the data center in the form of configuration templates. 2) When a business service in the server is started, each business service passes its configuration path and name to its corresponding configuration acquisition module. The configuration acquisition module obtains the configuration information content from the data center based on the configuration path and name, and provides it to the business service for use. The business service configuration path and name refer to the location where the configuration information related to the business service is stored in the data center and the name of the stored file, respectively.

2. The method for implementing unified configuration management of a monitoring platform according to claim 1, characterized in that: If the obtained configuration information content contains a reference, the configuration acquisition module will obtain the reference content from the data center according to the reference name and specified path in the configuration information content, instantiate the configuration reference content, and return it to the business service; otherwise, the configuration acquisition module will read the configuration information content for use by the business service.

3. The method for implementing unified configuration management of a monitoring platform according to claim 2, characterized in that: The configuration templates include a first general configuration template, a second general configuration template and a special configuration template. The first general configuration template is the same for all servers in the cluster and does not need to be configured according to different monitoring systems; the second general configuration template is the same for all servers in the cluster but contains the server IP or machine name that needs to be configured; the special configuration template has different configuration contents for different servers in the cluster.

4. The method for implementing unified configuration management of a monitoring platform according to claim 3, characterized in that: The configuration information content of the first general configuration template does not contain references; the configuration information content of the second general configuration template and the configuration information content of the dedicated configuration template contain references.

5. The method for implementing unified configuration management of a monitoring platform according to claim 1, characterized in that: The interaction between the configuration acquisition module and the data center adopts a subscription service method to subscribe to the configuration information content of the specified path. If the configuration information content of the specified path in the data center changes, the cluster service center will notify the configuration acquisition module. After receiving the notification, the configuration acquisition module will call back the changed configuration information content to the business service to update the configuration information content of the business service in real time.

6. The method for implementing unified configuration management of a monitoring platform according to claim 5, characterized in that: The configuration acquisition module also includes a configuration information processing module, a configuration information acquisition interface and a subscription callback interface. The configuration information processing module obtains the configuration path, name and subscription tag from the business service through the configuration information acquisition interface, and receives configuration / subscription / change notifications from the data center. When the configuration information content of the subscription-specified path changes, the change notification is sent to the subscription callback interface, and the subscription callback interface sends the change notification and the changed configuration information content to the business service.

7. The method for implementing unified configuration management of a monitoring platform according to claim 1, characterized in that: The unified configuration management tool is used to parse, modify and maintain configuration information content.

8. The method for implementing unified configuration management of a monitoring platform according to claim 7, characterized in that: When the unified configuration management tool on any server modifies the configuration information content, the configuration information on other servers is synchronously updated.

9. A monitoring platform, characterized in that: The monitoring platform is configured by using the method for implementing unified configuration management of a monitoring platform as described in any one of claims 1 to 8.

Images