Cluster configuration method, device, electronic device and computer readable medium

Abstract

The embodiments of the present disclosure disclose a cluster configuration method, device, electronic device, and computer-readable medium. A specific implementation of the method includes: in response to determining that a configuration task corresponding to a target cluster component meets a preset trigger condition, obtaining monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task; extracting a configuration recommendation operator from the cluster configuration information; generating a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator; in response to the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result meeting a preset abnormal condition, sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster, wherein the target cluster component is deployed in the target cluster. This implementation can realize automatic and dynamic modification of the resource configuration of the cluster.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of computer technology, and in particular to a cluster configuration method, device, electronic device, and computer-readable medium. Background Art

[0002] With the development of big data and AI technologies, big data platforms built on the cloud service IaaS (Infrastructure as a Service) layer have been launched one after another. Big data platforms can deploy multiple cluster components. At present, when configuring resources for cluster components of big data clusters, the usual approach is to keep the configuration of each cluster node of the big data cluster consistent, or to configure through operation and maintenance means or tools, such as using ansible to send the configuration information completely to the big data cluster, and restart the cluster components to take effect.

[0003] However, when using the above method to configure resources, the following technical problems often occur: manual operation by operation and maintenance personnel is required, the configuration cannot be modified automatically, and the optimization of the configuration depends on expert experience, and the configuration cannot be adjusted dynamically at any time. Summary of the invention

[0004] The content of this disclosure is used to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. The content of this disclosure is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to limit the scope of the technical solution claimed for protection.

[0005] Some embodiments of the present disclosure propose a cluster configuration method, an apparatus, an electronic device, and a computer-readable medium to solve the technical problems mentioned in the above background technology section.

[0006] In a first aspect, some embodiments of the present disclosure provide a cluster configuration method, the method comprising: in response to determining that a configuration task corresponding to a target cluster component satisfies a preset trigger condition, obtaining monitoring information corresponding to the above-mentioned target cluster component and cluster configuration information corresponding to the above-mentioned configuration task; extracting a configuration recommendation operator from the above-mentioned cluster configuration information; generating a cluster configuration recommendation result based on the above-mentioned monitoring information and the above-mentioned configuration recommendation operator; in response to the above-mentioned cluster configuration recommendation result and the configuration result of the target cluster corresponding to the above-mentioned configuration recommendation result satisfying a preset abnormal condition, sending the above-mentioned cluster configuration recommendation result to each cluster node corresponding to the above-mentioned target cluster, wherein the above-mentioned target cluster component is deployed in the above-mentioned target cluster.

[0007] Optionally, the sending of the cluster configuration recommendation result to each cluster node corresponding to the target cluster includes: sending the cluster configuration recommendation result to an associated display device; in response to receiving a confirmation sending information record corresponding to the cluster configuration recommendation result, sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster.

[0008] Optionally, the method further includes: in response to receiving a cancellation information sending record corresponding to the above-mentioned cluster configuration recommendation result, or the above-mentioned cluster configuration recommendation result and the configuration result of the above-mentioned target cluster corresponding to the above-mentioned configuration recommendation result do not meet the above-mentioned preset abnormal condition, determining the above-mentioned configuration result as the target configuration result.

[0009] Optionally, the monitoring information is collected based on the cluster configuration information; and the generating of the cluster configuration recommendation result includes: inputting the monitoring information into the configuration recommendation operator to obtain the cluster configuration recommendation result.

[0010] Optionally, in response to determining that the configuration task corresponding to the target cluster component satisfies a preset trigger condition, obtaining the monitoring information corresponding to the target cluster component and the cluster configuration information corresponding to the configuration task includes: in response to determining that the current time satisfies a preset periodic trigger condition included in the preset trigger condition, obtaining the monitoring information corresponding to the target cluster component and the cluster configuration information corresponding to the configuration task.

[0011] Optionally, sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster includes storing the cluster configuration recommendation result in a target database.

[0012] Optionally, the cluster configuration information includes configuration modification priority information, and the sending of the cluster configuration recommendation result to each cluster node corresponding to the target cluster includes: sending the configuration modification priority information and the cluster configuration recommendation result to each cluster node.

[0013] In a second aspect, some embodiments of the present disclosure provide a cluster configuration device, comprising: an acquisition unit, configured to, in response to determining that a configuration task corresponding to a target cluster component satisfies a preset trigger condition, acquire monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task; an extraction unit, configured to extract a configuration recommendation operator from the cluster configuration information; a generation unit, configured to generate a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator; a sending unit, configured to, in response to the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result satisfying a preset abnormal condition, send the cluster configuration recommendation result to each cluster node corresponding to the target cluster, wherein the target cluster component is deployed in the target cluster.

[0014] Optionally, the sending unit of the device is further configured to: send the above-mentioned cluster configuration recommendation result to an associated display device; in response to receiving a confirmation sending information record corresponding to the above-mentioned cluster configuration recommendation result, send the above-mentioned cluster configuration recommendation result to each cluster node corresponding to the above-mentioned target cluster.

[0015] Optionally, the device also includes: a determination unit, configured to determine the above configuration result as the target configuration result in response to receiving a cancellation information sending record corresponding to the above cluster configuration recommendation result, or the above cluster configuration recommendation result and the configuration result of the above target cluster corresponding to the above configuration recommendation result do not meet the above preset abnormal condition.

[0016] Optionally, the monitoring information is collected based on the cluster configuration information. The generating unit is further configured to: input the monitoring information into the configuration recommendation operator to obtain a cluster configuration recommendation result.

[0017] Optionally, the acquisition unit is further configured to: in response to determining that the current time satisfies a preset period trigger condition included in the preset trigger condition, acquire monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task.

[0018] Optionally, the sending unit includes: a storage unit configured to store the above cluster configuration recommendation result in a target database.

[0019] Optionally, the cluster configuration information includes configuration modification priority information. The sending unit is further configured to: send the configuration modification priority information and the cluster configuration recommendation result to each of the cluster nodes.

[0020] In a third aspect, some embodiments of the present disclosure provide an electronic device comprising: one or more processors; a storage device on which one or more programs are stored, and when the one or more programs are executed by the one or more processors, the one or more processors implement the method described in any implementation manner of the above-mentioned first aspect.

[0021] In a fourth aspect, some embodiments of the present disclosure provide a computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method described in any implementation manner of the above-mentioned first aspect is implemented.

[0022] The above-mentioned various embodiments of the present disclosure have the following beneficial effects: through the cluster configuration method of some embodiments of the present disclosure, the resource configuration of the cluster can be automatically and dynamically modified. Specifically, the reason why the resource configuration of the cluster cannot be automatically and dynamically modified is that: manual operation by operation and maintenance personnel is required, the configuration cannot be automatically modified, and the optimization of the configuration depends on expert experience, and the configuration cannot be dynamically adjusted at any time. Based on this, the cluster configuration method of some embodiments of the present disclosure, first, in response to determining that the configuration task corresponding to the target cluster component meets the preset trigger condition, obtains the monitoring information corresponding to the above-mentioned target cluster component and the cluster configuration information corresponding to the above-mentioned configuration task. Thus, the monitoring information of the cluster component (i.e., the target cluster component) corresponding to the currently triggered configuration task and the cluster configuration information of the currently triggered configuration task can be automatically obtained through the trigger condition corresponding to the configuration task. Then, the configuration recommendation operator is extracted from the above-mentioned cluster configuration information. Afterwards, based on the above-mentioned monitoring information and the above-mentioned configuration recommendation operator, a cluster configuration recommendation result is generated. Thus, the cluster configuration recommendation result can be automatically generated through the configuration recommendation operator and the monitoring information included in the cluster configuration information. Finally, in response to the above cluster configuration recommendation result and the configuration result of the target cluster corresponding to the above configuration recommendation result satisfying the preset abnormal condition, the above cluster configuration recommendation result is sent to each cluster node corresponding to the above target cluster. Among them, the above target cluster component is deployed in the above target cluster. Therefore, when the automatically generated cluster configuration recommendation result is different from the current configuration result of the target cluster, the cluster configuration recommendation result can be automatically pushed to each cluster node of the target cluster, so that each cluster node performs configuration modification according to the cluster configuration recommendation result. Also, because the cluster configuration recommendation result can be automatically generated and pushed, the resource configuration of the cluster can be automatically and dynamically modified. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0024] Figure 1 is a schematic diagram of an application scenario of a cluster configuration method according to some embodiments of the present disclosure;

[0025] Figure 2 is a flow chart of some embodiments of the cluster configuration method according to the present disclosure;

[0026] Figure 3 are flow charts of other embodiments of the cluster configuration method according to the present disclosure;

[0027] Figure 4 are flow charts of some further embodiments of the cluster configuration method according to the present disclosure;

[0028] Figure 5 is a schematic diagram of the structure of some embodiments of the cluster configuration device according to the present disclosure;

[0029] Figure 6 It is a schematic diagram of the structure of an electronic device suitable for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION

[0030] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0031] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0032] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0033] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0034] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0035] The present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0036] Figure 1 It is a schematic diagram of an application scenario of the cluster configuration method according to some embodiments of the present disclosure.

[0037] exist Figure 1 In the application scenario, first, the computing device 101 can obtain the monitoring information 103 corresponding to the target cluster component and the cluster configuration information 104 corresponding to the configuration task 102 in response to determining that the configuration task 102 corresponding to the target cluster component meets the preset trigger condition. Then, the computing device 101 can extract the configuration recommendation operator 105 from the cluster configuration information 104. After that, the computing device 101 can generate a cluster configuration recommendation result 106 based on the monitoring information 103 and the configuration recommendation operator 105. Finally, the computing device 101 can send the cluster configuration recommendation result 106 to each cluster node 108 corresponding to the target cluster in response to the cluster configuration recommendation result 106 and the configuration result 107 of the target cluster corresponding to the configuration recommendation result 106 meeting the preset abnormal condition. Among them, the target cluster component is deployed in the target cluster.

[0038] It should be noted that the computing device 101 can be hardware or software. When the computing device is hardware, it can be implemented as a distributed cluster consisting of multiple servers or terminal devices, or as a single server or a single terminal device. When the computing device is embodied as software, it can be installed in the hardware devices listed above. It can be implemented as multiple software or software modules for providing distributed services, or as a single software or software module. No specific limitation is made here.

[0039] It should be understood that Figure 1 The number of computing devices in the embodiment is only illustrative. Any number of computing devices may be provided according to implementation requirements.

[0040] Continue to refer Figure 2 , shows a process 200 of some embodiments of the cluster configuration method according to the present disclosure. The cluster configuration method comprises the following steps:

[0041] Step 201 : in response to determining that a configuration task corresponding to a target cluster component satisfies a preset trigger condition, acquiring monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task.

[0042] In some embodiments, the execution body of the cluster configuration method (eg Figure 1The computing device 101 shown in the figure can obtain the monitoring information corresponding to the target cluster component and the cluster configuration information corresponding to the configuration task from the target database through a wired connection or a wireless connection in response to determining that the configuration task corresponding to the target cluster component meets the preset trigger condition. Among them, the preset trigger condition can be "detecting the trigger instruction of the configuration task". The trigger instruction can be an instruction generated by the user manually triggering the configuration task. The configuration task can be a task for cluster configuration of the target cluster component. For example, the configuration task can be a scheduled task for cluster configuration of the target cluster component. The target cluster component can be a cluster component corresponding to the configuration task. The cluster component can be a big data component. For example, the target cluster component can be but not limited to one of the following: hadoop component, hbase component, elasticsearh component. The target database can be a database storing the cluster configuration information of each cluster component submitted by the user and the monitoring information of each cluster component. The monitoring information can be real-time monitoring related information of the operation of the target cluster component, which can include but not limited to: basic information, component business information. Among them, the basic information can be related information when the device is running, which can include but not limited to: memory occupancy rate, CPU occupancy rate. The component business information may be the relevant business information corresponding to the cluster component, and may include but not limited to: query rate per second, read speed, JVM maximum memory, and JVM minimum memory. The cluster configuration information may be the relevant information for configuring the target cluster component included in the configuration task, and may include but not limited to: cluster component name, configuration parameters corresponding to the cluster component name, configuration recommendation operator, and execution cycle. The cluster configuration information may also include an identifier indicating whether the corresponding configuration task is retryable. The execution cycle may be a cycle for triggering the configuration task. The configuration parameters may include but not limited to one of the following: JVM memory, number of concurrency, file block size, and number of Kafka partitions. The configuration recommendation operator may be an operator configured by the user to generate cluster configuration recommendation results by adding indicators and operators. For example, the configuration recommendation operator may be a formula configured by the user with the indicator added by the user as an independent variable and the configuration parameter as a dependent variable. The configuration recommendation operator may also be a code block of a method with the indicator added by the user as a parameter and the value of the configuration parameter as a return value. As an example, the above cluster configuration information may be "cluster component name: HIVE, configuration parameter: hive.heapsize, configuration recommendation operator: hive.heap.max×1.2, execution period: 20 minutes".

[0043] It should be noted that the above-mentioned wireless connection methods may include but are not limited to 3G / 4G connection, WiFi connection, Bluetooth connection, WiMAX connection, Zigbee connection, UWB (ultra wideband) connection, and other wireless connection methods currently known or to be developed in the future.

[0044] In some optional implementations of some embodiments, the execution subject may obtain the monitoring information corresponding to the target cluster component and the cluster configuration information corresponding to the configuration task in response to determining that the current time satisfies the preset periodic trigger condition included in the preset trigger condition. The preset trigger condition includes a preset periodic trigger condition. The preset periodic trigger condition may be "the current time is the periodic trigger time of the configuration task". For example, the current time may be "2021 / 8 / 1 11:00". The period of triggering the configuration task may be 20 minutes. The last time the configuration task was triggered may be "2021 / 8 / 1 10:40". Then the current time "2021 / 8 / 1 11:00" is the periodic trigger time of the configuration task after "2021 / 8 / 1 10:40". Thus, the monitoring information and cluster configuration information may be automatically and periodically obtained through the preset periodic trigger condition.

[0045] Step 202: extract the configuration recommendation operator from the cluster configuration information.

[0046] In some embodiments, the execution subject may extract the configuration recommendation operator from the cluster configuration information. In practice, the execution subject may extract the field value of the field "configuration recommendation operator" from the cluster configuration information as the configuration recommendation operator.

[0047] Step 203: Generate a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator.

[0048] In some embodiments, the above-mentioned execution subject may generate a cluster configuration recommendation result based on the above-mentioned monitoring information and the above-mentioned configuration recommendation operator. In practice, first, the above-mentioned execution subject may extract various information corresponding to each indicator in the above-mentioned configuration recommendation operator from the above-mentioned monitoring information as various indicator value information. Then, the above-mentioned various indicator value information may be respectively input into the above-mentioned configuration recommendation operator to obtain the cluster configuration recommendation result. For example, the above-mentioned configuration recommendation operator may be "hive.heap.max×1.2". The above-mentioned various indicator value information may be "hive.heap.max: 128G". The generated cluster configuration recommendation result may be: "hive.heapsize: 153.6G" (153.6G=128G×1.2).

[0049] Optionally, the monitoring information is collected based on the cluster configuration information. Then the monitoring information only includes the information corresponding to the indicators in the configuration recommendation operator included in the cluster configuration information. The execution subject can directly input the monitoring information into the configuration recommendation operator to obtain the cluster configuration recommendation result. In this way, the utilization rate of the monitoring information can be improved, so that the monitoring information can be directly input into the configuration recommendation operator to obtain the cluster configuration recommendation result.

[0050] Step 204 , in response to the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result satisfying a preset abnormal condition, the cluster configuration recommendation result is sent to each cluster node corresponding to the target cluster.

[0051] In some embodiments, the above-mentioned execution subject may send the above-mentioned cluster configuration recommendation result to each cluster node corresponding to the above-mentioned target cluster in response to the above-mentioned cluster configuration recommendation result and the configuration result of the target cluster corresponding to the above-mentioned configuration recommendation result satisfying the preset abnormal condition. The above-mentioned target cluster may be a cluster of computers on which the above-mentioned target cluster components are deployed. The above-mentioned configuration result may be the configuration parameter value of the configuration parameter included in the above-mentioned configuration recommendation result corresponding to the above-mentioned target cluster. For example, the above-mentioned configuration result may be "hive.heapsize: 128G". The above-mentioned preset abnormal condition may be that the above-mentioned cluster configuration recommendation result is different from the above-mentioned configuration result. In practice, the above-mentioned execution subject may synchronously send the above-mentioned cluster configuration recommendation result to each cluster node corresponding to the above-mentioned target cluster. It can be understood that the above-mentioned execution subject may be any node among the above-mentioned cluster nodes.

[0052] In some optional implementations of some embodiments, the execution subject may also store the cluster configuration recommendation result in a target database. The target database may be a database storing the monitoring information and the cluster configuration information. For example, the target database may be a MYSQL database. Thus, the sent cluster configuration recommendation result may be stored and backed up.

[0053] The above-mentioned various embodiments of the present disclosure have the following beneficial effects: through the cluster configuration method of some embodiments of the present disclosure, the resource configuration of the cluster can be automatically and dynamically modified. Specifically, the reason why the resource configuration of the cluster cannot be automatically and dynamically modified is that: manual operation by operation and maintenance personnel is required, the configuration cannot be automatically modified, and the optimization of the configuration depends on expert experience, and the configuration cannot be dynamically adjusted at any time. Based on this, the cluster configuration method of some embodiments of the present disclosure, first, in response to determining that the configuration task corresponding to the target cluster component meets the preset trigger condition, obtains the monitoring information corresponding to the above-mentioned target cluster component and the cluster configuration information corresponding to the above-mentioned configuration task. Thus, the monitoring information of the cluster component (i.e., the target cluster component) corresponding to the currently triggered configuration task and the cluster configuration information of the currently triggered configuration task can be automatically obtained through the trigger condition corresponding to the configuration task. Then, the configuration recommendation operator is extracted from the above-mentioned cluster configuration information. Afterwards, based on the above-mentioned monitoring information and the above-mentioned configuration recommendation operator, a cluster configuration recommendation result is generated. Thus, the cluster configuration recommendation result can be automatically generated through the configuration recommendation operator and the monitoring information included in the cluster configuration information. Finally, in response to the above cluster configuration recommendation result and the configuration result of the target cluster corresponding to the above configuration recommendation result satisfying the preset abnormal condition, the above cluster configuration recommendation result is sent to each cluster node corresponding to the above target cluster. Among them, the above target cluster component is deployed in the above target cluster. Therefore, when the automatically generated cluster configuration recommendation result is different from the current configuration result of the target cluster, the cluster configuration recommendation result can be automatically pushed to each cluster node of the target cluster, so that each cluster node performs configuration modification according to the cluster configuration recommendation result. Also, because the cluster configuration recommendation result can be automatically generated and pushed, the resource configuration of the cluster can be automatically and dynamically modified.

[0054] Further references Figure 3 , which shows a process 300 of another embodiment of a cluster configuration method. The process 300 of the cluster configuration method includes the following steps:

[0055] Step 301 : in response to determining that a configuration task corresponding to a target cluster component satisfies a preset trigger condition, acquiring monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task.

[0056] Step 302: extract the configuration recommendation operator from the cluster configuration information.

[0057] Step 303: Generate a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator.

[0058] In some embodiments, the specific implementation of steps 301-303 and the technical effects brought about can be referred to Figure 2The corresponding steps 201-203 in the embodiments are not described in detail here.

[0059] Step 304: Send the cluster configuration recommendation result to the associated display device.

[0060] In some embodiments, the execution body of the cluster configuration method (eg Figure 1 The computing device 101 shown can send the cluster configuration recommendation result to an associated display device in response to the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result satisfying a preset abnormal condition, so that the display device displays the cluster configuration recommendation result.

[0061] Step 305 : in response to receiving a confirmation sending information record corresponding to the cluster configuration recommendation result, the cluster configuration recommendation result is sent to each cluster node corresponding to the target cluster.

[0062] In some embodiments, the execution subject may send the cluster configuration recommendation result to each cluster node corresponding to the target cluster in response to receiving a confirmation sending information record corresponding to the cluster configuration recommendation result. The confirmation sending information record may be an information record generated by the execution subject after the user browses the displayed cluster configuration recommendation result through the display device and performs a confirmation sending operation on the displayed cluster configuration recommendation result, indicating that the cluster configuration recommendation result has been confirmed to be sent. The confirmation sending operation may include but is not limited to: clicking, sliding, hovering, and dragging. Thus, the cluster configuration recommendation result may be pushed after the user confirms the automatically generated cluster configuration recommendation result.

[0063] Optionally, in response to receiving a cancellation information record corresponding to the above-mentioned cluster configuration recommendation result, or the above-mentioned cluster configuration recommendation result and the configuration result of the above-mentioned target cluster corresponding to the above-mentioned configuration recommendation result do not meet the above-mentioned preset abnormal condition, the above-mentioned execution subject may determine the above-mentioned configuration result as the target configuration result. Among them, the above-mentioned cancellation information record may be an information record representing that the above-mentioned cluster configuration recommendation result has been canceled for sending, which is generated by the above-mentioned execution subject after the user browses the above-mentioned cluster configuration recommendation result displayed through the above-mentioned display device and performs a cancellation sending operation on the above-mentioned cluster configuration recommendation result displayed. The above-mentioned cancellation sending operation may include but is not limited to: clicking, sliding, hovering, and dragging. The above-mentioned target configuration result may be a configuration result that represents that the above-mentioned configuration result does not need to be modified. As a result, when the user cancels sending the cluster configuration recommendation result, or the cluster configuration recommendation result is the same as the configuration result, the original configuration of the target cluster can be maintained.

[0064] from Figure 3It can be seen that Figure 2 Compared with the description of some corresponding embodiments, Figure 3 The process 300 of the cluster configuration method in some corresponding embodiments embodies the steps of displaying the cluster configuration recommendation result and expanding the confirmation sending information record. Therefore, the scheme described in these embodiments can push the cluster configuration recommendation result after the user confirms the automatically generated cluster configuration recommendation result.

[0065] Further references Figure 4 , which shows a process 400 of some other embodiments of the cluster configuration method. The process 400 of the cluster configuration method includes the following steps:

[0066] Step 401 : in response to determining that a configuration task corresponding to a target cluster component satisfies a preset trigger condition, monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task are acquired.

[0067] Step 402: extract the configuration recommendation operator from the cluster configuration information.

[0068] Step 403: Generate a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator.

[0069] In some embodiments, the specific implementation of steps 401-403 and the technical effects brought about can be referred to Figure 2 The corresponding steps 201-203 in the embodiments are not described in detail here.

[0070] Step 404: Send the configuration modification priority information and the cluster configuration recommendation result to each cluster node.

[0071] In some embodiments, the execution body of the cluster configuration method (eg Figure 1The computing device 101 shown in the figure can respond to the above-mentioned cluster configuration recommendation result and the configuration result of the target cluster corresponding to the above-mentioned configuration recommendation result meeting the preset abnormal condition, and send the configuration modification priority information and the above-mentioned cluster configuration recommendation result to the above-mentioned each cluster node. Among them, the above-mentioned cluster configuration information includes the above-mentioned configuration modification priority information. The above-mentioned configuration modification priority information can be information that characterizes the urgency of modifying the configuration or the degree of priority to be handled. For example, the configuration modification priority information can include but is not limited to one of the following: high priority, medium priority, and low priority. Among them, the above-mentioned high priority can represent that if the current configuration parameters are abnormal, it will seriously affect the cluster performance and need to be modified immediately. The priority of modifying the configuration represented by the above-mentioned medium priority is lower than the above-mentioned high priority. The priority of modifying the configuration represented by the above-mentioned low priority is lower than the above-mentioned medium priority. Thus, the configuration modification priority information and the cluster configuration recommendation result can be sent to each cluster node of the cluster at the same time, so that each node of the cluster can modify the configuration in order according to the configuration modification priority information corresponding to the cluster configuration recommendation result.

[0072] from Figure 4 It can be seen that Figure 2 Compared with the description of some corresponding embodiments, Figure 4 The process 400 of the cluster configuration method in some corresponding embodiments embodies the step of expanding the configuration modification priority information. Therefore, the schemes described in these embodiments can simultaneously send the configuration modification priority information and the cluster configuration recommendation result to each cluster node of the cluster, so that each node of the cluster can perform configuration modification in order according to the configuration modification priority information corresponding to the cluster configuration recommendation result.

[0073] Further references Figure 5 As an implementation of the methods shown in the above figures, the present disclosure provides some embodiments of a cluster configuration device. These device embodiments are similar to Figure 2 Corresponding to the method embodiments shown, the device can be specifically applied to various electronic devices.

[0074] like Figure 5As shown, the cluster configuration device 500 of some embodiments includes: an acquisition unit 501, an extraction unit 502, a generation unit 503 and a sending unit 504. The acquisition unit 501 is configured to acquire the monitoring information corresponding to the target cluster component and the cluster configuration information corresponding to the configuration task in response to determining that the configuration task corresponding to the target cluster component meets the preset trigger condition; the extraction unit 502 is configured to extract the configuration recommendation operator from the cluster configuration information; the generation unit 503 is configured to generate a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator; the sending unit 504 is configured to send the cluster configuration recommendation result to each cluster node corresponding to the target cluster in response to the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result meeting the preset abnormal condition, wherein the target cluster component is deployed in the target cluster.

[0075] Optionally, the sending unit 504 of the cluster configuration device 500 can be further configured to: send the above-mentioned cluster configuration recommendation result to an associated display device; in response to receiving a confirmation sending information record corresponding to the above-mentioned cluster configuration recommendation result, send the above-mentioned cluster configuration recommendation result to each cluster node corresponding to the above-mentioned target cluster.

[0076] Optionally, the cluster configuration device 500 may further include: a determination unit (not shown in the figure), configured to determine the above configuration result as the target configuration result in response to receiving a cancellation information sending record corresponding to the above cluster configuration recommendation result, or the above cluster configuration recommendation result and the configuration result of the above target cluster corresponding to the above configuration recommendation result do not meet the above preset abnormal condition.

[0077] Optionally, the monitoring information is collected based on the cluster configuration information. The generating unit 503 may be further configured to: input the monitoring information into the configuration recommendation operator to obtain a cluster configuration recommendation result.

[0078] Optionally, the acquisition unit 501 may be further configured to: in response to determining that the current time satisfies a preset periodic trigger condition included in the preset trigger condition, acquire monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task.

[0079] Optionally, the sending unit 504 may include: a storage unit (not shown in the figure), configured to store the above cluster configuration recommendation result in a target database.

[0080] Optionally, the cluster configuration information includes configuration modification priority information. The sending unit 504 may be further configured to: send the configuration modification priority information and the cluster configuration recommendation result to each of the cluster nodes.

[0081] It is understood that the units described in the device 500 are similar to those described in the reference Figure 2 Therefore, the operations, features and beneficial effects described above for the method are also applicable to the device 500 and the units included therein, and will not be described in detail here.

[0082] Reference below Figure 6 , which shows an electronic device (eg, Figure 1 Schematic diagram of the structure of the computing device 101)600. Figure 6 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0083] like Figure 6 As shown, the electronic device 600 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 into a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the electronic device 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0084] Typically, the following devices may be connected to the I / O interface 605: an input device 606 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 608 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 609. The communication device 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 6 The electronic device 600 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead. Figure 6 Each block shown in the figure may represent one device, or may represent multiple devices as required.

[0085] In particular, according to some embodiments of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In some such embodiments, the computer program can be downloaded and installed from the network through the communication device 609, or installed from the storage device 608, or installed from the ROM 602. When the computer program is executed by the processing device 601, the above-mentioned functions defined in the method of some embodiments of the present disclosure are executed.

[0086] It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0087] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0088] The computer-readable medium may be included in the electronic device; or it may exist independently without being installed in the electronic device. The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: in response to determining that the configuration task corresponding to the target cluster component meets the preset trigger condition, obtains the monitoring information corresponding to the target cluster component and the cluster configuration information corresponding to the configuration task; extracts the configuration recommendation operator from the cluster configuration information; generates a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator; in response to the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the configuration recommendation result meeting the preset abnormal condition, sends the cluster configuration recommendation result to each cluster node corresponding to the target cluster, wherein the target cluster component is deployed in the target cluster.

[0089] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0090] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0091] The units described in some embodiments of the present disclosure may be implemented by software or by hardware. The described units may also be set in a processor, for example, may be described as: a processor includes an acquisition unit, an extraction unit, a generation unit and a sending unit. Among them, the names of these units do not constitute a limitation on the unit itself under certain circumstances. For example, the acquisition unit may also be described as "a unit that acquires monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the above configuration task in response to determining that the configuration task corresponding to the target cluster component meets a preset trigger condition."

[0092] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0093] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above invention concept. For example, the above features are replaced with (but not limited to) technical features with similar functions disclosed in the embodiments of the present disclosure.

Claims

1. A cluster configuration method, comprising: In response to determining that a configuration task corresponding to a target cluster component satisfies a preset trigger condition, acquiring monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task, wherein the target cluster component is a cluster component corresponding to the configuration task, and the cluster component is a big data component; Extracting a configuration recommendation operator from the cluster configuration information, wherein the configuration recommendation operator is an operator configured by a user by adding indicators and operators and used to generate a cluster configuration recommendation result; Based on the monitoring information and the configuration recommendation operator, a cluster configuration recommendation result is generated, wherein the generating of the cluster configuration recommendation result includes: extracting each information corresponding to each indicator in the configuration recommendation operator from the monitoring information as each indicator value information; inputting each indicator value information into the configuration recommendation operator respectively to obtain the cluster configuration recommendation result; In response to the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the cluster configuration recommendation result satisfying a preset abnormal condition, the cluster configuration recommendation result is sent to each cluster node corresponding to the target cluster, wherein the target cluster component is deployed in the target cluster, and the preset abnormal condition is that the cluster configuration recommendation result is different from the configuration result.

2. The method according to claim 1, wherein: The sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster includes: Sending the cluster configuration recommendation result to an associated display device; In response to receiving a confirmation sending information record corresponding to the cluster configuration recommendation result, the cluster configuration recommendation result is sent to each cluster node corresponding to the target cluster.

3. The method according to claim 2, wherein: The method further comprises: In response to receiving a cancellation information record corresponding to the cluster configuration recommendation result, or the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the cluster configuration recommendation result not satisfying the preset abnormal condition, the configuration result is determined as the target configuration result.

4. The method according to claim 1, wherein: The monitoring information is collected based on the cluster configuration information; as well as The generating of the cluster configuration recommendation result includes: The monitoring information is input into the configuration recommendation operator to obtain a cluster configuration recommendation result.

5. The method according to claim 1, wherein: In response to determining that the configuration task corresponding to the target cluster component meets a preset trigger condition, acquiring monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task includes: In response to determining that the current time satisfies a preset period trigger condition included in the preset trigger condition, monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task are acquired.

6. The method according to claim 1, wherein: The sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster includes: The cluster configuration recommendation result is stored in a target database.

7. The method according to claim 1, wherein: The cluster configuration information includes configuration modification priority information, and The sending the cluster configuration recommendation result to each cluster node corresponding to the target cluster includes: The configuration modification priority information and the cluster configuration recommendation result are sent to each cluster node.

8. A cluster configuration device, comprising: an acquisition unit, configured to acquire monitoring information corresponding to the target cluster component and cluster configuration information corresponding to the configuration task in response to determining that the configuration task corresponding to the target cluster component satisfies a preset trigger condition, wherein the target cluster component is a cluster component corresponding to the configuration task, and the cluster component is a big data component; An extraction unit is configured to extract a configuration recommendation operator from the cluster configuration information, wherein the configuration recommendation operator is an operator configured by a user by adding indicators and operators to generate a cluster configuration recommendation result; A generating unit is configured to generate a cluster configuration recommendation result based on the monitoring information and the configuration recommendation operator, wherein the generating of the cluster configuration recommendation result includes: extracting each information corresponding to each indicator in the configuration recommendation operator from the monitoring information as each indicator value information; inputting each indicator value information into the configuration recommendation operator respectively to obtain the cluster configuration recommendation result; A sending unit is configured to send the cluster configuration recommendation result to each cluster node corresponding to the target cluster in response to the cluster configuration recommendation result and the configuration result of the target cluster corresponding to the cluster configuration recommendation result satisfying a preset abnormal condition, wherein the target cluster component is deployed in the target cluster, and the preset abnormal condition is that the cluster configuration recommendation result is different from the configuration result.

9. An electronic device, comprising: one or more processors; a storage device having one or more programs stored thereon, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

10. A computer readable medium having a computer program stored thereon, wherein: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images