Processing method and device for routing inspection of cluster resources

Abstract

The embodiment of the invention relates to a processing method and device for routing inspection of cluster resources. The method comprises the following steps: customizing full-platform routing inspection configuration; the routing inspection shielding configuration is updated based on the real-time working condition feedback of any computing platform; multiple versions of test programs are customized for each cluster, and a feedback data file set which can be output by each version of test program in a normal execution state is used as a corresponding program feedback file set; regularly confirming the to-be-inspected cluster subjected to current inspection according to the full-platform inspection configuration and the inspection shielding configuration; testing programs required by all the to-be-detected clusters and corresponding program feedback file sets are collected; performing a round of inspection on all the clusters to be inspected at the time based on the inspection configuration and the test material set; and carrying out identification and early warning on abnormal events of each cluster according to the inspection report. According to the invention, the monitoring and guarantee of the cluster resources can be improved.

Description

Technical Field

[0001] The present invention relates to the technical field of data processing, and in particular to a processing method and device for inspecting cluster resources. Background Art

[0002] A large amount of scientific computing is required in scientific research fields such as new energy materials and biochemistry, and the industry-customized scientific computing platform is a professional computing platform provided for scientific research / teaching workers in various fields. In addition to self-built clusters, the computing resources of this type of scientific computing platform are often connected to the cluster resources of multiple external cloud / supercomputing platforms. In order to ensure the availability and stability of all computing resources of the scientific computing platform, it is necessary to conduct regular inspections of cluster resources, which is also the technical problem that the present invention needs to solve. Summary of the invention

[0003] The purpose of the present invention is to provide a processing method, device, electronic device and computer-readable storage medium for patrol inspection of cluster resources in view of the defects of the prior art. The present invention customizes a default configuration for the regular patrol inspection of all computing platforms as the corresponding full-platform patrol inspection configuration; and dynamically updates a patrol shielding configuration for cluster shielding based on the real-time working condition feedback of any computing platform; and customizes multiple versions of test programs for each computing node cluster, and uses the feedback data file set that each version of the test program will output under normal execution as the corresponding program feedback file set; and regularly confirms the cluster to be inspected according to the full-platform patrol inspection configuration and the patrol shielding configuration to obtain the corresponding first patrol configuration, and based on the first patrol inspection configuration, collects the test programs and corresponding program feedback file sets required for all the clusters to be inspected at that time to obtain the corresponding first test material set, and performs a round of patrol inspection on all the clusters to be inspected at that time based on the first patrol inspection configuration and the first test material set to obtain the corresponding first patrol report, and identifies and warns the abnormal events of each cluster according to the first patrol report. The present invention can perform regular inspections on all cluster resources of all computing platforms, can shield clusters that are in maintenance or abnormal status during each inspection, and can issue real-time warnings for abnormal events at the end of each inspection; the present invention can improve the efficiency of identifying and resolving abnormal events, and can improve the monitoring and protection of the health status of cluster resources.

[0004] To achieve the above object, a first aspect of an embodiment of the present invention provides a method for inspecting cluster resources, the method comprising:

[0005] A default configuration is customized for the regular inspection of all computing platforms as the corresponding full-platform inspection configuration; and an inspection shielding configuration for cluster shielding is dynamically updated based on the real-time working condition feedback of any computing platform; and multiple versions of test programs are customized for each computing node cluster, and the feedback data file set that will be output by each version of the test program under normal execution is used as the corresponding program feedback file set; the program feedback file set includes one or more feedback data files;

[0006] Based on the preset first inspection frequency, the clusters to be inspected at the current inspection are regularly confirmed according to the full-platform inspection configuration and the inspection shielding configuration to obtain the corresponding first inspection configuration; and based on the first inspection configuration, the test programs required for all clusters to be inspected at the current inspection and the corresponding program feedback file sets are collected to obtain the corresponding first test material set; and based on the first inspection configuration and the first test material set, a round of inspection is performed on all clusters to be inspected at the current inspection to obtain the corresponding first inspection report; and according to the first inspection report, abnormal events of each cluster are identified and early warning is processed.

[0007] Preferably, the full-platform inspection configuration includes one or more first cluster inspection configurations; each of the first cluster inspection configurations corresponds to a computing node cluster deployed on a computing platform in an area; the first cluster inspection configuration includes a first platform name, a first area name, a first cluster name, first basic information, a first management node configuration and a first test version; the first platform name is the name of the computing platform to which the current computing node cluster belongs; the first area name is the name of the deployment area of ​​the current computing node cluster; the first cluster name is the cluster name of the current computing node cluster; the first basic information is the basic information of the current computing node cluster; the first management node configuration corresponds to the management node of the current computing node cluster; the first management node configuration includes a first node connection interface and a first node login information; the first node login information includes a login user name and a user login password; the first test version is the test program version corresponding to the current computing node cluster;

[0008] When the inspection shielding configuration is not empty, it includes one or more first shielding configurations; each of the first shielding configurations corresponds to a computing node cluster that needs to be shielded; the first shielding configuration includes a second platform name, a second area name, and a second cluster name;

[0009] The first inspection configuration is composed of one or more of the first cluster inspection configurations; the total number of the first cluster inspection configurations in the first inspection configuration is less than or equal to the total number of the first cluster inspection configurations in the full-platform inspection configuration;

[0010] The first test material set includes a plurality of first cluster materials; each of the first cluster materials corresponds to a computing node cluster; the first cluster materials include a third platform name, a third region name, a third cluster name, a first test program and a first feedback data file set;

[0011] The first inspection report includes multiple first cluster reports; each of the first cluster reports corresponds to a computing node cluster; the first cluster report includes a fourth platform name, a fourth area name, a fourth cluster name and a first test report; the first test report is composed of one or more first test records; the first test record includes a first test step, a first step execution time and a first step execution status; the first test step includes cluster connection, test program loading, running the test program, terminating the test program, program feedback data check, cluster log check and cluster resource release; the first execution status includes success, cluster connection abnormality, program loading abnormality, running program abnormality, cluster resource scheduling abnormality, program termination abnormality, program feedback abnormality, cluster log abnormality and cluster resource release abnormality.

[0012] Preferably, the dynamically updating of a patrol shielding configuration for cluster shielding based on real-time working condition feedback of any computing platform specifically includes:

[0013] Step 31, receiving the real-time working condition feedback of any computing platform and recording it as the corresponding first platform feedback; and recording the platform name of the current computing platform as the corresponding current platform name;

[0014] Wherein, the first platform feedback includes a plurality of first operating condition records; the first operating condition record includes a first feedback area name, a first feedback cluster name and a first operating condition state; the first operating condition state includes a normal state, a maintenance state and an abnormal state;

[0015] Step 32, perform a round of traversal of all the first operating condition records fed back by the first platform; and in this round of traversal, take the first operating condition record currently traversed as the corresponding current operating condition record; and take the first feedback area name, the first feedback cluster name and the first operating condition state corresponding to the current operating condition record as the corresponding current area name, the current cluster name and the current operating condition state; and take the first shielding configuration in which the second platform name, the second area name and the second cluster name in the inspection shielding configuration respectively match the corresponding current platform name, the current area name and the current cluster name as the corresponding current shielding configuration; and identify the current shielding configuration and the current operating condition state; if the current shielding configuration is not empty and the current operating condition state is normal, delete the current shielding configuration from the inspection shielding configuration; if the current shielding configuration is empty and the current operating condition state is a maintenance state or an abnormal state, add a new first shielding configuration in the inspection shielding configuration as the corresponding current newly added shielding configuration, and set the second platform name, the second area name and the second cluster name of the current newly added shielding configuration to the corresponding current platform name, the current area name and the current cluster name.

[0016] Preferably, the step of confirming the cluster to be inspected for the current inspection according to the full-platform inspection configuration and the inspection shielding configuration to obtain the corresponding first inspection configuration specifically includes:

[0017] A round of traversal is performed on all the first cluster inspection configurations of the full platform inspection configuration; and during this round of traversal, the first cluster inspection configuration currently traversed is used as the corresponding current cluster inspection configuration; and the first platform name, the first area name and the first cluster name of the current cluster inspection configuration are used as the corresponding current platform name, current area name and current cluster name; and the first shielding configuration in which the second platform name, the second area name and the second cluster name in the inspection shielding configuration respectively match the corresponding current platform name, the current area name and the current cluster name is used as the corresponding current shielding configuration; and it is identified whether the current shielding configuration is empty, and if so, the current cluster inspection configuration is marked as an optional configuration; and at the end of this round of traversal, all the optional configurations obtained in this round of traversal constitute the corresponding first inspection configuration.

[0018] Preferably, the collecting of the test programs and the corresponding program feedback file sets required by all the clusters to be inspected at the time based on the first inspection configuration to obtain the corresponding first test material set specifically includes:

[0019] A round of traversal is performed on all the first cluster inspection configurations of the first inspection configuration; and during this round of traversal, the first cluster inspection configuration currently traversed is used as the corresponding current cluster inspection configuration; and the computing node cluster corresponding to the current cluster inspection configuration is used as the corresponding current cluster; and the first platform name, the first area name, the first cluster name and the first test version of the current cluster inspection configuration are used as the corresponding current platform name, current area name, current cluster name and current test version; and from all versions of the test programs of the current cluster, the test program corresponding to the current test version is selected as the corresponding current test program; and the program feedback file set corresponding to the current test program is used as the corresponding current program feedback file set; and the current platform name, the current area name, the current cluster name, the current test program and the current program feedback file set are used as the corresponding third platform name, the third area name, the third cluster name, the first test program and the first feedback data file set to form a corresponding first cluster material; and at the end of this round of traversal, all the first cluster materials obtained in this round of traversal form the corresponding first test material set.

[0020] Preferably, performing a round of inspection on all the clusters to be inspected at the time based on the first inspection configuration and the first test material set to obtain a corresponding first inspection report specifically includes:

[0021] Step 61: when the first inspection configuration is not empty, the total number of the first cluster inspection configurations of the first inspection configuration is counted to obtain the corresponding total number of clusters N; and a first counter is initialized to N;

[0022] Wherein, the total number of clusters N is a positive integer;

[0023] Step 62, assigning a test task as the corresponding first test task to each of the first cluster inspection configurations of the first inspection configuration; and synchronously executing the N first test tasks according to the concurrent mechanism; and in the synchronous execution process, each of the first test tasks performs a round of testing on the designated computing node cluster according to the corresponding first cluster inspection configuration and the first cluster material to obtain the corresponding first cluster report; and in the synchronous execution process, the first counter is decremented by 1 once each time a first test task is completed;

[0024] Step 63: When the count value of the first counter is 0, it is confirmed that the current round of inspection is completed and the obtained N first cluster reports form the corresponding first inspection report.

[0025] Further, each of the first test tasks performs a round of testing on a designated computing node cluster according to the corresponding first cluster inspection configuration and the first cluster material to obtain the corresponding first cluster report, specifically including:

[0026] Step 71, the first test task uses the corresponding first cluster inspection configuration and the first cluster material as the corresponding current cluster inspection configuration and current cluster material; and uses the computing node cluster corresponding to the current cluster inspection configuration as the corresponding current cluster; and uses the management node of the current cluster as the corresponding current management node; and uses the first platform name, the first area name, the first cluster name and the first management node configuration of the current cluster inspection configuration as the corresponding current platform name, current area name, current cluster name and current management node configuration; and uses the first node connection interface and the first node login information of the current management node configuration as the corresponding current node connection interface and current node login information; and uses the first test program and the first feedback data file set of the current cluster material as the corresponding current test program and current feedback data file set;

[0027] Step 72, initialize the count value of the second counter to 0; and use the current node login information to connect and log in to the current management node of the current cluster through the current node connection interface to obtain the corresponding first connection login status; and identify the status of the first connection login status; if the first connection login status is successful, set a corresponding first test step to cluster connection, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to success, and form a corresponding first test record with the obtained first test step, the first step execution time and the first step execution status, and go to step 73; if the first connection login status is failed, add 1 to the second counter, and the second counter after adding 1 is Whether it exceeds the preset first counter threshold value for identification; if the second counter after adding 1 exceeds the first counter threshold value, then set a corresponding first test step to cluster connection, and set a corresponding first step execution time to the current time, and set a corresponding first step execution status to cluster connection abnormality, and form a corresponding first test record by the obtained first test step, the first step execution time and the first step execution status, and go to step 79; if the second counter after adding 1 does not exceed the first counter threshold value, then after waiting for the preset first time length, reconnect with the current management node of the current cluster through the current node connection interface to obtain a new first connection login status, and identify the status of the new first connection login status again;

[0028] Wherein, the first connection login status includes success and failure;

[0029] Step 73, transmit the current test program to the current cluster through the current node connection interface for remote program loading processing to obtain the corresponding first loading state; and perform state identification on the first loading state; if the first loading state is successful, set a corresponding first test step to test program loading, set a corresponding first step execution time to the current time, and set a corresponding first step execution state to success, and form a corresponding first test record with the obtained first test step, the first step execution time and the first step execution state, and go to step 74; if the first loading state is failed, set a corresponding first step execution state to test program loading, set a corresponding first step execution time to the current time, and set a corresponding first step execution state to program loading exception, and form a corresponding first test record with the obtained first test step, the first step execution time and the first step execution state, and go to step 77;

[0030] Wherein, the first loading status includes success and failure;

[0031] Step 74, running the loaded current test program on the current cluster through the current node connection interface; and at the start time of this program running, setting a corresponding first test step to run the test program, setting a corresponding first step execution time to the current time, and setting a corresponding first step execution status to success, and forming a corresponding first test record with the obtained first test step, the first step execution time and the first step execution status;

[0032] Step 75, monitor the running process of this program through the current node connection interface; and during this monitoring process, if it is found that the program is running with an error, set a corresponding first test step to run the test program, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to run the program abnormally, and the obtained first test step, the first step execution time and the first step execution status form a corresponding first test record, and terminate the program running, terminate the monitoring process, and go to step 77; and during this monitoring process, if it is found that a resource scheduling error occurs in the current cluster, set a corresponding first test step to run the test program, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to cluster resource scheduling abnormality, and the obtained first test step, the first step execution time and the first step execution status form a corresponding first test record. Record, terminate the program running, terminate the monitoring process, and go to step 77; and in the monitoring process, if it is found that the program running has been successfully ended, set a corresponding first test step to terminate the test program, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to success, and the obtained first test step, the first step execution time and the first step execution status form a corresponding first test record, and terminate the monitoring process, and go to step 76; and in the process of terminating the program running, when it is found that the program terminates with an error, set a corresponding first test step to terminate the test program, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to terminate the program abnormally, and the obtained first test step, the first step execution time and the first step execution status form a corresponding first test record, and go to step 77;

[0033] Step 76, taking the feedback data file set generated by the current program running on the current cluster as the corresponding first test file set; obtaining the first test file set through the current node connection interface; comparing whether the obtained first file set is consistent with the content of the current feedback data file set, if so, setting a corresponding first step execution status to success, if not, setting a corresponding first step execution status to program feedback exception; setting a corresponding first test step to program feedback data check, and setting a corresponding first step execution time to the current time; and forming a corresponding first test record with the obtained first test step, the first step execution time, and the first step execution status;

[0034] Step 77, taking the system log related to the program loading process and program running process of the current test program on the current cluster as the corresponding test program log; and obtaining all the test program logs through the current node connection interface and forming a corresponding first log set from all the obtained logs; and identifying whether there is an abnormal log in the first log set, if there is, setting a corresponding first step execution status as cluster log abnormality, if not, setting a corresponding first step execution status as success; and setting a corresponding first test step as cluster log check, and setting a corresponding first step execution time as the current time; and forming a corresponding first test record from the obtained first test step, the first step execution time and the first step execution status;

[0035] Step 78, perform a program uninstallation operation on the current test program loaded on the current cluster to obtain a corresponding first operation state; and confirm whether this test generates a feedback data file set. If it is confirmed that no feedback data file set is generated, set the corresponding second operation state to success; if it is confirmed that a feedback data file set is generated, perform a process file deletion operation on the generated feedback data file set to obtain a corresponding second operation state; and identify whether both the first and second operation states are successful. If so, set a corresponding first step execution state to success; otherwise, set a corresponding first step execution state to cluster resource release exception; and set a corresponding first test step to cluster resource release, and set a corresponding first step execution time to the current time; and the obtained first test step, the first step execution time, and the first step execution state constitute a corresponding first test record;

[0036] Step 79, all the first test records obtained are used to form the corresponding first test report; and the current platform name, the current area name and the current cluster name are used as the corresponding fourth platform name, the fourth area name and the fourth cluster name; and the fourth platform name, the fourth area name, the fourth cluster name and the first test report are used to form the corresponding first cluster report; and when the first cluster report is obtained, the current first test task is terminated.

[0037] Preferably, the identifying and early warning processing of abnormal events of each cluster according to the first inspection report specifically includes:

[0038] A round of traversal is performed on all the first cluster reports of the first inspection report; and in this round of traversal, the first cluster report currently traversed is used as the corresponding current cluster report; the computing platform administrator interface corresponding to the current cluster report is used as the corresponding current warning interface; the first test report of the current cluster report is used as the corresponding current test report; the first test record in which the execution status of the first step in the current test report is a type of abnormality is used as a corresponding abnormal event record; the total number of the abnormal event records corresponding to the current test report is counted to obtain the corresponding total number of abnormal events; and when the total number of abnormal events is greater than 0, a corresponding first cluster abnormal event set composed of all the abnormal event records corresponding to the current test report is sent to the current warning interface.

[0039] A second aspect of an embodiment of the present invention provides a device for implementing the processing method for inspecting cluster resources described in the first aspect, the device comprising: an inspection preparation module and a regular inspection module;

[0040] The inspection preparation module is used to customize a default configuration for the regular inspection of all computing platforms as the corresponding full-platform inspection configuration; and dynamically update an inspection shielding configuration for cluster shielding based on the real-time working condition feedback of any computing platform; and customize multiple versions of test programs for each computing node cluster, and use the feedback data file set that each version of the test program will output under normal execution as the corresponding program feedback file set; the program feedback file set includes one or more feedback data files;

[0041] The periodic inspection module is used to regularly confirm the clusters to be inspected at the current inspection according to the full-platform inspection configuration and the inspection shielding configuration based on a preset first inspection frequency to obtain the corresponding first inspection configuration; and based on the first inspection configuration, collect the test programs required for all clusters to be inspected at the current inspection and the corresponding program feedback file set to obtain the corresponding first test material set; and based on the first inspection configuration and the first test material set, perform a round of inspection on all clusters to be inspected at the current inspection to obtain the corresponding first inspection report; and identify and warn of abnormal events in each cluster according to the first inspection report.

[0042] A third aspect of an embodiment of the present invention provides an electronic device, including: a memory, a processor, and a transceiver;

[0043] The processor is used to be coupled to the memory, read and execute instructions in the memory, so as to implement the method steps described in the first aspect above;

[0044] The transceiver is coupled to the processor, and the processor controls the transceiver to send and receive messages.

[0045] A fourth aspect of an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions. When the computer instructions are executed by a computer, the computer executes the instructions of the method described in the first aspect above.

[0046] The embodiment of the present invention provides a processing method, device, electronic device and computer-readable storage medium for inspecting cluster resources. As can be seen from the above content, the embodiment of the present invention customizes a default configuration for the regular inspection of all computing platforms as the corresponding full-platform inspection configuration; and dynamically updates an inspection shielding configuration for cluster shielding based on the real-time working condition feedback of any computing platform; and customizes multiple versions of test programs for each computing node cluster, and uses the feedback data file set that each version of the test program will output under normal execution as the corresponding program feedback file set; and regularly confirms the cluster to be inspected according to the full-platform inspection configuration and the inspection shielding configuration to obtain the corresponding first inspection configuration, and based on the first inspection configuration, collects the test programs and corresponding program feedback file sets required for all clusters to be inspected at that time to obtain the corresponding first test material set, and performs a round of inspection on all clusters to be inspected at that time based on the first inspection configuration and the first test material set to obtain the corresponding first inspection report, and identifies and warns abnormal events of each cluster according to the first inspection report. The embodiments of the present invention can perform regular inspections on all cluster resources of all computing platforms, can shield clusters that are under maintenance or in an abnormal state during each inspection, and can issue real-time warnings for abnormal events at the end of each inspection; the embodiments of the present invention improve the efficiency of identifying and resolving abnormal events, and improve the monitoring and protection of the health status of cluster resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 A schematic diagram of a processing method for inspecting cluster resources provided in Embodiment 1 of the present invention;

[0048] Figure 2 A module structure diagram of a processing device for inspecting cluster resources provided in Embodiment 2 of the present invention;

[0049] Figure 3 A schematic diagram of the structure of an electronic device provided in Embodiment 3 of the present invention. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0051] Embodiment 1 of the present invention provides a method for inspecting cluster resources. Figure 1 A schematic diagram of a processing method for inspecting cluster resources provided in the first embodiment of the present invention is shown. The method mainly includes the following steps:

[0052] Step 1: customize a default configuration for the regular inspection of all computing platforms as the corresponding full-platform inspection configuration; dynamically update an inspection shielding configuration for cluster shielding based on the real-time working condition feedback of any computing platform; customize multiple versions of test programs for each computing node cluster, and use the feedback data file set that each version of the test program will output under normal execution as the corresponding program feedback file set;

[0053] Specifically, it includes: step 11, customizing a default configuration for the periodic inspection of all computing platforms as the corresponding full-platform inspection configuration;

[0054] Here, the full-platform inspection configuration of the embodiment of the present invention includes one or more first cluster inspection configurations; each first cluster inspection configuration corresponds to a computing node cluster deployed on a computing platform in an area; wherein the first cluster inspection configuration includes a first platform name, a first area name, a first cluster name, a first basic information, a first management node configuration and a first test version; the first platform name is the name of the computing platform to which the current computing node cluster belongs; the first area name is the name of the deployment area of ​​the current computing node cluster; the first cluster name is the cluster name of the current computing node cluster; the first basic information is the basic information of the current computing node cluster, which can be customized based on application requirements, and conventional basic information such as software resource information, hardware resource information, computing power distribution information, etc.; the first management node configuration corresponds to the management node of the current computing node cluster; the first management node configuration includes a first node connection interface and a first node login information; the first node login information includes a login user name and a user login password; the first test version is the test program version corresponding to the current computing node cluster;

[0055] Step 12, dynamically updating a patrol shielding configuration for cluster shielding based on real-time operating condition feedback of any computing platform;

[0056] Wherein, when the inspection shielding configuration is not empty, it includes one or more first shielding configurations; each first shielding configuration corresponds to a computing node cluster that needs to be shielded; the first shielding configuration includes a second platform name, a second area name, and a second cluster name;

[0057] Specifically, it includes: step 121, receiving the real-time working condition feedback of any computing platform as the corresponding first platform feedback; and recording the platform name of the current computing platform as the corresponding current platform name;

[0058] The first platform feedback includes a plurality of first working condition records; the first working condition record includes a first feedback area name, a first feedback cluster name and a first working condition state; the first working condition state includes a normal state, a maintenance state and an abnormal state;

[0059] Step 122, perform a round of traversal of all first operating condition records fed back by the first platform; and in this round of traversal, use the currently traversed first operating condition record as the corresponding current operating condition record; and use the first feedback area name, the first feedback cluster name and the first operating condition state corresponding to the current operating condition record as the corresponding current area name, the current cluster name and the current operating condition state; and use the first shielding configuration in which the second platform name, the second area name and the second cluster name in the inspection shielding configuration respectively match the corresponding current platform name, the current area name and the current cluster name as the corresponding current shielding configuration; and identify the current shielding configuration and the current operating condition state; if the current shielding configuration is not empty and the current operating condition state is normal, delete the current shielding configuration from the inspection shielding configuration; if the current shielding configuration is empty and the current operating condition state is a maintenance state or an abnormal state, add a first shielding configuration in the inspection shielding configuration as the corresponding current newly added shielding configuration, and set the second platform name, the second area name and the second cluster name of the current newly added shielding configuration to the corresponding current platform name, the current area name and the current cluster name;

[0060] Step 13, multiple versions of test programs are customized for each computing node cluster, and feedback data file sets that will be output by each version of the test program in a normal execution state are used as corresponding program feedback file sets;

[0061] Here, the program feedback file set of the embodiment of the present invention includes one or more feedback data files.

[0062] Step 2: Based on the preset first inspection frequency, regularly confirm the clusters to be inspected for the inspection according to the full platform inspection configuration and the inspection shielding configuration to obtain the corresponding first inspection configuration; and based on the first inspection configuration, collect the test programs required for all the clusters to be inspected for the inspection and the corresponding program feedback file set to obtain the corresponding first test material set; and based on the first inspection configuration and the first test material set, perform a round of inspection on all the clusters to be inspected for the inspection to obtain the corresponding first inspection report; and identify and warn the abnormal events of each cluster according to the first inspection report;

[0063] Specifically, it includes: step 21, based on the preset first inspection frequency, regularly confirming the cluster to be inspected according to the full platform inspection configuration and the inspection shielding configuration to obtain the corresponding first inspection configuration;

[0064] Here, the first inspection frequency is a preset time frequency parameter; the first inspection configuration is composed of one or more first cluster inspection configurations; the total number of first cluster inspection configurations in the first inspection configuration is less than or equal to the total number of first cluster inspection configurations in the full platform inspection configuration;

[0065] Specifically, it includes: performing a round of traversal of all first cluster inspection configurations of the full platform inspection configuration; and in this round of traversal, taking the currently traversed first cluster inspection configuration as the corresponding current cluster inspection configuration; and taking the first platform name, the first region name and the first cluster name of the current cluster inspection configuration as the corresponding current platform name, the current region name and the current cluster name; and taking the first shielding configuration that matches the second platform name, the second region name and the second cluster name in the inspection shielding configuration with the corresponding current platform name, the current region name and the current cluster name respectively as the corresponding current shielding configuration; and identifying whether the current shielding configuration is empty, and if so, marking the current cluster inspection configuration as an optional configuration; and at the end of this round of traversal, all optional configurations obtained in this round of traversal form the corresponding first inspection configuration;

[0066] Step 22, based on the first inspection configuration, the test programs and corresponding program feedback file sets required by all the clusters to be inspected at the time are collected to obtain a corresponding first test material set;

[0067] The first test material set includes a plurality of first cluster materials; each first cluster material corresponds to a computing node cluster; the first cluster materials include a third platform name, a third region name, a third cluster name, a first test program and a first feedback data file set;

[0068] Specifically, it includes: performing a round of traversal of all first cluster inspection configurations of the first inspection configuration; and in this round of traversal, taking the currently traversed first cluster inspection configuration as the corresponding current cluster inspection configuration; and taking the computing node cluster corresponding to the current cluster inspection configuration as the corresponding current cluster; and taking the first platform name, first region name, first cluster name and first test version of the current cluster inspection configuration as the corresponding current platform name, current region name, current cluster name and current test version; and selecting the test program corresponding to the current test version from all versions of the test program of the current cluster as the corresponding current test program; and taking the program feedback file set corresponding to the current test program as the corresponding current program feedback file set; and taking the current platform name, current region name, current cluster name, current test program and current program feedback file set as the corresponding third platform name, third region name, third cluster name, first test program and first feedback data file set to form a corresponding first cluster material; and at the end of this round of traversal, all the first cluster materials obtained in this round of traversal form a corresponding first test material set;

[0069] Step 23, based on the first inspection configuration and the first test material set, a round of inspection is performed on all the clusters to be inspected at that time to obtain a corresponding first inspection report;

[0070] Among them, the first inspection report includes multiple first cluster reports; each first cluster report corresponds to a computing node cluster; the first cluster report includes a fourth platform name, a fourth area name, a fourth cluster name and a first test report; the first test report is composed of one or more first test records; the first test record includes a first test step, a first step execution time and a first step execution status; the first test step includes cluster connection, test program loading, running the test program, terminating the test program, program feedback data check, cluster log check and cluster resource release; the first execution status includes success, cluster connection abnormality, program loading abnormality, running program abnormality, cluster resource scheduling abnormality, program termination abnormality, program feedback abnormality, cluster log abnormality and cluster resource release abnormality;

[0071] Specifically, it includes: step 231, when the first inspection configuration is not empty, counting the total number of first cluster inspection configurations of the first inspection configuration to obtain the corresponding total number of clusters N; and initializing the first counter to N;

[0072] Among them, the total number of clusters N is a positive integer;

[0073] Step 232, assign a test task as the corresponding first test task to each first cluster inspection configuration of the first inspection configuration; and synchronously execute the N first test tasks according to the concurrency mechanism; and in the synchronous execution process, each first test task performs a round of testing on the designated computing node cluster according to the corresponding first cluster inspection configuration and the first cluster material to obtain the corresponding first cluster report; and in the synchronous execution process, the first counter is decremented by 1 once each time a first test task is completed;

[0074] Here, in the current step 232, each first test task performs a round of testing on the designated computing node cluster according to the corresponding first cluster inspection configuration and the first cluster material to obtain the corresponding first cluster report. The specific implementation process consists of the following steps A1-A9:

[0075] Step A1, the first test task uses the corresponding first cluster inspection configuration and the first cluster material as the corresponding current cluster inspection configuration and the current cluster material; and uses the computing node cluster corresponding to the current cluster inspection configuration as the corresponding current cluster; and uses the management node of the current cluster as the corresponding current management node; and uses the first platform name, the first area name, the first cluster name and the first management node configuration of the current cluster inspection configuration as the corresponding current platform name, the current area name, the current cluster name and the current management node configuration; and uses the first node connection interface and the first node login information of the current management node configuration as the corresponding current node connection interface and the current node login information; and uses the first test program and the first feedback data file set of the current cluster material as the corresponding current test program and the current feedback data file set;

[0076] Step A2, initialize the count value of the second counter to 0; and use the current node login information to connect and log in with the current management node of the current cluster through the current node connection interface to obtain the corresponding first connection login state; and identify the state of the first connection login state; if the first connection login state is successful, set a corresponding first test step to cluster connection, set a corresponding first step execution time to the current time, and set a corresponding first step execution state to success, and form a corresponding first test record by the obtained first test step, first step execution time and first step execution state, and go to step A3; if the first connection login state is failed, add 1 to the second counter, and the second counter after adding 1 is Whether it exceeds the preset first counter threshold value for identification; if the second counter after adding 1 exceeds the first counter threshold value, then set a corresponding first test step as cluster connection, and set a corresponding first step execution time as the current time, and set a corresponding first step execution status as cluster connection abnormality, and form a corresponding first test record by the obtained first test step, first step execution time and first step execution status, and go to step A9; if the second counter after adding 1 does not exceed the first counter threshold value, then after waiting for the preset first time length, reconnect with the current management node of the current cluster through the current node connection interface to obtain a new first connection login status, and re-identify the status of the new first connection login status;

[0077] The first counter threshold is a preset threshold parameter, such as 3; the first duration is a preset time length; the first connection login state includes success and failure;

[0078] Step A3, transmit the current test program to the current cluster through the current node connection interface for remote program loading processing to obtain the corresponding first loading state; and identify the state of the first loading state; if the first loading state is successful, set a corresponding first test step to test program loading, set a corresponding first step execution time to the current time, and set a corresponding first step execution state to success, and form a corresponding first test record with the obtained first test step, first step execution time and first step execution state, and go to step A4; if the first loading state is failed, set a corresponding first step execution state to test program loading, set a corresponding first step execution time to the current time, and set a corresponding first step execution state to program loading exception, and form a corresponding first test record with the obtained first test step, first step execution time and first step execution state, and go to step A7;

[0079] Wherein, the first loading status includes success and failure;

[0080] Step A4, running the loaded current test program on the current cluster through the current node connection interface; and at the start time of this program running, setting a corresponding first test step to run the test program, setting a corresponding first step execution time to the current time, and setting a corresponding first step execution status to success, and forming a corresponding first test record with the obtained first test step, first step execution time and first step execution status;

[0081] Step A5, monitor the running process of this program through the current node connection interface; and during this monitoring process, if it is found that the program is running with an error, set a corresponding first test step to run the test program, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to run the program abnormally, and the obtained first test step, the first step execution time and the first step execution status form a corresponding first test record, and terminate the program running, terminate the monitoring process, and go to step A7; and during this monitoring process, if it is found that a resource scheduling error occurs in the current cluster, set a corresponding first test step to run the test program, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to cluster resource scheduling abnormality, and the obtained first test step, the first step execution time and the first step execution status form a corresponding first test record. , and terminate the current program running, terminate the current monitoring process, and go to step A7; and in the current monitoring process, if it is found that the current program running has been successfully ended, set a corresponding first test step to terminate the test program, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to success, and form a corresponding first test record with the obtained first test step, first step execution time and first step execution status, and terminate the current monitoring process, and go to step A6; and in the process of terminating the current program running, if it is found that the program terminates with an error, set a corresponding first test step to terminate the test program, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to terminate the program abnormally, and form a corresponding first test record with the obtained first test step, first step execution time and first step execution status, and go to step A7;

[0082] Step A6, taking the feedback data file set generated by the current program running on the current cluster as the corresponding first test file set; and obtaining the first test file set through the current node connection interface; and comparing whether the obtained first file set is consistent with the current feedback data file set, if so, setting a corresponding first step execution status to success, and if not, setting a corresponding first step execution status to program feedback exception; and setting a corresponding first test step to program feedback data check, and setting a corresponding first step execution time to the current time; and forming a corresponding first test record by the obtained first test step, the first step execution time, and the first step execution status;

[0083] Step A7, taking the system log related to the program loading process and program running process of the current test program on the current cluster as the corresponding test program log; and obtaining all the test program logs through the current node connection interface and forming a corresponding first log set from all the obtained logs; and identifying whether there is an abnormal log in the first log set, if there is, setting a corresponding first step execution status to cluster log abnormality, if not, setting a corresponding first step execution status to success; and setting a corresponding first test step to cluster log check, and setting a corresponding first step execution time to the current time; and forming a corresponding first test record from the obtained first test step, the first step execution time, and the first step execution status;

[0084] Step A8, perform a program uninstallation operation on the current test program loaded on the current cluster to obtain a corresponding first operation state; and confirm whether this test generates a feedback data file set. If it is confirmed that no feedback data file set is generated, set the corresponding second operation state to success; if it is confirmed that a feedback data file set is generated, perform a process file deletion operation on the generated feedback data file set to obtain a corresponding second operation state; and identify whether both the first and second operation states are successful. If so, set a corresponding first step execution state to success; otherwise, set a corresponding first step execution state to cluster resource release exception; and set a corresponding first test step to cluster resource release, and set a corresponding first step execution time to the current time; and form a corresponding first test record by the obtained first test step, the first step execution time, and the first step execution state;

[0085] Step A9, forming a corresponding first test report from all the first test records obtained; and using the current platform name, current region name and current cluster name as the corresponding fourth platform name, fourth region name and fourth cluster name; and forming a corresponding first cluster report from the fourth platform name, fourth region name, fourth cluster name and the first test report; and when the first cluster report is obtained, performing task end processing on the current first test task;

[0086] Step 233, when the count value of the first counter is 0, confirm that the current round of inspection is completed and form a corresponding first inspection report with the obtained N first cluster reports;

[0087] Step 24, identifying and early warning the abnormal events of each cluster according to the first inspection report;

[0088] Specifically, it includes: performing a round of traversal of all first cluster reports of the first inspection report; and in this round of traversal, taking the currently traversed first cluster report as the corresponding current cluster report; and taking the computing platform administrator interface corresponding to the current cluster report as the corresponding current warning interface; and taking the first test report of the current cluster report as the corresponding current test report; and taking the first test record with a first-class abnormal execution status in the current test report as a corresponding abnormal event record; and counting the total number of abnormal event records corresponding to the current test report to obtain the corresponding total number of abnormal events; and when the total number of abnormal events is greater than 0, all abnormal event records corresponding to the current test report form a corresponding first cluster abnormal event set and send it to the current warning interface.

[0089] Here, the type of exception mentioned in the current step 24 at least includes: cluster connection exception, program loading exception, program running exception, cluster resource scheduling exception, program termination exception, program feedback exception, cluster log exception and cluster resource release exception.

[0090] Figure 2 The module structure diagram of a processing device for inspecting cluster resources provided in the second embodiment of the present invention is a terminal device or server that implements the aforementioned method embodiment, and can also be a device that enables the aforementioned terminal device or server to implement the aforementioned method embodiment. For example, the device can be a device or chip system of the aforementioned terminal device or server. Figure 2 As shown, the device includes: an inspection preparation module 201 and a regular inspection module 202.

[0091] The inspection preparation module 201 is used to customize a default configuration for the regular inspection of all computing platforms as the corresponding full-platform inspection configuration; and dynamically update an inspection shielding configuration for cluster shielding based on the real-time working condition feedback of any computing platform; and customize multiple versions of test programs for each computing node cluster, and use the feedback data file set that each version of the test program will output under normal execution as the corresponding program feedback file set; the program feedback file set includes one or more feedback data files.

[0092] The periodic inspection module 202 is used to regularly confirm the clusters to be inspected at the current inspection according to the full-platform inspection configuration and the inspection shielding configuration based on the preset first inspection frequency to obtain the corresponding first inspection configuration; and based on the first inspection configuration, collect the test programs required for all the clusters to be inspected at the current inspection and the corresponding program feedback file sets to obtain the corresponding first test material set; and based on the first inspection configuration and the first test material set, perform a round of inspection on all the clusters to be inspected at the current inspection to obtain the corresponding first inspection report; and identify and warn of abnormal events in each cluster according to the first inspection report.

[0093] An embodiment of the present invention provides a processing device for inspecting cluster resources, which can execute the method steps in the above method embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0094] It should be noted that it should be understood that the division of the various modules of the above device is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. And these modules can all be implemented in the form of software called by processing elements; they can also be all implemented in the form of hardware; some modules can also be implemented in the form of software called by processing elements, and some modules can be implemented in the form of hardware. For example, the inspection preparation module can be a separately established processing element, or it can be integrated in a chip of the above device. In addition, it can also be stored in the memory of the above device in the form of program code, and called and executed by a processing element of the above device. The function of the above-determined module. The implementation of other modules is similar. In addition, all or part of these modules can be integrated together, or they can be implemented independently. The processing element described here can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each module above can be completed by an integrated logic circuit of hardware in the processor element or instructions in the form of software.

[0095] For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as one or more application specific integrated circuits (ASIC), or one or more digital signal processors (DSP), or one or more field programmable gate arrays (FPGA). For another example, when a module above is implemented in the form of a processing element scheduling program code, the processing element may be a general-purpose processor, such as a central processing unit (CPU) or other processor that can call program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).

[0096] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the above method embodiments are generated. The above computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The above-mentioned computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the above-mentioned computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, Bluetooth, microwave, etc.) methods. The above-mentioned computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media integrated. The above-mentioned available medium can be a magnetic medium (such as a floppy disk, a hard disk, a tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (SSD)), etc.

[0097] Figure 3 This is a schematic diagram of the structure of an electronic device provided in Embodiment 3 of the present invention. The electronic device may be a terminal device or a server for implementing the method of the aforementioned embodiment, or may be a terminal device or a server for implementing the method of the aforementioned embodiment connected to the aforementioned terminal device or server. Figure 3As shown, the electronic device may include: a processor 301 (such as a CPU), a memory 302, and a transceiver 303; the transceiver 303 is coupled to the processor 301, and the processor 301 controls the transceiver 303. Various instructions may be stored in the memory 302 to complete various processing functions and implement the processing steps described in the aforementioned embodiment method. Preferably, the electronic device involved in the embodiment of the present invention also includes: a power supply 304, a system bus 305 and a communication port 306. The system bus 305 is used to realize the communication connection between components. The above-mentioned communication port 306 is used for connecting and communicating between the electronic device and other peripherals.

[0098] exist Figure 3 The system bus 305 mentioned in the figure can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The system bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus. The communication interface is used to realize the communication between the database access device and other devices (such as clients, read-write libraries, and read-only libraries). The memory may include random access memory (RAM), and may also include non-volatile memory (Non-Volatile Memory), such as at least one disk storage.

[0099] The above-mentioned processor can be a general-purpose processor, including a central processing unit CPU, a network processor (Network Processor, NP), a graphics processing unit (Graphics Processing Unit, GPU), etc.; it can also be a digital signal processor DSP, an application-specific integrated circuit ASIC, a field programmable gate array FPGA or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0100] It should be noted that an embodiment of the present invention further provides a computer-readable storage medium, in which instructions are stored. When the computer-readable storage medium is run on a computer, the computer executes the method and processing process provided in the above embodiments.

[0101] The embodiment of the present invention provides a processing method, device, electronic device and computer-readable storage medium for inspecting cluster resources. As can be seen from the above content, the embodiment of the present invention customizes a default configuration for the regular inspection of all computing platforms as the corresponding full-platform inspection configuration; and dynamically updates an inspection shielding configuration for cluster shielding based on the real-time working condition feedback of any computing platform; and customizes multiple versions of test programs for each computing node cluster, and uses the feedback data file set that each version of the test program will output under normal execution as the corresponding program feedback file set; and regularly confirms the cluster to be inspected according to the full-platform inspection configuration and the inspection shielding configuration to obtain the corresponding first inspection configuration, and based on the first inspection configuration, collects the test programs and corresponding program feedback file sets required for all clusters to be inspected at that time to obtain the corresponding first test material set, and performs a round of inspection on all clusters to be inspected at that time based on the first inspection configuration and the first test material set to obtain the corresponding first inspection report, and identifies and warns abnormal events of each cluster according to the first inspection report. The embodiments of the present invention can perform regular inspections on all cluster resources of all computing platforms, can shield clusters that are under maintenance or in an abnormal state during each inspection, and can issue real-time warnings for abnormal events at the end of each inspection; the embodiments of the present invention improve the efficiency of identifying and resolving abnormal events, and improve the monitoring and protection of the health status of cluster resources.

[0102] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0103] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A method for inspecting cluster resources, characterized in that: The method comprises: A default configuration is customized for the regular inspection of all computing platforms as the corresponding full-platform inspection configuration; and an inspection shielding configuration for cluster shielding is dynamically updated based on the real-time working condition feedback of any computing platform; and multiple versions of test programs are customized for each computing node cluster, and the feedback data file set that will be output by each version of the test program under normal execution is used as the corresponding program feedback file set; the program feedback file set includes one or more feedback data files; Based on the preset first inspection frequency, the clusters to be inspected at the current inspection are regularly confirmed according to the full-platform inspection configuration and the inspection shielding configuration to obtain the corresponding first inspection configuration; and based on the first inspection configuration, the test programs required for all clusters to be inspected at the current inspection and the corresponding program feedback file sets are collected to obtain the corresponding first test material set; and based on the first inspection configuration and the first test material set, a round of inspection is performed on all clusters to be inspected at the current inspection to obtain the corresponding first inspection report; and according to the first inspection report, abnormal events of each cluster are identified and early warning is processed.

2. The method for inspecting cluster resources according to claim 1, characterized in that: The full platform inspection configuration includes one or more first cluster inspection configurations; each of the first cluster inspection configurations corresponds to a computing node cluster deployed on a computing platform in a region; the first cluster inspection configuration includes a first platform name, a first region name, a first cluster name, first basic information, a first management node configuration and a first test version; The first platform name is the name of the computing platform to which the current computing node cluster belongs; The first region name is the deployment region name of the current computing node cluster; The first cluster name is the cluster name of the current computing node cluster; The first basic information is basic information of the current computing node cluster; The first management node configuration corresponds to the management node of the current computing node cluster; the first management node configuration includes a first node connection interface and first node login information; The first node login information includes a login user name and a user login password; the first test version is a test program version corresponding to the current computing node cluster; When the inspection shielding configuration is not empty, it includes one or more first shielding configurations; each of the first shielding configurations corresponds to a computing node cluster that needs to be shielded; the first shielding configuration includes a second platform name, a second area name, and a second cluster name; The first inspection configuration is composed of one or more of the first cluster inspection configurations; the total number of the first cluster inspection configurations in the first inspection configuration is less than or equal to the total number of the first cluster inspection configurations in the full-platform inspection configuration; The first test material set includes a plurality of first cluster materials; each of the first cluster materials corresponds to a computing node cluster; the first cluster materials include a third platform name, a third region name, a third cluster name, a first test program and a first feedback data file set; The first inspection report includes multiple first cluster reports; each of the first cluster reports corresponds to a computing node cluster; the first cluster report includes a fourth platform name, a fourth area name, a fourth cluster name and a first test report; the first test report is composed of one or more first test records; the first test record includes a first test step, a first step execution time and a first step execution status; the first test step includes cluster connection, test program loading, running the test program, terminating the test program, program feedback data check, cluster log check and cluster resource release; the first execution status includes success, cluster connection abnormality, program loading abnormality, running program abnormality, cluster resource scheduling abnormality, program termination abnormality, program feedback abnormality, cluster log abnormality and cluster resource release abnormality.

3. The method for inspecting cluster resources according to claim 2, characterized in that: The method of dynamically updating a patrol shielding configuration for cluster shielding based on real-time working condition feedback of any computing platform specifically includes: Step 31, receiving the real-time working condition feedback of any computing platform and recording it as the corresponding first platform feedback; and recording the platform name of the current computing platform as the corresponding current platform name; Wherein, the first platform feedback includes a plurality of first operating condition records; the first operating condition record includes a first feedback area name, a first feedback cluster name and a first operating condition state; the first operating condition state includes a normal state, a maintenance state and an abnormal state; Step 32, perform a round of traversal of all the first operating condition records fed back by the first platform; and in this round of traversal, take the first operating condition record currently traversed as the corresponding current operating condition record; and take the first feedback area name, the first feedback cluster name and the first operating condition state corresponding to the current operating condition record as the corresponding current area name, the current cluster name and the current operating condition state; and take the first shielding configuration in which the second platform name, the second area name and the second cluster name in the inspection shielding configuration respectively match the corresponding current platform name, the current area name and the current cluster name as the corresponding current shielding configuration; and identify the current shielding configuration and the current operating condition state; if the current shielding configuration is not empty and the current operating condition state is normal, delete the current shielding configuration from the inspection shielding configuration; if the current shielding configuration is empty and the current operating condition state is a maintenance state or an abnormal state, add a new first shielding configuration in the inspection shielding configuration as the corresponding current newly added shielding configuration, and set the second platform name, the second area name and the second cluster name of the current newly added shielding configuration to the corresponding current platform name, the current area name and the current cluster name.

4. The method for inspecting cluster resources according to claim 2, characterized in that: The step of confirming the cluster to be inspected for the current inspection according to the full-platform inspection configuration and the inspection shielding configuration to obtain the corresponding first inspection configuration specifically includes: A round of traversal is performed on all the first cluster inspection configurations of the full platform inspection configuration; and during this round of traversal, the first cluster inspection configuration currently traversed is used as the corresponding current cluster inspection configuration; and the first platform name, the first area name and the first cluster name of the current cluster inspection configuration are used as the corresponding current platform name, current area name and current cluster name; and the first shielding configuration in which the second platform name, the second area name and the second cluster name in the inspection shielding configuration respectively match the corresponding current platform name, the current area name and the current cluster name is used as the corresponding current shielding configuration; and it is identified whether the current shielding configuration is empty, and if so, the current cluster inspection configuration is marked as an optional configuration; and at the end of this round of traversal, all the optional configurations obtained in this round of traversal constitute the corresponding first inspection configuration.

5. The method for inspecting cluster resources according to claim 2, characterized in that: The collecting the test programs and the corresponding program feedback file sets required by all the clusters to be inspected at the time based on the first inspection configuration to obtain the corresponding first test material set specifically includes: A round of traversal is performed on all the first cluster inspection configurations of the first inspection configuration; and during this round of traversal, the first cluster inspection configuration currently traversed is used as the corresponding current cluster inspection configuration; and the computing node cluster corresponding to the current cluster inspection configuration is used as the corresponding current cluster; and the first platform name, the first area name, the first cluster name and the first test version of the current cluster inspection configuration are used as the corresponding current platform name, current area name, current cluster name and current test version; and from all versions of the test programs of the current cluster, the test program corresponding to the current test version is selected as the corresponding current test program; and the program feedback file set corresponding to the current test program is used as the corresponding current program feedback file set; and the current platform name, the current area name, the current cluster name, the current test program and the current program feedback file set are used as the corresponding third platform name, the third area name, the third cluster name, the first test program and the first feedback data file set to form a corresponding first cluster material; and at the end of this round of traversal, all the first cluster materials obtained in this round of traversal form the corresponding first test material set.

6. The method for inspecting cluster resources according to claim 2, characterized in that: The step of performing a round of inspection on all the clusters to be inspected based on the first inspection configuration and the first test material set to obtain a corresponding first inspection report specifically includes: Step 61: when the first inspection configuration is not empty, the total number of the first cluster inspection configurations of the first inspection configuration is counted to obtain the corresponding total number of clusters N; and a first counter is initialized to N; Wherein, the total number of clusters N is a positive integer; Step 62, assigning a test task as the corresponding first test task to each of the first cluster inspection configurations of the first inspection configuration; and synchronously executing the N first test tasks according to the concurrent mechanism; and in the synchronous execution process, each of the first test tasks performs a round of testing on the designated computing node cluster according to the corresponding first cluster inspection configuration and the first cluster material to obtain the corresponding first cluster report; and in the synchronous execution process, each time a first test task is completed, the first counter is decremented by 1; Step 63: When the count value of the first counter is 0, it is confirmed that the current round of inspection is completed and the obtained N first cluster reports form the corresponding first inspection report.

7. The method for inspecting cluster resources according to claim 6, characterized in that: The step of performing a round of testing on the designated computing node cluster according to the corresponding first cluster inspection configuration and the first cluster material by each of the first test tasks to obtain the corresponding first cluster report specifically includes: Step 71, the first test task uses the corresponding first cluster inspection configuration and the first cluster material as the corresponding current cluster inspection configuration and current cluster material; and uses the computing node cluster corresponding to the current cluster inspection configuration as the corresponding current cluster; and uses the management node of the current cluster as the corresponding current management node; and uses the first platform name, the first area name, the first cluster name and the first management node configuration of the current cluster inspection configuration as the corresponding current platform name, current area name, current cluster name and current management node configuration; and uses the first node connection interface and the first node login information of the current management node configuration as the corresponding current node connection interface and current node login information; and uses the first test program and the first feedback data file set of the current cluster material as the corresponding current test program and current feedback data file set; Step 72, initialize the count value of the second counter to 0; and use the current node login information to connect and log in to the current management node of the current cluster through the current node connection interface to obtain the corresponding first connection login status; and identify the status of the first connection login status; if the first connection login status is successful, set a corresponding first test step to cluster connection, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to success, and form a corresponding first test record with the obtained first test step, the first step execution time and the first step execution status, and go to step 73; if the first connection login status is failed, add 1 to the second counter, and the second counter after adding 1 is Whether it exceeds the preset first counter threshold value for identification; if the second counter after adding 1 exceeds the first counter threshold value, then set a corresponding first test step to cluster connection, and set a corresponding first step execution time to the current time, and set a corresponding first step execution status to cluster connection abnormality, and form a corresponding first test record by the obtained first test step, the first step execution time and the first step execution status, and go to step 79; if the second counter after adding 1 does not exceed the first counter threshold value, then after waiting for the preset first time length, reconnect with the current management node of the current cluster through the current node connection interface to obtain a new first connection login status, and identify the status of the new first connection login status again; Wherein, the first connection login status includes success and failure; Step 73, transmit the current test program to the current cluster through the current node connection interface for remote program loading processing to obtain the corresponding first loading state; and perform state identification on the first loading state; if the first loading state is successful, set a corresponding first test step to test program loading, set a corresponding first step execution time to the current time, and set a corresponding first step execution state to success, and form a corresponding first test record with the obtained first test step, the first step execution time and the first step execution state, and go to step 74; if the first loading state is failed, set a corresponding first step execution state to test program loading, set a corresponding first step execution time to the current time, and set a corresponding first step execution state to program loading exception, and form a corresponding first test record with the obtained first test step, the first step execution time and the first step execution state, and go to step 77; Wherein, the first loading status includes success and failure; Step 74, running the loaded current test program on the current cluster through the current node connection interface; and at the start time of this program running, setting a corresponding first test step to run the test program, setting a corresponding first step execution time to the current time, and setting a corresponding first step execution status to success, and forming a corresponding first test record with the obtained first test step, the first step execution time and the first step execution status; Step 75, monitor the running process of this program through the current node connection interface; and during this monitoring process, if it is found that the program is running with an error, set a corresponding first test step to run the test program, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to run the program abnormally, and the obtained first test step, the first step execution time and the first step execution status form a corresponding first test record, and terminate the program running, terminate the monitoring process, and go to step 77; and during this monitoring process, if it is found that a resource scheduling error occurs in the current cluster, set a corresponding first test step to run the test program, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to cluster resource scheduling abnormality, and the obtained first test step, the first step execution time and the first step execution status form a corresponding first test record. Record, terminate the program running, terminate the monitoring process, and go to step 77; and in the monitoring process, if it is found that the program running has been successfully ended, set a corresponding first test step to terminate the test program, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to success, and the obtained first test step, the first step execution time and the first step execution status form a corresponding first test record, and terminate the monitoring process, and go to step 76; and in the process of terminating the program running, when it is found that the program terminates with an error, set a corresponding first test step to terminate the test program, set a corresponding first step execution time to the current time, and set a corresponding first step execution status to terminate the program abnormally, and the obtained first test step, the first step execution time and the first step execution status form a corresponding first test record, and go to step 77; Step 76, taking the feedback data file set generated by the current program running on the current cluster as the corresponding first test file set; obtaining the first test file set through the current node connection interface; comparing whether the obtained first file set is consistent with the content of the current feedback data file set, if so, setting a corresponding first step execution status to success, if not, setting a corresponding first step execution status to program feedback exception; setting a corresponding first test step to program feedback data check, and setting a corresponding first step execution time to the current time; and forming a corresponding first test record with the obtained first test step, the first step execution time, and the first step execution status; Step 77, taking the system log related to the program loading process and program running process of the current test program on the current cluster as the corresponding test program log; and obtaining all the test program logs through the current node connection interface and forming a corresponding first log set from all the obtained logs; and identifying whether there is an abnormal log in the first log set, if there is, setting a corresponding first step execution status as cluster log abnormality, if not, setting a corresponding first step execution status as success; and setting a corresponding first test step as cluster log check, and setting a corresponding first step execution time as the current time; and forming a corresponding first test record from the obtained first test step, the first step execution time and the first step execution status; Step 78, perform a program uninstallation operation on the current test program loaded on the current cluster to obtain a corresponding first operation state; and confirm whether this test generates a feedback data file set. If it is confirmed that no feedback data file set is generated, set the corresponding second operation state to success; if it is confirmed that a feedback data file set is generated, perform a process file deletion operation on the generated feedback data file set to obtain a corresponding second operation state; and identify whether both the first and second operation states are successful. If so, set a corresponding first step execution state to success; otherwise, set a corresponding first step execution state to cluster resource release exception; and set a corresponding first test step to cluster resource release, and set a corresponding first step execution time to the current time; and the obtained first test step, the first step execution time, and the first step execution state constitute a corresponding first test record; Step 79, all the first test records obtained are used to form the corresponding first test report; and the current platform name, the current area name and the current cluster name are used as the corresponding fourth platform name, the fourth area name and the fourth cluster name; and the fourth platform name, the fourth area name, the fourth cluster name and the first test report are used to form the corresponding first cluster report; and when the first cluster report is obtained, the current first test task is terminated.

8. The method for inspecting cluster resources according to claim 2, characterized in that: The identifying and early warning processing of abnormal events of each cluster according to the first inspection report specifically includes: A round of traversal is performed on all the first cluster reports of the first inspection report; and in this round of traversal, the first cluster report currently traversed is used as the corresponding current cluster report; the computing platform administrator interface corresponding to the current cluster report is used as the corresponding current warning interface; the first test report of the current cluster report is used as the corresponding current test report; the first test record in which the execution status of the first step in the current test report is a type of abnormality is used as a corresponding abnormal event record; the total number of the abnormal event records corresponding to the current test report is counted to obtain the corresponding total number of abnormal events; and when the total number of abnormal events is greater than 0, a corresponding first cluster abnormal event set composed of all the abnormal event records corresponding to the current test report is sent to the current warning interface.

9. A device for executing the processing method for inspecting cluster resources according to any one of claims 1 to 8, characterized in that: The device comprises: an inspection preparation module and a regular inspection module; The inspection preparation module is used to customize a default configuration for the regular inspection of all computing platforms as the corresponding full-platform inspection configuration; and dynamically update an inspection shielding configuration for cluster shielding based on the real-time working condition feedback of any computing platform; and customize multiple versions of test programs for each computing node cluster, and use the feedback data file set that each version of the test program will output under normal execution as the corresponding program feedback file set; the program feedback file set includes one or more feedback data files; The periodic inspection module is used to regularly confirm the clusters to be inspected at the current inspection according to the full-platform inspection configuration and the inspection shielding configuration based on a preset first inspection frequency to obtain the corresponding first inspection configuration; and based on the first inspection configuration, collect the test programs required for all clusters to be inspected at the current inspection and the corresponding program feedback file set to obtain the corresponding first test material set; and based on the first inspection configuration and the first test material set, perform a round of inspection on all clusters to be inspected at the current inspection to obtain the corresponding first inspection report; and identify and warn of abnormal events in each cluster according to the first inspection report.

10. An electronic device, characterized in that: include: memory, processors, and transceivers; The processor is used to couple with the memory, read and execute instructions in the memory, so as to implement the method according to any one of claims 1 to 8; The transceiver is coupled to the processor, and the processor controls the transceiver to send and receive messages.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a computer, the computer is enabled to execute the method according to any one of claims 1 to 8.

Images