Automatic inspection method and device based on distributed system and computer equipment

Abstract

The invention relates to an automatic inspection method and device based on a distributed system and computer equipment. The method comprises the following steps: acquiring a preset inspection task; the inspection task comprises project information, index information and time information; determining a target node according to the load information of each node in the distributed system; and the target node executes the inspection task to obtain automatic inspection data. By presetting the inspection task, the manual configuration time is shortened, and the inspection efficiency and accuracy are improved. By distributing the inspection tasks to the nodes with lower loads, the stability and response speed of the whole distributed system are improved, and the inspection efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of operation and maintenance monitoring technology, and in particular to an automated inspection method, device and computer equipment based on a distributed system. Background Art

[0002] With the development of the Internet, the number of people and devices connected to the Internet has increased rapidly. More and more access devices have brought about a rapid increase in Internet access. The rapid increase in access volume has put increasing pressure on the stable operation of Internet system platform services. In order to ensure the stable operation of the system, inspection of system service status is one of the important means.

[0003] In the related art, the inspection system usually has only one server. When there are many inspection tasks, the inspection speed is slow and the inspection efficiency is low due to the limitation of the processing capacity of the server itself. Summary of the invention

[0004] Based on this, it is necessary to provide an automated inspection method, device and computer equipment based on a distributed system to address the above technical problems.

[0005] In the first aspect, the present application provides an automated inspection method based on a distributed system, the method comprising: obtaining a pre-set inspection task; the inspection task comprises: project information, indicator information and time information; determining a target node based on the load information of each node in the distributed system; the target node executes the inspection task to obtain automated inspection data.

[0006] In one of the embodiments, the method further includes: obtaining project information, indicator information and time information input by the user; the time information includes: inspection task execution time and indicator data collection time; constructing and storing the inspection task based on the project information, indicator information and time information.

[0007] In one of the embodiments, determining the target node according to the load information of each node in the distributed system includes: obtaining the CPU usage of each node in the distributed system; and taking the node with the smallest CPU usage as the target node.

[0008] In one embodiment, the target node executes the inspection task and obtains automated inspection data, including: determining multiple server information to be inspected in the asset management system based on the project information of the inspection task; constructing multiple inspection threads based on the multiple server information to be inspected and the inspection task; and executing the multiple inspection threads to obtain automated inspection data.

[0009] In one embodiment, determining multiple server information to be inspected in the asset management system based on the project information of the inspection task includes: searching for multiple first server information to be inspected in the asset management system based on the project information of the inspection task; searching for related projects in the asset management system based on the project information of the inspection task; and searching for multiple second server information to be inspected in the asset management system based on the related projects.

[0010] In one of the embodiments, constructing multiple inspection threads based on the multiple server information to be inspected and the inspection tasks includes: dividing the multiple servers to be inspected into multiple project groups based on the project information corresponding to the multiple server information to be inspected; and constructing corresponding inspection threads based on the server information to be inspected corresponding to each project group, the indicator information corresponding to the inspection task, and the indicator data collection time corresponding to the inspection task.

[0011] In one of the embodiments, the method also includes: constructing topology map report data based on the automated inspection data, with the project corresponding to the inspection task as the root node and the related projects as child nodes; constructing an inspection result report based on the automated inspection data and the topology map report data; and outputting and displaying the inspection result report.

[0012] In the second aspect, the present application provides an automated inspection device based on a distributed system, the device comprising: an acquisition module, used to obtain pre-set inspection tasks; the inspection tasks include: project information, indicator information and time information; a node determination module, used to determine the target node according to the load information of each node in the distributed system; an inspection module, used for the target node to execute the inspection task and obtain automated inspection data.

[0013] In a third aspect, the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the above-mentioned method when executing the computer program.

[0014] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the method described above when executed by a processor.

[0015] The above-mentioned automated inspection method, device and computer equipment based on distributed systems obtains pre-set inspection tasks and determines the target node according to the load information of each node in the distributed system. The inspection task is executed based on the target node to obtain automated inspection data. Among them, the inspection task includes: project information, indicator information and time information. By pre-setting the inspection task, the time of manual configuration is reduced, and the efficiency and accuracy of the inspection are improved. By allocating the inspection task to the node with lower load, the stability and response speed of the entire distributed system are improved, and the inspection efficiency is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A structural block diagram of an automated inspection system based on a distributed system in one embodiment; Figure 2 A schematic diagram of a process of an automated inspection method based on a distributed system in one embodiment; Figure 3 A schematic diagram of a process flow of an automated inspection method in one embodiment; Figure 4 It is a structural block diagram of a multi-dimensional distributed automated inspection system based on CMDB in a specific embodiment; Figure 5 It is a structural block diagram of an automated inspection device based on a distributed system in one embodiment; Figure 6 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0017] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0018] With the development of the Internet, the number of people and devices connected to the Internet has increased rapidly. More and more access devices have brought about a rapid increase in Internet access. The rapid increase in access volume has put increasing pressure on the stable operation of Internet system platform services. In order to ensure the stable operation of the system, the service status of the inspection system is one of the important means. The traditional inspection system design is relatively simple and usually faces the following problems: 1. Slow inspection speed: Traditional inspection systems often use a single server architecture, which cannot cope with the computing pressure of inspecting multiple indicators of numerous devices and cannot support dynamic expansion.

[0019] 2. Inspection indicator dimensions are fixed: In traditional inspection systems, inspection indicator dimensions are relatively fixed, and the inspection indicator dimensions can only be manually defined in advance for maintenance.

[0020] 3. The inspection report results have a single correlation: In traditional inspection systems, the inspection result report only has a single indicator result of a single server-related dimension, which cannot reflect the correlation between projects. The inspection results have poor correlation and cannot timely and effectively detect potential problems in system projects and avoid potential failures.

[0021] Based on the above, the traditional inspection system has problems such as slow inspection speed, fixed inspection indicator dimensions, and single inspection report results. Therefore, a faster, more scalable, multi-dimensional, more relevant and more reliable inspection solution is needed to address these problems.

[0022] The present application embodiment provides an automated inspection system based on a distributed system, such as Figure 1 As shown, it includes a CMDB module, an inspection task definition module, an inspection task distributed computing module, and an inspection result report module.

[0023] The CMDB module is also known as the asset management system. CMDB is used to store and manage asset information of all IT assets and their relationships. For example, CMDB records all hardware, software, network equipment, documents, and any configuration items (CI, Configuration Items) related to IT services. Including servers, storage devices, network equipment, software licenses, business applications, etc. For servers, the number of each server, the number of CPU cores of the server, the size of the disk memory, the IP room to which it belongs, the public network information, and the bandwidth information are stored. And each server is added with the product and project tags corresponding to the server. For example, a company has multiple products, each product corresponds to multiple projects, and each project corresponds to the server used. The server is added with the corresponding product and project tags. In addition, CMDB also stores the association relationship between each project.

[0024] The inspection task definition module consists of a front-end inspection task page and a back-end inspection task storage service, and provides inspection task definition, saving, and other related functions. Users enter inspection tasks, such as project information, indicator information, and time information, on the front-end inspection task page to generate inspection tasks. And store them in the back-end inspection task storage service. Among them, the project information is the project that needs to be inspected, and the indicator information includes the custom indicators when inspecting the project, such as the server's CPU usage, memory usage, disk occupancy, system request volume, number of queries per second (qps), number of transactions per second (tps), and read and write latency. The time information includes the inspection task execution time and the indicator data collection time. Among them, the inspection task execution time indicates the time when the inspection task needs to be executed. For example, if it is 8 am every day, then the inspection task needs to be executed at 8 am every day. The indicator data collection time is the time period for indicator data collection. For example, if the inspection task is executed at 8 am every day, then the indicator data collection time can be to obtain indicator data between 8 am today and 8 am the previous day. It is understandable that all information of the inspection task can be set according to actual usage requirements, and this embodiment does not make any specific limitation.

[0025] The inspection task distributed computing module is a distributed system used to complete the inspection task. When the inspection task set in the inspection task definition module reaches the inspection task execution time, the inspection task distributed computing module obtains the inspection task and distributes the inspection task to the target node for calculation to generate the inspection calculation result, that is, the automated inspection data.

[0026] The inspection result report module is used to receive the inspection calculation results submitted by the inspection task distributed computing module and automatically generate report data.

[0027] In one embodiment, Figure 2 As shown, an automated inspection method based on a distributed system is provided, the method comprising: Step 201, obtaining a preset inspection task.

[0028] The inspection task is pre-stored in the inspection task definition module, and the inspection task includes: project information, indicator information and time information. The time information includes the inspection task execution time and the indicator data collection time. When the current time reaches the inspection task execution time, the corresponding inspection task is obtained. The inspection task is used to inspect the indicator information of the server corresponding to the project information. By pre-setting the inspection task, the automation and consistency of the inspection task can be ensured, the time of manual configuration can be reduced, and the efficiency and accuracy of the inspection can be improved.

[0029] Step 202: determine the target node according to the load information of each node in the distributed system.

[0030] The distributed system consists of multiple computer nodes, each of which corresponds to a server. Each node can work independently, and multiple nodes can work together to complete the inspection task. After obtaining the inspection task, the load information of each node in the distributed system is first obtained. Among them, the load information includes the processing capacity of the node, the current workload and the resource occupancy. For example, it can be information such as the CPU usage, memory usage and disk I / O of the server corresponding to the node. After obtaining the load information of each node, the target node can be determined by the minimum load priority algorithm and the load balancing algorithm. Among them, the target node is the node used to perform the current inspection task. For example, the node with the smallest load can be found by the minimum load priority algorithm and used as the target node. The optimal node for processing the inspection task can be found by the load balancing algorithm and used as the target node. By allocating the inspection task to the node with lower load, the overload of a node can be avoided, thereby improving the stability and response speed of the entire distributed system. At the same time, the inspection efficiency is improved.

[0031] Step 203: The target node performs the inspection task and obtains automated inspection data.

[0032] After the target node is determined, the inspection task is sent to the target node. The target node executes the inspection task based on the project information, indicator information and time information of the inspection task and obtains the automated inspection data based on the CMDB asset management system. The automated inspection data is the indicator information of the server corresponding to the project information in the inspection task.

[0033] This embodiment provides an automated inspection method based on a distributed system, which obtains a pre-set inspection task and determines the target node according to the load information of each node in the distributed system. The inspection task is executed based on the target node to obtain automated inspection data. The inspection task includes: project information, indicator information and time information. By pre-setting the inspection task, the time of manual configuration is reduced, and the efficiency and accuracy of the inspection are improved. By allocating the inspection task to the node with lower load, the stability and response speed of the entire distributed system are improved, and the inspection efficiency is improved.

[0034] In one embodiment, the method further includes, in the inspection task definition module, presetting the inspection task. Specifically, the following steps are included: Step 1: Obtain the project information, indicator information, and time information input by the user.

[0035] When setting up inspection tasks in advance, users enter project information, indicator information, and time information through the interactive interface provided by the front-end inspection task page. Among them, the project information is the detailed information of the project that needs to be inspected, such as the project name, description, etc. The indicator information includes the custom indicator for the inspection of the corresponding project, which is a measure to evaluate the performance or status of the system. For example, it includes indicator data such as the server's CPU usage, memory usage, disk occupancy, system request volume, number of queries per second (qps), number of transactions per second (tps), and read and write latency. The time information includes the inspection task execution time and the indicator data collection time. Among them, the inspection task execution time indicates the time when the inspection task needs to be executed, and the indicator data collection time is the time period for indicator data collection. Through the inspection task information entered by the user, the inspection task is more customized, and the inspection can be performed according to specific needs, thereby improving the pertinence and accuracy of the inspection.

[0036] Step 2: Build and store inspection tasks based on project information, indicator information, and time information.

[0037] After obtaining the project information, indicator information, and time information, the inspection task is constructed and stored based on the above information. The inspection task definition module creates a complete inspection task based on the project information, indicator information, and time information provided by the user. The inspection task includes specific inspection steps, indicators to be detected during execution, expected execution time, etc. Then, the inspection task is stored in a database or other storage system for subsequent execution and management.

[0038] In this embodiment, by constructing the inspection task, the integrity and accuracy of the inspection task is ensured, so that the inspection task can be executed as expected. By storing the inspection task, the inspection task can be scheduled and executed in a timely manner, and the query and management of historical data are also facilitated, thereby improving the traceability and reliability of the inspection.

[0039] In one embodiment, when determining a target node according to load information of multiple nodes, the following steps are specifically included: Step 1: Get the CPU usage of each node in the distributed system.

[0040] The distributed system is composed of multiple computer nodes, each of which can be a server, a virtual machine or other computing resources. This embodiment is described with each node corresponding to a server. Each node can work independently, and multiple nodes can work together to complete the inspection task. Before executing the inspection task, it is first necessary to obtain the CPU usage of each node in the distributed system. For example, the CPU usage of each node in the distributed system is obtained through a monitoring tool. By obtaining the CPU usage of each node, it is possible to provide a data basis for the allocation of subsequent inspection tasks, thereby further improving the inspection efficiency.

[0041] Step 2: Select the node with the lowest CPU usage as the target node.

[0042] The target node is the node in the distributed system used to execute the current inspection task. After obtaining the CPU usage of all nodes, all CPU usages are compared to find the node with the lowest CPU usage and use it as the target node.

[0043] In this embodiment, the current inspection task is executed by the node with the lowest CPU usage, which can effectively utilize CPU resources, thereby improving the performance and stability of the entire distributed system and further improving the inspection efficiency.

[0044] In one embodiment, Figure 3 As shown, an automated inspection method is provided, the method comprising: Step 301, determining information of multiple servers to be inspected in the asset management system according to the project information of the inspection task.

[0045] According to the load conditions of each node, the target node is determined. After the target node is determined, the current inspection task is distributed to the target node with relatively idle load for inspection calculation. After receiving the inspection task, the target node determines the information of multiple servers to be inspected in the asset management system according to the project information of the inspection task. Among them, the asset management system stores information such as the number of each server, the number of CPU cores of the server, the size of the disk memory, the IP room to which it belongs, the public network information, and the bandwidth information. Each server also corresponds to a product and project label. At the same time, the asset management system also stores the association between each project. Based on the project information, the target node searches for servers with the same project label in the asset management system, and uses the information of the corresponding server as the server information to be inspected. Specifically, the following steps are included: Step 1: Search for information of multiple first servers to be inspected in the asset management system according to the project information of the inspection task.

[0046] Each server in the asset management system corresponds to a product and project tag. According to the project information of the inspection task, multiple server information with the same project tag is searched in the asset management system, and it is used as the first server information to be inspected. For example, you can first obtain the project corresponding to the inspection task, search for the tag of the corresponding project in the asset management system, and determine the server information of the corresponding project tag. The server information can be the server number, the number of CPU cores of the server, the size of the disk memory, the IP room to which it belongs, the public network information, and the bandwidth information.

[0047] Step 2: Search for related projects in the asset management system based on the project information of the inspection task.

[0048] The asset management system also stores the associations between various projects. The associated projects are other projects associated with the project information of the inspection task, and can be queried through the associations between various projects. For example, the associated associated projects are searched in the associations between various projects according to the project information of the inspection task.

[0049] Step 3: Search for information of multiple second servers to be inspected in the asset management system according to the associated items.

[0050] After finding the associated project, multiple server information with the same project tag is searched in the asset management system according to the associated project, and it is used as the second server information to be inspected. The search method is the same as the search method in step 1 above, that is, the search is based on the project tag, which will not be repeated here. Finally, the first server information to be inspected corresponding to the project information of the inspection task and the second server information to be inspected corresponding to the associated project are used as multiple server information to be inspected.

[0051] Through the above method, the information of all servers that need to be inspected can be fully determined, including the first servers to be inspected that are directly related to the inspection task and the second servers to be inspected that are indirectly related through the associated items. This ensures the comprehensiveness and accuracy of the inspection, and at the same time helps to reduce omissions and unnecessary repeated inspections, thereby improving resource utilization and inspection efficiency.

[0052] Step 302: construct multiple inspection threads according to information of multiple servers to be inspected and inspection tasks.

[0053] After determining the information of multiple servers to be inspected, the servers to be inspected can be grouped according to the different projects to which they belong, with one group set for each project, and for each group, a corresponding inspection thread is constructed according to the indicator information corresponding to the inspection task and the indicator data collection time. When executing the inspection thread, the indicator information corresponding to the server during the indicator data collection time is obtained. By constructing multiple inspection threads, parallel processing can be achieved, the inspection speed can be accelerated, and the efficiency can be improved. Each thread can be executed independently, thereby reducing the inspection time of the server. Among them, the thread is the smallest unit that the operating system can perform calculation scheduling, and is the actual operating unit in the process. The inspection task is realized by executing multiple inspection threads. Specifically including: Step 1: divide the multiple servers to be inspected into multiple project groups according to the project information corresponding to the information of the multiple servers to be inspected.

[0054] After determining the information of multiple servers to be inspected, the servers to be inspected are grouped according to the projects to which each server to be inspected belongs. The project label corresponding to each server to be inspected is determined, and the servers to be inspected with the same project label are grouped into the same project group according to the project label. Thus, multiple project groups corresponding to different projects are obtained.

[0055] Step 2: Based on the server information to be inspected corresponding to each project group, the indicator information corresponding to the inspection task, and the indicator data collection time corresponding to the inspection task, a corresponding inspection thread is constructed.

[0056] After the project groups are divided, based on the server information to be inspected corresponding to each project group, the corresponding inspection threads are constructed according to the indicator information corresponding to the inspection task and the indicator data collection time. For example, for each project group, a corresponding inspection thread is created according to its server information, inspection task indicators and collection time. Specific inspection tasks are configured for each inspection thread, including the server to be inspected, the indicators to be collected and the collection time of the indicator data.

[0057] By grouping the servers to be inspected and building multiple inspection threads, we can implement parallel inspections of multiple servers. This improves the efficiency of inspections and resource utilization, while maintaining the customization and pertinence of inspection tasks. Through parallel processing, a large number of inspection tasks can be completed in a shorter period of time, which is crucial to ensuring stable system operation and timely detection of potential problems.

[0058] Step 303, executing multiple inspection threads to obtain automated inspection data.

[0059] After multiple inspection threads are constructed, they are executed in parallel. Each inspection thread returns the data collected during the inspection process, which is the automated inspection data. The automated inspection data includes the indicator data of all servers to be inspected during the indicator data collection period. The indicator data includes the CPU usage, memory usage, disk occupancy, system request volume, number of queries per second (qps), number of transactions per second (tps), and read and write latency.

[0060] In the above embodiment, the target node groups from different project dimensions according to the project information of the inspection task and the associated projects associated from the CMDB, creates an inspection thread task for querying the indicator data of each dimension, and submits it to the thread pool. Each asynchronously executed inspection thread task in the thread pool obtains the CPU usage, memory usage, disk occupancy, system request volume, number of queries per second (qps), number of transactions per second (tps), and read and write delays and other indicator data of all servers in the specified time period, that is, the indicator data collection time, from the monitoring system. By executing the inspection thread and collecting data, the current operating status of the server can be automatically obtained, providing a basis for subsequent monitoring, analysis and maintenance. The automation level of the inspection is improved, manual intervention is reduced, and the maintainability of the system is enhanced.

[0061] In one of the embodiments, an inspection result report may be generated based on the automated inspection data obtained from the inspection task, specifically including: Step 1: Based on the automated inspection data, the project corresponding to the inspection task is used as the root node and the related projects are used as child nodes to construct the topology report data.

[0062] After the inspection task distributed computing module obtains the automated inspection data, it sends the automated inspection data to the inspection result report module. The automated inspection data includes the indicator data of the server of the project corresponding to the inspection task, and the indicator data of the server of the associated project. With the project corresponding to the inspection task as the root node and the associated project as the child node, the indicator data of the server corresponding to each project is used to generate topology report data. The root node is the starting point in the topology map, and the child node is the node extending from the root node in the topology map, representing the project associated with the root node. The topology report data is report data that graphically displays the relationship between projects.

[0063] Step 2: Build an inspection result report based on the automated inspection data and topology report data.

[0064] After generating the topology map report data, since the topology map report data is graphical report data, the amount of indicator data displayed is limited, and only important indicator data can be displayed. Therefore, it is necessary to combine the topology map report data with the original automated inspection data to construct an inspection result report to provide a more comprehensive indicator data display. For example, in the topology map report data, only important indicator data is displayed for each topology node. When a topology node is clicked, the indicator data of all servers of the topology node is displayed based on the automated inspection data.

[0065] Step 3: Output the inspection result report.

[0066] The inspection result report is visually displayed to the user through the display component. For example, the inspection result report can be displayed through the web interface, desktop application, or report generation tool. Users can view the indicator data of a specific server in the inspection result report through the filtering, sorting, and filtering functions.

[0067] The above-mentioned embodiment, by using distributed multi-threaded dynamic expansion technology, can calculate the inspection task data of a large number of projects in real time and quickly generate inspection result reports. Based on the automatic acquisition of multi-dimensional automated inspection data of inspection tasks based on CMDB, there is no need to manually define the many indicator dimensions of maintenance inspection tasks in advance, reducing manual repetitive operations and avoiding information errors and omissions caused by manual operations. Comprehensive inspection calculations are performed based on multi-dimensional indicator data such as the server number, public network information, and the relationship between projects of the inspection task obtained from CMDB, and comprehensive inspection reports are generated based on the inspection data of related indicators, thereby improving the comprehensiveness and reliability of the inspection results.

[0068] In order to more clearly illustrate the technical solution of the present application, the present application also provides a detailed embodiment. Figure 4 As shown in the figure, a multi-dimensional distributed automated inspection system based on CMDB is provided in detail, which specifically includes: CMDB module, also known as CMDB asset management platform module, is used to store asset information, such as the number of server CPU cores, disk memory size, IP room, public network information, bandwidth, etc., and add product and project related tags to each server asset to realize asset information network.

[0069] The inspection task definition module is used to define and save inspection tasks. Customize inspection tasks by specifying time periods based on indicators such as products, projects, and server resource utilization. First, add an inspection task, then select products and projects saved in the CMDB module, set the inspection time range, execution cycle, and other information, and save the inspection task.

[0070] The inspection task distributed computing module periodically executes the inspection tasks saved in the inspection task definition module in the previous step and in the enabled state for scheduled inspection tasks, and queries the inspection task details. According to the load of each node in the inspection task distributed computing module, the inspection tasks are distributed to the inspection task computing module nodes with relatively idle loads. According to the project information defined in the inspection task, the inspection task computing node queries the internal network IP of the server associated with the project, the computer room to which it belongs, and the server IP and computer room, public network IP, bandwidth information, etc. under the dependent project from the CMDB. According to the project in the inspection task definition and other projects associated with the CMDB, group them from different project dimensions, create thread tasks for querying indicator data of each dimension, and submit them to the thread pool for asynchronous execution. Using multi-threading technology, each thread asynchronously executes to obtain indicator data such as CPU usage, memory usage, disk occupancy, system request volume, number of queries per second (qps), number of transactions per second (tps), and read and write latency of all machines in the group of tasks in the specified time period from the monitoring system. Synchronize the results of asynchronous execution of each thread, and submit the inspection calculation results of each dimensional indicator of the project to the inspection result report module.

[0071] The inspection result report module receives the inspection results submitted by the inspection task distributed computing module. With the project defined by the inspection task as the root node and other dependent projects obtained from the CMDB as child nodes, the inspection results of each dimension indicator of each project (CPU usage, memory usage, disk occupancy, system request volume, number of queries per second (qps), number of transactions per second (tps), read and write delay, etc.) are used to generate topology map report data. Output the detailed inspection result report of the defined inspection task, showing the inspection results of each indicator dimension (CPU usage, memory usage, disk occupancy, system request volume, number of queries per second (qps), number of transactions per second (tps), read and write delay, etc.) of each project.

[0072] The present embodiment provides a multi-dimensional distributed automated inspection system based on the CMDB asset management platform. The system utilizes a distributed architecture design, and based on the project-related information of the CMDB, formulates customizable and dynamically adjustable indicator dimensions, so as to realize rapid processing of data calculations of many project platform systems during inspections. Through this system and method, system operation and maintenance personnel only need to select project information to automatically specify inspection dimensions based on the system service information associated with the project in real time based on the CMDB. There is no need to manually associate and define the many associated systems and services of the project, thus avoiding errors and omissions in manually defining the inspection indicator dimensions. The present embodiment solves the problems of slow inspection speed, fixed inspection indicator dimensions, and single inspection report results in traditional inspection systems. It provides an inspection solution that is faster, more scalable, multi-dimensional, has higher correlation between result reports, and is more reliable.

[0073] In this embodiment, multi-dimensional data of inspection items is automatically obtained based on CMDB, without the need to manually define and maintain the numerous indicator dimensions of inspection items in advance, thus reducing manual repetitive operations and avoiding information errors caused by manual operations. A dynamically scalable distributed computing inspection task data backend cluster is used to calculate inspection tasks in real time and efficiently, obtain the indicator information of each related project from CMDB, and submit the calculation results to the inspection result report module according to the project dependency relationship. The inspection result report uses the project defined by the inspection task as the root node and other dependent projects obtained from CMDB as child nodes. The inspection results of each dimensional indicator of each project (CPU utilization, memory utilization, disk occupancy, system request volume, number of queries per second (qps), number of transactions per second (tps), read and write delays, etc.) are used to generate topology map report data.

[0074] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0075] Based on the same inventive concept, the embodiment of the present application also provides an automated inspection device based on a distributed system for implementing the automated inspection method based on a distributed system involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the embodiments of one or more automated inspection devices based on a distributed system provided below can refer to the limitations of the automated inspection method based on a distributed system above, and will not be repeated here.

[0076] In one embodiment, Figure 5 As shown, an automatic inspection device based on a distributed system is provided, comprising: an acquisition module 100, a node determination module 200 and an inspection module 300, wherein: The acquisition module 100 is used to acquire a preset inspection task; the inspection task includes: project information, indicator information and time information.

[0077] The node determination module 200 is used to determine the target node according to the load information of each node in the distributed system.

[0078] The inspection module 300 is used for the target node to execute the inspection task and obtain automated inspection data.

[0079] The acquisition module 100 is also used to obtain project information, indicator information and time information input by the user; the time information includes: inspection task execution time and indicator data collection time; according to the project information, indicator information and time information, the inspection task is constructed and stored.

[0080] The node determination module 200 is also used to obtain the CPU usage of each node in the distributed system; and take the node with the smallest CPU usage as the target node.

[0081] The inspection module 300 is also used to determine multiple server information to be inspected in the asset management system according to the project information of the inspection task; construct multiple inspection threads according to the multiple server information to be inspected and the inspection task; and execute the multiple inspection threads to obtain automated inspection data.

[0082] The inspection module 300 is also used to search for multiple first server information to be inspected in the asset management system according to the project information of the inspection task; search for related projects in the asset management system according to the project information of the inspection task; and search for multiple second server information to be inspected in the asset management system according to the related projects.

[0083] The inspection module 300 is also used to divide the multiple servers to be inspected into multiple project groups according to the project information corresponding to the multiple server information to be inspected; and to construct a corresponding inspection thread based on the server information to be inspected corresponding to each project group, the indicator information corresponding to the inspection task, and the indicator data collection time corresponding to the inspection task.

[0084] The inspection module 300 is also used to construct topology report data based on the automated inspection data, with the project corresponding to the inspection task as the root node and the related projects as child nodes; construct an inspection result report based on the automated inspection data and the topology report data; and output and display the inspection result report.

[0085] Each module in the above-mentioned distributed system-based automated inspection device can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each of the above modules.

[0086] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 6As shown. The computer device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data required for executing an automated inspection method based on a distributed system. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, an automated inspection method based on a distributed system is implemented.

[0087] Those skilled in the art will understand that Figure 6 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0088] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, any one of the automated inspection methods based on a distributed system in the above embodiments is implemented.

[0089] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, any one of the automated inspection methods based on a distributed system in the above embodiments is implemented.

[0090] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0091] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0092] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. An automated inspection method based on a distributed system, characterized in that: The method comprises: Obtaining a pre-set inspection task; the inspection task includes: project information, indicator information and time information; Determine the target node based on the load information of each node in the distributed system; The target node executes the inspection task to obtain automated inspection data.

2. The method according to claim 1, characterized in that The method further comprises: Obtaining project information, indicator information and time information input by the user; the time information includes: inspection task execution time and indicator data collection time; The inspection task is constructed and stored according to the project information, indicator information and time information.

3. The method according to claim 1, characterized in that Determining the target node according to the load information of each node in the distributed system includes: Get the CPU usage of each node in the distributed system; The node with the lowest CPU usage is taken as the target node.

4. The method according to claim 1, characterized in that: The target node executes the inspection task, and obtains the automated inspection data including: Determine information of multiple servers to be inspected in the asset management system according to the project information of the inspection task; Constructing multiple inspection threads according to the information of the multiple servers to be inspected and the inspection tasks; Execute multiple inspection threads to obtain automated inspection data.

5. The method according to claim 4, characterized in that Determining information of multiple servers to be inspected in the asset management system according to the project information of the inspection task includes: Searching for information of a plurality of first servers to be inspected in the asset management system according to the project information of the inspection task; Searching for related projects in the asset management system according to the project information of the inspection task; According to the associated items, multiple pieces of information of the second servers to be inspected are searched in the asset management system.

6. The method according to claim 5, characterized in that The constructing of multiple inspection threads according to the information of the multiple servers to be inspected and the inspection tasks includes: According to the project information corresponding to the information of the multiple servers to be inspected, the multiple servers to be inspected are divided into multiple project groups; Based on the to-be-inspected server information corresponding to each project group, the indicator information corresponding to the inspection task, and the indicator data collection time corresponding to the inspection task, a corresponding inspection thread is constructed.

7. The method according to claim 6, characterized in that The method further comprises: According to the automated inspection data, topology report data is constructed with the project corresponding to the inspection task as the root node and the related projects as the child nodes; Constructing an inspection result report based on the automated inspection data and topology report data; Output and display the inspection result report.

8. An automated inspection device based on a distributed system, characterized in that: The device comprises: The acquisition module is used to acquire a preset inspection task; the inspection task includes: project information, indicator information and time information; A node determination module is used to determine the target node according to the load information of each node in the distributed system; The inspection module is used for the target node to execute the inspection task and obtain automated inspection data.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images