Distributed system testing and evaluation method, device, electronic equipment and storage medium

By logically partitioning and testing data injection of the physical partitions of the distributed system, combined with the evaluation model, the problem of not being able to predict the actual use environment during the acceptance process of the distributed system is solved, and the rapid and effective testing and evaluation of the distributed system is achieved.

CN114610642BActive Publication Date: 2025-04-04INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210292054.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-23
Publication Date
2025-04-04
Estimated Expiration
2042-03-23

AI Technical Summary

Technical Problem

During the acceptance process of distributed systems, it is impossible to guarantee that the same environment as the production environment is exactly the same, resulting in the inability to effectively predict the problems faced by distributed systems in the actual use environment, and thus the inability to effectively evaluate distributed systems deployed in off-site areas.

Method used

By obtaining the physical partition of the distributed system, logically divide the node server in the target area, generate logical partitions associated with the physical partition, and inject test data based on the preset test parameters of the logical partition to generate test results, and then judge whether the distributed system is operating normally through the evaluation model.

Benefits of technology

It realizes rapid and effective testing and evaluation of distributed systems, which can effectively avoid failures in distributed systems in production environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114610642B_ABST
    Figure CN114610642B_ABST
Patent Text Reader

Abstract

The present disclosure provides a distributed system test evaluation method, device, electronic device and storage medium, which can be applied to the field of distributed system technology, finance or other fields. The method includes: obtaining at least one physical partition of the distributed system in the area to be evaluated; logically partitioning the M node servers in the target area according to the at least one physical partition to generate at least one logical partition, the physical partition is associated with the logical partition, each logical partition contains at least one preset test parameter, M is an integer greater than 1; injecting test data into at least one logical partition according to the at least one preset test parameter to generate at least one test result; inputting at least one test result into the evaluation model to obtain the evaluation result of the distributed system in the area to be evaluated, and the evaluation result includes normal operation and abnormal operation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the technical field of distributed systems, and more specifically to a test and evaluation method, device, electronic device, and readable storage medium for a distributed system. Background Art

[0002] With the development of Internet technology, in the architecture of financial application software, in order to ensure the high availability of applications, the application of distributed systems is becoming more and more widespread. In order to avoid downtime at a smaller regional level, the architecture of application software often adopts distributed remote deployment. However, for systems that adopt distributed remote deployment, it is impossible to ensure that the environment is exactly the same as the production environment during acceptance. As a result, when accepting distributed systems, it is impossible to effectively predict the problems faced by distributed systems in the actual use environment, and thus it is impossible to effectively evaluate distributed systems deployed remotely. Summary of the invention

[0003] In view of the above problems, the first aspect of the present disclosure provides a test and evaluation method for a distributed system, including: obtaining at least one physical partition of a distributed system in an area to be evaluated; performing logical partitioning for M node servers in a target area according to the at least one physical partition to generate at least one logical partition, wherein the physical partition is associated with the logical partition, and each of the logical partitions contains at least one preset test parameter, wherein M is an integer greater than 1; injecting test data into the at least one logical partition according to the at least one preset test parameter to generate at least one test result; inputting the at least one test result into an evaluation model to obtain an evaluation result of the distributed system in the area to be evaluated, wherein the evaluation result includes normal operation and abnormal operation.

[0004] In some exemplary embodiments of the present disclosure, the M node servers in the target area are logically partitioned according to the at least one physical partition to generate at least one logical partition, including: determining the number of the logical partitions to be generated according to the number of the physical partitions; determining at least one preset test parameter contained in each of the logical partitions to be generated according to the physical parameters of each of the physical partitions; and logically partitioning the M node servers according to the number of the logical partitions to be generated and the at least one preset test parameter contained in each of the logical partitions to be generated to generate at least one logical partition.

[0005] In some exemplary embodiments of the present disclosure, the physical parameters include the physical distance between physical partitions, and determining at least one preset test parameter contained in each of the logical partitions to be generated based on the physical parameters of each of the physical partitions includes: determining the network delay parameter between each of the logical partitions to be generated based on the physical distance between each of the physical partitions.

[0006] In some exemplary embodiments of the present disclosure, injecting test data into the at least one logical partition according to the at least one preset test parameter to generate at least one test result includes: determining a test method for the test data according to the preset test parameters contained in the logical partition; injecting the test data into each node server in the logical partition according to the test method; and obtaining test details of each node server in each logical partition, generating at least one test result for the M node servers according to the test details, each of the test results being associated with the test method for the test data.

[0007] In some exemplary embodiments of the present disclosure, the test details of each node server of each logical partition are obtained, and at least one test result for the M node servers is generated according to the test details, including: obtaining the initial time and the end time of injecting the test data into each node server of each logical partition; after the injection of the test data into each node server of each logical partition is completed, obtaining the data content; and generating at least one test result according to at least one of the initial time, the end time, and the data content.

[0008] In some exemplary embodiments of the present disclosure, generating at least one test result based on at least one of the initial time, the end time and the data content includes: generating a time test result based on the initial time and the end time; generating a data volume test result based on the data content; and generating a success rate test result based on the initial time, the end time and the data content.

[0009] In some exemplary embodiments of the present disclosure, the test evaluation method further includes: when the evaluation result of the distributed system in the area to be evaluated is an operation abnormality, analyzing the at least one test result to determine the logical partition and the physical partition associated with the test result that exceeds a set threshold in the at least one test result.

[0010] In some exemplary embodiments of the present disclosure, the test evaluation method further includes: training the evaluation model before inputting the at least one test result into the evaluation model, wherein data in a training set, a validation set, and a test set for training the evaluation model are obtained from a normally operating distributed system.

[0011] A second aspect of the present disclosure provides a test and evaluation device for a distributed system, including: a first acquisition module, configured to acquire at least one physical partition of a distributed system in an area to be evaluated; a first generation module, configured to perform logical partitioning for M node servers in a target area according to the at least one physical partition, and generate at least one logical partition, wherein the physical partition is associated with the logical partition, and each of the logical partitions contains at least one preset test parameter, wherein M is an integer greater than 1; a second generation module, configured to inject test data into the at least one logical partition according to the at least one preset test parameter, and generate at least one test result; a second acquisition module, configured to input the at least one test result into an evaluation model, and acquire an evaluation result of the distributed system in the area to be evaluated, wherein the evaluation result includes normal operation and abnormal operation.

[0012] In some exemplary embodiments of the present disclosure, the first generation module includes: a first determination unit, configured to determine the number of the logical partitions to be generated according to the number of the physical partitions; a second determination unit, configured to determine at least one preset test parameter contained in each of the logical partitions to be generated according to the physical parameters of each of the physical partitions; and a first generation unit, configured to logically partition the M node servers according to the number of the logical partitions to be generated and at least one preset test parameter contained in each of the logical partitions to be generated, and generate at least one logical partition.

[0013] In some exemplary embodiments of the present disclosure, the physical parameters include a physical distance between physical partitions, and the first generation unit includes a first determination submodule, which is configured to determine a network delay parameter between each of the logical partitions to be generated based on the physical distance between each of the physical partitions.

[0014] In some exemplary embodiments of the present disclosure, the second generation module includes: a third determination unit, configured to determine a test method for test data based on preset test parameters contained in the logical partition; a data injection unit, configured to inject the test data into each node server in the logical partition according to the test method; and a second generation unit, configured to obtain test details of each node server in each logical partition, and generate at least one test result for the M node servers based on the test details, each of the test results being associated with the test method for the test data.

[0015] In some exemplary embodiments of the present disclosure, the second generation unit includes: a first acquisition submodule, configured to obtain the initial time and the end time of each node server of each logical partition injecting the test data; a second acquisition submodule, configured to obtain the data content after the injection of the test data into each node server of each logical partition is completed; and a first generation submodule, configured to generate at least one test result based on at least one of the initial time, the end time and the data content.

[0016] In some exemplary embodiments of the present disclosure, the first generation submodule includes: a test result generation module, and the test result generation module is configured to: generate a time test result according to the initial time and the end time; generate a data volume test result according to the data content; and generate a success rate test result according to the initial time, the end time and the data content.

[0017] In some exemplary embodiments of the present disclosure, the test evaluation device also includes: an analysis module, configured to analyze the at least one test result when the evaluation result of the distributed system in the area to be evaluated is an operation abnormality, and determine the logical partition and the physical partition associated with the test result that exceeds a set threshold in the at least one test result.

[0018] In some exemplary embodiments of the present disclosure, the test evaluation device also includes: a training module, configured to train the evaluation model before inputting the at least one test result into the evaluation model, wherein the data in the training set, validation set and test set for training the evaluation model are obtained from a normally operating distributed system.

[0019] A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; a storage device for storing executable instructions, wherein when the executable instructions are executed by the processors, the method described above is implemented.

[0020] A fourth aspect of the present disclosure provides a computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, implement the method described above.

[0021] A fifth aspect of the present disclosure provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the method described above is implemented.

[0022] According to the embodiments of the present disclosure, by dividing the target area, generating logical partitions associated with the physical partitions of the distributed system, injecting test data into the logical partitions according to the preset test parameters of the logical partitions, and evaluating the test results through the evaluation model, it is possible to determine whether the distributed system is running normally. In this way, a fast and effective test evaluation of the distributed system can be achieved, effectively avoiding failures of the distributed system in the production environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The above contents and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:

[0024] Figure 1 A schematic diagram schematically shows a system architecture to which a test and evaluation method for a distributed system according to an embodiment of the present disclosure can be applied;

[0025] Figure 2 A flow chart schematically shows a test and evaluation method for a distributed system according to an embodiment of the present disclosure;

[0026] Figure 3 The flowchart in operation S220 of the test evaluation method for a distributed system according to an embodiment of the present disclosure is schematically shown;

[0027] Figure 4 The flowchart in operation S222 of the test evaluation method for a distributed system according to an embodiment of the present disclosure is schematically shown;

[0028] Figure 5 The flowchart in operation S230 of the test evaluation method for a distributed system according to an embodiment of the present disclosure is schematically shown;

[0029] Figure 6 The flowchart in operation S233 of the test evaluation method for a distributed system according to an embodiment of the present disclosure is schematically shown;

[0030] Figure 7 The flowchart in operation S330 of the test evaluation method for a distributed system according to an embodiment of the present disclosure is schematically shown;

[0031] Figure 8 A schematic diagram showing a structural block diagram of a test and evaluation device for a distributed system according to an embodiment of the present disclosure; and

[0032] Fig. 9 A block diagram of an electronic device suitable for implementing a test and evaluation method for a distributed system according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0033] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.

[0034] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.

[0035] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification, and should not be interpreted in an idealized or overly rigid manner.

[0036] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).

[0037] In the technical solution disclosed in the present invention, the acquisition, storage and application of user personal information involved are in compliance with the provisions of relevant laws and regulations, necessary confidentiality measures are taken, and do not violate public order and good morals.

[0038] In the technical solution of the present disclosure, operations such as acquisition, storage and application of user personal information are all authorized by the user.

[0039] In order to solve the problem in the related art that the distributed system cannot be effectively predicted in the actual use environment, the present disclosure provides a test and evaluation method, device, electronic device, readable storage medium and computer program product for a distributed system, which can realize fast and effective test and evaluation of the distributed system and avoid failures in the distributed system in the production environment. The test and evaluation method of the distributed system disclosed in the present disclosure includes but is not limited to: obtaining at least one physical partition of the distributed system in the area to be evaluated; logically partitioning the M node servers in the target area according to the at least one physical partition to generate at least one logical partition, the physical partition is associated with the logical partition, and each logical partition contains at least one preset test parameter, where M is an integer greater than 1; injecting test data into at least one logical partition according to the at least one preset test parameter to generate at least one test result; inputting at least one test result into the evaluation model to obtain the evaluation result of the distributed system in the area to be evaluated, and the evaluation result includes normal operation and abnormal operation.

[0040] According to the embodiments of the present disclosure, by dividing the target area, generating logical partitions associated with the physical partitions of the distributed system, injecting test data into the logical partitions according to the preset test parameters of the logical partitions, and evaluating the test results through the evaluation model, it is possible to determine whether the distributed system is running normally. In this way, a fast and effective test evaluation of the distributed system can be achieved, effectively avoiding failures of the distributed system in an actual production environment.

[0041] Figure 1 The schematic diagram schematically shows a system architecture to which the test and evaluation method of a distributed system can be applied according to an embodiment of the present disclosure. It should be noted that: Figure 1 What is shown is only an example of a system architecture to which the embodiments of the present disclosure can be applied, in order to help those skilled in the art understand the technical content of the present disclosure, but it does not mean that the embodiments of the present disclosure cannot be used in other devices, systems, environments or scenarios. It should be noted that the test and evaluation method and device for a distributed system provided by the embodiments of the present disclosure can be used in the technical field of distributed systems and related aspects of the financial field, and can also be used in any field other than the financial field. The test and evaluation method and device for a distributed system provided by the embodiments of the present disclosure do not limit the application field.

[0042] like Figure 1 As shown, an exemplary system architecture 100 to which the test and evaluation method for a distributed system can be applied may include terminal devices 101 and 102, a network 103, a load balancing server 104, and a node server 105. The network 103 is used to provide a medium for communication links between the terminal devices 101 and 102 and the load balancing server 104 and the node server 105. The network 103 may include various connection types, such as wired or wireless communication links or optical fiber cables, etc.

[0043] The user can use the terminal devices 101 and 102 to interact with the load balancing server 104 and the node server 105 through the network 103 to receive or send messages, instructions, etc. Various payment client applications or various transaction client applications can be installed on the terminal devices 101 and 102, such as online banking client processing applications, shopping applications, mobile payment applications, public transportation payment applications, investment and financial management applications, etc. (only for example).

[0044] The terminal devices 101 and 102 may be various electronic devices having a display screen and supporting functions such as mobile payment and electronic transactions, including but not limited to tablet computers, laptop computers, and desktop computers.

[0045] The load balancing server 104 may be a load balancing server such as Nginx, LVS, or HAProxy. The load balancing server 104 may be a software load balancing server or a hardware load balancing server. The software load balancing server may be a server that installs one or more additional software on the corresponding operating system of one or more servers to achieve load balancing, such as DNS LoadBalance, CheckPoint Firewall-1 ConnectControl, etc. It may also be a server that directly installs a load balancing device between the server and the external network, and a dedicated device completes a dedicated task, and intelligently manages traffic.

[0046] The node server 105 may be a server that provides various services, such as a background management server (only as an example) that provides support for instructions sent by users using terminal devices 101 and 102, or information retrieved or websites browsed, or a WEB server, FTP server, enterprise core application server, and other main task servers. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user instructions or user requests) to the terminal devices 101 and 102. The node server 105 is used to collaborate with the load balancing server 104 to complete work tasks.

[0047] It should be noted that the test and evaluation method of the distributed system provided in the embodiment of the present disclosure can be executed by the load balancing server 104 and the node server 105. Accordingly, the test and evaluation device of the distributed system provided in the embodiment of the present disclosure can generally be set in the load balancing server 104 and the node server 105. The test and evaluation method of the distributed system provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the load balancing server 104 and the node server 105 and can communicate with the terminal devices 101, 102 and / or the load balancing server 104 and the node server 105. Accordingly, the test and evaluation device of the distributed system provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the load balancing server 104 and the node server 105 and can communicate with the terminal devices 101, 102 and / or the load balancing server 104 and the node server 105.

[0048] It should be understood that Figure 1 The number of terminal devices, networks, load balancing servers and node servers in the embodiment is only for illustration. According to the implementation requirements, there may be any number of terminal devices, networks, load balancing servers and node servers.

[0049] The following will be passed Figures 2 to 7 The test and evaluation method of the distributed system of the disclosed embodiment is described in detail.

[0050] Figure 2 The flowchart of the test and evaluation method of the distributed system according to the embodiment of the present disclosure is schematically shown.

[0051] like Figure 2 As shown, the process 200 of the distributed system test and evaluation method of the present disclosure includes operations S210 to S240.

[0052] In operation S210, at least one physical partition of a distributed system in a region to be evaluated is obtained.

[0053] In operation S220, logical partitioning is performed for M node servers in the target area according to at least one physical partition to generate at least one logical partition, the physical partition is associated with the logical partition, each logical partition includes at least one preset test parameter, and M is an integer greater than 1.

[0054] In operation S230, test data is injected into at least one logical partition according to at least one preset test parameter to generate at least one test result.

[0055] In operation S240, at least one test result is input into the evaluation model to obtain an evaluation result of the distributed system in the area to be evaluated, where the evaluation result includes normal operation and abnormal operation.

[0056] The following example illustrates a schematic flow of each operation of the test and evaluation method for a distributed system of this embodiment.

[0057] Exemplarily, the distributed system of the area to be evaluated may include, for example, a distributed system within a specific physical area, for example, multiple node servers belonging to the same distributed system set at different locations in the same urban area. The distributed system of the area to be evaluated has at least one physical partition. A physical partition may, for example, refer to the physical location of a cluster composed of at least one node server located at different locations, each physical partition including at least one node server. The clusters composed of node servers in different physical partitions are affected by geographical locations and there are certain differences, for example, there are differences such as network delays between node servers in different physical partitions.

[0058] In an embodiment of the present disclosure, at least one physical partition of the distributed system of the area to be evaluated is obtained. For example, if the distributed system of the area to be evaluated includes multiple physical partitions, each physical partition is obtained.

[0059] The physical partition is associated with the logical partition, for example, the number of physical partitions is the same as the number of logical partitions, or the number of physical partitions is in a set ratio with the number of logical partitions. The physical partition is associated with the logical partition, for example, the physical spacing between each physical partition in the physical partition is associated with the set parameter in the logical partition.

[0060] The M node servers in the target area are logically partitioned according to the obtained physical partitions to generate logical partitions.

[0061] In the embodiments of the present disclosure, the target area may refer to an area located at the same geographical location, for example, and the logical partition is a plurality of areas located within the target area after the target area is logically partitioned. The node servers in the logical partition may be arranged adjacently or at intervals, for example, node servers belonging to the same logical partition may be provided with node servers of other logical partitions.

[0062] Exemplarily, the number of logical partitions to be generated in the target area is determined according to the number of physical partitions, and the M node servers in the target area are zoned according to the type, service type, and number of node servers in each physical partition. For example, the type, service type, and number of node servers in the physical partition are associated with the type, service type, and number of node servers in the logical partition.

[0063] For example, according to the situation of the distributed system in the area to be evaluated, the M node servers in the target area are partitioned according to IP logic to generate multiple logical partitions. Logical partitions are associated with physical partitions of the distributed system. Specifically, there are 2 node servers in physical partition A, 3 node servers in physical partition B, and 2 node servers in physical partition C. Then, the node servers of IP1-7 in the target area are partitioned according to IP logic to generate logical partition A including IP1-2, logical partition B including IP3-5, and logical partition C including IP6-7.

[0064] In the embodiment of the present disclosure, each logical partition includes at least one preset test parameter. The preset test parameter may, for example, reflect the association between each logical partition, and each preset test parameter may be adjusted to meet the test evaluation requirements of different distributed systems.

[0065] Test data is injected into at least one logical partition according to at least one preset test parameter to generate at least one test result.

[0066] Exemplarily, each logical partition includes at least one preset test parameter, and test data is injected into the at least one logical partition according to the obtained at least one preset test parameter. For all logical partitions in the target area, a preset test parameter included in each logical partition is obtained, and a test input is injected into the logical partition according to the obtained preset test parameter, and at least one test result is generated.

[0067] For example, one test result may be generated according to one preset parameter, or multiple test results may be generated according to one preset test parameter.

[0068] In an embodiment of the present disclosure, the test result may be, for example, a result summarized from tests of all logical partitions of the target area, and the test result may reflect the overall performance of all logical partitions of the target area under current test data.

[0069] After generating at least one test result, the at least one test result is input into the evaluation model to obtain the evaluation result of the distributed system in the area to be evaluated, wherein the evaluation result includes normal operation and abnormal operation.

[0070] Exemplarily, the test results can be used as input data of the evaluation model, and the operating conditions of the M node servers in the target area can be obtained by analyzing the input test results. For example, by adjusting the type and amount of injected test data, or adjusting at least one preset test parameter of each logical partition, the problems that the M node servers in the target area may face in the actual production environment can be simulated. And the M node servers in the target area can be adjusted according to the evaluation results to solve the problems in the actual production environment.

[0071] In the embodiments of the present disclosure, by associating the physical partition with the logical partition, the operating status of the M node servers in the target area is associated with the node servers in the physical partition. When the evaluation results of the M node servers in the target area are normal operation and abnormal operation, the normal operation and abnormal operation status of the distributed system in the area to be evaluated can be reflected. According to the association status of the target area and the area to be evaluated, the relevant personnel are guided to adjust the specific content of the distributed system according to the evaluation results, such as increasing the number of node servers in the distributed system, or reducing the amount of data processed by the distributed system, or reducing the deployment scale of the distributed system, etc.

[0072] According to the embodiments of the present disclosure, by associating at least one physical partition of the distributed system in the area to be evaluated with at least one logical partition generated from the target area, the simulation of the distributed system deployed remotely is realized, and test data is injected into the logical partition according to at least one preset test parameter contained in the logical partition, and the test result is evaluated by the evaluation model to determine whether the distributed system is running normally. In this way, a fast and effective test evaluation of the distributed system can be realized, and failures of the distributed system in the actual production environment can be effectively avoided.

[0073] Figure 3 The flowchart in operation S220 of the test and evaluation method for a distributed system according to an embodiment of the present disclosure is schematically shown.

[0074] like Figure 3 As shown, operation S220 includes performing logical partitioning on the M node servers in the target area according to the at least one physical partition to generate at least one logical partition. The process of the test evaluation method in operation S220 of the embodiment of the present disclosure may include operations S221 to S223.

[0075] In operation S221 , the number of logical partitions to be generated is determined according to the number of physical partitions.

[0076] In an embodiment of the present disclosure, the distributed system of the area to be evaluated includes at least one physical partition.

[0077] For example, when the distributed system of the area to be evaluated includes multiple physical partitions, there is a physical distance between each physical partition, and parameters such as the number of node servers between each physical partition are different. When the target area is logically divided into zones, the physical factors of the physical partitions are referenced to ensure that the logical partitions are associated with the physical partitions.

[0078] In this embodiment, after obtaining the number of physical partitions, the number of logical partitions to be generated is determined according to the number of physical partitions, for example, the number of logical partitions is determined to be the same as the number of physical partitions. For another example, the number of physical partitions and the number of logical partitions meet a set ratio.

[0079] In operation S222, at least one preset test parameter included in each logical partition to be generated is determined according to the physical parameters of each physical partition.

[0080] In this embodiment, each physical partition has a physical parameter. For example, the physical parameter may be a physical distance between the physical partitions.

[0081] Figure 4 The flowchart in operation S222 of the test evaluation method for a distributed system according to an embodiment of the present disclosure is schematically shown. Figure 4 As shown, operation S222 may specifically include operation S2221, in which a network delay parameter between each logical partition to be generated is determined according to a physical distance between each physical partition.

[0082] For example, in the distributed system of the area to be evaluated, there is a certain physical distance between each physical partition, and the transmission speed and efficiency of information change with the change of the physical distance. By obtaining the physical distance between each physical partition, the network delay parameter between each logical partition to be generated is determined. In this way, the simulation of the actual production environment is realized, making the evaluation result of the distributed system more accurate.

[0083] For example, the number of generated logical partitions is the same as that of physical partitions, and each logical partition has a corresponding or associated physical partition. By obtaining the physical distance between the physical partitions, the network delay parameters between the corresponding or associated logical partitions are determined, thereby simulating the actual production environment.

[0084] In this embodiment, determining the network delay parameters between each logical partition to be generated can be achieved, for example, by using the ChaosBlade tool, by adding network delay parameters to the specified network card, local port, remote port, and target IP through the physical parameters between the physical partitions of the distributed system in the area to be evaluated. Specifically, ChaosBlade implements network delay by calling the Linux kernel TC framework.

[0085] In operation S223, the M node servers are logically partitioned according to the number of logical partitions to be generated and at least one preset test parameter included in each logical partition to be generated, so as to generate at least one logical partition.

[0086] After determining the number of logical partitions and at least one preset test parameter contained in each logical partition, the M node servers in the target area are logically partitioned to generate at least one logical partition. The number of logical partitions corresponds to the number of physical partitions, thereby achieving simulation of the production environment.

[0087] In this embodiment, the preset test parameters include network delay. In other optional embodiments, the preset test parameters may also include parameters such as data packet transmission rate and resource consumption. Depending on the specific content of the preset test parameters, the operating conditions of the distributed system under different conditions can be tested. In other optional embodiments, one or more preset test parameters can be selected for test evaluation according to the actual production environment, so as to obtain more accurate evaluation results.

[0088] Figure 5 The flowchart in operation S230 of the test and evaluation method for a distributed system according to an embodiment of the present disclosure is schematically shown.

[0089] In an embodiment of the present disclosure, operation S230 includes injecting test data into at least one logical partition according to at least one preset test parameter to generate at least one test result. Figure 5 As shown, it specifically includes operations S231 to S233.

[0090] In operation S231, a test method for test data is determined according to preset test parameters included in the logical partition.

[0091] In an embodiment of the present disclosure, the logical partition, for example, includes at least one preset test parameter, and each preset test parameter, for example, may correspond to at least one test method.

[0092] Exemplarily, the preset test parameter included in the logical partition is a network delay parameter, according to which a test method can be determined, and each test method can test and obtain a test result. The corresponding test method is determined by the preset test parameter, thereby obtaining different test results.

[0093] In operation S232 , test data is injected into each node server in the logical partition according to the test method.

[0094] In an embodiment of the present disclosure, after the test method is determined, test data is injected into each node server in each logical partition according to the test method.

[0095] For example, the preset test parameter may be a network delay parameter, and the test method may be determined based on the network delay parameter to include a first test method and a second test method. The first test method includes calculating the network time consumption between each node server of different logical partitions. For example, according to the first test method, any node server pings the M node servers in the target area to determine the network time consumption between two node servers, and the network time consumption is counted and analyzed. The second test method determined based on the network delay parameter may include calculating the data synchronization efficiency and synchronization success rate between the logical partitions of the target area. For example, according to the second test method, test data of a set type and a set size is injected into the logical partition of each target area.

[0096] In an embodiment of the present disclosure, the process of injecting test data into each node server also includes determining the data type and data volume of the injected test data.

[0097] In operation S233, test details of each node server of each logical partition are obtained, and at least one test result for the M node servers is generated according to the test details, and each test result is associated with a test method of the test data.

[0098] The test details of each node server of the logical partition are obtained, and the test details can be, for example, a test sub-result returned by each node server. For example, the test details can be the network time consumed between the determined node servers (including the minimum network time consumed or the maximum network time consumed), and for another example, the test details can be the time required for each node server to obtain all data. Based on the test details, the test results of M node servers are generated, and the test results of M node service areas can reflect the operating status of the M node servers in the target area.

[0099] For example, the test details of each logical partition are determined according to the test details of each node server, and the test result is further determined according to the test details of each logical partition.

[0100] In an embodiment of the present disclosure, the M node servers in the target area generate a corresponding test result according to each test method. When multiple test methods are used for testing, or multiple preset test parameters are tested, the M node servers in the target area generate corresponding multiple test results.

[0101] Figure 6 The flowchart in operation S233 of the test evaluation method for a distributed system according to an embodiment of the present disclosure is schematically shown.

[0102] like Figure 6 As shown, operation S233 includes operations S310 to S330.

[0103] In operation S310 , the initial time and the end time of injecting test data into each node server of each logical partition are obtained.

[0104] In an embodiment of the present disclosure, the initial time and the end time of injecting test data into each node server are obtained. By obtaining the initial time and the end time, the total time of injecting test data into each node server (that is, the time required for all test data to be injected into the test data) can be determined, or the minimum network time consumption between each node server can be determined.

[0105] In operation S320 , after the injection of test data into each node server of each logical partition is completed, data content is obtained.

[0106] After each node server of each logical partition has injected test data, determine the data content received by each node server. If the success rate of data injection is 100%, the data content obtained from each node server is the same as the data content of the injected test data. The success rate of data transmission can be calculated by obtaining the data content received by each node server.

[0107] In operation S330, at least one test result is generated according to at least one of the initial time, the end time, and the data content.

[0108] Figure 7 The flowchart in operation S330 of the test and evaluation method for a distributed system according to an embodiment of the present disclosure is schematically shown.

[0109] like Figure 7 As shown, operation S330 may include operation S331, operation S332, and operation S333. Operations S331 to S333 may be executed in different orders or simultaneously.

[0110] In an embodiment of the present disclosure, in operation S331 , a time test result is generated according to an initial time and an end time.

[0111] Exemplarily, the time test results can be generated based on the initial time and end time of each node server, by counting the initial time and end time of each node server in the target area, determining the time distribution required for injecting test data for all node servers in the target area, and determining the time test results for all node servers in the target area based on the time distribution.

[0112] In operation S332, a data volume test result is generated according to the data content.

[0113] Exemplarily, the data volume test result is calculated based on the data content received by each node server of each logical partition. For example, test data of a set size is injected into each node server in the target area, and the injected test data content is compared with the data content received by each node server to calculate the data volume test details of each node server. Based on the data volume test details of each node server, the data volume test results of all node servers in the target area are determined.

[0114] According to this embodiment, by generating data volume test results, the amount of data that a distributed system can support can be effectively evaluated.

[0115] In operation S333, a success rate test result is generated according to the initial time, the end time and the data content.

[0116] Exemplarily, the total time required to inject the test data is obtained according to the initial time and the end time of each node server injecting the test data. The success rate of data transmission is obtained according to the data content received by each node server and the initial time and the end time. The success rate test results of all node servers in the target area are calculated according to the data transmission success rate of each node server.

[0117] In an embodiment of the present disclosure, the at least one test result generated includes a success rate test result, a data volume test result, a time test result, etc. The at least one test result generated and the number of node servers in the target area are input into the evaluation model, and the evaluation model evaluates the operating status of the M node servers in the target area according to the input test results and other parameters, and concludes that the M node servers in the target area are operating normally or abnormally. The operating status of the distributed system in the area to be evaluated is determined according to the operating status of the M node servers in the target area.

[0118] Exemplarily, the evaluation model may include a reverse neural network, and the operating status of the distributed system is judged by inputting at least one of the above test results into the reverse neural network.

[0119] For example, a reverse neural network includes an input layer, a hidden layer, and an output layer.

[0120] The input layer is used to input input variables containing at least one test result, and the input layer and the output layer are connected through a connection layer. The hidden layer also includes an activation layer, which adds nonlinearity to the result of the matrix operation. For example, the activation layer can be a Relu activation function. The output layer also includes a Softmax layer, which can be a Softmax function, for example, to correspond the output value to the classification value. The output layer also includes a cross entropy loss located after the Softmax layer, and the cross entropy loss is used to quantify the Softmax output result. After calculating the differential entropy, the parameter optimization in the neural network is achieved through back propagation, thereby improving the accuracy of the test evaluation of the neural network.

[0121] According to the embodiments of the present disclosure, by using the evaluation model to evaluate the distributed system in the area to be evaluated, the operating status of the distributed system can be quickly determined.

[0122] In an embodiment of the present disclosure, the test evaluation method of a distributed system also includes: when an evaluation result of the distributed system in the area to be evaluated is abnormal operation, analyzing at least one test result to determine the logical partition and physical partition associated with the test result that exceeds a set threshold in at least one test result.

[0123] Exemplarily, when the evaluation result is an abnormal operation, the test results are analyzed to determine the logical partitions and physical partitions associated with the test results that exceed the set threshold, and the node servers in the logical partitions and physical partitions are further adjusted according to the test results so that the distributed system can meet actual production requirements.

[0124] According to the embodiments of the present disclosure, by analyzing at least one test result and determining the corresponding logical partitions and physical partitions, accurate adjustment of the distributed system can be achieved, which can better meet actual production needs.

[0125] In an embodiment of the present disclosure, the test evaluation method for a distributed system also includes: training the evaluation model before inputting at least one test result into the evaluation model, wherein the data in the training set, validation set and test set of the training evaluation model are obtained from a normally operating distributed system.

[0126] According to an embodiment of the present disclosure, by obtaining the training set, verification set and test set of the training evaluation model from a normally operating distributed system, the trained evaluation model can more accurately evaluate the distributed system in the actual production environment, and the obtained evaluation results are more accurate.

[0127] The embodiment of the present disclosure divides the target area into zones, generates logical partitions associated with the physical partitions of the distributed system, injects test data into the logical partitions according to the preset test parameters of the logical partitions, and evaluates the test results through the evaluation model to determine whether the distributed system is running normally. In this way, a fast and effective test evaluation of the distributed system can be achieved, effectively avoiding failures of the distributed system in the actual production environment.

[0128] Figure 8 The structure block diagram of the test and evaluation device of the distributed system according to the embodiment of the present disclosure is schematically shown.

[0129] like Figure 8 As shown, the test and evaluation device 800 of the distributed system according to the embodiment of the present disclosure includes a first acquisition module 810 , a first generation module 820 , a second generation module 830 and a second acquisition module 840 .

[0130] The first acquisition module 810 is configured to acquire at least one physical partition of the distributed system in the area to be evaluated. In one embodiment, the first acquisition module 810 is used to perform the operation S210 described above, which will not be described in detail herein.

[0131] The first generation module configuration 820 is to perform logical partitioning for the M node servers in the target area according to at least one physical partition, and generate at least one logical partition, the physical partition is associated with the logical partition, and each logical partition includes at least one preset test parameter, wherein M is an integer greater than 1. In one embodiment, the first generation module 820 is used to perform the operation S220 described above, which will not be repeated here.

[0132] The second generation module 830 is configured to inject test data into at least one logical partition according to at least one preset test parameter to generate at least one test result. In one embodiment, the second generation module 830 is used to perform the operation S230 described above, which will not be described in detail here.

[0133] The second acquisition module 840 is configured to input at least one test result into the evaluation model to obtain the evaluation result of the distributed system in the area to be evaluated, and the evaluation result includes normal operation and abnormal operation. In one embodiment, the second acquisition module 840 is used to perform the operation S240 described above, which will not be repeated here.

[0134] In some exemplary embodiments of the present disclosure, the first generation module includes: a first determination unit, configured to determine the number of logical partitions to be generated according to the number of physical partitions; a second determination unit, configured to determine at least one preset test parameter contained in each logical partition to be generated according to the physical parameters of each physical partition; and a first generation unit, configured to logically partition M node servers according to the number of logical partitions to be generated and at least one preset test parameter contained in each logical partition to be generated, and generate at least one logical partition.

[0135] In some exemplary embodiments of the present disclosure, the physical parameters include a physical distance between physical partitions, and the first generation unit includes a first determination submodule, which is configured to determine a network delay parameter between each logical partition to be generated based on the physical distance between each physical partition.

[0136] In some exemplary embodiments of the present disclosure, the second generation module includes: a third determination unit, configured to determine a test method for test data based on preset test parameters contained in the logical partition; a data injection unit, configured to inject test data into each node server in the logical partition according to the test method; and a second generation unit, configured to obtain test details of each node server in each logical partition, and generate at least one test result for M node servers based on the test details, each test result being associated with the test method for the test data.

[0137] In some exemplary embodiments of the present disclosure, the second generation unit includes: a first acquisition submodule, configured to obtain the initial time and end time of injecting test data into each node server of each logical partition; a second acquisition submodule, configured to obtain data content after the injection of test data into each node server of each logical partition is completed; and a first generation submodule, configured to generate at least one test result based on at least one of the initial time, end time and data content.

[0138] In some exemplary embodiments of the present disclosure, the first generation submodule includes: a test result generation module, and the test result generation module is configured to: generate a time test result based on the initial time and the end time; generate a data volume test result based on the data content; and generate a success rate test result based on the initial time, the end time and the data content.

[0139] In some exemplary embodiments of the present disclosure, the test evaluation device also includes: an analysis module, configured to analyze at least one test result when an evaluation result of the distributed system in the area to be evaluated is an operation abnormality, and determine the logical partition and physical partition associated with the test result that exceeds a set threshold in at least one test result.

[0140] In some exemplary embodiments of the present disclosure, the test evaluation device also includes: a training module, configured to train the evaluation model before inputting the at least one test result into the evaluation model, wherein the data in the training set, validation set and test set of the training evaluation model are obtained from a normally operating distributed system.

[0141] According to an embodiment of the present disclosure, any multiple modules among the first acquisition module 810, the first generation module 820, the second generation module 830, the second acquisition module 840, the first determination unit, the second determination unit, the first generation unit, the first determination submodule, the third determination unit, the data injection unit, the second generation unit, the first acquisition submodule, the second acquisition submodule, the first generation submodule, the test result generation module, the analysis module and the training module can be combined into one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the first acquisition module 810, the first generation module 820, the second generation module 830, the second acquisition module 840, the first determination unit, the second determination unit, the first generation unit, the first determination submodule, the third determination unit, the data injection unit, the second generation unit, the first acquisition submodule, the second acquisition submodule, the first generation submodule, the test result generation module, the analysis module and the training module can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or can be implemented in any one of the three implementation methods of software, hardware and firmware or in an appropriate combination of any of them. Alternatively, at least one of the first acquisition module 810, the first generation module 820, the second generation module 830, the second acquisition module 840, the first determination unit, the second determination unit, the first generation unit, the first determination sub-module, the third determination unit, the data injection unit, the second generation unit, the first acquisition sub-module, the second acquisition sub-module, the first generation sub-module, the test result generation module, the analysis module and the training module can be at least partially implemented as a computer program module, which can perform the corresponding function when the computer program module is executed.

[0142] Fig. 9 A block diagram of an electronic device suitable for implementing a test and evaluation method for a distributed system according to an embodiment of the present disclosure is schematically shown. Fig. 9 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0143] like Fig. 9 As shown, the electronic device 900 according to an embodiment of the present disclosure includes a processor 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage part 908 into a random access memory (RAM) 903. The processor 901 may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a special-purpose microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor 901 may also include an onboard memory for caching purposes. The processor 901 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.

[0144] In RAM 903, various programs and data required for the operation of electronic device 900 are stored. Processor 901, ROM 902 and RAM 903 are connected to each other via bus 904. Processor 901 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 902 and / or RAM 903. It should be noted that the program can also be stored in one or more memories other than ROM 902 and RAM 903. Processor 901 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.

[0145] According to an embodiment of the present disclosure, the electronic device 900 may further include an input / output (I / O) interface 905, which is also connected to the bus 904. The electronic device 900 may further include one or more of the following components connected to the I / O interface 905: an input portion 906 including a keyboard, a mouse, etc.; an output portion 907 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 908 including a hard disk, etc.; and a communication portion 909 including a network interface card such as a LAN card, a modem, etc. The communication portion 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to the I / O interface 905 as needed. A removable medium 911, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 910 as needed, so that a computer program read therefrom is installed into the storage portion 908 as needed.

[0146] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the test evaluation method of the distributed system according to the embodiment of the present disclosure is implemented.

[0147] According to an embodiment of the present disclosure, a computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus or a device. For example, according to an embodiment of the present disclosure, a computer-readable storage medium may include the ROM 902 and / or RAM 903 described above and / or one or more memories other than ROM 902 and RAM 903.

[0148] The embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the test and evaluation method of the distributed system provided by the embodiment of the present disclosure.

[0149] The above functions defined in the system / device of the embodiment of the present disclosure are performed when the computer program is executed by the processor 901. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0150] In one embodiment, the computer program may be based on a tangible storage medium such as an optical storage device, a magnetic storage device, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of a signal on a network medium, and downloaded and installed through the communication part 909, and / or installed from a removable medium 911. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0151] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 909, and / or installed from the removable medium 911. When the computer program is executed by the processor 901, the above functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the system, device, means, module, unit, etc. described above can be implemented by a computer program module.

[0152] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).

[0153] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0154] It will be appreciated by those skilled in the art that the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations and / or combinations are not explicitly described in the present disclosure. In particular, the features described in the various embodiments and / or claims of the present disclosure may be combined and / or combined in a variety of ways without departing from the spirit and teachings of the present disclosure. All of these combinations and / or combinations fall within the scope of the present disclosure.

[0155] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above separately, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. The scope of the present disclosure is defined by the attached claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1. A distributed system test and evaluation method, comprising: Obtain at least one physical partition of the distributed system of the area to be evaluated; Performing logical partitioning for M node servers in the target area according to the at least one physical partition to generate at least one logical partition, wherein the physical partition is associated with the logical partition, and each of the logical partitions includes at least one preset test parameter, wherein M is an integer greater than 1; Injecting test data into the at least one logical partition according to the at least one preset test parameter to generate at least one test result; Inputting the at least one test result into an evaluation model to obtain an evaluation result of the distributed system in the area to be evaluated, wherein the evaluation result includes normal operation and abnormal operation, The step of performing logical partitioning on the M node servers in the target area according to the at least one physical partition to generate at least one logical partition includes: Determining the number of the logical partitions to be generated according to the number of the physical partitions; Determining at least one preset test parameter included in each of the logical partitions to be generated according to the physical parameters of each of the physical partitions; and According to the number of the logical partitions to be generated and at least one preset test parameter contained in each of the logical partitions to be generated, the M node servers are logically partitioned to generate at least one logical partition.

2. The test evaluation method according to claim 1, wherein: The physical parameters include the physical spacing between physical partitions, The step of determining at least one preset test parameter included in each of the logical partitions to be generated according to the physical parameters of each of the physical partitions comprises: According to the physical distance between each of the physical partitions, a network delay parameter between each of the logical partitions to be generated is determined.

3. The test evaluation method according to claim 1, wherein: The injecting test data into the at least one logical partition according to the at least one preset test parameter to generate at least one test result comprises: Determining a test method for test data according to preset test parameters included in the logical partition; Injecting the test data into each node server in the logical partition according to the test method; and The test details of each node server of each logical partition are obtained, and at least one test result for the M node servers is generated according to the test details, wherein each of the test results is associated with a test method of the test data.

4. The test evaluation method according to claim 3, wherein: The obtaining test details of each node server of each logical partition, and generating at least one test result for the M node servers according to the test details, includes: Obtain the initial time and the end time of injecting the test data into each node server of each logical partition; After each node server in each logical partition has completed injecting the test data, obtaining data content; and At least one test result is generated according to at least one of the initial time, the end time, and the data content.

5. The test evaluation method according to claim 4, wherein: The generating at least one test result according to at least one of the initial time, the end time and the data content comprises: Generate a time test result according to the initial time and the end time; Generate a data volume test result according to the data content; and A success rate test result is generated according to the initial time, the end time and the data content.

6. The test evaluation method according to any one of claims 1 to 5, wherein: Also includes: When the evaluation result of the distributed system in the area to be evaluated is abnormal operation, The at least one test result is analyzed to determine the logical partition and the physical partition associated with the test result exceeding a set threshold in the at least one test result.

7. The test evaluation method according to any one of claims 1 to 5, wherein: Also includes: Before inputting the at least one test result into the evaluation model, the evaluation model is trained, wherein data in a training set, a validation set and a test set for training the evaluation model are obtained from a normally operating distributed system.

8. A distributed system test and evaluation device, comprising: A first acquisition module is configured to acquire at least one physical partition of a distributed system in a region to be evaluated; A first generating module is configured to perform logical partitioning for M node servers in a target area according to the at least one physical partition, and generate at least one logical partition, wherein the physical partition is associated with the logical partition, and each of the logical partitions includes at least one preset test parameter, wherein M is an integer greater than 1; A second generating module, configured to inject test data into the at least one logical partition according to the at least one preset test parameter, and generate at least one test result; The second acquisition module is configured to input the at least one test result into the evaluation model to obtain the evaluation result of the distributed system in the area to be evaluated, wherein the evaluation result includes normal operation and abnormal operation. The step of performing logical partitioning on the M node servers in the target area according to the at least one physical partition to generate at least one logical partition includes: Determining the number of the logical partitions to be generated according to the number of the physical partitions; Determining at least one preset test parameter included in each of the logical partitions to be generated according to the physical parameters of each of the physical partitions; and According to the number of the logical partitions to be generated and at least one preset test parameter contained in each of the logical partitions to be generated, the M node servers are logically partitioned to generate at least one logical partition.

9. An electronic device, comprising: one or more processors; A storage device, used for storing executable instructions, wherein when the executable instructions are executed by the processor, the method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium having executable instructions stored thereon, which, when executed by a processor, implement the method according to any one of claims 1 to 7.

11. A computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Method and device for recognizing available partitions, and clustering network system

    CN102594596A

  • Model training method and device, electronic equipment and medium

    CN114091589A