A data correction method, system, device, and storage medium

Abstract

The present application discloses a data correction method, system, device and storage medium to solve the technical problem that the existing IP address change needs to rely on manual work, which leads to low efficiency and easy errors. The method includes: collecting the IP address segment that needs to be changed this time and the BMC username and password of the server input by the user; integrating the IP address segment and the BMC username and password of the server to establish a corresponding data correction task; generating a data analysis model, and processing the change information of the historically changed IP address segment through the data analysis model to generate a correspondence between the historically changed IP address segment and the original IP address segment; in the data correction task, based on the corresponding relationship, rewrite the IP address segment that needs to be changed this time input by the user to the latest IP address segment. The embodiment of the present application can improve the efficiency of data modification as a whole, improve the accuracy of data correction, and enhance the user experience.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a data correction method, system, device and storage medium. Background Art

[0002] In the era of cloud computing, servers have developed rapidly. With the large-scale construction of data centers, a lot of challenges have also been brought. With the increasingly large-scale server clusters and the unified integration of customer resources, after the initial network planning is determined, the equipment is uniformly managed on a unified platform, and the entire operation and maintenance is not a problem. However, with the expansion of business or due to unreasonable division of network resources, customers often need to re-allocate IP addresses for these large numbers of devices.

[0003] However, the physical infrastructure management platform collects and monitors device data based on IP addresses. After the IP address of a device is changed, it often brings a problem that the operation and maintenance engineers need to modify the IP address of each device one by one. This work requires a lot of manpower and material resources to inventory assets and generate a corresponding table of IP and devices for data modification. In addition, batch modification is often not possible, which is inefficient and prone to errors. Summary of the invention

[0004] The embodiments of the present application provide a data correction method, system, device and storage medium to solve the technical problem that the existing IP address change needs to rely on manual work, which leads to low efficiency and prone to errors.

[0005] On the one hand, an embodiment of the present application provides a data correction method, the method comprising:

[0006] Collect the IP address segment that needs to be changed this time and the server's BMC user name and password entered by the user;

[0007] Integrate the IP address segment and the BMC user name and password of the server to establish a corresponding data correction task;

[0008] Generate a data analysis model, and process the change information of the historically changed IP address segments through the data analysis model to generate a corresponding relationship between the historically changed IP address segments and the original IP address segments;

[0009] In the data correction task, based on the corresponding relationship, the IP address segment that needs to be changed this time and input by the user is rewritten as the latest IP address segment.

[0010] In one implementation of the present application, after integrating the IP address segment and the BMC user name and password of the server to establish a corresponding data correction task, the method further includes:

[0011] Split the IP address segment and capture the asset information corresponding to the server; wherein the asset information includes: manufacturer, model, motherboard number, CPU, memory, network card, and disk;

[0012] Inputting the asset information into the data analysis model for training;

[0013] Based on the trained data analysis model, the corresponding relationship is extracted.

[0014] In one implementation of the present application, the training process of the data analysis model is:

[0015] Create files for each item of asset information of all users to be changed according to part number, serial number and quantity;

[0016] Expanding the asset information of the historical equipment that has completed the data change in the archive, and grouping the archive;

[0017] Calculate the weighted value of each asset information in the grouped archives to generate a similarity score, and select the device corresponding to the highest similarity score in each group of archives as the target device;

[0018] The corresponding relationship of the target device is extracted.

[0019] In an implementation of the present application, after extracting the corresponding relationship of the target device, the method further includes:

[0020] Select multiple groups of IP address segments before and after the server change;

[0021] Verifying whether the corresponding relationship is correct;

[0022] If correct, the training of the data analysis model is completed; if wrong, the training process is repeated.

[0023] In one implementation of the present application, after splitting the IP address segment and capturing the asset information corresponding to the server, the method further includes:

[0024] Clean invalid asset information data; wherein, the invalid asset information data includes: asset information data that failed to be collected and data with incorrect IP addresses.

[0025] The present application provides a data correction system, the system comprising:

[0026] The collection module is used to collect the IP address segment that needs to be changed this time and the BMC user name and password of the server input by the user;

[0027] An integration module, used for integrating the IP address segment and the BMC user name and password of the server to establish a corresponding data correction task;

[0028] A correspondence extraction module, used to generate a data analysis model, and process the change information of the historically changed IP address segment through the data analysis model to generate a correspondence between the historically changed IP address segment and the original IP address segment;

[0029] The IP rewriting module is used to rewrite the IP address segment that needs to be changed this time and input by the user into the latest IP address segment based on the corresponding relationship in the data correction task.

[0030] In one implementation of the present application, the system also includes: an asset information capture module, which is used to split the IP address segment to capture the asset information corresponding to the server; wherein the asset information includes: manufacturer, model, motherboard number, CPU, memory, network card, and disk.

[0031] In one implementation of the present application, the correspondence extraction module includes: a data analysis model training submodule, which is used to train the data analysis model.

[0032] The present application provides a data correction device, the device comprising:

[0033] at least one processor; and,

[0034] a memory communicatively connected to the at least one processor; wherein,

[0035] The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to:

[0036] Collect the IP address segment that needs to be changed this time and the server's BMC user name and password entered by the user;

[0037] Integrate the IP address segment and the BMC user name and password of the server to establish a corresponding data correction task;

[0038] Generate a data analysis model, and process the change information of the historically changed IP address segments through the data analysis model to generate a corresponding relationship between the historically changed IP address segments and the original IP address segments;

[0039] In the data correction task, based on the corresponding relationship, the IP address segment that needs to be changed this time and input by the user is rewritten as the latest IP address segment.

[0040] The embodiment of the present application provides a non-volatile computer storage medium for data correction, which stores computer executable instructions, and the computer executable instructions are configured as follows:

[0041] Collect the IP address segment that needs to be changed this time and the server's BMC user name and password entered by the user;

[0042] Integrate the IP address segment and the BMC user name and password of the server to establish a corresponding data correction task;

[0043] Generate a data analysis model, and process the change information of the historically changed IP address segments through the data analysis model to generate a corresponding relationship between the historically changed IP address segments and the original IP address segments;

[0044] In the data correction task, based on the corresponding relationship, the IP address segment that needs to be changed this time and input by the user is rewritten as the latest IP address segment.

[0045] The embodiments of the present application provide a data correction method, system, device and storage medium, which automatically analyze and extract corresponding relationships by setting an algorithm, and automatically find the optimal solution to modify the IP address. There is no need to invest a lot of manpower, and there is no need for human intervention. By establishing a model, batch modification of data is automatically performed, which solves the problem that operation and maintenance engineers need to modify the equipment one by one, which is prone to errors and low work efficiency. The method provided in the embodiments of the present application can improve the efficiency of data modification as a whole and enhance the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0047] Figure 1 A flow chart of a data correction method provided in an embodiment of the present application;

[0048] Figure 2 A structural diagram of a data correction system provided in an embodiment of the present application;

[0049] Figure 3 A schematic diagram of a data correction device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0051] The embodiments of the present application provide a data correction method, system, device and storage medium to solve the technical problem that the existing IP address change needs to rely on manual work, which leads to low efficiency and prone to errors.

[0052] The technical solution proposed in the embodiments of the present application is described in detail below with reference to the accompanying drawings.

[0053] Figure 1 A flow chart of a data correction method provided in an embodiment of the present application. Figure 1 As shown, the method mainly includes the following steps.

[0054] Step 101: Collect the IP address segment that needs to be changed this time and the BMC user name and password of the server input by the user.

[0055] In the embodiment of the present application, when each user needs to change the IP address segment, he edits the changed IP address segment and the username and password of his server and sends them to the system. Both the IP address segment before the change and the IP address segment after the change should be sent.

[0056] Step 102: Integrate the IP address segment and the BMC user name and password of the server to establish a corresponding data correction task.

[0057] In the embodiment of the present application, the system integrates the IP address segment sent by each user and the user name and password corresponding to the server BMC. Then a data correction task is established, which includes the IP address segment change requirements of multiple users. It should be noted that the time or the number of users can be set, such as setting the time to modify the data of all changed users within one month. Or when the number of users reaches 1,000, the data is modified uniformly.

[0058] In an embodiment of the present application, after establishing the corresponding data correction task, the IP address segment is split and the asset information corresponding to the server is captured, wherein the asset information of the server includes: manufacturer, model, motherboard number, CPU, memory, network card, and disk; the asset information is then input into the data analysis model for training; and then based on the trained data analysis model, the corresponding relationship is extracted.

[0059] Furthermore, after capturing the asset information corresponding to the server, the method further includes: cleaning invalid asset information data; wherein the invalid asset information data includes: asset information data that failed to be collected and data with an incorrect IP address.

[0060] Step 103: Generate a data analysis model, and process the change information of the historically changed IP address segments through the data analysis model to generate a corresponding relationship between the historically changed IP address segments and the original IP address segments.

[0061] In an embodiment of the present application, first, each item of asset information of all users to be changed is archived according to part number, serial number and quantity; the asset information of historical devices that have completed data changes is expanded in the archive, and the archive is grouped; then, the weighted value of each asset information in the grouped archive is calculated to generate a similarity score, and the device corresponding to the highest similarity score in each group of archives is selected as the target device; finally, the corresponding relationship of the target device is extracted.

[0062] It should be noted that because many devices in the data center are very similar, we cannot arbitrarily determine whether they correspond based on the size of the value. We should look for a similarity with an overall maximum value based on this batch of changed IPs.

[0063] In the embodiment of the present application, a greedy algorithm is used to perform recursive optimization to find the optimal corresponding relationship. The collection set of historical asset messages is: {A1, A2, A3, ... An}, and the hardware weight ratio is: (1) A1 CPU [quantity N accounts for 5%, model M accounts for 5%, part number K accounts for 30%], A1 memory [quantity N accounts for 5%, model M accounts for 5%, capacity C5%, serial number K accounts for 30%], A1 fan [quantity N accounts for 5%, model M accounts for 5%, slot S accounts for 5%], A1 disk [quantity N accounts for 5%, serial number M accounts for 5%, capacity S accounts for 5%]... The historical device change IP value set is: {A1cpu (N+M+K) + A1 memory (N+M+C+K) + A1 fan (N+M+ S)+…, A2cpu(N+M+K)+A2memory(N+M+C+K)+A2fan(N+M+S)+…, Ancpu(N+M+K)+Anmemory(N+M+C+K)+Anfan(N+M+S)+…}, the above sets are identified by characters. Assuming that there are N changed devices and M historical devices, M sets are calculated by comparing with historical data: N1={S1, S2, S3…Sm}; N2={S1, S2, S3…Sm}; N3={S1, S2, S3…Sm}…Nn={S1, S2, S3…Sm}.

[0064] The threshold method for triggering whether the new and old groups of devices are the same device is as follows: assuming that there are 10,000 devices, of which 2,000 have changed IP addresses, find the relationship between the 2,000 devices before and after the change, and determine whether the serial numbers of the two groups of devices are unique. If they are unique, it is determined that the two devices correspond one to one. If they are not unique, it means that the serial numbers are repeated.

[0065] According to the greedy recursion in each set from N1 to Nn, the maximum value data is selected. There may be multiple maximum values ​​in each set, and once a data is selected, it cannot be selected in other sets. For example, if N1 selects S2, the subsequent device cannot select S2 again, because S2 has found the corresponding device, and then N2 selects the maximum value, and so on, until the selection is completed. However, the data selected each time is different, and the final results are also different. The greedy algorithm can be used to select data, and a group of data with the largest sum of all data is selected, and the optimal solution or better solution of the device correspondence relationship is found.

[0066] Furthermore, after extracting the correspondence of the target device, the correctness of the correspondence must be verified. First, multiple groups of IP address segments before and after the server change are selected; second, verify whether the correspondence is correct; if correct, complete the training of the data analysis model; if wrong, repeat the training process.

[0067] Step 104: In the data correction task, based on the corresponding relationship, the IP address segment that needs to be changed this time and input by the user is rewritten as the latest IP address segment.

[0068] The above is a data correction method provided by an embodiment of the present application. Based on the same inventive concept, an embodiment of the present application also provides a data correction system, such as Figure 2 As shown, Figure 2 A data correction system structure diagram provided in an embodiment of the present application. Figure 2 In the invention, the system mainly includes the following structure.

[0069] The collection module 201 is used to collect the IP address segment that needs to be changed this time and the BMC user name and password of the server input by the user;

[0070] An integration module 202, for integrating the IP address segment and the BMC user name and password of the server to establish a corresponding data correction task;

[0071] A correspondence extraction module 203 is used to generate a data analysis model, and to process the change information of the historically changed IP address segments through the data analysis model to generate a correspondence between the historically changed IP address segments and the original IP address segments;

[0072] The IP rewriting module 204 is used to rewrite the IP address segment that needs to be changed this time and input by the user into the latest IP address segment based on the corresponding relationship in the data correction task.

[0073] In one embodiment of the present application, an asset information capture module is used to split the IP address segment to capture the asset information corresponding to the server; wherein the asset information includes: manufacturer, model, motherboard number, CPU, memory, network card, and disk.

[0074] In one embodiment of the present application, the correspondence extraction module includes: a data analysis model training submodule, which is used to train the data analysis model.

[0075] The data correction method and system provided in the embodiment of the present application automatically analyze and extract the corresponding relationship by setting an algorithm, and automatically find the optimal solution to modify the IP address. There is no need to invest a lot of manpower, and there is no need for human intervention. By establishing a model, batch modification of data is automatically performed, which solves the problem that operation and maintenance engineers need to modify the equipment one by one, which is easy to cause errors and low work efficiency. The method provided in the embodiment of the present application can improve the efficiency of data modification as a whole and enhance the user experience.

[0076] The above is a data correction method provided by an embodiment of the present application. Based on the same inventive concept, an embodiment of the present application also provides a data correction device. Figure 3 A schematic diagram of a data correction device provided in an embodiment of the present application is shown in FIG. Figure 3 As shown, the device mainly includes: at least one processor 301; and a memory 302 connected to the at least one processor in communication; wherein the memory 302 stores instructions that can be executed by the at least one processor 301, and the instructions are executed by the at least one processor 301, so that the at least one processor 301 can complete: collecting the IP address segment that needs to be changed this time and the BMC user name and password of the server input by the user;

[0077] Integrate the IP address segment and the BMC user name and password of the server to establish a corresponding data correction task;

[0078] Generate a data analysis model, and process the change information of the historically changed IP address segments through the data analysis model to generate a corresponding relationship between the historically changed IP address segments and the original IP address segments;

[0079] In the data correction task, based on the corresponding relationship, the IP address segment that needs to be changed this time and input by the user is rewritten as the latest IP address segment.

[0080] In addition, the embodiment of the present application further provides a non-volatile computer storage medium for data correction, storing computer executable instructions, wherein the computer executable instructions are configured to: collect the IP address segment to be changed this time and the BMC user name and password of the server input by the user;

[0081] Integrate the IP address segment and the BMC user name and password of the server to establish a corresponding data correction task;

[0082] Generate a data analysis model, and process the change information of the historically changed IP address segments through the data analysis model to generate a corresponding relationship between the historically changed IP address segments and the original IP address segments;

[0083] In the data correction task, based on the corresponding relationship, the IP address segment that needs to be changed this time and input by the user is rewritten as the latest IP address segment.

[0084] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0085] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0086] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0087] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0088] Each embodiment in this application is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0089] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0090] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A data correction method, characterized in that: The method comprises: Collect the IP address segment that needs to be changed this time and the server's BMC user name and password entered by the user; Integrate the IP address segment and the BMC user name and password of the server to establish a corresponding data correction task; Generate a data analysis model, and process the change information of the historically changed IP address segment through the data analysis model to generate a correspondence between the historically changed IP address segment and the original IP address segment; the process of generating the data analysis model includes: splitting the IP address segment and capturing the asset information corresponding to the server; wherein the asset information includes: manufacturer, model, motherboard number, CPU, memory, network card, disk; inputting the asset information into the data analysis model for training; and extracting the correspondence based on the trained data analysis model; In the data correction task, based on the corresponding relationship, the IP address segment that needs to be changed this time and input by the user is rewritten as the latest IP address segment.

2. A data correction method according to claim 1, characterized in that: The training process of the data analysis model is as follows: Create files for each item of asset information of all users to be changed according to part number, serial number and quantity; Expanding the asset information of the historical equipment that has completed the data change in the archive, and grouping the archive; Calculate the weighted value of each asset information in the grouped archives to generate a similarity score, and select the device corresponding to the highest similarity score in each group of archives as the target device; The corresponding relationship of the target device is extracted.

3. A data correction method according to claim 2, characterized in that: After extracting the corresponding relationship of the target device, the method further includes: Select multiple groups of IP address segments before and after the server change; Verifying whether the corresponding relationship is correct; If correct, the training of the data analysis model is completed; if wrong, the training process is repeated.

4. A data correction method according to claim 1, characterized in that: After splitting the IP address segment and capturing the asset information corresponding to the server, the method further includes: Clean invalid asset information data; wherein, the invalid asset information data includes: asset information data that failed to be collected and data with incorrect IP addresses.

5. A data correction system, characterized in that: The system comprises: The collection module is used to collect the IP address segment that needs to be changed this time and the BMC user name and password of the server input by the user; An integration module, used for integrating the IP address segment and the BMC user name and password of the server to establish a corresponding data correction task; A corresponding relationship extraction module is used to generate a data analysis model, and process the change information of the historically changed IP address segment through the data analysis model to generate a corresponding relationship between the historically changed IP address segment and the original IP address segment; the process of generating the data analysis model includes: splitting the IP address segment and capturing the asset information corresponding to the server; wherein the asset information includes: manufacturer, model, motherboard number, CPU, memory, network card, disk; inputting the asset information into the data analysis model for training; extracting the corresponding relationship based on the trained data analysis model; The IP rewriting module is used to rewrite the IP address segment that needs to be changed this time and input by the user into the latest IP address segment based on the corresponding relationship in the data correction task.

6. A data correction system according to claim 5, characterized in that: The system also includes: an asset information capture module, which is used to split the IP address segment to capture the asset information corresponding to the server; wherein the asset information includes: manufacturer, model, motherboard number, CPU, memory, network card, and disk.

7. A data correction system according to claim 5, characterized in that: The corresponding relationship extraction module includes: a data analysis model training submodule, which is used to train the data analysis model.

8. A data correction device, characterized in that: The device comprises: at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to: Collect the IP address segment that needs to be changed this time and the server's BMC user name and password entered by the user; Integrate the IP address segment and the BMC user name and password of the server to establish a corresponding data correction task; Generate a data analysis model, and process the change information of the historically changed IP address segment through the data analysis model to generate a correspondence between the historically changed IP address segment and the original IP address segment; the process of generating the data analysis model includes: splitting the IP address segment and capturing the asset information corresponding to the server; wherein the asset information includes: manufacturer, model, motherboard number, CPU, memory, network card, disk; inputting the asset information into the data analysis model for training; and extracting the correspondence based on the trained data analysis model; In the data correction task, based on the corresponding relationship, the IP address segment that needs to be changed this time and input by the user is rewritten as the latest IP address segment.

9. A data corrected non-volatile computer storage medium storing computer executable instructions, characterized in that: The computer executable instructions are configured to: Collect the IP address segment that needs to be changed this time and the server's BMC user name and password entered by the user; Integrate the IP address segment and the BMC user name and password of the server to establish a corresponding data correction task; Generate a data analysis model, and process the change information of the historically changed IP address segments through the data analysis model to generate a corresponding relationship between the historically changed IP address segments and the original IP address segments; The process of generating a data analysis model includes: splitting the IP address segment and capturing asset information corresponding to the server; wherein the asset information includes: manufacturer, model, motherboard number, CPU, memory, network card, and disk; inputting the asset information into the data analysis model for training; and extracting the corresponding relationship based on the trained data analysis model; In the data correction task, based on the corresponding relationship, the IP address segment that needs to be changed this time and input by the user is rewritten as the latest IP address segment.

Images