Data cleaning method and device, storage medium, electronic device and program product

Abstract

The embodiment of the invention provides a data cleaning method which comprises the following steps: when data cleaning needs to be carried out on a target disk included in a target server, determining whether a target control card for managing and controlling the disk is integrated in the target server; when a target control card is integrated in the target server and the target control card has a data cleaning function, performing a first data cleaning operation on the target disk by calling the data cleaning function of the target control card; when it is determined that the first data cleaning operation is completed, the configuration mode of the target disk is modified into a JBOD mode, the target server is restarted, a target guide mirror image is mounted, and the target guide mirror image comprises a first tool supporting data cleaning of the target disk; a target tool used for conducting data cleaning on the target disk is determined according to a preset rule and the type of the target disk, second-time data cleaning operation is conducted on the target disk through the target tool, and the first tool comprises the target tool.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of communications, and in particular, to a data cleaning method, device, storage medium, electronic device and program product. Background Art

[0002] Server data cleaning is not only a requirement of technical management, but also the basis for ensuring business security, compliance and efficient operation. Data cleaning methods in related technologies may lead to data leakage due to poor data cleaning effects. Summary of the invention

[0003] Embodiments of the present invention provide a data cleaning method, device, storage medium, electronic device and program product to at least solve the problem of data leakage that may occur due to poor data cleaning effect in data cleaning methods in related technologies.

[0004] According to one embodiment of the present invention, a data cleaning method is provided, comprising: in case it is necessary to perform data cleaning on a target disk included in a target server, determining whether a target control card for managing and controlling the disk is integrated in the target server; in case the target control card is integrated in the target server and the target control card has a data cleaning function, performing a first data cleaning operation on the target disk by calling the data cleaning function of the target control card; in case it is determined that the first data cleaning operation is completed, modifying the configuration mode of the target disk to JBOD mode, restarting the target server and mounting a target boot image, wherein the target boot image includes a first tool that supports data cleaning of the target disk; determining a target tool for data cleaning of the target disk according to the type of the target disk according to a predetermined rule, and performing a second data cleaning operation on the target disk using the target tool, wherein the first tool includes the target tool.

[0005] In an exemplary embodiment, when it is determined that the first data cleanup operation is completed, the configuration mode of the target disk is changed to JBOD mode, the target server is restarted and the target boot image is mounted, including: when it is determined that the first data cleanup operation is completed, determining whether there is uncleared data in the target disk; when it is determined that there is uncleared data, the configuration mode of the target disk is changed to JBOD mode, the target server is restarted and the target boot image is mounted.

[0006] In an exemplary embodiment, after determining whether there is any uncleared data in the target disk when the first data cleaning operation is completed, the method further includes: determining that data cleaning of the target disk is completed when it is determined that there is no uncleared data.

[0007] In an exemplary embodiment, when it is necessary to perform data cleanup on a target disk included in a target server, after determining whether a target control card for managing and controlling the disk is integrated in the target server, the method further includes: when the target control card is not integrated in the target server, modifying the configuration mode of the target disk to JBOD mode, restarting the target server and mounting the target boot image; determining the target tool according to the type of the target disk in accordance with predetermined rules, and using the target tool to perform data cleanup operations on the target disk.

[0008] In an exemplary embodiment, after determining a target tool for performing data cleansing on the target disk according to the type of the target disk in accordance with predetermined rules, and performing a second data cleansing operation on the target disk using the target tool, the method further includes: determining target data for overwriting the target disk, and writing the target data into all storage areas in the target disk; and clearing the target data in the target disk to perform data cleansing on the target disk again.

[0009] In an exemplary embodiment, after determining the target data for covering the target disk and writing the target data into all storage areas in the target disk, the method further includes: determining whether all storage areas are fully covered by the target data; if it is determined that there are storage areas in the target disk that are not fully covered by the target data, writing the target data into the storage areas again until all storage areas are fully covered by the target data.

[0010] According to another embodiment of the present invention, a data cleaning device is provided, comprising: a first determination module, for determining whether a target control card for managing and controlling the disk is integrated in the target server when data cleaning of a target disk included in the target server is required; a cleaning module, for performing a first data cleaning operation on the target disk by calling the data cleaning function of the target control card when the target control card is integrated in the target server and the target control card has a data cleaning function; a first modification module, for modifying the configuration mode of the target disk to JBOD mode, restarting the target server and mounting a target boot image when it is determined that the first data cleaning operation is completed, wherein the target boot image includes a first tool that supports data cleaning of the target disk; a second determination module, for determining a target tool for data cleaning of the target disk according to the type of the target disk in accordance with a predetermined rule, and performing a second data cleaning operation on the target disk using the target tool, wherein the first tool includes the target tool.

[0011] According to yet another embodiment of the present invention, a computer-readable storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the steps of any one of the above method embodiments when run.

[0012] According to yet another embodiment of the present invention, there is provided an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0013] According to yet another embodiment of the present invention, a computer program product is provided. The computer program product includes a computer program. When the computer program is executed by a processor, the steps in any one of the above method embodiments are implemented.

[0014] Through the present invention, since the target control card is integrated in the target server, the data cleaning function of the target control card is first used to clean the data, and then the cleaning tool is determined according to the type of disk, so as to perform secondary cleaning. Therefore, the problem of data leakage caused by poor data cleaning effect in the data cleaning method in the related art can be solved, thereby achieving the effect of improving data security. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 is a hardware structure block diagram of a mobile terminal according to a data cleaning method according to an embodiment of the present invention;

[0016] Figure 2The process of the data cleaning method according to the embodiment of the present invention is as follows: Figure 1 ;

[0017] Figure 3 The process of the data cleaning method according to the embodiment of the present invention is as follows: Figure 2 ;

[0018] Figure 4 It is a structural block diagram of a data cleaning device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0019] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings and in combination with the embodiments.

[0020] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0021] The method embodiments provided in the embodiments of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking running on a mobile terminal as an example, Figure 1 is a hardware structure block diagram of a mobile terminal according to a data cleaning method according to an embodiment of the present invention. Figure 1 As shown, the mobile terminal may include one or more ( Figure 1 Only one is shown in the figure) a processor 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, wherein the mobile terminal may also include a transmission device 106 and an input / output device 108 for communication functions. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the mobile terminal. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.

[0022] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the data cleaning method in the embodiment of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the mobile terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0023] The transmission device 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0024] In this embodiment, a data cleaning method running on the above mobile terminal is provided. Figure 2 The process of the data cleaning method according to the embodiment of the present invention is as follows: Figure 1 ,like Figure 2 As shown, the process includes the following steps:

[0025] Step S202, when it is necessary to clean up data on a target disk included in a target server, determining whether a target control card for managing and controlling the disk is integrated in the target server;

[0026] Step S204, when the target server is integrated with the target control card and the target control card has a data cleaning function, performing a first data cleaning operation on the target disk by calling the data cleaning function of the target control card;

[0027] Step S206, when it is determined that the first data cleaning operation is completed, modifying the configuration mode of the target disk to the JBOD mode, restarting the target server and mounting the target boot image, wherein the target boot image includes a first tool that supports data cleaning of the target disk;

[0028] Step S208, determining a target tool for cleaning data on the target disk according to the type of the target disk in accordance with a predetermined rule, and performing a second data cleaning operation on the target disk using the target tool, wherein the first tool includes the target tool.

[0029] In the above steps, the target control card includes but is not limited to: H3C storage control card, RAID control card, etc., and the target disk includes but is not limited to: solid state drive SSD (for example,

[0030] nvme SSD, SATA SSD), mechanical hard disk HDD, etc. Before step S202, the method further includes: restarting the target server. Exemplarily, the target boot image includes but is not limited to: a boot image of CentOS7.7 or above containing hdparm and nvme-cli. Exemplarily, before step S208, the method further includes: determining the type of the target disk in the following manner: executing the lsblk–d–o name,rata command, and when the returned result is 1, determining that the type of the target disk is HDD, and when the returned result is 0, determining that the type of the target disk is SSD; executing the nvmelist command, and when a result is returned, it indicates that an nvme device exists.

[0031] Exemplarily, when the target control card is a RAID control card, performing the first data cleanup operation on the target disk by calling the data cleanup function of the target control card includes but is not limited to: entering the data erase option of the management interface of the RAID control card, selecting the Normal mode, and setting the target disk to be erased three times in the Normal mode.

[0032] In the above steps, when the target control card is integrated in the target server, the data cleaning function of the target control card is first used to clean the data, and then the cleaning tool is determined according to the type of disk, so as to perform secondary cleaning. This solves the problem of data leakage caused by poor data cleaning effect in the data cleaning method in the related technology, thereby improving data security.

[0033] The execution subject of the above steps may be a server, etc., but is not limited thereto.

[0034] In an optional embodiment, when it is determined that the first data cleanup operation is completed, the configuration mode of the target disk is changed to JBOD mode, the target server is restarted and the target boot image is mounted, including: when it is determined that the first data cleanup operation is completed, determining whether there is uncleared data in the target disk; when it is determined that there is uncleared data, the configuration mode of the target disk is changed to JBOD mode, the target server is restarted and the target boot image is mounted.

[0035] In the above steps, determining whether there is uncleared data in the target disk includes but is not limited to: Method 1, entering the array card configuration interface, checking the hard disk list status, when the hard disk status is "Unconfigured Good", determining that no RAID is configured on the hard disk and the data has been cleared, and when the hard disk status is not "Unconfigured Good", determining that there may be uncleared data; Method 2, checking the SMART (Self-Monitoring, Analysis and Reporting Technology) status of the hard disk, when the SMART data shows that the hard disk has an abnormality or has a large number of read and write operations, determining that there may be uncleared data; Method 3, scanning the hard disk through data recovery software, when the software can scan the previously stored data, determining that there may be uncleared data.

[0036] In an optional embodiment, after determining whether there is any uncleared data in the target disk when determining that the first data cleaning operation is completed, the method further includes: determining that data cleaning of the target disk is completed when determining that there is no uncleared data.

[0037] In an optional embodiment, when it is necessary to perform data cleanup on a target disk included in a target server, after determining whether a target control card for managing and controlling the disk is integrated in the target server, the method further includes: when the target control card is not integrated in the target server, modifying the configuration mode of the target disk to JBOD mode, restarting the target server and mounting the target boot image; determining the target tool according to the type of the target disk in accordance with predetermined rules, and using the target tool to perform data cleanup operations on the target disk.

[0038] In the above steps, by restarting the server and mounting the target boot image, data cleaning can be performed directly at the operating system level, avoiding complex hardware operations and improving the efficiency of data cleaning.

[0039] In an optional embodiment, after determining a target tool for performing data cleansing on the target disk according to the type of the target disk in accordance with predetermined rules, and performing a second data cleansing operation on the target disk using the target tool, the method further includes: determining target data for overwriting the target disk, and writing the target data into all storage areas in the target disk; and clearing the target data in the target disk to perform data cleansing on the target disk again.

[0040] In the above steps, exemplarily, the method also includes: using the dd command to perform full disk overwriting and cleaning of the target disk in the following manner: identifying the type of disk, for example, identifying the target disk as a SATA HDD through the server's BIOS or disk management tool; selecting a tool, for example, selecting a hard disk erasing tool that supports the SATA interface; cleaning, using DBAN to start the server, selecting the "Quick Erase" option, and quickly erasing the hard disk; selecting overwrite data, for example, using all-0 data as overwrite data; writing overwrite data, for example, using the dd command to write all-0 data to the entire hard disk; clearing the overwrite data, for example, using DBAN to erase the hard disk again, or using other tools to ensure that all-0 data is cleared.

[0041] In the above steps, by writing the target data to the entire storage area of ​​the target disk and then clearing the data, it can be ensured that all space on the disk is overwritten, thereby completely erasing the original data.

[0042] In an optional embodiment, after determining the target data for covering the target disk and writing the target data into all storage areas in the target disk, the method further includes: determining whether all storage areas are fully covered by the target data; if it is determined that there are storage areas in the target disk that are not fully covered by the target data, writing the target data into the storage areas again until all storage areas are fully covered by the target data.

[0043] The following is a collection of specific embodiments to illustrate the solutions in this application:

[0044] Figure 3 The process of the data cleaning method according to the embodiment of the present invention is as follows: Figure 2 ,like Figure 3 As shown, the process includes the following steps:

[0045] Step S302, determine whether a RAID card is integrated, if yes, execute step S304, if no, jump to step S306;

[0046] Step S304, cleaning the data of the target disk by using the data cleaning function of the RAID card;

[0047] Step S306, changing the management mode of the target disk to a pass-through mode;

[0048] Step S308, determining whether the target disk includes an nvme SSD hard disk, if yes, executing step S310, if no, jumping to step S312;

[0049] Step S310, cleaning the nvme SSD hard disk;

[0050] Step S312, determining whether the target disk includes a SATA SSD hard disk. If yes, executing step S314; if no, jumping to step S316;

[0051] Step S314, cleaning the SATA SSD hard disk;

[0052] Step S316, performing dd overwriting and cleaning on the target disk.

[0053] In the above steps, when determining the disk type included in the target disk, the order is not limited.

[0054] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0055] In this embodiment, a data cleaning device is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0056] Figure 4 is a structural block diagram of a data cleaning device according to an embodiment of the present invention. Figure 4As shown, the device includes: a first determination module 42, which is used to determine whether a target control card for managing and controlling the disk is integrated in the target server when data cleaning of the target disk included in the target server is required; a cleaning module 44, which is used to perform a first data cleaning operation on the target disk by calling the data cleaning function of the target control card when the target control card is integrated in the target server and the target control card has a data cleaning function; a first modification module 46, which is used to modify the configuration mode of the target disk to JBOD mode, restart the target server and mount the target boot image when it is determined that the first data cleaning operation is completed, wherein the target boot image includes a first tool that supports data cleaning of the target disk; a second determination module 48, which is used to determine a target tool for data cleaning of the target disk according to the type of the target disk according to a predetermined rule, and perform a second data cleaning operation on the target disk using the target tool, wherein the first tool includes the target tool.

[0057] In an optional embodiment, the first modification module 46 includes: a first determination unit, used to determine whether there is uncleared data in the target disk when it is determined that the first data cleaning operation is completed; a second determination unit, used to modify the configuration mode of the target disk to JBOD mode, restart the target server and mount the target boot image when it is determined that there is uncleared data.

[0058] In an optional embodiment, the device also includes: a third determination module, which is used to determine whether there is any uncleared data in the target disk after determining that the first data cleaning operation is completed, and if it is determined that there is no uncleared data, determine that the data cleaning of the target disk has been completed.

[0059] In an optional embodiment, the device also includes: a second modification module, which is used to determine whether a target control card for managing and controlling the disk is integrated in the target server when data cleaning of the target disk included in the target server is required. If the target control card is not integrated in the target server, the configuration mode of the target disk is modified to JBOD mode, the target server is restarted and the target boot image is mounted; a fourth determination module, which is used to determine the target tool according to the type of the target disk according to predetermined rules, and use the target tool to perform data cleaning operations on the target disk.

[0060] In an optional embodiment, the device also includes: a fifth determination module, which is used to determine the target tool for performing data cleansing on the target disk according to the type of the target disk in accordance with predetermined rules, and after using the target tool to perform a second data cleansing operation on the target disk, determine the target data for overwriting the target disk and write the target data to all storage areas in the target disk; and a clearing module, which is used to clear the target data in the target disk to perform data cleansing on the target disk again.

[0061] In an optional embodiment, the device also includes: a sixth determination module, which is used to determine whether all storage areas are fully covered by the target data after determining the target data for covering the target disk and writing the target data into all storage areas in the target disk; and a writing module, which is used to write the target data into the storage area again until all storage areas are fully covered by the target data when it is determined that there are storage areas in the target disk that are not fully covered by the target data.

[0062] It should be noted that the above modules can be implemented by software or hardware. For the latter, it can be implemented in the following ways, but not limited to: the above modules are all located in the same processor; or the above modules are located in different processors in any combination.

[0063] An embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above method embodiments when running.

[0064] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk.

[0065] An embodiment of the present invention further provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0066] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0067] An embodiment of the present invention further provides a computer program product, the computer program product comprising a computer program, and when the computer program is executed by a processor, the steps in any one of the above method embodiments are implemented.

[0068] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail herein.

[0069] Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order than here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0070] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A data cleaning method, characterized in that: include: In the case where data cleaning is required for a target disk included in a target server, determining whether a target control card for managing and controlling the disk is integrated in the target server; In a case where the target control card is integrated in the target server and the target control card has a data cleaning function, performing a first data cleaning operation on the target disk by calling the data cleaning function of the target control card; When it is determined that the first data cleaning operation is completed, the configuration mode of the target disk is changed to JBOD mode, the target server is restarted and a target boot image is mounted, wherein the target boot image includes a first tool that supports data cleaning of the target disk; A target tool for cleaning data on the target disk is determined according to a predetermined rule based on the type of the target disk, and a second data cleaning operation is performed on the target disk using the target tool, wherein the first tool includes the target tool.

2. The method according to claim 1, characterized in that When it is determined that the first data cleaning operation is completed, changing the configuration mode of the target disk to the JBOD mode, restarting the target server and mounting the target boot image includes: In the case of determining that the first data cleaning operation is completed, determining whether there is uncleared data in the target disk; When it is determined that there is uncleared data, the configuration mode of the target disk is changed to JBOD mode, the target server is restarted, and the target boot image is mounted.

3. The method according to claim 2, characterized in that In the case of determining that the first data cleaning operation is completed, after determining whether there is uncleared data in the target disk, the method further includes: When it is determined that there is no uncleared data, it is determined that data clearing of the target disk is completed.

4. The method according to claim 1, characterized in that In the case where data cleaning is required for a target disk included in a target server, after determining whether a target control card for managing and controlling the disk is integrated in the target server, the method further includes: In the case where the target control card is not integrated in the target server, the configuration mode of the target disk is changed to JBOD mode, the target server is restarted and the target boot image is mounted; The target tool is determined according to a predetermined rule based on the type of the target disk, and the target tool is used to perform a data cleaning operation on the target disk.

5. The method according to claim 1, characterized in that After determining a target tool for performing data cleaning on the target disk according to the type of the target disk in accordance with a predetermined rule, and performing a second data cleaning operation on the target disk using the target tool, the method further includes: Determining target data for overwriting the target disk, and writing the target data into all storage areas in the target disk; The target data in the target disk is cleared to perform data cleaning on the target disk again.

6. The method according to claim 1, characterized in that After determining the target data for overwriting the target disk and writing the target data into all storage areas in the target disk, the method further includes: Determining whether all storage areas are fully covered by the target data; When it is determined that there are storage areas in the target disk that are not fully covered by the target data, the target data is written into the storage areas again until all the storage areas are fully covered by the target data.

7. A data cleaning device, characterized in that: include: A first determination module is used to determine whether a target control card for managing and controlling the disk is integrated in the target server when data cleaning of the target disk included in the target server is required; a cleaning module, configured to perform a first data cleaning operation on the target disk by calling the data cleaning function of the target control card when the target control card is integrated in the target server and the target control card has a data cleaning function; a first modification module, configured to modify the configuration mode of the target disk to the JBOD mode, restart the target server and mount a target boot image when determining that the first data cleaning operation is completed, wherein the target boot image includes a first tool that supports data cleaning of the target disk; The second determination module is used to determine a target tool for cleaning data on the target disk according to the type of the target disk in accordance with a predetermined rule, and perform a second data cleaning operation on the target disk using the target tool, wherein the first tool includes the target tool.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program implements the steps of the method described in any one of claims 1 to 6 when executed by a processor.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method described in any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method described in any one of claims 1 to 6 are implemented.

Images