Data cleaning method and device, storage medium, electronic device and program product

Abstract

The embodiment of the present application provides a data cleaning method, comprising: when data cleaning is needed for a target disk included in a target server, determining whether a target control card for controlling the disk is integrated in the target server; when the target control card is integrated in the target server and the target control card has a data cleaning function, performing a first data cleaning operation on the target disk by calling the data cleaning function of the target control card; when it is determined that the first data cleaning operation is completed, modifying a configuration mode of the target disk to a JBOD mode, restarting the target server and mounting a target boot image, wherein the target boot image includes a first tool supporting data cleaning of the target disk; determining a target tool for data cleaning of the target disk according to a kind of the target disk according to a predetermined rule, and performing a second data cleaning operation on the target disk by using the target tool, wherein the first tool includes the target tool.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the field of communications, and in particular, to a data cleaning method and device, a storage medium, an electronic device, and a program product. BACKGROUND

[0002] Data cleaning of a server is not only a need of technical management, but also a basis for ensuring safe, compliant, and efficient operation of a business. The data cleaning method in the related art may lead to data leakage due to poor data cleaning effect. SUMMARY

[0003] Embodiments of the present application provide a data cleaning method, device, storage medium, electronic device, and program product to at least solve the problem of data leakage that may be caused by the poor data cleaning effect of the data cleaning method in the related art.

[0004] According to an embodiment of the present application, a data cleaning method is provided, including: in the case that data cleaning needs to be performed on a target disk included in a target server, determining whether a target control card for controlling a disk is integrated in the target server; in the case that the target control card is integrated in the target server and the target control card has a data cleaning function, performing a first data cleaning operation on the target disk by invoking the data cleaning function of the target control card; in the case that it is determined that the first data cleaning operation is completed, modifying a configuration mode of the target disk to a JBOD mode, restarting the target server, and mounting a target boot image, wherein the target boot image includes a first tool supporting data cleaning of the target disk; determining a target tool for data cleaning of the target disk according to a type of the target disk according to a predetermined rule, and performing a second data cleaning operation on the target disk by using the target tool, wherein the first tool includes the target tool.

[0005] In one exemplary embodiment, in the case that it is determined that the first data cleaning operation is completed, modifying the configuration mode of the target disk to the JBOD mode, restarting the target server, and mounting the target boot image include: in the case that it is determined that the first data cleaning operation is completed, determining whether there is uncleaned data in the target disk; in the case that it is determined that there is uncleaned data, modifying the configuration mode of the target disk to the JBOD mode, restarting the target server, and mounting the target boot image.

[0006] In one example embodiment, after determining that the first data cleaning operation is completed, and determining whether there is any data in the target disk that is not cleaned, the method further comprises: in the case that there is no data that is not cleaned, determining that the target disk is cleaned.

[0007] In one example embodiment, after determining that the target server needs to perform data cleaning on the target disk included in the target server, and determining whether the target control card for managing the disk is integrated in the target server, the method further comprises: in the case that the target control card is not integrated in the target server, modifying the configuration mode of the target disk to the JBOD mode, restarting the target server and mounting the target boot image; determining the target tool according to the type of the target disk according to a predetermined rule, and performing data cleaning operation on the target disk by using the target tool.

[0008] In one example embodiment, after determining the target tool for performing data cleaning on the target disk according to the type of the target disk according to a predetermined rule, and performing second data cleaning operation on the target disk by using the target tool, the method further comprises: determining target data for covering the target disk, and writing the target data into all storage areas in the target disk; cleaning the target data in the target disk to clean the target disk again.

[0009] In one example embodiment, after determining the target data for covering the target disk, and writing the target data into all storage areas in the target disk, the method further comprises: determining whether the target data fully covers all the storage areas; in the case that there is a storage area in the target disk that is not fully covered by the target data, writing the target data into the storage area again until all the storage areas are fully covered by the target data.

[0010] According to another embodiment of the present application, a data cleaning device is provided, comprising: a first determining module configured to determine whether a target control card for managing a disk is integrated in a target server in a case where data cleaning is required for a target disk included in the target server; a cleaning module configured to perform a first data cleaning operation on the target disk by invoking a data cleaning function of the target control card in a case where the target control card is integrated in the target server and the target control card is provided with the data cleaning function; a first modifying module configured to modify a configuration mode of the target disk to a JBOD mode, restart the target server and mount a target boot image in a case where it is determined that the first data cleaning operation is completed, wherein the target boot image includes a first tool supporting data cleaning of the target disk; a second determining module configured to determine a target tool for data cleaning of the target disk according to a type of the target disk according to a predetermined rule, and perform a second data cleaning operation on the target disk by using the target tool, wherein the first tool includes the target tool.

[0011] According to still another embodiment of the present application, a computer readable storage medium is also provided, and the computer readable storage medium stores a computer program, wherein the computer program is configured to execute the steps in any of the above method embodiments when running.

[0012] According to still another embodiment of the present application, an electronic device is also provided, comprising a memory and a processor, the memory stores a computer program, and the processor is configured to execute the computer program to perform the steps in any of the above method embodiments.

[0013] According to still another embodiment of the present application, a computer program product is also provided, and the computer program product comprises a computer program, and the computer program is executed by a processor to implement the steps in any of the above method embodiments.

[0014] According to the present application, in a case where the target control card is integrated in the target server, the data cleaning is performed by using the data cleaning function of the target control card first, and then the cleaning tool is determined according to the type of the disk to perform the second cleaning, so that the problem of data leakage caused by poor data cleaning effect in the related art can be solved, and the effect of improving data security is achieved. BRIEF DESCRIPTION OF DRAWINGS

[0015] Figure 1 is a hardware structure block diagram of a mobile terminal according to the data cleaning method of the embodiment of the present application;

[0016] Figure 2is a flow of a data cleaning method according to an embodiment of the present application Figure 1 ;

[0017] Figure 3 is a flow of a data cleaning method according to an embodiment of the present application Figure 2 ;

[0018] Figure 4 is a structural block diagram of a data cleaning device according to an embodiment of the present application. DETAILED DESCRIPTION

[0019] Hereinafter, embodiments of the present application will be described in detail with reference to the accompanying drawings and in conjunction with embodiments.

[0020] It should be noted that the terms "first", "second", and the like in the description and claims of the present application and the above-described accompanying drawings are used to distinguish similar objects, and do not necessarily have to be used to describe a specific order or sequence.

[0021] The method embodiments provided in the embodiments of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking the case of running on a mobile terminal, Figure 1 is a hardware structural block diagram of a mobile terminal for a data cleaning method according to an embodiment of the present application. As shown in Figure 1 , the mobile terminal can include one or more (only one is shown in Figure 1 ) processors 102 (the processor 102 can include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, wherein the above-mentioned mobile terminal can also include a transmission device 106 for communication function and an input / output device 108. Those skilled in the art can understand that Figure 1 the structure shown is only schematic, which does not limit the structure of the above-mentioned mobile terminal. For example, the mobile terminal can also include more or less components than those shown in Figure 1 , or have a different configuration from that shown in Figure 1 .

[0022] The memory 104 can be used to store computer programs, such as software programs of application software and modules, such as a computer program corresponding to the data cleaning method in the embodiments of the present application. The processor 102 can execute various functional applications and data processing, i.e., implement the above method, by running the computer programs stored in the memory 104. The memory 104 can include a high-speed random access memory, and can further include a non-volatile memory, such as one or more magnetic storage devices, flash memories, or other non-volatile solid-state memories. In some examples, the memory 104 can further include memories remotely arranged with respect to the processor 102, which can be connected to the mobile terminal through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0023] The transmission device 106 is used to receive or send data via a network. Specific examples of the above network can include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device 106 includes a network adapter (NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet in a wireless manner.

[0024] In the present embodiment, a data cleaning method running on the above mobile terminal is provided, Figure 2 is a flow of the data cleaning method according to the embodiments of the present application Figure 1 As shown in the flowchart, Figure 2 the flow includes the following steps:

[0025] Step S202, in a case where it is necessary to perform data cleaning on a target disk included in a target server, it is determined whether a target control card for controlling a disk is integrated in the target server;

[0026] Step S204, in a case where the target control card is integrated in the target server and the target control card has a data cleaning function, a first data cleaning operation is performed on the target disk by calling the data cleaning function of the target control card;

[0027] Step S206, in a case where it is determined that the first data cleaning operation is completed, a configuration mode of the target disk is modified to a JBOD mode, the target server is restarted and a target boot image is mounted, wherein the target boot image includes a first tool supporting data cleaning on the target disk;

[0028] Step S208, determining a target tool for data cleaning of the target disk according to the type of the target disk according to a predetermined rule, and performing a second data cleaning operation on the target disk by using the target tool, wherein the first tool includes the target tool.

[0029] In the above steps, the target control card includes but is not limited to an H3C storage control card, a RAID control card, etc., and the target disk includes but is not limited to a solid state disk (SSD) such as an nvme SSD, a SATA SSD, a mechanical hard disk (HDD), etc.

[0030] Before step S202, the method further includes restarting the target server. For example, the target boot image includes but is not limited to a CentOS 7.7 or later version boot image containing hdparm and nvme-cli. For example, before step S208, the method further includes determining the type of the target disk by executing the lsblk–d–o name, rata command, determining that the type of the target disk is HDD when the returned result is 1, and determining that the type of the target disk is SSD when the returned result is 0; and executing the nvmelist command, and returning a result indicating that there is an nvme device.

[0031] For example, when the target control card is a RAID control card, the first data cleaning operation on the target disk by calling the data cleaning function of the target control card includes but is not limited to entering the data erasing option of the management interface of the RAID control card, selecting the Normal mode, and setting three times of data erasing on the target disk in the Normal mode.

[0032] In the above steps, when the target control card is integrated in the target server, the data cleaning is first performed by using the data cleaning function of the target control card, and then the cleaning tool is determined according to the type of the disk to perform the second cleaning, thereby solving the problem of data leakage caused by poor data cleaning effect in the related art, and improving the security of data.

[0033] The execution subject of the above steps can be a server, but is not limited thereto.

[0034] In an optional embodiment, after determining that the first data cleaning operation is completed, modifying the configuration mode of the target disk to the JBOD mode, restarting the target server and mounting the target boot image include: after determining that the first data cleaning operation is completed, determining whether there is uncleaned data in the target disk; after determining that there is uncleaned data, modifying the configuration mode of the target disk to the JBOD mode, restarting the target server and mounting the target boot image.

[0035] In the above step, determining whether there is uncleaned data in the target disk includes but is not limited to: mode one, entering the array card configuration interface, checking the hard disk list state, in the case that the hard disk state is "Unconfigured Good", it is determined that there is no RAID configured on the hard disk, and the data has been cleaned, and in the case that the hard disk state is not "Unconfigured Good", it is determined that there may be uncleaned data; mode two, checking the SMART (Self-Monitoring, Analysis and Reporting Technology) state of the hard disk, in the case that the SMART data shows that the hard disk has an exception or a large number of read / write operations, it is determined that there may be uncleaned data; mode three, scanning the hard disk through data recovery software, in the case that the software can scan the previously stored data, it is determined that there may be uncleaned data.

[0036] In an optional embodiment, after determining that the first data cleaning operation is completed, determining whether there is uncleaned data in the target disk, the method further includes: in the case that there is no uncleaned data, it is determined that the target disk has completed data cleaning.

[0037] In an optional embodiment, after determining that the target server needs to perform data cleaning on the target disk included in the target server, the method further includes: in the case that the target server does not integrate the target control card for controlling the disk, modifying the configuration mode of the target disk to the JBOD mode, restarting the target server and mounting the target boot image; determining the target tool according to the type of the target disk according to a predetermined rule, and performing data cleaning operation on the target disk by using the target tool.

[0038] In the above step, by restarting the server and mounting the target boot image, data cleaning can be directly performed at the operating system level, avoiding complex hardware operations and improving the efficiency of data cleaning.

[0039] In an alternative embodiment, after determining the target tool for data cleaning of the target disk according to the type of the target disk and performing a second data cleaning operation on the target disk using the target tool, the method further comprises: determining target data for covering the target disk, and writing the target data into all storage areas in the target disk; and cleaning the target data in the target disk to clean the target disk again.

[0040] In the above steps, the method further comprises: performing full-disk covering cleaning of the target disk using the dd command in the following manner: identifying the type of the disk, for example, identifying that the target disk is a SATA HDD through the BIOS or disk management tool of the server; selecting a tool, for example, selecting a hard disk erasing tool supporting the SATA interface; cleaning, starting the server using DBAN, selecting the “Quick Erase” option, and performing quick erasing of the hard disk; selecting covering data, for example, using all 0 data as the covering data; writing the covering data, for example, using the dd command to write the all 0 data into the entire hard disk; and cleaning the covering data, for example, erasing the hard disk again using DBAN or using other tools to ensure that the all 0 data is cleaned.

[0041] In the above steps, by writing the target data into all storage areas of the target disk and then cleaning the data, it can be ensured that all spaces on the disk are covered, so that the original data is completely erased.

[0042] In an alternative embodiment, after determining the target data for covering the target disk and writing the target data into all storage areas in the target disk, the method further comprises: determining whether the target data fully covers all the storage areas; and in the case where it is determined that there is a storage area in the target disk that is not fully covered by the target data, writing the target data into the storage area again until all the storage areas are fully covered by the target data.

[0043] The following sets of specific embodiments are used to exemplarily illustrate the scheme in the present application:

[0044] Figure 3 is a flow of the data cleaning method according to an embodiment of the present application Figure 2 As shown in Figure 3 , the flow comprises the following steps:

[0045] Step S302: determining whether a RAID card is integrated, and in the case of yes, performing step S304, and in the case of no, jumping to step S306;

[0046] Step S304, data cleaning of the target disk is performed through a data cleaning function of the RAID card;

[0047] Step S306, the management mode of the target disk is modified to a pass-through mode;

[0048] Step S308, it is judged whether the target disk includes an nvme SSD hard disk, in the case of yes, step S310 is executed, in the case of no, step S312 is jumped to;

[0049] Step S310, the nvme SSD hard disk is cleaned;

[0050] Step S312, it is judged whether the target disk includes a SATA SSD hard disk, in the case of yes, step S314 is executed, in the case of no, step S316 is jumped to;

[0051] Step S314, the SATA SSD hard disk is cleaned;

[0052] Step S316, the target disk is cleaned by dd overlay.

[0053] In the above steps, when the judgment of the disk type included in the target disk is performed, the sequence is not limited.

[0054] Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be realized by means of software and the necessary general hardware platform, of course, it can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solutions of the present application or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes a plurality of instructions for making a terminal device (which can be a mobile phone, computer, server, or network device, etc.) execute the method described in each embodiment of the present application.

[0055] In the present embodiment, a data cleaning device is also provided, which is used to implement the above embodiments and preferred embodiments, which have been described and will not be repeated. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware, or a combination of software and hardware is also possible and is contemplated.

[0056] Figure 4 is a structure block diagram of the data cleaning device according to the embodiment of the present application, as Figure 4As shown, the apparatus comprises: a first determining module 42, configured to determine whether a target control card for controlling a disk is integrated in a target server in a case where data cleaning is required for a target disk included in the target server; a cleaning module 44, configured to perform a first data cleaning operation on the target disk by invoking a data cleaning function of the target control card in a case where the target control card is integrated in the target server and the target control card is provided with the data cleaning function; a first modifying module 46, configured to modify a configuration mode of the target disk to a JBOD mode, restart the target server and mount a target boot image in a case where it is determined that the first data cleaning operation is completed, wherein the target boot image comprises a first tool supporting data cleaning of the target disk; a second determining module 48, configured to determine a target tool for data cleaning of the target disk according to a kind of the target disk according to a predetermined rule, and perform a second data cleaning operation on the target disk by using the target tool, wherein the first tool comprises the target tool.

[0057] In an optional embodiment, the first modifying module 46 comprises: a first determining unit, configured to determine whether there is data that is not cleaned in the target disk in a case where it is determined that the first data cleaning operation is completed; and a second determining unit, configured to modify the configuration mode of the target disk to the JBOD mode, restart the target server and mount the target boot image in a case where it is determined that there is data that is not cleaned.

[0058] In an optional embodiment, the apparatus further comprises: a third determining module, configured to determine that the target disk completes data cleaning in a case where it is determined that there is no data that is not cleaned after it is determined that there is no data that is not cleaned in the target disk in a case where it is determined that the first data cleaning operation is completed.

[0059] In an optional embodiment, the apparatus further comprises: a second modifying module, configured to modify the configuration mode of the target disk to the JBOD mode, restart the target server and mount the target boot image in a case where the target control card is not integrated in the target server after it is determined that the target control card is integrated in the target server in a case where data cleaning is required for a target disk included in the target server; and a fourth determining module, configured to determine the target tool according to the kind of the target disk according to a predetermined rule, and perform a data cleaning operation on the target disk by using the target tool.

[0060] In an alternative embodiment, the apparatus further comprises a fifth determining module configured to determine a target tool for data cleaning of the target disk according to the category of the target disk in a predetermined rule, and determine target data for covering the target disk after the second data cleaning operation of the target disk by the target tool, and write the target data into all storage areas in the target disk; and a clearing module configured to clear the target data in the target disk to clean the target disk again.

[0061] In an alternative embodiment, the apparatus further comprises a sixth determining module configured to determine whether all storage areas are fully covered by the target data after determining the target data for covering the target disk and writing the target data into all storage areas in the target disk; and a writing module configured to write the target data into the storage areas again until all storage areas are fully covered by the target data in the case that there are storage areas in the target disk which are not fully covered by the target data.

[0062] It should be noted that each of the above modules can be implemented by software or hardware, and for the latter, the following implementation manners can be used, but are not limited thereto: all of the above modules are located in the same processor; or each of the above modules is located in a different processor in any combination.

[0063] Embodiments of the present application further provide a computer readable storage medium, which stores a computer program, and the computer program is configured to execute the steps in any of the above method embodiments when running.

[0064] In an exemplary embodiment, the above computer readable storage medium can include, but is not limited to, a U disk, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and various media which can store computer programs.

[0065] Embodiments of the present application further provide an electronic device, which comprises a memory storing a computer program and a processor configured to execute the computer program to perform the steps in any of the above method embodiments.

[0066] In an exemplary embodiment, the above electronic device can further comprise a transmission device connected to the processor and an input / output device connected to the processor.

[0067] An embodiment of the present invention further provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the steps of any of the above method embodiments are implemented.

[0068] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail here.

[0069] Obviously, those skilled in the art will appreciate that the various modules or steps of the present invention described above can be implemented using a general-purpose computing device, can be centralized on a single computing device, or can be distributed across a network of multiple computing devices. They can be implemented using program code executable by the computing device, and thus, can be stored in a storage device and executed by the computing device. In some cases, the steps shown or described herein can be performed in a different order than that shown, or can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, the present invention is not limited to any particular combination of hardware and software.

[0070] The foregoing description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Those skilled in the art will readily appreciate that various modifications and variations of the present invention are possible. Any modifications, equivalent substitutions, or improvements made within the principles of the present invention are intended to be within the scope of protection of the present invention.

Claims

1. A data cleaning method, characterized in that: include: In the case where data cleaning is required for a target disk included in a target server, determining whether a target control card for managing and controlling the disk is integrated in the target server; In a case where the target server is integrated with the target control card and the target control card has a data cleaning function, performing a first data cleaning operation on the target disk by calling the data cleaning function of the target control card; If it is determined that the first data cleanup operation is completed, changing the configuration mode of the target disk to JBOD mode, restarting the target server and mounting a target boot image, wherein the target boot image includes a first tool that supports data cleanup on the target disk; determining a target tool for performing data cleansing on the target disk according to a predetermined rule and the type of the target disk, and performing a second data cleansing operation on the target disk using the target tool, wherein the first tool includes the target tool; After determining the target data for covering the target disk and writing the target data into all storage areas in the target disk, the method further includes: determining whether all storage areas are fully covered by the target data; if it is determined that there are storage areas in the target disk that are not fully covered by the target data, writing the target data into the storage areas again until all storage areas are fully covered by the target data.

2. The method according to claim 1, characterized in that When it is determined that the first data cleaning operation is completed, changing the configuration mode of the target disk to JBOD mode, restarting the target server and mounting the target boot image includes: When it is determined that the first data cleaning operation is completed, determining whether there is any uncleared data in the target disk; If it is determined that there is uncleared data, the configuration mode of the target disk is changed to JBOD mode, the target server is restarted, and the target boot image is mounted.

3. The method according to claim 2, characterized in that When it is determined that the first data cleaning operation is completed, after determining whether there is any uncleared data in the target disk, the method further includes: When it is determined that no uncleaved data exists, it is determined that data cleaning of the target disk is completed.

4. The method according to claim 1, wherein In the case where data cleaning is required for a target disk included in a target server, after determining whether a target control card for managing and controlling the disk is integrated in the target server, the method further includes: If the target control card is not integrated in the target server, modify the configuration mode of the target disk to JBOD mode, restart the target server and mount the target boot image; The target tool is determined according to a predetermined rule based on the type of the target disk, and the target tool is used to perform a data cleaning operation on the target disk.

5. The method according to claim 1, wherein After determining a target tool for performing data cleaning on the target disk according to the type of the target disk in accordance with a predetermined rule, and performing a second data cleaning operation on the target disk using the target tool, the method further includes: Determining target data for overwriting the target disk, and writing the target data into all storage areas of the target disk; The target data in the target disk is cleared to perform data cleaning on the target disk again.

6. A data cleaning device, characterized in that: include: A first determining module is configured to determine whether a target control card for managing and controlling the disk is integrated in the target server when data cleaning of the target disk included in the target server is required; a cleaning module configured to perform a first data cleaning operation on the target disk by calling the data cleaning function of the target control card when the target server is integrated with the target control card and the target control card has a data cleaning function; a first modification module configured to, upon determining that the first data scrubbing operation is completed, modify the configuration mode of the target disk to JBOD mode, restart the target server, and mount a target boot image, wherein the target boot image includes a first tool that supports data scrubbing of the target disk; a second determining module, configured to determine a target tool for performing data cleansing on the target disk according to a predetermined rule and based on the type of the target disk, and perform a second data cleansing operation on the target disk using the target tool, wherein the first tool includes the target tool; The device also includes: a sixth determination module, which is used to determine whether all storage areas are fully covered by the target data after determining the target data for covering the target disk and writing the target data into all storage areas in the target disk; and a writing module, which is used to write the target data into the storage area again until all storage areas are fully covered by the target data when it is determined that there are storage areas in the target disk that are not fully covered by the target data.

7. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, wherein the computer program implements the steps of the method described in any one of claims 1 to 5 when executed by a processor.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 5 are implemented.

9. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.

Images