Data dump method and device based on data dump tool, electronic equipment, storage medium and program product

Abstract

The invention provides a data dump method and device based on a data dump tool, electronic equipment, a storage medium and a program product. Relates to the technical field of data processing. The data dump tool comprises a message queue, a service component and a console component, and the console component is used for configuring an adaptive storage medium in response to a user-defined configuration operation of a user. The method comprises the steps of receiving a data dump request based on a service component, determining a source storage medium and a target storage medium corresponding to the dump request, accessing the source storage medium based on the service component to obtain to-be-dumped data, and dumping the to-be-dumped data to the target storage medium based on the service component. According to the data dump method based on the data dump tool provided by the invention, the dump efficiency of stock data can be improved.

Description

Technical Field

[0001] This application relates to the field of data processing technology, and in particular to a data dumping method, apparatus, electronic device, storage medium and program product based on a data dumping tool. Background Technology

[0002] In the digital age, businesses or individual users often need to transfer existing data from old source storage media to new target storage media to meet the needs of technology upgrades, storage expansion, or data backup.

[0003] Currently, when faced with the need for data dumping, it is necessary to customize and develop dumping tools for different storage media and business requirements. The purpose of using customized dumping tools is to synchronize existing data from the source storage media to the target storage media.

[0004] However, the current method of custom-developing dump tools requires developing a separate interface for each type of storage medium, which results in high development costs, long development cycles, and low efficiency in dumping existing data. Summary of the Invention

[0005] This application provides a data dumping method, apparatus, electronic device, storage medium, and program product based on a data dumping tool, to improve the efficiency of dumping existing data.

[0006] In a first aspect, embodiments of this application provide a data dumping method based on a data dumping tool. The data dumping tool includes a message queue, a service component, and a console component. The console component is used to respond to user-defined configuration operations to configure an adapted storage medium. The method includes:

[0007] Data dumping requests are received based on service components;

[0008] The source and target storage media corresponding to the dump request are determined based on the service components, wherein the data dump tool is adapted to the source and target storage media;

[0009] Access the source storage medium based on the service component to obtain the data to be dumped;

[0010] The service component is used to dump the data to be dumped to the target storage medium.

[0011] In one possible implementation, the data dumping tool also includes interfaces corresponding to each adapted storage medium;

[0012] Accordingly, the source storage medium is accessed based on the service component to obtain the data to be dumped, including:

[0013] The type of source storage medium is determined based on the service components;

[0014] Based on the type of the source storage medium, the service component determines the source interface corresponding to the source storage medium.

[0015] The service component accesses the source storage medium through the source interface to obtain the data to be dumped.

[0016] In one possible implementation, the data dumping tool further includes a first database; correspondingly, it also includes:

[0017] Identify at least one dump task corresponding to the data to be dumped;

[0018] Each dump task is recorded to a pre-defined first database based on the service components;

[0019] The service components monitor the processing progress of each dump task in real time and update the processing progress of each dump task to the first database in real time.

[0020] In one possible implementation, it also includes:

[0021] The first database is read based on the service component to determine the first dump task;

[0022] The processing status of the first dump task is determined by scanning the preset dump task status table based on the service component.

[0023] If the processing status indicates that the first dump task has been successfully processed, the service component performs an integrity check on the data corresponding to the first dump task, and if the data is incomplete, the dump task is re-executed.

[0024] If the processing status indicates that the first dump task has failed, the dump task will be re-executed based on the service component.

[0025] In one possible implementation, it also includes:

[0026] Based on the service components, the storage period corresponding to each dump task is marked in the first database;

[0027] The service component periodically scans the first database to determine the expired second dump task based on the storage period corresponding to each dump task.

[0028] The second dump task is deleted from the first database based on the service component.

[0029] In one possible implementation, the data dumping tool further includes a second database; correspondingly, it also includes:

[0030] The service component reads a preset second database to determine preset special characters or fields;

[0031] The service component performs desensitization processing on special characters or fields in the data to be dumped.

[0032] Secondly, embodiments of this application provide a data dumping apparatus based on a data dumping tool. The data dumping tool includes a message queue, a service component, and a console component. The console component is used to respond to user-defined configuration operations to configure an adapted storage medium. The apparatus includes:

[0033] The receiving module is used to receive data dump requests based on the service component;

[0034] The processing module is used to determine the source and target storage media corresponding to the dump request based on the service components, wherein the data dump tool is adapted to the source and target storage media;

[0035] The processing module is also used to access the source storage medium based on the service component to obtain the data to be dumped;

[0036] The processing module is also used to dump the data to be dumped to the target storage medium based on the service components.

[0037] In one possible implementation, the data dumping tool also includes interfaces corresponding to each adapted storage medium;

[0038] Accordingly, the processing module is specifically used to determine the type of the source storage medium based on the service component;

[0039] The processing module is also specifically used to determine the source interface corresponding to the source storage medium based on the type of the source storage medium, according to the service component.

[0040] The processing module is also used to access the source storage medium through the source interface based on the service component in order to obtain the data to be dumped.

[0041] In one possible implementation, the processing module is further configured to determine at least one dump task corresponding to the data to be dumped;

[0042] The processing module is also used to record each dump task to a preset first database based on the service components;

[0043] The processing module is also used to monitor the processing progress of each dump task in real time based on the service components, and update the processing progress of each dump task to the first database in real time.

[0044] In one possible implementation, the processing module is further configured to read the first database based on the service component to determine the first dump task;

[0045] The processing module is also used to scan a preset dump task status table based on the service components to determine the processing status of the first dump task.

[0046] The processing module is also used to perform integrity verification on the data corresponding to the first dump task based on the service component if the processing status indicates that the first dump task has been successfully processed, and to re-execute the dump task if the data is incomplete.

[0047] The processing module is also used to re-execute the dump task based on the service component if the processing status indicates that the first dump task has failed.

[0048] In one possible implementation, the processing module is further configured to mark the storage period corresponding to each dump task in the first database based on the service component;

[0049] The processing module is also used to periodically scan the first database based on the service components in order to determine the expired second dump task based on the storage period corresponding to each dump task;

[0050] The processing module is also used to delete the second dump task from the first database based on the service component.

[0051] In one possible implementation, the data dumping tool further includes a second database, and correspondingly, the processing module is specifically used to read the preset second database based on the service component to determine preset special characters or fields;

[0052] The processing module is also used to perform desensitization processing on special characters or fields in the data to be dumped based on the service components.

[0053] Thirdly, embodiments of this application provide an electronic device, including: a processor, and a memory communicatively connected to the processor;

[0054] The memory stores instructions that the computer executes;

[0055] The processor executes computer execution instructions stored in memory, causing the processor to perform the first aspect and / or various possible implementations of the first aspect as described above.

[0056] Fourthly, embodiments of this application provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the first aspect and / or various possible implementations of the first aspect.

[0057] Fifthly, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the first aspect and / or various possible implementations of the first aspect.

[0058] The data dumping method, apparatus, electronic device, storage medium, and program product based on a data dumping tool provided in this application pre-configures the storage medium using the data dumping tool to adapt it to various storage media. Therefore, this application can access the adapted source storage medium through the data dumping tool to obtain the data to be dumped stored in the source storage medium. The data dumping tool then completes the purpose of dumping the data from the source storage medium to the target storage medium. Therefore, the data dumping method based on the data dumping tool provided in this application eliminates the need to develop a separate adapted dumping tool for each dumping task, reducing the cost and time of tool development, thereby improving the efficiency of data dumping. Attached Figure Description

[0059] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0060] Figure 1 A schematic diagram illustrating a data dumping scenario based on the data dumping tool provided in this application;

[0061] Figure 2 A flowchart illustrating the data dumping method based on the data dumping tool provided in this application. Figure 1 ;

[0062] Figure 3 Schematic diagram of the data dumping tool as an example Figure 1 ;

[0063] Figure 4 A flowchart illustrating the data dumping method based on the data dumping tool provided in this application. Figure 2 ;

[0064] Figure 5 Schematic diagram of the data dumping tool as an example Figure 2 ;

[0065] Figure 6 A flowchart illustrating the data dumping method based on the data dumping tool provided in this application. Figure 3 ;

[0066] Figure 7 A flowchart illustrating the data dumping method based on the data dumping tool provided in this application. Figure 4 ;

[0067] Figure 8 A flowchart illustrating the data dumping method based on the data dumping tool provided in this application. Figure 5 ;

[0068] Figure 9 Schematic diagram of the data dumping tool as an example Figure 3;

[0069] Figure 10 A flowchart illustrating the data dumping method based on the data dumping tool provided in this application. Figure 6 ;

[0070] Figure 11 A schematic diagram of the structure of the data dumping device based on the data dumping tool provided in this application;

[0071] Figure 12 A schematic diagram of the structure of the electronic device provided in this application.

[0072] The accompanying drawings have illustrated specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to specific embodiments. Detailed Implementation

[0073] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0074] The collection, storage, use, processing, transmission, provision, and disclosure of financial data or user data involved in the technical solution of this application all comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0075] It should be noted that in the embodiments of this application, certain software, components, models and other existing solutions in the industry may be mentioned. These should be regarded as exemplary and are only intended to illustrate the feasibility of implementing the technical solution of this application. However, it does not mean that the applicant has used or necessarily used the solution.

[0076] In the digital age, businesses and individual users often need to migrate existing data from old source storage media to new target storage media to adapt to needs such as technology upgrades, storage expansion, or data backup. For example, enterprise data migration: when a company changes its storage system or migrates to the cloud, it needs to completely migrate files, databases, and other data from the original storage devices to the new platform. Data backup and recovery: regularly backing up critical data from local storage to off-site storage (such as cloud storage), or quickly restoring data in recovery scenarios. Commonly used mainstream storage media mainly include: hard drives, solid-state drives (SSDs), network-attached storage (NAS), and cloud storage.

[0077] Currently, when faced with data dumping needs, it is necessary to customize dumping tools for different storage media and business requirements. These customized tools are used to synchronize existing data from the source storage media to the target storage media. However, the current method of custom-developing dumping tools requires developing separate interfaces for each storage medium, resulting in high development costs, long development cycles, and low efficiency in dumping existing data.

[0078] Figure 1 This application provides a schematic diagram of a data dumping scenario based on a data dumping tool, as shown below. Figure 1 As shown, the source and target storage media can be pre-configured to adapt to the data dumping tool. Figure 1 The example illustrates n source storage media and m target storage media, the number of which can be determined based on actual conditions. A data dumping tool receives data dumping requests, determines the corresponding source and target storage media, and then accesses the appropriate source storage media to obtain the data to be dumped. The tool then completes the dumping of the data from the source storage media to the target storage media. Therefore, the data dumping method based on this application eliminates the need to develop separate dumping tools for each dumping task, reducing development costs and time, and thus improving data dumping efficiency.

[0079] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0080] Figure 2 A flowchart illustrating the data dumping method based on the data dumping tool provided in this application. Figure 1The data dumping tool includes a message queue, service components, and a console component. The console component responds to user-defined configuration operations to configure the appropriate storage medium, such as... Figure 2 As shown, the method includes:

[0081] S201, Receive data dumping requests based on service components.

[0082] Combined with scenario examples, Figure 3 Schematic diagram of the data dumping tool as an example Figure 1 ,like Figure 3 As shown, the console component of a data dumping tool can be represented as a management interface. The management interface is a visual operating platform used to monitor, configure, and control a system, device, or software. Users can configure the storage media adapted to the data dumping tool through the management interface. The storage media adapted to the data dumping tool can be determined according to actual needs. The service component is the core module in the data dumping tool, responsible for "data read / write core logic," "resource management," or "protocol interaction," and is the "central hub" for the tool to implement data dumping functions. Therefore, when data dumping is required, data dumping requests can be received based on the service component of the data dumping tool. A message queue (MQ) is a data structure based on a queue.

[0083] S202. Determine the source and target storage media corresponding to the dump request based on the service components, wherein the data dumping tool is adapted to the source and target storage media.

[0084] In the example scenario, the dump request carries the source storage medium and the target storage medium for which the data needs to be dumped. Both the source storage medium and the target storage medium are pre-configured storage media that are compatible with the data dumping tool.

[0085] S203. Access the source storage medium based on the service component to obtain the data to be dumped.

[0086] Combined with scenario examples, Figure 1 If the source storage medium carried in the dump request is source storage medium 1, then the service component of the data dump tool accesses source storage medium 1 to extract the data stored in source storage medium 1, and determines the data stored in source storage medium 1 as the data to be dumped.

[0087] Optionally, the data dumping tool also includes interfaces for each compatible storage medium. Figure 4 A flowchart illustrating the data dumping method based on the data dumping tool provided in this application. Figure 2 ,like Figure 4 As shown, S203 includes:

[0088] S401. Determine the type of the source storage medium based on the service component.

[0089] Based on scenario examples, the types of source storage media typically include hard drives, SSDs, NAS, and cloud storage.

[0090] S402. Based on the type of the source storage medium, the service component determines the source interface corresponding to the source storage medium.

[0091] Based on specific scenarios, for hard disk storage media, the corresponding source interface can be a local direct-connect physical interface. For SSD storage media, the corresponding source interface can be an M.2 interface or a Peripheral Component Interconnect Express (PCIe) interface. For NAS storage media, the corresponding source interface can be a network protocol interface. For cloud storage media, the corresponding source interface can be an Application Programming Interface (API).

[0092] S403. Based on the service component, access the source storage medium through the source interface to obtain the data to be dumped.

[0093] Taking a scenario example, with source storage medium 1 as the source storage medium, if source storage medium 1 is an SSD storage medium, then the source storage medium 1 can be accessed through the M.2 interface or PCIe interface to obtain the data to be dumped.

[0094] Based on the method provided in this example, various types of source storage media can be accessed by following the interface corresponding to the source storage media.

[0095] S204. Based on the service component, dump the data to be dumped to the target storage medium.

[0096] Combined with scenario examples, Figure 1 If the target storage medium is target storage medium 1, the service component can dump the data to be dumped to target storage medium 1.

[0097] The data dumping method based on the data dumping tool provided in this example eliminates the need to develop separate, adapted dumping tools for each dumping task, reducing the cost and time required for tool development and thus improving the efficiency of data dumping.

[0098] Optional, Figure 5 Schematic diagram of the data dumping tool as an example Figure 2 ,like Figure 5 As shown, the data dumping tool also includes a first database.

[0099] Accordingly, Figure 6A flowchart illustrating the data dumping method based on the data dumping tool provided in this application. Figure 3 ,like Figure 6 As shown, it also includes:

[0100] S601. Determine at least one dump task corresponding to the data to be dumped.

[0101] Based on a scenario example, for data to be dumped, the data can be divided into multiple dump tasks according to a preset data volume. The preset data volume can be determined according to the actual situation, for example, 5G. Therefore, dividing the data to be dumped into 5G data volumes will result in dump tasks corresponding to 5G of data to be dumped. All the resulting dump tasks are then added to a message queue sequentially, and the dump tasks are sorted according to the order in which they were added. Figure 1 If the target storage medium is target storage medium 1, the service component extracts the first dump task from the message queue according to the order in which the dump tasks are arranged, and executes the extracted dump task. This achieves the purpose of dumping the 5G of data corresponding to the dump task to target storage medium 1. After executing all dump tasks in the message queue, the purpose of dumping all the data to be dumped to target storage medium 1 can be achieved.

[0102] S602. Record each dump task to the preset first database based on the service component.

[0103] Based on the scenario example, there can be one or multiple first databases, and the first database is used to store all dump tasks at the same time.

[0104] S603. Based on the service component, monitor the processing progress of each dump task in real time, and update the processing progress of each dump task to the first database in real time.

[0105] Based on the scenario example, after each dump task is recorded in the first database, the tag for each dump task is marked as "pending dump", which means the corresponding processing progress is "0". After it is detected that the data corresponding to a certain dump task has been dumped to the target storage medium, the tag for the dump task in the first database can be updated to "dumped", which means the processing progress of the dump task is "100%".

[0106] Based on the method provided in this example, the processing progress of each dump task is recorded by the first data volume, and the completion status of each dump task can be monitored in a timely manner.

[0107] Optional, Figure 7 A flowchart illustrating the data dumping method based on the data dumping tool provided in this application. Figure 4 ,like Figure 7 As shown, it also includes:

[0108] S701. Read the first database based on the service component to determine the first dump task.

[0109] Based on the scenario example, by reading the first database, the tag information corresponding to each dump task is obtained, and the dump task with the tag "dumped" is identified as the first dump task.

[0110] S702. Based on the service component, scan the preset dump task status table to determine the processing status of the first dump task.

[0111] Based on the scenario example, the dump task status table records the processing status of each first dump task. The processing status is divided into successful and failed. A successful dump task indicates that the data corresponding to that task was successfully dumped to the target storage medium, while a failed dump task indicates that the data corresponding to that task was not successfully dumped to the target storage medium. In the dump task status table, a successfully processed first dump task can be marked as "1", and a failed first dump task can be marked as "0".

[0112] S703. If the processing status indicates that the first dump task has been successfully processed, the integrity of the data corresponding to the first dump task is verified based on the service component, and the dump task is re-executed if the data is incomplete.

[0113] In a scenario example, for the first successfully processed dump task, hash values ​​are generated for the source data and the new data. The source data is the data before the dump, and the new data is the data after the dump. If the hash values ​​are the same, it indicates that the new data after the dump is complete; otherwise, if the hash values ​​are different, it indicates that the new data after the dump is incomplete. If the new data after the dump is incomplete, the dump task can be re-executed sequentially.

[0114] S704. If the processing status indicates that the first dump task has failed, the dump task will be re-executed based on the service component.

[0115] Based on the scenario example, for the first dump task that failed to process, the task can be directly re-executed.

[0116] Based on the method provided in this example, the integrity of the data is verified for the first dump task that is successfully processed, and the dump task is re-executed for the first dump task that fails to process, thus ensuring the integrity of the data after dumping.

[0117] Optional, Figure 8 A flowchart illustrating the data dumping method based on the data dumping tool provided in this application. Figure 5 ,like Figure 8 As shown, it also includes:

[0118] S801. Based on the service components in the first database, mark the storage period corresponding to each dump task.

[0119] Based on the scenario examples, the storage period can be determined according to the actual situation, such as one week.

[0120] S802. Based on the service component, periodically scan the first database to determine the expired second dump task according to the storage period corresponding to each dump task.

[0121] Based on the scenario example, if the storage time of the dump task exceeds one week, the dump task can be identified as an expired second dump task.

[0122] S803. Based on the service component, delete the second dump task from the first database.

[0123] Based on the scenario example, the service component can delete expired second dump tasks from the first database at a fixed time each day.

[0124] Based on the method provided in this example, storage resources of the first database can be saved by periodically cleaning up expired dump tasks.

[0125] Optional, Figure 9 Schematic diagram of the data dumping tool as an example Figure 3 ,like Figure 9 As shown, the data dumping tool also includes a second database.

[0126] Accordingly, Figure 10 A flowchart illustrating the data dumping method based on the data dumping tool provided in this application. Figure 6 ,like Figure 10 As shown, it also includes:

[0127] S1001: Read the preset second database based on the service component to determine the preset special characters or fields.

[0128] Based on the scenario example, the second database can be a Redis database, and the special characters or fields can be characters with special functions, such as quotation marks, backslashes, and angle brackets in programming languages. Alternatively, they can be combinations of characters containing sensitive information, such as special symbols in passwords, verification codes in ID card numbers, and key numbers in bank card numbers.

[0129] S1002. Based on the service component, perform desensitization processing on special characters or fields in the data to be dumped.

[0130] In the context of specific scenarios, the desensitization of special characters or fields refers to the process of transforming, replacing, or masking special characters or fields in order to protect data security or meet compliance requirements.

[0131] Based on the data dumping method provided in this application, the storage medium is pre-configured using the data dumping tool to adapt it to various storage media. Therefore, this application can access the adapted source storage medium through the data dumping tool to obtain the data to be dumped stored in the source storage medium, and then use the data dumping tool to complete the dumping of the data from the source storage medium to the target storage medium. Thus, this application eliminates the need to develop a separate adapted dumping tool for each dumping task, reducing tool development costs and time, and thereby improving data dumping efficiency.

[0132] Figure 11 This is a schematic diagram of the structure of the data dumping device based on the data dumping tool provided in this application. The data dumping tool includes a message queue, a service component, and a console component. The console component is used to respond to user-defined configuration operations to configure the appropriate storage medium, such as... Figure 11 As shown, the device includes:

[0133] Receiving module 111 is used to receive data dump requests based on service components;

[0134] Processing module 112 is used to determine the source storage medium and target storage medium corresponding to the dump request based on the service component, wherein the data dump tool is adapted to the source storage medium and the target storage medium;

[0135] The processing module 112 is also used to access the source storage medium based on the service component to obtain the data to be dumped;

[0136] The processing module 112 is also used to divide the data to be dumped according to a preset data volume based on the service component, so as to obtain at least one dumping task;

[0137] Processing module 112 is also used to add at least one dump task to the message queue based on the service component;

[0138] The processing module 112 is also used to extract each dump task sequentially according to the order of each dump task in the message queue based on the service component, and execute each extracted dump task to dump the data corresponding to each dump task to the target storage medium.

[0139] Optionally, the data dumping tool also includes interfaces for each compatible storage medium;

[0140] Accordingly, the processing module 112 is specifically used to determine the type of the source storage medium based on the service component;

[0141] The processing module 112 is further used to determine the source interface corresponding to the source storage medium based on the type of the source storage medium, according to the service component.

[0142] The processing module 112 is also specifically used to access the source storage medium through the source interface based on the service component to obtain the data to be dumped.

[0143] Optionally, the processing module 112 is also used to determine at least one dump task corresponding to the data to be dumped;

[0144] Processing module 112 is also used to record each dump task to a preset first database based on the service component;

[0145] The processing module 112 is also used to monitor the processing progress of each dump task in real time based on the service component, and update the processing progress of each dump task to the first database in real time.

[0146] Optionally, the processing module 112 is also configured to read the first database based on the service component to determine the first dump task;

[0147] Processing module 112 is also used to scan a preset dump task status table based on the service component to determine the processing status of the first dump task;

[0148] The processing module 112 is also used to perform integrity verification on the data corresponding to the first dump task based on the service component if the processing status indicates that the first dump task has been successfully processed, and to re-execute the dump task if the data is incomplete.

[0149] The processing module 112 is also used to re-execute the dump task based on the service component if the processing status indicates that the first dump task has failed.

[0150] Optionally, the processing module 112 is also used to mark the storage period corresponding to each dump task in the first database based on the service component;

[0151] Processing module 112 is also used to periodically scan the first database based on the service component to determine the expired second dump task through the storage period corresponding to each dump task;

[0152] The processing module 112 is also used to delete the second dump task from the first database based on the service component.

[0153] Optionally, the data dumping tool also includes a second database. Accordingly, the processing module 112 is specifically used to read the preset second database based on the service component to determine preset special characters or fields.

[0154] The processing module 112 is also used to perform desensitization processing on special characters or fields in the data to be dumped based on the service component.

[0155] The data dumping device based on the data dumping tool provided in this embodiment can execute the method provided in the above method embodiment. Its implementation principle and technical effect are similar, and will not be described in detail here.

[0156] Figure 12 A schematic diagram of the structure of the electronic device provided in this application. Figure 12 As shown, the electronic device 50 provided in this embodiment includes at least one processor 501 and a memory 502. Optionally, the electronic device 50 further includes a communication component 503. The processor 501, memory 502, and communication component 503 are connected via a bus.

[0157] In a specific implementation, at least one processor 501 executes computer execution instructions stored in memory 502, causing at least one processor 501 to perform the above-described method.

[0158] The specific implementation process of processor 501 can be found in the above method embodiments, and its implementation principle and technical effect are similar. It will not be repeated here.

[0159] In the above embodiments, it should be understood that the processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this invention can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules within the processor.

[0160] The memory may include random access memory (RAM) and may also include non-volatile memory (NVM), such as at least one disk storage device.

[0161] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, the buses shown in the accompanying drawings are not limited to a single bus or a single type of bus.

[0162] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the above-described method.

[0163] This application also provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the above-described method.

[0164] The aforementioned readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The readable storage medium can be any available medium accessible to a general-purpose or special-purpose computer.

[0165] An exemplary readable storage medium is coupled to a processor, enabling the processor to read information from and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and the readable storage medium can exist as discrete components in the device.

[0166] The division of units is merely a logical functional division; in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, or units, and may be electrical, mechanical, or other forms.

[0167] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0168] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0169] If a function is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0170] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0171] Finally, it should be noted that other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein, and is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the invention is limited only by the appended claims.

Claims

1. A data dumping method based on a data dumping tool, characterized in that, The data dumping tool includes a message queue, a service component, and a console component. The console component is used to respond to user-defined configuration operations to configure an adapted storage medium. The method includes: Receive data dumping requests based on the aforementioned service component; The source storage medium and target storage medium corresponding to the dump request are determined based on the service component, wherein the data dump tool is adapted to the source storage medium and the target storage medium; Access the source storage medium based on the service component to obtain the data to be dumped; The service component is used to transfer the data to be transferred to the target storage medium.

2. The method according to claim 1, characterized in that, The data dumping tool also includes interfaces corresponding to each compatible storage medium; Accordingly, the step of accessing the source storage medium based on the service component to obtain the data to be dumped includes: The type of the source storage medium is determined based on the service component; Based on the type of the source storage medium, the service component determines the source interface corresponding to the source storage medium; The service component accesses the source storage medium through the source interface to obtain the data to be dumped.

3. The method according to claim 1, characterized in that, The data dumping tool also includes a first database; correspondingly, it also includes: Identify at least one dump task corresponding to the data to be dumped; Based on the service components, each dump task is recorded to a preset first database; The service component monitors the processing progress of each dump task in real time and updates the processing progress of each dump task to the first database in real time.

4. The method according to claim 3, characterized in that, Also includes: The first database is read based on the service component to determine the first dump task; The processing status of the first dump task is determined by scanning a preset dump task status table based on the service component. If the processing status indicates that the first dump task has been successfully processed, then the integrity of the data corresponding to the first dump task is verified based on the service component, and if the data is incomplete, the dump task is re-executed. If the processing status indicates that the first dump task has failed, the dump task will be re-executed based on the service component.

5. The method according to claim 3, characterized in that, Also includes: Based on the service component, mark the storage period corresponding to each dump task in the first database; Based on the service component, the first database is scanned periodically to determine the expired second dump task according to the storage period corresponding to each dump task. The second dump task is deleted from the first database based on the service component.

6. The method according to claim 1, characterized in that, The data dumping tool also includes a second database; correspondingly, it also includes: The service component reads a preset second database to determine preset special characters or fields. The service component performs desensitization processing on special characters or fields in the data to be dumped.

7. A data dumping device based on a data dumping tool, characterized in that, The data dumping tool includes a message queue, a service component, and a console component. The console component is used to respond to user-defined configuration operations to configure an adapted storage medium. The device includes: The receiving module is used to receive data dumping requests based on the service component; The processing module is used to determine the source storage medium and target storage medium corresponding to the dump request based on the service component, wherein the data dump tool is adapted to the source storage medium and the target storage medium; The processing module is also used to access the source storage medium based on the service component to obtain the data to be dumped; The processing module is also used to transfer the data to be transferred to the target storage medium based on the service component.

8. An electronic device, characterized in that, include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory to implement the method as described in any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1-6.

10. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method described in any one of claims 1-6.

Images