Data archiving method and device
By dividing and converting the data to be archived in the bank's core business system and then transmitting it to the open platform for encoding conversion and compression storage, the problems of long data archiving cycle and high resource consumption are solved, and efficient data archiving and cost savings are achieved.
Patent Information
- Application Number
- CN202510533038.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-25
- Publication Date
- 2025-08-19
AI Technical Summary
In the prior art, in the process of upgrading from a centralized architecture based on IBM host platform to a distributed architecture, the transfer and dumping efficiency of massive archived data is low, resulting in too long data archiving cycle, high resource consumption, increased operation and maintenance costs, and poor user interaction.
The data to be archived is divided into a collection of different storage structures through the host platform, and converted into a unified storage structure and then transmitted to the open platform. The open platform performs encoding and compression storage, and only encodes and converts the target data required by users to reduce the processing of the entire amount of data.
It shortens the data archiving cycle, reduces resource consumption on host platforms and open platforms, saves time and operational costs, and improves data archiving efficiency and user experience.
Smart Images

Figure CN120508534A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computers, and more particularly, to a data archiving method and device. Background Art
[0002] As banks' core business systems gradually upgrade from a centralized to a distributed architecture based on IBM mainframe platforms, commercial banks have gradually shut down their IBM mainframes. To meet data recovery and extraction needs for scenarios such as access, inspection, and internal cross-sectional data recovery, banks' core business systems are required to archive their important data.
[0003] The traditional method for transferring and retrieving archived data involves restoring the full amount of archived data of all types from the host platform's tape library to the host's disk device through the host platform's operating system and transcoding program. This full amount of archived data is then converted using a transcoding program that includes file type and file encoding conversion functions. Once the transcoding is complete on the host platform, the resulting file is made available on the platform. However, the host platform's tape library, which has been operating continuously for many years for archival data management, has accumulated a massive amount of historical archived data. This massive amount of archived data requires significant host computing resources, including CPU and disk space, and can take years to implement.
[0004] There is currently no effective solution to the above problems. Summary of the Invention
[0005] The embodiments of the present invention provide a data archiving method and device to at least solve the problem of long data archiving period in related technologies.
[0006] According to one embodiment of the present invention, a data archiving method is provided, comprising: a host platform acquiring data to be archived, wherein the data to be archived includes a first data set and a second data set, the storage structure of the data in the first data set is a first storage structure, and the storage structure of the data in the second data set is a second storage structure; the host platform converts the storage structure of the data in the second data set into the first storage structure to obtain a third data set; the host platform transmits the first data set and the third data set to an open platform, so that the open platform, upon receiving a target instruction, performs encoding conversion on target data indicated in the target instruction, wherein the first data set and the third data set include the target data.
[0007] In an exemplary embodiment, after the host platform transmits the first data set and the third data set to the open platform, the method further includes: the open platform compressing the first data set and the third data set to obtain a compressed data set, wherein each compressed data in the compressed data set is obtained by compressing the corresponding data in the first data set and the third data set; and the open platform storing the compressed data set in a target storage area.
[0008] In an exemplary embodiment, after the open platform stores the compressed data set in the target storage area, the method further includes: when the open platform receives a verification instruction, decompressing the compressed data in the compressed data set in response to the verification instruction to obtain the fourth data set; and the open platform returning the fourth data set to the host platform.
[0009] In an exemplary embodiment, after the open platform transmits the fourth data set back to the host platform, the method further includes: the host platform verifies the fourth data set; if the data in the fourth data set is consistent with the data in the first data set and / or the data in the third data set, the host platform determines that the data to be archived is successfully archived.
[0010] In an exemplary embodiment, when the open platform receives a verification instruction, the compressed data in the compressed data set is decompressed in response to the verification instruction to obtain the fourth data set, including: the open platform decompresses all the compressed data in the compressed data set to obtain the fourth data set; or the open platform determines a first compressed data subset in the compressed data set according to a preset ratio, and decompresses each compressed data in the first compressed data subset to obtain the fourth data set.
[0011] In an exemplary embodiment, after the host platform determines that the data to be archived is successfully archived, the method further includes: the host platform clearing the data to be archived.
[0012] In an exemplary embodiment, upon receiving a target instruction, the open platform performs encoding conversion on the target data indicated in the target instruction, including: the open platform determines target compressed data in a target storage area according to the target instruction, wherein the target compressed data is data compressed from the target data, and a compressed data set is stored in the target storage area, and the compressed data set is obtained by the open platform compressing the first data set and the third data set; the open platform decompresses the target compressed data to obtain the target data; the open platform performs encoding conversion on the target data to obtain target encoded data; and the open platform displays the target encoded data.
[0013] According to another embodiment of the present invention, a data archiving device is provided, which is applied to a host platform and includes: an acquisition module, configured to acquire data to be archived, wherein the data to be archived includes: a first data set and a second data set, wherein the storage structure of the data in the first data set is a first storage structure, and the storage structure of the data in the second data set is a second storage structure;
[0014] a conversion module for converting the storage structure of the data in the second data set into the first storage structure to obtain a third data set; a transmission module for transmitting the first data set and the third data set to an open platform so that the open platform, upon receiving a target instruction, performs encoding conversion on the target data indicated in the target instruction, wherein the first data set and the third data set include the target data.
[0015] According to yet another embodiment of the present invention, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above methods are implemented.
[0016] According to another embodiment of the present invention, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any one of the above method embodiments.
[0017] According to yet another embodiment of the present invention, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the steps of any of the above methods are implemented.
[0018] Through the present invention, the host platform obtains the data to be archived, and converts the storage structure of other data in the data to be archived into a first storage structure to obtain the second data, thereby transmitting the first data and the second data in the data to be archived to the open platform, so that when the user obtains data from the open platform, only the target data required by the user is subjected to the encoding conversion operation. Since the host platform only needs to perform the storage format conversion operation on part of the data to be archived, and performs the encoding conversion operation on the target data that the user needs to obtain through the open platform, the host platform does not need to perform the file type conversion and file encoding conversion on the entire amount of data to be archived before transmitting it to the open platform for storage, thereby avoiding the problem of a long data archiving cycle caused by the huge amount of data to be archived, reducing the dependence of the data archiving process on the host platform, and at the same time, reducing the consumption of resources of the host platform and the open platform, saving time cost and operating cost. Therefore, the problem of a long data archiving cycle in the related technology can be solved, achieving the effect of cost saving. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1 1 is a hardware structure block diagram of a mobile terminal according to a data archiving method of an embodiment of the present invention;
[0020] Figure 2 is a flow chart of a data archiving method according to an embodiment of the present invention;
[0021] Figure 3 is a flowchart of transferring and dumping archived data according to an embodiment of the present invention;
[0022] Figure 4 is a schematic diagram of file type conversion on a host platform according to an embodiment of the present invention;
[0023] Figure 5 is a schematic diagram of data transmission on a host platform according to an embodiment of the present invention;
[0024] Figure 6 2 is a schematic diagram of a data verification implementation process according to an embodiment of the present invention;
[0025] Figure 7 is a flow chart of a method for extracting dump archived data from an open platform according to an embodiment of the present invention;
[0026] Figure 8 is a schematic diagram of a transcoding operation according to an embodiment of the present invention;
[0027] Figure 9 Schematic diagram of an apparatus for implementing archive data transfer and dumping according to an embodiment of the present invention;
[0028] Figure 10 4 is a structural block diagram of a data archiving device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0029] After upgrading and transforming a core banking system to a distributed architecture, the existing host-based software and hardware must be promptly shut down. However, due to differences in file types and encoding between the host platform and the open platform, the open system (i.e., the system running on the open platform) cannot directly read the files. Therefore, before shutting down the host equipment (i.e., the physical equipment that implements the host platform's functions), the massive archived data in the host platform's tape library must be transferred to the open platform.
[0030] In the process of transferring archived data from existing host platform tape libraries to open platforms, the host platform's software and hardware must be used to convert the entire data (including file type conversion and file encoding conversion). This presents numerous problems, including the following:
[0031] (1) The transfer and dumping of the entire archived data stored in the host platform's tape library requires the host platform to perform file type conversion and file encoding conversion. The efficiency of transferring and dumping massive historical data is low, and it is impossible to completely shut down the host platform's software and hardware equipment in the short term, which will lead to a continuous increase in the operation and maintenance costs of the host platform.
[0032] (2) The rate of return on the implementation of archived data transfer and dumping is relatively low. The probability of the result files after full transfer and dumping being fully extracted in business scenarios such as retrieval and viewing is low. There is a serious imbalance between the long transfer and dumping implementation cycle and the low probability of being extracted;
[0033] (3) The financial cost of transfer and dump is high. Since the data compression ratio of the host platform tape library is higher than that of the open platform, the data recovery and transfer of massive archived data to the open platform will lead to a sudden increase in the procurement cost of the open platform disk storage device, which is inconsistent with the management goal of reducing costs and increasing efficiency in operation and maintenance work.
[0034] (4) The existing implementation scheme of dumping and transferring has poor user interactivity and user experience during the operation process, and is dependent on the technical level of the host platform possessed by the operation and maintenance personnel.
[0035] Therefore, the present invention proposes a data archiving method and device to solve the problems existing in the above-mentioned existing archiving data transfer and dumping methods.
[0036] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings and in combination with embodiments.
[0037] In order to better understand the embodiments of the present invention, some terms in the embodiments are explained below:
[0038] File type: refers to the organization of the internal records of a file, including sequential access and random access. The host platform operating system includes files with sequential storage and virtual storage access method files indexed by key values.
[0039] File encoding: refers to the character encoding standard used by the operating system software. For example, the host platform operating system uses the EBCDIC character encoding specification, and the open platform operating system uses the ASCII encoding specification.
[0040] Host platform: refers to an information system operating platform, originally used in key information systems such as the bank's core business system. With the upgrade of the bank's core business system to a distributed architecture, it has gradually ceased to serve as the basic support platform for the bank's core business system. The original historical archived data needs to be transferred and dumped to meet the demand for future extraction from the open platform.
[0041] Open platform: refers to an information system operation support platform, such as hardware that uses the X86 hardware architecture, or the ARM hardware architecture of domestically produced information technology innovation (i.e. domestic information technology application innovation), plus an information system operation support platform based on the Linux operating system.
[0042] File transcoding: Since the host platform uses a different file encoding standard from the open platform, the open system cannot directly read the files on the host platform. It needs to use a transcoding program or tool to perform encoding conversion operations on the files on the host platform to meet cross-platform file reading requirements.
[0043] Tape library: A massive archival data storage system composed of physical tapes combined with data backup and recovery management software. It is widely used on host platforms. The tape library stores key data that needs to be permanently retained, such as business transactions from the bank's core business systems that have been running for many years.
[0044] Archived data transfer and dump: The archived data in the host platform tape library is transcoded according to the reading requirements of the open platform and then stored in a storage system that can be read by the open platform.
[0045] Data extraction: When a bank needs to review the historical details of a specific customer at the bank, it extracts specific historical record data from its archived data to meet the review needs.
[0046] Sequential files store multiple records sequentially. To read a record, you must start at the first record in the sequential file and traverse it until you find the corresponding entry. The data type stored on tapes in host platform tape libraries is a sequential file.
[0047] A partition file consists of a directory and directory members. The directory records the storage location of each directory member, and each directory member is a sequential file. Executable programs in host platform operating systems are often partition files. The host operating system can directly access a directory member based on the information in the directory. However, a limitation of partition files is that the space occupied by a deleted directory member must be manually reclaimed.
[0048] Extended partition type file is an enhanced version of partition type file. The main advantage of extended partition type file over partition type file is that when some directory members are cleared, the operating system will automatically reclaim the storage space, and the reclaimed available space will be used for the space requirements when adding subsequent directory members.
[0049] VSM files are primarily used by applications running on the host platform and are not intended for use by basic software such as the operating system. While the management mechanism for VSM files is relatively complex, they are a unique file type for host platforms that enables efficient file access. In VSM files, each record has a key value, allowing applications to quickly and randomly access specific entries using this key value.
[0050] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.
[0051] The method embodiments provided in the embodiments of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking running on a mobile terminal as an example, Figure 1 FIG is a hardware structure block diagram of a mobile terminal of a data archiving method according to an embodiment of the present invention. Figure 1 As shown, the mobile terminal may include one or more ( Figure 1 Only one is shown) a processor 102 (the processor 102 may include but is not limited to a microprocessor MCU or a programmable logic device FPGA and other processing devices) and a memory 104 for storing data, wherein the mobile terminal may also include a transmission device 106 and an input and output device 108 for communication functions. It will be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the mobile terminal. Figure 1 More or fewer components than shown, or with Figure 1 Different configurations shown.
[0052] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the data archiving method in the embodiment of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, implementing the above-mentioned method. The memory 104 may include a high-speed random access memory and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely located relative to the processor 102, and these remote memories may be connected to the mobile terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0053] The transmission device 106 is used to receive or send data via a network. A specific example of the aforementioned network may include a wireless network provided by the mobile terminal's communications provider. In one embodiment, the transmission device 106 includes a network interface controller (NIC), which can be connected to other network devices via a base station to enable communication with the Internet. In another embodiment, the transmission device 106 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.
[0054] In this embodiment, a method for archiving data running on the above mobile terminal or network architecture is provided. Figure 2 : is a flow chart of a data archiving method according to an embodiment of the present invention. Figure 2 As shown, the process includes the following steps:
[0055] Step S202: The host platform obtains data to be archived, wherein the data to be archived includes a first data set and a second data set, the storage structure of the data in the first data set is a first storage structure, and the storage structure of the data in the second data set is a second storage structure;
[0056] The host platform can be a computing device or system, such as a mainframe system based on the IBM Z series that runs the z / OS operating system, or a data center, cloud platform, etc., which is used to manage and process data to be archived and has high performance, high reliability and large-scale data processing capabilities.
[0057] The above-mentioned data to be archived can be data stored in the host platform that needs to be transferred and dumped. The data to be archived includes but is not limited to business data such as business transaction details of a bank account. Among them, the business data can be data of various file types, such as sequential type files, partition type files, extended partition type files, virtual storage access method type files, etc. The data storage structures of different file types are not the same.
[0058] The above-mentioned first data set can be a set of data of the first storage structure, such as a sequential type file set; the above-mentioned second data set can be a set of data of the second storage structure, that is, a set of data of other storage structures in the data to be archived except the first storage structure, such as partition type files, extended partition type files, virtual storage access method type files and other file sets, wherein the amount of data in the first data set in the data to be archived is greater than the amount of data in the second data set.
[0059] When data stored in a host platform needs to be transferred or dumped, all the data to be archived in the host platform that needs to be transferred or dumped is obtained and classified according to the file type (or storage structure of the data) into a first data set and another data set, wherein the amount of data in the first data set is much larger than the amount of data in the second data set. By classifying the files to be archived according to the file type, the most suitable transfer and dumping strategy can be adopted for different types of data, thereby facilitating the rational allocation of computing and storage resources, avoiding unnecessary waste of resources, and improving data processing efficiency. At the same time, it can more flexibly respond to user needs and emergencies, giving priority to processing critical data to meet business needs.
[0060] Step S204: the host platform converts the storage structure of the data in the second data set into the first storage structure to obtain a third data set;
[0061] The above-mentioned third data set can be a set of data obtained after the storage structure of the data in the second data set is converted. The storage structure of the data in the third data set is the first storage structure. For example, the third data set can be a file set after converting partition type files, extended partition type files, and virtual storage access method type files into sequential type files.
[0062] After obtaining all the data to be archived that needs to be transferred and dumped in the host platform, the storage structure of the data in the second data set with a small data volume is converted into the storage structure of the data in the first data set with a large data volume to obtain the third data set, thereby maintaining the uniformity of the storage structure of the data to be archived (that is, the data in the first data set and the data in the third data set), simplifying the subsequent data migration process, making data migration more efficient, and reducing the complexity of data processing; at the same time, it reduces the centralized demand for computing resources CPU, disk dump space, etc. in the process of converting all files of all file types in the host platform into open platform files at one time, reduces processing time and resource consumption, thereby shortening the dependence time on the host platform software and hardware, reducing overall operating costs, and thus realizing early shutdown of the host platform software and hardware.
[0063] In step S206, the host platform transmits the first data set and the third data set to the open platform, so that the open platform performs encoding conversion on the target data indicated in the target instruction when receiving the target instruction, wherein the first data set and the third data set include the target data.
[0064] These open platforms can be open service platforms that allow developers to perform data transmission, processing, and conversion operations to meet diverse application needs. They represent next-generation information processing and storage systems, such as servers based on X86 or ARM architectures running operating systems such as Linux, Unix, or Windows, or cloud computing platforms, distributed storage systems, big data platforms, and data warehouse systems. When banks upgrade their system architectures, open platforms can better adapt to modern information technologies such as cloud computing, distributed storage, and big data analytics. They offer excellent cross-platform compatibility and low operational and maintenance costs, making them a crucial support for the transition of banks' core business systems from a centralized to a distributed architecture.
[0065] The target data may be data that the user wants to obtain and view from the open platform; the target instruction may be an instruction for the user to obtain and view the target data, and the target instruction includes an identifier of the target data.
[0066] The above-mentioned encoding conversion can be the process of converting data between different character encoding systems. It usually occurs when different systems, software or platforms need to share or interpret text data, thereby ensuring the correct interpretation and display of data between different systems. For example, after reading data from a data file in the EBCDIC encoding format of the host platform, if it is to be processed on an open platform (such as Linux, Windows and other systems), the data is converted from EBCDIC encoding to a data file in the UTF-8 encoding format of the corresponding open platform.
[0067] The open platform receives and stores the data to be archived (i.e., the data in the first data set and the data in the third data set) after the file type conversion (i.e., storage structure conversion) sent by the host platform. When the user obtains the target data from the open platform, the open platform performs a transcoding operation on the target data obtained by the user, so that only the minimum set of archived data (i.e., target data) that meets the business needs needs to be transcoded during the data extraction operation on the open platform, rather than the existing host platform performing encoding conversion operations on the entire amount of archived data. Through the conversion method of the minimum set of archived data file encoding, accurate transcoding operations can be achieved for the archived data, reducing the huge consumption of computing resources and storage disk space of the open platform by the file encoding transcoding operation, improving the accuracy of file transcoding, and avoiding the blind implementation of file encoding conversion by default without considering business needs.
[0068] Optionally, the execution entity of the above steps can be a background processor, or other devices with similar processing capabilities, or a machine that integrates at least an image acquisition device and a data processing device, wherein the image acquisition device may include a graphics acquisition module such as a camera, and the data processing device may include a computer, a mobile phone and other terminals, but is not limited to this.
[0069] Through the above steps, the host platform obtains the data to be archived, and converts the storage structure of the data in the second storage structure in the data to be archived into the first storage structure to obtain the third data set, thereby transmitting the data to be archived (i.e., the data in the first data set and the data in the third data set) to the open platform, so that when the user obtains data from the open platform, only the target data required by the user is subjected to encoding conversion operations. The host platform only needs to perform storage format conversion operations on part of the data to be archived, and perform encoding conversion operations on the target data that the user needs to obtain through the open platform. The host platform does not need to perform file type conversion and file encoding conversion on the entire amount of data to be archived before transmitting it to the open platform for storage, thereby avoiding the problem of a long data archiving cycle caused by the huge amount of data to be archived, reducing the dependence of the data archiving process on the host platform, and at the same time, reducing the consumption of resources on the host platform and the open platform, saving time cost and operating cost. The problem of a long data archiving cycle in the related technology is solved, the archiving efficiency of data is improved, and the cost saving effect is achieved.
[0070] As an optional embodiment, after the host platform transmits the first data set and the third data set to the open platform, the method further includes: the open platform compresses the first data set and the third data set to obtain a compressed data set, wherein each compressed data in the compressed data set is obtained by compressing the corresponding data in the first data set and the third data set; and the open platform stores the compressed data set in the target storage area.
[0071] The compressed data set may be a set of data obtained by compressing each data in the first data set and each data in the third data set; the target storage area may be an area for storing data in the open platform, such as a tape library.
[0072] When the open platform receives the first data set and the third data set sent by the host platform, the open platform temporarily stores the first data set and the third data set on the disk of the open platform, compresses each data in the first data set and each data in the third data set stored on the disk, obtains multiple compressed data (i.e., compressed data sets), and then stores the multiple compressed data in the target storage area of the open platform, completing the preliminary transfer and dumping of the data to be archived. It should be noted that if the stored compressed data does not need to be verified, the transfer and dumping of the data to be archived is completed at this time, and the first data set and the third data set temporarily stored on the disk of the open platform, as well as the data to be archived in the host platform, can be deleted, and the host platform can be shut down; if the stored compressed data needs to be verified, the compressed data in the target storage area needs to be verified before the transfer and dumping of the data to be archived is finally completed.
[0073] As an optional embodiment, after the open platform stores the compressed data set in the target storage area, the method further includes: when the open platform receives a verification instruction, decompressing the compressed data in the compressed data set in response to the verification instruction to obtain the fourth data set; the open platform returns the fourth data set to the host platform.
[0074] The above-mentioned verification instruction can be an instruction for instructing the verification of the data to be archived (i.e., the compressed data in the compressed data set) stored in the open platform; the above-mentioned fourth data set can be a data set transmitted back by the open platform to the host platform for data verification, and the data in the fourth data set is obtained by decompressing the compressed data in the compressed data set.
[0075] When it is necessary to verify the data to be archived stored in the open platform, the open platform responds to the verification instruction, decompresses the compressed data in the compressed data set, obtains a fourth data set, and transmits the fourth data set back to the host platform so that the host platform completes the verification of the fourth data set (or compressed data).
[0076] Specifically, when the open platform receives a verification instruction, it decompresses the compressed data in the compressed data set in response to the verification instruction to obtain the fourth data set, including: the open platform decompresses all the compressed data in the compressed data set to obtain the fourth data set; or the open platform determines a first compressed data subset in the compressed data set according to a preset ratio, and decompresses each compressed data in the first compressed data subset to obtain the fourth data set.
[0077] The first compressed data subset may be a set consisting of partial compressed data in the compressed data set. The partial compressed data may be obtained from the compressed data set according to a preset ratio or according to the importance of the data.
[0078] By decompressing all the compressed data in the compressed data set to obtain a fourth data set and verifying the data in the fourth data set, the verification of the entire data can be achieved without complex judgment and selection of which data needs to be decompressed and verified. The process is simple and direct, and at the same time avoids the risk of missing some data when selecting part of the data for decompression, thereby improving the integrity and consistency of the data; by decompressing part (i.e., a preset proportion) of the compressed data in the compressed data set to obtain a fourth data set and verifying the fourth data set, the required computing resources and time can be significantly reduced, especially when the amount of data is very large, and the storage space occupied by the decompressed data can be reduced, which is very useful for scenarios with limited storage resources. Users can selectively decompress important or related data according to business needs or analysis objectives, thereby improving the flexibility of data processing.
[0079] As an optional implementation, after the open platform transmits the fourth data set back to the host platform, the method further includes: the host platform verifies the fourth data set; when the data in the fourth data set is consistent with the data in the first data set and / or the data in the third data set, the host platform determines that the data to be archived is successfully archived.
[0080] Upon receiving the fourth data set transmitted back from the open platform, the host platform verifies the data in the fourth data set and, if all data in the fourth data set is consistent with the data in the first data set and / or the data in the second data set, determines that the data to be archived has been successfully archived. By transmitting the rows of data to be archived stored in the open platform back from the open platform to the host platform disk, the host platform compares the returned data to be archived (i.e., the data in the fourth data set) with the data to be archived after original type conversion (i.e., the data in the first data set and the data in the third data set), ensuring that the data to be archived after multiple operation steps is recoverable and has not been damaged or lost, thereby guaranteeing the integrity and accuracy of the data.
[0081] As an optional implementation, after the host platform determines that the data to be archived is successfully archived, the method further includes: the host platform clearing the data to be archived.
[0082] As an optional implementation, upon receiving a target instruction, the open platform performs encoding conversion on the target data indicated in the target instruction, including: the open platform determines target compressed data in the target storage area according to the target instruction, wherein the target compressed data is data compressed from the target data, and a compressed data set is stored in the target storage area, and the compressed data set is obtained by the open platform compressing the first data set and the third data set; the open platform decompresses the target compressed data to obtain the target data; the open platform performs encoding conversion on the target data to obtain target encoded data; and the open platform displays the target encoded data.
[0083] The above-mentioned target compressed data can be the compressed data corresponding to the target data in the compressed data set stored in the open platform; when the open platform receives the target instruction, it determines the compressed data corresponding to the target data (i.e., the target compressed data) in the compressed data set stored in the target storage area according to the identifier of the target data carried in the target instruction, and decompresses the target compressed data to obtain the target data. At the same time, in order to ensure that the target data can be correctly interpreted and displayed on the system of the open platform, the target data is subjected to encoding conversion operations to obtain the target encoded data, and then the open platform displays the target encoded data.
[0084] As an optional implementation method, after the host platform clears the data to be archived, the host platform is shut down. At the same time, the software and hardware devices of the host platform are recovered, and the tape library hardware devices of the host platform are adaptively modified. For example, the space capacity of the open platform tape library is expanded to meet the demand for additional data archiving capacity on other open platforms in the future, or the open platform tape library is converted to a dual-write mode, and a copy of backup data is dual-written to two identical modified open platform tape libraries to solve the single point of the open platform tape library hardware device, improve the high availability of the open platform tape library, ensure the physical security of the archived data, etc., thereby eliminating the need to purchase new equipment and saving costs.
[0085] As an optional implementation, Figure 3 : is a flowchart of transferring and dumping archived data according to an embodiment of the present invention, such as Figure 3 As shown, the specific process is as follows:
[0086] S301, host file (i.e., data to be archived) type conversion: restoring the archived data (i.e., data to be archived) in the host platform tape library to the host platform disk, and converting the partition type file, the extended partition type file, and the virtual storage access method type file (i.e., data of the second storage structure in the second data set) into a sequential type file (i.e., data of the first storage structure in the third data set) using a host platform file type conversion program, and storing the resulting files after type conversion (i.e., data in the first data set and data in the third data set) on the host platform disk; specifically:
[0087] Recover (i.e., decompress) the archived data in the host platform tape library to the host platform disk for storage, and convert files other than sequential type files, including partition type files, extended partition type files, and virtual storage access method type files, into sequential type files through the host platform operating system and file type conversion program, so as to achieve the following logic: Figure 4 shown.
[0088] Among them, the host platform archive data is stored in the host platform tape library. The tape library can use IBM TS7700 tape library hardware equipment and the host's tape library management software. The tape library management software realizes functions such as data expiration management and data location management in the tape library.
[0089] Before performing host file type conversion, you need to deploy a physical host and host disk devices, and connect these devices to the host tape library (i.e., the host platform's tape library) hardware through optical fiber for access. Create a virtual machine on the physical host, install the host operating system, plan disk storage that meets the required capacity, and deploy the host file type conversion program. First, restore the archived data from the host platform's tape library to the host platform's disk by calling the host platform interface program ADRDSSU.
[0090] Next, the partition type files, extended partition type files, and virtual storage access method type files are converted into sequential type files in a batch processing manner, and the conversion results are also stored on the host platform disk device.
[0091] In actual operation, the host platform file type conversion program can be implemented using the host platform interface program IDCAMS. The partition type files, extended partition type files, and virtual storage access method type files recovered from the host platform tape library will be converted into a unified batch job according to the file name to realize the conversion operation of all files into sequential type files.
[0092] It should be noted that the above file type conversion process only controls some host files other than sequential type files. The total amount of data is far smaller than the sequential type files in the host tape library. This can avoid the type conversion of all types of host files at one time, as well as the centralized demand for computing resources CPU, disk transfer space, etc. during the process of converting all files into open platform files. This shortens the dependence time on the host platform software and hardware, and enables early shutdown of the host platform software and hardware.
[0093] S302, host platform file transfer: the sequential type result file (i.e., the data in the first data set and the data in the third data set) stored in the host platform disk after the file type conversion is implemented is transferred to the open platform via the network, and the result is stored in the open platform disk, realizing the logic as follows: Figure 5 As shown; specifically:
[0094] Reserve network bandwidth between the host platform operating system and the open platform operating system for data transfer between the two platforms. Recycle unused physical hosts and disks from the host platform and, after adaptation and modification, use them to build the host platform required for data transfer and dump. The host platform's physical hosts can be IBM Z14 mainframe hardware, with virtual machines created on them, running the ZOS operating system. Data transfer software, such as the host platform version of CA XCOM software, can also be deployed on them. Alternatively, the FTP function of the host operating system can be enabled.
[0095] Reclaim physical hosts and disks no longer used by the host platform and, after adaptation and modification, use them to build an open platform for data transfer, dumping, and future data archiving and retrieval. The open platform's physical host can be an IBM LinuxONE host, on which virtual machines can be created, running the Linux operating system, and data transmission software, such as the open platform version of CAXCOM software, deployed. Alternatively, the FTP function of the open platform operating system can be enabled.
[0096] After the network is ready, cross-platform bidirectional data transmission software can be deployed on the host platform operating system and the open platform operating system respectively. In practice, commercial XCOM software can be used, or the enabled FTP function can be used.
[0097] After the host platform performs file type conversion, all archived data files are converted into sequential files that can be transcoded by the open platform. Using the data transfer software, all archived sequential files (i.e., the data in the first data set and the data in the third data set) can be transferred from the host platform to the open platform.
[0098] To improve transmission efficiency, all sequential archived data files to be transferred can be organized into a centralized batch job, reducing manual intervention during the transfer process and enabling centralized batch transfer. Through the above process, all types of archived data in the original host platform tape library are converted into sequential files, transmitted over the network, and ultimately written to the open platform disk.
[0099] S303, open platform file backup: compress the sequential type result file stored in the open platform disk through the open platform transcoding program, and back up the compressed result file to the open platform tape library; specifically:
[0100] On the open platform, the original host platform's tape library hardware equipment can be fully utilized. By deploying fiber optic connections, the tape library equipment that is no longer used by the host platform can be connected to the open platform operating system. It can be used as a storage medium for future archived data on the open platform, solving the problem of purchasing new storage media for the open platform.
[0101] At the same time, when backing up sequential type files in the open platform disk (i.e., data in the first data set and data in the third data set) to the open platform tape library, the tar command of the Linux operating system can be used in combination with the compression control option to achieve simultaneous backup and compression.
[0102] To improve backup efficiency, batch scheduling software can be deployed in the open platform operating system to implement centralized scheduling of open platform to open tape library file backup operations, reduce manual operation links, and improve backup efficiency.
[0103] S304, open platform file recovery: the open platform performs recovery and decompression operations on the sequential type results (i.e., compressed data) backed up in the open platform tape library; specifically:
[0104] The archived data stored in the open platform tape library is restored (ie, decompressed) by using the tar command of the Linux platform in combination with a decompression option, and the restored result (ie, the fourth data set) is stored in the disk of the open platform.
[0105] It should be noted that during the process of transferring and dumping archived data on the host platform, the scope of data recovered (i.e., decompressed) from the open platform tape library is different from the scope of data recovered from only part of the archived data when data extraction operations are implemented on the open platform later to meet business needs.
[0106] S305, open platform file transmission: the decompressed result file (i.e., the data in the fourth data set) is transmitted back to the host platform via the network; specifically:
[0107] The compressed archived data in the open platform tape library (i.e., the compressed data in the compressed data set) is saved to the disk of the open platform through a recovery operation (i.e., a decompression operation). At the same time, in order to compare the recovered archived data (i.e., the data in the fourth data set) with the source archived data that has not been transmitted to the open platform (i.e., the data in the first data set and the data in the third data set) on the host platform, the archived data recovered on the open platform (i.e., the fourth data set) needs to be transferred back to the host platform disk again.
[0108] The method of transmitting data from the open platform back to the host platform is similar to that of transmitting data from the host platform to the open platform. The commercial CA XCOM software can be used, or the FTP function can be used.
[0109] S306, file consistency comparison: The host platform performs a consistency comparison between the returned file (i.e., the data in the fourth data set) and the result file after the type conversion performed on the original host platform (i.e., the data in the first data set and the data in the third data set) to ensure that the compression, backup, and recovery operations of the open platform have not caused additional changes to the files that have undergone the type conversion operation in the original host platform disk library; specifically:
[0110] In addition to the overall implementation time, another issue that must be addressed during the archive data transfer and dump process is to ensure that data type conversion, data migration, and the recovery and decompression of archived data in the open platform tape library on the open platform do not tamper with the content of the original host platform archive data, resulting in the loss of the original archived data.
[0111] Therefore, after backing up the type-converted host archive data (i.e., the first data set and the third data set) to the open platform tape library and before completing the shutdown of the host platform software and hardware, the archive data (i.e., the target data) in the open platform tape library is restored and decompressed from the open tape library (i.e., the tape library of the open platform) to the open platform disk, and then transferred back to the host platform disk. The returned archive data (i.e., the fourth data set) is compared with the original type-converted archive data (i.e., the first data set and the third data set) on the host platform to ensure that the archive data after multiple operation steps can be restored and the data content has not been accidentally modified, thereby realizing the logic as follows: Figure 6 shown.
[0112] Among them, the implementation method of file consistency comparison on the host platform (i.e., verifying the data in the fourth data set) is: first, it can be implemented by sampling method, the advantage of which is that the implementation time is short, but the sampling ratio is relatively difficult to determine; second, the full comparison method can be adopted. The disadvantage of the full comparison is that the time window required for the comparison is relatively long, but it can ensure the reliability of the conclusion of the consistency of all data; the implementation method adopted for file consistency comparison is not restricted here, and the implementation personnel can make appropriate choices based on the specific circumstances.
[0113] After file consistency comparison is complete, intermediate files from both the host platform disk and the open platform disk during the transfer process can be proactively cleared, enabling disk device recycling. In the future, archived data will be stored in open platform tape libraries rather than disk devices, saving hardware costs.
[0114] S307, host platform shutdown: shut down the host platform tape library, shut down the host platform operating system, and reclaim hardware resources such as the host platform tape library, physical host, and host platform disk.
[0115] After completing the conversion of the host platform file (i.e., the data to be archived) to the sequential file type, transmitting the result files (i.e., the first data set and the third data set) to the open platform through the network, and then backing up the open platform disk storage to the open tape library, the archived data stored in the open platform tape library (i.e., the compressed data in the compressed data set) is restored and decompressed, and then returned to the host platform to complete the data consistency comparison (i.e., verify the data in the fourth data set), the host platform tape library archived data transfer and dumping work is completed.
[0116] Subsequently, the data encoding conversion operation during the extraction of specific archived data based on business data extraction requirements on the open platform will no longer involve the host platform. Therefore, after completing the data consistency check, the software and hardware of the host platform can be shut down.
[0117] Through the above steps, since for the transfer and dump process of the archived data in the host platform tape library, only the file types of some host platforms that cannot be completely controlled by the open platform are converted in advance through the host platform software and type conversion program, the subsequent file encoding conversion operations will use the encoding conversion program on the open platform to complete the file encoding conversion operation of the sequential type files, rather than using the existing host platform to implement the file type conversion and file encoding conversion of the entire data. This can shorten the dependence time of the archived data transfer and dump on the host platform software and hardware, and complete the shutdown of all host platform hardware and software in advance.
[0118] In addition, if more host tape library hardware devices are taken offline, the offline host platform tape library hardware devices can also be adaptively modified. One way to reuse them is to expand the capacity of the open platform tape library space to meet the future demand for increased data archiving capacity on other open platforms. The second is to transform the open platform tape library into a dual-write mode, and write a copy of backup data to two identically modified open platform tape libraries to solve the single point of the open platform tape library hardware device, improve the high availability of the open platform tape library, and ensure the physical security of the archived data.
[0119] As an optional implementation, Figure 7 FIG. 1 is a flow chart of a method for extracting dump archived data from an open platform according to an embodiment of the present invention. Figure 7 As shown in the figure, the archived data (i.e., compressed data) stored in the open platform tape library is a host platform file in the EBCDIC encoding format. When data is extracted according to business needs, the file encoding conversion program deployed on the open platform needs to first complete the file encoding and transcoding operation for the specific data required to meet the business needs. The specific process is as follows:
[0120] S701, specific file data (i.e., target compressed data) recovery: Based on business requirements, sequential result files (i.e., target compressed data) stored in the open platform tape library that meet the business requirements are recovered and extracted using the open platform tape library's recovery program, and the recovered and extracted results (i.e., target data) that meet the minimum set of business requirements are stored in the open platform disk; specifically:
[0121] This is achieved through the same technology as the open platform file recovery process during the archive data transfer and dump process, that is, the archive data (i.e., target compressed data) stored in the open platform tape library is restored and decompressed through the tar command of the Linux platform, and the recovery result (i.e., target data) is saved on the disk of the open platform.
[0122] It should be noted that when implementing data extraction on the open platform to meet business needs, only part of the archived data is restored. This is different from the object of data recovery from the open platform tape library during the archived data transfer and dump process, which is the object of the archived data operation after type conversion.
[0123] S702, specific file (i.e., target data) encoding conversion: The open platform transcoding program is used to transcode (i.e., convert) the sequential type result file (i.e., target data) stored in the open platform disk that meets the business requirements, thereby completing the precise conversion operation from the host platform file encoding to the open platform file encoding of the recovered and extracted sequential type result file that meets the business requirements; specifically, the following steps are performed:
[0124] All archived data on the original host platform is converted into sequential files and stored in the open platform tape library. When business needs arise, the specific sequential files are converted from the host file encoding to the open platform file encoding through the file transcoding program on the open platform. The implementation process is as follows: Figure 8 shown.
[0125] The Linux tar command combined with the compression control option is used to complete the data recovery operation of the specific archived data (i.e., target compressed data) required for business data extraction from the open platform tape library to the open platform disk; the open platform file encoding transcoding program is used to perform file encoding transcoding operations on the recovery result file (i.e., target data) stored on the open platform disk, converting the EBCDIC encoding format into the UTF-8 encoding format.
[0126] It should be noted that during data extraction operations on the open platform, file transcoding is performed on the minimum set of archived data that meets business requirements, rather than the full range of archived data as implemented in existing host-based transfer and dump solutions. By converting the file encoding of the minimum set of archived data, precise transcoding of archived data is achieved, reducing the significant consumption of computing resources and storage disk space on the open platform, improving file transcoding accuracy, and eliminating the blind default implementation of file encoding conversion without considering business needs in existing solutions.
[0127] S703, display of the extracted data (i.e., target coded data): the result file (i.e., target coded data) that has completed the conversion operation from the host platform file encoding to the open platform file encoding that meets the business requirements is displayed in the open platform extraction display interface. Specifically:
[0128] Unlike the host platform that lacks graphic display tools, on an open platform based on the Linux operating system, a high-performance graphical interface can be opened to display the data extraction process, improving the interactivity during user operations and enhancing the user experience.
[0129] The data extraction display function can provide the operating user with a full display of the extraction process and extraction results. The display content includes but is not limited to the business date, creation time, file size, business component, etc. of the extracted data.
[0130] Data recovery and extraction personnel can visually confirm whether the data extraction is successful through the interface display, reducing the requirements for the host platform operation and maintenance background and ability level of operation and maintenance personnel.
[0131] As an optional implementation, Figure 9 Schematic diagram of an implementation device for archiving data transfer and dumping according to an embodiment of the present invention, such as Figure 9 As shown, it mainly includes: host platform tape library, host platform, open platform, open platform tape library, among which,
[0132] The host platform tape library is used to store host platform archived data (i.e., data to be archived) that requires transfer or dump operations. After completing the transfer or dump operation, the host platform tape library will be taken offline for processing. After being taken offline for modification, it can be reused for capacity expansion or high-availability upgrades of the open platform tape library.
[0133] The host platform consists of hardware such as the physical host and host disk, and its software includes the ZOS operating system, host file type conversion program, data transmission software, etc.
[0134] After the host platform restores the archived data files (i.e., data to be archived) in the host platform tape library to the host platform disk, the host platform converts the partition type files, extended partition type files, and virtual memory access method type files into sequential type files through a file type conversion program. After the host platform transfers all sequential type host files (i.e., first data and second data) to the open platform through data transmission software, the host platform receives the restored archived data (i.e., third data) returned by the open platform. The host platform receives the full archived data (i.e., third data) returned by the open platform after data recovery and decompression from the open platform tape library, and stores the returned full archived data on the host platform disk. The host platform performs a consistency comparison (i.e., verification of the third data) between the type-converted archived data (i.e., first data and second data) and the returned archived data (i.e., third data) to ensure the consistency of the data after network transmission, open tape library backup, recovery, decompression, etc. with the original data. After the archived data is transferred and dumped, the host platform will be taken offline, and the disk devices can be used to meet the storage capacity requirements of the open platform after adaptation and modification.
[0135] The open platform hardware can be composed of an IBM LinuxONE physical host plus a host disk that has been adapted and modified after being taken offline. The software consists of Linux operating system software, data transmission software, file encoding and transcoding program, and data extraction result display program.
[0136] During the host archive data transfer and dumping stage, the open platform writes the archive data that has completed the type conversion operation to the open platform tape library, completes the data migration operation of the host tape library data to the open platform tape library, and serves as a working environment for archive data extraction in the future; the open platform's data transmission software is used to receive the archive data (i.e., the first data and the second data) that has undergone file type conversion transmitted from the host platform, and sends the archive data (i.e., the third data) that has undergone data recovery, decompression, etc. on the open platform to the host platform for data consistency verification on the host platform; the open platform's file encoding and transcoding program performs transcoding operations (i.e., encoding conversion) on specific archive data (i.e., target data) recovered from the open tape library according to business extraction requirements, and realizes the file transcoding operation from EBCDIC encoding format to UTF-8 encoding format; the open platform's archive data extraction result display interface realizes the display of the extraction results (i.e., target encoding data) in the subsequent archive data extraction process of the open platform, reduces the implementation complexity of archive data extraction, and improves user experience.
[0137] The open platform tape library is a storage medium for receiving the open platform archive data (ie, data to be archived) that undergoes a transfer and dump operation.
[0138] It should be noted that the software and hardware equipment used to realize archived data transfer, dumping and archived data extraction are all recycled and reused from offline host platform equipment, and there is no need to purchase new equipment.
[0139] Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus the necessary general hardware platform, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present invention.
[0140] This embodiment also provides a data archiving device for implementing the above-mentioned embodiments and preferred implementations. Details already described will not be repeated. As used below, the term "module" may refer to a combination of software and / or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation using hardware, or a combination of software and hardware, is also possible and contemplated.
[0141] Figure 10 : is a structural block diagram of a data archiving device according to an embodiment of the present invention. Figure 10 As shown, applied to the above-mentioned host platform, the device includes: an acquisition module 1002, used to acquire the data to be archived, wherein the data to be archived includes: a first data set and a second data set, the storage structure of the data in the first data set is a first storage structure, and the storage structure of the data in the second data set is a second storage structure; a conversion module 1004, used to convert the storage structure of the data in the second data set into the first storage structure to obtain a third data set; a transmission module 1006, used to transmit the first data set and the third data set to the open platform, so that the open platform, when receiving the target instruction, performs encoding conversion on the target data indicated in the target instruction, wherein the first data set and the third data set include the target data.
[0142] As an optional implementation, after transmitting the first data set and the third data set to the open platform, the open platform is also used to compress the first data set and the third data set to obtain a compressed data set, wherein each compressed data in the compressed data set is obtained by compressing the corresponding data in the first data set and the third data set; and the compressed data set is stored in the target storage area.
[0143] As an optional embodiment, after the open platform stores the compressed data set in the target storage area, the open platform is also used to, upon receiving a verification instruction, decompress the compressed data in the compressed data set in response to the verification instruction to obtain the fourth data set; and return the fourth data set to the host platform.
[0144] As an optional embodiment, after the open platform transmits the fourth data set back to the host platform, the device is also used to verify the fourth data set; when the data in the fourth data set is consistent with the data in the first data set and / or the data in the third data set, the host platform determines that the data to be archived is successfully archived.
[0145] As an optional embodiment, when the open platform receives a verification instruction, the open platform is also used to decompress all the compressed data in the compressed data set to obtain the fourth data set; or, determine a first compressed data subset in the compressed data set according to a preset ratio, and decompress each compressed data in the first compressed data subset to obtain the fourth data set.
[0146] As an optional implementation, after the host platform determines that the data to be archived is successfully archived, the device is further configured to clear the data to be archived.
[0147] As an optional embodiment, when the open platform receives a target instruction, the open platform is further used to determine target compressed data in the target storage area according to the target instruction, wherein the target compressed data is data compressed from the target data, and a compressed data set is stored in the target storage area, and the compressed data set is obtained by the open platform compressing the first data set and the third data set; decompressing the target compressed data to obtain the target data; performing encoding conversion on the target data to obtain target encoded data; and displaying the target encoded data.
[0148] It should be noted that the above modules can be implemented through software or hardware. For the latter, it can be implemented in the following ways, but not limited to: the above modules are all located in the same processor; or the above modules are located in different processors in any combination.
[0149] An embodiment of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, the steps of any of the above methods are implemented.
[0150] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk.
[0151] An embodiment of the present invention further provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.
[0152] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.
[0153] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail here.
[0154] An embodiment of the present invention further provides a computer program product, including a computer program, which implements the steps of the method described in each embodiment of the present application when executed by a processor.
[0155] Obviously, those skilled in the art will appreciate that the various modules or steps of the present invention described above can be implemented using a general-purpose computing device, can be centralized on a single computing device, or can be distributed across a network of multiple computing devices. They can be implemented using program code executable by the computing device, and thus, can be stored in a storage device and executed by the computing device. In some cases, the steps shown or described herein can be performed in a different order than that shown, or can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, the present invention is not limited to any particular combination of hardware and software.
[0156] The foregoing description is merely a preferred embodiment of the present invention and is not intended to limit the present invention. Those skilled in the art will readily appreciate that various modifications and variations of the present invention are possible. Any modifications, equivalent substitutions, or improvements made within the principles of the present invention are intended to be within the scope of protection of the present invention.
Claims
1. A data archiving method, characterized in that: include: The host platform obtains data to be archived, wherein the data to be archived includes a first data set and a second data set, the storage structure of the data in the first data set is a first storage structure, and the storage structure of the data in the second data set is a second storage structure; The host platform converts the storage structure of the data in the second data set into the first storage structure to obtain a third data set; The host platform transmits the first data set and the third data set to the open platform so that the open platform, upon receiving the target instruction, performs encoding conversion on the target data indicated in the target instruction, wherein the first data set and the third data set include the target data.
2. The method according to claim 1, characterized in that After the host platform transmits the first data set and the third data set to the open platform, the method further includes: The open platform compresses the first data set and the third data set to obtain a compressed data set, wherein each compressed data in the compressed data set is obtained by compressing corresponding data in the first data set and the third data set; The open platform stores the compressed data set in a target storage area.
3. The method according to claim 2, characterized in that After the open platform stores the compressed data set in the target storage area, the method further includes: When the open platform receives the verification instruction, decompressing the compressed data in the compressed data set in response to the verification instruction to obtain a fourth data set; The open platform transmits the fourth data set back to the host platform.
4. The method according to claim 3, characterized in that After the open platform transmits the fourth data set back to the host platform, the method further includes: The host platform verifies the fourth data set; In a case where the data in the fourth data set is consistent with the data in the first data set and / or the data in the third data set, the host platform determines that the data to be archived is successfully archived.
5. The method according to claim 3, characterized in that When the open platform receives the verification instruction, decompressing the compressed data in the compressed data set in response to the verification instruction to obtain the fourth data set includes at least one of the following methods: The open platform decompresses all the compressed data in the compressed data set to obtain the fourth data set; The open platform determines a first compressed data subset in the compressed data set according to a preset ratio, and decompresses each compressed data in the first compressed data subset to obtain the fourth data set.
6. The method according to claim 4, characterized in that After the host platform determines that the data to be archived is successfully archived, the method further includes: The host platform clears the data to be archived.
7. The method according to claim 1, characterized in that When the open platform receives the target instruction, the open platform performs encoding conversion on the target data indicated in the target instruction, including: The open platform determines target compressed data in a target storage area according to the target instruction, wherein the target compressed data is data obtained by compressing the target data, and the target storage area stores a compressed data set, which is obtained by the open platform compressing the first data set and the third data set; The open platform decompresses the target compressed data to obtain the target data; The open platform performs encoding conversion on the target data to obtain target encoded data; The open platform displays the target encoded data.
8. A data archiving device, characterized in that: Applicable to host platforms, including: an acquisition module, configured to acquire data to be archived, wherein the data to be archived includes: a first data set and a second data set, the storage structure of the data in the first data set is a first storage structure, and the storage structure of the data in the second data set is a second storage structure; A conversion module, configured to convert the storage structure of the data in the second data set into the first storage structure to obtain a third data set; A transmission module is used to transmit the first data set and the third data set to the open platform, so that the open platform can encode the target data indicated in the target instruction when receiving the target instruction, wherein the first data set and the third data set include the target data.
9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, wherein the computer program implements the steps of the method according to any one of claims 1 to 7 when executed by a processor.
10. An electronic device comprising a memory and a processor, characterized in that: A computer program is stored in the memory, and the processor is configured to run the computer program to perform the method according to any one of claims 1 to 7.