[0013] The present invention will be further described in detail below in conjunction with the drawings.
[0014] figure 1 The flow chart of a method for managing meta information according to the present invention is illustrated. The method according to the invention comprises step S1.
[0015] Among them, the method according to the present invention is implemented by an information management device included in a computer device. The computer device includes an electronic device that can automatically perform numerical calculation and/or information processing in accordance with pre-set or stored instructions. Its hardware includes, but is not limited to, a microprocessor, an application specific integrated circuit (ASIC), and a programmable gate. Array (FPGA), digital processor (DSP), embedded device, etc. The computer equipment includes network equipment and/or user equipment. Wherein, the network device includes, but is not limited to, a single network server, a server group composed of multiple network servers, or a cloud composed of a large number of hosts or network servers based on Cloud Computing, where cloud computing is distributed computing One type, a super virtual computer composed of a group of loosely coupled computer sets. The user equipment includes, but is not limited to, any electronic product that can interact with the user through a keyboard, a mouse, a remote control, a touch panel, or a voice control device, for example, a personal computer, a tablet computer, a smart phone, and a PDA. , Game console, or IPTV, etc. Wherein, the network where the user equipment and the network equipment are located includes, but is not limited to, the Internet, a wide area network, a metropolitan area network, a local area network, a VPN network, etc.
[0016] Preferably, the equipment in which the information management apparatus according to the present invention is located is included in the target system. Wherein, the target system includes various data storage systems.
[0017] It should be noted that the user equipment, network equipment, and network are only examples, and other existing or future user equipment, network equipment, and networks that are applicable to the present invention should also be included in the protection scope of the present invention. And is included here by reference.
[0018] Reference figure 1 In step S1, the information management device stores or updates its corresponding meta-information in each data block of the target system.
[0019] Preferably, the manner in which the information management apparatus stores meta-information includes but is not limited to at least any of the following:
[0020] 1) Store meta-information in the underlying file system; preferably, such meta-information includes the length of the data block, the identification information of the device where it is located, etc.;
[0021] 2) Store meta-information in the name of the data block; preferably, this type of meta-information includes identification information of the data block, information on the compression method of the data block, etc.;
[0022] 3) Store the meta-information in the data header of the data block; preferably, this type of meta-information includes meta-information that does not need to be constructed immediately when the system is started, mainly including the compressed block index information of the file and so on.
[0023] According to a preferred embodiment of the present invention, based on the service type information of the data to be stored, the information management device stores the data block and its meta-information corresponding to the data to be stored in a specific storage medium, so as to separately store data in each storage medium. Meta information for management.
[0024] The storage medium includes various types of media media, such as Serial Advanced Technology Attachment (SATA), Solid State Disk (SSD), memory files, archive disks, cloud disks, and so on.
[0025] Preferably, the information management device separately manages the meta information of the data blocks in each storage medium.
[0026] More preferably, for the same storage medium, the information management apparatus can separately manage the meta-information of data blocks stored in different devices.
[0027] According to the method of this preferred embodiment, different storage media can be selected for storage based on the service type of the data, and the meta-information in the different storage media can be managed, thereby reducing the competitive relationship between different services and avoiding low-priority service pairs. High-priority services bring performance impact; and the meta-information of different devices can be managed independently, thereby reducing cross-device competition.
[0028] Preferably, the method according to the present invention includes step S2 (not shown).
[0029] In step S2, when the system metadata needs to be loaded, the information management device creates multiple threads to load metadata information of the data blocks in multiple disks.
[0030] According to a preferred embodiment of the present invention, in the startup phase of the target system, the method includes step S3 (not shown), and the step S2 includes step S201 (not shown).
[0031] In step S3, the information management device determines the disk information that needs to be filtered out according to the blacklist information of the target system, so as to obtain one or more disk information that can be used.
[0032] Preferably, the disk information that needs to be filtered out includes broken disks or storage media that cannot be used due to other reasons.
[0033] In step S201, the information management apparatus creates multiple threads based on the available one or more disk information to load metadata information of the data blocks in each disk.
[0034] Preferably, the method according to the preferred embodiment includes step S4 (not shown in the figure).
[0035] In step S4, the information management device loads the low compression rate data block information of each disk, thereby skipping each low compression rate data block when the target system performs transparent compression.
[0036] Wherein, the low compression rate data block information is used to skip directly during transparent compression. Among them, transparent compression is a regular task that is performed in the background to compress uncompressed data into specified types of data on a regular basis, and is a kind of periodic compression of non-compressed data into specified types of data performed in the background. Timed work tasks.
[0037] Preferably, the method according to this preferred embodiment includes step S5 (not shown in the figure).
[0038] In step S5, the information management device performs deduplication processing on the data blocks loaded by each disk according to the usage information and status information of each disk that has been scanned.
[0039] According to the method of the present invention, by storing the meta-information in the data block, the loss of a large amount of data due to file damage can be avoided, and the security of data storage is improved; and, according to the solution of the present invention, multiple threads can be created in parallel. The way to load the meta information, thereby improving the system startup speed.
[0040] figure 2 The schematic diagram illustrating the structure of an information management device for managing meta-information according to the present invention. The information management device includes a device (hereinafter referred to as "storage device 1") for storing or updating its corresponding meta-information in each data block of the target system.
[0041] The storage device 1 stores or updates the corresponding meta information in each data block of the target system.
[0042] Preferably, the manner in which the storage device 1 stores meta information includes but is not limited to at least any of the following:
[0043] 1) Store meta-information in the underlying file system; preferably, such meta-information includes the length of the data block, the identification information of the device where it is located, etc.;
[0044] 2) Store meta-information in the name of the data block; preferably, this type of meta-information includes identification information of the data block, information about the compression method of the data block, etc.;
[0045] 3) Store the meta-information in the data header of the data block; preferably, this type of meta-information includes meta-information that does not need to be constructed immediately when the system is started, mainly including the compressed block index information of the file and so on.
[0046] According to a preferred embodiment of the present invention, the storage device 1 stores the data block corresponding to the to-be-stored data and its meta-information in a specific storage medium based on the service type information of the to-be-stored data, so that each storage medium can be stored separately. Meta information for management.
[0047] The storage medium includes various types of media media, such as Serial Advanced Technology Attachment (SATA), Solid State Disk (SSD), memory files, archive disks, cloud disks, and so on.
[0048] Preferably, the information management device separately manages the meta information of the data blocks in each storage medium.
[0049] More preferably, for the same storage medium, the information management apparatus can separately manage the meta-information of data blocks stored in different devices.
[0050] According to the solution of this preferred embodiment, different storage media can be selected for storage based on the service type of the data, and the meta-information in different storage media can be managed, thereby reducing the competitive relationship between different services and avoiding low-priority service pairs. High-priority services bring performance impact; and the meta-information of different devices can be managed independently, thereby reducing cross-device competition.
[0051] Preferably, the information management device according to the present invention includes a method for creating multiple threads to load metadata information of data blocks in multiple disks (not shown in the figure, hereinafter referred to as "loading device ").
[0052] When the system metadata needs to be loaded, the loading device creates multiple threads to load the metadata information of the data blocks in the multiple disks.
[0053] According to a preferred embodiment of the present invention, during the startup phase of the target system, the information management device includes information for determining the disk information that needs to be filtered out according to the blacklist information of the target system, so as to obtain one or more disks that can be used Information device (not shown in the figure, hereinafter referred to as "determining device").
[0054] The determining device determines the disk information to be filtered out according to the blacklist information of the target system, so as to obtain one or more disk information that can be used.
[0055] Preferably, the disk information that needs to be filtered out includes broken disks or storage media that cannot be used due to other reasons.
[0056] The loading device creates multiple threads based on the available one or more disk information to load the metadata information of the data blocks in each disk.
[0057] Preferably, the information management device according to the preferred embodiment includes a device for loading data block information with low compression rate of each disk, so that when the target system performs transparent compression, each data block with low compression rate is skipped (not shown in the figure). Show, hereinafter referred to as "data loading device").
[0058] The data loading device loads the low compression rate data block information of each disk, thereby skipping each low compression rate data block when the target system performs transparent compression.
[0059] Wherein, the low compression rate data block information is used to skip directly during transparent compression. Among them, transparent compression is a regular task that is performed in the background to compress uncompressed data into specified types of data on a regular basis, and is a kind of periodic compression of non-compressed data into specified types of data performed in the background. Timed work tasks.
[0060] Preferably, the information management device according to the preferred embodiment includes a device for deduplicating data blocks loaded on each disk according to the usage information and status information of each disk that has been scanned (not shown in the figure, hereinafter referred to as Heavy processing device").
[0061] The deduplication processing device performs deduplication processing on the data blocks loaded by each disk according to the use information and status information of each scanned disk.
[0062] According to the solution of the present invention, by storing the meta-information in the data block, the loss of a large amount of data due to file damage can be avoided, and the security of data storage is improved; and, according to the solution of the present invention, multiple threads can be created in parallel. The way to load meta information, thus improving the system startup speed.
[0063] The software program of the present invention can be executed by a processor to realize the steps or functions described above. Similarly, the software program (including related data structure) of the present invention can be stored in a computer-readable recording medium, such as a RAM memory, a magnetic or optical drive or a floppy disk and similar devices. In addition, some steps or functions of the present invention may be implemented by hardware, for example, as a circuit that cooperates with a processor to perform various functions or steps.
[0064] In addition, a part of the present invention can be applied as a computer program product, such as a computer program instruction, when executed by a computer, the method and/or technical solution according to the present invention can be invoked or provided through the operation of the computer. The program instructions for invoking the method of the present invention may be stored in a fixed or removable recording medium, and/or transmitted through a data stream in a broadcast or other signal bearing medium, and/or stored in a The program instructions run in the working memory of the computer equipment. Here, an embodiment according to the present invention includes a device including a memory for storing computer program instructions and a processor for executing the program instructions, wherein, when the computer program instructions are executed by the processor, trigger The operation of the device is based on the aforementioned methods and/or technical solutions according to multiple embodiments of the present invention.
[0065] For those skilled in the art, it is obvious that the present invention is not limited to the details of the foregoing exemplary embodiments, and the present invention can be implemented in other specific forms without departing from the spirit or basic characteristics of the present invention. Therefore, from any point of view, the embodiments should be regarded as exemplary and non-limiting. The scope of the present invention is defined by the appended claims rather than the above description, and therefore it is intended to fall within the claims. All changes within the meaning and scope of the equivalent elements of are included in the present invention. Any reference signs in the claims should not be regarded as limiting the claims involved. In addition, it is obvious that the word "including" does not exclude other units or steps, and the singular does not exclude the plural. Multiple units or devices stated in the system claims can also be implemented by one unit or device through software or hardware. Words such as first and second are used to denote names, but do not denote any specific order.
