A storage type conversion method, device and equipment

The method and device facilitate quick and effective conversion of object storage types in IaaS infrastructure by identifying and converting objects based on data access patterns and priorities, addressing the need for efficient storage type adaptation in enterprise environments.

CN111858497BActive Publication Date: 2024-12-03BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202010761389.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-07-31
Publication Date
2024-12-03
Estimated Expiration
2040-07-31

AI Technical Summary

Technical Problem

Enterprise users face the challenge of quickly and effectively converting object storage types based on their data hot and cold standards in IaaS infrastructure.

Method used

A method and device for determining candidate objects in a target server, identifying target objects that meet conversion conditions, and converting their storage types using a conversion interface based on data access patterns and priorities.

Benefits of technology

Enables rapid and effective conversion of object storage types in enterprise environments according to user-defined hot and cold data standards, optimizing storage efficiency and flexibility.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111858497B_ABST
    Figure CN111858497B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention provides a storage type conversion method, device and equipment. The method includes: determining each candidate object to be processed in the target server; determining the target object that meets the predetermined conversion condition from each candidate object; the conversion condition is the condition based on which it is determined whether any object can convert the storage type, and the conversion condition at least includes the number of accesses within a specified period meeting the predetermined number of conditions; by calling the conversion interface, the storage type of the target object in the target server is converted according to the conversion type corresponding to the conversion condition; the conversion type is the storage type to which the object that meets the conversion condition needs to be converted, and the conversion interface is an interface for converting the storage type of the object stored in the target server. Through this solution, the purpose of quickly and effectively converting the object storage type in the object storage used by the enterprise user according to the data hot and cold standards set by the enterprise user can be achieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of object storage technology, and in particular to a storage type conversion method, device and equipment. Background Art

[0002] IaaS infrastructure and services are a service model provided by cloud computing service providers, which mainly include CPU, memory, storage, network, virtualization software, distributed systems, etc., so that enterprise users do not need to worry about the supply of basic resources and only need to focus on deploying their own business application software. Among them, object storage is a common storage method under the IaaS service model. Specifically, different storage methods can be used for data with different hot and cold degrees, for example: hot data corresponds to standard storage, warm data corresponds to low-frequency storage, and cold data corresponds to archive storage.

[0003] In specific applications, enterprise users have the need to convert object storage types based on their own data hot and cold standards.

[0004] It can be seen that providing a storage type conversion solution to quickly and effectively convert the object storage type in the object storage used by enterprise users according to the data hot and cold standards set by enterprise users is an urgent problem to be solved. Summary of the invention

[0005] The purpose of the embodiments of the present invention is to provide a storage type conversion method, device and equipment to achieve the purpose of quickly and effectively converting the object storage type in the object storage used by enterprise users according to the data hot and cold standards set by enterprise users. The specific technical solution is as follows:

[0006] In a first aspect, an embodiment of the present invention provides a storage type conversion method, comprising:

[0007] Determine each candidate object to be processed in a target server; the target server is a cloud server for storing objects;

[0008] Determine a target object that satisfies a predetermined conversion condition from each candidate object; wherein the conversion condition is a condition for determining whether any object can convert the storage type, and the conversion condition at least includes that the number of accesses within a specified period meets a predetermined number condition;

[0009] By calling a conversion interface, converting the storage type of the target object in the target server according to a conversion type corresponding to the conversion condition;

[0010] The conversion type is the storage type to which the object satisfying the conversion condition needs to be converted, and the conversion interface is an interface for performing storage type conversion on the object stored in the target server.

[0011] Optionally, the determining each candidate object to be processed in the target server includes:

[0012] Determine objects that meet a predetermined pre-screening condition from objects stored in the target server, and obtain candidate objects to be processed;

[0013] The pre-screening conditions include: the parameter value of the target parameter of the object meets the specified parameter condition;

[0014] The target parameters include at least one parameter of the object name, the last modification time, the data size, the operation type of the access operation, and the storage type.

[0015] Optionally, after determining the target object that meets the predetermined conversion condition from the candidate objects, and before converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by calling the conversion interface, the method further includes:

[0016] Determining whether the target object meets a predetermined type locking condition;

[0017] When the judgment result is no, the step of converting the storage type of the target object in the target server by calling the conversion interface according to the conversion type corresponding to the conversion condition is executed.

[0018] Optionally, the number of the conversion conditions is at least one; each conversion condition is set with a priority;

[0019] The converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by calling the conversion interface includes:

[0020] If the target object satisfies at least two conversion conditions, the storage type of the target object in the target server is converted according to the conversion type corresponding to the target conversion condition by calling the conversion interface; the target conversion condition is the corresponding conversion condition satisfied by the target object;

[0021] If the target object satisfies only one conversion condition, the storage type of the target object in the target server is converted according to the conversion type corresponding to the conversion condition satisfied by the target object by calling the conversion interface.

[0022] Optionally, the target conversion condition is a conversion condition with the highest priority satisfied by the target object;

[0023] The converting the storage type of the target object in the target server by calling the conversion interface according to the conversion type corresponding to the target conversion condition includes:

[0024] If there are multiple target conversion conditions, using a preset priority relationship between storage types, determine a target conversion type with the highest corresponding priority from conversion types corresponding to each target conversion condition, and convert the storage type of the target object in the target server to the target conversion type;

[0025] If the number of the target conversion condition is one, the storage type of the target object in the target server is converted by calling the conversion interface and using the conversion type corresponding to the target conversion condition.

[0026] Optionally, the priority relationship between the storage types includes: the priority of low-frequency storage is lower than the priority of standard storage, and the priority of low-frequency storage is higher than the priority of archive storage.

[0027] In a second aspect, an embodiment of the present invention provides a storage type conversion device, including:

[0028] An object determination module, used to determine each candidate object to be processed in a target server; the target server is a cloud server for storing objects;

[0029] A screening module, used to determine, from among the candidate objects, a target object that satisfies a predetermined conversion condition; wherein the conversion condition is a condition for determining whether any object can be converted into a storage type, and the conversion condition at least includes that the number of accesses within a specified period meets a predetermined number condition;

[0030] A conversion module, configured to convert the storage type of the target object in the target server according to a conversion type corresponding to the conversion condition by calling a conversion interface;

[0031] The conversion type is the storage type to which the object satisfying the conversion condition needs to be converted, and the conversion interface is an interface for performing storage type conversion on the object stored in the target server.

[0032] In a third aspect, an embodiment of the present invention provides a storage type conversion system, including:

[0033] A rule management device, used to manage a predetermined conversion condition for object storage type conversion and a conversion type corresponding to the conversion condition; wherein the conversion condition is a condition based on which it is determined whether any object can convert its storage type, and the conversion condition at least includes that the number of accesses within a specified period meets a predetermined number of conditions; the conversion type is the storage type to which the object that meets the conversion condition needs to be converted;

[0034] An intelligent computing device, used to determine each candidate object to be processed in the target server; from each candidate object, determine the target object that meets the conversion condition managed by the rule management device; the target server is a cloud server for storing objects;

[0035] An operation execution device is used to convert the storage type of the target object in the target server by calling a conversion interface according to the conversion type corresponding to the conversion condition managed by the rule management device; wherein the conversion interface is an interface for converting the storage type of the object stored in the target server.

[0036] In a fourth aspect, an embodiment of the present invention provides an electronic device, including a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;

[0037] Memory, used to store computer programs;

[0038] The processor is used to implement the steps of the storage type conversion method provided in the embodiment of the present invention when executing the program stored in the memory.

[0039] In a fifth aspect, an embodiment of the present invention provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the steps of the storage type conversion method provided in the embodiment of the present invention are implemented.

[0040] Beneficial effects of the embodiments of the present invention:

[0041] In the solution provided by the embodiment of the present invention, the target object to be converted is determined from the candidate objects by using the conversion conditions related to the data hot and cold standards set by the enterprise user, and the storage type of the target object is converted according to the conversion type corresponding to the conversion conditions by calling the conversion interface related to the object storage used by the enterprise user, that is, the conversion interface corresponding to the target server. It can be seen that through this solution, the purpose of quickly and effectively converting the object storage type in the object storage used by the enterprise user according to the data hot and cold standards set by the enterprise user can be achieved.

[0042] Of course, it is not necessary to achieve all of the advantages described above at the same time to implement any product or method of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0044] Figure 1 A flowchart of a storage type conversion method provided by an embodiment of the present invention;

[0045] Figure 2 Another flow chart of a storage type conversion method provided by an embodiment of the present invention;

[0046] Figure 3 Another flow chart of a storage type conversion method provided by an embodiment of the present invention;

[0047] Figure 4 A schematic diagram of the interaction between the storage type conversion device, the log storage system and the target server;

[0048] Figure 5 A schematic diagram of the structure of a storage type conversion device provided by an embodiment of the present invention;

[0049] Figure 6 A schematic diagram of the structure of a storage type conversion system provided by an embodiment of the present invention;

[0050] Figure 7 A working principle diagram of the storage type conversion system provided by an embodiment of the present invention;

[0051] Figure 8 The present invention is a schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0052] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0053] In order to achieve the purpose of quickly and effectively converting the object storage type in the object storage used by enterprise users according to the data hot and cold standards set by the enterprise users, the embodiments of the present invention provide a storage type conversion method, device and equipment.

[0054] First, a storage type conversion method provided by an embodiment of the present invention is introduced below.

[0055] Among them, a storage type conversion method provided by an embodiment of the present invention is applied to an electronic device. Specifically, the execution subject of the storage type conversion method can be a storage type conversion device running in an electronic device. In a specific application, the storage type conversion device can be run in any device other than the target server that establishes a communication connection with the target server, wherein the target server is a storage server storing an object whose storage type is to be converted; of course, the storage type conversion device can also run in the target server. Exemplarily, in a scenario where a user client accesses the target server through an application server, the storage type conversion device can run in the application server; or, in a scenario where a user client directly accesses the target server, the storage type conversion device can run in a client device, which is a terminal device running a user client, and so on.

[0056] It should be noted that the target server is a cloud server for storing objects. Furthermore, the target server can be an object storage server provided by any third-party cloud vendor. That is to say, after an enterprise user uses an object storage server provided by any third-party cloud vendor to store objects, the storage type conversion device provided in the embodiment of the present invention can be used to implement storage type conversion.

[0057] Furthermore, in order to convert the storage type of objects in the target server through the storage type conversion device, a conversion interface may be pre-configured in the storage type conversion device, and the conversion interface is an interface for converting the storage type of objects stored in the target server, that is, the conversion interface is a conversion interface related to the object storage used by enterprise users. It is understandable that the conversion interface may be different for different target servers. In specific applications, since various interfaces including the conversion interface may exist in the SDK (simple develop key) provided by the cloud vendor to which the target server belongs, the SDK may be set in the storage type conversion device to achieve the purpose of pre-configuring the conversion interface, but of course it is not limited to this. It is understandable that by setting the SDK, the storage type conversion device can realize the modification and downloading of objects in the target server.

[0058] In addition, the objects involved in the embodiments of the present invention are usually unstructured data, such as pictures, videos or documents. Objects have metadata and object ids. Specifically, the metadata of an object can also be called the parameters of the object, which refers to the relevant description of the object, such as the size of the picture, the owner of the document, etc.; the object id is a global unique identifier used to distinguish objects. It can be understood by those skilled in the art that object storage can include multiple storage types, such as standard storage, that is, three-copy storage, as well as low-frequency storage and archive storage. Accordingly, the conversion type mentioned in the embodiments of the present invention can be any of the multiple storage types. Among them, three-copy storage specifically refers to storing three copies of a data in a storage device; for low-frequency storage, the storage method used can be an erasure code storage method; and for archive storage, the storage method used is a method of storing data in an offline storage server.

[0059] like Figure 1 As shown, a storage type conversion method provided by an embodiment of the present invention may include the following steps:

[0060] S101, determining each candidate object to be processed in the target server;

[0061] When performing storage type conversion on objects in the target server, each candidate object to be processed in the target server can be first determined, and then each candidate object can be analyzed for whether the storage type can be converted. In addition, the storage type conversion device can use all or part of the objects stored in the target server as the candidate objects to be processed, thereby realizing type conversion analysis for all or part of the objects in the target server.

[0062] Those skilled in the art will appreciate that the storage type conversion device can obtain each object stored in the target server by downloading object list information from the target server, wherein the object list information can record description information such as the object id, object name, format, data size, owner, etc.

[0063] In order to access the target server, the relevant information of the target server can be configured through the human-computer interaction interface, and the relevant information may include: the target server's access domain name, the key information for generating the signature required for identity authentication, the storage space information where the object is located, and whether to use encrypted access SSL (security socketlayer, secure socket), etc. Furthermore, the storage type conversion device can access the target server based on the pre-configured relevant information of the target server, and perform storage type conversion according to the pre-configured conversion interface, or download object list information according to the information access interface.

[0064] S102, determining a target object that meets a predetermined conversion condition from each candidate object; wherein the conversion condition is a condition based on which it is determined whether any object can be converted into a storage type, and the conversion condition at least includes that the number of accesses within a specified period meets a predetermined number of conditions;

[0065] The conversion condition and the conversion type corresponding to the conversion condition mentioned later can be configured by the configuration personnel of the enterprise user through the human-computer interaction interface. In addition, since the data hot and cold standard is related to the number of accesses, the conversion condition at least includes that the number of accesses within a specified period meets the predetermined number condition. The conversion type is the storage type to which the object that meets the conversion condition needs to be converted.

[0066] In specific applications, objects belonging to hot data can use standard storage, objects belonging to warm data can use low-frequency storage, and objects belonging to cold data can use archive storage. Then, the configuration personnel can set the conversion conditions and the conversion types corresponding to the conversion conditions according to the data hot and cold standards set by the enterprise users themselves, so as to match the hot and cold degree of the object with the storage type of the object. In other words, the conversion condition is the condition that needs to be met when determining that the object belongs to the target heat data, and the target heat data is: hot data, warm data or cold data; the conversion type corresponding to the conversion condition is the storage type that matches the target heat data. Among them, if the conversion condition is the condition that needs to be met when determining that the object belongs to hot data, the conversion type corresponding to the conversion condition is standard storage; if the conversion condition is the condition that needs to be met when determining that the object belongs to warm data, the conversion type corresponding to the conversion condition is low-frequency storage; if the conversion condition is the condition that needs to be met when determining that the object belongs to cold data, the conversion type corresponding to the conversion condition is archive storage.

[0067] Among them, hot data refers to the current hot data, which is data that needs to be accessed frequently for both users and system operation, such as new applications on the app store; warm data refers to data that is accessed less frequently as the data hotspot fades, such as the installation package file of a game that has lost popularity; cold data refers to data that is rarely accessed but needs to be stored and retained, such as bank transaction records from a few years ago. For example: Assuming that in the data hot and cold standards set by enterprise users, if any object is accessed more than 10 times in a week, the object is considered hot data. Then, the conversion condition can be set as: if the number of accesses in a week reaches more than 10 times, the conversion type corresponding to this conversion condition is standard storage; if any object is accessed more than 1 time and less than 10 times in a week, the object is considered warm data. Then, the conversion condition can be set as: if the number of accesses in a week exceeds 1 time and does not reach 10 times, the conversion type corresponding to this conversion condition is low-frequency storage; if any object is accessed less than 1 time in a week, the object is considered cold data. Then, the conversion condition can be set as: if the number of accesses in a week does not exceed 1 time, the conversion type corresponding to this conversion condition is archive storage.

[0068] It should be emphasized that, under the premise of considering the hot and cold standards, the values ​​of other parameters can also be considered, and the storage type conversion is performed only when all meet the conditions. Therefore, the conversion conditions may include: the number of accesses within a specified period meets the predetermined number of conditions, and the specified parameters meet the preset conditions. Among them, the specified parameters may include: data size, last modification time, etc.

[0069] For example: when the conversion condition only includes the number of accesses within a specified period meeting the predetermined number condition, the conversion condition may include: the number of accesses in the last thirty days exceeds 100 times, and accordingly, the conversion type corresponding to the conversion condition may be: standard storage; or, the conversion condition may include: the number of accesses in the last 180 days is not more than 10 times, and accordingly, the conversion type corresponding to the conversion condition may be low-frequency storage; or, the conversion condition may include: the number of accesses in the last 360 days is not more than 1 time, and accordingly, the conversion type corresponding to the conversion condition may be archive storage.

[0070] For example: when the conversion conditions include that the number of accesses within a specified period meets the predetermined number of conditions and the data volume meets the preset conditions, the conversion conditions may include: the number of accesses in the last thirty days exceeds 100 times and the data volume is not less than 10M, and accordingly, the conversion type corresponding to the conversion conditions may be: standard storage; or, the conversion conditions may include: the number of accesses in the last 180 days is not more than 10 times, and the data volume is greater than 20M, and accordingly, the conversion type corresponding to the conversion conditions may be low-frequency storage; or, the conversion conditions may include: the number of accesses in the last 360 days is not more than 1 time, and the data volume is greater than 30M, and accordingly, the conversion type corresponding to the conversion conditions may be archive storage.

[0071] In addition, for the number of accesses to any object within a specified period, the storage type conversion device can obtain the number of accesses to the target server through the log information about the target server. In order to obtain the access log, the access information of the log storage system storing the log information can be pre-configured, and then the log storage system can be accessed based on the access information of the log storage system. Figure 4 A schematic diagram of the interaction between the storage type conversion device, the log storage system and the target server is given.

[0072] S103, converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by calling the conversion interface;

[0073] The conversion type is the storage type to which the object meeting the conversion condition needs to be converted, and the conversion interface is a pre-configured interface for performing storage type conversion on the object stored in the target server.

[0074] After determining the target object, a pre-configured conversion interface can be called to convert the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition, that is, the target object is converted to be stored according to the conversion type. The number of target objects can be one or more, and for each target object, the storage type of the target object in the target server can be converted to the conversion type by calling the conversion interface.

[0075] Furthermore, by calling the conversion interface, the storage type of the target object in the target server is converted according to the conversion type corresponding to the conversion condition. Specifically, the object id and conversion type of the target object are passed as parameters to the target server through the conversion interface, so that the target server can complete the conversion of the storage type of the target object according to the object id and conversion type of the target object.

[0076] In the solution provided by the embodiment of the present invention, the target object to be converted is determined from the candidate objects by using the conversion conditions related to the data hot and cold standards set by the enterprise user, and the storage type of the target object is converted according to the conversion type corresponding to the conversion conditions by calling the conversion interface related to the object storage used by the enterprise user, that is, the conversion interface corresponding to the target server. It can be seen that through this solution, the purpose of quickly and effectively converting the object storage type in the object storage used by the enterprise user according to the data hot and cold standards set by the enterprise user can be achieved.

[0077] Optionally, the configuration personnel may configure at least one conversion condition. In this case, the number of conversion conditions obtained during the storage type conversion process may be at least one. The at least one conversion condition may correspond to the same or different conversion types. Furthermore, considering that an object may satisfy at least two conversion conditions at the same time, and the conversion type should be unique, a priority may be set for the at least one conversion condition, and each conversion condition is set with a priority, so that a unique conversion type can be selected later by the priority. The priority of each conversion condition may be specified by the configuration personnel, but is certainly not limited thereto.

[0078] For the sake of clarity, the following describes a storage type conversion method for object storage provided by an embodiment of the present invention for a situation where there are multiple conversion conditions.

[0079] like Figure 2 As shown, the storage type conversion method provided by the embodiment of the present invention may include the following steps:

[0080] S201, determining each candidate object to be processed in the target server;

[0081] In this embodiment, S201 is the same as the above-mentioned S101 and will not be described in detail here.

[0082] S202, determining a target object that satisfies at least one conversion condition from among various candidate objects;

[0083] Exemplarily, in one implementation, after determining each candidate object, it can be determined for each candidate object whether the candidate object satisfies at least one conversion condition, and if so, the candidate object is determined to be a target object that satisfies at least one conversion condition.

[0084] Exemplarily, in another implementation, after determining each candidate object, a target object that meets the conversion condition can be determined from each candidate object for each conversion condition. Any target object can meet only one conversion condition or at least two conversion conditions.

[0085] For the relevant contents of the conversion conditions, please refer to the corresponding contents in the above embodiments, which will not be elaborated here.

[0086] S203, if the target object satisfies at least two conversion conditions, converting the storage type of the target object in the target server according to the storage type corresponding to the target conversion condition by calling the conversion interface;

[0087] The target conversion condition is the corresponding conversion condition satisfied by the target object, that is, the conversion condition satisfied by the target object. In order to further meet the conversion needs of enterprise users, the target conversion condition can be the conversion condition with the highest priority satisfied by the target object.

[0088] Furthermore, the storage type of the target object is converted according to the conversion type corresponding to the target conversion condition, that is, the storage type of the target object in the target server is converted according to the conversion type corresponding to the target conversion condition.

[0089] S204: If the target object satisfies only one conversion condition, the storage type of the target object in the target server is converted according to the conversion type corresponding to the conversion condition satisfied by the target object by calling the conversion interface.

[0090] The number of target objects determined by S202 may be one or more. When the number of target objects is multiple, for each target object, specific storage type conversion may be performed according to S203-S204.

[0091] For any target object, if the target object meets at least two conversion conditions, since it is necessary to determine a unique conversion type, the conversion type corresponding to the conversion condition with the highest priority can be considered to be the type that best meets the needs of enterprise users. Therefore, when converting the type, the storage type of the target object in the target server can be converted according to the conversion type corresponding to the conversion condition with the highest priority.

[0092] For any target object, if the target object meets only one conversion condition, the storage type of the target object in the target server may be converted according to the conversion type corresponding to the conversion condition met by the target object.

[0093] Furthermore, by calling the conversion interface, the storage type of the target object in the target server is converted into any conversion type. Specifically, the object id of the target object and the any conversion type are passed as parameters to the target server through the conversion interface, so that the target server can complete the conversion of the storage type of the target object according to the object id of the target object and the any conversion type.

[0094] For a target object that satisfies at least two conversion conditions, there may be a situation where there are multiple target conversion conditions, that is, there are multiple conversion conditions corresponding to the highest priority. In order to ensure the uniqueness of the conversion type, the priority relationship of each storage type can be preset. In this way, when there are multiple target conversion conditions, the conversion type with the highest priority can be selected from the conversion types corresponding to the multiple target conversion conditions as the type to be converted. Based on this processing idea, the target conversion condition is the conversion condition with the highest priority satisfied by the target object; by calling the conversion interface, according to the conversion type corresponding to the target conversion condition, the storage type of the target object in the target server is converted, which may include:

[0095] If there are multiple target conversion conditions, using the preset priority relationship between the storage types, from the conversion types corresponding to the target conversion conditions, determine the target conversion type with the highest corresponding priority, and convert the storage type of the target object in the target server to the target conversion type;

[0096] If the number of the target conversion condition is one, the storage type of the target object in the target server is converted by calling the conversion interface and using the conversion type corresponding to the target conversion condition.

[0097] Exemplarily, the priority relationship of each storage type can be set according to the principle of ensuring the availability of object data. Exemplarily, the priority relationship of each storage type includes: the priority of low-frequency storage is lower than the priority of standard storage, and the priority of low-frequency storage is higher than the priority of archive storage.

[0098] In the solution provided by the embodiment of the present invention, the target object to be converted is determined from the candidate objects by using the conversion conditions related to the data hot and cold standards set by the enterprise user, and the storage type of the target object is converted according to the conversion type corresponding to the conversion conditions by calling the conversion interface related to the object storage used by the enterprise user, that is, the conversion interface corresponding to the target server. It can be seen that through this solution, the purpose of quickly and effectively converting the object storage type in the object storage used by the enterprise user according to the data hot and cold standards set by the enterprise user can be achieved. In addition, the number of conversion conditions can be at least one, and each conversion condition has a priority, so that the conversion of the storage type is more flexible and fast.

[0099] Considering that in some scenarios, it is not necessary to analyze whether the storage type of all objects in the target server is converted, but to analyze the storage type conversion of objects in a specific processing range. Based on this requirement, a pre-screening condition for filtering objects in a specific processing range can be set. Figure 1 and Figure 2In the illustrated embodiment, determining each candidate object to be processed in the target server may include:

[0100] From the objects stored in the target server, objects satisfying a predetermined pre-screening condition are determined to obtain various candidate objects to be processed.

[0101] Exemplarily, the pre-screening condition may include: the parameter value of the target parameter of the object meets the specified parameter condition. In a specific application, the target parameter includes at least one parameter of the object name, the last modification time, the data size, the operation type of the access operation, and the storage type, wherein the operation type of the access operation may include a read operation, a write operation, and a delete operation.

[0102] Furthermore, when the target parameter is one parameter, the specified parameter condition is the parameter condition corresponding to the one parameter; and when the target parameter is multiple parameters, the specified parameter condition is composed of the parameter conditions corresponding to the multiple parameters. The parameter conditions corresponding to different specified parameters may be different, for example: the parameter condition corresponding to the object name may be that the object name includes the specified characters, or that the prefix of the object name matches the specified characters; the parameter condition corresponding to the last modification time may be that the last modification time is not earlier than or later than the specified time point, or that the last modification time is equal to the specified time point; the parameter condition corresponding to the data volume may be that the data volume is greater than, less than or equal to the specified data volume; the parameter condition corresponding to the operation type of the access operation may be that a read operation, a write operation and / or a delete operation has occurred; the parameter condition corresponding to the storage type may be that the storage type is a specified type.

[0103] For example: when the target parameter is one, the pre-screening condition may include: the storage type is a specified type; or the data volume is less than a specified data volume;

[0104] When there are multiple target parameters, the pre-screening conditions may include: the prefix of the object name matches test*, the last modification time is earlier than January 10, 2020, and a read operation has occurred; or, the pre-screening conditions may include: the object name includes "important" and the data size is not greater than 100M.

[0105] In addition, it should be noted that the parameter value of the target parameter of the object in the target server can be determined by the target information record of the target server. Among them, the target information record may include: object list information of the object stored in the target server and / or access logs about the objects stored in the target server. The object list information may be information obtained by calling an information access interface, and the information access interface is a pre-configured interface for accessing the object list information about the target server. Among them, the information access interface corresponding to different target servers may be different, and the embodiment of the present invention does not limit this. In addition, in a specific application, the information access interface may be provided by the above-mentioned SDK.

[0106] In addition, in specific applications, there is a need to lock the storage type of a specific object, that is, whether the specific object meets the conversion conditions or not, the original storage type needs to be maintained. Based on this requirement, the configuration personnel can configure the type locking condition to further determine whether to convert the storage type. Then, in the above Figure 1 and Figure 2 In any of the embodiments shown, after determining the target object that meets the predetermined conversion condition from the candidate objects, before converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by calling the conversion interface, the method may also include:

[0107] Determine whether the target object meets the predetermined type locking condition;

[0108] When the judgment result is no, the step of converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by calling the conversion interface is executed.

[0109] The setting of the type locking condition may refer to the setting of the above-mentioned pre-screening condition. That is, the type locking condition may include: the parameter value of the specified parameter of the object meets the preset parameter condition. The specified parameters may include: the object name, the last modification time, the data size, the operation type of the access operation, and at least one parameter of the storage type. Moreover, when the specified parameter is one parameter, the preset parameter condition is the parameter condition corresponding to the one parameter; and when the specified parameter is multiple parameters, the preset parameter condition is composed of the parameter conditions corresponding to the multiple parameters.

[0110] For example: when the specified parameter is one, the type locking condition may include: the storage type is the specified type; or the data volume is less than the specified data volume;

[0111] When multiple parameters are specified, the type locking conditions may include: the prefix of the object name matches test*, the last modification time is earlier than January 10, 2020, and a read operation has occurred; or, the pre-screening conditions may include: the object name includes "important" and the data size is not greater than 100M.

[0112] The following describes a storage type conversion method for object storage provided by an embodiment of the present invention in conjunction with a specific embodiment.

[0113] like Figure 3 As shown, the storage type conversion method provided by the embodiment of the present invention may include the following steps:

[0114] S301, determining objects that meet a predetermined pre-screening condition from objects stored in the target server, and obtaining candidate objects to be processed;

[0115] S302: for each candidate object, determine whether the candidate object satisfies various conversion conditions. If the candidate object satisfies at least one conversion condition, determine that the candidate object is a target object.

[0116] S303, for each target object, determine whether the target object meets the predetermined type locking condition, if yes, end the processing of the target object; if no, execute S304 or S305;

[0117] S304, if the target object satisfies at least two conversion conditions, if there are multiple target conversion conditions, determine the target conversion type with the highest priority from the conversion types corresponding to the target conversion conditions by using the preset priority relationship between the storage types, and convert the storage type of the target object in the target server to the target conversion type; if there is one target conversion condition, convert the storage type of the target object in the target server by calling the conversion interface and using the conversion type corresponding to the target conversion condition;

[0118] S305: If the target object satisfies only one conversion condition, the storage type of the target object in the target server is converted according to the conversion type corresponding to the conversion condition satisfied by the target object by calling the conversion interface.

[0119] It can be seen that through this solution, the purpose of quickly and effectively converting the object storage type in the object storage used by enterprise users can be achieved according to the data hot and cold standards set by enterprise users. In addition, the number of conversion conditions can be multiple, and different conversion conditions correspond to different priorities, making the conversion of storage types more flexible and fast. At the same time, setting type locking conditions can meet the needs of locking the storage type of specific objects.

[0120] Corresponding to the above method embodiment, the embodiment of the present invention provides a storage type conversion device. Figure 5 As shown, the device is applied to electronic equipment and may include:

[0121] The object determination module 510 is used to determine each candidate object to be processed in the target server; the target server is a cloud server for storing objects;

[0122] The screening module 520 is used to determine the target object that meets the predetermined conversion condition from each candidate object; wherein the conversion condition is a condition based on which it is determined whether any object can be converted into a storage type, and the conversion condition at least includes that the number of accesses within a specified period meets the predetermined number condition;

[0123] The conversion module 530 is used to convert the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by calling the conversion interface;

[0124] The conversion type is the storage type to which the object satisfying the conversion condition needs to be converted, and the conversion interface is an interface for performing storage type conversion on the object stored in the target server.

[0125] In the solution provided by the embodiment of the present invention, the target object to be converted is determined from the candidate objects by using the conversion conditions related to the data hot and cold standards set by the enterprise user, and the storage type of the target object is converted according to the conversion type corresponding to the conversion conditions by calling the conversion interface related to the object storage used by the enterprise user, that is, the conversion interface corresponding to the target server. It can be seen that through this solution, the purpose of quickly and effectively converting the object storage type in the object storage used by the enterprise user according to the data hot and cold standards set by the enterprise user can be achieved.

[0126] Optionally, the object determination module 510 is specifically configured to:

[0127] Determine objects that meet a predetermined pre-screening condition from objects stored in the target server, and obtain candidate objects to be processed;

[0128] The pre-screening conditions include: the parameter value of the target parameter of the object meets the specified parameter condition;

[0129] The target parameters include at least one parameter of the object name, the last modification time, the data size, the operation type of the access operation, and the storage type.

[0130] Optionally, the device may further include:

[0131] A locking analysis module, configured to determine whether the target object satisfies a predetermined type locking condition before the conversion module converts the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition, after the screening module 520 determines the target object that satisfies a predetermined conversion condition from various candidate objects, by calling a conversion interface;

[0132] When the judgment result is no, the step of converting the storage type of the target object in the target server by calling the conversion interface according to the conversion type corresponding to the conversion condition is executed.

[0133] Optionally, the number of the conversion conditions is at least one; each conversion condition is set with a priority;

[0134] The conversion module 530 is specifically used for:

[0135] If the target object satisfies at least two conversion conditions, the storage type of the target object in the target server is converted according to the conversion type corresponding to the target conversion condition by calling the conversion interface; the target conversion condition is the corresponding conversion condition satisfied by the target object;

[0136] If the target object satisfies only one conversion condition, the storage type of the target object in the target server is converted according to the conversion type corresponding to the conversion condition satisfied by the target object by calling the conversion interface.

[0137] Optionally, the target conversion condition is a conversion condition with the highest priority satisfied by the target object;

[0138] The conversion module converts the storage type of the target object in the target server according to the conversion type corresponding to the target conversion condition by calling the conversion interface, including:

[0139] If there are multiple target conversion conditions, using a preset priority relationship between storage types, determine a target conversion type with the highest corresponding priority from conversion types corresponding to each target conversion condition, and convert the storage type of the target object in the target server to the target conversion type;

[0140] If the number of the target conversion condition is one, the storage type of the target object in the target server is converted by calling the conversion interface and using the conversion type corresponding to the target conversion condition.

[0141] Optionally, the priority relationship between the storage types includes: the priority of low-frequency storage is lower than the priority of standard storage, and the priority of low-frequency storage is higher than the priority of archive storage.

[0142] In addition, based on the above method embodiment, the embodiment of the present invention also provides a storage type conversion system. Figure 6 As shown, the storage type conversion system provided by the embodiment of the present invention may include:

[0143] The rule management device 610 is used for the rule management device, and is used to manage the predetermined conversion conditions for object storage type conversion and the conversion types corresponding to the conversion conditions; wherein the conversion conditions are conditions for determining whether any object can convert the storage type, and the conversion conditions at least include that the number of accesses within a specified period meets the predetermined number of conditions; the conversion type is the storage type to which the object that meets the conversion conditions needs to be converted;

[0144] The intelligent computing device 620 is used to determine each candidate object to be processed in the target server; determine the target object that meets the conversion condition managed by the rule management device from each candidate object; the target server is a cloud server for storing objects;

[0145] The operation execution device 630 is used to convert the storage type of the target object in the target server by calling the conversion interface according to the conversion type corresponding to the conversion condition managed by the rule management device; wherein the conversion interface is an interface for converting the storage type of the object stored in the target server.

[0146] Among them, the rule management device 610 can instruct the configuration personnel to configure the conversion conditions for object storage type conversion and the conversion types corresponding to the conversion conditions, for example: output an interface for object storage type conversion for the configuration personnel to configure the conversion conditions and conversion types; after the configuration is completed, the conversion conditions and the conversion types corresponding to the conversion conditions are saved, thereby realizing the management of rules for storage type conversion.

[0147] During type conversion, see Figure 7 As shown, the intelligent computing device can read the conversion conditions and the conversion types corresponding to the conversion conditions from the rule management device, determine the target object to be converted based on the obtained conversion conditions, and output the information of the target object to be converted to a predetermined storage area, wherein the information of the target object to be converted can include the ID of the target object and the conversion type to which the target object is to be converted; further, the operation execution device can read the information of the target object to be converted from the storage area, and use the conversion interface and the obtained information of the target object to perform storage type conversion on the target object in the target server.

[0148] In the solution provided by the embodiment of the present invention, through the cooperation of the rule management device, the intelligent computing device and the operation execution device, the conversion conditions related to the data hot and cold standards set by the enterprise user can be used to determine the target object to be converted from the candidate objects, and by calling the conversion interface related to the object storage used by the enterprise user, that is, the conversion interface corresponding to the target server, the storage type of the target object is converted according to the conversion type corresponding to the conversion condition. It can be seen that through this solution, the purpose of quickly and effectively converting the object storage type in the object storage used by the enterprise user according to the data hot and cold standards set by the enterprise user can be achieved.

[0149] The embodiment of the present invention further provides an electronic device, such as Figure 8 As shown, it includes a processor 801, a communication interface 802, a memory 803 and a communication bus 804, wherein the processor 801, the communication interface 802, and the memory 803 communicate with each other through the communication bus 804.

[0150] Memory 803, used for storing computer programs;

[0151] The processor 801 is used to implement the steps of the storage type conversion method provided in the embodiment of the present invention when executing the program stored in the memory 803.

[0152] The communication bus mentioned in the above electronic device can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0153] The communication interface is used for communication between the above electronic device and other devices.

[0154] The memory may include a random access memory (RAM) or a non-volatile memory (NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located away from the aforementioned processor.

[0155] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0156] In another embodiment provided by the present invention, a computer-readable storage medium is provided, in which a computer program is stored. When the computer program is executed by a processor, the steps of the storage type conversion method provided by the embodiment of the present invention are implemented.

[0157] In another embodiment of the present invention, a computer program product including instructions is provided. When the computer program product is run on a computer, the computer executes the steps of the storage type conversion method provided in the embodiment of the present invention.

[0158] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc.

[0159] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.

[0160] Each embodiment in this specification is described in a related manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for embodiments such as devices and electronic devices, since they are basically similar to method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0161] The above description is only a preferred embodiment of the present invention and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims

1. A storage type conversion method, characterized in that: Applied to a storage type conversion device, the storage type conversion device is run on an electronic device other than a target server and establishing a communication connection with the target server, the target server is an object storage server provided by any third-party cloud vendor, the method includes: Determine each candidate object to be processed in the target server; the target server is a cloud server for storing objects; wherein each candidate object to be processed is all or part of the objects stored in the target server, and the objects stored in the target server are determined based on the object list information downloaded from the target server; Determine a target object that satisfies a predetermined conversion condition from each candidate object; wherein the conversion condition is a condition for determining whether any object can convert the storage type, and the conversion condition at least includes that the number of accesses within a specified period meets a predetermined number condition; By calling a conversion interface, converting the storage type of the target object in the target server according to a conversion type corresponding to the conversion condition; The conversion type is the storage type to which the object that meets the conversion condition needs to be converted, the conversion interface is an interface for performing storage type conversion on the object stored in the target server, and the conversion interface is obtained in the storage type conversion device by setting the SDK provided by the third-party cloud vendor to which the target server belongs; The storage type adopts the storage method of: three-copy storage, erasure code storage, or offline storage server storage; The number of the conversion conditions is at least one; each conversion condition is set with a priority; The converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by calling the conversion interface includes: If the target object satisfies at least two conversion conditions, the storage type of the target object in the target server is converted according to the conversion type corresponding to the target conversion condition by calling the conversion interface; the target conversion condition is the corresponding conversion condition satisfied by the target object; If the target object satisfies only one conversion condition, converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition satisfied by the target object by calling the conversion interface; The target conversion condition is the conversion condition with the highest priority satisfied by the target object; The converting the storage type of the target object in the target server by calling the conversion interface according to the conversion type corresponding to the target conversion condition includes: If there are multiple target conversion conditions, using a preset priority relationship between storage types, determine a target conversion type with the highest corresponding priority from conversion types corresponding to each target conversion condition, and convert the storage type of the target object in the target server to the target conversion type; If the number of the target conversion condition is one, the storage type of the target object in the target server is converted by calling the conversion interface and using the conversion type corresponding to the target conversion condition.

2. The method according to claim 1, characterized in that The step of determining each candidate object to be processed in the target server includes: Determine objects that meet a predetermined pre-screening condition from objects stored in the target server, and obtain candidate objects to be processed; The pre-screening conditions include: the parameter value of the target parameter of the object meets the specified parameter condition; The target parameters include at least one parameter of the object name, the last modification time, the data size, the operation type of the access operation, and the storage type.

3. The method according to claim 1 or 2, characterized in that: After determining the target object that meets the predetermined conversion condition from the candidate objects, and before converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition by calling the conversion interface, the method further includes: Determining whether the target object meets a predetermined type locking condition; When the judgment result is no, the step of converting the storage type of the target object in the target server by calling the conversion interface according to the conversion type corresponding to the conversion condition is executed.

4. The method according to claim 1, characterized in that: The priority relationship of each storage type includes: the priority of low-frequency storage is lower than the priority of standard storage, and the priority of low-frequency storage is higher than the priority of archive storage.

5. A storage type conversion device, characterized in that: The storage type conversion device is run on an electronic device other than the target server and establishing a communication connection with the target server, and the target server is an object storage server provided by any third-party cloud vendor, and the device includes: An object determination module, used to determine each candidate object to be processed in a target server; the target server is a cloud server for storing objects; wherein each candidate object to be processed is all or part of the objects stored in the target server, and the objects stored in the target server are determined based on the object list information downloaded from the target server; A screening module, used to determine, from among the candidate objects, a target object that satisfies a predetermined conversion condition; wherein the conversion condition is a condition for determining whether any object can be converted into a storage type, and the conversion condition at least includes that the number of accesses within a specified period meets a predetermined number condition; A conversion module, configured to convert the storage type of the target object in the target server according to a conversion type corresponding to the conversion condition by calling a conversion interface; The conversion type is the storage type to which the object that meets the conversion condition needs to be converted, the conversion interface is an interface for performing storage type conversion on the object stored in the target server, and the conversion interface is obtained in the storage type conversion device by setting the SDK provided by the third-party cloud vendor to which the target server belongs; The storage type adopts the storage method of: three-copy storage, erasure code storage, or offline storage server storage; The number of the conversion conditions is at least one; each conversion condition is set with a priority; The conversion module is specifically used to convert the storage type of the target object in the target server according to the conversion type corresponding to the target conversion condition by calling the conversion interface if the target object satisfies at least two conversion conditions; the target conversion condition is the corresponding conversion condition satisfied by the target object; If the target object satisfies only one conversion condition, converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition satisfied by the target object by calling the conversion interface; The target conversion condition is the conversion condition with the highest priority satisfied by the target object; The conversion module is specifically configured to, if there are multiple target conversion conditions, determine the target conversion type with the highest corresponding priority from the conversion types corresponding to the target conversion conditions by using the preset priority relationship between the storage types, and convert the storage type of the target object in the target server to the target conversion type; If the number of the target conversion condition is one, the storage type of the target object in the target server is converted by calling the conversion interface and using the conversion type corresponding to the target conversion condition.

6. A storage type conversion system, characterized in that: The storage type conversion system is run on an electronic device other than a target server and establishing a communication connection with the target server, and the target server is an object storage server provided by any third-party cloud vendor; the system includes: A rule management device, used to manage a predetermined conversion condition for object storage type conversion and a conversion type corresponding to the conversion condition; wherein the conversion condition is a condition based on which it is determined whether any object can convert its storage type, and the conversion condition at least includes that the number of accesses within a specified period meets a predetermined number of conditions; the conversion type is the storage type to which the object that meets the conversion condition needs to be converted; An intelligent computing device, used for determining each candidate object to be processed in a target server; determining a target object satisfying the conversion condition managed by the rule management device from each candidate object; the target server is a cloud server for storing objects; each candidate object to be processed is all or part of the objects stored in the target server, and the objects stored in the target server are determined based on the object list information downloaded from the target server; The operation execution device is used to convert the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition managed by the rule management device by calling the conversion interface; wherein the conversion interface is an interface for performing storage type conversion on the object stored in the target server; the conversion interface is obtained by setting the SDK provided by the third-party cloud vendor to which the target server belongs in the storage type conversion system; The storage type adopts the storage method of: three-copy storage, erasure code storage, or offline storage server storage; The number of the conversion conditions is at least one; each conversion condition is set with a priority; The operation execution device is specifically used to convert the storage type of the target object in the target server according to the conversion type corresponding to the target conversion condition by calling the conversion interface if the target object satisfies at least two conversion conditions; the target conversion condition is the corresponding conversion condition satisfied by the target object; If the target object satisfies only one conversion condition, converting the storage type of the target object in the target server according to the conversion type corresponding to the conversion condition satisfied by the target object by calling the conversion interface; The target conversion condition is the conversion condition with the highest priority satisfied by the target object; The operation execution device is specifically used to, if there are multiple target conversion conditions, determine the target conversion type with the highest corresponding priority from the conversion types corresponding to the target conversion conditions by using the preset priority relationship between the storage types, and convert the storage type of the target object in the target server to the target conversion type; If the number of the target conversion condition is one, the storage type of the target object in the target server is converted by calling the conversion interface and using the conversion type corresponding to the target conversion condition.

7. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; Memory, used to store computer programs; A processor, for implementing any of the methods described in claims 1-4 when executing a program stored in a memory.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 4 is implemented.