Data storage method and device, computer equipment, storage medium and program product
By obtaining user-defined policy and historical access information, dynamically determining data storage policies, and realizing automatic classification and storage of data objects, it solves the problems of high storage costs and difficult management caused by changes in data access patterns in traditional storage services, and improves data access speed and security.
Patent Information
- Application Number
- CN202411781253.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-05
- Publication Date
- 2025-03-21
AI Technical Summary
In traditional object storage services, users manually select storage categories, and cannot effectively deal with changes in data access mode, resulting in high storage costs, poor data access experience, and high management difficulty.
By obtaining the user-defined data storage policy and historical access information of the target server, extracting feature access information, dynamically determining the data storage policy, and realizing automatic classification storage of data objects.
Reduces the difficulty and cost of data storage, improves data access speed and storage security, and simplifies data object management.
Smart Images

Figure CN119669169A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of data storage, and in particular to a data storage method, apparatus, computer equipment, storage medium and program product. Background Art
[0002] With the rapid development of the digital economy, the amount of data has exploded. As an efficient data storage solution, object storage has attracted attention for its high scalability, flexibility and cost-effectiveness. Nowadays, object storage data storage solutions have been widely used in cloud computing, big data, network resource distribution and other fields.
[0003] However, with the development of new infrastructure such as artificial intelligence and industrial Internet, the data generated is growing exponentially. How to effectively manage this data, reduce storage costs, and ensure fast access and security of data has become a pressing problem to be solved.
[0004] In traditional object storage services, users are generally provided with limited storage category options. Users manually select the appropriate storage category for the bucket based on the access frequency and importance of the data. After the user selects the storage category, access to the data is restricted by the storage category. However, as time goes by, the user's access pattern will also change. Some low-frequency data objects may become hot data, and the storage category limits the access experience to the data. At the same time, the access frequency of some data objects may decrease or even tend to be no longer accessed. If users rely on manual adjustment of data object categories, as the amount of data increases, in the case of large amounts of data, it will bring a lot of tedious work to users, and at the same time, data security cannot be guaranteed. It will make it difficult to reasonably manage data storage categories, and at the same time bring high storage costs to users. Summary of the invention
[0005] Based on this, it is necessary to provide a data storage method, device, computer equipment, storage medium and program product to address the above-mentioned technical problems, which can automatically classify and store data objects, thereby reducing the difficulty of data storage, saving data storage costs, further reducing the management difficulty and management costs of data objects, increasing data access speed, and improving the security of data storage.
[0006] A first aspect of an embodiment of the present application provides a data storage method, including:
[0007] Get the user-defined data storage policy of the target server;
[0008] Obtaining historical access information of the target server;
[0009] Extracting features from the historical access information to obtain feature access information;
[0010] Determining a dynamic data storage strategy of the target server according to the characteristic access information;
[0011] Determining a target data storage policy of the target server according to the user-defined data storage policy and the dynamic data storage policy;
[0012] According to the target data storage policy, the data object to be stored in the target server is stored.
[0013] In some embodiments, the user-defined data storage policy includes at least one of a data object access frequency, a storage cost budget of a target server, and a data object retention period; and / or,
[0014] The historical access information includes at least one of the accessed data object, access time, accessor identity, access request type and accessed data object capacity; and / or,
[0015] The target data storage strategy includes at least one of a standard data storage strategy, a low-frequency data storage strategy, and an archive data storage strategy.
[0016] In some implementations, obtaining a user-defined data storage policy for the target server includes:
[0017] Collect user input for custom data storage strategies;
[0018] Acquire the data storage rules of the target server;
[0019] The user-defined data storage policy of the target server is determined according to the data storage rule and the custom data storage policy.
[0020] In some implementations, obtaining the historical access information of the target server includes:
[0021] Obtaining a first data object access log of the target server;
[0022] Screening the first data object access log to obtain a second data object access log;
[0023] The second data object access log is formatted to obtain the historical access information.
[0024] In some implementations, storing the data object to be stored in the target server according to the target data storage policy includes:
[0025] Acquire storage information of the data object to be stored, wherein the storage information includes at least one of an access mode, a storage cost, and a storage performance requirement;
[0026] Determine a target storage mode corresponding to the data object to be stored according to the storage information;
[0027] According to the target storage mode, the data objects to be stored in the target server are stored.
[0028] In some embodiments, the data storage method further comprises:
[0029] Acquire the current storage mode of the data object to be stored;
[0030] Determining whether data migration can be currently performed on the data object to be stored according to the storage status information of the target server;
[0031] In the case that data migration can be currently performed on the data object to be stored, the storage state of the data object to be stored is updated according to the target storage mode.
[0032] According to a second aspect of the present application, there is provided a data storage device, including:
[0033] A first acquisition module is used to acquire a user-defined data storage policy of a target server;
[0034] A second acquisition module is used to acquire the historical access information of the target server;
[0035] A feature extraction module, used to extract features from the historical access information to obtain feature access information;
[0036] A first determination module, configured to determine a dynamic data storage strategy of the target server according to the characteristic access information;
[0037] A second determination module is used to determine a target data storage policy of the target server according to the user-defined data storage policy and the dynamic data storage policy;
[0038] The data storage module is used to store the data objects to be stored in the target server according to the target data storage strategy.
[0039] According to a third aspect of an embodiment of the present application, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:
[0040] Get the user-defined data storage policy of the target server;
[0041] Obtaining historical access information of the target server;
[0042] Extracting features from the historical access information to obtain feature access information;
[0043] Determining a dynamic data storage strategy of the target server according to the characteristic access information;
[0044] Determining a target data storage policy of the target server according to the user-defined data storage policy and the dynamic data storage policy;
[0045] According to the target data storage policy, the data object to be stored in the target server is stored.
[0046] According to a fourth aspect of the embodiments of the present application, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
[0047] Get the user-defined data storage policy of the target server;
[0048] Obtaining historical access information of the target server;
[0049] Extracting features from the historical access information to obtain feature access information;
[0050] Determining a dynamic data storage strategy of the target server according to the characteristic access information;
[0051] Determining a target data storage policy of the target server according to the user-defined data storage policy and the dynamic data storage policy;
[0052] According to the target data storage policy, the data object to be stored in the target server is stored.
[0053] According to a fifth aspect of the embodiments of the present application, a computer program product is provided, including a computer program, which, when executed by a processor, implements the following steps:
[0054] Get the user-defined data storage policy of the target server;
[0055] Obtaining historical access information of the target server;
[0056] Extracting features from the historical access information to obtain feature access information;
[0057] Determining a dynamic data storage strategy of the target server according to the characteristic access information;
[0058] Determining a target data storage policy of the target server according to the user-defined data storage policy and the dynamic data storage policy;
[0059] According to the target data storage policy, the data object to be stored in the target server is stored.
[0060] The data storage method, device, computer equipment, storage medium and program product provided in the embodiments of the present application can realize the customization of the data storage policy to a certain extent by obtaining the user-defined data storage policy of the target server, and at the same time, by obtaining the historical access information of the target server and extracting the features of the historical access information, the feature access information is obtained, so as to further generate the dynamic data storage policy of the target server for the data object to be stored according to the feature access information. Therefore, the target data storage policy of the target server can be comprehensively determined by combining the user-defined data storage policy and the dynamic data storage policy, so as to store the data object to be stored in the target server. Therefore, in the ever-increasing amount of user data and the diverse user needs, the automatic classification storage of the data object to be stored can be realized through the dynamic adjustment of the data storage policy, and at the same time, it can ensure that the data storage has a certain customization function, improve the personalization of data storage, thereby reducing the difficulty of data storage, saving the cost of data storage, further reducing the difficulty and cost of managing data objects, improving the access speed of data, and improving the security of data storage. BRIEF DESCRIPTION OF THE DRAWINGS
[0061] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related technologies, the drawings required for use in the embodiments or the related technical descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0062] Figure 1 A schematic flow chart of a data storage method provided in an embodiment of the present application;
[0063] Figure 2 A schematic structural diagram of a data storage device provided in an embodiment of the present application;
[0064] Figure 3 A schematic structural diagram of a computer device provided in an embodiment of the present application;
[0065] Figure 4 A schematic structural diagram of a computer-readable storage medium provided in an embodiment of the present application;
[0066] Figure 5A schematic structural diagram of a computer program product provided in an embodiment of the present application. DETAILED DESCRIPTION
[0067] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0068] With the rapid development of the digital economy, the amount of data has exploded. As an efficient data storage solution, object storage has attracted attention for its high scalability, flexibility and cost-effectiveness. Nowadays, object storage data storage solutions have been widely used in cloud computing, big data, network resource distribution and other fields.
[0069] However, with the development of new infrastructure such as artificial intelligence and industrial Internet, the data generated is growing exponentially. How to effectively manage this data, reduce storage costs, and ensure fast access and security of data has become a pressing problem to be solved.
[0070] In traditional object storage services, users are generally provided with limited storage category options. Users manually select the appropriate storage category for the bucket based on the access frequency and importance of the data. After the user selects the storage category, access to the data is restricted by the storage category. However, as time goes by, the user's access pattern will also change. Some low-frequency data objects may become hot data, and the storage category limits the access experience to the data. At the same time, the access frequency of some data objects may decrease or even tend to be no longer accessed. If users rely on manual adjustment of data object categories, as the amount of data increases, in the case of large amounts of data, it will bring a lot of tedious work to users, and at the same time, data security cannot be guaranteed. It will cause difficulties in the reasonable management of data storage categories, and bring high storage costs to users.
[0071] In view of this, providing a method for realizing automatic classification and storage of data objects is a technical problem that needs to be solved urgently.
[0072] like Figure 1 As shown, in a first aspect of an embodiment of the present application, a data storage method is provided, comprising:
[0073] Step S110: Acquire a user-defined data storage policy of the target server.
[0074] Exemplarily, a user may intuitively input and modify a user-defined data storage policy through a user interface.
[0075] Step S120: Obtain historical access information of the target server.
[0076] Exemplarily, the access activities of all data objects in the storage system of the target server can be monitored and captured, and the historical access information of the target server can be obtained according to the access log by monitoring the access events of the data objects in real time.
[0077] Step S130: extract features from historical access information to obtain feature access information.
[0078] Exemplarily, key features can be extracted from access logs to identify user patterns of the target server, such as the periodicity of access frequency, the distribution of access time, and the changing trend of the size of transmitted data objects, to generate feature analysis reports and provide data input for large model analysis.
[0079] Step S140: Determine the dynamic data storage strategy of the target server according to the characteristic access information.
[0080] For example, the large model can be fine-tuned to adapt it to specific data sets and business needs, so that it can understand and predict data access patterns and output a series of dynamic data storage strategies. These dynamic data storage strategies will be combined with user-defined data storage strategies to form a comprehensive strategy to provide decision-making basis for the intelligent decision engine.
[0081] Step S150: Determine the target data storage policy of the target server according to the user-defined data storage policy and the dynamic data storage policy.
[0082] Exemplarily, the target data storage strategy can be determined by an intelligent decision engine. The intelligent decision engine is responsible for automatically determining the best storage category for the data object to be stored according to the target data storage strategy. The intelligent decision engine uses a complex algorithm to comprehensively consider the access pattern, storage cost, performance requirements and other relevant factors of the data object to determine whether each data object should be stored in standard storage, low-frequency storage or archive storage.
[0083] Step S160: store the data object to be stored in the target server according to the target data storage policy.
[0084] The data storage method, device, computer equipment, storage medium and program product provided by the embodiments of the present application can realize the customization of the data storage policy to a certain extent by obtaining the user-defined data storage policy of the target server, and at the same time, by obtaining the historical access information of the target server and extracting the features of the historical access information, the feature access information is obtained, so as to further generate the dynamic data storage policy of the target server for the data object to be stored according to the feature access information. Therefore, the target data storage policy of the target server can be comprehensively determined by combining the user-defined data storage policy and the dynamic data storage policy, so as to store the data object to be stored in the target server. Therefore, in the ever-increasing amount of user data and the diverse user needs, the automatic classification storage of the data object to be stored can be realized through the dynamic adjustment of the data storage policy, and at the same time, it can ensure that the data storage has a certain customization function, improve the personalization of data storage, thereby reducing the difficulty of data storage, saving the cost of data storage, further reducing the difficulty and cost of managing data objects, improving the access speed of data, and improving the security of data storage.
[0085] In some feasible implementations, the user-defined data storage strategy includes at least one of the data object access frequency, the storage cost budget of the target server, and the data object retention period; the historical access information includes at least one of the accessed data object, the access time, the identity of the accessor, the access request type, and the capacity of the accessed data object; and the target data storage strategy includes at least one of the standard data storage strategy, the low-frequency data storage strategy, and the archived data storage strategy.
[0086] The data storage method, apparatus, computer equipment, storage medium and program product provided in the embodiments of the present application can further enhance the accuracy of automatic classification storage of data objects to be stored and improve the data storage effect by increasing the decision parameters of the data storage strategy, thereby reducing the difficulty of data storage, saving data storage costs, further reducing the management difficulty and management costs of data objects, increasing the speed of data access, and improving the security of data storage.
[0087] In some feasible implementations, obtaining a user-defined data storage policy of the target server includes: collecting a custom data storage policy input by a user; obtaining data storage rules of the target server; and determining the user-defined data storage policy of the target server based on the data storage rules and the custom data storage policy.
[0088] For example, the system administrator can set rules and restrictions for the policy to ensure the rationality and security of the user policy. The policy management module is also responsible for storing the user-defined policy persistently and providing it to other system components, such as the intelligent decision engine, for further processing when needed.
[0089] Exemplarily, the custom data storage policy input by the user can be verified based on the custom policy legal rules and setting restrictions set by the system administrator. When the user enters the custom data storage policy, the custom data storage policy is verified and filtered. If the custom data storage policy fails to pass the verification, an error prompt is given to the user, and the user is required to re-enter the policy. When the custom data storage policy passes the verification, the custom data storage policy is persistently stored to obtain the user-defined data storage policy, and the cached data storage policy is updated. When the dependent component needs to obtain the user-defined data storage policy, the user-defined data storage policy is provided to perform subsequent operations.
[0090] The data storage method provided in the embodiment of the present application can further supervise the user-defined data storage policy to prevent user misoperation from affecting the data storage effect, thereby further improving the security of data storage and the stability and reliability of the target server.
[0091] In some feasible implementations, obtaining historical access information of a target server includes: obtaining a first data object access log of the target server; filtering the first data object access log to obtain a second data object access log; and formatting the second data object access log to obtain historical access information.
[0092] Exemplarily, the user's access operations on each data object in the target server can be monitored and recorded to generate a first data object access log. The first data object access log is cleaned to remove useless and erroneous log records to obtain a second data object access log. The second data object access log is formatted according to a fixed format to obtain historical access information, which is stored so that the historical access information can be used as an original data source and can be directly used for analysis and processing in subsequent processes.
[0093] The data storage method provided in the embodiment of the present application can improve the effectiveness of historical access information and the readability of historical access information by pre-screening and pre-processing the first data object access log of the target server, thereby reducing the difficulty of data storage, saving data storage costs, and further reducing the management difficulty and management costs of data objects.
[0094] In some feasible implementations, data objects to be stored in a target server are stored according to a target data storage strategy, including: obtaining storage information of the data objects to be stored, wherein the storage information includes at least one of an access mode, storage cost, and storage performance requirement; determining a target storage mode corresponding to the data objects to be stored according to the storage information; and storing the data objects to be stored in the target server according to the target storage mode.
[0095] For example, the access mode, storage cost, performance requirements and other related factors of the data object to be stored can be comprehensively considered according to the input target data storage strategy to analyze the storage requirements of the data object to be stored. It is determined whether the data object to be stored is suitable for standard storage, low-frequency storage and archive storage, and the target storage mode of the data object is given.
[0096] The data storage method provided in the embodiment of the present application can improve the automatic classification storage quality of the data object to be stored by determining the target storage mode corresponding to the data object to be stored through the storage information of the data object to be stored, thereby further reducing the difficulty of data storage, saving data storage costs, and further reducing the management difficulty and management costs of data objects.
[0097] In some feasible implementations, the data storage method also includes: obtaining the current storage mode of the data object to be stored; judging whether data migration can be currently performed on the data object to be stored based on the storage status information of the target server; and updating the storage status of the data object to be stored based on the target storage mode if data migration can currently be performed on the data object to be stored.
[0098] Exemplarily, a migration instruction for the data object to be stored can be generated and issued according to the decided target storage mode. Among them, by analyzing the migration instruction, it is determined whether the data object to be stored meets the migration conditions. If the migration conditions are not met, wait for the next evaluation time to re-evaluate, otherwise, execute the subsequent steps. When the data object to be stored meets the data migration conditions, the data object to be stored is migrated from the current object storage category in the current storage mode to the best object storage category given by the target storage mode according to the requirements of the migration instruction. During the migration process, attention is paid to the state of the migration, and specific processing is performed on abnormal situations in the migration process. When the migration of the data object to be stored is completed, the metadata of the relevant object is updated to ensure that the metadata correctly reflects the storage state and storage category of the data object to be stored. Ensure the consistency and integrity of the data.
[0099] The data storage method provided in the embodiment of the present application can further ensure the migration quality of the data objects to be stored by evaluating the migration conditions before data migration is required, and avoid the loss of the data objects to be stored during the migration process, thereby further reducing the management difficulty and cost of the data objects, improving the data access speed, and improving the security of data storage.
[0100] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0101] Based on the same inventive concept, the embodiment of the present application also provides a memory management device for implementing the memory management method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more memory management device embodiments provided below can refer to the limitations on the memory management method above, and will not be repeated here.
[0102] like Figure 2 As shown, in a second aspect of an embodiment of the present application, a data storage device is provided, comprising:
[0103] A first acquisition module 100 is used to acquire a user-defined data storage policy of a target server;
[0104] The second acquisition module 200 is used to acquire historical access information of the target server;
[0105] The feature extraction module 300 is used to extract features from the historical access information to obtain feature access information;
[0106] A first determination module 400 is used to determine a dynamic data storage strategy of a target server according to characteristic access information;
[0107] The second determination module 500 is used to determine the target data storage policy of the target server according to the user-defined data storage policy and the dynamic data storage policy;
[0108] The data storage module 600 is used to store the data objects to be stored in the target server according to the target data storage policy.
[0109] Each module in the above memory management device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.
[0110] like Figure 3 As shown, in a third aspect of the embodiment of the present application, a computer device is provided, which may be a device integrating multiple target applications, and the specific implementation process of the memory monitoring module in the target application may be executed by the computer device; wherein, the computer device may be a server, and its internal structure diagram may be as shown in FIG. Figure 3 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store memory data. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a memory management method is implemented.
[0111] Those skilled in the art will appreciate that the structure shown in FIG. 1 is merely a block diagram of a portion of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0112] like Figure 4 As shown, in a fourth aspect of the embodiments of the present application, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
[0113] Get the user-defined data storage policy of the target server;
[0114] Get the historical access information of the target server;
[0115] Extract features from historical access information to obtain feature access information;
[0116] Determine the dynamic data storage strategy of the target server based on the characteristic access information;
[0117] Determine the target data storage policy of the target server according to the user-defined data storage policy and the dynamic data storage policy;
[0118] According to the target data storage strategy, the data objects to be stored in the target server are stored.
[0119] like Figure 5 As shown, in a fifth aspect of the embodiments of the present application, a computer program product is provided, including a computer program, which implements the following steps when executed by a processor:
[0120] Get the user-defined data storage policy of the target server;
[0121] Get the historical access information of the target server;
[0122] Extract features from historical access information to obtain feature access information;
[0123] Determine the dynamic data storage strategy of the target server based on the characteristic access information;
[0124] Determine the target data storage policy of the target server according to the user-defined data storage policy and the dynamic data storage policy;
[0125] According to the target data storage strategy, the data objects to be stored in the target server are stored.
[0126] It should be noted that the information (including but not limited to application information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.
[0127] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.
[0128] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0129] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A data storage method, characterized in that: include: Get the user-defined data storage policy of the target server; Obtaining historical access information of the target server; Extracting features from the historical access information to obtain feature access information; Determining a dynamic data storage strategy of the target server according to the characteristic access information; Determining a target data storage policy of the target server according to the user-defined data storage policy and the dynamic data storage policy; According to the target data storage policy, the data object to be stored in the target server is stored.
2. The data storage method according to claim 1, characterized in that: The user-defined data storage policy includes at least one of a data object access frequency, a storage cost budget of a target server, and a data object retention period; and / or, The historical access information includes at least one of the accessed data object, access time, accessor identity, access request type and accessed data object capacity; and / or, The target data storage strategy includes at least one of a standard data storage strategy, a low-frequency data storage strategy, and an archive data storage strategy.
3. The data storage method according to claim 1, characterized in that: The step of obtaining a user-defined data storage policy of the target server includes: Collect user input for custom data storage strategies; Acquire the data storage rules of the target server; The user-defined data storage policy of the target server is determined according to the data storage rule and the custom data storage policy.
4. The data storage method according to claim 1, characterized in that: The obtaining of the historical access information of the target server includes: Obtaining a first data object access log of the target server; Screening the first data object access log to obtain a second data object access log; The second data object access log is formatted to obtain the historical access information.
5. The data storage method according to claim 1, characterized in that: The storing the data object to be stored in the target server according to the target data storage policy includes: Acquire storage information of the data object to be stored, wherein the storage information includes at least one of an access mode, a storage cost, and a storage performance requirement; Determine a target storage mode corresponding to the data object to be stored according to the storage information; According to the target storage mode, the data objects to be stored in the target server are stored.
6. The data storage method according to claim 5, characterized in that: Also includes: Acquire the current storage mode of the data object to be stored; Determining whether data migration can be currently performed on the data object to be stored according to the storage status information of the target server; In the case that data migration can be currently performed on the data object to be stored, the storage state of the data object to be stored is updated according to the target storage mode.
7. A data storage device, characterized in that: include: A first acquisition module is used to acquire a user-defined data storage policy of a target server; A second acquisition module is used to acquire the historical access information of the target server; A feature extraction module, used to extract features from the historical access information to obtain feature access information; A first determination module, configured to determine a dynamic data storage strategy of the target server according to the characteristic access information; A second determination module is used to determine a target data storage policy of the target server according to the user-defined data storage policy and the dynamic data storage policy; The data storage module is used to store the data objects to be stored in the target server according to the target data storage strategy.
8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the data storage method according to any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the data storage method according to any one of claims 1 to 6 are implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the data storage method according to any one of claims 1 to 6 are implemented.
Citation Information
Cited By
Cloud intelligent image processing system and application method thereof
CN120111274A