A storage system cache capacity adjustment method and product

By combining memory units and system disks, dynamically adjusting the cache capacity of the storage system, and using the data capacity of the system disk to optimize cache capacity allocation, the hardware cost increase caused by the increase in cache capacity in the storage system is solved, and efficient storage performance and cost are achieved reduce.

CN118672514BActive Publication Date: 2024-11-08INSPUR SUZHOU INTELLIGENT TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411147380.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-08-20
Publication Date
2024-11-08
Estimated Expiration
2044-08-20

AI Technical Summary

Technical Problem

In the era of big data, the increase in cache capacity in storage systems has led to an increase in hardware costs. How to reduce the cost of storage systems without reducing cache capacity.

Method used

By combining memory units and system disks, the capacity of the total cache space is dynamically adjusted, and the data capacity of the system disk is used as a variable cache unit to optimize cache capacity allocation and data processing strategies to ensure that the storage system does not add solid-state drives specifically for caches. In the case of , improve cache capacity and utilization.

Benefits of technology

It effectively improves the utilization rate of the system disk, reduces the cost of the hard disk, and ensures the storage performance of the storage system, solving the system downtime and upgrade failure caused by insufficient cache capacity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118672514B_ABST
    Figure CN118672514B_ABST
Patent Text Reader

Abstract

The embodiment of the present application provides a method and product for adjusting the cache capacity of a storage system, the method comprising: determining the capacity of a total cache space according to the capacity of a fixed cache unit and the capacity of a variable cache unit, wherein the fixed cache unit comprises a memory unit and the variable cache unit comprises the data capacity of a system disk; updating the available cache capacity in the total cache space according to the execution of the current business by the storage system, the available cache capacity being used to cache the data of the current business processed by the controller. The embodiment of the present application aims to reduce the cost of the storage system while ensuring that the cache capacity of the storage system is not reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present application relate to the technical field of data storage, and in particular, to a method and product for adjusting cache capacity of a storage system. Background Art

[0002] In the era of big data, higher requirements are placed on the reliability and efficiency of data storage, especially the stable reliability of data backup of storage systems and the increasing demand for safe operation without downtime. In order to achieve efficient operation of storage systems, the cache capacity of storage systems has been continuously improved. Initially, cache was based only on memory sticks. In addition to memory sticks for caching, current hybrid flash storage devices are also equipped with solid-state drives dedicated to caching, which can improve cache capacity and read and write efficiency.

[0003] However, increasing cache capacity will also lead to an increase in cost. Currently, the cost of large-capacity solid-state drives is relatively high. When a large number of high-cost cache solid-state drives are introduced to increase cache capacity, the hardware cost of the storage system will increase. Summary of the invention

[0004] The embodiments of the present application provide a method and product for adjusting the cache capacity of a storage system, aiming to reduce the cost of the storage system while ensuring that the cache capacity of the storage system is not reduced.

[0005] In a first aspect, an embodiment of the present application provides a method for adjusting cache capacity of a storage system, which is applied to a storage system, wherein the storage system includes a controller, a memory unit, and a system disk, and the method includes:

[0006] Determine the capacity of the total cache space according to the capacity of the fixed cache unit and the capacity of the variable cache unit, wherein the fixed cache unit includes the memory unit and the variable cache unit includes the data capacity of the system disk;

[0007] According to the execution status of the current service by the storage system, the available cache capacity in the total cache space is updated, and the available cache capacity is used to cache the data of the current service processed by the controller.

[0008] Optionally, the storage system may further include a cache hard disk unit, and determining the capacity of the total cache space according to the capacity of the fixed cache unit and the capacity of the variable cache unit includes:

[0009] Determining the capacity of the fixed cache unit according to the capacity of the memory unit and the capacity of the cache hard disk unit;

[0010] Monitoring the current data capacity of the system disk as the capacity of the variable cache unit;

[0011] The capacity of the total cache space is determined according to the sum of the capacity of the fixed cache unit and the capacity of the variable cache unit.

[0012] Optionally, updating the available cache capacity in the total cache space according to the execution status of the current service by the storage system includes:

[0013] Using the current available cache capacity of the total cache space to allocate an upper partition and a lower partition to the controller, wherein the upper partition is used to cache the to-be-written data sent by the controller when processing the current business; and the lower partition is used to write the to-be-written data in the upper partition into a storage pool of the storage system;

[0014] Acquire the pre-read data corresponding to the current service determined by the controller in the storage pool, and store the pre-read data in the variable cache unit;

[0015] After the pre-reading is completed, the pre-read data in the variable cache unit is sent to the front-end device corresponding to the current service, and the available cache capacity in the total cache space is updated.

[0016] Optionally, using the current available cache capacity of the total cache space to allocate an upper partition and a lower partition to the controller includes:

[0017] Enable data compression software in manufacturing control systems;

[0018] In response to the read and write instructions sent by the manufacturing control system, determining the target size corresponding to the upper partition according to the compression ratio of the data compression software function and the size of the data currently in the storage pool;

[0019] Allocating an upper partition of the target size in the fixed cache unit;

[0020] The cache space other than the upper partition in the total cache space is allocated as the lower partition.

[0021] Optionally, obtaining the pre-read data corresponding to the current service determined by the controller in the storage pool and storing the pre-read data in the variable cache unit includes:

[0022] When the controller processes the current business, the controller determines the pre-read data corresponding to the current business and sets a pre-read flag for the pre-read data in the storage pool;

[0023] All pre-read data carrying the pre-read flag in the storage pool are acquired and stored in the variable cache unit.

[0024] Optionally, after updating the available cache capacity in the total cache space according to the execution status of the current service by the storage system, the method further includes:

[0025] Determine the allocatable cache capacity corresponding to the storage software in the available cache capacity;

[0026] Execute the storage software capacity optimization strategy to allocate corresponding cache capacity to the storage software to be executed for executing the current business.

[0027] Optionally, determining the allocatable cache capacity corresponding to the storage software in the available cache capacity includes:

[0028] Monitoring the current business and determining the data processing cache capacity of the storage system when processing the current business;

[0029] Monitoring the operating status of the storage system and determining the system operating cache capacity of the storage system;

[0030] The cache capacity other than the data processing cache capacity and the system operation cache capacity in the available cache capacity is used as the allocatable cache capacity corresponding to the storage software.

[0031] Optionally, executing a storage software capacity optimization strategy to allocate corresponding cache capacity to the storage software to be executed for executing the current business includes:

[0032] Executing a first optimization sub-strategy in the storage software capacity optimization strategy, wherein the first optimization sub-strategy is used to determine the storage software to be executed for executing the current business;

[0033] A second optimization sub-strategy in the storage software capacity optimization strategy is executed, where the second optimization sub-strategy is used to allocate corresponding cache capacity for the storage software to be executed.

[0034] Optionally, executing the first optimization sub-strategy in the storage software capacity optimization strategy includes:

[0035] Estimate the base value of cache capacity of each storage software when executing the current business;

[0036] According to the cache capacity base value of each storage software when executing the current business, the allocatable cache capacity corresponding to each storage software is split in proportion to determine the pre-allocated storage capacity corresponding to each storage software;

[0037] One or more storage software to be executed are determined according to the cache capacity base values ​​of the respective storage software when executing the current service and the pre-allocated storage capacity.

[0038] Optionally, executing the second optimization sub-strategy in the storage software capacity optimization strategy includes:

[0039] According to the cache capacity base values ​​corresponding to the one or more storage software to be executed when executing the current business, the cache capacities corresponding to the one or more storage software to be executed are allocated to the one or more storage software to be executed in the allocatable cache capacity corresponding to the storage software.

[0040] Optionally, after executing the second optimization sub-strategy in the storage software capacity optimization strategy, the method further includes:

[0041] After allocating the corresponding cache capacity to the one or more storage software to be executed, the remaining capacity in the allocatable cache capacity corresponding to the storage software is used as temporary storage space. The temporary storage space is used as auxiliary capacity for the execution of any storage software when the number of read and write operations per second corresponding to the current business is lower than a preset threshold during the execution of any storage software.

[0042] Optionally, the method further comprises:

[0043] Monitoring the execution process of the to-be-executed stored software, setting a processing mark for the current processing data of the to-be-executed stored software, and sending the processing mark to the business execution module of the manufacturing control system, wherein the business execution module is used to process the business data corresponding to the processing mark after responding to the processing mark;

[0044] When the storage software to be executed and the service execution module have completed processing the data corresponding to the processing mark, a disk identifier of the data corresponding to the processing mark is sent to the storage pool of the storage system;

[0045] The storage pool stores the data corresponding to the processing mark in response to the disk identifier;

[0046] The data corresponding to the processing mark in the available cache capacity is deleted to release the cache capacity of the data corresponding to the processing mark.

[0047] In a second aspect, an embodiment of the present application provides a computer device, comprising: at least one processor, and a memory, wherein the memory stores a computer program that can be run on the processor, wherein when the processor executes the computer program, a cache capacity adjustment method for a storage system as described in the first aspect of the embodiment is performed.

[0048] In a third aspect, an embodiment of the present application provides a non-volatile readable storage medium, wherein the non-volatile readable storage medium stores a computer program, wherein when the computer program is executed by a processor, a cache capacity adjustment method for a storage system described in the first aspect of the embodiment is performed.

[0049] In a fourth aspect, an embodiment of the present application provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements a cache capacity adjustment method for a storage system described in the first aspect of the embodiment.

[0050] Beneficial effects:

[0051] In this method, the capacity of the total cache space can be determined based on the capacity of the fixed cache unit and the capacity of the variable cache unit, the fixed cache unit includes the memory unit, and the variable cache unit includes the data capacity of the system disk; according to the execution of the current business by the storage system, the available cache capacity in the total cache space is updated, and the available cache capacity is used to cache the data of the current business processed by the controller.

[0052] By using the data capacity of the system disk as the available cache capacity, the cache capacity can be increased to ensure the storage performance of the storage system without adding a solid-state drive specifically for caching. This not only improves the utilization rate of the system disk, but also reduces the cost of the storage system while ensuring that the cache capacity of the storage system is not reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art.

[0054] Figure 1 A flowchart showing the steps of a method for adjusting cache capacity of a storage system provided by an embodiment of the present application is shown;

[0055] Figure 2 A schematic diagram showing a process of updating available cache capacity provided by an embodiment of the present application is shown;

[0056] Figure 3 A schematic diagram of a process of allocating corresponding cache capacity to storage software to be executed provided in an embodiment of the present application is shown;

[0057] Figure 4 A schematic diagram of a process for releasing cache capacity provided in an embodiment of the present application is shown;

[0058] Figure 5 A functional module diagram of a cache capacity adjustment device for a storage system provided in an embodiment of the present application is shown;

[0059] Figure 6 A schematic diagram of a computer device provided in an embodiment of the present application is shown;

[0060] Figure 7 A schematic diagram of a non-volatile readable storage medium provided in an embodiment of the present application is shown;

[0061] Figure 8 A schematic diagram of a computer program product provided by an embodiment of the present application is shown. DETAILED DESCRIPTION

[0062] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

[0063] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, each embodiment of the present application will be described in detail below in conjunction with the accompanying drawings. However, it will be appreciated by those skilled in the art that in each embodiment of the present application, many technical details are proposed in order to enable the reader to better understand the present application. However, even without these technical details and various changes and modifications based on the following embodiments, the technical scheme claimed in the present application can also be implemented. The division of the following embodiments is for the convenience of description, and the specific implementation of the present application should not constitute any limitation, and the various embodiments can be combined with each other and referenced to each other without contradiction.

[0064] CPU: Central Processing Unit, central processing unit;

[0065] IO card: A hardware device used to expand the input / output (I / O) capabilities of a computer or other device;

[0066] PCIE: PCI-Express or peripheral component interconnect express, a high-speed serial computer expansion bus standard.

[0067] In the era of big data, higher requirements are placed on the reliability and efficiency of data storage, especially the stable reliability of data backup of storage devices, as well as the increasing demand for safe operation without downtime.

[0068] In order to achieve efficient operation of storage devices, the cache capacity of storage devices has been continuously improved. From the initial caching based only on memory bars, the current hybrid flash storage devices are equipped with solid-state drives dedicated to caching in addition to memory bars for caching, thereby improving cache capacity and read and write efficiency; after the cache capacity and read and write rate are upgraded, the CPU can read and write data more smoothly, and the business rate of storage devices is also improved. As far as storage devices are concerned, the characteristic advantages brought by the increase in cache capacity include but are not limited to: support for larger capacity data remote replication, further improvement in data compression ratio, and support for more IO cards with higher specifications.

[0069] However, the method of increasing cache capacity by setting up a solid-state drive specifically for caching will also lead to an increase in the hardware cost of the storage system; therefore, in order to ensure that the storage system does not reduce the cache capacity while reducing the cost of the storage system, an embodiment of the present application provides a method for adjusting the cache capacity of a storage system.

[0070] Reference Figure 1 , shows a flowchart of a method for adjusting cache capacity of a storage system provided in an embodiment of the present application, the method is applied to a storage system, the storage system includes a controller, a memory unit and a system disk, and the method may include the following steps:

[0071] S101: Determine the capacity of the total cache space according to the capacity of the fixed cache unit and the capacity of the variable cache unit.

[0072] In a feasible implementation, the fixed cache unit refers to the memory unit, and the variable cache unit refers to the cache space composed of the data capacity in the system disk. The memory unit and the system disk are connected to each other. The controller of the storage system, i.e., the CPU, can be cascaded with the memory unit and the system disk through PCIE lane, so that the CPU can read and write system data and business data based on the total cache space composed of the memory unit and the system disk. The data capacity in the system disk referred to in this embodiment is the capacity in the system disk that can store data except the capacity occupied by the normal operation of the system and the applications in the system.

[0073] The system disk is a unit that can be used as a data backup after a power outage. During the operation of the storage system, the system disk contains system data corresponding to the normal operation of the storage system, and there is also a large amount of data capacity of non-storage system data in the system disk that can be used. Therefore, this embodiment uses the data capacity in the system disk as the capacity of the variable cache unit, and uses the memory unit and the system disk together to form a total cache space, thereby expanding the cache capacity of the storage system with the assistance of the system disk. On the basis of ensuring storage performance, multiple storage software functions in the storage system can be brought into play, solving the problems of system crashes and upgrade failures caused by insufficient cache capacity when running high-performance storage software in the storage system, thereby improving the utilization rate of the system disk capacity and saving hard disk costs.

[0074] The data capacity of the system disk is constantly changing during the operation of the storage system, so the capacity of the variable cache unit is also constantly changing, and the capacity of the total cache space is no longer a static value, but a dynamic value that changes in real time.

[0075] In another feasible implementation, in order to further improve the cache capacity of the storage system, the storage system may also be provided with a limited cache hard disk unit. For example, a solid state hard disk may be provided for caching.

[0076] When a cache hard disk unit is configured in the storage system, in the process of determining the capacity of the total cache space, the capacity of the fixed cache unit is determined according to the capacity of the memory unit and the capacity of the cache hard disk unit; and the current data capacity of the system disk is monitored as the capacity of the variable cache unit; and the capacity of the total cache space is determined according to the sum of the capacity of the fixed cache unit and the capacity of the variable cache unit.

[0077] The memory unit, cache hard disk unit and system disk are cascaded on the link, and the CPU is cascaded with the memory unit, cache hard disk unit and system disk through PCIE lane, which is convenient for the CPU to read and write system data and business data.

[0078] In the actual implementation process, the system disk can be selected as 512G or above, which can provide more variable cache unit capacity for the storage system to use; because the system disk is usually easy to design, in addition to the capacity occupied by the system when running, the remaining capacity of the system disk in the storage system can be used as cache capacity.

[0079] S102: updating the available cache capacity in the total cache space according to the execution status of the current service by the storage system, where the available cache capacity is used to cache the data of the current service processed by the controller.

[0080] Reference Figure 2, a schematic diagram of a process of updating available cache capacity provided by an embodiment of the present application is shown. After determining the total cache space, the available cache capacity is updated in the total cache space according to the execution status of the current business by the storage system. Specifically, the process of updating the available cache capacity may include the following steps:

[0081] A1: using the current available cache capacity of the total cache space to allocate an upper partition and a lower partition to the controller.

[0082] The upper partition is used to cache the to-be-written data sent by the controller when processing the current business; the lower partition is used to write the to-be-written data in the upper partition into the storage pool of the storage system.

[0083] When allocating upper partitions and lower partitions to the controller according to the current available cache capacity of the total cache space, the available cache capacity may be partitioned according to storage software in the manufacturing control system of the storage system.

[0084] For example, the data compression software in the manufacturing control system is turned on. Since the data compression software has the highest requirements on the cache capacity and CPU performance, the upper partition and the lower partition can be divided according to the data compression software with the highest requirements.

[0085] After starting the data compression software in the manufacturing control system, the manufacturing control system sends a read / write instruction, i.e., an I / O read / write instruction, to the storage system. The storage system responds to the read / write instruction sent by the manufacturing control system, determines the target size corresponding to the upper partition according to the compression ratio of the data compression software function and the data size currently in the storage pool, and allocates the upper partition of the target size in the fixed cache unit, and allocates the cache space of the non-upper partition in the total cache space as the lower partition.

[0086] For example, assuming that the compression ratio of the data compression software is 3:1, and the data size in the current storage pool is 10GB, the data sent to the storage system by the front-end device providing business services of the storage system is 30GB, indicating that the data compression software needs to process 30GB of data. Therefore, the target size of the upper partition is 30GB, and 30GB of space is allocated from the fixed cache unit as the upper partition, and the cache space of the non-upper partition in the total cache space is allocated as the lower partition, that is, the space in the total cache space except the upper partition belongs to the space of the lower partition.

[0087] When the CPU of the storage system executes the write data instruction of the current business, the data to be written is first written into the cache space of the upper partition, and then the data to be written in the upper partition is written into the lower partition, and then the data to be written is written into the hard disk in the storage pool of the storage system through the lower partition.

[0088] A2: Obtain the pre-read data corresponding to the current service determined by the controller in the storage pool, and store the pre-read data in the variable cache unit.

[0089] In the process of obtaining the pre-read data corresponding to the current business determined by the controller to the variable cache unit in the storage pool, when the controller processes the current business, the controller determines the pre-read data corresponding to the current business and sets a pre-read flag for the pre-read data in the storage pool; then obtains all the pre-read data carrying the pre-read flag in the storage pool and stores them in the variable cache unit.

[0090] Pre-read data is data that is likely to be read later in the process of processing the current business but has not yet been read. The selection of pre-read data can be customized according to the needs of the actual application. For example, the pre-read data can be determined according to the address range of the data and a pre-read flag can be added to it. For example, when the CPU executes reading and writing data A, the data around the address of data A is likely to be read. Therefore, data B, data C and data D within the preset range can be used as pre-read data and pre-read flags can be added to them respectively.

[0091] In this embodiment, the pre-read data is preferentially stored in the variable cache unit, that is, the pre-read data can be stored in the available capacity of the system disk, because the fixed cache unit is preferentially divided into upper partitions for executing the CPU's write data instructions, and the available capacity in the system disk is usually larger than the capacity of the fixed cache unit. Therefore, the pre-read data can be preferentially stored in the variable cache unit, that is, the system disk.

[0092] A3: After the pre-reading is completed, the pre-read data in the variable cache unit is sent to the front-end device corresponding to the current service, and the available cache capacity in the total cache space is updated.

[0093] When the pre-reading is completed and the pre-reading completion response signal is detected, the pre-read data in the variable cache unit can be sent to the front-end device corresponding to the current business, such as the front-end server, and then the pre-read data in the variable cache unit can be erased in real time, and a signal for updating the available cache capacity can be triggered to update the real-time cache capacity after releasing the pre-read data.

[0094] In a feasible implementation, the method further includes determining the allocatable cache capacity corresponding to the storage software in the available cache capacity; and executing a storage software capacity optimization strategy to allocate corresponding cache capacity to the storage software to be executed for executing the current business.

[0095] Reference Figure 3, shows a schematic diagram of a process of allocating corresponding cache capacity to the storage software to be executed provided in an embodiment of the present application, and the process of allocating corresponding cache capacity to the storage software to be executed for executing the current business includes the following steps:

[0096] B1: monitor the current business to determine the data processing cache capacity of the storage system when processing the current business; and monitor the operation status of the storage system to determine the system operation cache capacity of the storage system.

[0097] In the actual implementation process, the data processing cache capacity and the system operation cache capacity can be monitored through the controller of the storage system, that is, the CPU.

[0098] Specifically, the CPU counts the amount of current business data that the storage system needs to process each time before the pre-read operation is triggered as the data processing cache capacity when the storage system processes the current business. Because the pre-read operation is triggered each time the available cache capacity is updated, the data completed by the pre-read mark is the amount of current business data that the storage system needs to process that is counted this time.

[0099] In the actual implementation process, the pre-read flag can be set according to the integrity of the current business. In order to facilitate the identification of the current progress of pre-reading, a mark can be made at the end of the pre-read data. Moreover, according to the size of the pre-read data, when the amount of pre-read data is large, the pre-read data can be segmented. For example, the capacity of the fixed cache unit can be selected as the standard for whether to segment. When the amount of pre-read data of the current business is lower than the capacity of the fixed cache unit, the pre-read flag can be set at the end of the data of the current business. When the amount of pre-read data of the current business is higher than the capacity of the fixed cache unit, the pre-read data of the current business can be segmented according to the capacity of the fixed cache unit, and marked at the end of each segment of data, so that the position of the pre-read data can be quickly located.

[0100] The system operation cache capacity consists of two parts. The first part is the capacity of the storage system itself, which is confirmed and recorded during the initial canning process and can be directly obtained. The second part is the capacity occupied by the system operation data during the normal operation of the current storage system. The changes in the system operation data can be monitored through the cache capacity monitoring unit inside the CPU. By comparing the changes in the system operation data with the system's own capacity, the average value within the business period can be obtained, thereby obtaining the system operation cache capacity.

[0101] B2: Using the cache capacity other than the data processing cache capacity and the system operation cache capacity in the available cache capacity as the allocatable cache capacity corresponding to the storage software.

[0102] The remaining cache capacity in the available cache capacity except for the data processing cache capacity and the system operation cache capacity is used as the allocatable cache capacity corresponding to the storage software, and then the corresponding storage software is gradually executed while ensuring that the storage system can smoothly handle the current business. The storage software is used to provide different storage functions, for example data storage, data backup, remote replication, and active-active storage functions.

[0103] B3: Execute the first optimization sub-strategy in the storage software capacity optimization strategy, where the first optimization sub-strategy is used to determine the storage software to be executed for executing the current business.

[0104] Specifically, when executing the first optimization sub-strategy, first estimate the cache capacity base value of each storage software when executing the current business, then divide the allocatable cache capacity corresponding to the storage software in proportion according to the cache capacity base value of each storage software when executing the current business, and determine the pre-allocated storage capacity corresponding to each storage software; determine one or more storage software to be executed according to the cache capacity base value of each storage software when executing the current business and the pre-allocated storage capacity.

[0105] For example, when there are storage software 1, storage software 2 and storage software 3, the cache capacity base values ​​of the three storage software are C1, C2 and C3 respectively. According to the ratio of C1, C2 and C3, the allocatable cache capacity is split to determine the pre-allocated storage capacity corresponding to each storage software, which are C'1, C'2 and C'3 respectively. When the pre-allocated storage capacity of any storage software is less than the cache capacity base value of the storage software, the storage software cannot be executed. If C'1 is greater than C1, C'2 is greater than C2, and C'3 is less than C3, the storage software to be executed is storage software 1 and storage software 2, and then the storage software whose current cache capacity is sufficient to support the operation can be selected.

[0106] B4: Execute the second optimization sub-strategy in the storage software capacity optimization strategy, where the second optimization sub-strategy is used to allocate corresponding cache capacity for the storage software to be executed.

[0107] During the execution of the second optimization sub-strategy, according to the cache capacity base value corresponding to each of the one or more storage software to be executed when executing the current business, the corresponding cache capacity is allocated to the one or more storage software to be executed in the allocatable cache capacity corresponding to the storage software.

[0108] For example, when storage software 1 and storage software 2 are storage software to be executed, corresponding cache capacities can be allocated in the allocatable cache capacity according to respective cache capacity base values ​​of storage software 1 and storage software 2 .

[0109] In a feasible implementation, after allocating corresponding cache capacities to the one or more storage software to be executed, the remaining capacity in the allocatable cache capacity corresponding to the storage software is used as temporary storage space. The temporary storage space is used as auxiliary capacity for the execution of any storage software when the number of read and write operations per second corresponding to the current business is lower than a preset threshold during the execution of any storage software.

[0110] For example, the allocatable cache capacity can support the operation of storage software 1 and storage software 2, and there is remaining capacity, but the remaining capacity is insufficient to support the operation of storage software 3. Therefore, this part of the remaining capacity is used as temporary storage space. When storage software 1 is executed, if it is detected that the number of read and write operations per second corresponding to the current business is lower than the preset threshold, it is used as auxiliary capacity for the execution of the storage software. Furthermore, when a certain storage software is executed, when the IOPS (Input / Output Operations Per Second) of the storage system for the current business is greatly reduced, the temporary storage space can be used to assist the execution of this function, thereby allowing the storage software to achieve better results.

[0111] In a feasible implementation, in the process of balancing the capacity of the storage software of the storage system, the method can execute the priority flushing of overlapping data to disk, and release the double cache capacity occupied by the overlapping data after the flushing is completed. This not only achieves twice the speed of flushing the overlapping data to disk, but also can quickly release the cache capacity for subsequent use.

[0112] Reference Figure 4 , shows a schematic diagram of a process flow of a cache capacity release process provided in an embodiment of the present application, the cache capacity release process includes the following steps:

[0113] C1: Monitor the execution process of the storage software to be executed, set a processing mark for the current processing data of the storage software to be executed, and send the processing mark to the business execution module of the manufacturing control system. The business execution module is used to process the business data corresponding to the processing mark after responding to the processing mark.

[0114] In the actual implementation process, the manufacturing control system of the storage system can monitor the execution process of the storage software being executed and adjust the priority order of receiving and processing business data;

[0115] When the storage software starts to execute, a processing mark is set for the business data currently processed by the storage software. In the case where multiple different storage software processes different data, the dual controllers in the storage system can also be used to assign the storage software to the two controllers for separate execution. Then, based on the NTB (Non-Transparent Bridge), the data processed by each storage software is compared, and a processing mark is set for data that is processed by at least two storage software.

[0116] The processing mark is then sent to the business execution module of the manufacturing control system, and the business execution module will process the business data corresponding to the processing mark first according to the processing mark.

[0117] C2: When the storage software to be executed and the service execution module have completed processing the data corresponding to the processing mark, a disk identifier of the data corresponding to the processing mark is sent to the storage pool of the storage system.

[0118] When the storage software to be executed and the service execution module have completed processing the data corresponding to the processing mark, a disk identifier of the data corresponding to the processing mark may be sent to the storage pool of the storage system.

[0119] C3: the storage pool stores the data corresponding to the processing tag in response to the disk identifier.

[0120] When the storage pool detects the disk placement identifier, the data corresponding to the processing mark is placed on the disk. For example, the data corresponding to the processing mark is written to the system disk, and then written to the hard disk of the storage pool through the system disk.

[0121] C4: deleting the data corresponding to the processing mark in the available cache capacity to release the cache capacity of the data corresponding to the processing mark.

[0122] After the data corresponding to the processing mark is completely written to the disk, the data corresponding to the processing mark in the available cache capacity is deleted, that is, the double capacity occupied by this part of the data is released.

[0123] The CPU compares the business data and the data processed by the software function at the same time, and prioritizes writing the overlapping data to the hard disk. After the writing is completed, the cache capacity of the overlapping data is released.

[0124] The cache capacity adjustment method of the storage system provided in this embodiment can be applied to devices with high cache capacity requirements, such as servers or high-performance computers. This method can reorganize the memory units and system disks in the storage system into cache space, and expand the cache capacity with the assistance of the system disk of the storage system. On the basis of ensuring storage performance, more storage software functions can be brought into play, and problems such as system crashes and upgrade failures caused by insufficient cache capacity in the process of running high-specification feature software in the storage device can be solved. In addition, without affecting the normal use of the system disk, the utilization rate of the system disk capacity is improved, saving hard disk costs.

[0125] Reference Figure 5 , shows a functional module diagram of a cache capacity adjustment device for a storage system provided in an embodiment of the present application, which is applied to a storage system, wherein the storage system includes a controller, a memory unit and a system disk, and the device includes:

[0126] A total capacity determination module 100, configured to determine the capacity of the total cache space according to the capacity of the fixed cache unit and the capacity of the variable cache unit, wherein the fixed cache unit includes a memory unit and the variable cache unit includes the data capacity of the system disk;

[0127] The cache capacity update module 200 is used to update the available cache capacity in the total cache space according to the execution status of the current service by the storage system, and the available cache capacity is used to cache the data of the current service processed by the controller.

[0128] Optionally, the storage system may further include a cache hard disk unit, and the total capacity determination module includes:

[0129] A fixed cache capacity determination unit, used to determine the capacity of the fixed cache unit according to the capacity of the memory unit and the capacity of the cache hard disk unit;

[0130] A variable capacity determination unit, used to monitor the current data capacity of the system disk as the capacity of the variable cache unit;

[0131] The total capacity determination unit is used to determine the capacity of the total cache space according to the sum of the capacity of the fixed cache unit and the capacity of the variable cache unit.

[0132] Optionally, the cache capacity updating module includes:

[0133] A partition unit, configured to allocate an upper partition and a lower partition to the controller using the current available cache capacity of the total cache space, wherein the upper partition is used to cache the to-be-written data sent by the controller when processing the current business; and the lower partition is used to write the to-be-written data in the upper partition into a storage pool of the storage system;

[0134] A pre-reading unit, used to obtain the pre-reading data corresponding to the current business determined by the controller in the storage pool, and store it in the variable cache unit;

[0135] The updating unit is used to send the pre-read data in the variable cache unit to the front-end device corresponding to the current business after the pre-reading is completed, and to update the available cache capacity in the total cache space.

[0136] Optionally, the partition unit includes:

[0137] A starter unit, used to start the data compression software function in the manufacturing control system;

[0138] A first partitioning subunit is configured to respond to a read / write instruction sent by the manufacturing control system, determine a target size corresponding to the upper partition according to a compression ratio of the data compression software function and a current data size in the storage pool, and allocate an upper partition of the target size in the fixed cache unit;

[0139] The second partitioning subunit is used to allocate the cache space of non-upper-layer partitions in the total cache space as the lower-layer partition.

[0140] Optionally, the pre-reading unit includes:

[0141] a pre-read determination subunit, configured to, when the controller processes the current service, cause the controller to determine the pre-read data corresponding to the current service and to set a pre-read flag for the pre-read data in the storage pool;

[0142] The pre-reading sub-unit is used to obtain all pre-reading data carrying the pre-reading flag in the storage pool, and store them in the variable cache unit.

[0143] Optionally, the device further includes an allocatable cache capacity determination module, configured to:

[0144] Determine the allocatable cache capacity corresponding to the storage software in the available cache capacity;

[0145] Execute the storage software capacity optimization strategy to allocate corresponding cache capacity to the storage software to be executed for executing the current business.

[0146] Optionally, the allocatable cache capacity determination module includes:

[0147] A first capacity determination unit, configured to monitor the current business and determine a data processing cache capacity when the storage system processes the current business;

[0148] A second capacity determination unit, configured to monitor the operating state of the storage system and determine the system operating cache capacity of the storage system;

[0149] The third capacity determination unit is used to use the cache capacity other than the data processing cache capacity and the system operation cache capacity in the available cache capacity as the allocatable cache capacity corresponding to the storage software.

[0150] Optionally, the allocatable cache capacity determination module includes:

[0151] A first execution unit, configured to execute a first optimization sub-strategy in the storage software capacity optimization strategy, wherein the first optimization sub-strategy is used to determine the storage software to be executed for executing the current business;

[0152] The second execution unit is used to execute a second optimization sub-strategy in the storage software capacity optimization strategy, where the second optimization sub-strategy is used to allocate corresponding cache capacity to the storage software to be executed.

[0153] Optionally, the first execution unit includes:

[0154] An estimation subunit, used to estimate the base value of the cache capacity of each storage software when executing the current business;

[0155] A pre-allocation subunit is used to divide the allocatable cache capacity corresponding to the storage software in proportion according to the cache capacity base value of each storage software when executing the current business, and determine the pre-allocated storage capacity corresponding to each storage software;

[0156] The storage software to be executed determining subunit is used to determine one or more storage software to be executed according to the cache capacity base value of each storage software when executing the current business and the pre-allocated storage capacity.

[0157] Optionally, the second execution unit includes:

[0158] The allocation subunit is used to allocate the corresponding cache capacity to the one or more storage software to be executed in the allocatable cache capacity corresponding to the storage software according to the cache capacity base value corresponding to the one or more storage software to be executed when executing the current business.

[0159] Optionally, the device further comprises:

[0160] The temporary storage space determination module is used to use the remaining capacity in the allocatable cache capacity corresponding to the storage software as temporary storage space after allocating the corresponding cache capacity to the one or more storage software to be executed. The temporary storage space is used as auxiliary capacity for the execution of any storage software when the number of read and write operations per second corresponding to the current business is lower than a preset threshold during the execution of any storage software.

[0161] Optionally, the device further comprises a releasing module, wherein the releasing module is used to:

[0162] Monitoring the execution process of the to-be-executed stored software, setting a processing mark for the current processing data of the to-be-executed stored software, and sending the processing mark to the business execution module of the manufacturing control system, wherein the business execution module is used to process the business data corresponding to the processing mark after responding to the processing mark;

[0163] When the storage software to be executed and the service execution module have completed processing the data corresponding to the processing mark, a disk identifier of the data corresponding to the processing mark is sent to the storage pool of the storage system;

[0164] The storage pool stores the data corresponding to the processing mark in response to the disk identifier;

[0165] The data corresponding to the processing mark in the available cache capacity is deleted to release the cache capacity of the data corresponding to the processing mark.

[0166] Reference Figure 6 , shows a schematic diagram of a computer device provided in an embodiment of the present application, the computer device comprising: at least one processor 601, and a memory 602, the memory 602 storing a computer program that can be executed on the processor 601, wherein the processor 601 executes a cache capacity adjustment method of a storage system described in an embodiment when executing the computer program.

[0167] Reference Figure 7 , shows a schematic diagram of a non-volatile readable storage medium provided in an embodiment of the present application, wherein the non-volatile readable storage medium 700 stores a computer program 701, wherein when the computer program 701 is executed by a processor, a cache capacity adjustment method of a storage system described in an embodiment is executed.

[0168] Reference Figure 8, showing a schematic diagram of a computer program product provided in an embodiment of the present application, the computer program product 800 includes a computer program / instruction 801, and when the computer program / instruction 801 is executed by a processor, a cache capacity adjustment method of a storage system described in an embodiment is implemented.

[0169] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0170] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, devices, or computer program products. Therefore, the present application can adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0171] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a controller of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the controller of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0172] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0173] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0174] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.

[0175] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0176] Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A method for adjusting cache capacity of a storage system, It is characterized in that Applied to a storage system, the storage system includes a controller, a memory unit and a system disk, and the method includes: Determine the capacity of the total cache space according to the capacity of the fixed cache unit and the capacity of the variable cache unit, wherein the fixed cache unit includes the memory unit, and the variable cache unit includes the data capacity of the system disk, and the data capacity of the system disk is the capacity of the system disk used to store data in addition to the capacity occupied by the normal operation of the system and the applications in the system; According to the execution status of the current service by the storage system, updating the available cache capacity in the total cache space, wherein the available cache capacity is used to cache the data of the current service processed by the controller; Determine the allocatable cache capacity corresponding to the storage software in the available cache capacity; Execute the storage software capacity optimization strategy to allocate corresponding cache capacity to the storage software to be executed for executing the current business.

2. The method according to claim 1, It is characterized in that The storage system may further include a cache hard disk unit, and determining the capacity of the total cache space according to the capacity of the fixed cache unit and the capacity of the variable cache unit, including: Determining the capacity of the fixed cache unit according to the capacity of the memory unit and the capacity of the cache hard disk unit; Monitoring the current data capacity of the system disk as the capacity of the variable cache unit; The capacity of the total cache space is determined according to the sum of the capacity of the fixed cache unit and the capacity of the variable cache unit.

3. The method according to claim 1 or 2, It is characterized in that Updating the available cache capacity in the total cache space according to the execution status of the current service by the storage system includes: Using the current available cache capacity of the total cache space to allocate an upper partition and a lower partition to the controller, wherein the upper partition is used to cache the to-be-written data sent by the controller when processing the current business; and the lower partition is used to write the to-be-written data in the upper partition into a storage pool of the storage system; Acquire the pre-read data corresponding to the current service determined by the controller in the storage pool, and store the pre-read data in the variable cache unit; After the pre-reading is completed, the pre-read data in the variable cache unit is sent to the front-end device corresponding to the current service, and the available cache capacity in the total cache space is updated.

4. The method according to claim 3, It is characterized in that Allocating an upper partition and a lower partition to the controller using the current available cache capacity of the total cache space includes: Enable data compression software in manufacturing control systems; In response to the read and write instructions sent by the manufacturing control system, determining the target size corresponding to the upper partition according to the compression ratio of the data compression software function and the size of the data currently in the storage pool; Allocating an upper partition of the target size in the fixed cache unit; The cache space other than the upper partition in the total cache space is allocated as the lower partition.

5. The method according to claim 3, It is characterized in that Acquiring the pre-read data corresponding to the current service determined by the controller in the storage pool and storing the pre-read data in the variable cache unit includes: When the controller processes the current business, the controller determines the pre-read data corresponding to the current business and sets a pre-read flag for the pre-read data in the storage pool; All pre-read data carrying the pre-read flag in the storage pool are acquired and stored in the variable cache unit.

6. The method according to claim 1, It is characterized in that Determining the allocatable cache capacity corresponding to the storage software in the available cache capacity includes: Monitoring the current business and determining the data processing cache capacity of the storage system when processing the current business; Monitoring the operating status of the storage system and determining the system operating cache capacity of the storage system; The cache capacity other than the data processing cache capacity and the system operation cache capacity in the available cache capacity is used as the allocatable cache capacity corresponding to the storage software.

7. The method according to claim 1, It is characterized in that Executing a storage software capacity optimization strategy to allocate corresponding cache capacity to the storage software to be executed for executing the current business includes: Executing a first optimization sub-strategy in the storage software capacity optimization strategy, wherein the first optimization sub-strategy is used to determine the storage software to be executed for executing the current business; A second optimization sub-strategy in the storage software capacity optimization strategy is executed, where the second optimization sub-strategy is used to allocate corresponding cache capacity for the storage software to be executed.

8. The method according to claim 7, It is characterized in that Executing the first optimization sub-strategy in the storage software capacity optimization strategy includes: Estimate the base value of cache capacity of each storage software when executing the current business; According to the cache capacity base value of each storage software when executing the current business, the allocatable cache capacity corresponding to each storage software is split in proportion to determine the pre-allocated storage capacity corresponding to each storage software; One or more storage software to be executed are determined according to the cache capacity base values ​​of the respective storage software when executing the current service and the pre-allocated storage capacity.

9. The method according to claim 8, It is characterized in that Executing the second optimization sub-strategy in the storage software capacity optimization strategy includes: According to the cache capacity base values ​​corresponding to the one or more storage software to be executed when executing the current business, the cache capacities corresponding to the one or more storage software to be executed are allocated to the one or more storage software to be executed in the allocatable cache capacity corresponding to the storage software.

10. The method according to claim 8, It is characterized in that After executing the second optimization sub-strategy in the storage software capacity optimization strategy, the method further includes: After allocating the corresponding cache capacity to the one or more storage software to be executed, the remaining capacity in the allocatable cache capacity corresponding to the storage software is used as temporary storage space. The temporary storage space is used as auxiliary capacity for the execution of any storage software when the number of read and write operations per second corresponding to the current business is lower than a preset threshold during the execution of any storage software.

11. The method according to claim 1, It is characterized in that The method further comprises: Monitoring the execution process of the to-be-executed stored software, setting a processing mark for the current processing data of the to-be-executed stored software, and sending the processing mark to the business execution module of the manufacturing control system, wherein the business execution module is used to process the business data corresponding to the processing mark after responding to the processing mark; When the storage software to be executed and the service execution module have completed processing the data corresponding to the processing mark, a disk identifier of the data corresponding to the processing mark is sent to the storage pool of the storage system; The storage pool stores the data corresponding to the processing mark in response to the disk identifier; The data corresponding to the processing mark in the available cache capacity is deleted to release the cache capacity of the data corresponding to the processing mark.

12. A computer device, It is characterized in that include: At least one processor, and a memory, wherein the memory stores a computer program that can be run on the processor, wherein when the processor executes the computer program, a cache capacity adjustment method for a storage system as described in any one of claims 1-11 is executed.

13. A non-volatile readable storage medium, It is characterized in that The non-volatile readable storage medium stores a computer program, wherein the computer program, when executed by a processor, executes a cache capacity adjustment method for a storage system according to any one of claims 1 to 11.

14. A computer program product comprising a computer program / instructions, It is characterized in that When the computer program / instruction is executed by a processor, a cache capacity adjustment method for a storage system as described in any one of claims 1 to 11 is implemented.