Storage configuration adjustment method, storage medium, electronic equipment and program product
By monitoring the business situation of the business system and the performance data of the controller nodes, generating performance warning information and dynamically adjusting configuration operations, the resource competition problem during the cache mirroring is solved, and the resource optimization and performance stability of the storage system are achieved.
Patent Information
- Application Number
- CN202510395937.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-31
- Publication Date
- 2025-04-29
- Estimated Expiration
- 2045-03-31
AI Technical Summary
During cache image reorganization, storage configuration operations can lead to resource competition and affect the performance of the storage system.
By monitoring the business situation of the business system, determining the performance data of the storage controller node, and generating performance warning information when the target performance data does not meet the preset conditions, dynamically adjusting multiple execution configuration operations to ensure that the target performance data meets the performance conditions.
The optimization of storage system resources and stable performance balance is achieved, performance degradation caused by resource competition is avoided, and the availability of storage system is improved.
Smart Images

Figure CN119902722A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a storage configuration adjustment method, a storage medium, an electronic device, and a program product. Background Art
[0002] In storage arrays, especially high-end multi-controller storage arrays, cache mirror pair reorganization is a routine but critical operation for data protection and fault recovery.
[0003] Currently, in the related art, performing storage configuration operations during cache mirror pair reorganization will cause resource competition between cache mirror pair reorganization and front-end storage services, thereby affecting the performance of the storage system. Summary of the invention
[0004] The present application provides a storage configuration adjustment method, storage medium, electronic device and program product. Its main purpose is to solve the problem that the storage configuration operation during the cache mirror pair reorganization in the related technology will cause resource competition between the cache mirror pair reorganization and the front-end storage business, thereby affecting the performance of the storage system.
[0005] In a first aspect, the present application provides a method for adjusting a storage configuration, comprising: Monitor the business conditions of the business system, and determine the performance data of the storage controller node in the storage system corresponding to the business system based on the business conditions; Determining target performance data, pending configuration operations, and multiple executed configuration operations of the storage controller node during cache mirror pair reorganization based on the performance data; In the case where it is determined that the target performance data does not meet the preset performance condition during the cache mirror pair reorganization, generating performance warning information of the storage controller node based on the configuration operation to be executed and the multiple executed configuration operations; Based on the performance warning information, multiple execution configuration operations are adjusted to make the target performance data meet the performance conditions.
[0006] In a second aspect, the present application provides a storage configuration adjustment device, comprising: A monitoring module is configured to monitor the business conditions of the business system and determine the performance data of the storage controller node in the storage system corresponding to the business system based on the business conditions; A determination module configured to determine target performance data, a configuration operation to be performed, and a plurality of performed configuration operations of the storage controller node during the reorganization of the cache mirror pair according to the performance data; a generating module configured to generate performance warning information of the storage controller node based on the configuration operation to be executed and the plurality of executed configuration operations if it is determined that the target performance data does not meet the performance condition during the reorganization of the preset cache mirror pair; The adjustment module is configured to adjust multiple execution configuration operations based on the performance warning information so that the target performance data meets the performance conditions.
[0007] In a third aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, which implements the method of the first aspect when the computer program is executed by a processor.
[0008] In a fourth aspect, the present application provides an electronic device, comprising a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, wherein the processor implements the method of the first aspect when executing the computer program.
[0009] In a fifth aspect, the present application provides a computer program product having a computer program stored thereon, which implements the method of the first aspect when the computer program is executed by a processor.
[0010] The present application provides a storage configuration adjustment method, storage medium, electronic device and program product, wherein the method includes: monitoring the business situation of the business system, and determining the performance data of the storage controller node in the storage system corresponding to the business system based on the business situation; determining the target performance data, the configuration operation to be executed and multiple execution configuration operations of the storage controller node during the cache mirror pair reorganization according to the performance data; generating performance warning information of the storage controller node based on the configuration operation to be executed and multiple execution configuration operations when it is determined that the target performance data does not meet the performance conditions during the preset cache mirror pair reorganization; adjusting multiple execution configuration operations based on the performance warning information so that the target performance data meets the performance conditions. Compared with the related art, the present application can monitor the business situation of the business system, and if it is determined that the target performance data of the storage controller node does not meet the performance conditions during the cache mirror pair reorganization, it can generate warning information and dynamically adjust multiple execution configuration operations so that the performance conditions can be met after the adjustment, thereby achieving a balance between resource optimization and performance stability of the storage system, avoiding the situation that the storage system does not meet the performance conditions due to multiple execution configuration operations during the cache mirror pair reorganization, thereby causing the storage system to be unable to normally undertake business, thereby improving the availability of the storage system.
[0011] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present application, nor is it intended to limit the scope of the present application. Other features of the present application will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] In order to more clearly illustrate the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0013] Figure 1 A schematic diagram of a flow chart of a storage configuration adjustment method provided in an embodiment of the present application is shown; Figure 2 A schematic diagram showing a flow chart of another storage configuration adjustment method provided in an embodiment of the present application; Figure 3 A schematic diagram showing an example provided by an embodiment of the present application; Figure 4 A schematic diagram of the structure of a storage configuration adjustment device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION
[0014] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0015] It should be noted that, in the description of this application, the terms "include", "comprise" or any other variant thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. The terms "first", "second", etc. in this application are used to distinguish similar objects, and are not used to describe a specific order or sequence.
[0016] In storage arrays, especially high-end multi-controller storage arrays, cache mirror pair reorganization is a routine but critical operation for data protection and fault recovery. However, during the reorganization process, configuration operations such as storage pools and volumes may affect the reorganization process due to resource competition and even affect the performance of the entire system. Especially under high business pressure, resource competition may lead to longer response time and even affect business operations. Currently, there is no independent module with an effective policy mechanism in the relevant technology to adjust the configuration operation strategy during the reorganization according to real-time business pressure to improve reliability, optimize performance and resource utilization. Under the pressure of complex business models with high loads, it is easy for cache mirror pairs to fail to be reorganized in time due to problems such as resource competition, and even affect the cluster's inability to respond to front-end business in time, thereby affecting the availability of the entire storage system.
[0017] In order to improve the technical problem that the storage configuration operation during the cache mirror pair reorganization in the related technology will cause resource competition between the cache mirror pair reorganization and the front-end storage business, thereby affecting the performance of the storage system. This embodiment provides a method for adjusting the storage configuration, such as Figure 1 As shown, the method comprises the following steps: Step 101: Monitor the business situation of the business system, and determine the performance data of the storage controller node in the storage system corresponding to the business system based on the business situation.
[0018] It should be noted that the execution subject of the embodiment of the present application can be a storage system, specifically a whole machine storage system. Optionally, the whole machine storage system is an enterprise-level storage solution designed to meet the needs of high capacity, high performance and high availability. These systems may include various types of storage media (such as HDD, SSD), controllers, front-end interfaces (for connecting to the host), back-end interfaces (for connecting to the storage medium), and a series of software functions to manage data access, protection and optimization. In some examples, the key components of the whole machine storage system may include: Hard disk drive (HDD): provides large-capacity data storage, suitable for applications that require a large amount of storage space. Solid-state drive (SSD): provides faster data reading and writing speeds, especially for applications with high performance requirements. Hybrid configuration: Combine HDD and SSD, and use SSD as a cache layer to accelerate frequently accessed data. Controller: The controller is one of the core components of the storage system, responsible for managing and allocating storage resources, performing independent disk redundant array (RAID) calculations, and processing data transmission. High-end systems may contain multiple controllers to improve redundancy and performance. Front-end interface: Provides standard interfaces for connecting to hosts or clients, such as Fibre Channel (FC), Internet Small Computer System Interface (iSCSI), Network File System / Common Internet File System (NFS / CIFS), etc. Back-end interface: Used to connect to storage media and supports different types of disk interface technologies. Cache: The high-speed cache inside the storage system can significantly improve read and write performance. Cache strategies include prefetch, write-back, and write-through, which are designed to optimize performance under different types of workloads. Management software: Provides a graphical user interface (GUI) or command line interface (CLI) to facilitate administrators to configure, monitor, and maintain the storage system. Functions include but are not limited to volume management, snapshot creation, replication, remote mirroring, performance monitoring, etc. Power and cooling system: A stable and reliable power supply is essential to ensure the normal operation of the storage system. The cooling system ensures that all components operate at a suitable operating temperature to prevent failures caused by overheating.
[0019] In the embodiment of the present application, the business system may be an upper-level business pressure system. Specifically, the upper-level business pressure system may be a tool and method for simulating and testing the performance and stability of an application or service under high load conditions. The main purpose of such a system is to ensure that the application can run normally under the expected user load and identify potential performance bottlenecks and failure points.
[0020] For this embodiment, the business situation of the business system may include a business model (large and small data blocks, sequential / random, read / write, etc.) and a business pressure situation, wherein the data block size may include a small data block: such as 4KB, 8KB, etc., which are usually used for database operations or metadata operations of the file system. Large data blocks: such as 64KB, 128KB or even larger, suitable for application scenarios such as video streaming and big data processing that require the transmission of a large amount of continuous data. Access modes may include sequential access: data is read or written sequentially, which is common in applications such as media playback and backup. Sequential access usually has higher throughput and lower I / O latency. Random access: data is accessed in a non-sequential manner, such as database queries. Random access has high requirements for the number of input and output operations per second (IOPS), but relatively low throughput. The read-write ratio may include read-intensive: such as application scenarios such as Web servers and data analysis, which mainly focus on data reading operations. Write-intensive: such as scenarios such as logging and transaction processing, which pay more attention to data writing efficiency. Mixed read-write: Many practical applications have both a large number of read operations and a large number of write operations, such as online transaction processing (OLTP) systems, etc.
[0021] As an optional method, business pressure can be the workload that the business system needs to handle in a specific period of time. This can be measured by the following dimensions, but not limited to: 1. Concurrent users: the number of users accessing the system at the same time. 2. Request frequency: the number of requests issued per unit time. 3. Peak load: the maximum workload reached in a short period of time. 4. Duration: the length of time the high load state lasts, etc.
[0022] In some examples, the storage controller nodes in the storage system are the core components responsible for managing and processing data storage and retrieval requests. They are the bridge connecting the front-end (such as the server or client) and the back-end storage devices such as hard disk drives (HDDs), solid-state drives (SSDs), etc., to ensure that data can be stored and accessed efficiently and reliably; among them, the main functions of the storage controller nodes may include but are not limited to: 1. Data transmission management: responsible for receiving read and write requests from front-end applications and forwarding these requests to the corresponding storage media. Implement efficient data transmission protocols such as Fibre Channel (FC), Internet Small Computer System Interface (iSCSI), etc. 2. Cache management: Use high-speed cache to accelerate frequently accessed data and reduce the number of direct accesses to slow storage media. Implement intelligent caching strategies such as pre-fetch algorithms and write-back mechanisms to improve overall I / O efficiency. 3. RAID management: Support different levels of RAID configurations (such as RAID 0, 1, 5, 6) to provide data redundancy and fault tolerance. Automatically rebuild damaged disk data to maintain data consistency and integrity. 4. Fault detection and recovery: Real-time monitoring of hardware status, including the working conditions of key components such as power supplies, fans, and disks. Automatically trigger the recovery process when a failure occurs, such as switching to a backup controller or starting data reconstruction operations. 5. Load balancing: Distributed deployment of multiple controllers to share workloads through load balancing technology to avoid single-point overload. Dynamically adjust resource allocation strategies to adapt to changing workload requirements.
[0023] For this embodiment, the performance data of the storage controller node in the storage system may include but is not limited to: Input / Output Operations Per Second (IOPS), throughput, latency, bandwidth utilization, CPU utilization, memory utilization, queue depth, cache hit rate, error rate, etc.
[0024] Step 102: Determine target performance data, configuration operations to be executed, and multiple executed configuration operations of the storage controller node during cache mirror pair reorganization according to the performance data.
[0025] In an embodiment of the present application, the cache mirror pair reorganization period can be a period for reestablishing or adjusting the data synchronization relationship between the primary cache (Primary Cache) and the mirror cache (Mirror Cache or Secondary Cache) when failure recovery, maintenance operations, or system expansion activities occur between the two.
[0026] In some examples, the target performance data may be performance data of the storage system during cache mirror pair reorganization; accordingly, the multiple executed configuration operations may be configuration operations currently being executed by the storage system, and the configuration operations to be executed may be configuration operations that the storage system needs to execute next.
[0027] Step 103: if it is determined that the target performance data does not meet the preset performance condition during the cache mirror pair reorganization, generate performance warning information of the storage controller node based on the configuration operation to be executed and the multiple executed configuration operations.
[0028] In the embodiment of the present application, the performance warning information may be alarm information generated when the performance does not meet the performance condition.
[0029] Step 104: Adjust multiple execution configuration operations based on the performance warning information so that the target performance data meets the performance conditions.
[0030] In some examples, adjusting the multiple execution configuration operations may include reducing the operating efficiency level or suspending the execution of the multiple execution configuration operations, so that the target performance data of the storage system can meet the performance conditions during the cache mirror pair reorganization.
[0031] Compared with the related art, this embodiment can monitor the business situation of the business system, and if it is determined that the target performance data of the storage controller node does not meet the performance conditions during the reorganization of the cache mirror pair, it can generate early warning information and dynamically adjust multiple execution configuration operations so that the performance conditions can be met after the adjustment, thereby achieving a balance between resource optimization and performance stability of the storage system, avoiding the situation in which the storage system does not meet the performance conditions due to multiple execution configuration operations during the reorganization of the cache mirror pair, thereby causing the storage system to be unable to undertake business normally, thereby improving the availability of the storage system.
[0032] Further, as a refinement and extension of the above embodiment, optionally, this embodiment also provides a method for adjusting the storage configuration, such as Figure 2 As shown, the method includes: Step 201: Monitor the business situation of the business system, and determine the performance data of the storage controller node in the storage system corresponding to the business system based on the business situation.
[0033] Optionally, step 201 may specifically include: interconnecting the business system and the storage system through a high-speed link; monitoring the business model and business pressure situation of the business system, and determining the performance data of the storage controller node in the storage system corresponding to the business system based on the business model and business pressure situation.
[0034] In the embodiments of the present application, Figure 3As shown, the business module is the business system in the embodiment of the present application, which is generally the user's business server, etc., which is interconnected with the storage array through high-speed data links such as Fibre Channel (FC) or Internet Protocol (IP) or remote direct memory access (RDMA over Converged Ethernet, RoCE) based on converged Ethernet or InfiniBand (IB), i.e., the storage system in the embodiment of the present application. A business pressure monitoring and analysis module may be included in the storage system. Specifically, the business pressure monitoring and analysis module is located on the storage, and can obtain the current business model (large and small data blocks, sequential / random, read / write, etc.) and business pressure of the business system, and monitor the pressure of the front-end business in real time. The pressure can be comprehensively evaluated through multiple indicators such as the system's IOPS, bandwidth, CPU usage, and latency.
[0035] Step 202: Perform data cleaning based on the performance data to obtain target performance data.
[0036] In an embodiment of the present application, data cleaning processing may specifically be removing erroneous data in the performance data, thereby obtaining target performance data.
[0037] Step 203: Determine the business pressure of the storage controller node based on the performance data, and determine the configuration operation to be executed and multiple execution configuration operations according to the configuration operation policy corresponding to the business pressure.
[0038] In some examples, when the business pressure is determined to be within a preset low pressure range using a preset nonlinear function, the first strategy is determined as the configuration operation strategy; when the business pressure is determined to be within a preset high pressure range using a preset nonlinear function, the second strategy is determined as the configuration operation strategy; and the configuration operation to be executed is determined based on the configuration operation strategy and multiple execution configuration operations.
[0039] The first strategy is to allow the execution of multiple execution configuration operations in sequence, and the second strategy is to suspend the execution of multiple execution configuration operations in sequence.
[0040] In the embodiments of the present application, Figure 3 As shown, the storage module also includes a pressure response module. Specifically, the pressure response module is located on the storage and can determine the current configuration operation strategy through a nonlinear function based on the target performance data transmitted by the business pressure monitoring and analysis module. The nonlinear function is designed to gradually allow more configuration operations under low pressure and restrict these operations under high pressure to ensure that the cache mirror pair reorganization process is not interfered with.
[0041] It should be noted that the nonlinear function may be a function preset by the cache mirror state management module in the storage system.
[0042] In some examples, the preset low pressure range may be the pressure range corresponding to when the storage module is in a low pressure mode; correspondingly, the high pressure range may be the pressure range corresponding to when the storage module is in a high pressure mode. In the embodiment of the present application, the values of the low pressure range and the high pressure range may be set according to demand or system conditions and are not specifically limited here.
[0043] Step 204: if it is determined that the target performance data does not meet the preset performance condition during the cache mirror pair reorganization, generate performance warning information of the storage controller node based on the configuration operation to be executed and the multiple executed configuration operations.
[0044] In the embodiments of the present application, Figure 3 As shown, it also includes a cache mirror pair state management module, which obtains real-time performance data A (IOPS, bandwidth, CPU utilization, latency, etc.) of each storage controller node through the business pressure monitoring and analysis module. The cache mirror pair state management module obtains the current real-time storage configuration action, i.e., multiple execution configuration operations in the embodiment of the present application, and the next step requirement, i.e., the configuration operation to be executed in the embodiment of the present application, through the storage configuration management module.
[0045] Optionally, step 204 may specifically include: determining the execution mode and performance threshold of the storage controller node; comparing the target performance data with the first performance threshold in normal mode, and if it is determined that the target performance data is less than the first performance threshold, generating performance warning information based on the configuration operation to be executed and multiple execution configuration operations.
[0046] The execution modes include a normal mode and a high availability mode, and the performance threshold includes a first performance threshold and a second performance threshold.
[0047] In an embodiment of the present application, according to the configuration and requirements of the system, the storage controller can operate in different modes, mainly divided into normal mode and high availability mode; wherein, in normal mode, the storage system includes only one controller to handle all I / O requests. If the controller fails, the entire storage system may become unavailable until the controller is repaired or replaced. Since there is only one controller, there is no built-in redundancy mechanism to prevent service interruptions caused by hardware failures. Data security relies on disk-level redundancy provided by technologies such as RAID, but does not include controller-level protection. Compared with the high availability mode, the initial investment in normal mode is lower, which is suitable for environments with limited budgets and high tolerance for downtime.
[0048] In some examples, in high-availability mode, storage systems improve system reliability and continuous availability by adding redundancy and automated recovery mechanisms: Dual-controller architecture: The system is equipped with two independent controllers, one of which serves as the primary controller to handle all I / O requests, and the other serves as a backup controller, automatically taking over its responsibilities when the primary controller fails. Multi-controller architecture: Expands the concept of dual-controller and adds more controller nodes, further enhancing the system's scalability and high availability. Automatic failover: When a primary controller failure is detected, the system can automatically transfer control to the backup controller to ensure service continuity. The failover process is usually transparent and minimizes the impact on end users. In dual-controller or multi-controller architectures, data consistency needs to be maintained between controllers, which is usually achieved through mirror cache, logging or other synchronization mechanisms. After failure recovery, the system automatically synchronizes data to ensure that the data of all nodes is up to date. Provides detailed health check and status monitoring functions, and administrators can view the system's operating status in real time through a graphical interface or command line tool. Supports setting alarm thresholds, and notifications will be sent to administrators once the set value is exceeded.
[0049] For this embodiment, the execution of determining the performance threshold of the storage controller node may specifically include: determining the standard performance data, the first performance optimization coefficient and the second performance optimization coefficient corresponding to the storage controller node performing multiple execution configuration operations; determining the product of the standard performance data and the first performance optimization coefficient as the first performance threshold, and determining the product of the standard performance data and the second performance optimization coefficient as the second performance threshold.
[0050] In some examples, the standard performance data may be the optimal theoretical performance of each storage controller node under different data models (large and small data blocks, sequential / random, read / write, etc.) under different storage configuration actions when the cache mirror pair is reorganized. The first performance optimization coefficient and the second performance optimization coefficient may be pre-configured coefficients, wherein the first performance optimization coefficient and the second performance optimization coefficient may be the same or different. The numerical relationship between the first performance optimization coefficient and the second performance optimization coefficient is not limited in the embodiments of the present application.
[0051] For this embodiment, when generating performance warning information based on the configuration operation to be executed and multiple execution configuration operations, it may include: determining a first performance requirement corresponding to the multiple execution configuration operations and a second performance requirement corresponding to the configuration operation to be executed, and when it is determined that the first performance requirement is not lower than the second performance requirement, generating first performance warning information corresponding to the first warning level; when it is determined that the first performance requirement is lower than the second performance requirement, generating operation mode switching information and second performance warning information corresponding to the second warning level.
[0052] Among them, the second warning level is higher than the first warning level, and the operation mode switching information is used to request switching to the high availability mode.
[0053] Optionally, the method of this embodiment further includes: in a high availability mode, comparing the target performance data with a second performance threshold, and generating first performance warning information when it is determined that the target performance data is less than the second performance threshold.
[0054] As an optional method, the cache mirror pair state management module can also report the first-level cache mirror pair state warning, i.e., the first performance warning information in the embodiment of the present application, if the target performance data A is always less than the first performance threshold (optimal theoretical performance B×first performance optimization coefficient K1) in the cache mirror pair reorganization time period T1 in the normal mode. If the next storage configuration requirement obtained by the cache mirror pair state management module at this time is higher than the current moment, the cache mirror pair state management module will upgrade the first-level cache mirror pair state warning to the second-level cache mirror pair state warning, i.e., the second performance warning information in the embodiment of the present application, and report whether to switch to the high availability mode at the same time. In the high availability mode, if the target performance data A is always less than (optimal theoretical performance B×second performance optimization coefficient K2) in the time period T2, the cache mirror pair state management module will report the first-level cache mirror pair state warning.
[0055] Step 205: Adjust multiple execution configuration operations based on the performance warning information so that the target performance data meets the performance conditions.
[0056] Optionally, step 205 may specifically include: in high availability mode, assigning corresponding execution weights and execution efficiency levels to multiple execution configuration operations according to the degree of performance impact on cache mirror pair reorganization; and adjusting the execution efficiency levels of multiple execution configuration operations based on performance warning information and execution weights.
[0057] In some examples, the cache mirror pair state management module can also divide execution weights for all configuration actions in high availability mode, for example, L1, L2, L3...Ln (the sum is 1) and execution efficiency levels, for example, Q1, Q2, Q3...Qn (from small to large, Qn is full-speed execution). The division is mainly based on the impact of the configuration action on the system performance when the cache mirror pair is reorganized. The greater the impact, the greater the weight.
[0058] In an embodiment of the present application, when adjusting the execution efficiency level of multiple execution configuration operations based on performance warning information and execution weights, it can include: when generating the first performance warning information, if it is determined that the business pressure of the storage controller node is less than a predetermined business pressure threshold, then the execution efficiency of the multiple configuration operations to be executed is reduced by a first preset number of levels in sequence from large to small according to the execution weights, until it is determined that the target performance data is greater than or equal to the second performance threshold; if it is determined that the business pressure is greater than or equal to the predetermined business pressure threshold, then the execution efficiency of the multiple configuration operations to be executed is reduced by a second preset number of levels in sequence from large to small according to the execution weight values, until it is determined that the target performance data is greater than or equal to the second performance threshold.
[0059] Exemplarily, lowering the first preset number level may be lowering it by one level or by two levels, and lowering the second preset number level may be lowering it by two levels or by three levels. It should be noted that the values of the first preset number level and the second preset number level can be set according to demand or system conditions, and are not limited here.
[0060] As an optional method, the cache mirror pair status management module can also, when the business pressure is less than the predetermined business pressure threshold C1 under the first-level cache mirror pair status alarm, the cache mirror pair status management module will, according to the current configuration action weight value, give priority to adjusting the execution efficiency gear -N1 of the high-weight configuration action, that is, reducing the first preset number of levels in the embodiment of the present application, until the target performance data A is not less than (optimal theoretical performance B×second performance optimization coefficient K2) within the cache mirror pair reorganization time period T2.
[0061] Under the first-level CPS alarm, the cache image pair status management module will, when the business pressure is not less than the predetermined business pressure threshold C1, according to the current configuration action weight value, give priority to adjusting the execution efficiency gear -N2 of the high-weight configuration action, that is, reducing the second preset number level in the embodiment of the present application, until the target performance data A is not less than (the best theoretical performance B×the second performance optimization coefficient K2) within the cache image pair reorganization time period T2.
[0062] Optionally, an embodiment of the present application also includes: when the execution efficiency levels of multiple configuration operations to be executed are reduced to the lowest level, if the target performance data is less than a second performance threshold, a second performance warning information is generated and multiple configuration operations to be executed are suspended in sequence from large to small according to the execution weight values until it is determined that the target performance data is greater than or equal to the second performance threshold.
[0063] As an optional method, when the execution efficiency gear of all configuration actions is at the lowest level Q1, and the target performance data A is always less than (the best theoretical performance B×the second performance optimization coefficient K2) within the cache mirror pair reorganization time period T2, the cache mirror pair status reports a secondary cache mirror pair status alarm and suspends high-weight configuration actions in turn until the target performance data A is not less than (the best theoretical performance B×the second performance optimization coefficient K2) within the cache mirror pair reorganization time period T2.
[0064] Exemplarily, in normal mode, if the target performance data A is always less than the best theoretical performance B×75% (i.e., the first performance optimization coefficient K1 in the embodiment of the present application) within the cache mirror pair reorganization time period of 2min (i.e., the cache mirror pair reorganization time period T1 in the embodiment of the present application), the cache mirror pair status management module will report a first-level cache mirror pair status warning. If the next storage configuration requirement obtained by the cache mirror pair status management module at this time is higher than the current moment, the cache mirror pair status management module will upgrade the first-level cache mirror pair status warning to a second-level cache mirror pair status warning and report whether to switch to high availability mode. In high availability mode, if the target performance data A is always less than the best theoretical performance B×85% (i.e., the first performance optimization coefficient K2 in the embodiment of the present application) within the time period of 1min (i.e., the cache mirror pair reorganization time period T2 in the embodiment of the present application), the cache mirror pair status management module will report a first-level cache mirror pair status alarm.
[0065] Correspondingly, the storage configuration management module divides all configuration actions into execution weights of 0.5, 0.3, 0.2 (sum is 1) and execution efficiency gears of 1, 2, 3...16 (from small to large, 16 is full-speed execution) in high-availability mode. The division is mainly based on the impact of the configuration action on the system performance during the reorganization of the cache mirror pair. The greater the impact, the greater the weight. Under the first-level cache mirror pair status alarm, the cache mirror pair status management module will, when the business pressure is less than 35% (i.e., the predetermined business pressure threshold C1 in the embodiment of the present application), according to the current configuration action weight value, give priority to adjusting the execution efficiency gear of the high-weight configuration action -1 (i.e., reducing the first preset number of levels in the embodiment of the present application), until the target performance data A is not less than B*85% within the time period of 1min (i.e., the cache mirror pair reorganization time period T2 in the embodiment of the present application). When the first-level cache mirror pair status alarm is on, the cache mirror pair status management module will, when the business pressure is not less than 35%, prioritize the adjustment of the execution efficiency gear of the high-weight configuration action to -3 (i.e., reducing the second preset number of levels in the embodiment of the present application) according to the current configuration action weight value, until the target performance data A is not less than the optimal theoretical performance B*85% (i.e., the first performance optimization coefficient K2 in the embodiment of the present application) within the time period of 1min (i.e., the cache mirror pair reorganization time period T2 in the embodiment of the present application).
[0066] Optionally, if the execution efficiency gear of all configuration actions is 1 (i.e., the lowest level in the embodiment of the present application) at this time, and the target performance data A is always less than the optimal theoretical performance B*85% (i.e., the first performance optimization coefficient K2 in the embodiment of the present application) within the time period of 1min (i.e., the cache mirror pair reorganization time period T2 in the embodiment of the present application), the cache mirror pair status management module reports the secondary cache mirror pair status alarm and suspends high-weight configuration actions in turn until the target performance data A is not less than the optimal theoretical performance B*85% (i.e., the first performance optimization coefficient K2 in the embodiment of the present application) within the time period of 1min (i.e., the cache mirror pair reorganization time period T2 in the embodiment of the present application).
[0067] It should be noted that the first performance optimization coefficient K1, the second performance optimization coefficient K2, the cache mirror pair reorganization time period T1, the cache mirror pair reorganization time period T2, the execution weight L1, L2, L3...Ln, the execution efficiency level, Q1, Q2, Q3...Qn, the predetermined business pressure threshold C1, the first preset number level N1, the second preset number level N2, etc. are all system preset parameters, which can be adjusted in the system or parameter module, etc. At the same time, in the high availability mode, the cache mirror pair state management module integrates AI algorithms, predicts business pressure trends, models, etc. based on historical business data and adjusts corresponding strategies in advance, such as optimizing threshold parameters based on historical data (i.e., the first performance optimization coefficient K1 and the second performance optimization coefficient K2 in the embodiment of the present application), dynamically allocating execution weights, etc., avoiding mechanical execution gear adjustment and further improving response accuracy. The storage configuration operation during the reorganization of the mirror pair is intelligently processed by the cache mirror pair state management module. By real-time monitoring of front-end business pressure, the embodiment of the present application adjusts the execution strategy of the storage configuration task according to the pressure level, thereby achieving a balance between system resource optimization and performance stability, especially the multiple cache mirror pair state strategy processing in high-availability mode, avoiding abnormal situations such as the cluster being unable to normally undertake front-end business due to the reorganization of cache mirror pairs in extreme scenarios due to high-load complex business model pressure coupling failure scenarios, thereby improving the availability of the entire system.
[0068] Optionally, the embodiment of the present application further includes: in response to configuring a target function, adjusting a plurality of execution configuration operations based on the target function.
[0069] like Figure 3 As shown, the storage module of the embodiment of the present application may further include a parameter module, and specifically, the parameter module may be used to perform information exchange between the outside world and the multiple cache mirrors, parameter presets, and activation of related functions of the state management module.
[0070] Compared with the related art, this embodiment can monitor the business situation of the business system, and if it is determined that the target performance data of the storage controller node does not meet the performance conditions during the reorganization of the cache mirror pair, it can generate early warning information and dynamically adjust multiple execution configuration operations so that the performance conditions can be met after the adjustment, thereby achieving a balance between resource optimization and performance stability of the storage system, avoiding the situation in which the storage system does not meet the performance conditions due to multiple execution configuration operations during the reorganization of the cache mirror pair, thereby causing the storage system to be unable to undertake business normally, thereby improving the availability of the storage system.
[0071] The embodiment of the present application also provides a storage configuration adjustment device, as Figure 1 The specific implementation of the method shown is as follows Figure 4As shown, the device includes: a monitoring module 31, a determining module 32, a generating module 33, and an adjusting module 34.
[0072] The monitoring module 31 is configured to monitor the business conditions of the business system and determine the performance data of the storage controller node in the storage system corresponding to the business system based on the business conditions; A determination module 32, configured to determine target performance data, a configuration operation to be performed, and a plurality of performed configuration operations of the storage controller node during the cache mirror pair reorganization period according to the performance data; A generating module 33 is configured to generate performance warning information of the storage controller node based on the configuration operation to be executed and the multiple executed configuration operations when it is determined that the target performance data does not meet the preset performance condition during the cache mirror pair reorganization; The adjustment module 34 is configured to adjust the plurality of execution configuration operations based on the performance warning information so that the target performance data meets the performance condition.
[0073] In some examples of this embodiment, the determination module 32 is specifically configured to perform data cleaning processing based on the performance data to obtain target performance data; determine the business pressure of the storage controller node based on the performance data, and determine the configuration operation to be executed and multiple execution configuration operations according to the configuration operation policy corresponding to the business pressure.
[0074] In some examples of the present embodiment, the determination module 32 is further configured to use a preset nonlinear function to determine a first strategy as a configuration operation strategy when it is determined that the business pressure belongs to a preset low pressure range, wherein the first strategy is to allow execution of multiple execution configuration operations in sequence; use a preset nonlinear function to determine a second strategy as a configuration operation strategy when it is determined that the business pressure belongs to a preset high pressure range, wherein the second strategy is to suspend execution of multiple execution configuration operations in sequence; and determine the configuration operation to be executed based on the configuration operation strategy and multiple execution configuration operations.
[0075] In some examples of this embodiment, the generation module 33 is specifically configured to determine the execution mode and performance threshold of the storage controller node, the execution mode includes a normal mode and a high availability mode, and the performance threshold includes a first performance threshold and a second performance threshold; in the normal mode, the target performance data is compared with the first performance threshold, and if it is determined that the target performance data is less than the first performance threshold, performance warning information is generated based on the configuration operation to be executed and multiple execution configuration operations.
[0076] In some examples of this embodiment, the generation module 33 is specifically configured to determine standard performance data, a first performance optimization coefficient, and a second performance optimization coefficient corresponding to the storage controller node performing multiple execution configuration operations; determine the product of the standard performance data and the first performance optimization coefficient as the first performance threshold, and determine the product of the standard performance data and the second performance optimization coefficient as the second performance threshold.
[0077] In some examples of the present embodiment, the generation module 33 is further specifically configured to determine a first performance requirement corresponding to multiple execution configuration operations and a second performance requirement corresponding to the configuration operation to be executed, and when it is determined that the first performance requirement is not lower than the second performance requirement, generate a first performance warning information corresponding to the first warning level; when it is determined that the first performance requirement is lower than the second performance requirement, generate operation mode switching information and second performance warning information corresponding to the second warning level, wherein the second warning level is higher than the first warning level, and the operation mode switching information is used to request switching to high availability mode operation.
[0078] In some examples of this embodiment, the generation module 33 is specifically configured to compare the target performance data with the second performance threshold in a high availability mode, and generate first performance warning information when it is determined that the target performance data is less than the second performance threshold.
[0079] In some examples of this embodiment, the adjustment module 34 is specifically configured to assign corresponding execution weights and execution efficiency levels to multiple execution configuration operations according to the performance impact of cache mirror pair reorganization in high availability mode; and adjust the execution efficiency levels of multiple execution configuration operations based on performance warning information and execution weights.
[0080] In some examples of the present embodiment, the adjustment module 34 is further configured to, when generating the first performance warning information, if it is determined that the business pressure of the storage controller node is less than a predetermined business pressure threshold, reduce the execution efficiency of multiple configuration operations to be executed by a first preset number of levels in sequence according to the execution weight from large to small, until the target performance data is determined to be greater than or equal to the second performance threshold; if it is determined that the business pressure is greater than or equal to the predetermined business pressure threshold, reduce the execution efficiency of multiple configuration operations to be executed by a second preset number of levels in sequence according to the execution weight value from large to small, until the target performance data is determined to be greater than or equal to the second performance threshold.
[0081] In some examples of this embodiment, the adjustment module 34 is further configured to generate a second performance warning message and suspend the processing of multiple configuration operations to be executed in sequence from large to small according to the execution weight values, when the execution efficiency levels of multiple configuration operations to be executed are all reduced to the lowest level, if the target performance data is less than the second performance threshold, until it is determined that the target performance data is greater than or equal to the second performance threshold.
[0082] In some examples of this embodiment, the monitoring module 31 is specifically configured to interconnect the business system and the storage system through a high-speed link; monitor the business model and business pressure situation of the business system, and determine the performance data of the storage controller node in the storage system corresponding to the business system based on the business model and business pressure situation.
[0083] In some examples of this embodiment, the adjustment module 34 is further configured to adjust the plurality of execution configuration operations based on the target function in response to the configuration target function.
[0084] It should be noted that for other corresponding descriptions of the functional units involved in the storage configuration adjustment device provided in this embodiment, reference can be made to Figure 1 The corresponding description in will not be repeated here.
[0085] Based on the above Figure 1 The method shown in the embodiment also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the above-mentioned Figure 1 The method shown.
[0086] Based on the above Figure 1 The method shown in the embodiment also provides a computer program product, on which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned Figure 1 The method shown.
[0087] Based on this understanding, the technical solution of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, USB flash drive, mobile hard disk, etc.), including a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of various implementation scenarios of the present application.
[0088] Based on the above Figure 1 The method shown, and Figure 4In order to achieve the above-mentioned purpose, the embodiment of the present application also provides an electronic device, such as a personal computer, a server, which includes a storage medium and a processor; the storage medium is used to store a computer program; the processor is used to execute the computer program to achieve the above-mentioned Figure 1 The method shown.
[0089] In some embodiments, the above-mentioned physical device may also include a user interface, a network interface, a camera, a radio frequency (RF) circuit, a sensor, an audio circuit, a WI-FI module, etc. The user interface may include a display, an input unit such as a keyboard, etc., and the optional user interface may also include a USB interface, a card reader interface, etc. The network interface may include a standard wired interface, a wireless interface (such as a WI-FI interface), etc. in some embodiments.
[0090] Those skilled in the art will appreciate that the above-mentioned physical device structure provided in this embodiment does not constitute a limitation on the physical device, and may include more or fewer components, or a combination of certain components, or different arrangements of components.
[0091] The storage medium may also include an operating system and a network communication module. The operating system is a program that manages the hardware and software resources of the above-mentioned physical device, and supports the operation of the information processing program and other software and / or programs. The network communication module is used to realize the communication between the components inside the storage medium, and the communication with other hardware and software in the information processing physical device.
[0092] Through the description of the above implementation methods, those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform, or by hardware. By applying the solution of this embodiment, compared with the related art, this embodiment can monitor the business situation of the business system, and if it is determined that the target performance data of the storage controller node does not meet the performance conditions during the reorganization of the cache mirror pair, it can generate early warning information and dynamically adjust multiple execution configuration operations so that the performance conditions can be met after the adjustment, thereby achieving a balance between resource optimization and performance stability of the storage system, avoiding the situation in which the storage system does not meet the performance conditions due to multiple execution configuration operations during the reorganization of the cache mirror pair, thereby causing the storage system to be unable to normally undertake business, thereby improving the availability of the storage system.
[0093] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0094] The above is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to these embodiments herein, but will conform to the widest scope consistent with the principles and novel features applied for herein.
Claims
1. A method for adjusting storage configuration, characterized in that: include: Monitoring the business conditions of the business system, and determining performance data of a storage controller node in a storage system corresponding to the business system based on the business conditions; Determining target performance data, a configuration operation to be performed, and a plurality of performed configuration operations of the storage controller node during cache mirror pair reorganization according to the performance data; In a case where it is determined that the target performance data does not meet the preset performance condition during the cache mirror pair reorganization, generating performance warning information of the storage controller node based on the to-be-performed configuration operation and the plurality of executed configuration operations; The multiple execution configuration operations are adjusted based on the performance warning information so that the target performance data meets the performance condition.
2. The method according to claim 1, characterized in that Determining target performance data, configuration operations to be performed, and multiple configuration operations to be performed of the storage controller node within a cache mirror pair reorganization time period according to the performance data includes: Performing data cleaning processing based on the performance data to obtain the target performance data; The business pressure of the storage controller node is determined based on the performance data, and the configuration operation to be executed and the multiple execution configuration operations are determined according to the configuration operation policy corresponding to the business pressure.
3. The method according to claim 2, characterized in that Determining the configuration operation to be performed and the multiple execution configuration operations according to the configuration operation policy corresponding to the business pressure includes: When it is determined by using a preset nonlinear function that the business pressure belongs to a preset low pressure range, a first strategy is determined as the configuration operation strategy, wherein the first strategy is to sequentially allow the execution of the multiple execution configuration operations; When it is determined by using a preset nonlinear function that the business pressure belongs to a preset high pressure range, a second strategy is determined as the configuration operation strategy, wherein the second strategy is to sequentially suspend the execution of the multiple execution configuration operations; The configuration operation to be performed is determined based on the configuration operation policy and the multiple execution configuration operations.
4. The method according to claim 1, characterized in that The generating, when it is determined that the target performance data does not meet the preset performance condition during the cache mirror pair reorganization, performance warning information of the storage controller node based on the to-be-performed configuration operation and the multiple executed configuration operations includes: Determine an execution mode and a performance threshold of the storage controller node, wherein the execution mode includes a normal mode and a high availability mode, and the performance threshold includes a first performance threshold and a second performance threshold; In the normal mode, the target performance data is compared with the first performance threshold, and if it is determined that the target performance data is less than the first performance threshold, the performance warning information is generated based on the configuration operation to be executed and the multiple execution configuration operations.
5. The method according to claim 4, characterized in that Determining a performance threshold of the storage controller node includes: Determine standard performance data, a first performance optimization coefficient, and a second performance optimization coefficient corresponding to the storage controller node executing the plurality of execution configuration operations; The product of the standard performance data and the first performance optimization coefficient is determined as the first performance threshold, and the product of the standard performance data and the second performance optimization coefficient is determined as the second performance threshold.
6. The method according to claim 4, characterized in that Generating the performance warning information based on the to-be-performed configuration operation and the multiple executed configuration operations includes: Determine a first performance requirement corresponding to the multiple execution configuration operations and a second performance requirement corresponding to the configuration operation to be executed, and if it is determined that the first performance requirement is not lower than the second performance requirement, generate first performance warning information corresponding to a first warning level; When it is determined that the first performance requirement is lower than the second performance requirement, the operation mode switching information and the second performance warning information corresponding to the second warning level are generated, wherein the second warning level is higher than the first warning level, and the operation mode switching information is used to request switching to the high availability mode.
7. The method according to claim 6, characterized in that The method further comprises: In the high availability mode, the target performance data is compared with the second performance threshold, and when it is determined that the target performance data is less than the second performance threshold, the first performance warning information is generated.
8. The method according to claim 7, characterized in that The adjusting the multiple execution configuration operations based on the performance warning information includes: In the high availability mode, corresponding execution weights and execution efficiency levels are assigned to the plurality of execution configuration operations according to the degree of performance impact on the cache mirror pair reorganization; The execution efficiency levels of the multiple execution configuration operations are adjusted based on the performance warning information and the execution weight.
9. The method according to claim 8, characterized in that The adjusting the execution efficiency levels of the multiple execution configuration operations based on the performance warning information and the execution weights includes: In the case of generating the first performance warning information, if it is determined that the business pressure of the storage controller node is less than a predetermined business pressure threshold, the execution efficiency of the multiple configuration operations to be executed is reduced by a first preset number of levels in order from large to small according to the execution weights, until it is determined that the target performance data is greater than or equal to the second performance threshold; If it is determined that the business pressure is greater than or equal to the predetermined business pressure threshold, the execution efficiency of the multiple configuration operations to be executed is reduced by a second preset number of levels in sequence from large to small according to the execution weight values until it is determined that the target performance data is greater than or equal to the second performance threshold.
10. The method according to claim 9, characterized in that The method further comprises: When the execution efficiency levels of the multiple configuration operations to be executed are all reduced to the lowest level, if the target performance data is less than the second performance threshold, the second performance warning information is generated and the multiple configuration operations to be executed are suspended in sequence from large to small according to the execution weight values until it is determined that the target performance data is greater than or equal to the second performance threshold.
11. The method according to claim 1, characterized in that: The monitoring of the business situation of the business system and determining, based on the business situation, performance data of a storage controller node in a storage system corresponding to the business system includes: Interconnecting the business system and the storage system via a high-speed link; The business model and business pressure situation of the business system are monitored, and performance data of a storage controller node in a storage system corresponding to the business system is determined based on the business model and the business pressure situation.
12. The method according to claim 1, characterized in that The method further comprises: In response to configuring a target function, the plurality of execution configuration operations are adjusted based on the target function.
13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 12 is implemented.
14. An electronic device comprising a storage medium, a processor, and a computer program stored in the storage medium and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 12 is implemented.
15. A computer program product having a computer program stored thereon, characterized in that: When the computer program product is executed by a processor, the method according to any one of claims 1 to 12 is implemented.
Citation Information
Patent Citations
Hardware based memory migration and resilvering
CN103959253A
System service load distribution method and device, and medium
CN115061634A
Data processing method and device, electronic equipment and storage medium
CN117093141A
Control method and device for computing resource allocation, storage medium and electronic equipment
CN118377427A
Multi-control array storage control method and device
CN118897657A
Cited By
Performance test method and device of storage equipment, electronic equipment and storage medium
CN120564815A
Storage device performance testing method and device, electronic device and storage medium
CN120564815B