Load verification system and load verification method
The load verification system addresses the challenge of reproducing performance impacts across different storage models by collecting and simulating I/O patterns, enabling efficient and timely verification of load performance during data migration.
Patent Information
- Application Number
- JP2023073183
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-04-27
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2043-04-27
AI Technical Summary
In data migration, the performance impact on shared resources within a storage system cannot be accurately reproduced when the migration source and destination devices have different models, leading to inefficiencies in load verification.
A load verification system that collects performance metrics and I/O patterns from multiple storage devices, generates expected performance metrics data, and applies simulated I/O patterns to reproduce the load on the destination volume, using a load simulator to verify performance impacts.
This system allows for timely verification of load performance by reproducing the source environment's load on the destination, reducing verification time and ensuring timely operation of applications and services.
Smart Images

Figure 2024158195000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a load verification system and a load verification method. [Background technology]
[0002] When migrating data stored in a storage system, it is common to first verify the performance of the volume in the actual environment of the migration destination.In this performance verification, a load is applied to the volume created in the target storage system by data input / output (I / O), and it is confirmed whether the performance of the migrated volume and the impact on other operations (applications) using the migration destination storage device meet the requirements.
[0003] Patent Document 1 describes a technique for constructing an environment equivalent to a migration destination when performing load verification of the migration destination. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] International Publication No. 2015 / 049771 Summary of the Invention [Problem to be solved by the invention]
[0005] The migration destination volume shares the shared resources (ports, processors, etc.) in the storage system with other volumes used for other purposes. Therefore, if a load is generated on the migration destination volume, the generated load will have a performance impact on the other volumes that use the shared resources. For this reason, when migrating data, it is necessary to verify the performance impact on not only the volume in question, but also on other resources in the device.
[0006] In data migration, the volume usage trends before and after migration are consistent, so the trends in performance metrics that show the results for the load generated at the migration source and the trends in performance metrics at the migration destination are consistent. Here, the performance metrics that were generated at the migration source volume can be known in advance. In other words, if I / O that generates a specific performance metric can be reproduced, a load equivalent to that of the migration source can be reproduced on the migration destination volume, so that the performance impact on other volumes in the migration destination device when that load occurs can be verified. However, if the device models (specs) of the migration source storage system and the migration destination storage system are different, the performance metrics that show the performance impact results when exactly the same I / O occurs will be different values for each model.
[0007] Previously, due to this feature, if the source and destination device models were different, it was not possible to identify the I / O that would generate the expected performance metrics for the destination volume, making reproduction impossible. For this reason, in order to reproduce trends, it was necessary to apply a load to the destination volume by trial and error, measure the performance impact, and check the performance impact on other volumes at the same time. Applying a load by trial and error here means, for example, applying a load based on an I / O pattern extracted randomly from accumulated load data, or based on specific rules.
[0008] Note that the explanation so far has focused on the issues involved with storage systems, but similar issues arise when verifying data migration even when combining different types of data storage systems, known as a hybrid cloud solution.
[0009] In view of the above, an object of the present invention is to provide a load verification system and a load verification method that can appropriately perform verification in a short time when migrating stored data in a storage system or the like. [Means for solving the problem]
[0010] In order to solve the above problems, for example, the configurations described in the claims are adopted. The present application includes multiple means for solving the above-mentioned problems, and one example is a load verification system that performs load performance verification of a specified data storage area, and includes a verification performance metrics collection unit that acquires performance metrics of the data storage area and its volume that are the subject of load verification, an expected performance metrics data generation unit that generates performance metrics data that results in an expected load for the volume that is the subject of load verification, and an I / O pattern data generation unit that generates input / output pattern data that produces a load that results in performance metrics data equivalent to the expected performance indicated by the expected performance metrics data. Then, based on the input / output pattern data generated by the expected performance metrics data generation unit, input / output is performed to the volume under load verification, and the verification performance metrics collection unit collects performance metrics as a result of applying the load. Effect of the Invention
[0011] According to the present invention, it is possible to provide input / output pattern data that reproduces the expected performance metrics for the volume to be subjected to load verification. Therefore, it is possible to reproduce the load generated in the source environment in the destination environment, shorten the verification period, and enable the timely provision of the application services to be operated. Problems, configurations and effects other than those described above will become apparent from the following description of the embodiments. [Brief description of the drawings]
[0012] [Figure 1] 1 is a configuration diagram showing an example of an overall load verification system according to an embodiment of the present invention; [Diagram 2] 2 is a block diagram showing an example of the configuration of an I / O pattern data generating unit according to an embodiment of the present invention. FIG. [Diagram 3] 1 is a block diagram showing an example of the configuration of a load verification management system according to an embodiment of the present invention; [Figure 4] FIG. 2 is a diagram showing an example of the configuration of performance metrics data according to an embodiment of the present invention. [Diagram 5]FIG. 4 is a diagram showing an example of the configuration of I / O pattern data according to an embodiment of the present invention. [Figure 6] FIG. 11 is a diagram illustrating an example of a process for generating load data according to an embodiment of the present invention. [Figure 7] 13 is a flowchart illustrating an example of processing by an expected performance metrics data generation unit according to an embodiment of the present invention. [Figure 8] 11 is a flowchart showing an example of processing by an I / O pattern data generating unit according to an embodiment of the present invention. [Figure 9] 10 is a flowchart illustrating an example of a process of a load data generating unit according to an embodiment of the present invention. [Figure 10] 10 is a flowchart illustrating an example of a process performed by a load simulator according to an embodiment of the present invention. [Figure 11] 11 is a flowchart illustrating an example of processing by a verification performance metric collector according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0013] Hereinafter, a load verification system according to an embodiment of the present invention (hereinafter, referred to as "this embodiment") will be described with reference to the accompanying drawings.
[0014] [Load verification system configuration] FIG. 1 shows the overall configuration of the load verification system of this embodiment. The load verification system of this example includes a load verification management system 100 and a load simulator 19, and performs verification of a storage device 10 to be verified that is installed in a data center DC1. The storage device 10 to be verified is a data migration destination. The storage device 10 to be verified comprises a plurality of volumes 10a to 10n (n is an arbitrary integer), and each of the volumes 10a to 10n has a predetermined data storage area. The load simulator 19 is installed in the data center DC1.
[0015] The storage device 10 under verification includes an interface 11 and a port 12, and simulated input / output pattern data from a reproducing unit 19a of a load simulator 19 is supplied to the volumes 10a to 10n under verification via the port 12. Note that the input / output pattern data and input / output data will be referred to as I / O pattern data and I / O data in the following description. Furthermore, the performance metrics data actually measured in each of the volumes 10a to 10n is transmitted from the interface 11 via a predetermined LAN (Local Area Network) 181 to the load verification management system 100.
[0016] Performance metrics data for storage (volume) includes various data that indicate the performance of the storage, such as read throughput, write throughput, the number of read request operations per unit time, the number of write request operations per unit time, read latency, write latency, utilization rate, etc. These performance metrics vary not only depending on the performance of the device (storage) itself, which is the data storage area, but also on the environment in which the storage is installed.
[0017] The load verification management system 100 receives target performance metrics data as input from a user terminal 190, which is an external terminal, generates I / O pattern data, and supplies the generated I / O pattern data to a load simulator 19. The load simulator 19 applies a load to the volume to be verified based on the simulated I / O pattern data based on that data. The load simulator 19 then collects performance metrics data actually measured when applying the load, and performs load verification.
[0018] Furthermore, a plurality (a large number) of storage devices 20, 30, 40, ... are connected to the load verification management system 100 via a network as storage devices from which data is transferred. For example, the storage device 20 installed in a data center DC2 and the storage devices 30, 40 installed in data centers DCn (n is any integer) are connected via a WAN (Wide Area Network) 182, and the load verification management system 100 collects performance metrics data from each storage device. The plurality of storage devices 20, 30, 40, ... are storage devices of different formats. Alternatively, it is preferable that the same storage devices are installed in different environments.
[0019] Regarding the specific configuration of the load verification management system 100, the load verification management system 100 includes an expected performance metrics data generation unit 111, a verification performance metrics collection unit 112, an I / O pattern data generation unit 113, a load data storage unit 114, an I / O pattern data storage unit 115, and a performance metrics data storage unit 116.
[0020] The expected performance metrics data generating unit 111 generates expected performance metric data based on the target performance metric data input from the user terminal 190. In the user terminal 190, the performance metric data may be obtained by user input, or may be obtained automatically by a program installed in the user terminal 190. The expected performance metric data generated by the expected performance metrics data generating unit 111 is supplied to an I / O pattern data generating unit 113 . The verification performance metrics collector 112 collects performance metrics data transmitted via the LAN 181 from the storage apparatus 10 under verification in the data center DC1.
[0021] The I / O pattern data generation unit 113 generates and outputs I / O pattern data that matches expected performance metrics data, using data stored in the load data storage unit 114, the I / O pattern data storage unit 115, and the performance metrics data storage unit 116. A detailed configuration for generating I / O pattern data will be described with reference to FIG. The I / O pattern data output by the I / O pattern data generating unit 113 is supplied to the load simulator 19 via the LAN 181 .
[0022] In the load simulator 19, the reproducing unit 19a generates simulated I / O pattern data based on the I / O pattern data supplied from the I / O pattern data generating unit 113. The simulated I / O pattern data generated by the reproducing unit 19a is supplied to the volumes 10a to 10n to be verified via the port 12.
[0023] [Configuration of I / O pattern data generator] FIG. 2 shows a configuration of the I / O pattern data generator 113. The I / O pattern data generator 113 includes a load data generator 201 , a performance metrics data collector 202 , an I / O pattern data collector 203 , and an I / O pattern data output unit 204 .
[0024] The performance metrics data collection unit 202 collects performance metrics data from the storage device that is the source of data transfer. The I / O pattern data collection unit 203 collects I / O pattern data from the storage device that is the source of data transfer. The example in Fig. 2 shows an example in which performance metrics data and I / O pattern data are collected from the storage device 20 installed in the data center DC2, but the performance metrics data collection unit 202 also collects performance metrics data and I / O pattern data from storage devices 30, 40, etc. installed in data centers in other environments.
[0025] The performance metrics data of a plurality of storage devices collected by the performance metrics data collector 202 is stored in the performance metrics data storage unit 116 . FIG. 4 shows an example of the configuration of performance metrics data collected by the performance metrics data collector 202 and stored in the performance metrics data storage unit 116. As shown in FIG. The performance metrics data stored in the performance metrics data storage unit 116 has one record consisting of a device identifier indicating the storage device configuration, a target volume identifier, the time when the data was collected, and the actually measured performance metrics data.
[0026] The I / O pattern data of a plurality of storage devices collected by the I / O pattern data collection unit 203 is stored in the I / O pattern data storage unit 115 . The performance metrics data stored in the performance metrics data storage unit 116 and the I / O pattern data stored in the I / O pattern data storage unit 115 are read out by the load data generation unit 201 . FIG. 5 shows an example of the configuration of I / O pattern data collected by the I / O pattern data collection unit 203 and stored in the I / O pattern data storage unit 115. As shown in FIG. The I / O pattern data stored in the I / O pattern data storage unit 115 has one record consisting of a device identifier indicating the device configuration, a target volume identifier, the time the data was collected, and the actually measured I / O pattern data.
[0027] Returning to the explanation of Fig. 2, the load data generation unit 201 maps each stored data, generates load data, and stores the generated load data in the load data storage unit 114. When generating this load data, the load data generation unit 201 acquires I / O pattern data from the I / O pattern data storage unit 115, and also acquires performance metrics data corresponding to the collection time of the acquired I / O pattern data from the performance metrics data storage unit 116. Then, the load data generation unit 201 generates load data for a combination of each acquired data, and stores the generated load data in the load data storage unit 114.
[0028] FIG. 6 shows an example of a processing state in which the load data generating unit 201 generates load data. The load data generating unit 201 selects as mapping targets those tables prepared in the performance metrics data storage unit 116 and those prepared in the I / O pattern data storage unit 115 that have the same value for "device identifier-volume identifier-collection time". Then, the load data generating unit 201 generates load data in which the "device configuration-performance metrics data-I / O pattern data" of the corresponding mapping target is one record, and stores the generated load data in a table in the load data storage unit 114.
[0029] Returning to the explanation of Figure 2, the I / O pattern data output unit 204 searches the stored data in the load data storage unit 114 based on an input indicating a set of device configuration-performance metrics data from the user terminal 190, reads out the corresponding I / O pattern data, and outputs it to the load simulator 19 (Figure 1).
[0030] [Example of hardware configuration for load verification management system] FIG. 3 shows an example of the hardware configuration of the load verification management system 100. As shown in FIG. The load verification management system 100 shown in FIG. 3 is an example configured with a computer. That is, the load verification management system 100 configured as a computer comprises a processor 101, a memory 102, a storage device 103, and an input / output device 104, and each component is connected by a bus line to enable data transfer between them.
[0031] Then, when the processor 101 executes the program stored in the storage device 103, a verification performance metrics collector 111, an expected performance metrics data generator 112, and an I / O pattern data generator 113 are configured in the storage device 103. In addition, a load data storage unit 114, an I / O pattern data storage unit 115, and a performance metrics data storage unit 116 are configured using part of the storage area of the storage device 103.
[0032] Note that the load verification management system 100 configured by a computer having the processor 101 is just an example, and other configurations may be used. For example, a part or the whole of the load verification management system 100 may be realized by dedicated hardware such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). The load verification management system 100 may also be a so-called cloud computer provided on a server accessible via the Internet or the like. In this case, each storage unit such as the load data storage unit 114 is also stored on the server. Alternatively, each storage unit such as the load data storage unit 114 may be provided on the server, and a computer constituting the load verification management system 100 may read the stored data from the server and perform the management process of the load verification.
[0033] [Processing performed by the expected performance metrics data generation unit] FIG. 7 is a flowchart showing an example of processing performed by the expected performance metrics data generating unit 111. First, the expected performance metrics data generator 111 receives as input from the user terminal 190 a target for which metrics are to be generated (step S11). Then, the expected performance metrics data generating unit 111 performs an expected performance metrics data generating process for generating performance metrics data indicating the load result expected for the target of the load verification in response to the received input (step S12). The performance metrics data generated in step S12 is supplied to the I / O pattern data generating unit 113.
[0034] [Processing performed by the I / O pattern data generator] FIG. 8 is a flowchart showing an example of a process performed by the I / O pattern data generating unit 113. The I / O pattern data generating unit 113 receives the expected performance metrics data supplied from the expected performance metrics data generating unit 111 as an input (step S21). Then, the I / O pattern data generating unit 113 performs an I / O pattern data generating process for generating I / O pattern data for the received performance metrics data that will generate corresponding performance metrics data in the storage system that is the target of load verification (step S22). That is, the I / O pattern data generating unit 113 extracts I / O pattern data that will be performance metrics data equivalent to expected performance metrics data from the various load data stored in the load data storage unit 114, and generates this I / O pattern data.
[0035] [Processing performed by the load data generator] FIG. 9 is a flowchart showing an example of the process performed by the load data generating unit 201. The load data generator 201 acquires I / O pattern data from the I / O pattern data storage unit 115 (step S31). Then, the load data generator 201 acquires performance metrics data corresponding to the collection time of the I / O pattern data acquired in step S31 from the performance metrics data storage unit 116 (step S32). After that, the load data generating unit 201 generates load data for each combination of the acquired data (step S33). Then, the load data generating unit 201 registers (stores) the load data generated in step S33 in the load data storage unit 114 (step S34).
[0036] [Processing performed by the load simulator] FIG. 10 is a flowchart showing an example of processing performed by the reproducing unit 19a of the load simulator 19. The load simulator 19 receives as input the I / O pattern data transmitted from the I / O pattern data generating unit 113 (step S41). Then, the reproducing unit 19a of the load simulator 19 simulates an I / O pattern to a volume to be subjected to load verification from the input pattern data, and executes a process of applying input and output loads (step S42).
[0037] [Processing performed by the verification performance metrics collection unit] FIG. 11 is a flowchart showing an example of processing performed by the verification performance metrics collector 112. The verification performance metrics collector 112 performs a verification performance metrics collection process to receive performance metrics data of the actually measured storage system and all volumes in the storage device 10 from the storage device 10 subject to load verification (step S42). The load verification management system 100 compares the performance metrics data received by the verification performance metrics collection unit 112 with the expected performance metrics data generated by the expected performance metrics data generation unit 111, and verifies whether the storage device 10 is exhibiting the expected performance. The verification result is displayed on the user terminal 190, for example.
[0038] [Effects of the load verification system] As explained above, the load verification system of this embodiment can provide input / output pattern data that reproduces the expected performance metrics for the volume being verified. This makes it possible to reproduce the load generated in the source environment in the destination environment, shortening the verification period and enabling the timely provision of application services to be operated.
[0039] In other words, in the past, when the models of the source storage device and the destination storage device were different, it was not possible to identify the I / O pattern data that would generate the performance metrics expected for the destination volume, making reproduction impossible. For this reason, in the past, in order to reproduce trends, a load was applied based on I / O pattern data extracted randomly or based on specific rules from load data accumulated by trial and error in the destination volume, and the performance impact was measured, and the performance impact of other volumes at the matching time was confirmed.
[0040] In contrast, in the case of the load verification system of this example, combinations of performance metrics data and I / O pattern data are collected in advance from multiple storage devices 20, 30, 40, ... that differ in type and installation environment, and the I / O pattern data that matches the expected performance is extracted and simulated on the storage device 10 to be verified. Therefore, according to the load verification system of this embodiment, the time required for I / O load verification using a large number of test patterns can be reduced, and the verification period can be shortened.
[0041] Furthermore, in the case of the load verification system of this example, the load verification management system 100 is equipped with a load data storage unit 114, an I / O pattern data storage unit 115, and a performance metrics data storage unit 116, and is capable of extracting I / O pattern data that matches expected performance from the load data, thereby enabling verification against various expected performances.
[0042] [Variations] It should be noted that the embodiment examples described so far have been described in detail in order to explain the present invention in an easily understandable manner, and are not necessarily limited to those having all of the configurations described. For example, in the above-described embodiment, a storage device installed in a data center is used as the device having the data storage area to be verified, but it may also be used to verify a data storage area of a predetermined volume provided by a cloud solution or a hybrid cloud solution. In other words, when a data storage area provided in various devices such as a server connected to the Internet or the like is used as a predetermined volume as the data storage area, the volume may be used as the verification target.
[0043] In this case, the storage devices 20, 30, 40, . . . that collect performance metrics data and I / O pattern data may also be volumes provided by a cloud solution or a hybrid cloud solution.
[0044] Furthermore, when verifying a storage device 10 installed in a data center as shown in FIG. 1, it is preferable to install the load simulator 19 in the same location as the storage device 10 and supply simulated I / O pattern data, but the load simulator 19 may be installed in a location other than the location where the data storage area is installed.
[0045] In the above-described embodiment, the I / O pattern data generating unit 113 stores I / O pattern data that becomes various performance metrics from the multiple storage devices 20, 30, 40, etc., and obtains I / O pattern data that has equivalent performance from the stored data. Alternatively, the I / O pattern data generating unit 113 may generate I / O pattern data that corresponds to expected performance metrics by some kind of calculation processing. In the above embodiment, the process up to the point where the verification performance metrics collector 112 collects performance metrics as a result of applying a load has been described, but the load verification management system 100 may perform verification based on the collected data. Alternatively, the collected performance metrics may be sent to the user terminal 190, and verification may be performed on the user terminal 190 side.
[0046] 1 to 3, only control lines and information lines that are considered necessary for explanation are shown, and not all control lines and information lines in the product are shown. In reality, it can be considered that almost all components are connected to each other. Furthermore, the process flows shown in the flowcharts of FIGS. 7 to 11 are also examples, and as long as the process results are the same, the order of some processes may be changed or multiple processes may be executed simultaneously.
[0047] The load verification management system 100 described in this embodiment can be configured by installing a program for load verification management in a general computer as described in Fig. 3. In this case, the program for realizing each processing function may be prepared in a storage device within the computer, or may be stored and transferred on a recording medium such as an external memory, an IC card, an SD card, or an optical disk. [Explanation of symbols]
[0048] 10...storage device (storage device to be verified), 10a to 10n...volume, 11...interface, 12...port, 19...load simulator, 19a...reproduction unit, 20, 30...storage device, 100...load verification management system, 101...processor, 102...memory, 103...storage device, 104...input / output device, 111...expected performance metrics data generation unit, 112...verification performance metrics collection unit, 113...I / O pattern data generation unit, 114...load data storage unit, 115...I / O pattern data storage unit, 116...performance metrics data storage unit, 181...LAN, 182...WAN, 190...user terminal, 201...load data generation unit, 202...performance metrics data collection unit, 203...I / O pattern data collection unit, 204...I / O pattern data output unit, DC1 to DCn...data center
Claims
1. A load verification system for performing load performance verification of a predetermined data storage area, a verification performance metrics collection unit that acquires performance metrics of the data storage area and its volume that are the subject of load verification; an expected performance metrics data generating unit that generates performance metrics data resulting from an expected load for the volume that is a load verification target; an I / O pattern data generating unit that generates I / O pattern data that generates a load that results in performance metrics data equivalent to the expected performance indicated by the expected performance metrics data; Based on the input / output pattern data generated by the expected performance metrics data generation unit, input / output is performed to the volume that is the target of load verification, and the verification performance metrics collection unit collects performance metrics as a result of applying the load. Load verification system.
2. a performance metrics data collection unit that collects performance metrics of components used to execute input / output processing for the plurality of data storage areas; a performance metrics data storage unit that stores the performance metrics data collected by the performance metrics data collection unit; an I / O pattern data collection unit that monitors input / output data of a plurality of data storage areas and collects input / output pattern data; an I / O pattern data storage unit that stores the input / output pattern data collected by the I / O pattern data collection unit; a load data generating unit that generates load data in which components of the data storage area and their performance metrics and input / output pattern data are mapped based on the data stored in the performance metrics data storing unit and the I / O pattern data storing unit; a load data storage unit that stores the load data generated by the load data generation unit; The load validation system of claim 1 .
3. The expected performance metric data generating unit generates expected performance metric data based on target performance metric data input from an external terminal. The load validation system of claim 1 .
4. The data storage area is a storage device having a predetermined volume. The load validation system of claim 1 .
5. The system further includes a load simulator that reproduces input / output to the volume that is a load verification target based on the input / output pattern data generated by the I / O pattern data generating unit. The load validation system of claim 1 .
6. The data storage area is a data storage area of a predetermined volume provided in a hybrid cloud solution. The load validation system of claim 1 .
7. A load verification method for verifying load performance of a data storage area having a predetermined volume provided by a storage device or a hybrid cloud solution, comprising: a verification performance metrics collection process for acquiring performance metrics of the data storage area and its volume that are the subject of load verification; an expected performance metrics data generation process for generating performance metrics data that is a result of an expected load for the volume that is a load verification target; an I / O pattern data generation process for generating I / O pattern data that generates a load that results in performance metrics data equivalent to the expected performance indicated by the expected performance metrics data; a reproduction process for reproducing input / output to the volume that is a load verification target based on the input / output pattern data generated by the I / O pattern data generation process, The performance metrics as a result of applying a load to the volume to be subjected to load verification are collected by the verification performance metrics collection process. Load verification method.
Citation Information
Patent Citations
Storage control device, control program, and control method
JP2015179425A
Proportional service quality based on client usage and system metrics.
JP2015507268A
Computer system
WO2015049771A1
