Storage control device and storage control method

The storage control device addresses the challenge of determining timeout causes by measuring command response times and saving logs in designated areas, facilitating detailed analysis and efficient log management.

JP2024161828APending Publication Date: 2024-11-20FSAS TECH INC
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023076897
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-08
Publication Date
2024-11-20

AI Technical Summary

Technical Problem

Existing storage systems struggle to accurately determine the root cause of timeouts in disk responses, leading to inefficient log collection and lack of detailed analysis for fault investigation.

Method used

A storage control device measures command response times and saves command histories and internal logs in specific storage areas based on threshold criteria, allowing detailed analysis of timeouts and efficient log management.

Benefits of technology

Enables detailed analysis of timeout failures and reduces unnecessary log collection, improving fault investigation efficiency and minimizing performance impact on storage systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024161828000001_ABST
    Figure 2024161828000001_ABST
Patent Text Reader

Abstract

To enable detailed analysis of timeout failures that do not generate error logs based on types and trends of commands that cause response delays.SOLUTION: A method: measures a response time of a command issued from a storage control device 10 to a storage device 2; if the measured response time is equal to or greater than a first threshold and further less than a second threshold, saves one piece of command history corresponding to the command in a first saving area 102 where is not overwritten by increases in the command history; and if the measured response time is equal to or greater than the second threshold, saves the one piece of command history in the first saving area 102, and further collects and saves internal logs of the storage device 2 into a second saving area 103.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a storage control device and a storage control method. [Background technology]

[0002] There are Hard Disk Drives (HDD) / Solid State Drives (SSD) (hereinafter referred to as "disks") and Redundant Arrays of Independent Disks (RAID) devices equipped with controllers that control the disks.

[0003] If there is a delay in the command response from a disk, the controller will treat this as a timeout and will disconnect the disk in question. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2011-227639 A [Patent Document 2] JP 2012-108726 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, there are cases where the disk does not respond to the error, and even if the cause is investigated, the root cause of the timeout cannot be identified, making it impossible to implement improvement measures.

[0006] For this reason, it is desirable to collect logs of timeout predictions; however, in a RAID device, if a log is collected every time a minor timeout occurs, there is a risk that a large amount of logs unrelated to failure investigation will be stored.

[0007] The amount of logs to be collected can be reduced by setting a longer timeout time standard for collecting logs, but information about disk commands when a timeout begins to occur is necessary for troubleshooting.

[0008] One aspect of the invention is to enable detailed analysis of timeout failures that do not generate error logs, based on the types and trends of commands that cause response delays. [Means for solving the problem]

[0009] In one aspect, a storage control device is provided in a storage device to which a storage device is connected, and includes a processor that measures a response time of a command issued from the storage control device to the storage device, and if the measured response time is equal to or greater than a first threshold and less than a second threshold, stores a command history corresponding to the command in a first storage area that is not overwritten by an increase in command history, and if the measured response time is equal to or greater than the second threshold, in addition to storing the command history in the first storage area, collects internal logs of the storage device and stores them in a second storage area. Effect of the Invention

[0010] In one aspect, it is possible to perform detailed analysis of timeout failures that do not generate error logs based on the types and trends of commands that cause response delays. [Brief description of the drawings]

[0011] [Figure 1] FIG. 2 is a block diagram illustrating an example of a hardware configuration of a storage system according to an embodiment. [Diagram 2] 2 is a block diagram illustrating an example of a data structure in a controller illustrated in FIG. 1. [Diagram 3] 3 is a diagram illustrating a command history management table shown in FIG. 2. [Figure 4] 3 is a table illustrating the disk log storage area shown in FIG. 2. [Diagram 5] 11 is a flowchart illustrating a storage control process according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] [A] Embodiment An embodiment will be described below with reference to the drawings. However, the embodiment described below is merely an example, and there is no intention to exclude the application of various modified examples and techniques not specified in the embodiment. In other words, the present embodiment can be implemented with various modifications within the scope of the gist of the embodiment. In addition, each figure does not intend to include only the components shown in the figure, but can include other functions, etc.

[0013] FIG. 1 is a block diagram illustrating an example of the hardware configuration of a storage system 100 according to an embodiment.

[0014] The storage system 100 includes a storage device 1 and a host device 3 .

[0015] The host device 3 is, for example, a computer equipped with a server function. In the example shown in Fig. 1, the storage system 100 includes one host device 3, but the number of host devices 3 included in the storage system 100 can be changed in various ways.

[0016] The storage device 1 includes a controller 10 and a plurality of disks 2 (Disks #1 to #n). In the example shown in Fig. 1, the storage device 1 includes one controller 10, but the number of controllers 10 included in the storage device 1 can be changed in various ways.

[0017] The disk 2 is a device that stores data in a readable and writable manner, and may be, for example, a HDD, an SSD, or a Storage Class Memory (SCM).

[0018] The controller 10 is a control device that performs various controls, and performs various controls in accordance with a storage access request from the host device 3.

[0019] The controller 10 is an example of a storage control device, and includes a Central Processing Unit (CPU) 11 and a memory 12.

[0020] The memory 12 is a storage device including, for example, a Read Only Memory (ROM) and a Random Access Memory (RAM). The RAM may be, for example, a Dynamic RAM (DRAM). Programs such as a Basic Input / Output System (BIOS) may be written in the ROM of the memory 12. The software programs in the memory 12 may be appropriately read and executed by the CPU 11. The RAM of the memory 12 may be used as a primary recording memory or a working memory.

[0021] The CPU 11 is, for example, a processing device that performs various controls and calculations, and executes an Operating System (OS) and programs read by the memory 12 to realize various functions.

[0022] The programs for implementing various functions may be provided in a form recorded on a computer-readable recording medium, such as a flexible disk, a CD (CD-ROM, CD-R, CD-RW, etc.), a DVD (DVD-ROM, DVD-RAM, DVD-R, DVD+R, DVD-RW, DVD+RW, HD DVD, etc.), a Blu-ray disk, a magnetic disk, an optical disk, a magneto-optical disk, etc. Then, the computer (CPU 11 in this embodiment) may read the program from the above-mentioned recording medium via a reading device (not shown), transfer it to an internal recording device or an external recording device, and store it for use. Also, the program may be recorded in a storage device (recording medium), such as a magnetic disk, an optical disk, a magneto-optical disk, etc., and provided to the computer from the storage device via a communication path.

[0023] When implementing various functions, a program stored in an internal storage device (memory 12 in this embodiment) may be executed by a computer (CPU 11 in this embodiment). Also, a program recorded on a recording medium may be read and executed by a computer.

[0024] The CPU 11 exemplarily controls the operation of the entire controller 10. The device for controlling the operation of the entire controller 10 is not limited to the CPU 11, and may be, for example, any one of an MPU, a DSP, an ASIC, a PLD, and an FPGA. The device for controlling the operation of the entire controller 10 may be a combination of two or more of a CPU, an MPU, a DSP, an ASIC, a PLD, and an FPGA. Note that MPU is an abbreviation for Micro Processing Unit, DSP is an abbreviation for Digital Signal Processor, and ASIC is an abbreviation for Application Specific Integrated Circuit. Also, PLD is an abbreviation for Programmable Logic Device, and FPGA is an abbreviation for Field Programmable Gate Array.

[0025] FIG. 2 is a block diagram showing a schematic example of a data structure in the controller 10 shown in FIG.

[0026] The memory 12 of the controller 10 stores a command history management table 101, a command storage area 102, and a disk log storage area 103. The command history management table 101, the command storage area 102, and the disk log storage area 103 may be stored in a storage area (not shown) other than the memory 12 in the controller 10.

[0027] FIG. 3 is a diagram illustrating the command history management table 101 shown in FIG.

[0028] The command history management table 101 records the history of, for example, the most recent 100 commands issued to the HDD / SSD from the controller 10. In the example shown in Fig. 3, the history of commands #1, #2, ... is recorded.

[0029] For example, command type, destination disk, response time, number of commands being processed, and destination address are recorded in the command history management table 101. In the command history management table 101, when the number of recorded commands exceeds 100, the oldest command may be overwritten. The command history management table 101 is an example of a third storage area.

[0030] The command storage area 102 stores the history of commands with a response time of 1 second or more recorded in the command history management table 101. In the command storage area 102, similar to the command history management table 101, for example, the command type, destination disk, response time, number of commands being processed, and destination address are recorded. Information recorded in the command storage area 102 is not overwritten, and is retained unless a deletion instruction is issued by the user. The command storage area 102 is an example of a first storage area.

[0031] FIG. 4 is a table illustrating the disk log storage area 103 shown in FIG.

[0032] The disk log storage area 103 stores the internal logs of the HDD / SSD. The disk log storage area 103 retrieves and stores information including, for example, "Read log," "Write log," "Verify log," "SMART log," "Log Sense," and "G-List" that are necessary for investigating a failure as the internal logs of the HDD / SSD from the disk 2. The disk log storage area 103 is an example of a second storage area.

[0033] When a command that requires a long response time is received, the controller 10 regards it as a sign of a timeout and saves an internal log inside the controller 10 before the disk 2 is disconnected, thereby improving the accuracy of investigating errors occurring on the disk 2 by leaving more information necessary for investigation.

[0034] Furthermore, by dividing the command response time threshold into two stages, the controller 10 limits the number of disk log storage processes to the minimum necessary, thereby improving the efficiency of use of the disk log storage area 103, and by combining this with information from the command storage area 102, it is possible to conduct an investigation that takes into account the time series of timeout precursors and their consistency with commands.

[0035] That is, if there is no response within one second (an example of a first threshold), the controller 10 regards this as the first stage of a timeout precursor, and also records the corresponding command history in the command storage area 102. If it takes even longer, more than three seconds (an example of a second threshold), the controller 10 determines that a timeout is imminent, and in addition to recording the time in the command storage area 102, it also collects the internal log of the disk 2 and stores it in the disk log storage area 103. If it takes more than four seconds (an example of a third threshold), the controller 10 determines that the disk 2 in question has timed out, and disconnects it.

[0036] The logs accumulated in the disk log storage area 103 can be deleted at any time if the user feels that they are no longer necessary, such as after they have been stored outside the storage device 1 or sent to a supplier. When it is desired to delete a log, a delete command is issued from the controller 10 of the storage device 1 to the disk log storage area 103.

[0037] The storage control process in this embodiment will be described with reference to the flowchart (steps S1 to S14) shown in FIG.

[0038] The disk 2 accepts a command from the controller 10 (step S1).

[0039] The controller 10 stores the most recent 100 command histories in the command history management table 101 (step S2).

[0040] The controller 10 checks the response time of the command (step S3).

[0041] If the response time is less than one second (step S4), the controller 10 records the response time in the command history management table 101 (step S5), and the storage control process ends.

[0042] If the response time is equal to or greater than 1 second and less than 3 seconds (step S6), the controller 10 records the response time in the command history management table 101 (step S7).

[0043] The controller 10 stores the command history in the command storage area 102 (step S8), and the storage control process then ends.

[0044] If the response time is greater than or equal to 3 seconds and less than 4 seconds (step S9), the controller 10 records the response time in the command history management table 101 (step S10).

[0045] The controller 10 stores the command history in the command storage area 102 (step S8).

[0046] The controller 10 extracts the log from the disk 2 and stores it in the disk log storage area 103 (step S12). Then, the storage control process ends.

[0047] If the response time is 4 seconds or more (step S13), the controller 10 determines that a timeout has occurred and disconnects the disk 2 from the storage system 100 (step S14), and the storage control process then ends.

[0048] [B] Effect According to the storage control device and the storage control method in the above-described embodiment, for example, the following advantageous effects can be achieved.

[0049] The controller 10 measures the response time of a command issued from the controller 10 to the disk 2. If the measured response time is equal to or greater than a first threshold and less than a second threshold, the controller 10 saves a command history corresponding to the command in a first storage area that is not overwritten by an increase in the command history. If the measured response time is equal to or greater than a second threshold, the controller 10 not only saves the command history in the first storage area, but also picks up an internal log of the disk 2 and saves it in a second storage area.

[0050] As a result, for timeout failures that do not generate error logs, precursors can be detected from command response times and the log of disk 2 can be saved in a storage area on the controller 10 side before disconnection, allowing for more detailed analysis based on the types and trends of commands that cause response delays.

[0051] Until now, disk timeout disconnection, which does not leave a clear error log, has often not been reproduced or the cause unknown even through log analysis, supplier investigation, etc. According to this embodiment, when a command response delay occurs, which is a sign of a timeout, it is possible to analyze by comparing the command processing and disk log in chronological order by collecting the command history and disk log immediately before the timeout, which can lead to improvement measures.

[0052] In addition, since the disk log is large in size when collected as is (approximately 5MB per disk), by collecting the disk log only at the second stage of the timeout threshold, the disk log storage area 103 can be utilized effectively and the performance impact on storage control can be reduced.

[0053] When the measured response time is less than a first threshold, the controller 10 stores the one command in a third storage area that is overwritten by an increase in the command history. When the measured response time is equal to or greater than the first threshold and less than a second threshold, the controller 10 stores the one command history in the first storage area in addition to storing the one command in the third storage area. When the measured response time is equal to or greater than the second threshold, the controller 10 stores the one command history in the first storage area and the third storage area in addition to storing the log in the second storage area.

[0054] This allows the command history to be stored only in an area to be overwritten when the response time to the command is normal, and allows the storage area in the controller 10 to be used appropriately.

[0055] The controller 10 stores the log in a third storage area when the measured response time is equal to or greater than the second threshold and less than the third threshold. The controller 10 disconnects the disk 2 from the storage device 1 when the measured response time is equal to or greater than the third threshold.

[0056] This allows the failed disk 2 to be properly disconnected from the storage device 1.

[0057] [C] Other The disclosed technology is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit of the present embodiment. Each configuration and each process of the present embodiment can be selected as necessary, or can be combined as appropriate.

[0058] [D] Additional Notes The following supplementary notes are further disclosed regarding the above embodiment.

[0059] (Appendix 1) A storage control device provided in a storage device to which a storage device is connected, measuring a response time of a command issued from the storage control device to the storage device; If the measured response time is equal to or greater than a first threshold and less than a second threshold, a command history corresponding to the command is stored in a first storage area that is not overwritten by an increase in the command history; If the measured response time is equal to or greater than the second threshold, in addition to storing the one command history in the first storage area, an internal log of the storage device is retrieved and stored in a second storage area. A storage control device comprising a processor.

[0060] (Appendix 2) The processor, If the measured response time is less than the first threshold, storing the one command in a third storage area that is overwritten as the command history increases; if the measured response time is equal to or greater than the first threshold and less than the second threshold, storing the one command in the third storage area, and also storing a history of the one command in the first storage area; if the measured response time is equal to or greater than the second threshold, storing the one command history in the first storage area and the third storage area, and storing the log in the second storage area; 2. A storage control device as described in appendix 1.

[0061] (Appendix 3) The processor, When the measured response time is equal to or greater than the second threshold and less than a third threshold, storing the log in the second storage area; disconnecting the storage device from the storage device when the measured response time is equal to or greater than the third threshold value; 3. A storage control device according to claim 1 or 2.

[0062] (Appendix 4) A storage control method for a storage device connected to a storage device, comprising: measuring a response time of a command issued from a storage control device provided in the storage device to the storage device; If the measured response time is equal to or greater than a first threshold and less than a second threshold, a command history corresponding to the command is stored in a first storage area that is not overwritten by an increase in the command history; If the measured response time is equal to or greater than the second threshold, in addition to storing the one command history in the first storage area, an internal log of the storage device is retrieved and stored in a second storage area. A storage control method in which processing is executed by a computer.

[0063] (Appendix 5) If the measured response time is less than the first threshold, storing the one command in a third storage area that is overwritten as the command history increases; if the measured response time is equal to or greater than the first threshold and less than the second threshold, storing the one command in the third storage area, and also storing a history of the one command in the first storage area; if the measured response time is equal to or greater than the second threshold, storing the one command history in the first storage area and the third storage area, and storing the log in the second storage area; 5. The storage control method according to claim 4, wherein processing is executed by the computer.

[0064] (Appendix 6) When the measured response time is equal to or greater than the second threshold and less than a third threshold, storing the log in the second storage area; disconnecting the storage device from the storage device when the measured response time is equal to or greater than the third threshold value; 6. The storage control method according to claim 4 or 5, wherein the processing is executed by the computer. [Explanation of symbols]

[0065] 1: Storage device 2: Disk 3: Host device 10: Controller 11: CPU 12: Memory 100: Storage systems 101: Command history management table 102: Command storage area 103: Disk log storage area

Claims

1. A storage control device provided in a storage device to which a storage device is connected, measuring a response time of a command issued from the storage control device to the storage device; If the measured response time is equal to or greater than a first threshold and less than a second threshold, a command history corresponding to the command is stored in a first storage area that is not overwritten by an increase in the command history; if the measured response time is equal to or greater than the second threshold, in addition to storing the one command history in the first storage area, an internal log of the storage device is collected and stored in a second storage area; A storage control device comprising a processor.

2. The processor, If the measured response time is less than the first threshold, the one command is stored in a third storage area that is overwritten as the command history increases; when the measured response time is equal to or greater than the first threshold and less than the second threshold, storing the one command in the third storage area, and also storing a history of the one command in the first storage area; when the measured response time is equal to or greater than the second threshold, storing the one command history in the first storage area and the third storage area, and storing the log in the second storage area; The storage control device according to claim 1 .

3. The processor, When the measured response time is equal to or greater than the second threshold and less than a third threshold, storing the log in the second storage area; disconnecting the storage device from the storage device when the measured response time is equal to or greater than the third threshold value; The storage control device according to claim 1 or 2.

4. A storage control method for a storage device connected to a storage device, comprising: measuring a response time of a command issued from a storage control device provided in the storage device to the storage device; If the measured response time is equal to or greater than a first threshold and less than a second threshold, a command history corresponding to the command is stored in a first storage area that is not overwritten by an increase in the command history; if the measured response time is equal to or greater than the second threshold, in addition to storing the one command history in the first storage area, an internal log of the storage device is collected and stored in a second storage area; A storage control method in which processing is executed by a computer.

Citation Information

Patent Citations

  • Information processing apparatus, timeout processing method, and timeout processing program

    JP2011227639A

  • Failure processing device, information processing device using the same, and failure processing method for information processing device

    JP2012108726A