Cluster normality determination method, cluster normality determination system, node management device, node device, processing program for node management device, and processing program for node device

Abstract

To provide a cluster normality determination system, cluster normality determination method, node management device, node device, and processing program that enable stable failure detection in cluster systems.SOLUTION: A cluster normality determination system 100 including at least one node device and at least one node management device includes a node-side normality determination unit, a management-side normality determination unit, and a cluster normality determination unit. The node-side normality determination unit generates node-side determination information that determines the normality of each node device that is connected to at least one other node device and constitutes a cluster. The management-side normality determination unit causes a node management device outside the node device to generate management-side determination information that has determined the normality of each node device that constitutes the cluster. The cluster normality determination unit determines the normality of the cluster based on the node-side determination information and the management-side determination information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a cluster normality determination method, a cluster normality determination system, a node management device, a node device, a processing program for a node management device, and a processing program for a node device. [Background technology]

[0002] In large-scale information processing systems such as cloud systems, multiple servers are connected to form clusters to increase system availability. In such clusters, it is necessary to determine failures of the constituent nodes. A method for determining a quorum number in a distributed computing system, such as that disclosed in Patent Document 1, is known. The method in Patent Document 1 determines a relaxed quorum number for quorum-based operation of a distributed computing system, and includes the steps of determining the number of active processors in a quorum group of processors and, if the number of active processors is even, determining a majority of the active processors in the quorum group of processors and subtracting one from the number to arrive at the relaxed quorum number for use by the quorum-based operation. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2001-117895 Summary of the Invention [Problem to be solved by the invention]

[0004] The method of Patent Document 1 continuously listens for messages from other processors in a quorum group of a distributed computing system, and determines the number of active processors in the quorum group based on the reception status of the listened messages. In this way, the majority voting method based on the results of heartbeat communications between the nodes that make up the system has the problem that the nodes themselves perform the confirmation process, making the failure determination unstable, depending on the load and failure of the nodes and network.

[0005] Therefore, the present disclosure aims to provide a cluster normality determination method, a cluster normality determination system, a node management device, a node device, a processing program for the node management device, and a processing program for the node device that enable stable fault determination in a cluster system. [Means for solving the problem]

[0006] In order to achieve the above object, the cluster normality determination method of the present disclosure includes: The method includes a node-side normality determination step, a management-side normality determination step, and a cluster normality determination step, The node side normality determination step includes: generating node-side determination information for determining normality for each of the node devices that are connected to at least one other node device and form a cluster; The management side normality determination step includes: causing a node management device outside the node device to generate management-side determination information that determines the normality of each of the node devices constituting the cluster; the cluster normality determination step determines the normality of the cluster based on the node-side determination information and the management-side determination information. A cluster normality determination method for a cluster system including at least one node device and at least one node management device.

[0007] The cluster health determination system of the present disclosure includes at least one node device and at least one node management device, the node device is connected to at least one other node device to form a cluster, the node device includes a node-side normality determination unit and an output unit; the node-side normality determination unit generates node-side determination information that determines the normality of each of the node devices that constitute the cluster; the output unit outputs the node-side determination information to the node management device; the node management device includes a management-side normality determination unit, a determination information acquisition unit, and a cluster normality determination unit; the management-side normality determination unit generates management-side determination information that determines the normality of each of the node devices that constitute the cluster; the determination information acquisition unit acquires the node-side determination information, The cluster normality determination unit determines the normality of the cluster based on the node-side determination information and the management-side determination information.

[0008] The node management device of the present disclosure includes: A management-side normality determination unit, a determination information acquisition unit, and a cluster normality determination unit are included, the management-side normality determination unit generates management-side determination information that determines the normality of each node device that is connected to at least one other node device and that constitutes a cluster; the determination information acquisition unit acquires node-side determination information that determines normality for each of the node devices that constitute the cluster, The cluster normality determination unit determines the normality of the cluster based on the node-side determination information and the management-side determination information.

[0009] The node device of the present disclosure includes: a node-side normality determination unit and an output unit; the node-side normality determination unit generates node-side determination information that determines the normality of each node device that is connected to at least one other node device and that forms a cluster; The output unit outputs the node-side determination information to the node management device included in the cluster normality determination system of the present disclosure or to the node management device of the present disclosure.

[0010] The processing program of the node management device of the present disclosure is The method includes a management side normality determination procedure, a determination information acquisition procedure, and a cluster normality determination procedure, the management-side normality determination procedure includes generating management-side determination information that determines the normality of each node device that is connected to at least one other node device and that constitutes a cluster; the determination information acquisition step includes the step of: acquiring node-side determination information indicating whether each of the node devices constituting the cluster is normal; the cluster normality determination procedure determines the normality of the cluster based on the node-side determination information and the management-side determination information; This is a program for causing a computer to execute each of the above procedures.

[0011] The processing program of the node device of the present disclosure is A node-side normality determination procedure and an output procedure are included, The node-side normality determination procedure generates node-side determination information that determines the normality of each node device that is connected to at least one other node device and that forms a cluster, The output step outputs the node-side determination information to the node management device included in the cluster normality determination system of the present disclosure or to the node management device of the present disclosure. This is a program for causing a computer to execute each of the above procedures. [Effects of the Invention]

[0012] According to the present disclosure, a stable fault determination for a cluster system is possible. [Brief explanation of the drawings]

[0013] [Figure 1] FIG. 1 is a block diagram showing a configuration of an example of a cluster normality determination system according to the present disclosure. [Figure 2] FIG. 2 is a block diagram illustrating an example of a hardware configuration of a node device according to the present disclosure. [Figure 3] FIG. 3 is a block diagram illustrating an example of a hardware configuration of a node management device according to the present disclosure. [Figure 4] FIG. 4 is a flowchart illustrating an example of processing by the node device and the node management device in the cluster normality determination system of the present disclosure. [Figure 5] FIG. 5 is a schematic diagram for explaining a specific example of the re-determination process in the cluster normality determination method of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0014] Next, embodiments of the present disclosure will be described with reference to the drawings. The present disclosure is not limited to the following embodiments. In the following drawings, the same parts are denoted by the same reference numerals. Furthermore, the descriptions of the embodiments can be mutually incorporated unless otherwise specified, and the configurations of the embodiments can be combined unless otherwise specified.

[0015] [Embodiment 1] A cluster normality determination system according to the present disclosure will be described with reference to FIG. 1. FIG. 1A is a block diagram illustrating an example of a configuration of a cluster normality determination system 100 including a node device 10 and a node management device 20 according to the present disclosure. As illustrated in FIG. 1, the cluster normality determination system 100 includes the node device 10 and the node management device 20. The node device 10 is connected to at least one other node device 10 (the number of node devices 10 in FIG. 1 is three, but is not limited to this) via a cluster network 30 to form a cluster system. The cluster network 30 may be, for example, a communication network (described later) or a hub that connects the node devices 10. The node management device 20 may be, for example, an external device (e.g., a BMC (Baseboard Management Controller)) provided on a board of the node device 10, or may be another device capable of communicating with the node device 10. The node management devices 20 can communicate with each other via, for example, an external cluster network 40. The extra-cluster network 40 is, for example, a network of a different system from the cluster network 30, and may be a communication line network described below, or a hub that connects the node management devices 20. The number of node devices 10 and the number of node management devices 20 included in the cluster normality determination system 100 are not particularly limited and can be any number. In the cluster normality determination system 100, the number of node devices 10 and the number of node management devices 20 may be the same or different.

[0016] The communication network may be, for example, an open network or a closed network. Examples of the communication network include the Internet, the World Wide Web (WWW), a telephone line, a Local Area Network (LAN), a Storage Area Network (SAN), Delay Tolerant Networking (DTN), Low Power Wide Area Network (LPWA), and Local 5G (L5G).

[0017] The node device 10 included in the cluster normality determination system 100 will be described below. As shown in FIG. 1(B), the node device 10 (hereinafter also referred to as "the device 10") includes a node-side normality determination unit 11 and an output unit 12. Although not shown, the device 10 may include, for example, an input unit, an output unit, a display unit, and / or a storage unit. The node device 10 may also include, for example, software (cluster software) for constructing the cluster system. In this case, at least one of the node-side normality determination unit 11 and the output unit 12 may be included in the cluster software as one of the functions of the cluster software. Although not shown, the node-side normality determination unit 11 may include, for example, a confirmation signal transmission / reception unit, a status voting unit, and a node-side determination unit.

[0018] The device 10 may be, for example, a single device including the above-described units, or a device in which the units can be connected via a communication network. The device 10 can be connected to an external device (described later) via the communication network. The communication network is not particularly limited and any known network can be used, for example, a wired or wireless network. The communication network is, for example, as described above. Examples of wireless communication include Wi-Fi (registered trademark), Bluetooth (registered trademark), local 5G, and LPWA. The wireless communication may be a form in which the devices communicate directly (ad hoc communication), infrastructure communication, indirect communication via an access point, or the like. The device 10 may be, for example, incorporated into a server as a system. The device 10 may be, for example, a personal computer (PC, e.g., desktop or laptop), a smartphone, a tablet terminal, or the like, on which the program of the present disclosure is installed. Furthermore, the device 10 may be, for example, a cloud computing or edge computing system in which at least one of the units is located on a server and the other units are located on a terminal.

[0019] 2 shows a block diagram of the hardware configuration of the device 10. The device 10 includes, for example, a central processing unit (CPU, GPU, etc.) 101, a memory 102, a bus 103, a storage device 104, an input device 105, an output device 106, and a communication device 107. The components of the device 10 are connected to each other via the bus 103 and their respective interfaces (I / F).

[0020] The central processing unit 101 operates in cooperation with other components via a controller (such as a system controller or an I / O controller) and is responsible for overall control of the device 10. In the device 10, the central processing unit 101 executes, for example, the program disclosed herein and other programs, and also reads and writes various types of information. Specifically, for example, the central processing unit 101 functions as a node-side normality determination unit 11 and an output unit 12. The device 10 may include, as a computing device, other computing devices such as a CPU, a GPU (Graphics Processing Unit), an APU (Accelerated Processing Unit), or a combination of these.

[0021] The bus 103 can also be connected to, for example, an external device. Examples of the external device include an external storage device (external database, etc.), a printer, an external input device, an external display device, an external imaging device, etc. The device 10 can be connected to an external network (the communication line network) by, for example, a communication device (communication unit) 107 connected to the bus 103, and can also be connected to other devices via the external network.

[0022] The memory 102 may be, for example, a main memory (primary storage device). When the central processing unit 101 performs processing, the memory 102 reads various operating programs, such as the program of the present disclosure, stored in the storage device 104 (described later), and the central processing unit 101 receives data from the memory 102 and executes the programs. The main memory may be, for example, a RAM (random access memory). The memory 102 may also be, for example, a ROM (read only memory).

[0023] The storage device 104 is also referred to as an auxiliary storage device, for example, in contrast to the main memory (primary storage device). As described above, the storage device 104 stores an operating program including the program of the present disclosure. The storage device 104 may be, for example, a combination of a recording medium and a drive for reading and writing data from and to the recording medium. The recording medium is not particularly limited and may be, for example, an internal or external type, such as a hard disk (HD), CD-ROM, CD-R, CD-RW, MO, DVD, flash memory, or memory card. The storage device 104 may be, for example, a hard disk drive (HDD) or a solid state drive (SSD) in which the recording medium and drive are integrated. When the device 10 includes the storage unit, for example, the storage device 104 functions as the storage unit.

[0024] In the present device 10, the memory 102 and the storage device 104 can also store various information such as log information, information acquired from an external database (not shown) or an external device, information generated by the present device 10, and information used when the present device 10 executes processing. In this case, the memory 102 and the storage device 104 may store, for example, the above-mentioned information on the user of the present device. Note that at least a portion of the information may be stored, for example, in an external server other than the memory 102 and the storage device 104, or may be stored in a distributed manner across multiple terminals using blockchain technology or the like.

[0025] The device 10 further includes, for example, an input device 105 and an output device 106. Examples of the input device 105 include pointing devices such as a touch panel, track pad, and mouse; a keyboard; imaging means such as a camera and scanner; card readers such as an IC card reader and a magnetic card reader; and audio input means such as a microphone. Examples of the output device 106 include display devices such as an LED display and a liquid crystal display; audio output devices such as a speaker; a printer; and the like. In the present disclosure, the input device 105 and the output device 106 are configured separately, but the input device 105 and the output device 106 may also be configured as an integrated device, such as a touch panel display.

[0026] The node management device 20 included in the cluster normality determination system 100 will be described below. As shown in FIG. 1(B), the node management device 20 (hereinafter also referred to as "this device 20") includes a management-side normality determination unit 21, a determination information acquisition unit 22, and a cluster normality determination unit 23. Although not shown, the management-side normality determination unit 21 may include, for example, a confirmation signal transmission / reception unit, a status voting unit, and a management-side determination unit. Although not shown, the device 20 may include, for example, an input unit, an output unit, a display unit, and / or a storage unit.

[0027] The device 20 may be, for example, a single device including the above-described units, or a device in which the units can be connected via a communication network. The device 20 can be connected to an external device (described later) via the communication network. The communication network is not particularly limited and may be a known network, for example, a wired or wireless network. The communication network is, for example, as described above. Examples of wireless communication include Wi-Fi (registered trademark), Bluetooth (registered trademark), local 5G, and LPWA. The wireless communication may be a form in which the devices communicate directly (ad hoc communication), infrastructure communication, indirect communication via an access point, or the like. The device 20 may be, for example, incorporated into a server as a system. The device 20 may be, for example, a personal computer (PC, e.g., desktop or laptop), a smartphone, a tablet terminal, or the like, on which the program of the present disclosure is installed. Furthermore, the device 20 may be, for example, a cloud computing or edge computing system in which at least one of the units is located on a server and the other units are located on a terminal.

[0028] 3 shows a block diagram of the hardware configuration of the device 20. The device 20 includes, for example, a central processing unit (CPU, GPU, etc.) 201, a memory 202, a bus 203, a storage device 204, an input device 205, an output device 206, and a communication device 207. The components of the device 20 are connected to each other via the bus 203 and their respective interfaces (I / F).

[0029] The central processing unit 201 operates in cooperation with other components via a controller (such as a system controller or an I / O controller) and is responsible for overall control of the device 20. In the device 20, the central processing unit 201 executes, for example, the program disclosed herein and other programs, and also reads and writes various types of information. Specifically, for example, the central processing unit 201 functions as a management-side normality determination unit 21, a determination information acquisition unit 22, and a cluster normality determination unit 23. The device 20 may include other calculation units such as a CPU, a GPU (Graphics Processing Unit), an APU (Accelerated Processing Unit), or a combination of these as a calculation unit.

[0030] The bus 203 can also be connected to, for example, an external device. Examples of the external device include an external storage device (external database, etc.), a printer, an external input device, an external display device, an external imaging device, etc. The present device 20 can be connected to an external network (the above-mentioned communication line network) by, for example, a communication device (communication unit) 207 connected to the bus 203, and can also be connected to other devices via the external network.

[0031] The memory 202 may be, for example, a main memory (primary storage device). When the central processing unit 201 performs processing, the memory 202 reads various operating programs, such as the program of the present disclosure, stored in the storage device 204 (described later), and the central processing unit 201 receives data from the memory 202 and executes the programs. The main memory may be, for example, a RAM (random access memory). The memory 202 may also be, for example, a ROM (read only memory).

[0032] The storage device 204 is also referred to as an auxiliary storage device, for example, in contrast to the main memory (primary storage device). As described above, the storage device 204 stores an operating program including the program of the present disclosure. The storage device 204 may be, for example, a combination of a recording medium and a drive for reading and writing data from and to the recording medium. The recording medium is not particularly limited and may be, for example, an internal or external type, such as a hard disk (HD), CD-ROM, CD-R, CD-RW, MO, DVD, flash memory, or memory card. The storage device 204 may be, for example, a hard disk drive (HDD) or a solid state drive (SSD) in which the recording medium and drive are integrated. When the device 20 includes the storage unit, for example, the storage device 204 functions as the storage unit.

[0033] In the present device 20, the memory 202 and the storage device 204 can also store various information such as log information, information acquired from an external database (not shown) or an external device, information generated by the present device 20, and information used when the present device 20 executes processing. In this case, the memory 202 and the storage device 204 may store, for example, the above-mentioned information on the user of the present device. Note that at least a portion of the information may be stored, for example, in an external server other than the memory 202 and the storage device 204, or may be stored in a distributed manner across multiple terminals using blockchain technology or the like.

[0034] The device 20 further includes, for example, an input device 205 and an output device 206. Examples of the input device 205 include pointing devices such as a touch panel, track pad, and mouse; a keyboard; imaging means such as a camera and scanner; card readers such as an IC card reader and a magnetic card reader; and audio input means such as a microphone. Examples of the output device 206 include display devices such as an LED display and a liquid crystal display; audio output devices such as a speaker; a printer; and the like. In the present disclosure, the input device 205 and the output device 206 are configured separately, but the input device 205 and the output device 206 may also be configured as an integrated device, such as a touch panel display.

[0035] Next, an example of the cluster normality determination method of the present disclosure will be described with reference to the flowchart of Fig. 4. The cluster normality determination method of the present disclosure is implemented as follows, for example, using the cluster normality determination system 100 shown in Fig. 1. Note that the cluster normality determination method of the present disclosure is not limited to use with the cluster normality determination system 100 of Fig. 1. Fig. 4 is a flowchart showing, from the left, an example of processing (S1 to S2) of the node device 10 and processing (S21 to S23) of the node management device 20.

[0036] First, the node-side normality determination unit 11 of the node device 10 generates node-side determination information that determines the normality of each of the node devices 10 that constitute the cluster (S1, node-side normality determination step). The node-side determination information is, for example, information in which node-device identification information that identifies each of the node devices 10 that constitute the cluster is linked to a determination result of the normality of each node device 10 (whether normal or abnormal). The node-side normality determination unit 11 may, for example, obtain information on the determination result of the normality (e.g., whether or not there is an abnormality) from each node device 10 to generate the node-side determination information, or may generate the node-side determination information based on a voting result of the normality in each node device 10. In the latter case, specifically, the node-side normality determination unit 11 transmits and receives a normality confirmation signal from the node device 10 to each of the other node devices 10 that constitute the cluster via the confirmation signal transmission / reception unit. The normality confirmation signal is not particularly limited as long as it is, for example, a signal (heartbeat) that can be used to confirm the alive status of a cluster system. For example, it may be a signal via specific hardware or a signal via a network. Specific examples of the signal via specific hardware include signals using disk paths such as SCSI (Small Computer System Interface) cables and FibreChannel cables, and signals via COM cables. Specific examples of the signal via a network are not particularly limited, and signals using any protocol can be used, for example, ping or TCP. The confirmation signal transmitting / receiving unit transmits the normality confirmation signal to other node devices 10 and receives normality confirmation signals transmitted by other node devices 10. Next, the status voting unit votes for status information for each node device 10 constituting the cluster based on the results of transmitting and receiving the normality confirmation signal. The status information is, for example, information indicating whether the node device 10 is in a normal state (normal node) in which it is operating normally, or in an abnormal state (abnormal node) in which it is not operating normally.For example, in each node device 10 constituting the cluster system, a node device 10 that has received the normality confirmation signal is voted as a normal node, and a node device 10 that has not received the normality confirmation signal is voted as an abnormal node. Then, the node-side determination unit can generate node-side determination information that determines the normality of each node device constituting the cluster based on the status information. The node-side normality determination unit 11 may, for example, record the node-side determination information in the storage unit.

[0037] Then, the output unit 12 outputs the node-side determination information to the node management device 20 (S2, output step). The output unit 12 may output the node-side determination information via the communication line network, for example, or may output the node-side determination information via the bus 103 if the node management device 20 is a device provided on the board of the node device 10.

[0038] Furthermore, the management-side normality determination unit 21 of the node management device 20 generates management-side determination information that has determined the normality of each of the node devices 10 that constitute the cluster (S21, management-side normality determination step). The management-side determination information is, for example, information in which node device identification information that identifies each of the node devices 10 that constitute the cluster is linked to a determination result of the normality of each node device 10 (whether normal or abnormal). The management-side normality determination unit 21 may, for example, obtain information on the determination result of the normality (for example, whether there is an abnormality) from each node device 10 to generate the node-side determination information, or may generate the node-side determination information based on a voting result of the normality in each node device 10. In the latter case, specifically, the management-side normality determination unit 21 transmits and receives a normality confirmation signal from the node device 10 to each of the other node devices 10 that constitute the cluster, for example, by the confirmation signal transmission / reception unit. The normality confirmation signal is not particularly limited as long as it is, for example, a signal (heartbeat) that can be used to confirm the alive status of a cluster system. For example, it may be a signal via specific hardware or a signal via a network. Specific examples of the signal via specific hardware include a signal that uses a disk path such as a SCSI (Small Computer System Interface) cable or a FibreChannel cable, and a signal that passes through a COM cable. Specific examples of the signal via a network are not particularly limited, and a signal based on any protocol can be used, for example, ping or TCP. The confirmation signal transmitting / receiving unit transmits the normality confirmation signal to other node devices 10 via the communication device 207 of the node management device 20, and receives normality confirmation signals transmitted from other node devices 10 via the communication device 207 of the node management device 20. Next, the management-side determination unit determines the normality of each node device constituting the cluster based on the transmission and reception results of the normality confirmation signal, and generates management-side determination information. Next, a status voting unit votes for status information for each of the node devices 10 constituting the cluster based on the results of transmission and reception of the normality confirmation signal.The status information is, for example, information indicating whether the node device 10 is in a normal state (normal node) where it is operating normally, or in an abnormal state (abnormal node) where it is not operating normally. For example, in each node device 10 constituting the cluster system, a node device 10 that has received the normality confirmation signal is voted as a normal node, and a node device 10 that has not received the normality confirmation signal is voted as an abnormal node. Then, the management-side determination unit can generate management-side determination information that determines the normality of each of the node devices constituting the cluster based on the status information.

[0039] Next, the determination information acquisition unit 22 acquires the node-side determination information (S22, determination information acquisition step). The determination information acquisition unit 22 may acquire the node-side determination information via the communication network, for example, or may acquire the node-side determination information via the bus 103 if the node management device 20 is a device provided on the board of the node device 10.

[0040] The cluster normality determination unit 23 determines the normality of the cluster based on the node-side determination information and the management-side determination information (S23, cluster normality determination step). For example, the cluster normality determination unit 23 can determine that a node device 10 determined to be normal in both the node-side determination information and the management-side determination information is normal. For example, the cluster normality determination unit 23 can determine that a node device 10 determined to be abnormal in both the node-side determination information and the management-side determination information is abnormal. If the cluster system can continue even if the node device 10 determined to be abnormal is degenerated, the cluster normality determination unit 23 may, for example, degenerate the node device 10 determined to be abnormal.

[0041] The cluster normality determiner 23 may perform a re-determination process, for example, when there is a node device 10 whose normality has been determined to be abnormal in at least one of the node-side determination information and the management-side determination information. The cluster normality determiner 23 may perform the re-determination process, for example, when there is a node device whose normality has been determined to be abnormal in the node-side determination information and the node-side determination information and the management-side determination information do not match. The cluster normality determiner 23 may perform the re-determination process, for example, when there is a node device 10 that has been determined to be abnormal in the node-side determination information and determined to be normal in the management-side determination information, or when there is a node device 10 that has been determined to be abnormal in the management-side determination information and determined to be normal in the node-side determination information, or when there is a node device 10 that has been determined to be abnormal in both the node-side determination information and the management-side determination information. In addition, the cluster normality determination unit 23 may determine that the node management device 20 is abnormal, for example, if there is a node device 10 that is determined to be abnormal in the management side determination information and determined to be normal in the node side determination information.

[0042] Specifically, the re-determination process by the cluster normality determiner 23 will be described with reference to FIG. 5. First, as shown in FIG. 5, the cluster normality determiner 23 acquires, for example, a transmission / reception result of a normality confirmation signal from a node device 10 to another node device 10. The cluster normality determiner 23 may acquire the transmission / reception result by, for example, acquiring a transmission / reception history of the normality confirmation signal recorded in a network interface card (NIC) of the node device 10, or by capturing packets when the node device transmits or receives a normality confirmation signal. Furthermore, if a normality confirmation signal is not transmitted from a node device 10 corresponding to the node management device 20, the cluster normality determiner 23 transmits or receives a normality confirmation signal to the other node device 10 via the NIC of the node device 10, thereby obtaining the transmission / reception result of the normality confirmation signal from the node device 10 to the other node device 10. Next, the cluster normality determiner 23 transmits, for example, status information about each of the node devices 10 constituting the cluster to the node device 10 and the other node management devices 20 based on the transmission / reception result. Then, the cluster normality determination unit 23 acquires, for example, node-side re-determination information based on the state information from the node device 10 that received the transmission and reception result, and management-side re-determination information based on the state information from the other node management devices 10. The node-side re-determination information and the management-side re-determination information are similar except that, for example, in steps S1 and S21, instead of the transmission and reception result of the normality confirmation signal transmitted and received by the node device 10 and the node management device 20, the transmission and reception result of the normality confirmation signal from the node device 10 to the other node devices 10 that is acquired by the cluster normality determination unit in the re-determination process is used.

[0043] Then, the cluster normality determination unit 23 re-determines the normality of the cluster based on, for example, the node-side re-determination information and the management-side re-determination information. For example, the cluster normality determination unit 23 can determine that a node device 10 determined to be normal in both the node-side re-determination information and the management-side re-determination information is normal. For example, the cluster normality determination unit 23 can determine that a node device 10 determined to be abnormal in both the node-side re-determination information and the management-side re-determination information is abnormal. Furthermore, if the cluster system can continue even if the node device 10 determined to be abnormal is degenerated, the cluster normality determination unit 23 may, for example, degenerate the node device 10 determined to be abnormal.

[0044] Furthermore, for example, if there is a node device whose normality is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, the cluster normality determination unit 23 may reboot functions related to normality determination of the node device 10 whose normality is determined to be abnormal, specifically, the node-side normality determination unit 11 and the output unit 12, and further perform the re-determination process. The re-determination process is similar to that described above. For example, if there are multiple node devices whose normality is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, the cluster normality determination unit 23 may reboot the node-side normality determination units 11 and the output units 12 of the multiple node devices 10 whose normality is determined to be abnormal, check the logs of the node devices 10 after the reboot, and delete from the cluster any node device 10 whose normality is determined to be abnormal based on the logs. In this case, for example, the cluster normality determination unit 23 may perform the re-determination process again on a cluster formed by node devices 10 other than the deleted node device 10. According to this processing, even if there is an abnormality (error) across multiple node devices 10 that make up a cluster system, it is possible to identify which of the node devices 10 is the error (error containment), and more stable normality determination processing can be performed.

[0045] In the present disclosure, steps S1 to S2 and steps S21 to S23 are executed sequentially, but the cluster normality determination method of the present disclosure is not limited to this. For example, steps S1 to S2 may be executed sequentially, or at least one or more steps may be executed simultaneously. Furthermore, for example, steps S21 to S23 may be executed sequentially, or at least one or more steps may be executed simultaneously.

[0046] Known methods for determining the health of nodes in a cluster system include a quorum method among the node devices that make up the cluster, or a highly reliable external device (e.g., BMC) that determines the health of the nodes. However, a quorum method based only on the node devices has the problem that the determination process can become unstable, resulting in incorrect determinations due to the state of the cluster network that makes up the cluster system or the load on the node devices themselves. Furthermore, because the determination based only on the external device is made from outside the node devices, it is possible to determine whether the node devices themselves are alive or dead using heartbeats, etc., but it is not possible to determine whether the cluster software inside the node devices is actually running.

[0047] According to the cluster normality determination method of the present disclosure, for example, a node-side normality determination step generates node-side determination information that determines the normality of each node device that is connected to at least one other node device and that forms a cluster; a management-side normality determination step causes a node management device external to the node device to generate management-side determination information that determines the normality of each node device that forms the cluster; and a cluster normality determination step determines the normality of the cluster based on the node-side determination information and the management-side determination information. That is, the cluster normality determination method of the present disclosure enables fault determination (normality determination) of a cluster system that combines normality determination by the node devices that form the cluster with normality determination by a node management device external to the node devices. Therefore, the cluster normality determination method of the present disclosure can achieve both stable cluster system normality determination by a highly reliable external device (node management device) and normality determination by a node device that includes the actual operation of cluster software. Therefore, the cluster normality determination method of the present disclosure enables, for example, stable and highly accurate fault determination.

[0048] [Embodiment 2] The processing program for the node management device of the present disclosure is a program for causing a computer to execute each step executed by the node management device in the above-described cluster normality determination method. Specifically, the processing program for the node management device of the present disclosure is a program for causing a computer to execute a management-side normality determination procedure, a determination information acquisition procedure, and a cluster normality determination procedure.

[0049] the management-side normality determination procedure includes generating management-side determination information that determines the normality of each node device that is connected to at least one other node device and that constitutes a cluster; the determination information acquisition step includes the step of: acquiring node-side determination information indicating whether each of the node devices constituting the cluster is normal; The cluster normality determination procedure determines the normality of the cluster based on the node-side determination information and the management-side determination information.

[0050] Furthermore, the processing program of the node management device of the present disclosure can also be said to be a program that causes a computer to function as a management-side normality determination procedure, a determination information acquisition procedure, and a cluster normality determination procedure.

[0051] The processing program of the node management device of the present disclosure can be incorporated into the descriptions of the cluster health determination system and cluster health determination method of the present disclosure. For example, the "procedure" in each of the steps can be replaced with "processing." The processing program of the node management device of the present disclosure may be recorded on, for example, a computer-readable recording medium. The recording medium is, for example, a non-transitory computer-readable storage medium. The recording medium is, for example, a non-transitory computer-readable storage medium. The recording medium is not particularly limited, and examples thereof include random access memory (RAM), read-only memory (ROM), hard disk (HD), flash memory (e.g., solid-state drive (SSD), USB flash memory, SD / SDHC card, etc.), optical disk (e.g., CD-R / CD-RW, DVD-R / DVD-RW, BD-R / BD-RE, etc.), magneto-optical disk (MO), floppy disk (FD), etc. Furthermore, the processing program of the node management device of the present disclosure (e.g., also referred to as a programming product or a program product) may be distributed, for example, from an external computer. The "distribution" may be, for example, distribution via a communication network or distribution via a device connected via a wire. The processing program of the node management device of the present disclosure may be installed and executed on the device to which it is distributed, or may be executed without being installed.

[0052] [Embodiment 3] The processing program for the node device of the present disclosure is a program for causing a computer to execute each step executed by the node device in the cluster normality determination method described above. Specifically, the processing program for the node device of the present disclosure is a program for causing a computer to execute a node-side normality determination procedure and an output procedure.

[0053] The node-side normality determination procedure generates node-side determination information that determines the normality of each node device that is connected to at least one other node device and that forms a cluster, The output step outputs the node-side determination information to the node management device included in the cluster normality determination system of the present disclosure or to the node management device of the present disclosure.

[0054] The processing program of the node device of the present disclosure can also be said to be a program that causes a computer to function as a node-side normality determination procedure and an output procedure.

[0055] The processing program of the node device of the present disclosure can be incorporated into the descriptions of the cluster health determination system and cluster health determination method of the present disclosure. For example, the "procedure" in each of the steps can be read as "processing." The processing program of the node device of the present disclosure may be recorded on, for example, a computer-readable recording medium. The recording medium is, for example, a non-transitory computer-readable storage medium. The recording medium is, for example, a non-transitory computer-readable storage medium. The recording medium is not particularly limited, and examples thereof include random access memory (RAM), read-only memory (ROM), hard disk (HD), flash memory (e.g., solid state drive (SSD), USB flash memory, SD / SDHC card, etc.), optical disc (e.g., CD-R / CD-RW, DVD-R / DVD-RW, BD-R / BD-RE, etc.), magneto-optical disk (MO), floppy disk (FD), etc. Furthermore, the processing program of the node device of the present disclosure (e.g., also referred to as a programming product or a program product) may be distributed from an external computer, for example. The "distribution" may be distribution via a communication network, or distribution via a device connected via a wire. The processing program of the node device of the present disclosure may be installed and executed on the device to which it is distributed, or may be executed without being installed.

[0056] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure.

[0057] <Additional Notes> Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. (Appendix 1) The method includes a node-side normality determination step, a management-side normality determination step, and a cluster normality determination step, The node side normality determination step includes: generating node-side determination information for determining normality for each of the node devices that are connected to at least one other node device and form a cluster; The management side normality determination step includes: causing a node management device outside the node device to generate management-side determination information that determines the normality of each of the node devices constituting the cluster; the cluster normality determination step determines the normality of the cluster based on the node-side determination information and the management-side determination information. A cluster normality determination method for a cluster system including at least one node device and at least one node management device. (Appendix 2) The cluster normality determination step includes: If there is a node device whose normality has been determined to be abnormal in at least one of the node-side determination information and the management-side determination information, a re-determination step is performed; The re-determination step includes: The node management device: acquiring a result of transmission and reception of a normality confirmation signal from the node device to another node device; transmits status information for each of the node devices constituting the cluster to the node device and other node management devices based on the transmission / reception result; acquires node-side re-determination information based on the state information from the node device that received the transmission / reception result, and acquires management-side re-determination information based on the state information from another node management device; 2. The cluster normality determination method according to claim 1, wherein the normality of the cluster is re-determined based on the node-side re-determination information and the management-side re-determination information. (Appendix 3) The cluster normality determination step includes: A cluster normality determination method according to claim 2, wherein the re-determination process is carried out when there is a node device whose normality is determined to be abnormal in the node-side determination information and the node-side determination information and the management-side determination information do not match. (Appendix 4) The cluster normality determination step includes: A cluster normality determination method as described in Appendix 2 or 3, wherein if there is a node device whose normality is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, the node-side normality determination unit and output unit of the node device determined to be abnormal are rebooted, and the re-determination process is further performed. (Appendix 5) The cluster normality determination step includes: When there are a plurality of node devices whose normality is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, rebooting the node-side normality determination units and output units of the plurality of node devices determined to be abnormal; 5. A cluster normality determination method according to any one of appendices 2 to 4, wherein the node management device is caused to check the log of the node device after the reboot, a node device determined to have a fatal error based on the log is deleted from the cluster, and the re-determination process is performed again for a cluster configured with node devices other than the deleted node device. (Appendix 6) The node side normality determination step includes: It includes a confirmation signal transmission / reception step, a status voting step, and a node side determination step, the confirmation signal transmitting / receiving step transmits / receives a normality confirmation signal from a node device to / from each of the other node devices constituting the cluster; the state voting step votes for state information for each of the node devices constituting the cluster based on a transmission / reception result of the normality confirmation signal; A cluster normality determination method according to any one of appendices 1 to 5, wherein the node-side determination step generates node-side determination information that determines the normality of each of the node devices that constitute the cluster based on the status information. (Appendix 7) The management side normality determination step includes: A confirmation signal transmission / reception step and a management side determination step are included, the confirmation signal transmitting / receiving step includes transmitting and receiving a normality confirmation signal to and from each of the node devices constituting the cluster by the node management device; A cluster normality determination method according to any one of appendices 1 to 6, wherein the management side determination process determines the normality of each of the node devices constituting the cluster based on the transmission and reception results of the normality confirmation signal, and generates management side determination information. (Appendix 8) at least one node device and at least one node management device; the node device is connected to at least one other node device to form a cluster, the node device includes a node-side normality determination unit and an output unit; the node-side normality determination unit generates node-side determination information that determines the normality of each of the node devices that constitute the cluster; the output unit outputs the node-side determination information to the node management device; the node management device includes a management-side normality determination unit, a determination information acquisition unit, and a cluster normality determination unit; the management-side normality determination unit generates management-side determination information that determines the normality of each of the node devices that constitute the cluster; the determination information acquisition unit acquires the node-side determination information, The cluster normality determination unit determines the normality of the cluster based on the node-side determination information and the management-side determination information. (Appendix 9) The cluster normality determination unit If there is a node device whose normality has been determined to be abnormal in at least one of the node-side determination information and the management-side determination information, a re-determination process is performed; The re-determination process includes: The node management device: acquiring a result of transmission and reception of a normality confirmation signal from the node device to another node device; transmits status information for each of the node devices constituting the cluster to the node device and other node management devices based on the transmission / reception result; acquires node-side re-determination information based on the state information from the node device that received the transmission / reception result, and acquires management-side re-determination information based on the state information from another node management device; 9. A cluster normality determination system according to claim 8, wherein the normality of the cluster is re-determined based on the node-side re-determination information and the management-side re-determination information. (Appendix 10) The cluster normality determination unit A cluster normality determination system as described in Appendix 9, wherein the re-determination process is performed when there is a node device whose normality is determined to be abnormal in the node-side determination information and the node-side determination information and the management-side determination information do not match. (Appendix 11) The cluster normality determination unit A cluster health determination system as described in Appendix 9 or 10, wherein if there is a node device whose health is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, the node-side health determination unit and output unit of the node device determined to be abnormal are rebooted, and the re-determination process is further performed. (Appendix 12) The cluster normality determination unit When there are a plurality of node devices whose normality is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, rebooting the node-side normality determination units and output units of the plurality of node devices determined to be abnormal; 12. A cluster normality determination method according to any one of appendices 9 to 11, wherein the node management device is caused to check the log of the node device after the reboot, a node device determined to have a fatal error based on the log is deleted from the cluster, and the re-determination process is performed again on a cluster configured with node devices other than the deleted node device. (Appendix 13) The node side normality determination unit It includes a confirmation signal transmitting / receiving unit, a status voting unit, and a node side determining unit, the confirmation signal transmitting / receiving unit transmits and receives a normality confirmation signal from the node device to each of the other node devices constituting the cluster; the status voting unit votes for status information for each of the node devices constituting the cluster based on a transmission / reception result of the normality confirmation signal; 13. A cluster normality determination system according to any one of appendices 8 to 12, wherein the node-side determination unit generates node-side determination information that determines the normality of each of the node devices that constitute the cluster based on the status information. (Appendix 14) The management-side normality determination unit a confirmation signal transmitting / receiving unit and a management side determining unit; the confirmation signal transmitting / receiving unit transmits and receives a normality confirmation signal to and from each of the node devices constituting the cluster, A cluster normality determination system according to any one of appendices 8 to 13, wherein the management side determination unit determines the normality of each of the node devices constituting the cluster based on the transmission and reception results of the normality confirmation signal, and generates management side determination information. (Appendix 15) A management-side normality determination unit, a determination information acquisition unit, and a cluster normality determination unit are included, the management-side normality determination unit generates management-side determination information that determines the normality of each node device that is connected to at least one other node device and that constitutes a cluster; the determination information acquisition unit acquires node-side determination information that determines normality for each of the node devices that constitute the cluster, The cluster normality determination unit determines the normality of the cluster based on the node-side determination information and the management-side determination information. (Appendix 16) The cluster normality determination unit If there is a node device whose normality has been determined to be abnormal in at least one of the node-side determination information and the management-side determination information, a re-determination process is performed; The re-determination process includes: Acquire a result of transmission and reception of a normality confirmation signal from the node device to another node device; transmits status information for each of the node devices constituting the cluster to the node device and other node management devices based on the transmission / reception result; acquires node-side re-determination information based on the state information from the node device that received the transmission / reception result, and acquires management-side re-determination information based on the state information from another node management device; 16. The node management device according to claim 15, wherein the node management device re-determines the normality of the cluster based on the node-side re-determination information and the management-side re-determination information. (Appendix 17) The cluster normality determination unit A node management device as described in Appendix 16, which performs the re-determination process when there is a node device whose normality is determined to be abnormal in the node side determination information and the node side determination information and the management side determination information do not match. (Appendix 18) The cluster normality determination unit A node management device as described in Appendix 16 or 17, which, if there is a node device whose normality is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, reboots the node-side normality determination unit and output unit of the node device determined to be abnormal, and further performs the re-determination process. (Appendix 19) The cluster normality determination unit When there are a plurality of node devices whose normality is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, rebooting the node-side normality determination units and output units of the plurality of node devices determined to be abnormal; 19. The node management device according to any one of appendices 16 to 18, wherein the node management device checks the log of the node device after the reboot, deletes a node device determined to have a fatal error based on the log from the cluster, and performs the re-determination process again on a cluster formed by node devices other than the deleted node device. (Appendix 20) The management-side normality determination unit a confirmation signal transmitting / receiving unit and a management side determining unit; the confirmation signal transmitting / receiving unit transmits and receives a normality confirmation signal to and from each of the node devices constituting the cluster, A node management device according to any one of appendices 15 to 19, wherein the management side determination unit determines the normality of each of the node devices constituting the cluster based on the transmission and reception results of the normality confirmation signal, and generates management side determination information. (Appendix 21) a node-side normality determination unit and an output unit; the node-side normality determination unit generates node-side determination information that determines the normality of each node device that is connected to at least one other node device and that forms a cluster; The output unit outputs the node-side determination information to the node management device included in the cluster normality determination system described in any one of Appendices 8 to 14, or to the node management device described in any one of Appendices 15 to 20. (Appendix 22) The node side normality determination unit It includes a confirmation signal transmitting / receiving unit, a status voting unit, and a node side determining unit, the confirmation signal transmitting / receiving unit transmits and receives a normality confirmation signal from the node device to each of the other node devices constituting the cluster; the status voting unit votes for status information for each of the node devices constituting the cluster based on a transmission / reception result of the normality confirmation signal; The node device according to claim 16, wherein the node-side determination unit generates node-side determination information that determines normality of each of the node devices that constitute the cluster based on the state information. (Appendix 23) The method includes a management side normality determination step, a determination information acquisition step, and a cluster normality determination step, the management-side normality determination step generates management-side determination information that determines the normality of each node device that is connected to at least one other node device and that constitutes a cluster; The determination information acquisition step includes the step of acquiring node-side determination information indicating whether each of the node devices constituting the cluster is normal, and The cluster normality determination step determines the normality of the cluster based on the node-side determination information and the management-side determination information. (Appendix 24) The cluster normality determination step includes: If there is a node device whose normality has been determined to be abnormal in at least one of the node-side determination information and the management-side determination information, a re-determination process is performed; The re-determination process includes: Acquire a result of transmission and reception of a normality confirmation signal from the node device to another node device; Based on the transmission / reception result, state information about each of the node devices constituting the cluster is transmitted to the processing method of the node device and other node management devices; From the node device that has received the transmission and reception result, node-side re-determination information based on the state information and management-side re-determination information based on the state information from a processing method of another node management device are acquired; 24. The processing method of a node management device according to claim 23, wherein the normality of the cluster is re-determined based on the node-side re-determination information and the management-side re-determination information. (Appendix 25) The cluster normality determination step includes: A processing method for a node management device described in Appendix 24, in which the re-determination process is performed when there is a node device whose normality is determined to be abnormal in the node side determination information and the node side determination information and the management side determination information do not match. (Appendix 26) The cluster normality determination step includes: A processing method for a node management device described in Appendix 24 or 25, wherein if there is a node device whose normality is determined to be abnormal in at least one of the node side re-determination information and the management side re-determination information, the node side normality determination unit and output unit of the node device determined to be abnormal are rebooted, and the re-determination process is further performed. (Appendix 27) The cluster normality determination step includes: When there are a plurality of node devices whose normality is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, rebooting the node-side normality determination process and the output process of the plurality of node devices determined to be abnormal; A processing method for a node management device according to any one of appendices 24 to 26, wherein the node management device checks the log of the node device after the reboot, deletes a node device determined to have a fatal error based on the log from the cluster, and performs the re-determination process again on a cluster formed by node devices other than the deleted node device. (Appendix 28) The management side normality determination step includes: A confirmation signal transmission / reception step and a management side determination step are included, the confirmation signal transmitting / receiving step is performed by transmitting and receiving a normality confirmation signal to each of the node devices constituting the cluster by a processing method of the node management device; A processing method for a node management device according to any one of appendices 23 to 27, wherein the management side determination process determines the normality of each of the node devices constituting the cluster based on the transmission and reception results of the normality confirmation signal, and generates management side determination information. (Appendix 29) a node-side normality determination step and an output step; the node-side normality determination unit generates node-side determination information that determines the normality of each node device that is connected to at least one other node device and that forms a cluster; The output step is a processing method of a node device that outputs the node-side determination information to the node management device included in the cluster normality determination system described in any one of Appendices 8 to 14, or to the node management device described in any one of Appendices 15 to 20. (Appendix 30) The node side normality determination step includes: It includes a confirmation signal transmission / reception step, a status voting step, and a node side determination step, the confirmation signal transmitting / receiving step transmits / receives a normality confirmation signal from a node device to / from each of the other node devices constituting the cluster; the state voting step votes for state information for each of the node devices constituting the cluster based on a transmission / reception result of the normality confirmation signal; 30. The node device processing method according to claim 29, wherein the node side determination step generates node side determination information that determines the normality of each of the node devices that constitute the cluster based on the status information. (Appendix 31) The method includes a management side normality determination procedure, a determination information acquisition procedure, and a cluster normality determination procedure, the management-side normality determination procedure includes generating management-side determination information that determines the normality of each node device that is connected to at least one other node device and that constitutes a cluster; the determination information acquisition step includes the step of: acquiring node-side determination information indicating whether each of the node devices constituting the cluster is normal; The cluster normality determination procedure is a processing program of a node management device that determines the normality of the cluster based on the node-side determination information and the management-side determination information. (Appendix 32) The cluster normality determination procedure includes: If there is a node device whose normality has been determined to be abnormal in at least one of the node-side determination information and the management-side determination information, a re-determination process is performed; The re-determination process includes: Acquire a result of transmission and reception of a normality confirmation signal from the node device to another node device; transmits state information about each of the node devices constituting the cluster to the processing programs of the node device and other node management devices based on the transmission / reception result; acquires, from the node device that has received the transmission / reception result, node-side re-determination information based on the state information and management-side re-determination information based on the state information from a processing program of another node management device; 32. The processing program of claim 31, wherein the node management device re-determines the normality of the cluster based on the node-side re-determination information and the management-side re-determination information. (Appendix 33) The cluster normality determination procedure includes: A processing program for a node management device described in Appendix 32, which performs the re-determination process when there is a node device whose normality is determined to be abnormal in the node side determination information and the node side determination information and the management side determination information do not match. (Appendix 34) The cluster normality determination procedure includes: A processing program for a node management device described in Appendix 32 or 33, which, if there is a node device whose normality is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, reboots the node-side normality determination unit and output unit of the node device determined to be abnormal, and further performs the re-determination process. (Appendix 35) The cluster normality determination procedure includes: When there are a plurality of node devices whose normality is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, rebooting the node-side normality determination procedures and output procedures of the plurality of node devices determined to be abnormal; A processing program for a node management device according to any one of appendices 31 to 34, which checks the log of the node device after the reboot, deletes from the cluster any node device that is determined to have a fatal error based on the log, and performs the re-determination process again on a cluster formed by node devices other than the deleted node device. (Appendix 36) The management side normality determination procedure includes: Includes a confirmation signal transmission / reception procedure and a management side determination procedure, the confirmation signal transmission / reception procedure includes a processing program of the node management device transmitting and receiving a normality confirmation signal to and from each of the node devices constituting the cluster; A processing program for a node management device according to any one of appendices 31 to 35, wherein the management side determination procedure determines the normality of each of the node devices constituting the cluster based on the transmission and reception results of the normality confirmation signal, and generates management side determination information. (Appendix 37) A node-side normality determination procedure and an output procedure are included, The node-side normality determination procedure generates node-side determination information that determines the normality of each node device that is connected to at least one other node device and that forms a cluster, The output procedure is a processing program of a node device that outputs the node-side determination information to the node management device included in the cluster health determination system described in any of Appendices 8 to 14, or to the node management device described in any of Appendices 15 to 20. (Appendix 38) The node-side normality determination procedure includes: Includes a confirmation signal transmission / reception procedure, a status voting procedure, and a node side determination procedure. the confirmation signal transmission / reception procedure includes transmitting and receiving a normality confirmation signal from a node device to each of the other node devices constituting the cluster; the state voting step votes for state information for each of the node devices constituting the cluster based on a result of transmission and reception of the normality confirmation signal; 38. The processing program of a node device according to claim 37, wherein the node-side determination procedure generates node-side determination information that determines the normality of each of the node devices that constitute the cluster based on the status information. (Appendix 39) The method includes a management side normality determination procedure, a determination information acquisition procedure, and a cluster normality determination procedure, the management-side normality determination procedure includes generating management-side determination information that determines the normality of each node device that is connected to at least one other node device and that constitutes a cluster; the determination information acquisition step includes the step of: acquiring node-side determination information indicating whether each of the node devices constituting the cluster is normal; The cluster normality determination procedure determines the normality of the cluster based on the node-side determination information and the management-side determination information. A computer-readable recording medium having recorded thereon a processing program for a node management device. (Appendix 40) The cluster normality determination procedure includes: If there is a node device whose normality has been determined to be abnormal in at least one of the node-side determination information and the management-side determination information, a re-determination process is performed; The re-determination process includes: Acquire a result of transmission and reception of a normality confirmation signal from the node device to another node device; transmits state information about each of the node devices constituting the cluster to the processing programs of the node device and other node management devices based on the transmission / reception result; acquires, from the node device that has received the transmission / reception result, node-side re-determination information based on the state information and management-side re-determination information based on the state information from a processing program of another node management device; 40. The recording medium of claim 39, wherein the normality of the cluster is re-determined based on the node-side re-determination information and the management-side re-determination information. (Appendix 41) The cluster normality determination procedure includes: A recording medium as described in Appendix 40, wherein the re-determination process is performed when there is a node device whose normality is determined to be abnormal in the node-side determination information and the node-side determination information and the management-side determination information do not match. (Appendix 42) The cluster normality determination procedure includes: A recording medium as described in Appendix 40 or 41, wherein if there is a node device whose normality is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, the node-side normality determination unit and output unit of the node device determined to be abnormal are rebooted, and the re-determination process is further performed. (Appendix 43) The cluster normality determination procedure includes: When there are a plurality of node devices whose normality is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, rebooting the node-side normality determination procedures and output procedures of the plurality of node devices determined to be abnormal; 43. The recording medium according to any one of appendices 39 to 42, wherein a log of the node device after the reboot is checked, a node device determined to have a fatal error based on the log is deleted from the cluster, and the re-determination process is performed again on a cluster formed by node devices other than the deleted node device. (Appendix 44) The management side normality determination procedure includes: Includes a confirmation signal transmission / reception procedure and a management side determination procedure, the confirmation signal transmission / reception procedure includes a processing program of the node management device transmitting and receiving a normality confirmation signal to and from each of the node devices constituting the cluster; A recording medium described in any of Appendices 39 to 43, wherein the management side determination procedure determines the normality of each node device that constitutes the cluster based on the transmission and reception results of the normality confirmation signal, and generates management side determination information. (Appendix 45) A node-side normality determination procedure and an output procedure are included, The node-side normality determination procedure generates node-side determination information that determines the normality of each node device that is connected to at least one other node device and that forms a cluster, The output procedure is a computer-readable recording medium having recorded thereon a processing program of a node device that outputs the node-side determination information to the node management device included in the cluster normality determination system described in any of Appendices 8 to 14, or to the node management device described in any of Appendices 15 to 20. (Appendix 46) The node-side normality determination procedure includes: Includes a confirmation signal transmission / reception procedure, a status voting procedure, and a node side determination procedure. the confirmation signal transmission / reception procedure includes transmitting and receiving a normality confirmation signal from a node device to each of the other node devices constituting the cluster; the state voting step votes for state information for each of the node devices constituting the cluster based on a result of transmission and reception of the normality confirmation signal; 46. The recording medium according to claim 45, wherein the node-side determination procedure generates node-side determination information that determines the normality of each of the node devices that constitute the cluster based on the state information. [Industrial Applicability]

[0058] According to the present disclosure, it is possible to determine a fault (normality determination) in a cluster system by using both normality determination by the node devices constituting the cluster and normality determination by a node management device external to the node devices. This enables stable fault determination in the cluster system. Therefore, the present disclosure is useful in various fields that use cluster systems. [Explanation of symbols]

[0059] 100 Cluster Health Assessment System 10 Node Equipment 11 Node-side normality determination unit 12 Output section 101 Central Processing Unit 102 memory 103 Bus 104 Storage device 105 Input Device 106 Output Device 20 Node Management Device 21 Management side normality determination unit 22 Judgment information acquisition unit 23 Cluster health determination unit 201 Central Processing Unit 202 memory 203 Bus 204 Storage device 205 Input Device 206 Output Device 30 Cluster Network 40 Extra-cluster network

Claims

1. The method includes a node-side normality determination step, a management-side normality determination step, and a cluster normality determination step, The node side normality determination step includes: generating node-side determination information for determining normality for each of the node devices that are connected to at least one other node device and form a cluster; The management side normality determination step includes: causing a node management device outside the node device to generate management-side determination information that determines the normality of each of the node devices constituting the cluster; the cluster normality determination step determines the normality of the cluster based on the node-side determination information and the management-side determination information. A cluster normality determination method for a cluster system including at least one node device and at least one node management device.

2. The cluster normality determination step includes: If there is a node device whose normality has been determined to be abnormal in at least one of the node-side determination information and the management-side determination information, a re-determination step is performed; The re-determination step includes: The node management device: acquiring a result of transmission and reception of a normality confirmation signal from the node device to another node device; transmits status information for each of the node devices constituting the cluster to the node device and other node management devices based on the transmission / reception result; acquires node-side re-determination information based on the state information from the node device that received the transmission / reception result, and acquires management-side re-determination information based on the state information from another node management device; 2. The cluster normality determination method according to claim 1, further comprising the step of re-determining the normality of the cluster based on the node-side re-determination information and the management-side re-determination information.

3. The cluster normality determination step includes:

3. The cluster normality determination method according to claim 2, wherein the re-determination step is carried out when there is a node device whose normality is determined to be abnormal in the node-side determination information and when the node-side determination information and the management-side determination information do not match.

4. The cluster normality determination step includes: A cluster normality determination method as described in claim 2 or 3, wherein if there is a node device whose normality is determined to be abnormal in at least one of the node side re-determination information and the management side re-determination information, the node side normality determination unit and output unit of the node device determined to be abnormal are rebooted, and further the re-determination process is carried out.

5. The cluster normality determination step includes: When there are a plurality of node devices whose normality is determined to be abnormal in at least one of the node-side re-determination information and the management-side re-determination information, rebooting the node-side normality determination units and output units of the plurality of node devices determined to be abnormal; 4. The cluster normality determination method according to claim 2, further comprising the steps of: causing the node management device to check a log of the node device after the reboot; deleting a node device determined to have a fatal error based on the log from the cluster; and performing the re-determination step again on a cluster configured with node devices other than the deleted node device.

6. at least one node device and at least one node management device; the node device is connected to at least one other node device to form a cluster, the node device includes a node-side normality determination unit and an output unit; the node-side normality determination unit generates node-side determination information that determines the normality of each of the node devices that constitute the cluster; the output unit outputs the node-side determination information to the node management device; the node management device includes a management-side normality determination unit, a determination information acquisition unit, and a cluster normality determination unit; the management-side normality determination unit generates management-side determination information that determines the normality of each of the node devices that constitute the cluster; the determination information acquisition unit acquires the node-side determination information, The cluster normality determination unit determines the normality of the cluster based on the node-side determination information and the management-side determination information.

7. A management-side normality determination unit, a determination information acquisition unit, and a cluster normality determination unit are included, the management-side normality determination unit generates management-side determination information that determines the normality of each node device that is connected to at least one other node device and that constitutes a cluster; the determination information acquisition unit acquires node-side determination information that determines normality for each of the node devices that constitute the cluster, The cluster normality determination unit determines the normality of the cluster based on the node-side determination information and the management-side determination information.

8. a node-side normality determination unit and an output unit; the node-side normality determination unit generates node-side determination information that determines the normality of each node device that is connected to at least one other node device and that forms a cluster; The node device, wherein the output unit outputs the node-side determination information to the node management device included in the cluster normality determination system according to claim 6 or to the node management device according to claim 7.

9. The method includes a management side normality determination procedure, a determination information acquisition procedure, and a cluster normality determination procedure, the management-side normality determination procedure includes generating management-side determination information that determines the normality of each node device that is connected to at least one other node device and that constitutes a cluster; the determination information acquisition step includes the step of: acquiring node-side determination information indicating whether each of the node devices constituting the cluster is normal; The cluster normality determination procedure is a processing program of a node management device that determines the normality of the cluster based on the node-side determination information and the management-side determination information.

10. A node-side normality determination procedure and an output procedure are included, The node-side normality determination procedure generates node-side determination information that determines the normality of each node device that is connected to at least one other node device and that forms a cluster, The output procedure is a processing program of a node device that outputs the node-side determination information to the node management device included in the cluster normality determination system according to claim 6 or to the node management device according to claim 7.

Images