Data node monitoring method, device and system and medium
By monitoring the metadata information of the data node and implementing a fault handling strategy when abnormal operations are detected, the problem of insufficient monitoring of abnormal operations at the file level of the database system in the prior art is solved, and the stability and security of the system are improved.
Patent Information
- Application Number
- CN202411871918.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-18
- Publication Date
- 2025-04-11
AI Technical Summary
The prior art lacks real-time monitoring and response mechanisms for abnormal operations at the file level of data nodes when monitoring database systems, making it difficult to distinguish between normal database business operations and abnormal operations, resulting in possible false alarms or missed important abnormal situations.
By obtaining the metadata information of the data node and sending it to the monitoring module, the monitoring module sends the path information to the file detection module, detects whether there is any change in the path information, and reports the operation information to the monitoring module. The monitoring module determines whether the operation information is an abnormal operation and implements a fault handling strategy when an abnormal operation is detected.
Real-time monitoring and response to abnormal operations at file-level data nodes is realized, the stability and security of the database system is improved, abnormal operation detection capabilities are enhanced, and flexible fault handling strategies are supported.
Smart Images

Figure CN119807175A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of database technology, and in particular to a data node monitoring method, device, system and medium. Background Art
[0002] The existing technology has actively explored the high reliability and high availability technology of databases, and has made effective research and inventions on system operation failures caused by factors such as network isolation, process abnormalities, and hard disk failures. The existing monitoring system mainly focuses on detecting and handling system-level failures, such as hardware failures and network interruptions.
[0003] However, the high reliability of data nodes not only needs to pay attention to failures caused by these non-subjective factors, but also lacks attention to intentional intrusions into the system such as artificially changing data node files. For example, when someone accesses a data node without authorization and modifies key files, the existing system may not be able to detect and prevent such behavior in a timely manner, and lacks an effective monitoring and response mechanism for abnormal operations at the file level. In addition, the existing technology is also insufficient in distinguishing between normal database business operations and abnormal operations, and may misreport or miss certain important abnormal situations. The existing technology is insufficient in the flexible configuration of monitoring parameters, the customization of abnormal scenarios, and the personalized setting of fault handling measures. This limits the ability of system administrators to adjust monitoring strategies according to actual needs, and reduces the adaptability and efficiency of the monitoring system. Summary of the invention
[0004] In view of the above-mentioned deficiencies in the prior art, the object of the present invention is to provide a data node monitoring method. The present invention monitors the change operation information of the data node, and performs real-time fault handling operations when abnormal operations occur, thereby solving the problem in the prior art that the database system can continue to run and provide services when a fault occurs.
[0005] In order to achieve the above object, the present invention adopts the following technical solutions:
[0006] A first aspect of the present invention provides a data node monitoring method, comprising the following steps:
[0007] Obtain metadata information of the data node and send the metadata information to the monitoring module;
[0008] The monitoring module sends the path information in the metadata information to the file detection module;
[0009] Detecting whether there is a change operation on the path information by the file detection module, and if there is a change operation on the path information, reporting the operation information of the path information to the monitoring module;
[0010] The monitoring module determines whether the operation information is an abnormal operation, and implements a fault handling strategy when the change operation is an abnormal operation.
[0011] In one embodiment, obtaining metadata information of the data node and sending the metadata information to the monitoring module includes:
[0012] Control the monitoring switch and set monitoring parameters according to monitoring requirements;
[0013] Configure fault handling measures based on abnormal scenarios;
[0014] Get metadata information of data nodes;
[0015] The monitoring parameters, metadata information and fault handling measures are sent to the monitoring module through the front-end page.
[0016] In one embodiment, the monitoring module sends the path information in the metadata information to the file detection module, including:
[0017] The monitoring module receives metadata information transmitted by the front-end page, parses the metadata information, and obtains path information;
[0018] The path information is sent to the file detection module, and a monitoring instruction is sent to the file detection module.
[0019] In one embodiment, the detecting by the file detection module whether there is a change operation on the path information, and if there is a change operation on the path information, reporting the operation information of the path information to the monitoring module includes:
[0020] The file detection module receives the path information and monitoring instructions;
[0021] In response to the monitoring instruction, the path information is monitored to detect whether there is a change operation on the path information;
[0022] When there is a change operation on the path information, the operation information of the path information is reported to the monitoring module.
[0023] In one embodiment, the monitoring module determines whether the operation information is an abnormal operation, and implements a fault handling strategy when the change operation is an abnormal operation, including:
[0024] The monitoring module determines whether the operation information is an abnormal operation;
[0025] If the operation information is a database business operation, the change operation is a normal operation;
[0026] If the operation information is a non-database business operation, the change operation is an abnormal operation, and a fault handling measure is implemented according to the abnormal operation type.
[0027] In one embodiment, if the operation information is a non-database business operation, the change operation is an abnormal operation, and a fault handling measure is implemented according to the abnormal operation type, including:
[0028] When the fault handling measure is alarm information processing, sending alarm information to the alarm module, and the alarm module displays the alarm information on the front-end page;
[0029] When the fault handling measure is alarm plus node switching processing, the role of the abnormal node is determined. If the abnormal node is an abnormal master node, the monitoring module sends an alarm message to the alarm module and sends a node switching instruction to the node management module.
[0030] In one embodiment, if the abnormal node is an abnormal master node, the monitoring module sends an alarm message to the alarm module and sends a node switching instruction to the node management module, including:
[0031] The node management module receives the node switching instruction sent by the monitoring module and executes the primary and standby node switching operation;
[0032] A standby node is selected according to the node switching priority, and data synchronization operation is performed on the primary node and the standby node to complete the data node switching.
[0033] A data node monitoring device, the device comprising:
[0034] A data acquisition module is used to acquire metadata information of data nodes and send the metadata information to the monitoring module;
[0035] A monitoring module, configured to send the path information in the metadata information to the file detection module;
[0036] A file detection module, used to detect whether there is a change operation on the path information through the file detection module, and if there is a change operation on the path information, report the operation information of the path information to the monitoring module;
[0037] The node management module is used for the monitoring module to determine whether the operation information is an abnormal operation, and implement a fault handling strategy when the change operation is an abnormal operation.
[0038] A data node monitoring system, the system comprising at least one processor; and
[0039] a memory communicatively connected to the at least one processor; wherein,
[0040] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the data node monitoring method.
[0041] A non-volatile computer-readable storage medium stores computer-executable instructions. When the computer-executable instructions are executed by one or more processors, the one or more processors can execute the data node monitoring method.
[0042] Beneficial Effects : The embodiments of the present invention disclose a data node monitoring method, device, system and medium. Compared with the prior art, the present invention monitors the change operation information of the data node, and when an abnormal operation occurs, performs real-time fault handling operations to ensure the stable operation of the database system, improve the security of the data node, enhance the abnormal operation detection capability, and realize the advantages of flexible fault handling strategies. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] The present invention will be further described below with reference to the accompanying drawings and embodiments, in which:
[0044] Figure 1 A flow chart of a data node monitoring method provided by an embodiment of the present invention;
[0045] Figure 2 Another flow chart of the data node monitoring method provided by an embodiment of the present invention;
[0046] Figure 3 A schematic diagram of the functional modules of a data node monitoring device provided by an embodiment of the present invention;
[0047] Figure 4 A schematic diagram of the hardware structure of a data node monitoring system provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0048] In order to make the technical problems, technical solutions and beneficial effects to be solved by the embodiments of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.
[0049] See also Figure 1 , Figure 1 This is a flow chart of an embodiment of a data node monitoring method provided by the present invention, and the method specifically comprises the following steps:
[0050] S100, obtaining metadata information of a data node, and sending the metadata information to a monitoring module;
[0051] S200, the monitoring module sends the path information in the metadata information to the file detection module;
[0052] S300, detecting whether there is a change operation on the path information by the file detection module, and if there is a change operation on the path information, reporting the operation information of the path information to the monitoring module;
[0053] S400, the monitoring module determines whether the operation information is an abnormal operation, and implements a fault handling strategy when the change operation is an abnormal operation.
[0054] In this embodiment, in actual application, the method can be gradually formed through the following steps: first, identify the monitoring requirements of the data node file change operation, and determine the metadata information that needs to be collected; then, send the path information in the metadata information to the file detection module through the monitoring module, so that the file detection module can monitor the changes of the path information in real time; once the file detection module detects the change operation of the path information, it immediately reports the operation information to the monitoring module; finally, the monitoring module analyzes the operation information, determines whether it is an abnormal operation, and takes a fault handling strategy in time when an abnormal operation is detected. Effectively monitor the file change operation of the data node, and take fault handling measures in time when an abnormal operation is detected, thereby improving the security and reliability of the system.
[0055] Furthermore, metadata information refers to various key information related to the data node, including but not limited to the file directory of the data node (such as the data directory, log directory, etc.), the IP of the data node management module, and the user name. The monitoring module is responsible for receiving and processing this metadata information, and sending the path information therein to the file detection module. The file detection module is responsible for real-time monitoring of the path information, detecting whether there is a change operation, and reporting the detected operation information to the monitoring module. After receiving the operation information, the monitoring module determines whether the operation is an abnormal operation, and adopts the corresponding fault handling strategy in the case of abnormal operation.
[0056] In one embodiment, obtaining metadata information of the data node and sending the metadata information to the monitoring module includes:
[0057] Control the monitoring switch and set monitoring parameters according to monitoring requirements;
[0058] Configure fault handling measures based on abnormal scenarios;
[0059] Get metadata information of data nodes;
[0060] The monitoring parameters, metadata information and fault handling measures are sent to the monitoring module through the front-end page.
[0061] In this embodiment, on the monitoring setting page, the user can view the status of the current monitoring switch, control the monitoring switch according to the monitoring requirements, and set the monitoring parameters. In this way, the monitoring function can be flexibly turned on or off, and the parameters can be adjusted according to specific requirements to adapt to different monitoring requirements. Configure fault handling measures according to abnormal scenarios. By pre-configuring fault handling measures for different abnormal scenarios, appropriate handling measures can be taken quickly when an abnormality occurs to improve the reliability of the system. Obtain the metadata information of the data node. Through this step, detailed information of the data node can be obtained to provide basic data for subsequent monitoring. The monitoring parameters, metadata information and fault handling measures are sent to the monitoring module through the front-end page, so that the monitoring module can obtain the latest monitoring parameters and metadata information in real time, and process according to the preset fault handling measures. Through the above technical means, the technical problem of how to obtain the metadata information of the data node and send it to the monitoring module is solved, thereby realizing effective monitoring of the data node.
[0062] Specifically, the monitoring switch and monitoring parameters can be set through the front-end configuration interface. Users can turn on or off the monitoring function according to actual needs, and adjust the monitoring parameters to adapt to different monitoring scenarios. For example, when the system load is high, the monitoring frequency can be appropriately reduced to reduce system overhead. Fault handling measures for abnormal scenarios can be pre-configured in the system, including but not limited to restarting services, switching nodes, sending alarms, etc. When the monitoring module detects abnormal operations, it can respond quickly according to the preset handling measures to ensure the stable operation of the system. Metadata information can be obtained through the system interface. The system will collect metadata information of data nodes regularly or in real time, and send it to the monitoring module through the front-end page to ensure that the monitoring module obtains the latest monitoring data.
[0063] This application improves the adaptability of the system through flexible monitoring switches and parameter settings; improves the response speed and processing capabilities of the system in abnormal situations through preset fault handling measures; and ensures the timeliness and accuracy of monitoring data through real-time acquisition and transmission of metadata information. Compared with the existing technology, this application not only focuses on failures caused by non-subjective factors, but also pays special attention to intentional intrusion into the system such as artificially changing data node files, thereby comprehensively improving the high reliability and high availability of data nodes.
[0064] In one embodiment, the monitoring module sends the path information in the metadata information to the file detection module, including:
[0065] The monitoring module receives metadata information transmitted by the front-end page, parses the metadata information, and obtains path information;
[0066] The path information is sent to the file detection module, and a monitoring instruction is sent to the file detection module.
[0067] In this embodiment, after the monitoring module receives the metadata information transmitted by the front-end page, it first parses the information. Specifically, the parsing process can be implemented by preset rules or algorithms, such as regular expression matching, keyword extraction, etc., so as to accurately obtain the path information. Then, the monitoring module sends the parsed path information to the file detection module through a network interface or other communication methods. At the same time, the monitoring module will also generate corresponding monitoring instructions, and send the instructions and the path information to the file detection module together. After receiving the path information and the monitoring instructions, the file detection module starts the monitoring operation of the path information and detects whether there is a change operation on the path information. When a change operation is detected, the file detection module reports the changed operation information to the monitoring module.
[0068] Through the above technical content, it is ensured that the file detection module can detect path change operations based on this information, effectively solve the path information transmission and monitoring problems of metadata information, improve the system's monitoring and detection efficiency, and ensure the high reliability and security of data nodes.
[0069] In one embodiment, the detecting by the file detection module whether there is a change operation on the path information, and if there is a change operation on the path information, reporting the operation information of the path information to the monitoring module includes:
[0070] The file detection module receives the path information and monitoring instructions;
[0071] In response to the monitoring instruction, the path information is monitored to detect whether there is a change operation on the path information;
[0072] When there is a change operation on the path information, the operation information of the path information is reported to the monitoring module.
[0073] In this embodiment, the file detection module receives the path information and the monitoring instruction, and monitors the path information in response to the monitoring instruction to detect whether there is a change operation on the path information. When there is a change operation on the path information, the file detection module reports the operation information of the path information to the monitoring module. In this way, the change operation of the path information can be monitored in real time, and the change information can be reported in time, thereby providing a basis for further abnormal operation judgment and fault handling. Through the above scheme, the problem of detecting the change operation of the path information is solved, so that the system can timely discover and report the change operation of the path information, and provide reliable data support for subsequent abnormal judgment and fault handling.
[0074] Specifically, the file detection module can be implemented by periodically checking the change of path information through polling; another way is that the file detection module monitors the change operation of path information in real time through the event notification mechanism of the file system. These implementation methods can effectively detect the change operation of path information and report the operation information to the monitoring module.
[0075] This embodiment can effectively solve the problem of detecting path information change operations. Compared with the prior art, this application can monitor the path information change operation in real time and report the change information in a timely manner, thereby providing reliable data support for further abnormal operation judgment and fault handling. This can improve the system's response speed to abnormal operations and reduce the risk of system failures caused by path information changes.
[0076] In one embodiment, the monitoring module determines whether the operation information is an abnormal operation, and implements a fault handling strategy when the change operation is an abnormal operation, including:
[0077] The monitoring module determines whether the operation information is an abnormal operation;
[0078] If the operation information is a database business operation, the change operation is a normal operation;
[0079] If the operation information is a non-database business operation, the change operation is an abnormal operation, and a fault handling measure is implemented according to the abnormal operation type.
[0080] In this embodiment, the monitoring module first determines whether the operation information is an abnormal operation; when the operation information belongs to a database business operation, it is regarded as a normal operation and no fault handling measures are taken; when the operation information belongs to a non-database business operation, it is regarded as an abnormal operation, and corresponding fault handling measures are taken according to the type of abnormal operation. This method effectively identifies and handles abnormal change operations of data nodes by distinguishing between database business operations and non-database business operations, thereby improving the reliability and security of the system.
[0081] Furthermore, the monitoring module can determine the type of operation information through preset rules or models. Specifically, database business operations may include common database query, update, insert and delete operations, while non-database business operations may include modifications to system files, unauthorized access, etc. Based on these rules, the monitoring module can quickly and accurately classify the operation information.
[0082] Specifically, when the monitoring module determines that the operation information is a non-database business operation, different fault handling measures can be taken according to the specific type of abnormal operation. For example, for unauthorized file modification, an alarm message can be immediately sent to the system administrator and relevant logs can be recorded; for potential malicious attacks, the system protection mechanism can be triggered to prevent further operations and conduct a detailed security review.
[0083] The method described in this application achieves efficient identification and processing of abnormal data node change operations by accurately distinguishing between database business operations and non-database business operations. This not only improves the reliability and security of the system, but also enables rapid response and processing when abnormal operations occur, reducing potential security risks and the impact of system failures.
[0084] In one embodiment, if the operation information is a non-database business operation, the change operation is an abnormal operation, and a fault handling measure is implemented according to the abnormal operation type, including:
[0085] When the fault handling measure is alarm information processing, sending alarm information to the alarm module, and the alarm module displays the alarm information on the front-end page;
[0086] When the fault handling measure is alarm plus node switching processing, the role of the abnormal node is determined. If the abnormal node is an abnormal master node, the monitoring module sends an alarm message to the alarm module and sends a node switching instruction to the node management module.
[0087] In this embodiment, when it is detected that the operation information of the data node is a non-database business operation, it is regarded as an abnormal operation. According to the type of abnormal operation, take corresponding fault handling measures. For alarm information processing, the system will send an alarm message to the alarm module and display the alarm message on the front-end page. For alarm plus node switching processing, the system first determines the role of the abnormal node. If the main node is detected to be abnormal, the monitoring module will send an alarm message to the alarm module, and at the same time send a node switching instruction to the node management module to execute the main and standby node switching operation. After receiving the instruction, the node management module will select the standby node for data synchronization operation and complete the switching of the data node.
[0088] Specifically, the fault handling measures include alarm information processing and alarm plus node switching processing. In the alarm information processing measures, an alarm message is sent to the alarm module and displayed on the front-end page. In the alarm plus node switching processing measures, the role of the abnormal node is first determined. If the main node is abnormal, an alarm message is sent to the alarm module and a node switching instruction is sent to the node management module, and the alarm message is displayed on the front-end page. If the standby node is abnormal, an alarm message is sent to the alarm module, and the alarm message is displayed on the front-end page. Through the mutual cooperation of these technical features, the technical solution of the present application can effectively detect and process abnormal operations caused by non-database business operations of data nodes, ensuring the high reliability and high availability of the system.
[0089] Therefore, this application can effectively avoid data node anomalies caused by human operations by detecting and processing non-database business operations, thereby improving the reliability and availability of the system. Compared with the prior art, this application not only focuses on system failures caused by factors such as network isolation, process anomalies, and hard disk failures, but also pays attention to the potential risks brought by human operations, and provides a comprehensive fault handling strategy.
[0090] In one embodiment, if the abnormal node is an abnormal master node, the monitoring module sends an alarm message to the alarm module and sends a node switching instruction to the node management module, including:
[0091] The node management module receives the node switching instruction sent by the monitoring module and executes the primary and standby node switching operation;
[0092] A standby node is selected according to the node switching priority, and data synchronization operation is performed on the primary node and the standby node to complete the data node switching.
[0093] In this embodiment, the monitoring module first detects whether an abnormality occurs in the main node. When an abnormality is detected, the monitoring module immediately sends an alarm message to the alarm module and sends a node switching instruction to the node management module. After receiving the instruction, the node management module selects a backup node according to the node switching priority. The node management module checks whether the status of the backup node is healthy and can take over the responsibilities of the main node, and selects a backup node that meets the requirements to perform the main and backup node switching operation. Subsequently, the node management module performs data synchronization operations on the main node and the backup node to ensure the consistency and integrity of the data, and finally completes the switching of the data node, updates the system configuration, and redirects the traffic and requests from the failed main node to the backup node. After the node switching, it verifies whether the backup node has successfully taken over the responsibilities of the main node and whether the service is running normally, ensuring that it can be executed quickly in the event of an actual certification failure, minimizing the service interruption time.
[0094] By effectively solving the data node switching problem when the master node is abnormal, it ensures that the system can quickly resume normal operation when the master node fails, avoiding data loss and service interruption. Compared with the prior art, this application not only focuses on failures caused by non-subjective factors, but also effectively monitors and handles intentional intrusions into the system such as manually changing data node files, further improving the security and reliability of the system.
[0095] See also Figure 2 , Figure 2 The flow chart of another embodiment of the data node monitoring method provided by the present invention, the present invention obtains the metadata information of the data node in the front-end page data, and configures the fault handling measures, the front-end page sends the metadata information and the fault handling measures to the monitoring module, the monitoring module receives the metadata information and parses it, obtains the path information in the metadata information, and sends the path information to the file detection module. The file detection module detects whether there is a change operation in the path information, and reports the operation information of the path information to the monitoring module. The monitoring module determines whether the operation information is an abnormal operation, if the operation information is an abnormal operation, a real-time fault handling operation is performed, and the fault handling operation is determined to be only an alarm, or an alarm plus node switching, when only an alarm is given, the alarm information is sent to the alarm module; when an alarm plus node switching is performed, it is determined whether the abnormal node is the main node or the standby node, if the main node is abnormal, the alarm information is sent to the alarm module, and the node switching instruction is sent to the node management module to implement the node switching operation; if the standby node is abnormal, the alarm information is sent to the alarm module, and the alarm information is sent to the front-end page for display, providing a reliable standby node, and achieving better maintenance of the stable operation of the database system.
[0096] A data node monitoring device, the device comprising:
[0097] The data acquisition module 11 is used to acquire metadata information of the data node and send the metadata information to the monitoring module;
[0098] A monitoring module 12, configured to send the path information in the metadata information to the file detection module;
[0099] A file detection module 13, used to detect whether there is a change operation on the path information through the file detection module, and if there is a change operation on the path information, report the operation information of the path information to the monitoring module;
[0100] The node management module 14 is used for the monitoring module to determine whether the operation information is an abnormal operation, and implement a fault handling strategy when the change operation is an abnormal operation.
[0101] like Figure 3As shown, the data acquisition module 11, the monitoring module 12, the file detection module 13 and the node management module 14 are connected in sequence. The module referred to in the present invention refers to a series of computer program instruction segments that can complete specific functions, which is more suitable for the data node monitoring method execution process than the program. For the specific implementation method of each module, please refer to the corresponding method embodiment above, which will not be repeated here.
[0102] In one embodiment, the data acquisition module 11 includes:
[0103] Monitoring unit, used to control the monitoring switch and set monitoring parameters according to monitoring requirements;
[0104] A measure configuration unit, used to configure fault handling measures according to abnormal scenarios;
[0105] A data acquisition unit, used to acquire metadata information of a data node;
[0106] The data transmission unit is used to send the monitoring parameters, metadata information and fault handling measures to the monitoring module through the front-end page.
[0107] In one embodiment, the monitoring module 12 includes:
[0108] A data parsing unit, used for the monitoring module to receive metadata information transmitted by the front-end page, parse the metadata information, and obtain path information;
[0109] The information sending unit is used to send the path information to the file detection module and send a monitoring instruction to the file detection module.
[0110] In one embodiment, the file detection module 13 includes:
[0111] A monitoring receiving unit, used for the file detection module to receive the path information and monitoring instructions;
[0112] A path information detection unit, used to monitor the path information in response to a monitoring instruction, and detect whether there is a change operation on the path information;
[0113] The operation information reporting unit is used to report the operation information of the path information to the monitoring module when there is a change operation on the path information.
[0114] In one embodiment, the node management module 14 includes:
[0115] An operation information judging unit, used by the monitoring module to judge whether the operation information is an abnormal operation;
[0116] A normal operation unit, used for, if the operation information is a database business operation, the change operation is a normal operation;
[0117] The abnormal operation unit is used to, if the operation information is a non-database business operation, then the change operation is an abnormal operation, and implement fault handling measures according to the abnormal operation type.
[0118] In one embodiment, the abnormal operation unit includes:
[0119] When the fault handling measure is alarm information processing, sending alarm information to the alarm module, and the alarm module displays the alarm information on the front-end page;
[0120] When the fault handling measure is alarm plus node switching processing, the role of the abnormal node is determined. If the abnormal node is an abnormal master node, the monitoring module sends an alarm message to the alarm module and sends a node switching instruction to the node management module.
[0121] In one embodiment, the node management module 14 includes:
[0122] The node management module receives the node switching instruction sent by the monitoring module and executes the primary and standby node switching operation;
[0123] A standby node is selected according to the node switching priority, and data synchronization operation is performed on the primary node and the standby node to complete the data node switching.
[0124] Another embodiment of the present invention provides a data node monitoring system, the system comprising at least one processor; and
[0125] a memory communicatively connected to the at least one processor; wherein,
[0126] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the data node monitoring method.
[0127] One or more processors 110 and memory 120, Figure 4 A processor 110 is used as an example for description. The processor 110 and the memory 120 may be connected via a bus or other means. Figure 4 The example of connecting through bus is taken in the following.
[0128] The processor 110 is used to complete various control logics of the control system 10. It can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), a single-chip microcomputer, an ARM (Acorn RISC Machine) or other programmable logic device, a discrete gate or transistor logic, a discrete hardware component, or any combination of these components. In addition, the processor 110 can also be any traditional processor, microprocessor or state machine. The processor 110 can also be implemented as a combination of computing devices, for example, a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors combined with a DSP and / or any other such configuration.
[0129] The memory 120 is a non-volatile computer-readable storage medium that can be used to store non-volatile software programs, non-volatile computer executable programs and modules, such as program instructions corresponding to the data node monitoring method in the embodiment of the present invention. The processor 110 executes various functional applications and data processing of the control system 10 by running the non-volatile software programs, instructions and units stored in the memory 120, that is, the data node monitoring method in the above method embodiment is implemented.
[0130] The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required by at least one function; the data storage area may store data created according to the use of the control system 10, etc. In addition, the memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory 120 may optionally include a memory remotely arranged relative to the processor 110, and these remote memories may be connected to the control system 10 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0131] One or more units are stored in the memory 120, and when executed by one or more processors 110, the data node monitoring method in any of the above method embodiments is executed, for example, the data node monitoring method described above is executed. Figure 1 The method comprises steps S100 to S400.
[0132] An embodiment of the present invention provides a non-volatile computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are executed by one or more processors, for example, to execute the above-described Figure 1 The method comprises steps S100 to S400.
[0133] As an example, non-volatile storage media can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) as external cache memory. By way of illustration and not limitation, RAM can be obtained in many forms such as synchronous RAM (SRAM), dynamic RAM, (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), Synchlink DRAM (SLDRAM), and direct Rambus RAM (DRRAM). The disclosed memory components or memories of the operating environment described herein are intended to include one or more of these and / or any other suitable types of memory.
[0134] In summary, the present invention discloses a data node monitoring method, device, system and medium, including: obtaining metadata information of a data node, and sending the metadata information to a monitoring module; the monitoring module sends the path information in the metadata information to a file detection module; the file detection module detects whether there is a change operation on the path information, and if there is a change operation on the path information, the operation information of the path information is reported to the monitoring module; the monitoring module determines whether the operation information is an abnormal operation, and implements a fault handling strategy when the change operation is an abnormal operation. The present invention monitors the change operation information of the data node, and performs real-time fault handling operations when an abnormal operation occurs, thereby ensuring the stable operation of the database system.
[0135] Of course, those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing related hardware (such as a processor, a controller, etc.) through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium, and the computer program can include the processes of the above-mentioned method embodiments when executed. The storage medium can be a memory, a disk, a floppy disk, a flash memory, an optical storage device, etc.
[0136] It should be understood that the application of the present invention is not limited to the above examples. For ordinary technicians in this field, improvements or changes can be made based on the above description. All these improvements and changes should fall within the scope of protection of the claims attached to the present invention.
Claims
1. A data node monitoring method, characterized in that: The steps include: Obtain metadata information of the data node and send the metadata information to the monitoring module; The monitoring module sends the path information in the metadata information to the file detection module; Detecting whether there is a change operation on the path information by the file detection module, and if there is a change operation on the path information, reporting the operation information of the path information to the monitoring module; The monitoring module determines whether the operation information is an abnormal operation, and implements a fault handling strategy when the change operation is an abnormal operation.
2. The data node monitoring method according to claim 1, characterized in that: The step of obtaining metadata information of the data node and sending the metadata information to the monitoring module includes: Control the monitoring switch and set monitoring parameters according to monitoring requirements; Configure fault handling measures based on abnormal scenarios; Get metadata information of data nodes; The monitoring parameters, metadata information and fault handling measures are sent to the monitoring module through the front-end page.
3. The data node monitoring method according to claim 1, characterized in that: The monitoring module sends the path information in the metadata information to the file detection module, including: The monitoring module receives metadata information transmitted by the front-end page, parses the metadata information, and obtains path information; The path information is sent to the file detection module, and a monitoring instruction is sent to the file detection module.
4. The data node monitoring method according to claim 3 is characterized in that: The step of detecting whether there is a change operation on the path information by the file detection module, and if there is a change operation on the path information, reporting the operation information of the path information to the monitoring module includes: The file detection module receives the path information and monitoring instructions; In response to the monitoring instruction, the path information is monitored to detect whether there is a change operation on the path information; When there is a change operation on the path information, the operation information of the path information is reported to the monitoring module.
5. The data node monitoring method according to claim 1, characterized in that: The monitoring module determines whether the operation information is an abnormal operation, and implements a fault handling strategy when the change operation is an abnormal operation, including: The monitoring module determines whether the operation information is an abnormal operation; If the operation information is a database business operation, the change operation is a normal operation; If the operation information is a non-database business operation, the change operation is an abnormal operation, and a fault handling measure is implemented according to the abnormal operation type.
6. The data node monitoring method according to claim 5, characterized in that: If the operation information is a non-database business operation, the change operation is an abnormal operation, and a fault handling measure is implemented according to the abnormal operation type, including: When the fault handling measure is alarm information processing, sending alarm information to the alarm module, and the alarm module displays the alarm information on the front-end page; When the fault handling measure is alarm plus node switching processing, the role of the abnormal node is determined. If the abnormal node is an abnormal master node, the monitoring module sends an alarm message to the alarm module and sends a node switching instruction to the node management module.
7. The data node monitoring method according to claim 6, characterized in that: If the abnormal node is an abnormal master node, the monitoring module sends an alarm message to the alarm module and sends a node switching instruction to the node management module, including: The node management module receives the node switching instruction sent by the monitoring module and executes the primary and standby node switching operation; A standby node is selected according to the node switching priority, and data synchronization operation is performed on the primary node and the standby node to complete the data node switching.
8. A data node monitoring device, characterized in that: The device comprises: A data acquisition module is used to acquire metadata information of data nodes and send the metadata information to the monitoring module; A monitoring module, configured to send the path information in the metadata information to the file detection module; A file detection module, used to detect whether there is a change operation on the path information through the file detection module, and if there is a change operation on the path information, report the operation information of the path information to the monitoring module; The node management module is used for the monitoring module to determine whether the operation information is an abnormal operation, and implement a fault handling strategy when the change operation is an abnormal operation.
9. A data node monitoring system, characterized in that: The system includes at least one processor; and, a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the data node monitoring method described in any one of claims 1-7.
10. A non-volatile computer-readable storage medium, characterized in that: The non-volatile computer-readable storage medium stores computer-executable instructions, which, when executed by one or more processors, enable the one or more processors to execute the data node monitoring method described in any one of claims 1-7.