A listening method and apparatus

Abstract

This invention discloses a monitoring method and apparatus, relating to the field of computer technology. One specific implementation of the method includes obtaining the full path; decomposing the full path level by level to obtain multiple target paths, thereby creating multiple corresponding target nodes; creating monitoring nodes and using the full path as the corresponding data content; parsing the data content of the monitoring nodes through a preset monitoring component, and performing compensation monitoring on each parsed path to determine the existence of the corresponding node. Therefore, the implementation of this invention can solve the technical problem of potentially losing some paths and their monitoring events imperceptibly when creating multi-level paths in ZooKeeper.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to a monitoring method and apparatus. Background Technology

[0002] Currently, the distributed data system Zookeeper is widely used, providing users with a convenient and highly consistent distributed data operation service.

[0003] In the process of realizing this invention, the inventors discovered at least the following problems in the prior art:

[0004] When a user creates a multi-level path in Zookeeper at once, due to Zookeeper's inherent defects, some paths and their monitoring mechanisms may be lost simultaneously. This results in Zookeeper being unaware of the lost paths and corresponding configuration change events, causing significant data risks. Summary of the Invention

[0005] In view of this, embodiments of the present invention provide a monitoring method and apparatus that can solve the technical problem that some paths and their monitoring events may be lost imperceptibly when creating multi-level paths in Zookeeper.

[0006] To achieve the above objectives, according to one aspect of the present invention, a monitoring method is provided, comprising: obtaining a full path; decomposing the full path level by level to obtain multiple target paths to create multiple target nodes; creating monitoring nodes and using the full path as the corresponding data content; parsing the data content of the monitoring nodes through a preset monitoring component, and performing compensation monitoring on each path obtained from the parsing to determine the existence of the corresponding node.

[0007] Optionally, a listener node is created, including:

[0008] Create a listening node under the specified path, wherein the specified path and the full path do not overlap.

[0009] Optionally, the data content of the listening node is parsed using a preset listening component, including:

[0010] In response to determining that the specified path is not empty, a preset listening component is invoked to read the data content of the listening nodes under the specified path.

[0011] Optionally, after reading the data content of the listening node under the specified path, it includes:

[0012] The read results are broken down step by step to obtain multiple target paths.

[0013] Optionally, after determining the existence of the corresponding node, the process includes:

[0014] In response to determining that a target node does not exist, the target node is marked as lost.

[0015] Optionally, after marking the target node as lost, the process includes:

[0016] Determine the target path corresponding to each lost target node, and recreate the corresponding target node under each target path.

[0017] Optionally, after marking the target node as lost, the process includes:

[0018] Record each lost target node to a specified file and upload the specified file to a specified port.

[0019] In addition, the present invention also provides a monitoring device, including an acquisition module for acquiring the full path; a creation module for disassembling the full path step by step to obtain multiple target paths, so as to create multiple target nodes; a monitoring module for creating monitoring nodes and using the full path as the corresponding data content; and a processing module for parsing the data content of the monitoring nodes through a preset monitoring component, and performing compensation monitoring on each path obtained by parsing, so as to determine the existence of the corresponding node.

[0020] One embodiment of the above invention has the following advantages or beneficial effects: The present invention achieves the technical objective of obtaining monitoring requirements and determining monitoring targets by acquiring the entire path; simultaneously, by progressively decomposing the entire path to obtain multiple target paths, multiple target nodes are created, generating multiple multi-level nodes corresponding to business requirements, thus satisfying the corresponding business technical objectives; furthermore, by creating monitoring nodes and using the entire path as corresponding data content, the present invention accurately records the entire path of business requirements, laying the foundation for subsequent monitoring components to perform comprehensive monitoring compensation by parsing monitoring nodes; furthermore, the present invention uses a preset monitoring component to parse the data content of the monitoring nodes and performs compensation monitoring on each path obtained from the parsing to determine the existence of the corresponding nodes, thereby enabling progressively investigating potentially abnormal paths and nodes, thus achieving the technical objective of identifying the anomaly as early as possible and performing corresponding compensation processing.

[0021] The further effects of the aforementioned unconventional alternative methods will be explained below in conjunction with specific implementation methods. Attached Figure Description

[0022] The accompanying drawings are provided to better understand the invention and are not intended to unduly limit the scope of the invention. Wherein:

[0023] Figure 1 This is a schematic diagram of the main flow of the monitoring method according to the first embodiment of the present invention;

[0024] Figure 2 This is a schematic diagram of a processing method of a monitoring component according to an embodiment of the present invention;

[0025] Figure 3 This is a schematic diagram of the main flow of the monitoring method according to the second embodiment of the present invention;

[0026] Figure 4 This is a schematic diagram of the main flow of the monitoring method according to the third embodiment of the present invention;

[0027] Figure 5 This is a schematic diagram of the main modules of the listening device according to the first embodiment of the present invention;

[0028] Figure 6 This is an exemplary system architecture diagram in which embodiments of the present invention can be applied;

[0029] Figure 7 This is a schematic diagram of the structure of a computer system suitable for implementing terminal devices or servers of the present invention. Detailed Implementation

[0030] The following description, in conjunction with the accompanying drawings, illustrates exemplary embodiments of the present invention, including various details to aid understanding. These details should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the invention. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0031] Figure 1 This is a schematic diagram of the main flow of the monitoring method according to the first embodiment of the present invention, as shown below. Figure 1 As shown, the monitoring method includes:

[0032] Step S101: Obtain the full path.

[0033] Step S102: The entire path is broken down step by step to obtain multiple target paths, thereby creating multiple corresponding target nodes.

[0034] In this embodiment, after the above two steps, different levels of paths for multiple nodes to be configured corresponding to business requirements are obtained. This allows for the creation of multiple dynamically configurable data storage nodes at different levels in ZooKeeper. For example, the obtained full path can be ` / rootPath / envPath / flowLimitRule / comp / compPath / module / modulePath`. It is known that the lowest level of the multi-level path is the module level, and the corresponding storage path for the component level above the module level is ` / rootPath / envPath / flowLimitRule / comp / compPath`. Thus, by creating nodes at different levels, configuration data at different levels is stored separately. Furthermore, for each node created in ZooKeeper, a corresponding listening mechanism is normally generated to monitor subsequent data updates in real time. However, due to inherent limitations of ZooKeeper, when multiple levels of paths (and their corresponding nodes) are created simultaneously, some path loss events may occur, along with the loss of the corresponding listening mechanism. This results in ZooKeeper being unaware of the path loss event and subsequent configuration data changes, causing significant data vulnerabilities.

[0035] Step S103: Create a listening node and use the full path as the corresponding data content.

[0036] In this embodiment, by writing the multi-level path as the value of the node after this step, the technical objective of accurately storing the full path corresponding to the business requirements can be achieved. That is, the nodes and paths lost during the creation of multi-level nodes in ZooKeeper will not affect the listening node, thus laying the foundation for subsequent processing to use the initial multi-level path value (i.e., data content) as the standard value for corresponding compensation processing.

[0037] In some embodiments, to avoid the listening node itself negatively impacting the entire path of business requirements, the specific processing during the creation of the listening node can be as follows: create the listening node under a specified path, wherein the specified path and the entire path do not overlap. This step ensures that the path of the listening node itself will not alter the multi-level target paths included in the entire path, thereby effectively preventing path disorder caused by the listening node. For example, such as... Figure 2It can be seen that the path / WatcherPath of the monitoring node and any target path included in the full path (such as / rootPath / envPath / flowLimitRule / comp / compPath / module / modulePath in the figure) do not have a hierarchical relationship.

[0038] Step S104: The data content of the listening node is parsed by a preset listening component, and each path obtained by parsing is compensated for listening to determine the existence of the corresponding node.

[0039] In this embodiment, this step enables the monitoring component to perform compensatory monitoring of all target nodes along the entire path by listening to the data content of the monitoring nodes. This allows for the timely detection of target nodes lost during the creation process and the implementation of corresponding compensation measures. This achieves the technical effect of timely detection of any missing node among multiple synchronously created nodes, enabling early detection and handling of potential data risks. For example, such as... Figure 2 As shown, by parsing the data content of / WatcherPath, the multi-level path monitoring device (i.e., monitoring component) in the diagram compensates for the corresponding monitoring events for each target path, including / modulePath and / campPath.

[0040] In some embodiments, to ensure that the preset monitoring component accurately identifies and parses the monitoring nodes, thereby improving the efficiency and accuracy of monitoring compensation in this technical solution, when parsing the data content of the monitoring node through the preset monitoring component, in response to determining that the specified path is not empty, the preset monitoring component can be invoked to read the data content of the monitoring node under the specified path. The specified path can be a path specifically for storing monitoring nodes; therefore, a non-empty specified path corresponds to the creation of the corresponding monitoring node, requiring the invocation of the preset monitoring component to process the corresponding compensation monitoring event. This step enables the monitoring component to perceive the monitoring compensation requirement in real time.

[0041] In some embodiments, in order to comprehensively monitor and verify paths and nodes that may have abnormal loss events, the data content of the monitoring nodes under the specified path can be read, and the reading results can be decomposed level by level to obtain multiple target paths.

[0042] In some embodiments, to quickly filter out suspected lost target nodes based on the monitoring process, after determining the existence of a corresponding node, in response to determining that a target node does not exist, the target node can be marked as lost. This step achieves the technical objective of compensating for each newly created target path and target node. Thus, even if the corresponding monitoring mechanism is lost, the monitoring component can quickly locate the defect in the entire path through monitoring compensation, thereby laying the foundation for subsequent node reconstruction and defect reporting.

[0043] In some embodiments, in order to minimize the business impact of lost target paths on the entire path, after marking the target node as lost, the target path corresponding to each lost target node can be determined, so as to recreate the corresponding target node under each target path.

[0044] In some embodiments, in order to report the results of compensation monitoring in a timely manner so as to facilitate the statistics and management of system anomalies, after marking the target node as lost, each lost target node can be recorded in a specified file and the specified file can be uploaded to a specified port so as to record and analyze the business anomalies that have occurred in a timely manner through the specified port.

[0045] Figure 3 This is a schematic diagram of the main flow of the monitoring method according to the second embodiment of the present invention, the monitoring method including:

[0046] Step S301: Obtain multi-level paths.

[0047] Step S302: Generate a target node outside the multi-level path.

[0048] Step S303: Use the multi-level path as the data content corresponding to the target node, and monitor the target node.

[0049] Step S304: Generate multiple corresponding nodes based on the multi-level path.

[0050] Step S305, in response to the detection of a target node change event.

[0051] Step S306: The data content of the target node change is split level by level to obtain multiple change paths.

[0052] Step S307: Perform compensation monitoring on the nodes corresponding to each changed path to determine the existence of each node.

[0053] Step S308: In response to determining that a certain node does not exist, the node is designated as the change node.

[0054] Step S309: Determine the change path corresponding to the changed node, so as to regenerate the corresponding node under the change path.

[0055] Figure 4 This is a schematic diagram of the main flow of the monitoring method according to the third embodiment of the present invention, the monitoring method including:

[0056] Step S401: Obtain the full path.

[0057] Step S402: The entire path is broken down level by level to obtain multiple target paths, thereby creating multiple corresponding target nodes.

[0058] Step S403: Create a listening node under the specified path.

[0059] Preferably, the specified path and the full path do not overlap.

[0060] Step S404: Use the full path as the corresponding data content.

[0061] Step S405: In response to determining that the specified path is not empty, a preset listening component is invoked to read the data content of the listening nodes under the specified path.

[0062] Step S406: The reading results are broken down step by step to obtain multiple target paths.

[0063] Step S407: Monitor the target nodes corresponding to each target path obtained from parsing.

[0064] Step S408: In response to determining that a target node does not exist, the target node is marked as lost.

[0065] Step S409: Determine the target path corresponding to each lost target node, so as to recreate the corresponding target node under each target path.

[0066] Preferably, each lost target node is recorded in a specified file, and the specified file is uploaded to a specified port.

[0067] Figure 5 This is a schematic diagram of the main modules of the monitoring device according to an embodiment of the present invention, such as... Figure 5As shown, the monitoring device 500 includes an acquisition module 501, a creation module 502, a monitoring module 503, and a processing module 504. The acquisition module 501 acquires the full path; the creation module 502 decomposes the full path step-by-step to obtain multiple target paths, thereby creating multiple corresponding target nodes; the monitoring module 503 creates monitoring nodes and uses the full path as the corresponding data content; and the processing module 504 parses the data content of the monitoring nodes using a preset monitoring component and performs compensated monitoring on each parsed path to determine the existence of the corresponding node.

[0068] In some embodiments, the listening module 503 is further configured to: create a listening node under a specified path, wherein the specified path and the full path do not overlap.

[0069] In some embodiments, the processing module 504 is further configured to: when parsing the data content of the listening node through a preset listening component, in response to determining that the specified path is not empty, invoke the preset listening component to read the data content of the listening node under the specified path.

[0070] In some embodiments, the processing module 504 is further configured to: after reading the data content of the listening node under the specified path, decompose the reading result step by step to obtain multiple target paths.

[0071] In some embodiments, the processing module 504 is further configured to: after determining the existence of a corresponding node, in response to determining that a target node does not exist, mark the target node as lost.

[0072] In some embodiments, the processing module 504 is further configured to: after marking the target node as lost, determine the target path corresponding to each lost target node, so as to recreate the corresponding target node under each target path.

[0073] In some embodiments, the processing module 504 is further configured to: after marking the target node as lost, record each lost target node in a specified file and upload the specified file to a specified port.

[0074] It should be noted that the monitoring method and the monitoring device described in this invention are related in their specific implementation, so repeated content will not be described again.

[0075] Figure 6 An exemplary system architecture 600 is shown that can be applied to the monitoring method or monitoring device of the present invention.

[0076] like Figure 6As shown, system architecture 600 may include terminal devices 601, 602, and 603, a network 604, and a server 605. Network 604 serves as the medium for providing communication links between terminal devices 601, 602, and 603 and server 605. Network 604 may include various connection types, such as wired or wireless communication links or fiber optic cables, etc.

[0077] Users can use terminal devices 601, 602, and 603 to interact with server 605 via network 604 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 601, 602, and 603.

[0078] Terminal devices 601, 602, and 603 can be various electronic devices with a page display processing screen that supports web browsing, including but not limited to smartphones, tablets, laptops, and desktop computers.

[0079] Server 605 can be a server that provides various services, such as a backend management server that supports users using terminal devices 601, 602, and 603 (for example only). The backend management server can analyze and process data such as received product information query requests, and feed back the processing results (such as target push information, product information - for example only) to the terminal devices.

[0080] It should be noted that the monitoring method provided in this embodiment of the invention is generally executed by server 605, and correspondingly, the computing device is generally located in server 605.

[0081] It should be understood that Figure 6 The number of terminal devices, networks, and servers shown is merely illustrative. Depending on implementation needs, any number of terminal devices, networks, and servers can be included.

[0082] The following is for reference. Figure 7 It shows a schematic diagram of the structure of a computer system 700 suitable for implementing a terminal device of the present invention. Figure 7 The terminal device shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of the present invention.

[0083] like Figure 7As shown, the computer system 700 includes a central processing unit (CPU) 701, which can perform various appropriate actions and processes based on programs stored in read-only memory (ROM) 702 or programs loaded from storage section 708 into random access memory (RAM) 703. The RAM 703 also stores various programs and data required for the operation of the computer system 700. The CPU 701, ROM 702, and RAM 703 are interconnected via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0084] The following components are connected to I / O interface 505: an input section 706 including a keyboard, mouse, etc.; an output section 707 including a cathode ray tube (CRT), liquid crystal display processor (LCD), speakers, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN card, modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to I / O interface 705 as needed. A removable medium 711, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on drive 710 as needed so that computer programs read from it can be installed into storage section 708 as needed.

[0085] In particular, according to the embodiments disclosed in this invention, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed in this invention include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 709, and / or installed from removable medium 711. When the computer program is executed by central processing unit (CPU) 701, it performs the functions defined above in the system of this invention.

[0086] It should be noted that the computer-readable medium shown in this invention can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this invention, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this invention, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0087] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0088] The modules described in the embodiments of the present invention can be implemented in software or hardware. The described modules can also be housed in a processor; for example, a processor can be described as including an acquisition module, a creation module, a listening module, and a processing module. The names of these modules do not necessarily limit the functionality of the module itself.

[0089] In another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiments; or it may exist independently and not assembled into the device. The computer-readable medium carries one or more programs, which, when executed by the device, cause the device to include: obtaining a full path; decomposing the full path step-by-step to obtain multiple target paths to create multiple corresponding target nodes; creating listening nodes and using the full path as corresponding data content; parsing the data content of the listening nodes through a preset listening component, and performing compensated listening on each parsed path to determine the existence of the corresponding node.

[0090] According to the technical solution of the present invention, the technical problem that some paths and their listening events may be lost imperceptibly when creating multi-level paths in Zookeeper can be solved.

[0091] The specific embodiments described above do not constitute a limitation on the scope of protection of this invention. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can occur depending on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this invention should be included within the scope of protection of this invention.

Claims

1. A monitoring method, characterized in that, include: Get the full path; The entire path is broken down level by level to obtain multiple target paths, thereby creating multiple corresponding target nodes; Create a listening node and use the full path as the corresponding data content; wherein the listening node and the full path do not overlap; The data content of the listening node is parsed by a preset listening component, and each path obtained by parsing is compensated for listening to determine the existence of the corresponding node.

2. The method according to claim 1, characterized in that, Creating a listener node includes: Create a listening node under the specified path, wherein the specified path and the full path do not overlap.

3. The method according to claim 2, characterized in that, The data content of the listening node is parsed using a preset listening component, including: In response to determining that the specified path is not empty, a preset listening component is invoked to read the data content of the listening nodes under the specified path.

4. The method according to claim 3, characterized in that, After reading the data content of the listening node under the specified path, it includes: The read results are broken down step by step to obtain multiple target paths.

5. The method according to claim 1, characterized in that, After confirming the existence of the corresponding node, the following steps are taken: In response to determining that a target node does not exist, the target node is marked as lost.

6. The method according to claim 5, characterized in that, After marking the target node as lost, the process includes: Determine the target path corresponding to each lost target node, and recreate the corresponding target node under each target path.

7. The method according to claim 5, characterized in that, After marking the target node as lost, the process includes: Record each lost target node to a specified file and upload the specified file to a specified port.

8. A listening device, characterized in that, include: The retrieval module is used to obtain the full path; A creation module is used to break down the entire path step by step to obtain multiple target paths, so as to create multiple corresponding target nodes; A listening module is used to create listening nodes and use the full path as the corresponding data content; wherein, the listening node and the full path do not overlap; The processing module is used to parse the data content of the listening node through a preset listening component, and to perform compensation listening on each path obtained by parsing in order to determine the existence of the corresponding node.

9. The apparatus according to claim 8, characterized in that, Creating a listener node includes: Create a listening node under the specified path, wherein the specified path and the full path do not overlap.

10. The apparatus according to claim 9, characterized in that, The data content of the listening node is parsed using a preset listening component, including: In response to determining that the specified path is not empty, a preset listening component is invoked to read the data content of the listening nodes under the specified path.

11. The apparatus according to claim 10, characterized in that, After reading the data content of the listening node under the specified path, it includes: The read results are broken down step by step to obtain multiple target paths.

12. The apparatus according to claim 8, characterized in that, After confirming the existence of the corresponding node, the following steps are taken: In response to determining that a target node does not exist, the target node is marked as lost.

13. The apparatus according to claim 12, characterized in that, After marking the target node as lost, the process includes: Determine the target path corresponding to each lost target node, and recreate the corresponding target node under each target path.

14. The apparatus according to claim 12, characterized in that, After marking the target node as lost, the process includes: Record each lost target node to a specified file and upload the specified file to a specified port.

15. An electronic device, characterized in that, include: One or more processors; Storage device for storing one or more programs. When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 1-7.

16. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1-7.

17. A computer-readable medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method as described in any one of claims 1-7.

Images