Data link network monitoring method and device

Abstract

The embodiments of the present application provide a method and device for monitoring a data link network. The method includes: obtaining the number of data processing times and the number of data processing anomalies in the data processing times for each data link in the data link network within a preset time; determining the abnormality ratio of each data link based on the data processing times and the number of data processing anomalies; determining the data link in the data link network whose abnormality ratio exceeds a preset threshold as an abnormal data link. The technical solution of the embodiments of the present application can improve the timeliness of monitoring the data link network.

Description

Technical Field

[0001] The present application relates to the field of computer and communication technology, and in particular to a method and device for monitoring a data link network. Background Art

[0002] In the monitoring scenario of data link network, such as the monitoring scenario of transaction data link network, it is usually done manually to sample and analyze the transaction data of a certain period. When an abnormality is found in the data link of the transaction data link network, the relevant agency is notified and the relevant agency handles the abnormality by itself. However, how to improve the timeliness of monitoring the data link network is a technical problem that needs to be solved urgently. Summary of the invention

[0003] The embodiments of the present application provide a method, device, computer-readable medium and electronic device for monitoring a data link network, thereby improving the timeliness of monitoring the data link network at least to a certain extent.

[0004] Other features and advantages of the present application will become apparent from the following detailed description, or may be learned in part by the practice of the present application.

[0005] According to one aspect of an embodiment of the present application, a monitoring method for a data link network is provided, wherein the data link network includes at least two data links, and the method includes: obtaining the number of data processing times and the number of data processing exceptions in the data processing times for each data link in the data link network within a preset time; determining the abnormality ratio of each data link based on the data processing times and the number of data processing exceptions; and determining the data link in the data link network whose abnormality ratio exceeds a preset threshold as an abnormal data link.

[0006] According to one aspect of an embodiment of the present application, a monitoring device for a data link network is provided, the device comprising: an acquisition unit, used to acquire the number of data processing times and the number of data processing exceptions in the data processing times for each data link in the data link network within a preset time; a first determination unit, used to determine the abnormality ratio of each of the data links based on the data processing times and the number of data processing exceptions; and a second determination unit, used to determine the data link in the data link network whose abnormality ratio exceeds a preset threshold as an abnormal data link.

[0007] In some embodiments of the present application, based on the aforementioned scheme, the acquisition unit is configured to: store in real time through shared memory the feedback results of each data link in the data link network after each data processing; and count the number of data processing times of each data link within a preset time and the number of data processing exceptions in which the feedback results are abnormal.

[0008] In some embodiments of the present application, based on the aforementioned scheme, the first determination unit is configured to: calculate the ratio between the number of data processing exceptions and the number of data processing times, and use the ratio as the abnormality ratio of each of the data links.

[0009] In some embodiments of the present application, based on the aforementioned scheme, the device also includes a closing unit, which is used to close the abnormal data link after determining the data link in the data link network whose abnormal ratio exceeds a preset threshold as an abnormal data link, so as to terminate data processing in the abnormal data link.

[0010] In some embodiments of the present application, based on the aforementioned scheme, the data link network includes a transaction data link network, the data link includes a transaction data link, and the link nodes in the transaction data link include a front-end node, a third-party node, a channel node, and a back-end node; wherein the front-end node is a common node of all transaction data links in the transaction data link network; and the closing unit is configured to: close the abnormal transaction data link.

[0011] In some embodiments of the present application, based on the aforementioned scheme, the closing unit is configured to: determine the abnormal link node in the abnormal transaction data link through the position of the abnormal transaction data link in the transaction data link network and the position of the link node in the abnormal transaction data link; when the abnormal link node is an abnormal front-end node, fuse the abnormal front-end node in the abnormal transaction data link; when the abnormal link node is an abnormal third-party node, fuse the abnormal third-party node in the abnormal transaction data link; when the abnormal link node is an abnormal channel node, fuse the abnormal channel node in the abnormal transaction data link; when the abnormal link node is an abnormal back-end node, fuse the abnormal back-end node in the abnormal transaction data link.

[0012] In some embodiments of the present application, based on the aforementioned scheme, the device also includes a detection unit, which is used to detect whether there is an available normal channel node in the transaction data link network after the abnormal channel node in the abnormal transaction data link is blown; a replacement unit, which is used to replace the abnormal channel node in the abnormal transaction data link with the normal channel node when there is an available normal channel node in the transaction data link network; and a calling unit, which is used to call the announcement at the back-end node in the abnormal transaction data link when there is no available normal channel node in the transaction data link network, so as to notify the front-end node in the abnormal transaction data link of the announcement and suspend data input at the front-end node.

[0013] In some embodiments of the present application, based on the aforementioned scheme, the device also includes a monitoring unit, which is used to monitor the amount of unprocessed transaction data accumulated in the abnormal transaction data link when the abnormal transaction data link returns to normal after pausing the input of data at the front-end node; and a cancellation unit, which is used to cancel the announcement of the front-end node in the abnormal transaction data link when the amount of the unprocessed transaction data is lower than a preset threshold value, so as to resume the input of data at the front-end node.

[0014] In some embodiments of the present application, based on the aforementioned scheme, the device also includes an opening unit, which is used to open the abnormal transaction data link at a preset time interval based on the abnormal occurrence time of the abnormal transaction data link after closing the abnormal transaction data link; a first input unit is used to input transaction data in the abnormal transaction data link to detect whether the abnormal transaction data link has returned to normal; and a second input unit is used to input the accumulated unprocessed transaction data into the restored transaction data link at a preset flow rate when it is detected that the abnormal transaction data link has returned to normal, so as to gradually process the unprocessed transaction data.

[0015] According to one aspect of an embodiment of the present application, a computer-readable medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method for monitoring a data link network as described in the above embodiment is implemented.

[0016] According to one aspect of an embodiment of the present application, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the data link network monitoring method as described in the above embodiments.

[0017] In the technical solutions provided in some embodiments of the present application, by obtaining the number of data processing times of each data link in the data link network within a preset time and the number of data processing anomalies in the data processing times, the abnormality ratio of each data link can be determined, and the data link whose abnormality ratio exceeds a preset threshold is determined as an abnormal data link. Since the technical solutions in the embodiments of the present application use the abnormality ratio as an indicator for judging abnormal data links, and the abnormality ratio can be determined by obtaining the number of data processing times of the data link and the number of data processing anomalies in the data processing times in real time, the technical solutions in the embodiments of the present application can improve the timeliness of monitoring the data link network.

[0018] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0020] Figure 1 A schematic diagram showing an exemplary system architecture to which the technical solution of the embodiments of the present application can be applied;

[0021] Figure 2 A flow chart showing a method for monitoring a data link network according to an embodiment of the present application is shown;

[0022] Figure 3 A detailed flowchart of obtaining the number of data processing times and the number of data processing exceptions in the data processing times for each data link in the data link network within a preset time according to an embodiment of the present application is shown;

[0023] Figure 4 A schematic diagram of a scenario for obtaining the number of data processing times and the number of data processing exceptions in the data processing times for each data link in the data link network within a preset time according to an embodiment of the present application is shown;

[0024] Figure 5 A detailed flow chart of closing an abnormal transaction data link according to an embodiment of the present application is shown;

[0025] Figure 6 A schematic diagram of a transaction data link network according to an embodiment of the present application is shown;

[0026] Figure 7 A flow chart of a method after fusing the abnormal channel node in the abnormal transaction data link according to an embodiment of the present application is shown;

[0027] Figure 8 A flow chart of a method after pausing inputting data at the front-end node according to an embodiment of the present application is shown;

[0028] Fig. 9 A flow chart of a method after closing an abnormal transaction data link according to an embodiment of the present application is shown;

[0029] Fig.10 A block diagram of a monitoring device for a data link network according to an embodiment of the present application is shown;

[0030] Fig.11 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown. DETAILED DESCRIPTION

[0031] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more comprehensive and complete and fully convey the concept of the example embodiments to those skilled in the art.

[0032] In addition, described feature, structure or characteristic can be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present application. However, those skilled in the art will appreciate that the technical scheme of the present application can be put into practice without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, known methods, devices, realizations or operations are not shown or described in detail to avoid blurring the various aspects of the application.

[0033] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0034] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0035] Figure 1 A schematic diagram of an exemplary system architecture to which the technical solution of the embodiments of the present application can be applied is shown.

[0036] like Figure 1 As shown, the system architecture may include terminal devices (such as Figure 1 The embodiment of the present invention is a schematic diagram of a mobile phone 101, a tablet computer 102, a portable computer 103, a desktop computer, etc., a network 104, and a server 105. The network 104 is used to provide a medium for a communication link between the terminal device and the server 105. The network 104 may include various connection types, such as a wired communication link, a wireless communication link, etc.

[0037] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. According to the implementation requirements, there may be any number of terminal devices, networks and servers. For example, the server 105 may be a server cluster composed of multiple servers.

[0038] In one embodiment of the present application, the server 105 can obtain from the terminal device the number of data processing times and the number of data processing exceptions in the data processing times for each data link in the data link network within a preset time, and determine the abnormality ratio of each data link based on the data processing times and the number of data processing exceptions, and determine the data link in the data link network whose abnormality ratio exceeds a preset threshold as an abnormal data link.

[0039] It should be noted that the data link network monitoring method provided in the embodiment of the present application is generally executed by the server 105, and accordingly, the data link network monitoring device is generally set in the server 105. However, in other embodiments of the present application, the terminal device may also have similar functions as the server, so as to execute the data link network monitoring solution provided in the embodiment of the present application.

[0040] The implementation details of the technical solution of the embodiment of the present application are described in detail below:

[0041] Figure 2 A flow chart of a method for monitoring a data link network according to an embodiment of the present application is shown. The method for monitoring a data link network can be executed by a device having a computing and processing function, for example, Figure 1 Refer to the server 105 shown in Figure 2 As shown, the data link network monitoring method at least includes steps 220 to 260, which are described in detail as follows:

[0042] In step 220, the number of data processing times within a preset time and the number of data processing exceptions in the data processing times are obtained for each data link in the data link network.

[0043] In the present application, the data link network includes at least two data links, and the number of data processing times and the number of data processing exceptions in the data processing times of each data link in the data link network within a preset time can be performed by executing the following steps: Figure 3 Obtained by following the steps shown.

[0044] See also Figure 3 , shows a detailed flowchart of obtaining the number of data processing times and the number of data processing exceptions in the data processing times for each data link in the data link network within a preset time according to an embodiment of the present application, which may specifically include steps 221 to 223:

[0045] Step 221, storing in real time through a shared memory the feedback result of each data link in the data link network after each data processing.

[0046] In the present application, each of the data links in the data link network is loaded with data processing tasks, and specifically, each of the data links includes at least two link nodes, wherein, during the data processing process, the processed data can flow from one link node in the data link to another link node in the data link for further processing. In the data link, an abnormality of a data link node will directly lead to a data processing failure.

[0047] In the present application, the feedback results of each data link in the data link network after each data processing can be uniformly stored in a shared memory.

[0048] Step 223, counting the number of data processing times of each data link within a preset time and the number of abnormal data processing times with abnormal feedback results.

[0049] In the present application, the preset time can be set arbitrarily according to actual needs, for example, it can be 10 seconds, 30 seconds or 1 minute.

[0050] In order to enable those skilled in the art to more clearly understand the process of obtaining the data processing times and the data processing exception times, the following will be combined with Figure 4 A brief explanation:

[0051] See also Figure 4, shows a scenario schematic diagram of obtaining the number of data processing times and the number of data processing exceptions in the data processing times for each data link in the data link network within a preset time according to an embodiment of the present application.

[0052] exist Figure 4 In the data link network 401, the shared memory can collect the feedback results of each data link in the data link network after each data processing in real time through the front-end interface 402 of the link node in the data link network 401, and report the feedback result data to the data link network monitoring system 404. The data link network monitoring system 404 counts the number of data processing times of each data link within a preset time and the number of data processing exceptions with abnormal feedback results.

[0053] Furthermore, the shared memory 403 may be divided into a plurality of logical data blocks, each logical data block is managed by a message queue, and each message queue manages stored data.

[0054] Furthermore, the feedback result data can be stored in JSON format. The advantage of doing so is that, on the one hand, it is convenient for subsequent demand changes and other service access, so that the detection system and sampling service can be decoupled. On the other hand, it can make the stored feedback result data transparent and pipelined.

[0055] It should be noted that the number of data processing times of each data link within a preset time and the number of abnormal data processing times with abnormal feedback results can also be counted in the shared memory 403 .

[0056] Continue to refer to Figure 2 In step 240, based on the number of data processing times and the number of data processing exceptions, the abnormality ratio of each of the data links is determined.

[0057] In one embodiment of the present application, the abnormal ratio of each of the data links may be determined by the following scheme:

[0058] The ratio between the data processing abnormality times and the data processing times is calculated, and the ratio is used as the abnormality ratio of each of the data links.

[0059] For example, a data link processes 10,000 data items in 10 seconds, of which 10 items are processed with a failure feedback result, that is, the data link processes data 10,000 times in 10 seconds, including 10 abnormal data processing times. Therefore, the abnormality rate of the data link is 0.1%.

[0060] In one embodiment of the present application, the abnormality ratio of each of the data links can also be determined by the corresponding relationship between the number of data processing abnormalities and the abnormality ratio. For example, when the number of data processing abnormalities exceeds 1 time, the abnormality ratio corresponds to 0.01, and when the number of data processing abnormalities exceeds 10 times, the abnormality ratio corresponds to 0.1.

[0061] Continue to refer to Figure 2 In step 260, the data link in the data link network whose abnormal ratio exceeds a preset threshold is determined as an abnormal data link.

[0062] Specifically, for example, there are three data links A, B, and C, among which the abnormality ratios of data link A, data link B, and data link C are 0.1%, 0.5%, and 1.1%, respectively. If the preset threshold of the abnormality ratio is 1%, data link C can be determined as an abnormal data link.

[0063] In the present application, after determining the data link in the data link network whose abnormal ratio exceeds a preset threshold as an abnormal data link, the following step may also be performed: closing the abnormal data link to terminate data processing in the abnormal data link.

[0064] In the present application, multiple preset thresholds for the abnormal ratio may be set. For example, a first preset threshold and a second preset threshold may be set, wherein the second preset threshold is higher than the first preset threshold.

[0065] In a specific implementation, when the abnormal ratio in the data link network exceeds a first preset threshold, the data link is determined as an abnormal data link, and an abnormal alarm is issued for the data link.

[0066] When the abnormal ratio in the data link network exceeds a second preset threshold, the abnormal data link is closed to terminate data processing in the abnormal data link. The following takes the monitoring scenario of the transaction data link network as an example to elaborate on the detailed technical solution of closing the abnormal data link in the technical solution of this application, as well as the detailed technical solution after closing the abnormal data link:

[0067] Specifically, in the monitoring scenario of the transaction data link network, the data link network may include a transaction data link network, the data link may include a transaction data link, and the link nodes in the transaction data link may include a front-end node, a third-party node, a channel node, and a back-end node; wherein the front-end node may be a common node of all transaction data links in the transaction data link network.

[0068] Further, closing the abnormal data link may include closing an abnormal transaction data link.

[0069] In one embodiment of the present application, the closing of the abnormal transaction data link may be performed as follows: Figure 5 Follow the steps shown.

[0070] See also Figure 5 , shows a detailed flow chart of closing an abnormal transaction data link according to an embodiment of the present application, which may specifically include steps 271 to 279:

[0071] Step 271, determining an abnormal link node in the abnormal transaction data link through the position of the abnormal transaction data link in the transaction data link network and the position of the link node in the abnormal transaction data link.

[0072] Step 273, when the abnormal link node is an abnormal front-end node, fuse the abnormal front-end node in the abnormal transaction data link.

[0073] Step 275: When the abnormal link node is an abnormal third-party node, fuse the abnormal third-party node in the abnormal transaction data link.

[0074] Step 277, when the abnormal link node is an abnormal channel node, fuse the abnormal channel node in the abnormal transaction data link.

[0075] Step 279, when the abnormal link node is an abnormal backend node, fuse the abnormal backend node in the abnormal transaction data link.

[0076] In order to enable those skilled in the art to more clearly understand the process of determining the abnormal link node in the abnormal transaction data link, the following will be combined with Figure 6 A brief explanation:

[0077] See also Figure 6 , showing a schematic diagram of a transaction data link network according to an embodiment of the present application.

[0078] exist Figure 6 The transaction data link network shown includes 2n 2 transaction data links, each of which includes a front-end node, a third-party node, a channel node, and a back-end node, and the front-end node serves as a common node for all transaction data links.

[0079] In the actual transaction data processing process, the transaction data to be processed can be input into the front-end node, and the transaction data processing is initiated by the front-end node. The transaction data to be processed is circulated or processed in the front-end node, third-party node, channel node and back-end node of the default transaction data link, and the transaction data processing is finally completed.

[0080] In some cases, abnormal nodes in the transaction data link network will cause the transaction data link where the abnormal node is located to be abnormal, which will cause the transaction data link to fail to process data. For example, when the computer room, line and system in some nodes are abnormal, they will cause node abnormality.

[0081] In a transaction data link network, an abnormal link node in the abnormal transaction data link may be determined according to the position of the abnormal transaction data link in the transaction data link network and the position of the link node in the abnormal transaction data link.

[0082] In a specific implementation of an embodiment, Figure 6 In the transaction data link network shown, when the data link "front-end node - third-party node 1 - channel node 1A - back-end node 1" is abnormal, and the data link "front-end node - third-party node 1 - channel node 1A - back-end node 2" is normal, it means that back-end node 1 may be an abnormal node.

[0083] In a specific implementation of an embodiment, Figure 6 In the transaction data link network shown, when the data link "front-end node - third-party node 1 - channel node 1A - back-end node 1" is abnormal, and the data link "front-end node - third-party node 1 - channel node 1B - back-end node 1" is normal, it means that channel node 1A may be an abnormal node.

[0084] In a specific implementation of an embodiment, Figure 6 In the transaction data link network shown, when the data link "front-end node - third-party node 1 - channel node 1A - back-end node 1" and the data link "front-end node - third-party node 1 - channel node 1B - back-end node 1" are abnormal, and the data link "front-end node - third-party node 2 - channel node 2A - back-end node 1" is normal, it means that the third-party node 1 may be an abnormal node.

[0085] In a specific implementation of an embodiment, Figure 6 In the transaction data link network shown, when all data links are abnormal, it means that the front-end node may be an abnormal node.

[0086] It should be noted that if Figure 6 The transaction data link network shown is only exemplary. In fact, it can be different from Figure 6 Other forms of transaction data link networks are shown.

[0087] In a specific implementation of an embodiment, after the abnormal channel node in the abnormal transaction data link is fuse-broken, the following steps may be performed: Figure 7 Steps shown.

[0088] See also Figure 7 , shows a method flow chart after fusing the abnormal channel node in the abnormal transaction data link according to an embodiment of the present application, specifically including steps 2781 to 2785:

[0089] Step 2781, detect whether there is an available normal channel node in the transaction data link network.

[0090] Step 2783, when there is an available normal channel node in the transaction data link network, the abnormal channel node in the abnormal transaction data link is replaced by the normal channel node.

[0091] Step 2785, when there is no available normal channel node in the transaction data link network, the back-end node in the abnormal transaction data link calls the announcement to notify the front-end node in the abnormal transaction data link of the announcement and suspend data input at the front-end node.

[0092] Specifically, Figure 6 For example, when channel node 1A is determined to be an abnormal node, it is possible to detect whether there is an alternative normal channel node in the transaction data link network, such as channel node 1B. When channel node 1B is available, the data to be processed in the data link "front-end node - third-party node 1 - channel node 1A - back-end node 1" can be transferred to the data link "front-end node - third-party node 1 - channel node 1B - back-end node 1" for processing; when channel node 1B is unavailable, the announcement is retrieved at the back-end node 1, and the announcement is notified to the front-end node 1, and the input of data at the front-end node 1 is suspended.

[0093] In a specific implementation of an embodiment, after pausing the input of data at the front-end node, the following operations may also be performed: Figure 8 Steps shown.

[0094] See also Figure 8 , shows a method flow chart after pausing inputting data at the front-end node according to an embodiment of the present application, specifically including steps 2787 to 2789:

[0095] Step 2787, when the abnormal transaction data link returns to normal, monitor the amount of unprocessed transaction data accumulated in the abnormal transaction data link.

[0096] Step 2789, when the amount of the unprocessed transaction data is lower than a preset threshold, cancel the announcement of the front-end node in the abnormal transaction data link to restore the input data at the front-end node.

[0097] Since the unprocessed data will be accumulated in the abnormal transaction data link after the abnormal transaction data link appears, when the abnormal transaction data link returns to normal, data cannot be directly input into the front-end node in the abnormal transaction data link, but it is necessary to monitor the amount of unprocessed transaction data accumulated in the abnormal transaction data link. Only when the amount of unprocessed transaction data is lower than the preset threshold, the announcement of the front-end node in the abnormal transaction data link can be cancelled and the input of data in the front-end node can be resumed. The advantage of this is to prevent the data processing in the data link from crashing due to excessive data in the data link.

[0098] In one embodiment of the present application, after closing the abnormal transaction data link, the following operations may also be performed: Fig. 9 Steps shown.

[0099] See also Fig. 9 , shows a flow chart of a method after closing an abnormal transaction data link according to an embodiment of the present application, which may specifically include steps 281 to 285:

[0100] Step 281, based on the abnormal occurrence time of the abnormal transaction data link, the abnormal transaction data link is opened at a preset time interval.

[0101] Step 283, inputting transaction data into the abnormal transaction data link to detect whether the abnormal transaction data link has returned to normal.

[0102] Specifically, for example, the abnormal transaction data link has an abnormal occurrence time of 00:00:00 on April 17, 2020. If the preset time interval is 30 seconds, then based on the time 00:00:00 on April 17, 2020, the abnormal transaction data link is opened every 30 seconds (for example, at 00:00:30 on April 17, 2020), and transaction data is input into the abnormal transaction data link to detect whether the abnormal transaction data link has returned to normal. When it is detected that the abnormal transaction data link has not returned to normal, a second detection is continued every 30 seconds, that is, the abnormal transaction data link is opened at 00:01:00 on April 17, 2020.

[0103] It should be noted that the transaction data input in the abnormal transaction data link can be selected as real transaction data, and the detection input is performed according to the logic of data priority sorting.

[0104] Step 285, when it is detected that the abnormal transaction data link returns to normal, the accumulated unprocessed transaction data is input into the transaction data link that returns to normal at a preset flow rate to gradually process the unprocessed transaction data.

[0105] In the present application, when the abnormal transaction data link returns to normal, the backlogged unprocessed transaction data cannot be input all at once, but needs to be input from low to high in a concurrency climbing manner to gradually digest the backlogged transaction data and avoid a one-time concurrency that is too high and causes a crash in data processing in the data link.

[0106] In the technical solutions provided in some embodiments of the present application, by obtaining the number of data processing times of each data link in the data link network within a preset time and the number of data processing anomalies in the data processing times, the abnormality ratio of each data link can be determined, and the data link whose abnormality ratio exceeds a preset threshold is determined as an abnormal data link. Since the technical solutions in the embodiments of the present application use the abnormality ratio as an indicator for judging abnormal data links, and the abnormality ratio can be determined by obtaining the number of data processing times of the data link and the number of data processing anomalies in the data processing times in real time, the technical solutions in the embodiments of the present application can improve the timeliness of monitoring the data link network.

[0107] In the technical solutions provided in some embodiments of the present application, after monitoring abnormal transaction data links in the transaction data link network, the automated processing of abnormal transaction data links in the transaction data link network is ensured through alarms, automatic fuses, announcements, and attempts at automatic recovery of the abnormal transaction data links.

[0108] The following describes an apparatus embodiment of the present application, which can be used to execute the data link network monitoring method in the above-mentioned embodiment of the present application. For details not disclosed in the apparatus embodiment of the present application, please refer to the embodiment of the data link network monitoring method in the above-mentioned embodiment of the present application.

[0109] Fig.10 A block diagram of a monitoring device for a data link network according to an embodiment of the present application is shown.

[0110] Reference Fig.10 As shown, a monitoring device 1000 for a data link network according to an embodiment of the present application includes: an acquisition unit 1001 , a first determination unit 1002 , and a second determination unit 1003 .

[0111] Among them, the acquisition unit 1001 is used to obtain the number of data processing times and the number of data processing exceptions in the data processing times for each data link in the data link network within a preset time; the first determination unit 1002 is used to determine the abnormality ratio of each data link based on the data processing times and the number of data processing exceptions; the second determination unit 1003 is used to determine the data link in the data link network whose abnormality ratio exceeds a preset threshold as an abnormal data link.

[0112] In some embodiments of the present application, based on the aforementioned scheme, the acquisition unit 1001 is configured to: store in real time through shared memory the feedback results of each data link in the data link network after each data processing; and count the number of data processing times of each data link within a preset time and the number of data processing exceptions in which the feedback results are abnormal.

[0113] In some embodiments of the present application, based on the aforementioned scheme, the first determination unit 1002 is configured to: calculate the ratio between the number of data processing exceptions and the number of data processing times, and use the ratio as the abnormality ratio of each of the data links.

[0114] In some embodiments of the present application, based on the aforementioned scheme, the device also includes a closing unit, which is used to close the abnormal data link after determining the data link in the data link network whose abnormal ratio exceeds a preset threshold as an abnormal data link, so as to terminate data processing in the abnormal data link.

[0115] In some embodiments of the present application, based on the aforementioned scheme, the data link network includes a transaction data link network, the data link includes a transaction data link, and the link nodes in the transaction data link include a front-end node, a third-party node, a channel node, and a back-end node; wherein the front-end node is a common node of all transaction data links in the transaction data link network; and the closing unit is configured to: close the abnormal transaction data link.

[0116] In some embodiments of the present application, based on the aforementioned scheme, the closing unit is configured to: determine the abnormal link node in the abnormal transaction data link through the position of the abnormal transaction data link in the transaction data link network and the position of the link node in the abnormal transaction data link; when the abnormal link node is an abnormal front-end node, fuse the abnormal front-end node in the abnormal transaction data link; when the abnormal link node is an abnormal third-party node, fuse the abnormal third-party node in the abnormal transaction data link; when the abnormal link node is an abnormal channel node, fuse the abnormal channel node in the abnormal transaction data link; when the abnormal link node is an abnormal back-end node, fuse the abnormal back-end node in the abnormal transaction data link.

[0117] In some embodiments of the present application, based on the aforementioned scheme, the device also includes a detection unit, which is used to detect whether there is an available normal channel node in the transaction data link network after the abnormal channel node in the abnormal transaction data link is blown; a replacement unit, which is used to replace the abnormal channel node in the abnormal transaction data link with the normal channel node when there is an available normal channel node in the transaction data link network; and a calling unit, which is used to call the announcement at the back-end node in the abnormal transaction data link when there is no available normal channel node in the transaction data link network, so as to notify the front-end node in the abnormal transaction data link of the announcement and suspend data input at the front-end node.

[0118] In some embodiments of the present application, based on the aforementioned scheme, the device also includes a monitoring unit, which is used to monitor the amount of unprocessed transaction data accumulated in the abnormal transaction data link when the abnormal transaction data link returns to normal after pausing the input of data at the front-end node; and a cancellation unit, which is used to cancel the announcement of the front-end node in the abnormal transaction data link when the amount of the unprocessed transaction data is lower than a preset threshold value, so as to resume the input of data at the front-end node.

[0119] In some embodiments of the present application, based on the aforementioned scheme, the device also includes an opening unit, which is used to open the abnormal transaction data link at a preset time interval based on the abnormal occurrence time of the abnormal transaction data link after closing the abnormal transaction data link; a first input unit is used to input transaction data in the abnormal transaction data link to detect whether the abnormal transaction data link has returned to normal; and a second input unit is used to input the accumulated unprocessed transaction data into the restored transaction data link at a preset flow rate when it is detected that the abnormal transaction data link has returned to normal, so as to gradually process the unprocessed transaction data.

[0120] Fig.11 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown.

[0121] It should be noted that Fig.11 The computer system 1100 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0122] like Fig.11 As shown, the computer system 1100 includes a central processing unit (CPU) 1101, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1102 or the program loaded from the storage part 1108 to the random access memory (RAM) 1103, such as executing the method described in the above embodiment. In the RAM 1103, various programs and data required for system operation are also stored. The CPU 1101, the ROM 1102 and the RAM 1103 are connected to each other through the bus 1104. The input / output (I / O) interface 1105 is also connected to the bus 1104.

[0123] The following components are connected to the I / O interface 1105: an input section 1106 including a keyboard, a mouse, etc.; an output section 1107 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1108 including a hard disk, etc.; and a communication section 1109 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 1109 performs communication processing via a network such as the Internet. A drive 1110 is also connected to the I / O interface 1105 as needed. A removable medium 1111, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1110 as needed so that a computer program read therefrom is installed into the storage section 1108 as needed.

[0124] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 1109, and / or installed from a removable medium 1111. When the computer program is executed by a central processing unit (CPU) 1101, various functions defined in the system of the present application are executed.

[0125] It should be noted that the computer-readable medium shown in the embodiment of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CompactDisc Read-Only Memory, CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0126] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0127] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0128] As another aspect, the present application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being assembled into the electronic device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by an electronic device, the electronic device implements the method described in the above embodiment.

[0129] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0130] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation method of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation method of the present application.

[0131] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed in the present application.

[0132] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A method for monitoring a data link network, characterized in that: The data link network includes at least two transaction data links, and the method includes: In the process of transaction data processing, the transaction data to be processed is input into the front-end node, and the transaction data processing is initiated by the front-end node. The transaction data to be processed is circulated or processed in the front-end node, third-party node, channel node and back-end node of the default transaction data link; Acquire feedback results reported by the shared memory, where the feedback results are obtained by real-time collection of feedback results of each transaction data link in the data link network after each data processing by the shared memory through a front-end processor interface of a link node in the data link network; The received feedback results are counted by the data link network monitoring system to obtain the number of data processing times of each transaction data link in the data link network within a preset time and the number of data processing exceptions in the data processing times; the data link network includes a transaction data link network, and the link nodes in the transaction data link include a front-end node, a third-party node, a channel node, and a back-end node; wherein the front-end node is a common node of all transaction data links in the transaction data link network; Determining an abnormality ratio of each of the transaction data links based on the number of data processing times and the number of data processing abnormalities; Determining the transaction data link whose abnormal ratio in the data link network exceeds a preset threshold as an abnormal transaction data link; The abnormal transaction data link is closed in the following manner to terminate data processing in the abnormal transaction data link: Determine an abnormal link node in the abnormal transaction data link according to the position of the abnormal transaction data link in the transaction data link network and the position of the link node in the abnormal transaction data link; When the abnormal link node is an abnormal front-end node, fuse the abnormal front-end node in the abnormal transaction data link; When the abnormal link node is an abnormal third-party node, fuse the abnormal third-party node in the abnormal transaction data link; When the abnormal link node is an abnormal channel node, fuse the abnormal channel node in the abnormal transaction data link; When the abnormal link node is an abnormal backend node, fuse the abnormal backend node in the abnormal transaction data link; After the abnormal channel node in the abnormal transaction data link is fuse-broken, the following steps are performed: Detecting whether there is an available normal channel node in the transaction data link network; When there is an available normal channel node in the transaction data link network, replacing the abnormal channel node in the abnormal transaction data link with the normal channel node; When there is no available normal channel node in the transaction data link network, the back-end node in the abnormal transaction data link retrieves an announcement to notify the front-end node in the abnormal transaction data link of the announcement, and suspends inputting data in the front-end node; Based on the abnormal occurrence time of the abnormal transaction data link, the abnormal transaction data link is opened at a preset time interval; Inputting transaction data into the abnormal transaction data link to detect whether the abnormal transaction data link returns to normal; When the abnormal transaction data link returns to normal, monitoring the amount of unprocessed transaction data accumulated in the abnormal transaction data link; When the amount of the unprocessed transaction data is lower than a preset threshold, canceling the announcement of the front-end node in the abnormal transaction data link to resume inputting data at the front-end node; The accumulated unprocessed transaction data is input into the transaction data link that is restored to normal, and is input from low to high in a concurrent climbing manner to gradually process the unprocessed transaction data.

2. The method according to claim 1, characterized in that The obtaining of the number of data processing times within a preset time and the number of data processing exceptions in the data processing times for each of the transaction data links in the data link network includes: The feedback result of each transaction data link in the data link network after each data processing is stored in real time through a shared memory; The number of data processing times within a preset time and the number of abnormal data processing times in which the feedback results are abnormal are counted for each of the transaction data links.

3. The method according to claim 1, characterized in that The determining, based on the number of data processing times and the number of data processing exceptions, the abnormality ratio of each transaction data link comprises: The ratio between the data processing exception times and the data processing times is calculated, and the ratio is used as the exception ratio of each of the transaction data links.

4. A monitoring device for a data link network, characterized in that: include: The acquisition unit is used to count the received feedback results through the data link network monitoring system to obtain the number of data processing times of each transaction data link in the data link network within a preset time and the number of data processing exceptions in the data processing times; the data link network includes a transaction data link network, and the link nodes in the transaction data link include a front-end node, a third-party node, a channel node, and a back-end node; wherein the front-end node is a common node of all transaction data links in the transaction data link network; in the transaction data processing process, the transaction data to be processed is input into the front-end node, and the transaction data processing is initiated by the front-end node, and the transaction data to be processed is circulated or processed in the front-end node, the third-party node, the channel node, and the back-end node of the default transaction data link; A first determining unit is used to determine an abnormality ratio of each of the transaction data links based on the number of data processing times and the number of data processing abnormalities; A second determining unit is used to determine the transaction data link whose abnormality ratio in the data link network exceeds a preset threshold as an abnormal transaction data link; Shutdown unit, configured as: The abnormal transaction data link is closed in the following manner to terminate data processing in the abnormal transaction data link: Determine an abnormal link node in the abnormal transaction data link according to the position of the abnormal transaction data link in the transaction data link network and the position of the link node in the abnormal transaction data link; When the abnormal link node is an abnormal front-end node, fuse the abnormal front-end node in the abnormal transaction data link; When the abnormal link node is an abnormal third-party node, fuse the abnormal third-party node in the abnormal transaction data link; When the abnormal link node is an abnormal channel node, fuse the abnormal channel node in the abnormal transaction data link; When the abnormal link node is an abnormal backend node, fuse the abnormal backend node in the abnormal transaction data link; Before the received feedback results are counted by the data link network monitoring system, the device is further used to: obtain the feedback results reported by the shared memory, the feedback results are obtained by the shared memory collecting the feedback results of each transaction data link in the data link network after each data processing in real time through the front-end interface of the link node in the data link network; The device also includes: A detection unit, used to detect whether there is an available normal channel node in the transaction data link network after the abnormal channel node in the abnormal transaction data link is fused; A replacement unit, used to replace the abnormal channel node in the abnormal transaction data link with the normal channel node when there is an available normal channel node in the transaction data link network; A calling unit is used to call the announcement at the back-end node in the abnormal transaction data link when there is no available normal channel node in the transaction data link network, so as to notify the front-end node in the abnormal transaction data link of the announcement and suspend data input at the front-end node; An opening unit is used to open the abnormal transaction data link according to a preset time interval based on the abnormal occurrence time of the abnormal transaction data link after closing the abnormal transaction data link; A first input unit is used to input transaction data into the abnormal transaction data link to detect whether the abnormal transaction data link returns to normal; A monitoring unit is used to monitor the amount of unprocessed transaction data accumulated in the abnormal transaction data link when the abnormal transaction data link returns to normal after suspending input of data in the front-end node; a cancelling unit, used to cancel the announcement of the front-end node in the abnormal transaction data link when the amount of the unprocessed transaction data is lower than a preset threshold, so as to resume inputting data at the front-end node; The second input unit is used to input the backlogged unprocessed transaction data into the restored normal transaction data link when it is detected that the abnormal transaction data link has returned to normal, and input from low to high in a concurrent climbing manner to gradually process the unprocessed transaction data.

5. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the data link network monitoring method according to any one of claims 1 to 3 is implemented.

6. An electronic device, characterized in that: include: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the one or more processors to implement the data link network monitoring method as described in any one of claims 1 to 3.

Images