Data processing method, device, storage medium and electronic equipment

By determining the dependencies of the business links and real-time monitoring of the message queues, alarm information is generated, and the problems of high labor costs and inaccurate alarm data in the existing technology are solved, and efficient and accurate business loop monitoring is achieved.

CN113918662BActive Publication Date: 2025-08-19JINGDONG TECH HLDG CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202111198164.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-10-14
Publication Date
2025-08-19
Estimated Expiration
2041-10-14

AI Technical Summary

Technical Problem

Existing business loop monitoring has problems such as high labor costs and low alarm data accuracy, especially in the asynchronous process, which requires intrusive code buried point development and verification, resulting in high maintenance costs and data loss risks.

Method used

By determining the dependencies of the business link, obtaining the target number of messages in the message queue message, and generating alarm information when the preset threshold is reached, monitoring business processes in real time, and reducing intrusive code operations.

Benefits of technology

It improves the accuracy of alarm data, reduces labor costs and maintenance costs, and realizes code-free intrusive business loop monitoring.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113918662B_ABST
    Figure CN113918662B_ABST
Patent Text Reader

Abstract

The present application discloses a data processing method, device, storage medium and electronic device, which determine the business links with dependency relationships in various business links, and the dependency relationship is used to characterize the relationship that the change of one business link in two business links affects the other business link, and obtain the target message number corresponding to the message queue message of the business link with dependency relationship. The target message number is used to indicate the business backlog number in the two business links with dependency relationship. If the target message number is greater than the preset threshold, an alarm message is generated and displayed. Through the above scheme, various business links in the entire business process are monitored in real time. If a business backlog occurs in any business link in the entire business process, a corresponding real-time alarm message is generated to improve the accuracy of the alarm data. In addition, during the monitoring process, there is no need to carry out operations such as point development, testing, online, and verification in each process link, which reduces labor costs and maintenance costs.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and more specifically, to a data processing method, device, storage medium, and electronic device. Background Art

[0002] With the rise of the internet, various products such as cash loans and wealth management have emerged. As businesses continue to iterate and develop, product complexity is increasing. Accurate alarms and business loop monitoring for various asynchronous processes are becoming increasingly important.

[0003] Existing business loop monitoring implementations require each business product line to perform intrusive code tracking at every stage. For example, if 10 nodes on a link need to be monitored, intrusive code programming must be performed on these 10 nodes. This intrusive code programming requires a series of operations, including tracking development, testing, rollout, and verification, at each stage of the process. Due to the high development costs of intrusive code programming, labor costs and maintenance costs are high. Furthermore, business loop monitoring relies on probe-mode method-level monitoring. The underlying architecture of probe-mode method-level monitoring can lead to data loss, resulting in inaccurate data in business loop monitoring and, consequently, inaccurate alarm data generated when business loop monitoring experiences anomalies.

[0004] Therefore, the labor cost and maintenance cost of business loop monitoring on existing asynchronous processes are high, and the accuracy of alarm data generated by business loop monitoring is low. Summary of the Invention

[0005] In view of this, the present application discloses a data processing method, device, storage medium and electronic device, which aim to improve the accuracy of alarm data in the entire business process and reduce labor costs and maintenance costs.

[0006] In order to achieve the above purpose, the disclosed technical solutions are as follows:

[0007] In a first aspect, the present application discloses a data processing method, the method comprising:

[0008] Determine the business links with dependencies among the business links; the dependency relationship is used to represent the relationship between two business links where a change in one business link affects the other business link;

[0009] Obtaining the target message quantity corresponding to the message queue message of the business link having the dependency relationship; the target message quantity is used to indicate the business backlog quantity in the two business links having the dependency relationship;

[0010] If the number of target messages is greater than a preset threshold, a first alarm message is generated and displayed.

[0011] Preferably, after obtaining the target number of messages corresponding to the message queue messages of the business link having the dependency relationship, the method further includes:

[0012] Storing the message queue message in a preset database;

[0013] The process of storing the message queue message in a preset database includes:

[0014] Determine the time dimension corresponding to the message in the message queue;

[0015] The message queue message is stored in a preset database corresponding to the time dimension.

[0016] Preferably, the obtaining of the target number of messages corresponding to the message queue messages of the business link having the dependency relationship includes:

[0017] Querying the preset database to obtain a first message queue message and a second message queue message of two business links having the dependency relationship;

[0018] The target message quantity corresponding to the message queue message of the business link having the dependency relationship is obtained by performing a difference calculation on the second message quantity corresponding to the second message queue message and the first message quantity corresponding to the first message queue message.

[0019] Preferably, it also includes:

[0020] When the first alarm information is received, a processing operation is performed; the processing operation includes at least one or more of a downgrade operation, a locking operation, and an interception operation.

[0021] Preferably, before determining the business links having dependencies among the business links, the method further includes:

[0022] Obtain the message queue messages of each business link.

[0023] Preferably, it also includes:

[0024] Configure the alarm thresholds corresponding to each business link;

[0025] If the number of messages in the message queue of each business link is less than the corresponding alarm threshold, a second alarm message is generated.

[0026] A second aspect of the present application discloses a data processing device, the device comprising:

[0027] A determination unit is used to determine business links with dependency relationships among various business links; the dependency relationship is used to represent the relationship in which a change in one of two business links affects the other business link;

[0028] A first acquiring unit is configured to acquire a target message quantity corresponding to message queue messages of the business link having the dependency relationship; the target message quantity is used to indicate a business backlog quantity in the two business links having the dependency relationship;

[0029] The first generating unit is configured to generate and display a first alarm message if the number of target messages is greater than a preset threshold.

[0030] Preferably, it also includes:

[0031] A storage unit, configured to store the message queue message in a preset database;

[0032] The storage unit includes:

[0033] A determination module, configured to determine a time dimension corresponding to a message in the message queue;

[0034] The storage module is used to store the message queue message in a preset database corresponding to the time dimension.

[0035] A third aspect of the present application discloses a storage medium, which includes stored instructions, wherein when the instructions are executed, the device where the storage medium is located is controlled to execute the data processing method as described in any one of the first aspects.

[0036] The fourth aspect of the present application discloses an electronic device comprising a memory and one or more instructions, wherein the one or more instructions are stored in the memory and configured to be executed by one or more processors to perform the data processing method as described in any one of the first aspects.

[0037] Through the above technical solution, it can be known that the present application discloses a data processing method, device, storage medium and electronic device, which determines the business links with dependent relationships in various business links, and the dependency relationship is used to characterize the relationship that the change of one business link in two business links affects the other business link, and obtains the target message number corresponding to the message queue message of the business link with dependent relationships. The target message number is used to indicate the business backlog number in the two business links with dependent relationships. If the target message number is greater than the preset threshold, an alarm message is generated and displayed. Through the above solution, various business links in the entire business process are monitored in real time. If a business backlog occurs in any business link in the entire business process, corresponding real-time alarm information is generated to improve the accuracy of the alarm data. In addition, during the monitoring process, there is no need to carry out operations such as point development, testing, online, and verification in each process link, which reduces labor costs and maintenance costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are merely embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0039] Figure 1 This is an architectural diagram of a data processing system disclosed in an embodiment of the present application;

[0040] Figure 2 A flowchart of a data processing method disclosed in an embodiment of the present application;

[0041] Figure 3 A schematic diagram of storing message queue messages in a preset database disclosed in an embodiment of the present application;

[0042] Figure 4 A schematic structural diagram of a data processing device disclosed in an embodiment of the present application;

[0043] Figure 5 The figure is a schematic structural diagram of an electronic device disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0044] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0045] In this application, the terms "comprises," "comprising," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

[0046] As can be seen from the background technology, the labor cost and maintenance cost of business loop monitoring on existing asynchronous processes are high, and the accuracy of alarm data generated by business loop monitoring is low.

[0047] In order to solve the above problems, the embodiments of the present application disclose a data processing method, device, storage medium and electronic device to monitor various business links in the entire business process in real time. If a business backlog occurs in any business link in the entire business process, corresponding real-time alarm information is generated to improve the accuracy of the alarm data. In addition, during the monitoring process, there is no need to carry out a series of operations such as point development, testing, online, and verification in each process link, thereby reducing labor costs and maintenance costs. The specific implementation method is illustrated by the following embodiments.

[0048] refer to Figure 1 As shown, it is an architecture diagram of a data processing system (loop monitoring architecture) disclosed in an embodiment of the present application. The data processing system includes a marketing system 11, a trading system 12, an mq1 interface, an mq2 interface, a message middleware 13, a Flink real-time computing platform 14, a Habase database 15, an indicator platform 16, a query display module 17, an alarm monitoring module 18 and a user behavior analysis module 19. Among them, the query methods of the query display module 17 include PC web pages, APPs and charts, and the functions of the alarm monitoring module 18 include analysis function, monitoring function, alarm function, T+N report function and data engine aviator function.

[0049] The marketing system 11, the transaction system 12 and other business systems exchange data with interfaces such as the mq1 interface and the mq2 interface through the message middleware 13.

[0050] Data is used by querying data in modules such as the display module 17, the alarm monitoring module 18 and the user behavior analysis module 19.

[0051] The marketing system 11 is used to provide operational tools and system services for user operations, transaction improvement, and revenue enhancement. When users pay at the cashier, discounts can be given on the principal or interest or other fees generated by the user's payment amount.

[0052] The transaction system 12 is used to provide a series of interface implementations for users to display on the front-end page and implement transaction functions.

[0053] The indicator platform 16 is mainly used for management functions including unified indicator definition, unified indicator caliber, unified data model, etc. Through unified management of indicators, the ambiguity of indicator data is eliminated. At the same time, the rapid application and monitoring and early warning of indicator data can be realized, avoiding data chimney construction and saving company resources.

[0054] The user behavior analysis module 19 is used for analyzing the behavior of users in various links such as user transactions and transaction flows for operation.

[0055] The T+N report function is used for data analysis and decision-making reference for management.

[0056] The data engine aviator function is a high-performance, lightweight expression evaluation engine implemented in Java, mainly used for dynamic evaluation of various expressions.

[0057] The Habase database 15 is used to store message queue messages of each business link.

[0058] HBASE Database 15 is a distributed, column-oriented, open-source database. Its technology is derived from Fay Chang's Google paper, "Bigtable: A Distributed Storage System for Structured Data." Just as Bigtable leverages the distributed data storage provided by the Google File System, HBASE Database 15 provides Bigtable-like capabilities on top of Hadoop. HBASE Database 15 is a subproject of the Apache Hadoop project. Unlike typical relational databases, HBASE Database 15 is suitable for storing unstructured data. Another difference is that HBASE Database 15 is column-based rather than row-based.

[0059] The query display module 17 obtains the number of messages in the first message queue based on the mq1 interface by querying the Habase database 15 ; and obtains the number of messages in the second message queue based on the mq2 interface by querying the Habase database 15 .

[0060] Message Queues (MQ) are a type of "first-in, first-out" data structure in the infrastructure. They are commonly used to address application decoupling, asynchronous messaging, and traffic peak shaving, enabling high-performance, high-availability, scalable, and eventually consistent architectures.

[0061] The data processing system determines the business links with dependency relationships among various business links; the dependency relationship is used to represent the relationship between two business links in which a change in one business link affects the other business link.

[0062] The target number of messages corresponding to the message queue messages of the business links with dependency is obtained through the Flink real-time computing platform 14; the target number of messages is used to indicate the number of business backlogs in the two business links with dependency.

[0063] The Flink real-time computing platform 14 calculates the difference between the second message quantity corresponding to the second message queue message and the first message quantity corresponding to the first message queue message to obtain the target message quantity corresponding to the message queue message of the business link with the dependency relationship.

[0064] The Flink Real-Time Computing Platform 14 is a distributed processing engine for both stream and batch data, primarily written in Java, with some code written in Scala. It can process both bounded batch data sets and unbounded real-time data sets. For Flink, the primary scenario it handles is stream data, with batch data being just an extreme special case of stream data. Therefore, the Flink Real-Time Computing Platform 14 is also a unified stream and batch computing engine. DataFocus is a data indicator management platform that primarily includes management functions such as unified indicator definitions, unified indicator calibers, and unified data models. Through unified indicator management, it eliminates ambiguity in indicator data and enables rapid application, monitoring, and early warning of indicator data, avoiding data silo construction and conserving company resources.

[0065] Resources are limited. To better allocate resources, we need to manage them in a hierarchical manner based on their importance to the e-commerce business, prioritizing high-priority systems. The basic tier definitions are shown in Table 1.

[0066]

[0067]

[0068] Table 1

[0069] If the number of target messages is greater than a preset threshold, a first alarm message is generated and displayed through the alarm monitoring module 17 .

[0070] Among them, the preset threshold can be 100, or 150, etc. The specific preset threshold is determined by technical personnel according to actual conditions, and this application does not make any specific limitations.

[0071] Each alarm threshold corresponding to each business link is configured. If the number of messages in the message queue of each business link is less than the corresponding alarm threshold, the alarm monitoring module 17 generates a second alarm message.

[0072] Among them, the determination of each alarm threshold is set according to the actual situation of each business link, and this application does not make specific restrictions.

[0073] When the alarm information is received, the alarm monitoring module 17 performs an alarm processing operation; the alarm processing operation includes at least one or more of a downgrade operation, a lock operation and an interception operation.

[0074] In the embodiments of this application, various business links in the entire business process are monitored in real time. If any business link in the entire business process encounters a business backlog, corresponding real-time alarm information is generated, thereby improving the accuracy of the alarm data. In addition, during the monitoring process, there is no need to carry out a series of operations such as point development, testing, online launch, and verification at each process link, thus reducing labor costs and maintenance costs.

[0075] refer to Figure 2 FIG. 1 is a flow chart of a data processing method disclosed in an embodiment of the present application, which is applied to the above embodiment. Figure 1 The data processing system mainly includes the following steps:

[0076] S201: Obtain message queue messages of each business link.

[0077] In S201, message queue information sent by each business link in the Structured Query Language (SQL) consumer business system is obtained, that is, MQ messages.

[0078] Message queues are a type of "first-in, first-out" data structure in basic data structures. They are generally used to solve problems such as application decoupling, asynchronous messaging, and traffic peak shaving, achieving high performance, high availability, scalability, and eventual consistency.

[0079] By monitoring the access of various business MQ messages, there is no code intrusion into the SQL consumer business system, and business anomalies can be monitored in real time.

[0080] The various business links include loan application, credit limit deduction, repayment plan generation, capital contribution, and payment on behalf of others.

[0081] The MQ messages generated in each link are consumed through the preset data operation platform and stored in the HBASE database.

[0082] Optionally, the message queue messages are stored in a preset database.

[0083] The process of storing message queue messages in the preset database is as follows:

[0084] First, determine the time dimension corresponding to the message queue message.

[0085] The time dimension may be different time dimensions such as minutes, hours, days, etc.

[0086] Then, the message queue message is stored in the preset database corresponding to the time dimension.

[0087] The preset database can be an HBASE database or other types of databases. The preset database is determined by technical personnel according to actual conditions and is not specifically limited in this application. The preset database of this application is preferably an HBASE database.

[0088] The HABASE database includes a HABASE database with a time dimension of hours, a HABASE database with a time dimension of minutes, and a HABASE database with a time dimension of days.

[0089] For the specific process of storing message queue messages in the preset database, please refer to Figure 3 .

[0090] Figure 3In JIMQ2: it_itloan_success is the entry for successful investment, JIMQ2: it_plan_success is the entry for successful plan generation, xjd_it_d_loan_success is a new table created on the real-time computing platform to store the MQ investment success message, xjd_it_d_plan_success is a new table created on the real-time computing platform to store the MQ installment success message, 326ffc4031b17bc3f45789f6724efd98 is the job for processing the investment success message, 5b87f9d163b79fe0aee4d008cb7f661e is the job for processing the installment success message, aa2104a4621619b597d785cc73290c6a is the job for processing the results of the above two message jobs, xjd_ it_d_plan_success_day is the time dimension in days, xjd_it_d_plan_success_hour is the time dimension in hours, xjd_it_d_plan_success_min is the time dimension in minutes, HABASE:dataservice:data_focus_rt_index_day is the HABASE database with a time dimension of days, HABASE:dataservice:data_focus_rt_index_hours is the HABASE database with a time dimension of hours, and HABASE:dataservice:data_focus_rt_index_min is the HABASE database with a time dimension of minutes.

[0091] To facilitate understanding of the process of processing the investment success message, the installment success message, and the processing of the results of the above two message operations, the following examples are provided:

[0092] For example, 326ffc4031b17bc3f45789f6724efd98 is the processing data for the investment success message operation. The number of MQs consumed at this time is 500; 5b87f9d163b79fe0aee4d008cb7f661e is the processing data for the installment success message operation. The number of MQs consumed at this time is 1000. aa2104a4621619b597d785cc73290c6a is the processed results of the above two operations. 1000 - 500 = 500. The difference of 500 is calculated based on the time dimension.

[0093] Through the JIMQ2: it_itloan_success link and the JIMQ2: it_plan_success link, the job named "Gold Bar Loan Installment Successful_Capital Contribution Successful" is processed, and then according to different time dimensions (xjd_it_d_plan_success_day, xjd_it_d_plan_success_hour, xjd_it_d_plan_success_min), the processed jobs are stored in the HBASE database corresponding to the time dimension (HABASE:dataservice:data_focus_rt_index_day, HABASE:dataservice:data_focus_rt_index_hours, HABASE:dataservice:data_focus_rt_index_min) through the job script.

[0094] To help you understand the details of a job's execution, an example is given here.

[0095] The job running content includes ID1, ID0 and ID2.

[0096] In the ID1 operation, the concurrency is 1, the system throughput (TPS) is 23.20 items / second, the service delay is 50.87s, there is no computing time, the input queue is 0.00%, and the output queue is 2.78%.

[0097] In the ID0 operation, the concurrency is 1, the TPS is 23.07 / second, the service delay is 51.98s, there is no computing time, the input queue is 0.00%, and the output queue is 2.78%.

[0098] In the ID2 operation, the concurrency is 1, the TPS is 11.57 / second, there is no business delay, no computing time, the input queue is 0.00%, and the output queue is 0.00%.

[0099] S202: Determine business links with dependency relationships among the various business links. A dependency relationship is used to represent a relationship in which a change in one of two business links affects the other business link.

[0100] In S202 , there are dependent business links, such as a dependency between a loan application link and a credit limit deduction link, a dependency between a capital contribution link and a payment link, and so on.

[0101] If the capital contribution link is not successful, the payment link cannot be executed. Therefore, there is a dependency relationship between the capital contribution link and the payment link, and the payment link depends on the capital contribution link.

[0102] S203: Obtain the target message quantity corresponding to the message queue messages of the business links with a dependent relationship; the target message quantity is used to indicate the business backlog quantity in the two business links with a dependent relationship.

[0103] In S203 , the number of messages in the message queues of two business links having a dependent relationship is counted, and the number of messages in the message queues of the two business links having a dependent relationship is calculated by difference to obtain the target number of messages.

[0104] The specific process of obtaining the target number of messages corresponding to the message queue messages of the business links with dependencies is as follows:

[0105] First, a preset database is queried to obtain a first message queue message and a second message queue message of two business links having a dependent relationship.

[0106] To facilitate understanding of the process of querying the preset database, an example is given here to illustrate.

[0107] For example, data query functions include indicator code, time granularity, time range, business dimension, upper limit of query items, table name, etc.

[0108] Set the time granularity to minutes, the time range to 2021-05-21 to 2021-05-21 14:59, the upper limit of the number of queries to 50, and the business dimension to all, query the data, and obtain the query results.

[0109] The query results include sequence numbers 1, 2, and 3. The time corresponding to sequence number 1 is 2021-05-21 14:00, the key corresponding to sequence number 1 is 95c4897_R_B_000300_ALL[M]202105211400, and the value corresponding to sequence number 1 is -232. The time corresponding to sequence number 2 is 2021-05-21 14:00, the key corresponding to sequence number 2 is 95c4897_R_B_000300_ALL[M]20210521141, and the value corresponding to sequence number 2 is -236. The time corresponding to sequence number 3 is 2021-05-21 14:00, the key corresponding to sequence number 3 is 95c4897_R_B_000300_ALL[M]202105211402, and the value corresponding to sequence number 3 is -231.

[0110] The data values obtained by querying the HBASE database are displayed in bar charts, fan charts, etc. through different time dimensions.

[0111] After the job is stored in the HBASE database, the HBASE database is queried to obtain the actual value of the business, that is, the business backlog amount in the two business links with a dependent relationship. If the actual value is greater than the preset threshold, an alarm operation is performed.

[0112] Then, a difference calculation is performed between the second message quantity corresponding to the second message queue message and the first message quantity corresponding to the first message queue message to obtain the target message quantity corresponding to the message queue message of the business link with a dependent relationship.

[0113] To facilitate understanding of the process of obtaining the target number of messages corresponding to message queue messages of business links with dependencies, an example is given here to illustrate.

[0114] For example, by querying the HBASE database, the funding link and the payment link that have a dependent relationship are obtained. The number of messages in the first message queue generated by the funding link is 200, and the number of messages in the second message queue generated by the payment link is 300. The target number of messages corresponding to the message queue messages of the funding link and the payment link is the number of messages in the second message queue minus the number of messages in the first message queue, which is 100.

[0115] S204: If the number of target messages is greater than a preset threshold, a first alarm message is generated and displayed.

[0116] In S204, if the number of target messages is greater than the preset threshold, it is determined that the business quantity in the two business links corresponding to the target message quantity is backlogged, and a first alarm message is generated, and the first alarm message is displayed through email, text message, application (APP) information, etc.

[0117] The first alarm information is used to indicate an alarm message generated when the number of target messages is greater than a preset threshold.

[0118] The preset threshold can be 200 or 300. The specific preset threshold is determined by technical personnel based on actual conditions and is not specifically limited in this application.

[0119] The display method can be email, text message, etc., and this application does not make any specific restrictions on the determination of the specific display method.

[0120] This solution monitors the entire business process and provides accurate monitoring and alarms when backlogs occur at each node within the business process.

[0121] When the first alarm information is received, a processing operation is performed; the processing operation includes at least one or more of a downgrade operation, a locking operation, and an interception operation.

[0122] Optionally, each alarm threshold corresponding to each business link is configured, and if the number of messages in the message queue of each business link is less than the corresponding alarm threshold, a second alarm message is generated.

[0123] The second alarm information is used to indicate the alarm information generated when the number of messages in each business link is less than the corresponding alarm threshold.

[0124] The alarm thresholds corresponding to each business link are set by technical personnel based on the actual conditions of each business link, and this application does not make any specific restrictions.

[0125] To facilitate understanding of the process of generating the second alarm information if the number of messages in the message queue of each business link is less than its corresponding alarm threshold, an example is given here to illustrate.

[0126] For example, the number of alarm thresholds configured in the investment link is 100 orders per minute, and the number of message queue messages generated in the investment link is 80 orders per minute, which is less than the configured alarm threshold of 100 orders per minute, and a second alarm message is generated.

[0127] This solution implements business loop monitoring and alarming in a code-free, intrusive manner, saving development and labor costs, timely discovering business anomalies, and reducing production accidents to minimize asset losses and reduce the risk of mass customer complaints.

[0128] In the embodiments of the present application, various business links in the entire business process are monitored in real time. If any business link in the entire business process encounters a business backlog, corresponding real-time alarm information is generated, thereby improving the accuracy of the alarm data. In addition, during the monitoring process, there is no need to carry out operations such as point-of-sale development, testing, online launch, and verification at each process link, thus reducing labor costs and maintenance costs.

[0129] Based on the above embodiment Figure 2 A data processing method disclosed in the present application is also disclosed in the embodiment of the present application. A data processing device is disclosed, such as Figure 4 As shown, the data processing device includes a determining unit 401 , a first acquiring unit 402 and a first generating unit 403 .

[0130] The determining unit 401 is used to determine business links with dependency relationships among various business links. The dependency relationship is used to indicate that a change in one of two business links affects the other business link.

[0131] The first acquisition unit 402 is used to acquire the target message quantity corresponding to the message queue messages of the business links with a dependent relationship; the target message quantity is used to indicate the business backlog quantity in two business links with a dependent relationship.

[0132] The first generating unit 403 is configured to generate and display first alarm information if the number of target messages is greater than a preset threshold.

[0133] Furthermore, a storage unit is also included.

[0134] The storage unit is used to store the message queue messages in a preset database.

[0135] Furthermore, the storage unit includes a determination module and a storage module.

[0136] The determination module is used to determine the time dimension corresponding to the message queue message.

[0137] The storage module is used to store the message queue messages in a preset database corresponding to the time dimension.

[0138] Furthermore, the first acquisition unit 402 includes a query module and a calculation module.

[0139] The query module is used to query a preset database to obtain a first message queue message and a second message queue message of two business links that have a dependent relationship.

[0140] The calculation module is used to calculate the difference between the second message quantity corresponding to the second message queue message and the first message quantity corresponding to the first message queue message to obtain the target message quantity corresponding to the message queue message of the business link with a dependent relationship.

[0141] Furthermore, it also includes an execution unit.

[0142] The execution unit is used to execute a processing operation when receiving the first alarm information; the processing operation includes at least one or more of a downgrade operation, a locking operation and an interception operation.

[0143] Furthermore, a second acquiring unit is also included.

[0144] The second acquiring unit is used to acquire message queue messages of each business link.

[0145] Furthermore, it also includes a configuration unit and a second generation unit.

[0146] The configuration unit is used to configure each alarm threshold corresponding to each business link.

[0147] The second generating unit is configured to generate second alarm information if the number of messages in the message queue of each business link is less than the corresponding alarm threshold.

[0148] In the embodiments of this application, various business links in the entire business process are monitored in real time. If any business link in the entire business process encounters a business backlog, corresponding real-time alarm information is generated, thereby improving the accuracy of the alarm data. In addition, during the monitoring process, there is no need to carry out a series of operations such as point development, testing, online launch, and verification at each process link, thus reducing labor costs and maintenance costs.

[0149] An embodiment of the present application further provides a storage medium, which includes stored instructions, wherein when the instructions are executed, the device where the storage medium is located is controlled to execute the above-mentioned data processing method.

[0150] The present application also provides an electronic device, the structure of which is shown in FIG. Figure 5 As shown, it specifically includes a memory 501 and one or more instructions 502, wherein the one or more instructions 502 are stored in the memory 501 and are configured to be executed by one or more processors 503 to perform the above data processing method.

[0151] The specific implementation processes and derivative methods of the above embodiments are all within the protection scope of the present invention.

[0152] Each embodiment in this specification is described in a progressive manner. The same or similar parts between the embodiments can be referred to each other. Each embodiment focuses on the differences from other embodiments. In particular, for system or system embodiments, since they are basically similar to method embodiments, the description is relatively simple. For relevant parts, refer to the partial description of the method embodiment. The system and system embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without expending creative work.

[0153] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the above description has generally described the components and steps of each example according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present invention.

[0154] The above description of the disclosed embodiments will enable one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention is not limited to the embodiments shown herein, but is to be construed in the widest manner consistent with the principles and novel features disclosed herein.

[0155] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as within the scope of protection of the present invention.

Claims

1. A data processing method, characterized in that: The method comprises: Determine business links with dependencies among the various business links; the dependency relationship is used to indicate that a change in one of the two business links affects the other business link; wherein each business link includes at least a loan application link, a credit limit deduction link, a repayment plan generation link, a capital contribution link, and a payment link; Obtaining the target message quantity corresponding to the message queue message of the business link having the dependency relationship; the target message quantity is used to indicate the business backlog quantity in the two business links having the dependency relationship; If the number of target messages is greater than a preset threshold, a first alarm message is generated and displayed; The obtaining of the target number of messages corresponding to the message queue messages of the business link having the dependency relationship includes: Querying a preset database to obtain a first message queue message and a second message queue message of two business links having the dependency relationship; The target message quantity corresponding to the message queue message of the business link having the dependency relationship is obtained by performing a difference calculation on the second message quantity corresponding to the second message queue message and the first message quantity corresponding to the first message queue message.

2. The method according to claim 1, characterized in that After obtaining the target number of messages corresponding to the message queue messages of the business link having the dependency relationship, the method further includes: Storing the message queue message in a preset database; The process of storing the message queue message in a preset database includes: Determine the time dimension corresponding to the message in the message queue; The message queue message is stored in a preset database corresponding to the time dimension.

3. The method according to claim 1, characterized in that Also includes: When the first alarm information is received, a processing operation is performed; the processing operation includes at least one or more of a downgrade operation, a locking operation, and an interception operation.

4. The method according to claim 1, wherein Before determining the business links with dependencies among the business links, the method further includes: Obtain the message queue messages of each business link.

5. The method according to claim 4, characterized in that Also includes: Configure the alarm thresholds corresponding to each business link; If the number of messages in the message queue of each business link is less than the corresponding alarm threshold, a second alarm message is generated.

6. A data processing device, characterized in that: The device comprises: A determination unit is configured to determine business links in each business link that have a dependency relationship; the dependency relationship is used to indicate that a change in one of the two business links affects the other business link; wherein each business link includes at least a loan application link, a credit limit deduction link, a repayment plan generation link, a capital contribution link, and a payment link; A first acquiring unit is configured to acquire a target message quantity corresponding to message queue messages of the business link having the dependency relationship; the target message quantity is used to indicate a business backlog quantity in the two business links having the dependency relationship; A first generating unit, configured to generate and display a first alarm message if the number of target messages is greater than a preset threshold; The first acquisition unit includes a query module and a calculation module: The query module is used to query a preset database to obtain the first message queue message and the second message queue message of the two business links having the dependency relationship; The calculation module is used to calculate the difference between the second message quantity corresponding to the second message queue message and the first message quantity corresponding to the first message queue message to obtain the target message quantity corresponding to the message queue message of the business link with the dependency relationship.

7. The device according to claim 6, characterized in that Also includes: A storage unit, configured to store the message queue message in a preset database; The storage unit includes: A determination module, configured to determine a time dimension corresponding to a message in the message queue; The storage module is used to store the message queue message in a preset database corresponding to the time dimension.

8. A storage medium, characterized in that: The storage medium includes stored instructions, wherein when the instructions are executed, the device where the storage medium is located is controlled to execute the data processing method according to any one of claims 1 to 5.

9. An electronic device, characterized in that: The device comprises a memory and one or more instructions, wherein the one or more instructions are stored in the memory and configured to cause one or more processors to execute the data processing method according to any one of claims 1 to 5.

Citation Information

Patent Citations

  • Backlog quantity monitoring method and device of message queue, readable medium and electronic equipment

    CN108694107A