Data processing method and device, equipment and storage medium

Abstract

The invention discloses a data processing method and device, equipment and a storage medium. The data processing method is applied to a target system, the target system comprises a central module and a proxy service module, and the method comprises the following steps: receiving business processing information based on the central module, and generating a first session according to the business processing information; based on the central module, a first directed graph is determined according to the session type of the first session, and the first directed graph comprises a plurality of execution nodes arranged in sequence; according to an execution node in the first directed graph, determining an execution instruction corresponding to the execution node, and sending the execution instruction to the message middleware, so as to send the execution instruction to the proxy service module based on the message middleware; and on the basis of the proxy service module, the target feedback data corresponding to the execution instruction is determined, and the target feedback data is fed back to the central module, so that the data processing efficiency and accuracy are improved.

Description

Technical Field

[0001] The present invention relates to the field of data processing technology, and in particular to a data processing method, apparatus, device and storage medium. Background Art

[0002] In the financial industry, each transaction consists of multiple steps, with different types of transactions corresponding to different steps. In each transaction, some steps are dependent on the previous step, while others are independent of each other.

[0003] In the prior art, transactions are typically processed using synchronous invocation and chained asynchronous processing. In the synchronous invocation solution, after the current link is successfully processed, the next link is processed in sequence. In the chained asynchronous processing solution, after the current link is successfully processed, a success message is sent to a buffer queue, and the next node subscribes to this success message and processes it.

[0004] In the prior art, transactions are processed through synchronous calling solutions and chained asynchronous processing solutions, which have the problems of low processing efficiency and low processing accuracy. Summary of the Invention

[0005] The present invention provides a data processing method, apparatus, device and storage medium to improve the efficiency and accuracy of data processing.

[0006] According to one aspect of the present invention, a data processing method is provided, which is applied to a target system, wherein the target system includes a hub module and an agent service module. The method includes:

[0007] Based on the central module, receiving business processing information, and generating a first session according to the business processing information;

[0008] Determining, based on the hub module and according to the session type of the first session, a first directed graph, wherein the first directed graph includes a plurality of sequentially arranged execution nodes;

[0009] Determine, according to the execution node in the first directed graph, an execution instruction corresponding to the execution node, and send the execution instruction to the message middleware, so as to send the execution instruction to the proxy service module based on the message middleware;

[0010] Based on the proxy service module, target feedback data corresponding to the execution instruction is determined, and the target feedback data is fed back to the central module.

[0011] According to another aspect of the present invention, a data processing device is provided, which is applied to a target system. The target system includes a hub module and an agent service module. The device includes:

[0012] A first session generating module is configured to: receive the service processing information based on the central module, and generate a first session according to the service processing information;

[0013] A first directed graph determining module, configured to: determine a first directed graph based on the central module and according to the session type of the first session, wherein the first directed graph includes a plurality of sequentially arranged execution nodes;

[0014] An execution instruction determination module is used to: determine the execution instruction corresponding to the execution node according to the execution node in the first directed graph, and send the execution instruction to the message middleware, so as to send the execution instruction to the proxy service module based on the message middleware;

[0015] The target feedback data determination module is used to: determine the target feedback data corresponding to the execution instruction based on the proxy service module, and feed back the target feedback data to the central module.

[0016] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0017] at least one processor; and

[0018] a memory communicatively connected to at least one processor; wherein,

[0019] The memory stores a computer program that can be executed by at least one processor. The computer program is executed by the at least one processor so that the at least one processor can perform the data processing method of any embodiment of the present invention.

[0020] According to another aspect of the present invention, a computer-readable storage medium is provided. The computer-readable storage medium stores computer instructions, which are used to enable a processor to implement the data processing method of any embodiment of the present invention when executed.

[0021] The technical solution of an embodiment of the present invention is applied to a target system, which includes a central module and a proxy service module. The method receives business processing information through the central module, generates a first session based on the business processing information, and performs subsequent analysis and processing based on the first session; based on the central module, a first directed graph is determined according to the session type of the first session, wherein the first directed graph includes multiple execution nodes arranged in sequence, thereby realizing accurate determination of the first directed graph and providing data support for subsequent analysis and processing; based on the execution nodes in the first directed graph, an execution instruction corresponding to the execution node is determined, and the execution instruction is sent to the message middleware, so as to send the execution instruction to the proxy service module based on the message middleware, thereby realizing the generation and sending of the execution instruction; based on the proxy service module, target feedback data corresponding to the execution instruction is determined, and the target feedback data is fed back to the central module, thereby realizing data processing of financial transactions, solving the problems of low efficiency and low accuracy of data processing of financial transactions in the prior art, and improving the data processing efficiency and accuracy of data processing of financial transactions.

[0022] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present invention, nor is it intended to limit the scope of the present invention. Other features of the present invention will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0024] Figure 1 This is a schematic diagram of the structure of a target system provided by an embodiment of the present invention.

[0025] Figure 2 This is a flow chart of a data processing method provided by the first embodiment of the present invention;

[0026] Figure 3 This is a schematic structural diagram of a hub module provided by an embodiment of the present invention;

[0027] Figure 4 is a schematic structural diagram of a first directed graph provided by an embodiment of the present invention;

[0028] Figure 5 This is a schematic diagram of the structure of a proxy service module provided by an embodiment of the present invention;

[0029] Figure 6 This is a schematic diagram of the structure of a proxy gateway provided by an embodiment of the present invention;

[0030] Figure 7 This is a schematic diagram of a processing flow of a proxy instruction executor provided by an embodiment of the present invention;

[0031] Figure 8 This is a schematic diagram of a processing flow of a detector provided by an embodiment of the present invention;

[0032] Figure 9 is a flow chart of a data processing method provided by Embodiment 2 of the present invention;

[0033] Figure 10 This is a schematic diagram of the structure of a gateway in a hub module provided by an embodiment of the present invention;

[0034] Figure 11 This is a schematic structural diagram of a rollback directed graph provided by an embodiment of the present invention;

[0035] Figure 12 This is a schematic diagram of a processing flow of a command listener provided by an embodiment of the present invention;

[0036] Figure 13 This is a schematic diagram of the structure of a dynamic directed graph provided by an embodiment of the present invention;

[0037] Figure 14 This is a schematic diagram of a processing flow of a scheduler in a hub module provided by an embodiment of the present invention;

[0038] Figure 15 This is a schematic diagram of a processing flow of a command executor in a central module provided by an embodiment of the present invention;

[0039] Figure 16 This is a state recording flow chart of a monitor provided by an embodiment of the present invention;

[0040] Figure 17 is a structural diagram of a data processing device provided by Embodiment 3 of the present invention;

[0041] Figure 18 This is a structural diagram of an electronic device provided in Example 4 of the present invention. DETAILED DESCRIPTION

[0042] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of the present invention.

[0043] It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0044] The data processing method disclosed in the present invention is applied to a target system, which is a component for processing financial transactions. The target system includes a central module and an agent service module. Among them, the central module is used to generate and send execution instructions corresponding to processing financial transactions, and receive instruction execution results (i.e., target feedback data) of the execution instructions. The agent service module receives the execution instructions, processes the execution instructions, obtains the target feedback data of the execution instructions, and sends the target feedback data of the execution instructions to the central module, thereby realizing data processing of financial transactions. The agent service module may include multiple sub-agent service modules, and different sub-agent service modules are used to process different execution instructions.

[0045] For example, see Figure 1 , Figure 1 It is a structural diagram of a target system provided by an embodiment of the present invention. In which, the instruction is an execution instruction, and the instruction execution result is the target feedback data. The target system includes a central module, multiple agent modules, a monitor and a data bus. The central module is used to generate and send execution instructions corresponding to processing financial transactions, and receive target feedback data of execution instructions. The central module can be connected to the agent module through communication, and the multiple agent modules represent multiple sub-agent service modules, which are used to process different instructions and obtain the instruction execution results of the execution instructions. The data bus can be connected to the central module, the agent module and the monitor respectively through communication. The data bus stores the business data required for the execution instructions, the control information corresponding to the execution instructions and the instruction monitoring information. The monitor is used to monitor abnormal instructions and trigger the exception handling mechanism.

[0046] Example 1

[0047] Figure 2This is a flowchart of a data processing method provided in the first embodiment of the present invention. This embodiment is applicable to situations where business data is processed. The method is applied to a target system, which includes a hub module and an agent service module. The method can be executed by a data processing device, which can be implemented in the form of hardware and / or software. The data processing device can be configured in an electronic device provided in an embodiment of the present invention. The electronic device can be a server, a computer, or a mobile terminal, for example, a mobile phone, a tablet computer, etc.

[0048] like Figure 2 As shown, the method includes:

[0049] S110. Based on the central module, receive business processing information and generate a first session according to the business processing information.

[0050] The central module can receive different business processing information and process different financial transaction data at the same time. The central module includes a gateway, an instruction executor, a scheduler and a detector. Based on the central module, the technical solution provided by this embodiment is explained through the gateway, the instruction executor, the scheduler and the detector. For example, see Figure 3 , Figure 3 It is a structural diagram of a central module provided by an embodiment of the present invention. Among them, the central module includes a gateway, an instruction executor, a scheduler and a detector. The session is the first session in the present invention, the directed graph is the first directed graph in the present invention, the instruction is the execution instruction in the present invention, and the instruction execution result is the target feedback data in the present invention. The scheduler determines the directed graph corresponding to the session in the scheduling rule based on the business processing information received by the central module, generates the corresponding execution instruction according to the execution node in the directed graph, and sends the execution instruction to the instruction executor. The instruction executor includes a thread queue, and the execution instructions of different sessions are stored in the ready-made queue. The instruction executor sends the execution instruction through the gateway. The gateway includes a feedback receiving module and an instruction sending module. The instruction sending module is used to store the sent execution instructions, and the feedback receiving module is used to store the received execution instruction results. The detector is used to monitor the execution of the execution instruction. When the detector detects the existence of an abnormal instruction, the exception handling mechanism is started.

[0051] The processing process of the central module generating instructions is as follows: in the process of sending execution instructions through the central module, the scheduler obtains the directed graph corresponding to the session, determines the next execution node in the directed graph according to the control information in the data bus, and the scheduler generates the corresponding execution instruction according to the next execution node and sends it to the instruction executor. The instruction executor determines the session corresponding to the execution instruction according to the execution instruction, stores the execution instruction in the ready-made queue of the session, and the instruction executor sends the execution instruction to the sending instruction module in the gateway. The execution instruction is sent via the sending instruction module in the gateway. The processing process of the central module receiving the instruction execution result is as follows: the receiving feedback module in the gateway receives the instruction execution result and sends the instruction execution result to the instruction executor. The instruction executor determines whether the instruction execution result meets the first preset condition and whether it belongs to the corresponding session. When the instruction execution result meets the preset condition, it generates a task to search the directed graph corresponding to the session. The scheduler generates a to-be-sent instruction based on the sent execution instruction and the directed graph. The scheduler sends the to-be-sent instruction as an execution instruction through the gateway.

[0052] Among them, business processing information is data used to represent financial transactions, and business processing information includes data on various types of financial transactions, requests, and status. The form of business processing information includes but is not limited to financial messages. The central module can receive business processing information through the Application Programming Interface (API). The first session is used to identify the unique identifier of the business processing information, and the first session includes but is not limited to a unique identification code. The first session can be determined based on the business processing information. For example, according to a pre-set first session generation template, the data in the business processing information is filled into the first session generation template to generate the first session corresponding to the business processing information. Different business processing information corresponds to different first sessions.

[0053] Specifically, the central module receives business processing information through the API, fills the data in the business processing information into the first session generation template according to the pre-set first session generation template, generates the first session corresponding to the business processing information, and performs subsequent analysis and processing based on the first session.

[0054] S120. Based on the central module, determine a first directed graph according to the session type of the first session, wherein the first directed graph includes a plurality of sequentially arranged execution nodes.

[0055] Among them, different first sessions have different session types. The session type can be determined based on the first session. For example, a session and session type mapping rule is pre-set, the first session is matched with the above mapping rule, and the matched session type is used as the session type of the first session. The first directed graph is a process execution graph for business processing. The first directed graph includes multiple execution nodes arranged in sequence, and the execution nodes correspond to specific operations of the business processing. In the first directed graph, it can include execution nodes for serial execution, execution nodes for parallel execution, and execution nodes for serial execution and execution nodes for parallel execution. Optionally, the first directed graph includes a forward directed graph and a rollback directed graph. The first directed graph can be determined based on the session type of the first session. For example, according to the pre-set directed graph scheduling rule, the session type of the first session is matched in the directed graph scheduling rule, and the matched directed graph is used as the first directed graph corresponding to the first session.

[0056] Specifically, the central module is pre-set with session and session type mapping rules and directed graph scheduling rules, matches the first session in the session and session type mapping rules, uses the matched session type as the session type of the first session, matches the session type of the first session in the directed graph scheduling rules, and uses the matched directed graph as the first directed graph corresponding to the first session, thereby realizing accurate determination of the first directed graph and providing data support for subsequent analysis and processing.

[0057] For example, see Figure 4 , Figure 4 This is a schematic diagram of the structure of a first directed graph provided by an embodiment of the present invention. The first directed graph includes six execution nodes: transaction reception, transaction generation, authorization processing, credit processing, quota processing, and position processing. Authorization processing, credit processing, and quota processing are parallel execution nodes, while the remaining nodes are serial execution nodes.

[0058] S130. Determine an execution instruction corresponding to the execution node according to the execution node in the first directed graph, and send the execution instruction to the message middleware, so as to send the execution instruction to the proxy service module based on the message middleware.

[0059] Among them, the execution instruction is information used to instruct the proxy service module to execute business processing. Different execution nodes correspond to different execution instructions. The execution instruction can be determined according to the execution node. For example, the central module can parse the execution node and generate the execution instruction corresponding to the execution node. The message middleware is a component that transfers data between the central module and the proxy service module. The message middleware can store the execution instruction generated in the central module in the message middleware, and the message middleware can send the stored execution instruction to the proxy service module. The message middleware and the central module can be connected by communication, and the message middleware and the proxy service module can also be connected by communication. Optionally, the message middleware can be a remote dictionary service (Remote Dictionary Server, Redis).

[0060] Specifically, the central module can parse the execution node, generate the execution instruction corresponding to the execution node, and send the execution instruction corresponding to the execution node to the message middleware through communication. The message middleware sends the execution instruction to the proxy service module, thereby realizing the generation and sending of the execution instruction.

[0061] S140. Based on the proxy service module, determine the target feedback data corresponding to the execution instruction, and feed back the target feedback data to the central module.

[0062] The proxy service module includes a proxy gateway, a proxy instruction executor, and a command listener. The proxy service module receives and processes execution instructions, obtains target feedback data, and transmits this target feedback data back to the central module. The technical solution provided by this embodiment is explained using the proxy service module, the gateway, the proxy instruction executor, and the command listener.

[0063] For example, see Figure 5 , Figure 5This is a structural diagram of a proxy service module provided by an embodiment of the present invention. In which, the proxy module is the proxy service module in the present invention, the instruction is the execution instruction in the present invention, the instruction execution result is the target feedback data in the present invention, session 1 and session 2 are different first sessions, and the session information is the unique identification code corresponding to the first session in the present invention. The proxy gateway is a component in the proxy service module for receiving instructions and sending instruction execution results. The proxy instruction executor is a component in the proxy module for executing received instructions. The instruction listener is used to determine the priority order of the received instructions and give priority to executing instructions with higher priority. The processing process of the proxy module is as follows: the proxy module receives instructions through the proxy gateway, the proxy gateway sends the instruction to the proxy instruction executor, the proxy instruction executor determines the session information corresponding to the instruction based on the received instruction, the proxy instruction executor determines the task of calling the instruction listener based on the control logic, the instruction listener determines the priority of the received instruction based on the pre-set priority rules, and gives priority to executing instructions with higher priority to improve data processing efficiency.

[0064] Specifically, the proxy service module identifies the unique identification code in the execution instruction, determines the target feedback data based on the unique identification code, and feeds the determined target feedback data back to the central module through communication, thereby achieving accurate feedback of the target feedback data and realizing data processing.

[0065] Optionally, the proxy service module includes a proxy gateway.

[0066] The proxy gateway is a component within the proxy service module that receives execution instructions and target feedback data from the message-based middleware. Optionally, the proxy service module includes multiple sub-proxy service modules, each of which processes different execution instructions. Upon receiving an execution instruction, the proxy gateway sends it to the corresponding sub-proxy service module for processing. The proxy service module uses the proxy gateway to accurately transmit execution instructions, thereby improving data processing accuracy.

[0067] For example, see Figure 6 , Figure 6It is a structural diagram of a proxy gateway provided by an embodiment of the present invention. Among them, the instruction is the execution instruction in the present invention, and the instruction execution result is the target feedback data in the present invention. The proxy gateway includes a message queue and multiple sub-proxy gateways, proxy gateway 1 and proxy gateway 2 are different sub-proxy gateways, and any sub-proxy gateway includes a monitoring module, a sending feedback module and a receiving instruction module. Among them, the monitoring module is used to monitor the corresponding instruction queue, and when the monitoring module monitors that there is an execution instruction in the instruction queue, the instruction in the instruction queue is sent to the receiving instruction module in the corresponding sub-proxy module. The message queue includes an instruction execution result queue and an instruction queue to be executed. The instruction execution result queue is used to store the instruction execution results of different instructions, and the instruction queue to be executed is used to store different instructions. Different instructions are stored in different instruction queues to improve the efficiency of data processing. Different proxy gateways are used to receive different instructions. As Figure 6 As shown, proxy gateway 1 is used to receive instruction 1 and send the execution result of instruction 1, while proxy gateway 2 is used to receive instruction 2 and send the execution result of instruction 2. When the monitoring module of the sub-proxy gateway detects that there is an instruction in the corresponding pending instruction queue, the pending instruction queue sends the instruction to the receiving instruction module of the sub-proxy gateway to receive the instruction. When the sending feedback module of the sub-proxy gateway receives the instruction execution result, it sends the instruction execution result to the instruction execution result queue in the message queue.

[0068] Optionally, S140 also includes: obtaining execution instructions from the message middleware based on the proxy gateway; determining the first session corresponding to the execution instruction based on the proxy instruction executor, and determining the target feedback data corresponding to the first session; when feeding back the target feedback data to the central module, storing the target feedback data in the business storage module of the data bus.

[0069] Among them, the proxy instruction executor is a component in the proxy service module, which is used to execute the received instructions and send target feedback data. The execution instruction includes a unique identification code of the first session, and the proxy instruction executor determines the first session corresponding to the execution instruction by identifying the unique identification code. The target feedback data is the data generated after the proxy service module executes the execution instruction delivered by the message middleware, which is used to characterize the execution status of the execution instruction. The target feedback data includes but is not limited to the unique identification code that characterizes the completion of the execution of the execution instruction, the failure of the execution of the execution instruction and the first session. The target feedback data includes at least one of the execution status of the execution instruction and the unique identification code of the first session. The data bus can be connected to the proxy service module through communication. The business storage module is a component in the data bus for storing target feedback data. The data bus is a component in the target system, which is used to store data required for the data processing process and the data generated. Optionally, the data bus can be Kafka.

[0070] Specifically, the proxy gateway obtains the execution instruction in the message middleware through communication, and the proxy instruction executor determines the first session and target feedback data corresponding to the execution instruction by identifying the unique identification code, and feeds back the target feedback data to the central module. At the same time, the proxy instruction executor stores the target feedback data in the business storage module of the data bus through communication, thereby realizing the determination and storage of the target feedback data and providing a data basis for the execution of subsequent execution instructions.

[0071] For example, see Figure 7 , Figure 7 The figure is a schematic diagram of the processing flow of a proxy instruction executor provided by an embodiment of the present invention. The "to-be-executed instruction" is an execution instruction received by the proxy instruction executor in the present invention, and the session information is the first session in the present invention. The processing flow of the proxy instruction executor is as follows: When the proxy instruction executor receives a to-be-executed instruction, the to-be-executed instruction includes a unique identification code for the first session. The first session is determined based on the unique identification code in the to-be-executed instruction. A corresponding to-be-executed task is generated based on the to-be-executed instruction, and a determination is made as to whether the to-be-executed instruction is a rollback instruction. If the to-be-executed instruction is a rollback instruction, the to-be-executed instruction is added to the rollback multi-threaded task queue and a distributed lock for the first session is obtained. If the to-be-executed instruction is not a rollback instruction, the to-be-executed instruction is added to the execution multi-threaded task queue and a distributed lock for the first session is obtained. After obtaining the distributed lock, the instruction listener is called to obtain the instruction execution result. Based on the instruction execution result, the control information in the data bus is updated and recorded. The instruction execution result is sent to the proxy gateway. The proxy gateway sends the instruction execution result to the central module, which releases the distributed lock, completing the execution of the execution instruction.

[0072] In some embodiments of the present invention, the data bus stores the business information required by the proxy service module to execute instructions, control information corresponding to the executed instructions, and instruction monitoring information. The business information, control information, and instruction monitoring information in the data bus can be stored using hash-type key-value pairs. For example, see Table 1, which is a schematic diagram of the storage of various components of information in a data bus, provided in an embodiment of the present invention.

[0073] Table 1 Schematic diagram of storage of each part of information in the data bus

[0074]

[0075]

[0076] Optionally, the central module also includes a detector, and S140 also includes: obtaining instruction monitoring information in the data bus based on the control logic deployed in the detector, wherein the instruction monitoring information includes execution instructions sent to the proxy service module, and associated information of the execution instructions; when it is determined based on the associated information that the instruction monitoring information includes abnormal instructions, retrying the abnormal instructions based on the instruction executor to obtain target feedback data corresponding to the abnormal instructions; wherein, the abnormal instruction is an execution instruction whose processing time reaches a preset time threshold, and the processing time is determined based on the associated information.

[0077] Among them, the detector is a component in the central module that is used to monitor the execution instruction status in real time, identify abnormal instructions and trigger the abnormal response mechanism. The detector is pre-deployed with control logic, and the control logic is a rule for obtaining instruction monitoring information in the data bus. For example, the control logic can be to obtain instruction monitoring information in the data bus according to a preset period. The instruction monitoring information is data for real-time tracking and recording of execution instructions. The instruction monitoring information includes the execution instructions that have been sent to the proxy service module, and the associated information of the execution instructions. The associated information is auxiliary data closely related to the execution instruction, and the associated information includes but is not limited to the sending time and number of sending of the execution instruction. The abnormal instruction is an execution instruction whose processing time reaches a preset time threshold. The preset time threshold can be set according to demand and is not limited here. The processing time can be determined based on the associated information. For example, the associated information includes the sending time of the execution instruction, and the processing time of the execution instruction is calculated based on the current time and the sending time of the execution instruction in the associated information. Abnormal instructions can be identified based on the associated information. For example, the execution time of the execution instruction is calculated based on the current time and the execution instruction's transmission time in the associated information. Instructions with a processing time greater than or equal to a preset duration threshold are considered abnormal instructions. To ensure normal service processing, the instruction executor resends the abnormal instruction to obtain the target feedback data corresponding to the abnormal instruction.

[0078] Specifically, according to the control logic deployed in the detector, the instruction monitoring information in the data bus is obtained according to the preset period, the processing time of the execution instruction is calculated according to the current time and the sending time of the execution instruction in the related information, and the execution instruction with a processing time greater than or equal to the preset time threshold is regarded as an abnormal instruction, and the abnormal instruction is sent to the instruction executor. The instruction executor retries the abnormal instruction to obtain the target feedback data corresponding to the abnormal instruction, thereby realizing the determination and processing of the abnormal instruction, which is conducive to improving the efficiency of data processing.

[0079] For example, see Figure 8 , Figure 8It is a processing flow diagram of a detector provided by an embodiment of the present invention. Among them, the system is the target system in the present invention. The detector can be set to be periodically triggered by the target system, and can also be triggered according to the monitoring instructions of the target system. It can be set according to needs and is not limited here. In the process of data processing, the detector obtains the instruction monitoring information in the data bus, and determines the timeout instruction list according to the sending time of the execution instruction in the instruction monitoring information and the current time. The timeout instruction list stores the timeout instruction. When there is a timeout instruction in the timeout instruction list, the data bus records the number of times the execution instruction in the instruction monitoring information is sent, and sends the timeout instruction through the gateway in the central module.

[0080] Optionally, S140 further includes: when determining the target feedback data, updating the instruction monitoring information in the data bus.

[0081] The instruction monitoring information can be updated based on the target feedback data. For example, in the data bus, the instruction monitoring information corresponding to the execution instruction is determined by the unique identification code in the first session. When the target feedback data indicates that the execution instruction is completed, the instruction monitoring information corresponding to the execution instruction in the data bus is updated to indicate that the execution instruction is completed.

[0082] Specifically, when the proxy instruction executor determines the target feedback data, it searches the data bus through the unique identification code of the first session in the target feedback data, determines the instruction monitoring information corresponding to the unique identification code, and updates the instruction monitoring information to the execution completion of the execution instruction, thereby realizing the update of the instruction monitoring information, which is conducive to ensuring the consistency of the target feedback data and the instruction monitoring information.

[0083] The technical solution of this embodiment receives business processing information through a central module, generates a first session based on the business processing information, and performs subsequent analysis and processing based on the first session; based on the central module, determines a first directed graph according to the session type of the first session, wherein the first directed graph includes a plurality of sequentially arranged execution nodes, thereby realizing accurate determination of the first directed graph and providing data support for subsequent analysis and processing; based on the execution nodes in the first directed graph, determines the execution instructions corresponding to the execution nodes, and sends the execution instructions to the message middleware, so as to send the execution instructions to the proxy service module based on the message middleware, thereby realizing the generation and sending of the execution instructions; based on the proxy service module, determines the target feedback data corresponding to the execution instructions, and feeds back the target feedback data to the central module, thereby realizing data processing of financial transactions and improving the data processing efficiency of financial transactions.

[0084] Example 2

[0085] Figure 9This is a flow chart of a data processing method provided by the second embodiment of the present invention. This embodiment is a refinement of the above embodiment. On the basis of the above embodiment, the determination of the execution instruction is further explained. The specific implementation method can be found in the technical solution of this embodiment. Among them, the technical terms that are the same or corresponding to the above embodiment are not repeated here. Figure 9 As shown, the method includes:

[0086] S210. Based on the central module, receive business processing information and generate a first session according to the business processing information.

[0087] S220. Based on the central module, determine a first directed graph according to the session type of the first session, wherein the first directed graph includes a plurality of sequentially arranged execution nodes.

[0088] S230: Determine an execution instruction corresponding to the execution node according to the execution node in the first directed graph, and send the execution instruction to the message middleware, so as to send the execution instruction to the proxy service module based on the message middleware.

[0089] S240. Based on the proxy service module, determine the target feedback data corresponding to the execution instruction, and feed back the target feedback data to the central module.

[0090] S250. Obtain target feedback data from the data feedback queue of the message middleware based on the gateway in the central module.

[0091] The gateway is a component in the central module used to send execution instructions and receive target feedback data. The data feedback queue is a component in the message middleware used to store target feedback data corresponding to execution instructions.

[0092] Specifically, the target feedback data corresponding to the execution instruction is stored in the data feedback queue of the message middleware. The gateway in the central module obtains the target feedback data from the data feedback queue of the message middleware through communication, thereby realizing the decoupling of the central module and the proxy service module.

[0093] For example, see Figure 10 , Figure 10It is a structural diagram of a gateway in a central module provided by an embodiment of the present invention. The instruction is the execution instruction in the present invention, and the instruction execution result is the target feedback data in the present invention. Among them, the gateway includes a message queue and a central gateway. Among them, the message queue includes an instruction execution result queue and an instruction queue to be executed, the instruction execution result queue is used to store the received instruction execution results, and the instruction queue to be executed is used to store execution instructions, and different instruction queues store different instructions. The central gateway includes a monitoring module, a receiving feedback module and a sending instruction module, wherein the monitoring module is used to monitor the instruction execution result queue, and when there is an instruction execution result in the instruction execution result queue, the instruction execution result queue sends the instruction execution result to the receiving feedback module; the receiving feedback module is used to receive the instruction execution result in the instruction execution result queue; and the sending instruction module is used to send the execution instruction to the corresponding instruction queue in the instruction queue to be executed.

[0094] S260. Based on the instruction executor in the central module, when it is determined that the target feedback data meets the first preset condition and the target feedback data belongs to the first session, a first task is generated, wherein the first task is used to find a first directed graph corresponding to the first session.

[0095] The first preset condition is a condition used to determine whether the target feedback data is consistent with the execution instruction. For example, if the execution instruction is to obtain and display business data for a preset time period, and the target feedback data is business data obtained and displayed for the preset time period, then the target feedback data satisfies the first preset condition. To determine whether the target feedback data belongs to the first session, a unique identification code in the target feedback data can be compared with the unique identification code in the first session. When the unique identification code in the target feedback data and the unique identification code in the first session are consistent, the target feedback data belongs to the first session. The first task is a task for searching the first directed graph corresponding to the first session. The first task can be generated according to the task generation logic in the instruction executor. For example, when the target feedback data meets the first preset condition and the target feedback data belongs to the first session, the first task is generated according to the task generation logic in the instruction executor. The first task includes the unique identification code corresponding to the first session.

[0096] Specifically, the instruction executor in the central module determines whether the target feedback data meets the first preset condition and whether the target feedback data belongs to the first session. When the target feedback data meets the first preset condition and the target feedback data belongs to the first session, the first task is generated according to the task generation logic in the instruction executor, thereby achieving accurate determination of the first task, which is conducive to improving the accuracy of data processing.

[0097] Optionally, S260 also includes: when the target feedback data does not meet the first preset condition, repeatedly executing the execution instruction corresponding to the target feedback data; when the number of repetitions of the execution instruction reaches a preset threshold, obtaining the rollback directed graph corresponding to the first session; based on the rollback directed graph and the control information in the data bus, generating a rollback control instruction to determine the target feedback data based on the rollback control instruction.

[0098] The rollback directed graph is a directed graph used to process logical rollbacks of execution instructions, and the rollback directed graph corresponds to the first directed graph. The rollback directed graph can be determined based on the session type of the first session. For example, based on a pre-set directed graph scheduling rule, the session type of the first session is matched against the directed graph scheduling rule, and the matched directed graph is used as the rollback directed graph corresponding to the first session. The rollback control instruction is control information used to instruct the proxy service module to perform a rollback operation. The control information is a component in the data bus that stores execution information corresponding to the execution instruction. The execution information includes, but is not limited to, not executed, being executed, and executed. The rollback control instruction can be generated based on the rollback directed graph and the control information in the data bus. The rollback control instruction can be generated based on the rollback directed graph and the control information in the data bus. For example, the control information includes an executed execution instruction, and the execution node in the rollback directed graph that needs to be rolled back is determined based on the executed execution instruction and the rollback directed graph, and the rollback control instruction is generated based on the execution node.

[0099] Specifically, by judging whether the target feedback data satisfies a first preset condition, when the target feedback data does not meet the first preset condition, repeatedly executing the execution instruction corresponding to the target feedback data, when the number of repetitions of the execution instruction reaches a preset threshold number, according to the pre-set directed graph scheduling rule, the session type of the first session is matched in the directed graph scheduling rule, and the matched directed graph is used as the rollback directed graph corresponding to the first session, and the execution node that needs to be rolled back in the rollback directed graph is determined according to the executed execution instruction and the rollback directed graph in the control information, and a rollback control instruction is generated according to the execution node to determine the target feedback data based on the rollback control instruction.

[0100] For example, see Figure 11 , Figure 11 The following is a schematic diagram of the structure of a rollback directed graph provided by an embodiment of the present invention. When a position processing instruction fails to execute, rollback instructions corresponding to authorization processing, credit processing, and quota processing are sent respectively; when an authorization processing instruction fails to execute, rollback instructions corresponding to credit processing and quota processing are sent respectively; when a credit processing instruction fails to execute, rollback instructions corresponding to authorization processing and quota processing are sent respectively; when a quota processing instruction fails to execute, rollback instructions corresponding to authorization processing and credit processing are sent respectively.

[0101] In some embodiments of the present invention, the proxy service module includes a command listener that can determine whether the received execution instruction is a forward instruction based on the received execution instruction. If the received execution instruction is a forward instruction, the forward processing logic is executed; if the received execution instruction is not a forward instruction, the rollback processing logic is executed. Whether the execution instruction is successfully executed is determined by updating control information in the data bus.

[0102] For example, see Figure 12 , Figure 12 This is a processing flow diagram of a command listener provided by an embodiment of the present invention. The processing process of the command listener is as follows: when the command listener receives a command, it determines whether the received execution command is a forward command based on the received command information. When the received execution command is a forward command, the forward processing logic is executed; when the received execution command is not a forward command, the rollback processing logic is executed. The received command is executed according to the processing logic. After the command execution is completed, the execution result in the control information of the data bus is updated. The execution result in the control information of the data bus is updated by determining whether the command is executed successfully. When the command is executed successfully, the execution result returned is execution success. When the command execution fails, the execution result returned is execution failure.

[0103] S270 : Based on the instruction executor, when the first directed graph is retrieved based on the first task, a distributed lock of the first session is acquired.

[0104] When the instruction executor simultaneously obtains multiple target feedback data for the same first session, the multiple target feedback data correspond to multiple first tasks, and the multiple first tasks all need to call the same first directed graph. To prevent confusion in the scheduling of the first directed graph, a distributed lock can be deployed in the instruction executor to ensure that only one first task calls the first directed graph in the same first session. The distributed lock can be determined based on the first session, for example, by using the unique identification code corresponding to the first session as the distributed lock for the first session.

[0105] Specifically, the unique identification code corresponding to the first session is used as the distributed lock of the first session. When the first directed graph is retrieved according to the first task, the distributed lock is deployed in the corresponding first task to prevent scheduling confusion in the first directed graph, thereby improving the accuracy of data processing.

[0106] S280. Based on the scheduler in the central module, in response to the event of obtaining the distributed lock, generate a to-be-sent instruction based on the sent execution instruction and the first directed graph.

[0107] The pending instruction is an operation instruction to be executed in the next step, which is generated based on the sent execution instruction and the first directed graph.

[0108] Specifically, when the instruction executor obtains the distributed lock of the first session, the scheduler in the central module determines the next execution node to be executed in the first directed graph based on the execution instruction sent and the first directed graph, and generates a pending instruction based on the next execution node to be executed, thereby achieving accurate determination of the pending instruction and providing a data basis for subsequent analysis and processing.

[0109] Optionally, S280 also includes: based on the data storage module, it is used to store the execution information of the first session, the first directed graph corresponding to the first session, and the executed execution instructions in the data bus, so as to determine the instructions to be generated based on the control information stored in the data bus.

[0110] The data storage module is a component for temporarily storing the first session, the first directed graph corresponding to the first session, and execution information of executed execution instructions. The data storage module and the data bus can be connected via communication. The data storage module stores the first session, the first directed graph corresponding to the first session, and execution information of executed execution instructions in the data bus.

[0111] Specifically, the data storage module temporarily stores the first session, the first directed graph corresponding to the first session, and the execution information of the executed execution instructions. The data storage module stores the first session, the first directed graph corresponding to the first session, and the execution information of the executed execution instructions in the control information in the data bus through communication. The scheduler in the central module can determine the instructions to be generated based on the control information in the data bus, realizes the storage of control information, and provides data support for subsequent analysis and processing.

[0112] In some embodiments of the present invention, the scheduler in the central module generates a dynamic directed graph based on the first directed graph and control information in the data bus in response to the event of acquiring a distributed lock, and generates instructions to be issued based on the dynamic directed graph.

[0113] For example, see Figure 13 , Figure 13 This is a schematic diagram of the structure of a dynamic directed graph provided by an embodiment of the present invention. The first directed graph includes the following: transaction acceptance, transaction generation, authorization processing, and credit granting processing. The next execution node is the execution node corresponding to quota processing, and pending instructions are generated based on the execution node for quota processing.

[0114] S290 . Based on the scheduler, in response to an event that there is an instruction to be sent, send the instruction to be sent as an execution instruction to the message middleware.

[0115] Specifically, when the scheduler generates a to-be-sent instruction, the scheduler sends the to-be-sent instruction to the instruction executor, and the instruction executor sends the to-be-sent instruction as an execution instruction to the message middleware through the gateway, thereby realizing the sending of the to-be-sent instruction.

[0116] For example, see Figure 14 , Figure 14 It is a processing flow diagram of a scheduler in a central module provided by an embodiment of the present invention. Among them, the current session is the first session in the present invention. When the list of pending instructions is generated by the scheduler, the corresponding scheduling rule is determined according to the unique identification code of the current session, the corresponding forward directed graph and rollback directed graph in the scheduling rule are obtained, and the execution directed graph of the first session is constructed according to the control information in the data bus and the first directed graph. Different processing scenarios correspond to different execution directed graphs. The processing scenarios include forward scenarios, rollback scenarios and abnormal scenarios. Among them, the normal scenario is a scenario that is executed in sequence according to the first directed graph. In the normal scenario, the execution instruction that is successfully executed is determined according to the control information in the data bus, and the execution node with an in-degree of 0 in the first directed graph is judged according to the successfully executed execution instruction. The corresponding pending instruction is generated according to the node with an in-degree of 0, and the pending instruction is added to the list of pending instructions to be sent. The pending instruction is sent to the proxy service module through the gateway as an execution instruction.

[0117] The rollback scenario is a scenario corresponding to instruction execution failure and execution timeout. When the instruction execution fails and the execution times out, it is determined whether the number of retries of the instruction exceeds the preset number of retries. When the number of retries of the instruction does not exceed the preset number of retries, the instruction is added to the list of instructions to be sent, and the instruction is sent through the gateway in the central module. When the number of retries of the instruction exceeds the preset number of retries, the control information and the rollback directed graph in the data bus are obtained, and the execution nodes that need to be rolled back in the rollback directed graph are determined based on the executed execution instructions and the rollback directed graph in the control information. A rollback instruction is generated for the execution nodes that need to be rolled back, and the generated rollback instruction is added to the list of instructions to be sent, and the rollback instruction is sent through the gateway in the central module.

[0118] The abnormal scenario is when a rollback instruction fails to execute. When a rollback instruction fails, a determination is made as to whether the number of retries for the failed rollback instruction exceeds the preset number of retries. If the number of retries for the rollback instruction does not exceed the preset number of retries, the rollback instruction is added to the list of pending instructions and sent via the gateway in the central module. If the number of retries for the rollback instruction exceeds the preset number of retries, an abnormality alert is issued for the rollback instruction to ensure efficient data processing.

[0119] For example, see Figure 15 , Figure 15This is a schematic diagram of the processing flow of an instruction executor in a central module provided by an embodiment of the present invention. Among them, the instruction execution result is the target feedback result, the session information is the first session, the session ID is the unique identification code corresponding to the first session, the task to be executed is the first task, and the instruction to be sent is the instruction to be sent. When the instruction executor receives the instruction execution result, it determines the session information according to the session ID carried by the instruction execution result, determines the task to be executed according to the session information, adds the task to be executed to the multi-threaded task queue, and the multi-threaded task queue is in the instruction executor, which is used to store the tasks to be executed corresponding to different sessions, obtains the current session ID, and uses the session ID as the distributed lock of the current session. When the distributed lock is successfully acquired, the instruction information is recorded by the monitor of the target system, and at the same time, a list of instructions to be sent is generated by the scheduler. When there is an instruction to be sent in the list of instructions to be sent, the sending time of the instruction is recorded, and the control information stored in the data bus is stored. When there is no instruction to be sent in the list of instructions to be sent, the distributed lock is released, and this scheduling is completed, that is, the data processing of the current session is completed.

[0120] In some embodiments of the present invention, the monitor is further configured to record and view the execution status, as well as record, view, and process failed financial transactions. For example, the monitor can obtain control information from the data bus through communication to obtain the execution status of the execution instruction, including but not limited to sent, executing, completed, and failed. Based on the execution status of the execution instruction, the monitor can record the status of the financial transaction, including but not limited to executing and completed. For another example, the monitor can view the status of the processed financial transaction, including but not limited to normal progress, completed, and failed. The monitor can also view the execution status of the corresponding execution instruction and the progress of the process instructions during the processing of the financial transaction. For another example, a failed financial transaction is assigned a corresponding error code. Based on a pre-set error code-failure type-action guideline comparison table, the error code is matched against the failure type comparison table. The matching action guide is used as the action guide for the failed financial transaction, and the failed financial transaction is processed according to the action guide, thereby improving data processing efficiency. For another example, the monitor can process failed financial transactions, including but not limited to instruction retry and process retry. The process is not rolled back during the instruction retry. During the process retry, a new process is created to process the financial transaction data. At the same time, the old process is treated as a historical process and associated with the new process to provide data support for subsequent maintenance.

[0121] For example, see Figure 16 , Figure 16This is a state recording flow chart of a monitor provided by an embodiment of the present invention. For any first session, when there is at least one abnormal instruction, it indicates that there is an abnormality in the entire process of the first session.

[0122] The technical solution of this embodiment receives business processing information through the central module, generates a first session based on the business processing information, and performs subsequent analysis and processing based on the first session; based on the central module, determines a first directed graph based on the session type of the first session, wherein the first directed graph includes a plurality of sequentially arranged execution nodes, thereby realizing accurate determination of the first directed graph and providing data support for subsequent analysis and processing; based on the execution nodes in the first directed graph, determines the execution instructions corresponding to the execution nodes, and sends the execution instructions to the message middleware, so as to send the execution instructions to the proxy service module based on the message middleware, thereby realizing generation and sending of the execution instructions; based on the proxy service module, determines the target feedback data corresponding to the execution instructions, and feeds back the target feedback data to the central module, thereby realizing data processing of financial transactions; based on the gateway in the central module, obtains the target feedback data from the data feedback queue of the message middleware, thereby realizing decoupling of the central module and the proxy service module; based on the instruction executor in the central module, When it is determined that the target feedback data meets the first preset condition and the target feedback data belongs to the first session, a first task is generated, wherein the first task is used to find the first directed graph corresponding to the first session, thereby realizing the precise determination of the first task, which is conducive to improving the accuracy of data processing; based on the instruction executor, when the first directed graph is retrieved based on the first task, the distributed lock of the first session is obtained to prevent the scheduling confusion of the first directed graph, which is conducive to improving the accuracy of data processing; based on the scheduler in the central module, in response to the event of obtaining the distributed lock, based on the sent execution instruction and the first directed graph, a to-be-sent instruction is generated, thereby realizing the precise determination of the to-be-sent instruction, and providing a data basis for subsequent analysis and processing; based on the scheduler, in response to the event of the existence of the to-be-sent instruction, the to-be-sent instruction is sent to the message middleware as an execution instruction, thereby realizing the sending of the to-be-sent instruction, solving the problems of low data processing efficiency and low accuracy of financial transactions in the prior art, and improving the data processing efficiency and accuracy of financial transactions.

[0123] Example 3

[0124] Figure 17 This is a structural diagram of a data processing device provided by the third embodiment of the present invention. Figure 17 As shown, the device includes:

[0125] The first session generating module 310 is configured to: receive the service processing information based on the central module, and generate a first session according to the service processing information;

[0126] A first directed graph determining module 320 is configured to: determine a first directed graph based on the central module and according to the session type of the first session, wherein the first directed graph includes a plurality of sequentially arranged execution nodes;

[0127] An execution instruction determination module 330 is configured to: determine, based on the execution nodes in the first directed graph, an execution instruction corresponding to the execution node, and send the execution instruction to the message middleware, so that the execution instruction is sent to the proxy service module based on the message middleware;

[0128] The target feedback data determination module 340 is used to: determine the target feedback data corresponding to the execution instruction based on the proxy service module, and feed back the target feedback data to the central module.

[0129] The technical solution of this embodiment is applied to a target system, which includes a central module and a proxy service module. The method receives business processing information through the central module, generates a first session based on the business processing information, and performs subsequent analysis and processing based on the first session; based on the central module, a first directed graph is determined according to the session type of the first session, wherein the first directed graph includes a plurality of sequentially arranged execution nodes, thereby realizing accurate determination of the first directed graph and providing data support for subsequent analysis and processing; based on the execution nodes in the first directed graph, an execution instruction corresponding to the execution node is determined, and the execution instruction is sent to the message middleware, so as to send the execution instruction to the proxy service module based on the message middleware, thereby realizing generation and sending of the execution instruction; based on the proxy service module, target feedback data corresponding to the execution instruction is determined, and the target feedback data is fed back to the central module, thereby realizing data processing of financial transactions, solving the problems of low efficiency and low accuracy of data processing of financial transactions in the prior art, and improving the data processing efficiency and accuracy of data processing of financial transactions.

[0130] Based on the above embodiment, optionally, the central module includes an instruction executor.

[0131] Optionally, the device also includes an execution instruction determination module, which is used to: obtain target feedback data from the data feedback queue of the message middleware based on the gateway in the central module; based on the instruction executor in the central module, when it is determined that the target feedback data meets the first preset condition and the target feedback data belongs to the first session, generate a first task, wherein the first task is used to find the first directed graph corresponding to the first session; based on the instruction executor, when the first directed graph is retrieved based on the first task, obtain the distributed lock of the first session; based on the scheduler in the central module, in response to the event of obtaining the distributed lock, generate a to-be-sent instruction based on the sent execution instruction and the first directed graph; based on the scheduler, in response to the event of the existence of the to-be-sent instruction, send the to-be-sent instruction as an execution instruction to the message middleware.

[0132] Optionally, the device also includes a module for determining instructions to be generated, which is used to: based on the data storage module, store the first session, the first directed graph corresponding to the first session, and the execution information of the executed execution instructions in the data bus, so as to determine the instructions to be generated based on the control information stored in the data bus.

[0133] Optionally, the execution instruction determination module is also used to: when the target feedback data does not meet the first preset condition, repeatedly execute the execution instruction corresponding to the target feedback data; when the number of repetitions of the execution instruction reaches a preset threshold, obtain the rollback directed graph corresponding to the first session; based on the rollback directed graph and the control information in the data bus, generate a rollback control instruction to determine the target feedback data based on the rollback control instruction.

[0134] Optionally, the central module also includes a detector.

[0135] Optionally, the device also includes an abnormal instruction retry module, which is used to: obtain instruction monitoring information in the data bus based on the control logic deployed in the detector, wherein the instruction monitoring information includes execution instructions that have been sent to the proxy service module, and associated information of the execution instructions; when it is determined based on the associated information that the instruction monitoring information includes abnormal instructions, retry the abnormal instructions based on the instruction executor to obtain target feedback data corresponding to the abnormal instructions; wherein the abnormal instruction is an execution instruction whose processing time reaches a preset time threshold, and the processing time is determined based on the associated information.

[0136] Optionally, the proxy service module includes a proxy gateway.

[0137] Optionally, the device also includes a target feedback data storage module, which is used to: obtain execution instructions from the message middleware based on the proxy gateway; determine the first session corresponding to the execution instruction based on the proxy instruction executor, and determine the target feedback data corresponding to the first session; when feeding back the target feedback data to the central module, store the target feedback data in the business storage module of the data bus.

[0138] Optionally, the target feedback data storage module is further used to: update the instruction monitoring information in the data bus when determining the target feedback data.

[0139] The data processing device provided by the embodiment of the present invention can execute the data processing method provided by any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0140] Example 4

[0141] Figure 181 is a structural diagram of an electronic device provided in Embodiment 4 of the present invention. The electronic device 10 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0142] like Figure 18 As shown, the electronic device 10 includes at least one processor 11 and a memory, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., which is communicatively connected to the at least one processor 11. The memory stores a computer program that can be executed by the at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. Various programs and data required for the operation of the electronic device 10 can also be stored in the random access memory (RAM) 13. The processor 11, the read-only memory (ROM) 12, and the random access memory (RAM) 13 are connected to each other via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0143] Various components in the electronic device 10 are connected to an input / output (I / O) interface 15, including an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0144] The processor 11 may be any general-purpose and / or specialized processing component with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors that run machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the data processing method.

[0145] In some embodiments, the data processing method may be implemented as a computer program that is tangibly contained in a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the read-only memory (ROM) 12 and / or the communication unit 19. When the computer program is loaded into the random access memory (RAM) 13 and executed by the processor 11, one or more steps of the data processing method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the data processing method in any other appropriate manner (e.g., by means of firmware).

[0146] Various embodiments of the systems and techniques described above can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0147] Computer programs for implementing the data processing methods of the present invention can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0148] Example 5

[0149] Embodiment 5 of the present invention further provides a computer-readable storage medium storing computer instructions, the computer instructions being used to cause a processor to execute a data processing method, which is applied to a target system including a hub module and an agent service module. The method includes:

[0150] Based on the central module, business processing information is received, and a first session is generated according to the business processing information; based on the central module, a first directed graph is determined according to the session type of the first session, wherein the first directed graph includes a plurality of sequentially arranged execution nodes; based on the execution nodes in the first directed graph, an execution instruction corresponding to the execution node is determined, and the execution instruction is sent to the message middleware, so as to send the execution instruction to the proxy service module based on the message middleware; based on the proxy service module, target feedback data corresponding to the execution instruction is determined, and the target feedback data is fed back to the central module.

[0151] In the context of the present invention, computer-readable storage media can be tangible media that can contain or store a computer program for use with an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. Computer-readable storage media can include but are not limited to electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, computer-readable storage media can be machine-readable signal media. More specific examples of machine-readable storage media can include electrical connections based on one or more lines, portable computer disks, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), optical fibers, portable compact disk read-only memories (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0152] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0153] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0154] A computing system may include clients and servers. The clients and servers are typically remote from each other and typically interact via a communication network. This client-server relationship arises through computer programs running on the respective computers, creating a client-server relationship. The server may be a cloud server, also known as a cloud computing server or cloud host. This server is a hosting product within the cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosting and VPS services.

[0155] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in the present invention can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of the present invention can be achieved. This is not limited herein.

[0156] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.

Claims

1. A data processing method, characterized in that: Applied in a target system, the target system includes a hub module and an agent service module, and the method includes: Based on the central module, receiving business processing information, and generating a first session according to the business processing information; Determining, based on the central module and according to the session type of the first session, a first directed graph, wherein the first directed graph includes a plurality of sequentially arranged execution nodes; Determining, according to the execution nodes in the first directed graph, an execution instruction corresponding to the execution node, and sending the execution instruction to the message middleware, so as to send the execution instruction to the proxy service module based on the message middleware; Based on the proxy service module, target feedback data corresponding to the execution instruction is determined, and the target feedback data is fed back to the central module.

2. The method according to claim 1, characterized in that The hub module includes an instruction executor, and the method further includes: Obtaining the target feedback data from the data feedback queue of the message middleware based on the gateway in the central module; Based on the instruction executor in the central module, when it is determined that the target feedback data meets a first preset condition and the target feedback data belongs to the first session, a first task is generated, wherein the first task is used to find a first directed graph corresponding to the first session; Based on the instruction executor, when the first directed graph is retrieved based on the first task, acquiring a distributed lock of the first session; Based on the scheduler in the hub module, in response to the event that the distributed lock has been acquired, generating a to-be-sent instruction based on the sent execution instruction and the first directed graph; Based on the scheduler, in response to the event that the instruction to be sent exists, the instruction to be sent is sent as an execution instruction to the message middleware.

3. The method according to claim 1 or 2, characterized in that The method further comprises: Based on the data storage module, it is used to store the execution information of the first session, the first directed graph corresponding to the first session, and the executed execution information of the executed execution instruction in the data bus, so as to determine the instruction to be generated based on the control information stored in the data bus.

4. The method according to claim 2, characterized in that The method further comprises: When the target feedback data does not meet the first preset condition, repeatedly executing the execution instruction corresponding to the target feedback data; When the number of repetitions of executing the instruction reaches a preset number threshold, obtaining a rollback directed graph corresponding to the first session; A rollback control instruction is generated based on the rollback directed graph and the control information in the data bus, so as to determine target feedback data based on the rollback control instruction.

5. The method according to claim 1, wherein The hub module further includes a detector, and the method further includes: Acquiring instruction monitoring information in a data bus based on the control logic deployed in the detector, wherein the instruction monitoring information includes an execution instruction sent to the proxy service module and associated information of the execution instruction; When it is determined according to the association information that the instruction monitoring information includes an abnormal instruction, retrying the abnormal instruction based on the instruction executor to obtain target feedback data corresponding to the abnormal instruction; The abnormal instruction is an execution instruction whose processing time reaches a preset time threshold, and the processing time is determined based on the associated information.

6. The method according to claim 5, characterized in that The proxy service module includes a proxy gateway, and the method further includes: Obtaining an execution instruction from the message middleware based on the proxy gateway; determining, based on the proxy instruction executor, a first session corresponding to the execution instruction, and determining target feedback data corresponding to the first session; When the target feedback data is fed back to the central module, the target feedback data is stored in the service storage module of the data bus.

7. The method according to claim 6, characterized in that The method further comprises: When the target feedback data is determined, the instruction monitoring information in the data bus is updated.

8. A data processing device, characterized in that: Applied in a target system, the target system includes a hub module and an agent service module, including: A first session generating module, configured to: receive business processing information based on the central module, and generate a first session according to the business processing information; a first directed graph determining module, configured to: determine, based on the hub module and according to the session type of the first session, a first directed graph, wherein the first directed graph includes a plurality of sequentially arranged execution nodes; an execution instruction determination module, configured to: determine, based on the execution nodes in the first directed graph, an execution instruction corresponding to the execution node, and send the execution instruction to the message middleware, so as to send the execution instruction to the proxy service module based on the message middleware; The target feedback data determination module is used to: determine the target feedback data corresponding to the execution instruction based on the proxy service module, and feed back the target feedback data to the central module.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program that can be executed by the at least one processor. The computer program is executed by the at least one processor to enable the at least one processor to perform the data processing method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the data processing method according to any one of claims 1 to 7 when executed.

Images