Business processing method, apparatus, device, and storage medium

Abstract

This application provides a service processing method, apparatus, device, and storage medium, relating to the field of communication technology, to solve the problem of low response efficiency to service requests. The method includes: acquiring a target request message, which instructs the execution of a target service based on target configuration information, where the target configuration information is the configuration information of a target data source, and the target data source is the data source of the target service. If first execution information for the target service exists among multiple stored service execution information, the first execution information is acquired, and modified according to the target configuration information to generate second execution information, wherein the first and second execution information contain identical information. Based on the second execution information, the target data source is executed.

Description

Technical Field

[0001] This application relates to the field of communication technology, and in particular to a service processing method, apparatus, device and storage medium. Background Technology

[0002] In recent years, with the development of communication technology, interactions between devices have become more frequent, and the demand for business processing between devices has also increased. For example, servers provide business services to terminals through streaming engines (such as Flink).

[0003] Currently, in the process of a server providing business services to a terminal via Flink, the server needs to receive business request messages from the terminal and create corresponding runtime information for each message based on Flink. Then, the server runs Flink based on this runtime information, obtains the results, and sends them back to the terminal. However, in this technical solution, there may be some identical information between the runtime information corresponding to different business request messages. This causes the server to repeatedly create some information during the creation of multiple runtime information sets, reducing the response efficiency to business requests. Summary of the Invention

[0004] This application provides a business processing method, apparatus, device, and storage medium to solve the problem of low response efficiency to business requests.

[0005] To achieve the above objectives, this application adopts the following technical solution:

[0006] Firstly, this application provides a service processing method, comprising: a service processing device acquiring a target request message, the target request message being used to instruct the execution of a target service based on target configuration information, the target configuration information being configuration information of a target data source, and the target data source being the data source of the target service. If a first execution information of the target service exists among multiple stored service execution information, the service processing device acquires the first execution information and, according to the target configuration information, modifies the first execution information to generate second execution information, wherein the first execution information and the second execution information contain identical information. The service processing device executes the target data source based on the second execution information.

[0007] The technical solution provided in this application offers at least the following advantages: The service processing device can obtain a target request message, which instructs the execution of a target service based on target configuration information. The target configuration information is the configuration information of the target data source, and the target data source is the data source of the target service. Next, the service processing device can determine whether first execution information for the target service exists among multiple stored service execution information. If first execution information for the target service exists, the device obtains the first execution information, modifies it according to the target configuration information, and generates second execution information. Then, the service processing device can execute the target data source based on the second execution information. In other words, the service processing device can modify the execution information of an existing data source according to the content of the service request to generate the execution information required for the service request. This avoids the repeated creation of some identical information during the creation of multiple execution information sets, improving the response efficiency to service requests.

[0008] Optionally, the target data source corresponds to multiple preset computing engines, and the second operational information includes: an identifier of at least one first computing engine. The method described above, in which the "business processing device runs the target data source based on the second operational information," includes: the business processing device determining at least one first computing engine from multiple preset computing engines based on the identifier of at least one first computing engine; and the business processing device running each first computing engine based on the second operational information.

[0009] Optionally, the method of "the business processing device running at least one first computing engine based on second operating information" includes: for each first computing engine, the business processing device runs each first computing engine according to a first operation, the first operation including: the business processing device determining whether there is a checkpoint for a second computing engine among a plurality of stored historical checkpoints, where the historical checkpoints are nodes of a preset computing engine during operation, and the second computing engine is any one of at least one first computing engine. If there is a checkpoint for a second computing engine among the plurality of stored historical checkpoints, the business processing device obtains the checkpoint for the second computing engine from the plurality of stored historical checkpoints, and runs the second computing engine based on the second operating information and the checkpoint for the second computing engine. If there is no checkpoint for a second computing engine among the plurality of stored historical checkpoints, the business processing device runs the second computing engine based on the second operating information.

[0010] Optionally, the target request message includes a target identity identifier. The method further includes: the service processing device obtaining a list of target services to be accessed, the list of target services to be accessed including multiple identity identifiers allowed to access the target services. If a target identity identifier exists in the list of target services to be accessed, the service processing device determines whether first operation information of the target service exists among the multiple stored service operation information.

[0011] Optionally, the target request message further includes: an identifier of the target service. The method further includes: the service processing device determining, based on the identifier of the target service, whether a target data source exists among a plurality of stored data sources. If a target data source exists among the plurality of stored data sources, the service processing device determines whether first operation information of the target service exists among a plurality of stored service operation information. If a target data source does not exist among the plurality of stored data sources, the service processing device obtains the target data source and creates second operation information based on the target configuration information.

[0012] Secondly, this application provides a business processing apparatus, which includes an acquisition module and a processing module.

[0013] The acquisition module is used to acquire a target request message, which instructs the execution of a target service based on target configuration information. The target configuration information is the configuration information of the target data source, and the target data source is the data source of the target service. The acquisition module is also used to acquire the first execution information of the target service if it exists among multiple stored service execution information. The processing module is used to modify the first execution information and generate second execution information based on the target configuration information. The first and second execution information contain identical information. The processing module is also used to execute the target data source based on the second execution information.

[0014] Optionally, the target data source corresponds to multiple preset computing engines, and the second runtime information includes: an identifier of at least one first computing engine. The processing module is specifically configured to determine at least one first computing engine from the multiple preset computing engines based on the identifier of the at least one first computing engine. The processing module is also configured to run each first computing engine based on the second runtime information.

[0015] Optionally, the processing module is specifically used to run each first computing engine according to a first operation for each first computing engine. The first operation includes: determining whether a checkpoint for a second computing engine exists among a plurality of stored historical checkpoints, where the historical checkpoints are nodes in the operation of a preset computing engine, and the second computing engine is any one of at least one first computing engine. If a checkpoint for a second computing engine exists among the plurality of stored historical checkpoints, then the checkpoint for the second computing engine is obtained from the plurality of stored historical checkpoints, and the second computing engine is run based on the second operation information and the checkpoint for the second computing engine. If a checkpoint for a second computing engine does not exist among the plurality of stored historical checkpoints, then the second computing engine is run based on the second operation information.

[0016] Optionally, the target request message includes a target identity identifier. The acquisition module is further configured to acquire a list of targets to be accessed, which includes multiple identity identifiers allowed to access the target service. The processing module is further configured to, if the target identity identifier exists in the list of targets to be accessed, determine whether the first operational information of the target service exists among the stored multiple operational information entries.

[0017] Optionally, the target request message may also include: an identifier of the target service. The processing module is further configured to determine, based on the identifier of the target service, whether a target data source exists among the stored multiple data sources. The processing module is further configured to, if a target data source exists among the stored multiple data sources, determine whether first operational information for the target service exists among the stored multiple operational information. The processing module is further configured to, if a target data source does not exist among the stored multiple data sources, obtain the target data source and create second operational information based on the target configuration information.

[0018] Thirdly, this application provides a business processing device, which includes a processor and a memory coupled together. The memory is used to store one or more programs, which include computer-executable instructions. When the business processing device is running, the processor executes the computer-executable instructions stored in the memory to implement any of the optional business processing methods described in the first aspect above.

[0019] Fourthly, this application provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform any of the optional business processing methods described in the first aspect above.

[0020] Fifthly, this application provides a computer program product applied to a server. The computer program product includes computer instructions, which, when executed on the server, enable the server to implement any of the optional business processing methods described in the first aspect above.

[0021] The technical problems that the business processing device, equipment, computer storage medium or computer program product can solve and the technical effects it can achieve can be found in the technical problems and effects solved in the first aspect above, and will not be repeated here. Attached Figure Description

[0022] Figure 1 A schematic diagram of a communication system provided in an embodiment of this application;

[0023] Figure 2 A flowchart illustrating a business processing method provided in an embodiment of this application;

[0024] Figure 3 A flowchart illustrating another business processing method provided in an embodiment of this application;

[0025] Figure 4 A flowchart illustrating another business processing method provided in an embodiment of this application;

[0026] Figure 5 A flowchart illustrating another business processing method provided in an embodiment of this application;

[0027] Figure 6 A flowchart illustrating another business processing method provided in an embodiment of this application;

[0028] Figure 7 This is a schematic diagram of the structure of a service processing device provided in an embodiment of this application;

[0029] Figure 8 A schematic diagram illustrating the internal architecture and relationships of a resource downloader and distributor provided in this application embodiment;

[0030] Figure 9 A schematic diagram of the operation flow of a state processor provided in an embodiment of this application;

[0031] Figure 10 A schematic diagram illustrating the dependency relationship between a dynamic data source assembly module and a custom data source protocol provided in this application embodiment;

[0032] Figure 11 This application provides a functional diagram illustrating the implementation of a new data source through a data source protocol definition in an embodiment of the present application.

[0033] Figure 12 A flowchart illustrating another business processing method provided in an embodiment of this application;

[0034] Figure 13 This is a schematic diagram of another business processing apparatus provided in an embodiment of this application;

[0035] Figure 14 This is a schematic diagram of the structure of a service processing device provided in an embodiment of this application;

[0036] Figure 15 A conceptual partial view of a computer program product provided for an embodiment of this application. Detailed Implementation

[0037] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0038] In this article, the character " / " generally indicates that the objects before and after it are in an "or" relationship. For example, A / B can be understood as A or B.

[0039] The terms “first” and “second” in the specification and claims of this application are used to distinguish different objects, rather than to describe a specific order of objects.

[0040] Furthermore, the terms "comprising" and "having," and any variations thereof, used in the description of this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or device that includes a series of steps or modules is not limited to the steps or modules listed, but may optionally include other steps or modules not listed, or may optionally include other steps or modules inherent to such process, method, product, or device.

[0041] Furthermore, in the embodiments of this application, the words "exemplary" or "for example" are used to indicate that they are examples, illustrations, or descriptions. Any embodiment or design that is described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design options. Specifically, the use of the words "exemplary" or "for example" is intended to present concepts in a concrete manner.

[0042] Before providing a detailed description of the business processing methods provided in the embodiments of this application, the implementation environment and application scenarios of the embodiments of this application will be introduced first.

[0043] First, the application scenarios of the embodiments of this application will be introduced.

[0044] In recent years, with the development of communication technology, interactions between devices have become more frequent, and the demand for business processing between devices has also increased. For example, servers provide business services to terminals through streaming engines (such as Flink).

[0045] Real-time data is becoming increasingly important in data analysis, and the requirements for data real-time performance and processing accuracy are also rising. Flink, as a mainstream framework for real-time computing, is gaining increasing attention. Data processing using Flink can generally be summarized into three main steps: "specifying the data source," "writing the processing logic," and "defining the output." Faced with numerous real-time processing tasks, Flink developers typically rely on Flink's internal operators to write Java code to implement specific task processing.

[0046] During the process of the server providing business services to the terminal through Flink, the server needs to receive business request messages from the terminal and create corresponding runtime information for the business request messages based on Flink. Then, the server runs Flink based on the runtime information, obtains the runtime results, and sends the results back to the terminal.

[0047] However, due to the characteristics of real-time data, the processing logic is generally not particularly complex. Therefore, the code logic written by Flink programs is relatively simple, but there is a lot of repetition.

[0048] In summary, in the current technical solutions, there may be some identical information between the runtime information corresponding to different business request messages. This causes the server to repeatedly create some information when creating multiple runtime information, which reduces the response efficiency to business requests.

[0049] To address the aforementioned issues, this application provides a business processing method applied to scenarios involving processing business requests. A business processing device acquires a request message instructing the execution of a business to be processed based on configuration information, where the configuration information is the configuration information of the data source for the business to be processed. Next, the business processing device determines whether the business to be processed exists among a plurality of stored business execution information. If such information exists, the device modifies the execution information of the business to be processed within the stored information, generating modified execution information based on the configuration information. Then, the business processing device executes the data source for the business to be processed based on the modified execution information. In other words, the business processing device can modify the execution information of an existing data source according to the content of the business request to generate the required execution information for the business request. This avoids the repeated creation of partially identical information during the creation of multiple execution information sets, improving the response efficiency to business requests.

[0050] The implementation environment of the embodiments of this application is described below.

[0051] like Figure 1The diagram shown is a schematic representation of a communication system provided in an embodiment of this application. The communication system may include a service processing device (such as a server 101) and a management device (such as a terminal 102). The server 101 can communicate with the terminal 102 via wired / wireless communication.

[0052] Specifically, terminal 102 can receive the user-inputted pending service and the configuration information of the data source for the pending service, generate a request message, and send the request message to server 101. Then, server 101 can receive the request message from terminal 102, parse the request message, and obtain the configuration information of the data source for the pending service. Next, server 101 can determine whether the pending service's operation information exists among the stored multiple service operation information records.

[0053] If the stored service operation information contains operation information for a service to be processed, server 101 can retrieve that information from the stored data and modify it according to the configuration information of the data source. Then, server 101 can run the data source of the service to be processed based on the modified operation information.

[0054] If the stored service operation information does not contain the operation information for the service to be processed, the server 101 can create the operation information for the service to be processed based on the configuration information of the data source of the service to be processed, and run the data source of the service to be processed based on the operation information of the service to be processed.

[0055] It should be noted that, in the embodiments of this application, the server (such as server 101) can be a single physical server, or it can be a server cluster consisting of multiple servers. Alternatively, the server cluster can be a distributed cluster. Or, the server can be a cloud server. The embodiments of this application do not limit the specific implementation method of the server.

[0056] The terminal (such as terminal 102) can be a mobile phone, tablet computer, desktop computer, laptop computer, handheld computer, notebook computer, ultra-mobile personal computer (UMPC), netbook, or other device with sending and receiving functions. This application does not impose any special restrictions on the specific form of the terminal. It can interact with the user through one or more methods such as keyboard, touchpad, touch screen, remote control, voice interaction, or handwriting device.

[0057] After introducing the application scenarios and implementation environment of the embodiments of this application, the business processing methods provided by the embodiments of this application will be described in detail below in conjunction with the above implementation environment.

[0058] The methods in the following embodiments can all be implemented in the above-described application scenarios and implementation environments. The embodiments of this application will be specifically described below using a business processing device as the execution subject, in conjunction with the accompanying drawings.

[0059] Figure 2 This is a flowchart illustrating a business processing method provided in an embodiment of this application. Figure 2 As shown, the method may include: S201-S205.

[0060] S201, The service processing device obtains the target request message.

[0061] The target request message is used to instruct the execution of the target service based on the target configuration information, where the target configuration information is the configuration information of the target data source, and the target data source is the data source of the target service.

[0062] In one possible implementation, the service processing unit can receive a target request message input by the user.

[0063] In another possible implementation, the service processing unit can receive a target request message from the management unit.

[0064] In some embodiments, after the service processing device obtains the target request message, the service processing device may parse the target request message and execute S202.

[0065] S202, The service processing device determines whether the first operation information of the target service exists among the multiple stored service operation information.

[0066] Among them, the operation information is used to indicate the operation of the data source. One business operation information corresponds to one data source, and the first operation information is used to indicate the operation of the target data source.

[0067] In one possible implementation, the target request message may include: an identifier of the target service, and the operation information may include the identifier of the corresponding service. The service processing device can determine whether there is operation information including the identifier of the target service among the multiple stored service operation information, and then determine whether there is first operation information of the target service among the multiple stored service operation information.

[0068] In one possible design, if the service processing device determines that there is service information including the identifier of the target service among the multiple stored service operation information, the service operation device can determine that there is first service information of the target service among the multiple stored service operation information, and use the service information including the identifier of the target service among the multiple service operation information as the first service information of the target service. The first service information of the target service may include the identifier of the target service.

[0069] In another possible design, if the service processing device determines that there is no service information including the identifier of the target service among the stored multiple service operation information, then the service operation device can determine that there is no first service information of the target service among the stored multiple service operation information.

[0070] In this embodiment, the identifier of the target service may include the name of the target service. The service processing device can determine whether there is any operation information including the name of the target service among the stored multiple service operation information, and then determine whether there is first operation information of the target service among the stored multiple service operation information.

[0071] In some embodiments, if the service processing device determines that there is first operation information of the target service among the stored multiple service operation information, the service processing device executes S203.

[0072] S203, The service processing device obtains the first operating information.

[0073] In one possible implementation, the service processing device can obtain the first operation information from multiple stored service operation information.

[0074] S204. The service processing device modifies the first operating information and generates the second operating information based on the target configuration information.

[0075] In one possible implementation, the target request message may further include target configuration information. The service processing device can determine first sub-information that differs from the target configuration information from the first operational information. Then, based on the target configuration information, the service processing device can modify the first sub-information that differs from the target configuration information in the first operational information to generate second operational information, wherein there is identical information between the first operational information and the second operational information.

[0076] S205. The business processing device operates the target data source based on the second operating information.

[0077] It should be noted that the process of the business processing device running the target data source based on the second operating information can be referred to the introduction of running the data source based on the operating information in the existing technology, and will not be repeated here.

[0078] The technical solution provided by the above embodiments brings at least the following beneficial effects: The service processing device can obtain a target request message, which is used to instruct the execution of a target service based on target configuration information. The target configuration information is the configuration information of the target data source, and the target data source is the data source of the target service. Next, the service processing device can determine whether first execution information of the target service exists among the stored multiple service execution information. If first execution information of the target service exists among the stored multiple service execution information, the device obtains the first execution information and modifies it according to the target configuration information to generate second execution information. Afterward, the service processing device can execute the target data source based on the second execution information. In other words, the service processing device can modify the execution information of an existing data source according to the content of the service request to generate the execution information required by the service request. This avoids the repeated creation of some identical information during the creation of multiple execution information, improving the response efficiency to service requests.

[0079] In other embodiments, if the service processing device determines that the first service information for the target service does not exist among the multiple stored service operation information, the service processing device can create second service information based on the target configuration information and run the target data source based on the second service information.

[0080] In one possible implementation, the target configuration information may include target request information, which indicates the content requested for the target service. The service processing device may create second operational information based on the target request information.

[0081] In one possible design, the target request information can be information edited using Structured Query Language (SQL).

[0082] In other words, the service processing device can generate the required runtime information for a service request based on the content of the service request, even when the runtime information of the existing data source does not exist. This improves the operability of responding to service requests.

[0083] It should be noted that one data source can correspond to multiple computing engines, and the process of running a data source can be the process of running the computing engine corresponding to the data source.

[0084] In some embodiments, such as Figure 3 As shown, in this business processing method, S205 may include: S301-S302.

[0085] S301. The service processing device determines at least one first computing engine from a plurality of preset computing engines based on the identifier of at least one first computing engine.

[0086] In one possible implementation, the second operational information may include: an identifier of at least one first computing engine, wherein the business processing device stores a plurality of preset computing engines. The business processing device may select the computing engine corresponding to the identifier of the first computing engine from the plurality of preset computing engines as the first computing engine, thereby obtaining at least one first computing engine.

[0087] In one possible design, the identifier of the first computing engine may include: the storage path information of the first computing engine and the name of the first computing engine.

[0088] In another possible design, the first computing engine may include at least one first user-defined function (UDF), and the identifier of the first computing engine may include the storage path information of the first UDF and the name of the first UDF.

[0089] S302, The business processing unit runs each of the first computing engines based on the second operating information.

[0090] In one possible implementation, the second operational information may further include: second sub-information for each first computing engine. The service processing device may run the first computing engine corresponding to each second sub-information based on multiple pieces of second sub-information.

[0091] Understandably, a data source can correspond to multiple computing engines. The business processing device can run each computing engine corresponding to the data source of the business request based on the information of each computing engine in the runtime information required by the business request, thereby realizing the response to the business request.

[0092] In some embodiments, before the service processing device determines at least one first computing engine from a plurality of preset computing engines based on the identifier of at least one first computing engine (i.e., S301), for each identifier of a first computing engine, the service processing device may also determine whether all the first computing engines exist among the plurality of preset computing engines.

[0093] In one possible implementation, if the service processing device determines that all the first computing engines exist among the multiple preset computing engines, the service processing device may execute S301.

[0094] In another possible implementation, the target configuration information may also include a custom UDF. If the service processing device determines that a third computing engine does not exist among the multiple preset computing engines, the service processing device may create a third computing engine based on the custom UDF. The third computing engine is any one of at least one of the first computing engines.

[0095] Optionally, the target configuration information may also include: checkpoint location information, checkpoint execution frequency information, and computing engine failure restart policy information. If the service processing device determines that there is no third computing engine among the multiple preset computing engines, the service processing device may create a third computing engine based on the custom UDF, checkpoint location information, checkpoint execution frequency information, and computing engine failure restart policy information. The third computing engine is any one of at least one first computing engine.

[0096] In some embodiments, for each first computing engine, the service processing device may run each first computing engine according to a first operation. The first operation may include: S401-S404.

[0097] like Figure 4 As shown, in this business processing method, S302 may include: S401-S404.

[0098] S401, The business processing unit determines whether there is a checkpoint of the second computing engine among the multiple stored historical checkpoints.

[0099] Among them, the historical checkpoint is a node in the operation of the preset computing engine, and the second computing engine is any one of the first computing engines.

[0100] In some embodiments, if the service processing device determines that there is a checkpoint of the second computing engine among a plurality of stored historical checkpoints, the service processing device may execute S402.

[0101] S402, The business processing unit obtains the checkpoint of the second computing engine from multiple stored historical checkpoints.

[0102] S403. The business processing unit runs the second computing engine based on the second operating information and the checkpoints of the second computing engine.

[0103] In one possible implementation, the service processing unit can run the second computing engine from its initial state to the node indicated by the checkpoint of the second computing engine based on the checkpoint of the second computing engine. Then, the service processing unit can continue running the second computing engine after the node indicated by the checkpoint of the second computing engine based on the second sub-information of the second computing engine in the second running information.

[0104] In other embodiments, if the service processing device determines that there is no checkpoint of the second computing engine among the stored multiple historical checkpoints, the service processing device may execute S404.

[0105] S404. The business processing device runs the second computing engine based on the second operating information.

[0106] In one possible implementation, the business processing device can start the second computing engine in an initial state based on the second sub-information of the second computing engine in the second operating information.

[0107] Understandably, during the operation of the computing engine, the business processing unit can continue running the computing engine based on the nodes in its historical execution process. This reduces the repeated running of the same processes by the computing engine, improving the response speed to business requests.

[0108] It should be noted that the business processing device can authenticate the received request message to determine whether to respond to the request message.

[0109] In some embodiments, such as Figure 5 As shown, after S201, the method may further include: S501-S502.

[0110] S501, The service processing device obtains the list of services to be accessed for the target service.

[0111] In one possible implementation, the service processing device stores multiple preset lists of services to be accessed, each list corresponding to a service identifier. The service processing device can use the list corresponding to the identifier of the target service from the multiple preset lists as the target service's list of services to be accessed, thereby obtaining the target service's list of services to be accessed. The target service's list of services to be accessed includes multiple identity identifiers that are permitted to access the target service.

[0112] S502, The service processing device determines whether the target identity identifier exists in the list of services to be accessed.

[0113] In one possible implementation, the target request message may further include a target identity identifier. The service processing device can determine whether the target identity identifier exists in the list of services to be accessed for the target service based on the target identity identifier in the target request message.

[0114] In one possible design, the target identity could be the user's account information for logging into the business processing device.

[0115] In another possible design, the target identity can be device information for managing the device.

[0116] In some embodiments, if the service processing device determines that the target identity does not exist in the list of services to be accessed, the service processing device will not respond to the target request message and will delete the target request message.

[0117] In other embodiments, if the service processing device determines that a target identity exists in the list of services to be accessed, the service processing device executes S202.

[0118] Understandably, the service processing device can verify the received service requests based on multiple authorized service access identifiers. This improves the operability of responding to service requests.

[0119] In some embodiments, such as Figure 6 As shown, after S201, the method may further include: S601.

[0120] S601. The service processing device determines whether the target data source exists among the multiple stored data sources based on the identifier of the target service.

[0121] In some embodiments, if the service processing device determines that a target data source exists among a plurality of stored data sources, the service processing device executes S501.

[0122] In other embodiments, if the service processing device determines that the target data source does not exist among the multiple stored data sources, the service processing device can obtain the target data source and create second operation information based on the target configuration information.

[0123] In one possible implementation, the business processing unit can obtain the target data source from the data source management platform.

[0124] Understandably, even if the data source for a business request does not exist in the existing data sources, the business processing unit can obtain the data source for the business request through the data source management platform and add it to the business processing unit. In other words, the business processing unit can expand to include new data sources. This improves the operability of responding to business requests.

[0125] It should be noted that the order of S502 and S601 is not limited in the embodiments of this application.

[0126] In some embodiments, the service processing device may first determine whether the target identity exists in the list of the target service to be accessed (i.e., S502), and then execute S601 if the target identity exists in the list of the target service to be accessed.

[0127] In other embodiments, the service processing device may first determine whether the target data source exists among the multiple stored data sources based on the identifier of the target service (i.e., S601), and then execute S502 if it is determined that the target data source exists among the multiple stored data sources.

[0128] In some embodiments, such as Figure 7As shown, the service processing device 700 may include: a configuration parser 701, a resource downloader and distributor 702, a status processor 703, a dynamic data source assembly module 704, and a task executor 705.

[0129] Among them, the business processing unit 700 relies on the Flink cluster.

[0130] It should be noted that a Flink cluster can be deployed in a server cluster environment. Alternatively, a Flink cluster can be deployed in a cloud cluster environment.

[0131] The configuration parser 701 can convert configuration content (i.e., the target request message) in JavaScript Object Notation (JSON) format to objects in the business processing unit 700 (i.e., the business processing unit parses the target request message).

[0132] In one possible design, the configuration content is generated based on a configuration template. The configuration template is as follows:

[0133]

[0134]

[0135] In other words, the permission configuration for different data sources is configured in "parameter", which defines the permissions to pull data and the tenant information (i.e., identity identifier) ​​that are allowed to execute. Tenant permissions can be restricted through the tenant information.

[0136] Resource downloader and distributor 702 can download or upload remote resources (such as data sources) used by the service processing unit 700 during operation according to the configuration, and distribute resource files to each computing engine. Resource downloader and distributor 702 can support file transfer between various platforms (such as socket file protocols) and obtain network files. Figure 8 The internal architecture and relationships of the resource downloader and distributor 702 are shown. The functions of the upload and download interfaces of the resource downloader and distributor 702 can include: local file upload, Hadoop file upload and download, S3 (an object system) upload and download, and Application Programming Interface (API) upload and download.

[0137] The resource downloader and distributor 702 can perform its functions by having different data sources execute the defined upload and download interface protocols. The upload and download interface protocols mainly define information such as file address, file type, file encoding format, and permission attributes.

[0138] The state processor 703 can save the historical state of the task's execution to ensure program reliability and fault tolerance when the service processing device 700 stops due to some situation, ensuring that the historical state can be restored after a failure. For example... Figure 9 As shown, the operation flow of the state processor 703 may include the following five steps:

[0139] The first step is for the state processor 703 to initialize the state of an object (such as a data source). The object is a dictionary-type memory area.

[0140] The second step is for the state processor 703 to determine whether there is a historical state saved based on the checkpoint configuration of the configuration content. If so, the historical checkpoint content is restored (i.e., the third and fourth steps are executed).

[0141] The third step is for the status processor 703 to iterate through the authorized tenant information based on the current data source's permission configuration.

[0142] Step 4: State processor 703 restores the historical state content for each tenant;

[0143] Step 5: The state processor 703 saves the current checkpoint content periodically according to the checkpoint strategy in the configuration file.

[0144] After the service processing unit 700 starts up, it updates the current tenant's status information for each piece of information it processes. To ensure that the service processing unit 700 can still correctly find the corresponding status information after changes to the tenant list and parallelism, a full snapshot of all tenants' statuses is saved each time a status is saved. Table 1 shows the status processing protocol upon which the status content of each tenant is based.

[0145] Table 1 Status Processing Protocol

[0146]

[0147] In this embodiment, the business processing device 700 may store a custom data source protocol. This custom data source protocol is used to quickly support data sources not supported internally by Flink, and includes: a data source protocol, a dynamic data source definition, and a dynamic data source template.

[0148] like Figure 10As shown, this illustrates the dependency between the Dynamic Data Source Assembly Module 704 and the custom data source protocol. The data source protocol defines several methods that a new data source must implement. The dynamic data source template is a data source that implements the Flink protocol; data retrieval is achieved by locating the data source of the data source protocol through reflection. The dynamic data source definition maps the dynamic data source template to a data source name, parameter list, and other content recognizable by Flink SQL. Finally, the Dynamic Data Source Assembly Module 704 interacts with the Flink cluster to publish the data source to the cluster.

[0149] like Figure 11 As shown, it illustrates the methods and functions for implementing a new data source in the data source protocol definition. The functions that need to be implemented in the data source protocol include:

[0150] 1. Initialization: Used to initialize the data source. The parameter passed in is the result of configuring parser 701, which is passed in during the initialization of the dynamic data source template.

[0151] 2. Get Tenant List: This function is mainly used to obtain the authorized tenant list of the data source and return a valid tenant list. This function is called by the dynamic data source template.

[0152] 3. Retrieve data: Retrieve data from the data source based on the current tenant information and status information, and return the result as a JSON object. This function is called by the dynamic data source template.

[0153] The dynamic data source template needs to implement Flink's built-in data source interface protocol and checkpoint methods. Its core functionalities are three: "Initialization," "Data Fetch," and "State Update." The initialization method primarily loads historical state, creates custom tenant objects, retrieves the current tenant list, and sets the historical state for each tenant. The data fetch method retrieves data based on the current tenant information and its corresponding state information, and updates the current tenant's state information. The state update method periodically writes the updated state information for each tenant to the checkpoint.

[0154] The main function of the dynamic data source definition is to implement the Flink built-in interface ScanTableSource based on the current configuration, defining the name and parameters of the current data source. The dynamic data source assembly module 704 implements the Flink built-in interface DynamicTableSourceFactory to interact with the Flink cluster. These two parts represent a common Flink implementation and can be implemented according to the Flink interface.

[0155] Task executor 705 serves as the scheduling center for assembling the various modules within the business processing unit 700, and is the core of the entire unit. Task executor 705 can receive external parameters and configuration content, and call configuration parser 701 to parse the configuration content into parameter objects. Then, task executor 705 can call dynamic data source assembly module 704 to load custom data sources and create Flink SQL data source operators. Finally, it executes the parsed SQL statements line by line, thus completing the entire data processing chain.

[0156] The following section describes the business processing methods provided in the embodiments of this application, using specific examples.

[0157] like Figure 12 As shown, the specific steps are as follows:

[0158] Step 1: The management device sends configuration information to the service processing unit.

[0159] Step 2: The business processing device obtains the configuration content.

[0160] Step 3: Analyze the configuration content of the business processing device.

[0161] Step 4: The service processing device determines whether there is task configuration content (i.e., the identifier of the target service) in the configuration content.

[0162] In some embodiments, if the service processing device determines that there is task configuration content in the configuration content, the service processing device executes step five.

[0163] Step 5: The business processing device parses the task configuration content.

[0164] Step 6: The service processing device determines whether there are custom functions (i.e., custom UDFs) in the configuration content.

[0165] In some embodiments, if the service processing device determines that there are custom functions in the configuration content, the service processing device executes step seven.

[0166] Step 7: The business processing unit determines whether the custom function is valid.

[0167] In one possible implementation, the business processing device can determine whether the custom function is valid by checking whether the storage path information of the custom function in the business processing device is in an abnormal state.

[0168] In one possible design, if the business processing device determines that the storage path information of the custom function in the business processing device is in a normal state, then the custom function is determined to be valid.

[0169] In another possible design, if the business processing device determines that the storage path information of the custom function in the business processing device is in an abnormal state, then the custom function is determined to be invalid.

[0170] In some embodiments, if the service processing device determines that the user-defined function is valid, the service processing device executes step eight.

[0171] Step 8: The business processing device distributes resource files (i.e., the business processing device runs the first computing engine corresponding to each second sub-information based on multiple second sub-informations).

[0172] Step 9: The business processing device determines whether there is structured query language content (i.e., target request information) in the configuration content.

[0173] In some embodiments, if the service processing device determines that the configuration content contains Structured Query Language content, the service processing device executes step ten.

[0174] Step 10: The business processing device determines whether there are delimiters in the structured query language content.

[0175] In some embodiments, if the service processing device determines that there are no delimiters in the structured query language content, the service processing device generates an exception message.

[0176] In other embodiments, if the business processing device determines that there are delimiters in the structured query language content, the business processing device executes step eleven.

[0177] Step 11: The business processing device breaks down the structured query language content to obtain multiple task information.

[0178] In some embodiments, after steps five, eight and eleven are completed, the service processing device may execute step twelfth.

[0179] Step 12: Initialize the task environment for the business processing device.

[0180] Step 13: Configure global task settings for the business processing device.

[0181] Step Fourteen: Load the custom function into the business processing device.

[0182] Step 15: The business processing device searches for data source configuration content.

[0183] Step 16: The business processing device initializes the data source and sets the data source parameters.

[0184] Step 17: Load historical checkpoint information into the business processing device.

[0185] Step 18: The business processing device executes the structured query language content.

[0186] In one possible implementation, the business processing device can execute the corresponding SQL content to implement data access, processing, and export logic.

[0187] Step 19: Business processing device performs checkpoints.

[0188] In one possible implementation, the business processing unit can periodically execute checkpoint procedures and restart strategies based on system configuration.

[0189] The foregoing primarily describes the solutions provided in the embodiments of this application from the perspective of computer devices. It is understood that, in order to achieve the aforementioned functions, the computer device includes corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should readily recognize that, based on the business processing method steps described in conjunction with the embodiments disclosed in this application, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0190] This application also provides a service processing apparatus. This service processing apparatus can be a computer device, a CPU within the aforementioned computer device, a processing module within the aforementioned computer device for processing services, or a client within the aforementioned computer device for processing services.

[0191] This application embodiment can divide the business processing device into functional modules or functional units according to the above method examples. For example, each function can be divided into a separate functional module or functional unit, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or in software functional modules or functional units. The module or unit division in this application embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.

[0192] like Figure 13 The diagram shown is a structural schematic of another service processing apparatus provided in an embodiment of this application. The service processing apparatus is used to execute... Figure 2 , Figure 3 , Figure 4 , Figure 5 or Figure 6The business processing method shown may include an acquisition module 1301 and a processing module 1302.

[0193] The acquisition module 1301 is used to acquire a target request message, which instructs the execution of a target service based on target configuration information. The target configuration information is the configuration information of a target data source, and the target data source is the data source of the target service. The acquisition module 1301 is also used to acquire the first execution information if a first execution information for the target service exists among multiple stored service execution information. The processing module 1302 is used to modify the first execution information and generate second execution information based on the target configuration information. The first and second execution information contain identical information. The processing module 1302 is also used to execute the target data source based on the second execution information.

[0194] Optionally, the target data source corresponds to multiple preset computing engines, and the second runtime information includes: an identifier of at least one first computing engine. The processing module 1302 is specifically configured to determine at least one first computing engine from the multiple preset computing engines based on the identifier of the at least one first computing engine. The processing module 1302 is also configured to run each first computing engine based on the second runtime information.

[0195] Optionally, the processing module 1302 is specifically configured to run each first computing engine according to a first operation for each first computing engine. The first operation includes: determining whether a checkpoint for a second computing engine exists among a plurality of stored historical checkpoints, where the historical checkpoints are nodes in the operation of a preset computing engine, and the second computing engine is any one of at least one first computing engine. If a checkpoint for a second computing engine exists among the plurality of stored historical checkpoints, then the checkpoint for the second computing engine is obtained from the plurality of stored historical checkpoints, and the second computing engine is run based on the second operation information and the checkpoint for the second computing engine. If a checkpoint for a second computing engine does not exist among the plurality of stored historical checkpoints, then the second computing engine is run based on the second operation information.

[0196] Optionally, the target request message includes a target identity identifier. The acquisition module 1301 is further configured to acquire a list of targets to be accessed, which includes multiple identity identifiers allowed to access the target service. The processing module 1302 is further configured to, if a target identity identifier exists in the list of targets to be accessed, determine whether the first running information of the target service exists among the stored multiple service running information.

[0197] Optionally, the target request message may also include: an identifier of the target service. Processing module 1302 is further configured to determine, based on the identifier of the target service, whether a target data source exists among the stored multiple data sources. Processing module 1302 is further configured to, if a target data source exists among the stored multiple data sources, determine whether first operational information of the target service exists among the stored multiple operational information. Processing module 1302 is further configured to, if a target data source does not exist among the stored multiple data sources, obtain the target data source and create second operational information based on the target configuration information.

[0198] Figure 14 This is a schematic diagram of the hardware structure of a service processing device according to an exemplary embodiment. The service processing device may include a processor 1402, which is used to execute application code to implement the service processing method of this application.

[0199] The processor 1402 may be a central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits used to control the execution of programs according to the present application.

[0200] like Figure 14 As shown, the service processing device may further include a memory 1403. The memory 1403 stores the application code that executes the scheme of this application, and its execution is controlled by the processor 1402.

[0201] Memory 1403 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but not limited thereto. Memory 1403 may exist independently and be connected to processor 1402 via bus 1404. Memory 1403 may also be integrated with processor 1402.

[0202] like Figure 14 As shown, the service processing device may further include a communication interface 1401, wherein the communication interface 1401, processor 1402, and memory 1403 may be coupled to each other, for example, through a bus 1404. The communication interface 1401 is used for information interaction with other devices, for example, supporting information interaction between the service processing device and other devices.

[0203] It should be pointed out that, Figure 14 The equipment structure shown does not constitute a limitation on the service processing equipment, except... Figure 14 In addition to the components shown, the service processing equipment may include more or fewer components than illustrated, or combine certain components, or have different component arrangements.

[0204] In actual implementation, the functions implemented by processing module 1302 can be provided by... Figure 14 The processor 1402 shown calls the program code in memory 1403 to implement this.

[0205] This application also provides a computer-readable storage medium storing instructions that, when executed by a processor of a computer device, enable the computer to perform the business processing provided in the embodiments described above. For example, the computer-readable storage medium may be a memory 1403 including instructions, which may be executed by a processor 1402 of a computer device to complete the described method. Optionally, the computer-readable storage medium may be a non-transitory computer-readable storage medium, such as a ROM, RAM, CD-ROM, magnetic tape, floppy disk, or optical data storage device.

[0206] Figure 15 A conceptual partial view of a computer program product provided in an embodiment of this application is shown as an example. The computer program product includes a computer program for executing computer processes on a computing device.

[0207] In one embodiment, a computer program product is provided using a signal bearer medium 1500. The signal bearer medium 1500 may include one or more program instructions that, when executed by one or more processors, can provide the above-mentioned... Figure 2 , Figure 3 , Figure 4 , Figure 5 or Figure 6 The described function or part of the function. Therefore, for example, refer to... Figure 2 In the embodiment shown, one or more features of S201 to S205 can be provided by one or more instructions associated with the signal carrying medium 1500. Furthermore, Figure 15 The program instructions in the document also describe example instructions.

[0208] In some examples, the signal carrying medium 1500 may include a computer-readable medium 1501, such as, but not limited to, a hard disk drive, a compact disc (CD), a digital video disc (DVD), a digital magnetic tape, a memory, a read-only memory (ROM), or a random access memory (RAM), etc.

[0209] In some implementations, the signal carrying medium 1500 may include a computer recordable medium 1502, such as, but not limited to, a memory, a read / write (R / W) CD, a R / W DVD, and so on.

[0210] In some implementations, the signal carrying medium 1500 may include a communication medium 1503, such as, but not limited to, digital and / or analog communication media (e.g., fiber optic cables, waveguides, wired communication links, wireless communication links, etc.).

[0211] The signal-bearing medium 1500 can be transmitted by a wireless communication medium 1503. One or more program instructions can be, for example, computer-executable instructions or logical implementation instructions.

[0212] In some examples, such as targeting Figure 13 The described business processing apparatus can be configured to provide various operations, functions, or actions in response to one or more program instructions in a computer-readable medium 1501, a computer-recordable medium 1502, and / or a communication medium 1503.

[0213] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0214] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0215] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be in one place or distributed in multiple different locations. Some or all of the constituent units can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0216] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0217] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, essentially, or the part that contributes to the prior art, or a complete or partial classification of the technical solution, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0218] The above are merely specific embodiments of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A service processing method characterized by, The method includes: Obtain a target request message, which is used to instruct the execution of a target service based on target configuration information. The target configuration information is the configuration information of a target data source, the target data source is the data source of the target service, the target data source corresponds to multiple preset computing engines, and the target configuration information includes custom user-defined functions. If the first operation information of the target service exists among the multiple stored operation information, then the first operation information is obtained, and according to the target configuration information, the first sub-information in the first operation information that is different from the target configuration information is modified to generate the second operation information, wherein there is identical information between the first operation information and the second operation information; If the third computing engine indicated by the modified first sub-information in the second running information does not exist in the plurality of preset computing engines, the third computing engine is created for the target data source according to the custom user-defined function; Based on the second operational information, the target data source is run.

2. The method of claim 1, wherein, The second runtime information includes: an identifier of at least one first computing engine, and the step of running the target data source based on the second runtime information includes: The at least one first computing engine is determined from the plurality of preset computing engines based on the identifier of the at least one first computing engine; Based on the second runtime information, each of the first computing engines is run.

3. The method of claim 2, wherein, Based on the second operational information, running the at least one first computing engine includes: For each of the first computing engines, each of the first computing engines is run according to a first operation, the first operation including: Determine whether there is a checkpoint of the second computing engine among the multiple stored historical checkpoints, wherein the historical checkpoint is a node in the operation of the preset computing engine, and the second computing engine is any one of the at least one first computing engine; If a checkpoint of the second computing engine exists among the stored historical checkpoints, then the checkpoint of the second computing engine is obtained from the stored historical checkpoints, and the second computing engine is run based on the second running information and the checkpoint of the second computing engine. If there is no checkpoint for the second computing engine among the stored historical checkpoints, then the second computing engine is run based on the second running information.

4. The method according to any one of claims 1-3, characterized in that, The target request message includes a target identity identifier. After obtaining the target request message, the method further includes: Obtain the list of the target service to be accessed, which includes multiple identity identifiers that are allowed to access the target service; If the target identity exists in the list of services to be accessed for the target service, then it is determined whether the first operation information of the target service exists among the stored multiple service operation information.

5. The method according to any one of claims 1-3, characterized in that, The target request message further includes: an identifier of the target service; after obtaining the target request message, the method further includes: Based on the identifier of the target service, determine whether the target data source exists among the multiple stored data sources; If the target data source exists among the multiple stored data sources, then determine whether the first operation information of the target service exists among the multiple stored business operation information. If the target data source is not among the stored multiple data sources, the target data source is obtained, and the second running information is created according to the target configuration information.

6. A business processing apparatus, characterized in that, The device includes: The acquisition module is used to acquire a target request message, which is used to instruct the execution of a target service based on target configuration information. The target configuration information is the configuration information of a target data source, which is the data source of the target service. The target data source corresponds to multiple preset computing engines, and the target configuration information includes custom user-defined functions. The acquisition module is further configured to acquire the first operating information if the first operating information of the target service exists among the multiple stored operating information; The processing module is configured to modify the first sub-information in the first running information that is different from the target configuration information according to the target configuration information, and generate the second running information, wherein there is identical information between the first running information and the second running information; The processing module is further configured to create the third computing engine for the target data source according to the custom user-defined function when the third computing engine indicated by the first sub-information modified in the second running information does not exist in the plurality of preset computing engines. The processing module is also used to run the target data source based on the second running information.

7. The apparatus according to claim 6, characterized in that, The second operational information includes: the identifier of at least one first computing engine; The processing module is specifically configured to determine the at least one first computing engine from the plurality of preset computing engines based on the identifier of the at least one first computing engine; The processing module is further configured to run each of the first computing engines based on the second running information.

8. The apparatus according to claim 7, characterized in that, The processing module is specifically configured to run each of the first computing engines according to a first operation, wherein the first operation includes: Determine whether there is a checkpoint of the second computing engine among the multiple stored historical checkpoints, wherein the historical checkpoint is a node in the operation of the preset computing engine, and the second computing engine is any one of the at least one first computing engine; If a checkpoint of the second computing engine exists among the stored historical checkpoints, then the checkpoint of the second computing engine is obtained from the stored historical checkpoints, and the second computing engine is run based on the second running information and the checkpoint of the second computing engine. If there is no checkpoint for the second computing engine among the stored historical checkpoints, then the second computing engine is run based on the second running information.

9. The apparatus according to any one of claims 6-8, characterized in that, The target request message includes: target identity identifier; The acquisition module is further configured to acquire the target service’s access list, which includes multiple identity identifiers that are allowed to access the target service. The processing module is further configured to determine whether the first operation information of the target service exists among the stored multiple service operation information if the target identity identifier exists in the list of services to be accessed by the target service.

10. The apparatus according to any one of claims 6-8, characterized in that, The target request message also includes: the identifier of the target service; The processing module is further configured to determine whether the target data source exists among the multiple stored data sources based on the identifier of the target service; The processing module is further configured to determine whether the first operation information of the target service exists among the stored multiple business operation information if the target data source exists among the stored multiple data sources. The processing module is further configured to, if the target data source is not present among the stored multiple data sources, obtain the target data source and create the second running information according to the target configuration information.

11. A business processing device, characterized in that, include: Processor and memory; The processor and the memory are coupled; The memory is used to store one or more programs, the one or more programs including computer-executable instructions. When the service processing device is running, the processor executes the computer-executable instructions stored in the memory to cause the service processing device to perform the service processing method as described in any one of claims 1-5.

12. A computer-readable storage medium storing instructions, characterized in that, When the computer executes the instructions, the computer performs the business processing method as described in any one of claims 1-5.

Images