Context-aware based service data transmission task dynamic generation method and system

Abstract

The application belongs to the technical field of information and data exchange, and provides a context-aware-based service data sending task dynamic generation method and system. The method is based on a service event to listen to changed service data, acquires a service context of the service event, and the service context includes information of a service application, a service type and a source service organization of the changed service data. The method is based on the service application and the source service organization to determine a deployed data center, determines a data transmission channel of the source service organization to send the changed service data, a target service organization and a target data center to receive the changed service data, packs the changed service data in batches according to the service type and data generation time, dynamically generates a changed data packet, and further generates a corresponding data sending task. The application can realize data reporting between service organizations deployed on data centers without hierarchical levels and capable of not directly communicating, and the sending strategy is flexible and timely sending processing.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of information and data exchange, and particularly relates to a context-aware business data sending task dynamic generation method and system. BACKGROUND

[0002] The statements in this section merely provide background information related to the present application and do not necessarily constitute prior art.

[0003] In some enterprises or units, due to the complex organizational structure and wide geographical distribution, multiple data centers deployed in different places are often constructed. However, the construction mode of these data centers usually breaks the traditional multi-level architecture mode, and instead forms a flat, non-hierarchical data center layout according to the principle of near deployment according to geographical location. The characteristics of this layout are: there is no direct business contact or administrative reporting relationship between the business units located in the same data center; on the contrary, business units with close business contact or clear administrative reporting relationship may be deployed in different data centers. At the same time, due to network security and compliance requirements, these distributed data centers are usually strategically isolated and prohibited from establishing direct network communication channels.

[0004] The above architectural characteristics result in significant difficulties in achieving efficient and reliable data transmission between different business organizations.

[0005] Currently, traditional cross-data center data sending schemes usually rely on preset hierarchical data center topology structures, and can only support vertical data reporting between organizations with direct superior-subordinate reporting relationships; or can only support pre-configured and fixed point-to-point data transmission paths. In addition, existing schemes generally lack support for diversified data sending strategies and rely mainly on timed batch processing mechanisms, making it difficult to meet the real-time or near-real-time data requirements of business scenarios. SUMMARY

[0006] To solve the above problems, the present application proposes a context-aware business data sending task dynamic generation method and system, which can realize data reporting between business organizations deployed in non-hierarchical and non-directly communicable data centers, and has flexible sending strategies and timely sending processing.

[0007] According to some embodiments, the present application adopts the following technical scheme:

[0008] A context-aware business data sending task dynamic generation method, comprising the following steps:

[0009] Based on the business event, the changed business data is listened to, the business context of the business event is obtained, and the business context includes information of a business application generating the changed business data, a business type, and a source business organization;

[0010] Based on the business application and the source business organization, a data center deploying the business application and the source business organization is determined;

[0011] The information is obtained through a pre-constructed data channel cache table in priority, and if the information is not obtained through the pre-constructed data channel cache table, the information is obtained through a pre-constructed data center management pool. The information obtaining includes determining a data transmission channel through which the source business organization sends the changed business data, and a target business organization and a target data center receiving the changed business data;

[0012] Based on the business event, the changed business data is packaged in batches according to the business type and the data generation time, and a changed data packet is dynamically generated;

[0013] Based on the source business organization, the changed data packet, the target business organization, and the data transmission channel, a corresponding data sending task is dynamically generated, and the data sending task is executed in batches according to a preset task resource allocation strategy.

[0014] As an optional implementation, the process of determining the data center deploying the business application and the source business organization based on the business application and the source business organization includes:

[0015] A data center management pool is pre-constructed, and the data center management pool is used to manage each data center. The management of each data center includes management of a business application, a business type, a business organization, a business data reporting strategy, and a communication relationship between data centers.

[0016] As an optional implementation, the process of determining the data transmission channel through which the source business organization sends the changed business data, and the target business organization and the target data center receiving the changed business data includes:

[0017] A data channel cache table is pre-constructed, and the data channel cache table stores a data transmission channel in which data sending is simulated to be successful in advance;

[0018] The corresponding data transmission channel, the target business organization, and the target data center are obtained from the pre-constructed data channel cache table;

[0019] If the corresponding data transmission channel, the target business organization, and the target data center are not obtained, the data transmission channel through which the source business organization sends the changed business data, and the target business organization and the target data center receiving the changed business data are determined through the pre-constructed data center management pool.

[0020] As a further implementation, the data channel cache table stores a service application, a service type, a source service organization, a target service organization, and a data transmission channel with which a pre-simulation data transmission is successful, and when information about the service application, the service type, the service organization, the service transmission strategy, and the communication relationship between data centers of the data center is added, deleted, or changed, the corresponding data in the data channel cache table is dynamically updated.

[0021] As a further implementation, the process of obtaining the target data center, the target service organization, and the data transmission channel through the pre-constructed data center management pool includes:

[0022] Based on a preset service data reporting strategy corresponding to the service type, the service data reporting strategy corresponding to the service type is obtained from the service system, and based on the service data reporting strategy, the target service organization that can receive the changed data is determined.

[0023] Based on the service application and the target service organization in the data center management pool, the target data center is obtained.

[0024] Based on the communication relationship between data centers in the data center management pool, the optimal data transmission channel is determined through a shortest path algorithm.

[0025] Simulate data transmission based on the optimal data transmission channel.

[0026] Cache the data transmission channel with which the simulation data transmission is successful to the data channel cache table.

[0027] As a further implementation, the process of determining the target service organization that can receive the changed data based on the service data reporting strategy includes:

[0028] The service data reporting strategy supports reporting according to an administrative relationship, reporting according to a business relationship, and a custom extended service data reporting strategy.

[0029] If the service data reporting strategy is reporting according to an administrative relationship, the reporting superior organization of the source service organization is obtained as the target service organization based on the preset administrative reporting relationship of the service system.

[0030] If the service data reporting strategy is reporting according to a business relationship, the corresponding organization of the source service organization is obtained as the target service organization based on the preset business relationship of the service system.

[0031] If the service data reporting strategy is a custom extended service data reporting strategy, the target service organization is obtained based on a pre-constructed custom business logic.

[0032] As a further implementation method, the process of determining the optimal data transmission channel using the shortest path algorithm includes:

[0033] When the source data center and the target data center communicate directly, the data transmission channel contains only two nodes: the source data center and the target data center. Otherwise, the data transmission channel will contain three or more nodes, meaning that there is at least one other data center as a relay node between the source data center and the target data center.

[0034] As a further implementation, the process of simulating data transmission based on the optimal data transmission channel includes:

[0035] A simulated data packet is constructed and sent based on the optimal data transmission channel. When it passes through the relay node, the relay node sends a successful arrival notification to the source node and sends the simulated data packet to the next node. When the source node receives successful arrival notifications from all subsequent nodes on the data transmission channel, the data transmission channel is considered a simulated successful data transmission channel.

[0036] As an alternative implementation, when dynamically generating the corresponding data transmission task, if the data transmission channel contains three or more nodes, the data transmission task will contain multiple transmission activities, with one data transmission activity corresponding to each pair of adjacent nodes.

[0037] A context-aware system for dynamically generating business data transmission tasks includes:

[0038] The business context acquisition module is configured to listen for changed business data based on business events and acquire the business context of the business events. The business context includes information about the business application, business type, and source business organization that generated the changed business data.

[0039] The sender data center determination module is configured to determine the data center where the service application and the source service organization are deployed based on the service application and the source service organization;

[0040] The data transmission channel determination module is configured to prioritize information acquisition through a pre-built data channel cache table. If the information is not acquired through this method, it will instead acquire information through a pre-built data center management pool. Information acquisition includes determining the data transmission channel through which the source business organization sends the changed business data, as well as the target business organization and target data center that receive the changed business data.

[0041] The data packet packaging module is configured to package the changed service data in batches according to service types and data generation times based on the service event, and dynamically generate a changed data packet.

[0042] The task generation and execution module is configured to dynamically generate corresponding data sending tasks based on the source service organization, the changed data packet, the target service organization and the data transmission channel, and execute the data sending tasks in batches according to a preset task resource allocation strategy.

[0043] Compared with the prior art, the application has the following beneficial effects:

[0044] The application realizes data reporting between service organizations deployed on data centers that are not hierarchical and cannot directly communicate, supports multiple scalable data sending strategies, and can perform sending in real time.

[0045] In order to make the above objects, features and advantages of the application more obvious and easy to understand, the following preferred embodiments are described in detail below, and the accompanying drawings are used for explanation. BRIEF DESCRIPTION OF DRAWINGS

[0046] The drawings constituting a part of the specification of the application are used to provide a further understanding of the application, the illustrative embodiments of the application and the description thereof are used to explain the application, and do not constitute an improper limitation on the application.

[0047] Figure 1 The flowchart of the context-aware service data real-time sending task dynamic generation method provided for an embodiment. DETAILED DESCRIPTION

[0048] The application will be further described below in combination with the drawings and embodiments.

[0049] It should be pointed out that the following detailed description is exemplary and is intended to provide further explanation of the application. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as generally understood by those skilled in the art to which the application belongs.

[0050] It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of example embodiments in accordance with the present application. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and / or "comprising," when used in this specification, specify the presence of stated features, steps, operations, elements, components, and / or groups thereof, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or groups thereof.

[0051] The embodiments in the application and the features in the embodiments can be combined with each other without conflict.

[0052] Embodiment one

[0053] A context-aware-based real-time sending task dynamic generation method for business data, as shown in Figure 1 , includes:

[0054] Based on the business event in the business system, the changed business data is listened to, the business context of the business event is obtained, and the business context includes information such as business application, business type, source business organization, etc. which produces the changed data;

[0055] Based on the business application and the source business organization, the data center where the business application and the source business organization are deployed is obtained by using the pre-constructed data center management pool;

[0056] Through the pre-constructed data channel cache table or the data center management pool, the data transmission channel through which the source business organization sends the changed data is determined, and the target business organization and the target data center that receive the changed data are determined;

[0057] Based on the business event, the changed data is packaged in multiple batches according to the business type and the data generation time, and the changed data package is dynamically generated;

[0058] Based on the source business organization, the changed data package, the target business organization, and the data transmission channel, the corresponding data sending task is dynamically generated and pushed to the pre-constructed task scheduling center for batch execution according to the preset task resource allocation strategy.

[0059] In the embodiment, the pre-constructed data center management pool further includes:

[0060] The data center management pool provides management of the data center, and each data center should at least include management of information such as the business application, the business type, the business organization, the business data reporting strategy, and the communication relationship between the data centers.

[0061] In the embodiment, the data transmission channel through which the source business organization sends the changed data, and the target business organization and the target data center that receive the changed data are determined, and the data transmission channel through which the source business organization sends the changed data, and the target business organization and the target data center that receive the changed data are determined.

[0062] obtaining the data transmission channel, the target business organization and the target data center from a pre-constructed data channel cache table;

[0063] If not obtained, obtaining the target data center, the target business organization and the data transmission channel through the data center management pool.

[0064] In the embodiment, the target data center, the target business organization and the data transmission channel are obtained through the data center management pool, and the method further comprises:

[0065] Based on a preset business data reporting strategy corresponding to a business type, obtaining the business data reporting strategy corresponding to the business type from a business system, and based on the business data reporting strategy, determining the target business organization that can receive the changed data;

[0066] Based on the business application and the target business organization, obtaining the target data center;

[0067] Based on the communication relationship between the data centers, determining the optimal data transmission channel through a shortest path algorithm;

[0068] Simulating data transmission based on the data transmission channel;

[0069] Caching the data transmission channel that is simulated successfully into a data channel cache table.

[0070] In the embodiment, determining the target business organization that can receive the changed data further comprises:

[0071] The business data reporting strategy at least supports reporting according to an administrative relationship and reporting according to a business relationship, and can be extended with a self-defined business data reporting strategy;

[0072] If the business data reporting strategy is reporting according to an administrative relationship, obtaining a superior organization of the source business organization based on a preset administrative reporting relationship of the business system, and taking the superior organization as the target business organization;

[0073] If the business data reporting strategy is reporting according to a business relationship, obtaining a counterpart organization of the source business organization based on a preset business relationship of the business system, and taking the counterpart organization as the target business organization;

[0074] If the business data reporting strategy is a self-defined business strategy, obtaining the target business organization based on a pre-constructed self-defined business logic.

[0075] In the embodiment, the optimal data transmission channel is determined through the shortest path algorithm, and the method further comprises:

[0076] When the source data center and the target data center can directly communicate, the data transmission channel only contains two nodes of the source data center and the target data center, otherwise, the data transmission channel will contain three or more nodes, that is, there will be other data centers as transit nodes between the source data center and the target data center.

[0077] In this embodiment, based on the simulation of data transmission channel data sending, it also includes:

[0078] The simulation data packet is constructed and sent based on the data transmission channel. When passing through the transit node, the transit node sends a successful arrival notification to the source node, and the simulation data packet is sent to the next node. When the source node receives the successful arrival notification of all subsequent nodes on the data transmission channel, the data transmission channel is considered available.

[0079] In this embodiment, the simulation of successful data transmission channel is cached in the pre-constructed data channel cache table, and it also includes:

[0080] The data channel cache table stores business applications, business types, source business organizations, target business organizations, and data transmission channels.

[0081] When adding, deleting data centers or changing the business applications, business types, business organizations, business sending strategies, communication relationships between data centers and other information of the data centers, the corresponding cached data in the data channel cache table is dynamically synchronized.

[0082] Embodiment two

[0083] A business data sending task dynamic generation system based on context awareness includes:

[0084] The business context acquisition module is configured to acquire the business context of the business event based on the changed business data of the business event, and the business context includes the information of the business application, the business type and the source business organization of the changed business data;

[0085] The sender data center determination module is configured to determine the data center deploying the business application and the source business organization based on the business application and the source business organization;

[0086] The data transmission channel determination module is configured to preferentially acquire information through the pre-constructed data channel cache table, and if the information is not acquired through this way, the information is acquired through the pre-constructed data center management pool. Information acquisition includes determining the data transmission channel of the source business organization sending the changed business data, and the target business organization and the target data center receiving the changed business data;

[0087] The data packet packaging module is configured to package the changed service data in batches according to service types and data generation times based on the service event, and dynamically generate a changed data packet.

[0088] The task generation and execution module is configured to dynamically generate corresponding data sending tasks based on the source service organization, the changed data packet, the target service organization and the data transmission channel, and execute the data sending tasks in batches according to a preset task resource allocation strategy.

[0089] Those skilled in the art will understand that embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROMs, optical storage devices, etc.) containing computer-usable program code. CD - ROM

[0090] The present application is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, as well as combinations of flows and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing apparatus to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing apparatus produce an apparatus that implements the functions specified in the flowcharts and / or block diagrams. Figure 1 The functions specified in one or more flows and / or blocks in the flowcharts and / or block diagrams. Figure 1 The functions specified in one or more flows and / or blocks in the flowcharts and / or block diagrams.

[0091] These computer program instructions can also be stored in a computer-readable memory that can direct the computer or other programmable data processing apparatus to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including instruction apparatus, which implements the functions specified in the flowcharts and / or block diagrams. Figure 1 The functions specified in one or more flows and / or blocks in the flowcharts and / or block diagrams. Figure 1 The functions specified in one or more flows and / or blocks in the flowcharts and / or block diagrams.

[0092] These computer program instructions can also be loaded onto a computer or other programmable data processing apparatus, so that a series of operation steps are performed on the computer or other programmable data processing apparatus to produce a computer-implemented process, so that the instructions executed on the computer or other programmable data processing apparatus provide a process for implementing the functions specified in the flowcharts and / or block diagrams. Figure 1 The functions specified in one or more flows and / or blocks in the flowcharts and / or block diagrams. Figure 1 ​steps of the functions specified in the one or more blocks.

[0093] The above descriptions are merely some embodiments of the present application, but are not intended to limit the present application. Within the spirit and principle of the present application, any modification, equivalent replacement, improvement, etc. made by those skilled in the art without creative effort should be included in the protection scope of the present application.

Claims

1. A method for dynamically generating business data transmission tasks based on context awareness, characterized in that, Includes the following steps: Based on business event monitoring, the business context of the business event is obtained, which includes information about the business application, business type, and source business organization that generated the changed business data. Based on the business application and the source business organization, determine the data center where the business application and the source business organization are deployed; Information is first obtained through a pre-built data channel cache table. If this method fails, information is obtained through a pre-built data center management pool. Information acquisition includes determining the data transmission channel through which the source business organization sends the changed business data, as well as the target business organization and target data center that receive the changed business data. Based on the business event, the changed business data is packaged in multiple batches according to business type and data generation time to dynamically generate change data packages; Based on the source business organization, the change data packet, the target business organization, and the data transmission channel, a corresponding data sending task is dynamically generated, and the data sending task is executed in batches according to a preset task resource allocation strategy. The process of acquiring information through a pre-built data center management pool includes: Based on the preset business data reporting strategy corresponding to the business type, the business data reporting strategy corresponding to the business type is obtained from the business system, and based on the business data reporting strategy, the target business organization that can receive the changed data is determined. Based on the business applications in the data center management pool and the target business organization, obtain the target data center; Based on the inter-data center communication relationships in the data center management pool, the optimal data transmission channel is determined using the shortest path algorithm; Simulate data transmission based on the optimal data transmission channel; The data transmission channel that successfully sends simulated data is cached in the data channel cache table; The process of determining the target business organization that can receive the changed data based on the business data reporting strategy includes: The business data reporting strategy supports reporting by administrative relationship, reporting by business relationship, and custom extended business data reporting strategy; If the business data reporting strategy is to report according to administrative relationship, then the reporting superior organization of the source business organization is obtained based on the preset administrative reporting relationship of the business system, and used as the target business organization. If the business data reporting strategy is to report based on business relationships, then based on the business relationships preset by the business system, the source business organization's business relationship organization is obtained as the target business organization; If the business data reporting strategy is a custom extended business data reporting strategy, the target business organization is obtained based on the pre-built custom business logic.

2. The method for dynamically generating business data transmission tasks based on context awareness as described in claim 1, characterized in that, The process of determining the data center for deploying the business application and the source business organization based on the business application and the source business organization includes: A data center management pool is pre-built to provide management for each data center. The management of each data center includes the management of its business applications, business types, business organizations, business data reporting strategies, and communication relationships between data centers.

3. The method for dynamically generating service data transmission tasks based on context awareness as described in claim 1, characterized in that, The data channel cache table stores business applications, business types, source business organizations, target business organizations, and data transmission channels that have been successfully simulated for data transmission. When data centers are added, deleted, or their business applications, business types, business organizations, business transmission strategies, and communication relationships between data centers are changed, the corresponding data in the data channel cache table is dynamically and synchronously updated.

4. The method for dynamically generating business data transmission tasks based on context awareness as described in claim 1, characterized in that, The process of determining the optimal data transmission channel using the shortest path algorithm includes: When the source data center and the target data center communicate directly, the data transmission channel contains only two nodes: the source data center and the target data center. Otherwise, the data transmission channel will contain three or more nodes, meaning that there is at least one other data center as a relay node between the source data center and the target data center.

5. The method for dynamically generating service data transmission tasks based on context awareness as described in claim 4, characterized in that, The process of simulating data transmission based on the optimal data transmission channel includes: A simulated data packet is constructed and sent based on the optimal data transmission channel. When it passes through the relay node, the relay node sends a successful arrival notification to the source node and sends the simulated data packet to the next node. When the source node receives successful arrival notifications from all subsequent nodes on the data transmission channel, the data transmission channel is considered a simulated successful data transmission channel.

6. The method for dynamically generating service data transmission tasks based on context awareness as described in claim 1, characterized in that, When dynamically generating corresponding data transmission tasks, if the data transmission channel contains three or more nodes, the data transmission task will contain multiple transmission activities, with one data transmission activity corresponding to each pair of adjacent nodes.

7. A context-aware dynamic generation system for business data transmission tasks, characterized in that, include: The business context acquisition module is configured to listen for changed business data based on business events and acquire the business context of the business events. The business context includes information about the business application, business type, and source business organization that generated the changed business data. The sender data center determination module is configured to determine the data center where the service application and the source service organization are deployed based on the service application and the source service organization; The data transmission channel determination module is configured to prioritize information acquisition through a pre-built data channel cache table. If the information is not acquired through this method, it will instead acquire information through a pre-built data center management pool. Information acquisition includes determining the data transmission channel through which the source business organization sends the changed business data, as well as the target business organization and target data center that receive the changed business data. The data packet packaging module is configured to package the changed business data in multiple batches according to the business type and data generation time based on the business event, and dynamically generate change data packets. The task generation and execution module is configured to dynamically generate corresponding data sending tasks based on the source business organization, the change data packet, the target business organization, and the data transmission channel, and to execute the data sending tasks in batches according to a preset task resource allocation strategy. The process of acquiring information through a pre-built data center management pool includes: Based on the preset business data reporting strategy corresponding to the business type, the business data reporting strategy corresponding to the business type is obtained from the business system, and based on the business data reporting strategy, the target business organization that can receive the changed data is determined. Based on the business applications in the data center management pool and the target business organization, obtain the target data center; Based on the inter-data center communication relationships in the data center management pool, the optimal data transmission channel is determined using the shortest path algorithm; Simulate data transmission based on the optimal data transmission channel; The data transmission channel that successfully sends simulated data is cached in the data channel cache table; The process of determining the target business organization that can receive the changed data based on the business data reporting strategy includes: The business data reporting strategy supports reporting by administrative relationship, reporting by business relationship, and custom extended business data reporting strategy; If the business data reporting strategy is to report according to administrative relationship, then the reporting superior organization of the source business organization is obtained based on the preset administrative reporting relationship of the business system, and used as the target business organization. If the business data reporting strategy is to report based on business relationships, then based on the business relationships preset by the business system, the source business organization's business relationship organization is obtained as the target business organization; If the business data reporting strategy is a custom extended business data reporting strategy, the target business organization is obtained based on the pre-built custom business logic.

Images