Data processing control method and device, computer device and data processing system

Abstract

The application relates to a data processing control method and device, computer equipment, a storage medium, a computer program product and a data processing system, relates to the technical field of big data, and can be applied to the field of financial technology or other related fields. The method comprises the following steps: receiving a task instruction for a target data processing task sent by a terminal, wherein the task instruction comprises a target region identifier and a target open platform identifier; obtaining host data corresponding to the target region identifier from a host database, and performing first data processing on the host data; and sending the processed host data to a target open platform corresponding to the target open platform identifier in a plurality of open platforms, so that the target open platform performs second data processing according to the processed host data, so as to complete the target data processing task. By adopting the method, the calculation resources can be saved, and the data processing efficiency is improved.

Description

Technical Field

[0001] This application relates to the field of big data technology, and in particular to a data processing control method, apparatus, computer equipment, storage medium, computer program product, and data processing system. Background Technology

[0002] With rapid economic development, people's financial activities are constantly increasing, and the volume of financial transactions is growing explosively, generating massive amounts of financial business data. This has placed new demands on the processing capabilities and security and reliability of data processing systems in various financial institutions. Currently, most financial institutions' data processing systems are based on mainframe systems (such as IBM mainframes) and combined with multiple open platforms to provide auxiliary functions, thereby completing the task of processing massive amounts of financial business data.

[0003] In the daily production scenarios of financial institutions, it is necessary to process all financial business data every day. For example, the mainframe system can process all business data of the day in batches during a preset period after the end of the day (such as statistical analysis of transaction data and account data), and then distribute the processed data to multiple open platforms (such as credit management platform, asset management platform, etc.) so that each open platform can carry out subsequent processing to complete the daily data processing task.

[0004] However, in some special scenarios, such as version testing and disaster recovery drills, it is generally only necessary to process a portion of the business data. If the full amount of business data is processed using the usual data processing methods, it will lead to a waste of computing resources and low processing efficiency. Summary of the Invention

[0005] Therefore, it is necessary to provide a data processing control method, apparatus, computer equipment, storage medium, computer program product, and data processing system that can save computing resources and improve processing efficiency in response to the above-mentioned technical problems.

[0006] Firstly, this application provides a data processing control method. The method is applied to a host system in a data processing system, which further includes a terminal and multiple open platforms. The method includes:

[0007] Receive a task instruction sent by the terminal for a target data processing task, the task instruction including a target region identifier and a target open platform identifier;

[0008] Retrieve host data corresponding to the target region identifier from the host database, and perform first data processing on the host data;

[0009] The processed host data is sent to the target open platform corresponding to the target open platform identifier among the plurality of open platforms, so that the target open platform performs a second data processing based on the processed host data to complete the target data processing task.

[0010] In one embodiment, the step of obtaining the host data corresponding to the target region identifier from the host database and performing a first data processing on the host data includes:

[0011] Based on a pre-stored batch identifier table, determine each batch identifier corresponding to each target region identifier, wherein the batch identifier table contains the correspondence between batch identifiers and region identifiers;

[0012] Retrieve host data corresponding to each target region identifier under each batch identifier from the host database;

[0013] The host data under each batch identifier is processed in parallel batches.

[0014] In one embodiment, the method further includes:

[0015] If no task instruction for the target data processing task is received from the terminal, the full amount of host data is obtained from the host database, and the full amount of host data is subjected to third-party data processing.

[0016] The processed full host data is sent to the multiple open platforms so that each open platform can perform a fourth data processing based on the processed full host data.

[0017] Secondly, this application also provides another data processing control method. The method is applied to a terminal in a data processing system, which further includes a host system and multiple open platforms. The method includes:

[0018] Obtain the target region identifier and the target open platform identifier corresponding to the target data processing task;

[0019] Based on the target region identifier and the target open platform identifier, generate task instructions for the target data processing task;

[0020] The task instruction is sent to the host system, so that the host system can obtain the host data corresponding to the target region identifier from the host database, perform a first data processing on the host data, and send the processed host data to the target open platform among the plurality of open platforms that corresponds to the target open platform identifier, so that the target open platform can perform a second data processing based on the processed host data, so as to complete the target data processing task.

[0021] In one embodiment, obtaining the target region identifier and the target open platform identifier corresponding to the target data processing task includes:

[0022] Obtain the notification file for the target data processing task;

[0023] The notification document is identified to determine the location name and business identifier contained in the notification document;

[0024] The target region identifier is determined based on the place name;

[0025] Based on the business identifier, the target open platform identifier is determined from the pre-stored correspondence between open platform identifiers and business identifiers.

[0026] In one embodiment, the method further includes:

[0027] The task instruction is sent to the target open platform corresponding to the target open platform identifier among the plurality of open platforms, so that the target open platform obtains the platform data corresponding to the target region identifier from the platform database corresponding to the target open platform according to the target region identifier contained in the task instruction, and performs second data processing according to the platform data and the processed host data sent by the host system, so as to complete the target data processing task.

[0028] Thirdly, this application also provides another data processing control method. The method is applied to an open platform in a data processing system, which further includes a host system and a terminal. The method includes:

[0029] Receive a task instruction sent by the terminal for a target data processing task, and determine the target region identifier contained in the task instruction;

[0030] Retrieve the platform data corresponding to the target region identifier from the platform database;

[0031] The system receives processed host data sent by the host system, and performs second data processing based on the platform data and the processed host data to complete the target data processing task. The processed host data sent by the host system is obtained by the host system from the host database according to the task instruction sent by the terminal, retrieving the host data corresponding to the target region identifier contained in the task instruction, and performing first data processing on the host data.

[0032] Fourthly, this application also provides a data processing control device. The device includes:

[0033] The receiving module is used to receive a task instruction sent by the terminal for a target data processing task, the task instruction including a target region identifier and a target open platform identifier;

[0034] The first processing module is used to obtain host data corresponding to the target region identifier from the host database and perform first data processing on the host data;

[0035] The sending module is used to send the processed host data to the target open platform corresponding to the target open platform identifier among the plurality of open platforms, so that the target open platform can perform a second data processing based on the processed host data to complete the target data processing task.

[0036] In one embodiment, the first processing module is specifically used for:

[0037] Based on a pre-stored batch identifier table, determine the batch identifier corresponding to each target region identifier, wherein the batch identifier table contains the correspondence between batch identifiers and region identifiers; retrieve the host data corresponding to each target region identifier under each batch identifier from the host database; and perform parallel batch processing on the host data under each batch identifier.

[0038] In one embodiment, the apparatus further includes a second processing module, configured to, in the absence of receiving a task instruction for a target data processing task sent by the terminal, obtain full host data from the host database and perform third data processing on the full host data; and send the processed full host data to the plurality of open platforms so that each of the open platforms performs fourth data processing based on the processed full host data.

[0039] Fifthly, this application also provides another data processing control device. The device includes:

[0040] The acquisition module is used to acquire the target region identifier and the target open platform identifier corresponding to the target data processing task;

[0041] The generation module is used to generate task instructions for the target data processing task based on the target region identifier and the target open platform identifier.

[0042] The first sending module is used to send the task instruction to the host system, so that the host system can obtain the host data corresponding to the target region identifier from the host database, perform a first data processing on the host data, and send the processed host data to the target open platform among the plurality of open platforms that corresponds to the target open platform identifier, so that the target open platform can perform a second data processing based on the processed host data, so as to complete the target data processing task.

[0043] In one embodiment, the acquisition module is specifically used for:

[0044] Obtain the notification file for the target data processing task; identify the notification file and determine the location name and business identifier contained in the notification file; determine the target region identifier based on the location name; and determine the target open platform identifier based on the business identifier in the pre-stored correspondence between open platform identifiers and business identifiers.

[0045] In one embodiment, the apparatus further includes a second sending module, configured to send the task instruction to a target open platform corresponding to the target open platform identifier among the plurality of open platforms, so that the target open platform obtains platform data corresponding to the target region identifier from the platform database corresponding to the target open platform according to the target region identifier contained in the task instruction, and performs second data processing according to the platform data and the processed host data sent by the host system, so as to complete the target data processing task.

[0046] Sixthly, this application also provides another data processing control device. The device includes:

[0047] The first receiving module is used to receive a task instruction sent by the terminal for a target data processing task, and to determine the target region identifier contained in the task instruction;

[0048] The acquisition module is used to obtain platform data corresponding to the target region identifier from the platform database;

[0049] The second receiving module is used to receive the processed host data sent by the host system, and perform second data processing based on the platform data and the processed host data to complete the target data processing task; wherein, the processed host data sent by the host system is obtained by the host system from the host database according to the task instruction sent by the terminal, retrieving the host data corresponding to the target region identifier contained in the task instruction, and performing first data processing on the host data.

[0050] Seventhly, this application also provides a data processing system. The data processing system includes a terminal, a host system, and multiple open platforms, wherein:

[0051] The terminal is used to send a task instruction to the host system for a target data processing task. The task instruction includes a target region identifier and a target open platform identifier.

[0052] The host system is configured to retrieve host data corresponding to the target region identifier from the host database, perform a first data processing on the host data, and send the processed host data to the target open platform corresponding to the target open platform identifier among the plurality of open platforms;

[0053] The target open platform is used to perform a second data processing based on the processed host data, so as to complete the target data processing task.

[0054] In one embodiment, the terminal is further configured to send the task instructions to the target open platform;

[0055] The target open platform is specifically used to obtain platform data corresponding to the target region identifier from the platform database, and perform second data processing based on the platform data and the processed host data to complete the target data processing task.

[0056] Eighthly, this application also provides a computer device. The computer device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the steps of the methods described in the first, second, or third aspects.

[0057] Ninthly, this application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program thereon, which, when executed by a processor, implements the steps of the methods described in the first, second, or third aspects.

[0058] In a tenth aspect, this application also provides a computer program product. The computer program product includes a computer program that, when executed by a processor, implements the steps of the methods described in the first, second, or third aspects.

[0059] The aforementioned data processing control method, apparatus, computer equipment, storage medium, computer program product, and data processing system receive task instructions for a target data processing task from a terminal via a host system. These task instructions include a target region identifier and a target open platform identifier. The host system then retrieves the host data corresponding to the target region identifier (business data stored in the host database) from the host database and performs a first data processing step on this data. The processed host data is then sent to the target open platform (the open platform corresponding to the target open platform identifier among multiple open platforms), allowing the target open platform to perform subsequent processing (i.e., a second data processing step) on the processed host data to complete the target data processing task. In this method, the host system only needs to process the business data corresponding to the target region identifier included in the task instruction and send the processed data to the target open platform for further processing. Therefore, the scope of business data to be processed and the open platforms that need to participate in the data processing can be limited according to the actual needs of the data processing task, avoiding the processing of unnecessary business data and avoiding the invocation of open platforms not participating in the current data processing task. This saves computing resources and improves data processing efficiency. Attached Figure Description

[0060] Figure 1 This is a schematic diagram of the structure of a data processing system in one embodiment;

[0061] Figure 2 This is a flowchart illustrating a data processing control method in one embodiment;

[0062] Figure 3 This is a flowchart illustrating the data processing control method in another embodiment;

[0063] Figure 4 This is a flowchart illustrating the data processing control method in another embodiment;

[0064] Figure 5 This is a structural block diagram of a data processing control device in one embodiment;

[0065] Figure 6 This is a structural block diagram of the data processing control device in another embodiment;

[0066] Figure 7 This is a structural block diagram of the data processing control device in another embodiment;

[0067] Figure 8 This is an internal structural diagram of a computer device in one embodiment. Detailed Implementation

[0068] To make the objectives, technical solutions, and advantages of this application clearer, the following detailed description is provided in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative and not intended to limit the scope of this application.

[0069] First, before introducing the technical solutions of the embodiments of this application in detail, let's first introduce the technical background or technical evolution on which the embodiments of this application are based. In the daily production scenarios of financial institutions, it is necessary to process all financial business data every day. For example, within a preset time period after the end of the day, the mainframe system (usually an IBM mainframe) can perform batch processing on all business data of the day (such as statistical analysis of transaction data and account data), and then distribute the processed data to multiple open platforms (such as credit management platforms, asset management platforms, accounting and clearing platforms, etc., different platforms provide different business functions), so that each open platform can perform subsequent processing to complete the daily data processing task.

[0070] However, in certain special scenarios, such as version testing, the focus is on targeted testing and verification of version changes and new features, as well as routine testing and verification of key business operations and transactions. Typically, testing and verification are conducted in selected regions (financial institutions often have multiple branches, which can be divided by region). Therefore, only business data from certain regions needs to be processed, and the testing may only involve a portion of business functions. Similarly, in disaster recovery drills, the current approach is to rotate drills across different regions, meaning each drill only targets a portion of the regions, thus requiring only the processing of business data from those regions. If the usual data processing methods are still used in these special scenarios, processing all business data, it will lead to a waste of computing resources and low processing efficiency. Against this backdrop, the applicant, through long-term research and development and experimental verification, proposes the data processing control method of this application, which can save computing resources and improve data processing efficiency. Furthermore, it should be noted that the applicant has devoted considerable creative effort to discovering the technical problems of this application and the technical solutions described in the following embodiments.

[0071] The data processing control method provided in this application embodiment can be applied to, for example... Figure 1The data processing system 100 shown includes a terminal 102, a host system 104, and multiple open platforms 106. The terminal 102, host system 104, and open platforms 106 communicate with each other via a network. The terminal 102 can be a business terminal of a financial institution, including but not limited to various personal computers, laptops, smartphones, tablets, and IoT devices. The host system 104 can be an IBM mainframe system. The open platforms 106 can be independent servers, server clusters consisting of multiple servers, or systems containing both terminals and servers.

[0072] In one embodiment, such as Figure 2 As shown, a data processing control method is provided, which is applied to... Figure 1 Taking the host system in the example, the following steps are included:

[0073] Step 201: Receive the task instruction sent by the terminal for the target data processing task.

[0074] The task instructions include the target region identifier and the target open platform identifier.

[0075] In implementation, the terminal can send task instructions for the target data processing task to the host system, which can then receive these instructions. For example, when the staff responsible for data processing receives a "version test task notification," they can determine the test regions and business functions involved based on the needs of this version test. They can then determine the target region identifier (which could be the region code corresponding to each test region) and the target open platform identifier (which provides the platform name for each business function involved in this test). The staff can input the target region identifier and the target open platform identifier into the terminal (such as a business terminal), causing the terminal to generate a task instruction for this data processing task (corresponding to this version test task) based on the target region identifier and the target open platform identifier, and send it to the host system.

[0076] Step 202: Obtain the host data corresponding to the target region identifier from the host database, and perform the first data processing on the host data.

[0077] The host database is the database corresponding to the host system, and the business data stored in the host database is simply referred to as host data. Host data generally includes business data such as transaction data and account data of all branches of the financial institution in the region. The business data of each branch can be stored in correspondence with the region identifier, that is, each piece of host data has a corresponding relationship with the region identifier.

[0078] In implementation, after receiving a task instruction, the host system can retrieve the host data corresponding to the target region identifier from the host database based on the target region identifier contained in the task instruction. Then, the host system can perform initial data processing on the host data corresponding to the target region identifier. The specific data processing method can be the same as routine data processing methods, such as business data statistical analysis, transaction supplementary accounting, automatic repayment of accounts upon maturity, and other accounting-related processing.

[0079] Step 203: Send the processed host data to the target open platform corresponding to the target open platform identifier among multiple open platforms, so that the target open platform can perform second data processing based on the processed host data to complete the target data processing task.

[0080] In implementation, after the host system performs the first data processing on the host data corresponding to the target region identifier, it can send the processed host data to the target open platform according to the target open platform identifier contained in the task instruction. The target open platform then performs the second data processing based on the processed host data to complete the target data processing task. The method of the second data processing performed by the target open platform can be the same as the routine data processing method. Specifically, it performs corresponding processing on the business data processed by the host system according to the business functions provided by the target open platform. For example, it performs verification, updates, and statistical analysis on the business data processed by the host system and the data stored locally on the platform.

[0081] Understandably, when the host system sends the processed business data to each target open platform, it can send all the data, or it can split the data according to the business functions of each target open platform and send only the required portion. After the target open platforms perform a second data processing, they can send the processed data to the regional servers corresponding to each target region identifier. This allows the regional servers to provide business data, process reports, and display them, facilitating on-demand use by staff. For example, for version testing tasks, staff can determine the test results based on the business data and reports provided.

[0082] In the aforementioned data processing control method, after receiving a task instruction from the terminal for a target data processing task, the host system performs first data processing on the host data corresponding to the target region identifier in the host database according to the target region identifier contained in the task instruction. Then, according to the target open platform identifier contained in the task instruction, it sends the processed host data to the target open platform, enabling the target open platform to perform subsequent processing (i.e., second data processing) on ​​the processed host data to complete the target data processing task. In this method, the host system only needs to process the business data corresponding to the target region identifier contained in the task instruction and send the processed data to the target open platform for further processing. Therefore, it can limit the scope of business data to be processed and the open platforms that need to participate in the data processing according to the actual needs of the data processing task, avoiding processing unnecessary business data and avoiding calling open platforms that do not need to participate in the current data processing task. This saves computing resources and improves data processing efficiency.

[0083] In one embodiment, the specific process of obtaining host data and performing the first data processing in step 202 includes the following steps: determining each batch identifier corresponding to each target region identifier according to a pre-stored batch identifier table, wherein the batch identifier table contains the correspondence between batch identifiers and region identifiers; obtaining host data corresponding to each target region identifier under each batch identifier from the host database; and performing parallel batch processing on the host data under each batch identifier.

[0084] In implementation, after receiving a task instruction, the host system can determine the batch identifier corresponding to the target region identifier contained in the task instruction based on a pre-stored batch identifier table. Specifically, the batch identifier table can be a batch number-region code mapping table, storing the correspondence between batch identifiers (e.g., batch number) and region identifiers (e.g., region code). Generally, one batch number corresponds to multiple region codes, which can be consecutive, forming a region code segment. As shown in Table 1, the batch identifier table contains 20 batch identifiers. For example, the region code corresponding to batch number "99" is all region codes from region code "0" to region code "101" (inclusive). The host system can control the batch processing of host data corresponding to each region code under each batch number, meaning each batch number can correspond to a separate batch processing channel, allowing for parallel batch processing of host data under each batch number. This can be controlled using IBM's TWS management software.

[0085] Table 1 Batch Identification Table

[0086]

[0087]

[0088] Once the host system determines the batch identifier corresponding to each target region identifier, it can identify the target region identifiers contained in each batch identifier. The host system can then retrieve the host data corresponding to each target region identifier under each batch identifier from the host database and perform parallel batch processing on the host data under each batch identifier. For example, batch number "2" in Table 1 corresponds to region codes between "102" and "299". If "102" to "299" only contains the three target region codes "110", "115", and "120", meaning the target region codes under batch number "2" are "110", "115", and "120", then the host system can retrieve only the host data corresponding to region codes "110", "115", and "120" and perform batch processing on the host data corresponding to these three region codes.

[0089] In another implementation, after determining the batch identifiers corresponding to each target region identifier, i.e., after determining the target region identifiers contained in each batch identifier, the host system can form a new batch identifier table (which can be called the target batch identifier table) based on each batch identifier and the target region identifiers corresponding to each batch identifier, as shown in Table 2. Here, "500~600" represents all region codes from region code "500" to region code "600" (inclusive). Then, the host system can use TWS management software (or TWS control tool) to read the target batch identifier table, obtain the service data (host data) corresponding to the target region identifiers under each batch number in the target batch identifier table, and perform parallel batch processing on the service data under each batch identifier.

[0090] Table 2 Target Batch Identification Table

[0091]

[0092]

[0093] Optionally, if there is no corresponding target region code under a certain batch number, the region code corresponding to the batch number can be represented by the region code with empty data (i.e. no data). Therefore, when the data under the batch number is actually processed, since there is no data under the region code it contains, empty processing can be skipped to meet the control requirement of TWS control tool to process (including empty processing) each batch. For example, in Table 2, the area codes "299" under batch "2" (i.e., batch number "2"), "1199" under batch "12", "3899" under batch "30", "4599" under batch "32", "4699" under batch "98", "4799" under batch "97", and "5200" under batch "40" are all empty area codes. That is, in this data processing task, none of these 7 batches contain the target area code, so empty processing is required. This improves processing efficiency, saves valuable computing resources, and does not require modification of the batch processing channel used in daily batch processing, thus saving the development and maintenance costs of the data processing system.

[0094] In this embodiment, the batch identifier corresponding to each target region identifier is determined according to the pre-stored batch identifier table, and the host data corresponding to each target region identifier under each batch identifier is processed in parallel batch, thereby improving data processing efficiency.

[0095] In one embodiment, the method further includes a processing step when no task instruction is received, specifically including: when no task instruction for the target data processing task is received from the terminal, obtaining the full amount of host data from the host database and performing third data processing on the full amount of host data; and sending the processed full amount of host data to multiple open platforms so that each open platform can perform fourth data processing based on the processed full amount of host data.

[0096] In implementation, if the host system does not receive the task instruction for the target data processing task sent by the terminal, it can retrieve the full host data from the host database, perform third data processing on the full host data, and send the processed full host data to multiple open platforms so that each open platform can perform fourth data processing based on the processed full host data. The specific methods for the third and fourth data processing can be the same as the methods used by the host system to perform daily data processing tasks in traditional methods.

[0097] In this embodiment, if the host system does not receive a task instruction, it can process all business data. That is, this method can be applied to data processing in various scenarios.

[0098] In one embodiment, such as Figure 3 As shown, it also provides applications for Figure 1 The data processing control method for the terminal in the middle includes the following steps:

[0099] Step 301: Obtain the target region identifier and the target open platform identifier corresponding to the target data processing task.

[0100] In practice, the terminal can obtain the target region identifier and the target open platform identifier corresponding to the target data processing task. For example, staff can input the target region identifier and the target open platform identifier for the target data processing task into the terminal, and the terminal can directly obtain the target region identifier and the target open platform identifier.

[0101] Step 302: Generate task instructions for the target data processing task based on the target region identifier and the target open platform identifier.

[0102] In practice, the terminal can generate task instructions for the target data processing task based on the target region identifier and the target open platform identifier. The specific form of the task instructions is not limited, but they contain the target region identifier and the target open platform identifier and can be read by the host system.

[0103] Step 303: Send the task instruction to the host system so that the host system can obtain the host data corresponding to the target region identifier from the host database, perform the first data processing on the host data, and send the processed host data to the target open platform corresponding to the target open platform identifier among multiple open platforms so that the target open platform can perform the second data processing based on the processed host data to complete the target data processing task.

[0104] In implementation, the terminal can send a task instruction for the target data processing task to the host system. This allows the host system to retrieve the host data corresponding to the target region identifier from the host database, perform first data processing on the host data, and then send the processed host data to the target open platform corresponding to the target open platform identifier among multiple open platforms. The target open platform then performs second data processing based on the processed host data to complete the target data processing task. The specific processing steps for this step can be found in the descriptions of steps 202 to 203 above, and will not be repeated here.

[0105] In this embodiment, the terminal generates a task instruction for the target data processing task based on the target region identifier and the target open platform identifier, and sends the task instruction to the host system. The host system then performs first data processing on the host data corresponding to the target region identifier in the host database, and subsequently sends the processed host data to the target open platform. The target open platform then performs subsequent processing (i.e., second data processing) on ​​the processed host data to complete the target data processing task. Therefore, the scope of business data to be processed and the open platforms that need to participate in the data processing can be limited according to the actual needs of the data processing task. This avoids the host system processing unnecessary business data and avoids calling open platforms that are not required to participate in the current data processing task, thus saving computing resources and improving data processing efficiency.

[0106] In one embodiment, the specific process of obtaining the target region identifier and the target open platform identifier in step 301 includes the following steps: obtaining the notification file of the target data processing task; identifying the notification file to determine the place name and business identifier contained in the notification file; determining the target region identifier based on the place name; and determining the target open platform identifier based on the business identifier in the pre-stored correspondence between open platform identifiers and business identifiers.

[0107] In implementation, the terminal can obtain notification files for target data processing tasks, such as "Version Test Task Notification" or "Disaster Recovery Drill Notification." These notification files can be in editable document or image format. The terminal can then recognize the notification files, for example, using text recognition algorithms or named entity recognition algorithms, to identify place names and business identifiers (such as credit business or accounting business). Place names can be provinces, autonomous regions, municipalities, or cities with independent planning status, such as Hebei Province or Beijing. The terminal can then determine the target region identifier based on the place name. For example, the terminal can look up the target region identifier corresponding to the place name in the notification file in a pre-stored table of place names and region identifiers. Understandably, if the notification file contains a provincial-level place name (such as Hebei Province), then the region identifiers (region codes) of all prefecture-level cities under that provincial-level place name are all target region identifiers. Furthermore, the terminal can determine the target open platform identifier based on the business identifiers contained in the notification file, using a pre-stored table of open platform identifiers and business identifiers. Since each open platform can generally provide different business functions, the identifiers of each open platform (such as open platform name or code) can be pre-stored in correspondence with the business functions they provide or the business identifiers of the business functions involved. If stored as a correspondence table, the terminal can determine the target open platform identifier by looking up the table.

[0108] In this embodiment, the terminal can intelligently identify the notification file of the target data processing task, determine the place name and business identifier contained in the notification file, and then determine the target region identifier and the target open platform identifier. Thus, the entire data processing process can be automated, saving labor costs and improving processing efficiency.

[0109] In one embodiment, the method further includes the step of sending a task instruction to a target open platform, specifically including: sending the task instruction to the target open platform corresponding to the target open platform identifier among multiple open platforms, so that the target open platform can obtain the platform data corresponding to the target region identifier from the platform database corresponding to the target open platform according to the target region identifier contained in the task instruction, and perform a second data processing according to the platform data and the processed host data sent by the host system, so as to complete the target data processing task.

[0110] In implementation, after generating a task instruction for the target data processing task, the terminal can send the task instruction to the target open platform corresponding to the target open platform identifier. This allows the target open platform to retrieve the platform data corresponding to the target region identifier from its platform database based on the target region identifier contained in the task instruction. Then, based on the platform data and the processed host data sent by the host system, it performs secondary data processing to complete the target data processing task. The specific processing procedures of the open platform will be explained in detail later and will not be repeated here.

[0111] In this embodiment, the terminal can also send task instructions to the target open platform, enabling the target open platform to retrieve the business data corresponding to the target region identifier from its platform database based on the target region identifier contained in the task instructions. This data is then processed together with the data sent by the host system to complete the target data processing task. This further limits the scope of business data that the target open platform needs to process, preventing it from processing unnecessary business data, thus further saving computing resources and improving data processing efficiency.

[0112] In one embodiment, such as Figure 4 As shown, it also provides applications for Figure 1 The data processing control method of the open platform includes the following steps:

[0113] Step 401: Receive the task instruction sent by the terminal for the target data processing task, and determine the target region identifier contained in the task instruction.

[0114] In implementation, the terminal can send task instructions for a target data processing task to a target open platform among multiple open platforms. The open platform (in the case of the target open platform) can receive the task instructions and determine the target region identifier contained in the task instructions. The process of generating task instructions can be referred to the relevant descriptions of steps 301 to 302 above, and will not be repeated here.

[0115] Step 402: Obtain the platform data corresponding to the target region identifier from the platform database.

[0116] Each open platform has its own database (referred to as the platform database) used to store local business data of the open platform or business data synchronized from other related systems (e.g., the credit management platform also needs to store business data synchronized from the People's Bank of China system). During data processing tasks, the open platform generally needs to process the business data stored in the platform database along with the data sent from the host system. The business data stored in the platform database (referred to as platform data) can be stored according to a region identifier.

[0117] During implementation, after receiving the task instruction, the target open platform can retrieve the business data (platform data) corresponding to the target region identifier from the platform database corresponding to the open platform, based on the target region identifier contained in the task instruction.

[0118] Step 403: Receive the processed host data sent by the host system, and perform second data processing based on the platform data and the processed host data to complete the target data processing task.

[0119] In implementation, the open platform (in the case of the target open platform) can receive processed host data sent by the host system. This processed host data is obtained by the host system retrieving the host data corresponding to the target region identifier contained in the task instruction sent by the terminal from the host database, and then performing a first data processing step on the host data. Then, the open platform can perform a second data processing step based on the platform data obtained in step 402 and the received processed host data to complete the target data processing task.

[0120] In this embodiment, the open platform can retrieve the business data corresponding to the target region identifier from its platform database based on the target region identifier included in the task instruction. This data is then processed together with the data sent by the host system to complete the target data processing task. Specifically, the data sent by the host system is obtained by retrieving the host data corresponding to the target region identifier from the host database based on the task instruction sent by the terminal, and then performing a first data processing step on that host data. In other words, in this method, the host system only needs to process the host data corresponding to the target region identifier, and the open platform only needs to process the platform data corresponding to the target region identifier. This avoids processing business data that is not required for the target data processing task, thus saving computing resources and improving data processing efficiency.

[0121] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0122] Based on the same inventive concept, this application also provides a data processing system for implementing the data processing control method described above. The solution provided by this system is similar to the implementation scheme described in the above method; therefore, the specific limitations in one or more data processing system embodiments provided below can be found in the limitations on data processing control described above, and will not be repeated here.

[0123] In one embodiment, a data processing system is provided, including a terminal, a host system, and multiple open platforms, wherein:

[0124] The terminal is used to send task instructions to the host system for the target data processing task. The task instructions include the target region identifier and the target open platform identifier.

[0125] The host system is used to retrieve host data corresponding to the target region identifier from the host database, perform first data processing on the host data, and send the processed host data to the target open platform corresponding to the target open platform identifier among multiple open platforms.

[0126] The target open platform is used to perform secondary data processing based on the processed host data in order to complete the target data processing task.

[0127] In one embodiment, the terminal is also used to send task instructions to the target open platform.

[0128] The target open platform is specifically used to obtain platform data corresponding to the target region identifier from the platform database, and to perform second data processing based on the platform data and the processed host data in order to complete the target data processing task.

[0129] Based on the same inventive concept, this application also provides a data processing control device for implementing the data processing control method described above. The solution provided by this device is similar to the implementation scheme described in the above method; therefore, the specific limitations in one or more data processing control device embodiments provided below can be found in the limitations of the data processing control method described above, and will not be repeated here.

[0130] In one embodiment, such as Figure 5 As shown, a data processing control device 500 is provided, including: a receiving module 501, a first processing module 502, and a transmitting module 503, wherein:

[0131] The receiving module 501 is used to receive the task instruction sent by the terminal for the target data processing task. The task instruction includes the target region identifier and the target open platform identifier.

[0132] The first processing module 502 is used to obtain host data corresponding to the target region identifier from the host database and perform first data processing on the host data.

[0133] The sending module 503 is used to send the processed host data to the target open platform corresponding to the target open platform identifier among multiple open platforms, so that the target open platform can perform second data processing based on the processed host data to complete the target data processing task.

[0134] In one embodiment, the first processing module 502 is specifically used for:

[0135] Based on the pre-stored batch identifier table, determine the batch identifier corresponding to each target region identifier. The batch identifier table contains the correspondence between batch identifiers and region identifiers. Retrieve the host data corresponding to each target region identifier under each batch identifier from the host database. Perform parallel batch processing on the host data under each batch identifier.

[0136] In one embodiment, the device 500 further includes a second processing module, configured to, in the absence of receiving a task instruction from the terminal for a target data processing task, retrieve the full amount of host data from the host database and perform third data processing on the full amount of host data; and send the processed full amount of host data to multiple open platforms so that each open platform performs fourth data processing based on the processed full amount of host data.

[0137] In one embodiment, such as Figure 6 As shown, another data processing control device 600 is also provided, including an acquisition module 601, a generation module 602, and a first transmission module 603, wherein:

[0138] The acquisition module 601 is used to acquire the target region identifier and the target open platform identifier corresponding to the target data processing task.

[0139] The generation module 602 is used to generate task instructions for the target data processing task based on the target region identifier and the target open platform identifier.

[0140] The first sending module 603 is used to send task instructions to the host system, so that the host system can obtain host data corresponding to the target region identifier from the host database, perform first data processing on the host data, and send the processed host data to the target open platform corresponding to the target open platform identifier among multiple open platforms, so that the target open platform can perform second data processing based on the processed host data, so as to complete the target data processing task.

[0141] In one embodiment, the acquisition module 601 is specifically used for:

[0142] Obtain the notification file for the target data processing task; identify the notification file and determine the location name and business identifier contained in the notification file; determine the target region identifier based on the location name; and determine the target open platform identifier based on the business identifier in the pre-stored correspondence between open platform identifiers and business identifiers.

[0143] In one embodiment, the device 600 further includes a second sending module, configured to send a task instruction to a target open platform corresponding to a target open platform identifier among multiple open platforms, so that the target open platform obtains platform data corresponding to the target region identifier from the platform database corresponding to the target open platform according to the target region identifier contained in the task instruction, and performs second data processing according to the platform data and the processed host data sent by the host system, so as to complete the target data processing task.

[0144] In one embodiment, such as Figure 7As shown, another data processing control device 700 is also provided, including a first receiving module 701, an acquisition module 702, and a second receiving module 703, wherein:

[0145] The first receiving module 701 is used to receive a task instruction sent by the terminal for a target data processing task, and to determine the target area identifier contained in the task instruction.

[0146] The acquisition module 702 is used to obtain platform data corresponding to the target region identifier from the platform database.

[0147] The second receiving module 703 is used to receive the processed host data sent by the host system, and perform second data processing based on the platform data and the processed host data to complete the target data processing task; wherein, the processed host data sent by the host system is obtained by the host system from the host database according to the task instruction sent by the terminal, obtaining the host data corresponding to the target region identifier contained in the task instruction, and performing first data processing on the host data.

[0148] Each module in the aforementioned data processing control device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of a computer device in hardware form or independent of it, or stored in the memory of a computer device in software form, so that the processor can call and execute the operations corresponding to each module.

[0149] In one embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 8 As shown, the computer device includes a processor, memory, and a network interface connected via a system bus. The processor provides computational and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database stores data required or generated for executing the aforementioned data processing control method. The network interface communicates with external terminals via a network connection. When the computer program is executed by the processor, it implements a data processing control method.

[0150] Those skilled in the art will understand that Figure 8 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0151] In one embodiment, a computer device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the steps in the above-described method embodiments.

[0152] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, which, when executed by a processor, implements the steps in the above method embodiments.

[0153] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, implements the steps in the above method embodiments.

[0154] The data processing control method, apparatus, computer equipment, storage medium, computer program product, and data processing system provided in this application relate to the field of big data technology and can be used in the field of financial technology or other related fields. This application does not limit the application field.

[0155] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0156] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, etc., and are not limited to these.

[0157] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0158] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A data processing control method, characterized in that, The method is applied to a host system in a data processing system, which also includes terminals and multiple open platforms. Different open platforms provide different business functions. The method includes: Receive a task instruction sent by the terminal for a target data processing task, the task instruction including a target region identifier and a target open platform identifier; Based on the target region identifier, the host data corresponding to the target region identifier is obtained from the host database of the host system, and the host data is subjected to a first data processing, wherein the first data processing includes statistical analysis or accounting processing. According to the target open platform identifier, the processed host data is sent to the target open platform corresponding to the target open platform identifier among the plurality of open platforms, so that the target open platform performs a second data processing based on the processed host data to complete the target data processing task, wherein the second data processing includes data verification, updating or statistical analysis processing; If no task instruction for the target data processing task is received from the terminal, the full amount of host data is obtained from the host database of the host system, and the full amount of host data is subjected to third-party data processing. The processed full host data is sent to the multiple open platforms so that each open platform can perform a fourth data processing based on the processed full host data.

2. The method according to claim 1, characterized in that, Retrieve host data corresponding to the target region identifier from the host database, and perform a first data processing on the host data, including: Based on a pre-stored batch identifier table, determine each batch identifier corresponding to each target region identifier, wherein the batch identifier table contains the correspondence between batch identifiers and region identifiers; Retrieve host data corresponding to each target region identifier under each batch identifier from the host database; The host data under each batch identifier is processed in parallel batches.

3. A data processing control method, characterized in that, The method is applied to a terminal in a data processing system, which also includes a host system and multiple open platforms. Different open platforms provide different business functions. The method includes: Obtain the target region identifier and the target open platform identifier corresponding to the target data processing task; Based on the target region identifier and the target open platform identifier, generate task instructions for the target data processing task; The task instruction is sent to the host system, so that the host system can obtain the host data corresponding to the target region identifier from the host database, perform a first data processing on the host data, and send the processed host data to the target open platform among the multiple open platforms that corresponds to the target open platform identifier, so that the target open platform can perform a second data processing based on the processed host data to complete the target data processing task. The first data processing includes statistical analysis or accounting processing, and the second data processing includes data verification, updating, or statistical analysis processing. If the terminal does not send a task instruction for the target data processing task, the host system shall obtain the full amount of host data from the host database and perform third data processing on the full amount of host data; and send the processed full amount of host data to the multiple open platforms, so that each of the open platforms shall perform fourth data processing based on the processed full amount of host data.

4. The method according to claim 3, characterized in that, The acquisition of the target region identifier and the target open platform identifier corresponding to the target data processing task includes: Obtain the notification file for the target data processing task; The notification document is identified to determine the location name and business identifier contained in the notification document; The target region identifier is determined based on the place name; Based on the business identifier, the target open platform identifier is determined from the pre-stored correspondence between open platform identifiers and business identifiers.

5. The method according to claim 3, characterized in that, The method further includes: The task instruction is sent to the target open platform corresponding to the target open platform identifier among the plurality of open platforms, so that the target open platform obtains the platform data corresponding to the target region identifier from the platform database corresponding to the target open platform according to the target region identifier contained in the task instruction, and performs second data processing according to the platform data and the processed host data sent by the host system, so as to complete the target data processing task.

6. A data processing control method, characterized in that, The method is applied to multiple open platforms in a data processing system. These open platforms provide different business functions. The data processing system also includes a host system and terminals. The method includes: Receive a task instruction sent by the terminal for a target data processing task, and determine the target region identifier contained in the task instruction; Obtain the platform data corresponding to the target region identifier from the platform database of the open platform; The system receives processed host data sent by the host system, and performs second data processing based on the platform data and the processed host data to complete the target data processing task. The processed host data sent by the host system is obtained by the host system from the host database based on the task instruction sent by the terminal, retrieving the host data corresponding to the target region identifier contained in the task instruction, and performing first data processing on the host data. The first data processing includes statistical analysis or accounting processing, and the second data processing includes data verification, updating, or statistical analysis processing. The system receives the processed full host data sent by the host system, performs a fourth data processing on the processed full host data, wherein the processed full host data is the full host data obtained by the host system from the host database when it has not received a task instruction for the target data processing task sent by the terminal, and performs a third data processing on the full host data.

7. A data processing system, characterized in that, The data processing system includes a terminal, a host system, and multiple open platforms. Different open platforms provide different business functions, among which: The terminal is used to send a task instruction to the host system for a target data processing task. The task instruction includes a target region identifier and a target open platform identifier. The host system is configured to retrieve host data corresponding to the target region identifier from the host database based on the target region identifier, and perform a first data processing on the host data; and send the processed host data to the target open platform among the plurality of open platforms that corresponds to the target open platform identifier, wherein the first data processing includes statistical analysis or accounting processing; The terminal is also used to send the task instructions to the target open platform; The target open platform is specifically used to obtain platform data corresponding to the target region identifier from the platform database, and perform second data processing based on the platform data and the processed host data to complete the target data processing task. The second data processing includes data verification, updating or statistical analysis processing. The host system is also configured to, in the absence of receiving a task instruction for the target data processing task sent by the terminal, obtain the full amount of host data from the host database of the host system, perform third data processing on the full amount of host data, and send the processed full amount of host data to the multiple open platforms. The open platform is also used to perform a fourth data processing based on the processed full host data.

8. A data processing control device, characterized in that, The device includes: The receiving module is used to receive task instructions sent by the terminal for a target data processing task. The task instructions include a target region identifier and a target open platform identifier. The first processing module is used to obtain host data corresponding to the target region identifier from the host database of the host system according to the target region identifier, and to perform a first data processing on the host data, wherein the first data processing includes statistical analysis or accounting processing. The sending module is used to send the processed host data to the target open platform corresponding to the target open platform identifier among multiple open platforms according to the target open platform identifier, so that the target open platform performs a second data processing according to the processed host data to complete the target data processing task. The second data processing includes data verification, updating or statistical analysis processing, and the different platforms of the multiple open platforms provide different business functions. The second processing module is configured to, in the absence of receiving a task instruction for the target data processing task sent by the terminal, obtain the full amount of host data from the host database of the host system, and perform third data processing on the full amount of host data; and send the processed full amount of host data to the multiple open platforms so that each of the open platforms can perform fourth data processing based on the processed full amount of host data.

9. A data processing control device, characterized in that, The device includes: The acquisition module is used to acquire the target region identifier and the target open platform identifier corresponding to the target data processing task; The generation module is used to generate task instructions for the target data processing task based on the target region identifier and the target open platform identifier. A first sending module is used to send the task instruction to the host system, so that the host system can obtain the host data corresponding to the target region identifier from the host database, perform a first data processing on the host data, and send the processed host data to a target open platform among multiple open platforms that corresponds to the target open platform identifier, so that the target open platform can perform a second data processing based on the processed host data to complete the target data processing task. The first data processing includes statistical analysis or accounting processing, and the second data processing includes data verification, updating, or statistical analysis processing. If the terminal does not send a task instruction for the target data processing task, the host system can obtain all the host data from the host database, perform a third data processing on the all-inclusive host data, and send the processed all-inclusive host data to the multiple open platforms, so that each open platform can perform a fourth data processing based on the processed all-inclusive host data. Different platforms among the multiple open platforms provide different business functions.

10. A data processing control device, characterized in that, The device includes: The first receiving module is used to receive a task instruction sent by the terminal for a target data processing task, and to determine the target region identifier contained in the task instruction; The acquisition module is used to obtain platform data corresponding to the target region identifier from the platform database of the open platform; The second receiving module is used to receive processed host data sent by the host system, and perform second data processing based on the platform data and the processed host data to complete the target data processing task; wherein, the processed host data sent by the host system is obtained by the host system from the host database according to the task instruction sent by the terminal, retrieving the host data corresponding to the target region identifier contained in the task instruction, and performing first data processing on the host data, wherein the first data processing includes statistical analysis or accounting processing, and the second data processing includes data verification, updating or statistical analysis processing; The second receiving module is further configured to receive the processed full host data sent by the host system, and perform a fourth data processing on the processed full host data. The processed full host data is the full host data obtained by the host system from the host database when it has not received a task instruction for the target data processing task sent by the terminal, and a third data processing is performed on the full host data.

11. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 2, 3 to 5, or 6.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 2, 3 to 5, or 6.

13. A computer program product, comprising a computer program, characterized in that, When executed by a processor, the computer program implements the steps of the method according to any one of claims 1 to 2, 3 to 5, or 6.

Images