Scheduling system and method for banking data processing operation

Abstract

The invention discloses a scheduling system and method for banking data processing operation. The scheduling system for the banking data processing operation comprises a setting assembly and an operation maintenance assembly, wherein the setting assembly is used for supporting system definition and maintaining all parameters, and the operation maintenance assembly is used for supporting system operation and maintenance; the setting assembly comprises a setting library, a setting module and a rule engine module I; the operation maintenance assembly comprises an operation maintenance module, an operation library, an operation scheduling engine module and a rule engine module II. According to the system and the method, all data processing operations are loaded to one system based on an operation scheduling rule data model by taking the rule engine module I, the rule engine module II and the operation scheduling engine module as cores, so that the maximized utilization of system resources is achieved, and the automation and visualization of operation scheduling are achieved; the adjustment on size of operation parallelism can be carried out according to quantity of data processed, so that time windows of data processing are reduced; the system and the method can be applied to the data processing operation scheduling of large-sized data marts or data warehouses of banks.

Description

technical field [0001] The invention belongs to a scheduling system, in particular to a bank data processing operation scheduling system and a method thereof. Background technique [0002] At present, the business systems of banks, especially large banks, have accumulated massive business data after years of operation. Banks use these business data to build data warehouses or data marts, and develop data analysis applications and data mining applications to support and assist bank operations. [0003] Large banks have many business systems including core business systems, bank card systems, wealth management systems, online banking systems, intermediary business systems, etc. The data of all business systems generates data files during batch processing and is downloaded by a dedicated data downloading system to the temporary repository; due to the different batch processing time and download time of each business system, there are many data files and a large amount of data,...

AI Technical Summary

Problems solved by technology

[0003] Large banks have many business systems including core business systems, bank card systems, wealth management systems, online banking systems, intermediary business systems, etc. The data of all business systems generates data files during batch processing and is downloaded by a dedicated data downloading system to the temporary repository; due to the different batch processing time and download time of each business system, there are many data files and a large amount of data, and there are processing logics between business systems and data files, therefore, in a limited time In the window, these data files with different arrival times are processed from the temporary repository to the detail layer of the intermediate repository and the integration layer of the intermediate repository, and then processed from the intermediate repository to the target application library. The entire processing logic and process are complex and Flexible and diverse

[0004] The existing data processing system cannot meet the above requirements, and cannot regularize and parameterize the processing logic between business systems, data files, and jobs; it cannot load all data processing jobs in one system to realize the automation of job scheduling , visualization of management; it is also impossible to adjust the degree of job parallelism according to the system resources combined with the amount of data processed by the job, so as to achieve the purpose of maximizing the use of system resources, thereby reducing the data processing time window

Images