A business processing method and a business processing platform

Abstract

The present disclosure provides a business processing method and a business processing platform, which are applied to the computer field. The method includes: a source system sends operation data to the database through a data bus system according to a preset cycle; the database receives the operation data, processes the operation data according to a first processing rule, and obtains at least one data set; the data processing system obtains at least one business requirement of the application system, obtains at least one target data set according to the at least one business requirement, performs data processing on the at least one target data set, and obtains at least one processing result; the application system performs business processing according to the at least one processing result to obtain a business processing result. By combining the database, the data processing system and the business system, the business processing efficiency of the business processing platform is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a business processing method and a business processing platform. Background Art

[0002] In the existing technology, digitalization is the transformation direction of the financial industry's business processing platform. In actual use, only by ensuring the accuracy and timeliness of the data can the business value of the data be maximized to serve the application system.

[0003] However, with the increase in customers and business types, the efficiency of data transmission and business processing will be affected, which in turn affects the service performance of the entire business processing platform. Summary of the invention

[0004] The present disclosure provides a business processing method and a business processing platform to at least solve the above technical problems existing in the prior art.

[0005] In a first aspect, an embodiment of the present disclosure provides a business processing method, which is applied to a business processing platform; the platform includes: a post source system, a database, a data processing system, and an application system; the post source system is connected to the database via a data bus system; the database is connected to the data processing system and the application system respectively;

[0006] The method comprises:

[0007] The source system sends the operation data to the database through the data bus system according to a preset period;

[0008] The database receives the operation data, and processes the operation data according to a first processing rule to obtain at least one data set;

[0009] The data processing system obtains at least one business requirement of the application system, obtains at least one target data set according to the at least one business requirement, and performs data processing on the at least one target data set to obtain at least one processing result;

[0010] The application system performs business processing according to the at least one processing result to obtain a business processing result.

[0011] In a second aspect, an embodiment of the present disclosure provides a business processing platform, the business processing platform comprising: a post source system, a database, a data processing system, and an application system; the post source system is connected to the database via a data bus system; the database is connected to the data processing system and the application system respectively;

[0012] The source system is used to send the operation data to the database through the data bus system according to a preset period;

[0013] The database is used to receive the operation data and process the operation data according to a first processing rule to obtain at least one data set;

[0014] The data processing system is used to obtain at least one business requirement of the application system, obtain at least one target data set according to the at least one business requirement, perform data processing on the at least one target data set, and obtain at least one processing result;

[0015] The application system is used to perform business processing according to the at least one processing result to obtain a business processing result.

[0016] The business processing method and business processing platform provided by the embodiments of the present disclosure include: the source system sends the operation data to the database through the data bus system according to a preset cycle; the database receives the operation data, processes the operation data according to a first processing rule, and obtains at least one data set; the data processing system obtains at least one business requirement of the application system, obtains at least one target data set according to the at least one business requirement, performs data processing on the at least one target data set, and obtains at least one processing result; the application system performs business processing according to the at least one processing result to obtain a business processing result.

[0017] In this way, the data processing system can process at least one business requirement in parallel to obtain processing results, thereby improving business processing efficiency, and each processing result is transmitted to the business system separately, thereby improving data transmission efficiency.

[0018] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 A flowchart of a business processing method provided by an embodiment of the present disclosure;

[0020] Figure 2 A schematic diagram of the structure of a business processing platform provided in an embodiment of the present disclosure;

[0021] Figure 3 A schematic diagram of the structure of a business processing platform provided for an application embodiment of the present disclosure. DETAILED DESCRIPTION

[0022] In order to make the purpose, features, and advantages of the present disclosure more obvious and easy to understand, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present disclosure.

[0023] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it can be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0024] In the following description, the terms "first\second" involved are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present disclosure described herein can be implemented in an order other than that illustrated or described herein.

[0025] Unless otherwise defined, all technical and scientific terms used in this disclosure have the same meaning as those commonly understood by those skilled in the art to which this disclosure belongs. The terms used in this disclosure are only for the purpose of describing the embodiments of this disclosure and are not intended to limit this disclosure.

[0026] It should be understood that in the various embodiments of the present disclosure, the size of the serial number of each implementation process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present disclosure.

[0027] Figure 1 A flowchart of a business processing method provided by an embodiment of the present disclosure is shown in FIG. Figure 1 As shown, the method is applied to a business processing platform; the platform includes: a post source system, a database, a data processing system, and an application system; the post source system, the data processing system, and the application system are connected to the database via a data bus system respectively; the data processing system is connected to the application system; the method includes:

[0028] Step 101, the source system sends the operation data to the database through the data bus system according to a preset period;

[0029] Step 102: The database receives the operation data and processes the operation data according to a first processing rule to obtain at least one data set;

[0030] Step 103: The data processing system obtains at least one business requirement of the application system, obtains at least one target data set according to the at least one business requirement, and performs data processing on the at least one target data set to obtain at least one processing result.

[0031] Step 104: The application system performs business processing according to the at least one processing result to obtain a business processing result.

[0032] In some embodiments, the method further comprises:

[0033] After receiving at least one business requirement of the application system, the data processing system performs demand relationship analysis according to the at least one business requirement to obtain at least one target business requirement; each of the target business requirements is used to implement business processing of one or more business requirements;

[0034] Determine a second processing rule corresponding to each of the target business requirements; the second processing rule is used to indicate a data set required for business processing and a processing strategy for the data set.

[0035] Specifically, the database contains all business scopes and data, and gathers data sets from multiple data sources; therefore, a data processing system can be provided to obtain and process the data sets according to each business requirement of the application system, and obtain a solution corresponding to each business requirement. At the same time, it is also considered that the business requirements of each application in the application system have complex business logic and are not very common, that is, the business requirements of each application need to be processed separately, which may lead to problems such as long time required and poor efficiency. Therefore, it is proposed to summarize the complex business and extract a common business logic, so as to meet multiple business requirements with the implementation of a common business logic, that is, to determine the target business requirements corresponding to multiple business requirements, so as to improve the processing efficiency of the data processing system, and then improve the timeliness of the business processing method.

[0036] Specifically, a flat design data link idea is proposed to extract the common logic of each business requirement within the application system and reduce the repeated processing of the same logic. That is, the data processing system can receive at least one business requirement of the application system, perform demand relationship analysis based on the at least one business requirement, and extract at least one target business requirement. The target business requirement is a common logic requirement that can meet multiple business requirements, where the multiple means two or more.

[0037] For example, a business requirement is to screen a specific customer group and then process various early warning factors of the corresponding customer group. In the related art, chimney-style construction is carried out according to each requirement, and requirement a realizes the processing of customer group a, and requirement b realizes the processing of customer group b. However, through the method disclosed in the present invention, the above requirements can be completed through a dedicated customer group processing unit, and multiple customer groups can be processed once, without the need to perform the same or similar processing on each requirement separately.

[0038] Assume that the first request of the application system includes:

[0039] Demand a, assuming it is loan warning demand, is targeted at customer group a: such as college students, unemployed customers, etc.;

[0040] b demand is assumed to be a business recommendation demand, where business recommendations include loan recommendations, deposit project recommendations, etc., targeting b customer group: employed staff.

[0041] The data processing system will summarize and extract the loan recommendation assessment needs for customer group a and customer group b as the target business needs, that is, the target business needs are to conduct loan security assessments on customer groups a and b to obtain assessment scores; the assessment scores can be used for both loan risk warnings and loan business recommendations; specifically, the higher the assessment score, the lower the loan risk, and the more worthy the loan business is to be recommended.

[0042] In this way, a target business requirement that can meet multiple business requirements is determined, and a processing result that can meet multiple business requirements is obtained by processing the target business requirement; that is, the results of multiple business requirements are obtained through one data processing, which greatly reduces the time and resource consumption of data processing, improves the efficiency of data processing, and then improves the business processing efficiency of the application system. In addition, only one processing result needs to be transmitted, which also improves the data transmission efficiency. The processing efficiency and data transmission efficiency of the business processing platform are improved as a whole.

[0043] In some embodiments, the second processing rule is further used to indicate an intermediate process table corresponding to each target business requirement; the intermediate process table is used to record data and / or processing results required for business processing according to the second processing rule;

[0044] The method further comprises:

[0045] According to the second processing rule, an intermediate process table is established.

[0046] Specifically, in order to achieve the processing of target business requirements, an intermediate process table can be provided to record the data and / or processing results required for business processing, so as to facilitate processing and recording.

[0047] Combined with the above example, in order to achieve the above loan recommendation evaluation for customer groups A and B, multiple customer groups can be processed uniformly first, for example, valid credit customers (with valid credit limit or loan balance greater than 0) are screened to form a loan customer table (which can be understood as an intermediate process table);

[0048] When the target business requirements corresponding to requirements a and b are achieved, the customer group types (such as whether they are working or not) are distinguished from the loan customer table based on the loan customer's age, job and other information, without additional repeated processing;

[0049] At the same time, other relevant information of the customer is recorded in the loan customer table, and the loan safety assessment is performed based on this information to obtain the assessment score. Here, the information required for the loan safety assessment and the assessment rules can be set based on the actual situation and are not limited here.

[0050] After obtaining the evaluation results, the customer information and the evaluation results can be recorded together in a loan customer table and sent to the application system. The application system can implement multiple businesses based on the loan customer table.

[0051] It should be noted that, in order to facilitate calculations, other intermediate process tables can also be constructed to adapt to the flexible and changeable needs of the application system. For example, it is necessary to rate the customer's assets, liabilities, historical performance, credit, etc. Among them, the historical performance and liabilities must be repeatedly associated and called with the credit limit and business information. Therefore, a credit limit business association information table can be provided, which stores information such as low-risk signs, credit limit signs, and credit product types. No matter how the application system's data requirements change, relevant information can be obtained from this credit limit business association information table (intermediate process table), avoiding repeated processing of credit limits and business information after each new requirement is raised. Here is only an example, and there is no limitation on the number and format of the intermediate process tables used.

[0052] In some embodiments, the data processing system includes: at least one application unit;

[0053] The second processing rule is further used to indicate the application unit corresponding to each target business requirement;

[0054] The acquiring the at least one data set according to the at least one business requirement, and performing data processing on the at least one data set according to a second processing rule to obtain at least one processing result includes:

[0055] The business unit corresponding to the target business requirement obtains at least one target data set from the database according to a second processing rule;

[0056] Performing data processing on the at least one target data set according to the second processing rule to obtain a processing result, and saving the processing result to an intermediate process table corresponding to the second processing rule;

[0057] The method further comprises:

[0058] The business unit corresponding to the target business requirement sends the processed intermediate process table to the application system.

[0059] Specifically, the data processing system includes: at least one application unit, the application unit is pre-designed and stored in the data processing system, each application unit corresponds to a target business requirement;

[0060] After determining the target business requirement, the application unit corresponding to the target business requirement obtains at least one target data set from the database, processes the at least one target data set, obtains a processing result, and saves the processing result to the intermediate process table corresponding to the second processing rule. In this way, through the application unit of common logic, the diversified requirements of the application system can be better supported to achieve a "small but precise" business processing effect.

[0061] Specifically, there is no calling relationship between each application unit. All of them obtain data from the database, process it accordingly, and then send it to the application system. In this way, each application unit works independently and follows the principle of flatness as much as possible to ensure the timeliness of data to the greatest extent. In addition, there is no dependency between application units, which means that a true application layer is realized, effectively reducing the time spent on data processing in the data processing system.

[0062] Specifically, the data processing system can provide predefined second processing rules, application units, etc., and can also use program scripts such as reports and data analysis tools to provide data access and analysis capabilities to support the decision-making and business processing needs of the business system.

[0063] Among them, the application unit can be pre-designed and saved in the data processing system, and the corresponding application unit can be directly called for data processing when applied. Each application unit must meet the target indicators, such as the script's running time, the memory occupied during runtime, and other indicators. During the application unit design process, if the test application unit cannot meet the target indicators, it needs to be optimized until it meets the hard requirements.

[0064] It should be noted that the second processing rule and the setting of the application unit can be set based on the actual application scenario without limitation.

[0065] In some embodiments, performing a demand relationship analysis according to the at least one business demand to obtain at least one target business demand includes:

[0066] Taking the first principle as the goal, performing a demand relationship analysis according to the at least one business requirement to obtain at least one target business requirement;

[0067] The first principle includes: meeting as many business needs as possible with as few target business needs as possible.

[0068] In actual application, in order to perform demand relationship analysis according to the at least one business demand and obtain at least one target business demand, a method for determining a target business demand is provided.

[0069] Based on this, in some embodiments, performing demand relationship analysis according to the at least one business demand to obtain at least one target business demand includes one of the following:

[0070] Determine at least one target business requirement corresponding to at least one business requirement according to the requirement relationship table;

[0071] The at least one business requirement is identified by using a preset recognition model to determine at least one target business requirement corresponding to the at least one business requirement; the recognition model is obtained by training a neural network model based on a training data set; the training data set includes multiple training data, each training data includes: multiple business requirements and target business requirements corresponding to the multiple business requirements.

[0072] Specifically, a demand relationship table can be pre-established and saved in a data processing system. The demand relationship table is used to indicate at least the common logic that can be extracted for each business requirement, as well as the target business requirement for implementing the common logic; that is, by querying the demand relationship table based on at least one business requirement, the target business requirement corresponding to each business requirement can be determined, and by comparing the target business requirements corresponding to each business requirement, the target business requirement that simultaneously meets multiple business requirements can be obtained.

[0073] Specifically, the recognition model is obtained by training a neural network model based on a training data set; the training data set includes multiple training data, each training data includes: multiple business requirements and target business requirements corresponding to the multiple business requirements. Multiple business requirements can be used as input in advance, and the target business requirements corresponding to the multiple business requirements can be used as labels, and input into the neural network model for training to obtain a trained neural network model as the recognition model. When applied, the recognition model is used to identify at least one received business requirement to obtain a recognition result, which includes a recommended target business requirement and multiple business requirements corresponding to each target business requirement.

[0074] Of course, the method of determining the target business needs corresponding to multiple business needs (such as the above-mentioned loan warning needs and loan recommendation needs) can be determined based on preset rules using a demand relationship table, or a neural network model can be used to identify and determine multiple business needs. Other methods can also be used. Here, there is no limitation on the method of extracting target business needs with common logic after aggregating business needs.

[0075] For example, the first request of the business system includes the following business requirements, and each business requirement can correspond to one or more target business requirements:

[0076] Business requirement 1 is achieved through target business requirement 1 or target business requirement 2;

[0077] Business requirement 2 is achieved through target business requirement 1 or target business requirement 2;

[0078] Business requirement 3 is achieved through target business requirement 2 or target business requirement 3;

[0079] Business requirement 4 is achieved through target business requirement 2 or target business requirement 4;

[0080] Business requirement 5 is achieved through target business requirement 3.

[0081] Then, according to the above method, a variety of target business requirements can be determined. For example, any of the following results can be determined:

[0082] The first type, target business requirement 2, is used to implement the business processing of business requirements 1, 2, 3, and 4; target business requirement 3 is used to implement the business processing of business requirement 5;

[0083] or,

[0084] The second type, target business requirement 2, is used to implement the business processing of business requirements 1, 2, and 4; target business requirement 3 is used to implement the business processing of business requirements 3 and 5;

[0085] or,

[0086] The third type, target business requirement 1, is used to implement the business processing of business requirements 1 and 2; target business requirement 2 is used to implement the business processing of business requirements 3 and 4; target business requirement 3 is used to implement the business processing of business requirement 5;

[0087] etc.

[0088] Combined with the first principle, you can choose the first or second target business needs.

[0089] In this way, as many business needs as possible can be met with as few target business needs as possible, which greatly reduces the processing pressure of the data processing system and improves business processing efficiency.

[0090] In some embodiments, the method further comprises:

[0091] The data processing system divides the at least one processing result into N slices; N is greater than or equal to 1;

[0092] Configure multiple export jobs;

[0093] Each slice is compressed using an online compression tool, and the compressed slices are transmitted to the application system through a data bus system using the multiple export jobs.

[0094] Specifically, considering that some processing results contain millions of pieces of data and the export takes more than half an hour, we can add a sorting field to the processing result set, divide the processing results into N slices according to the sorting field, and configure multiple export jobs to export in parallel to improve the export efficiency;

[0095] At the same time, during the export process, you can use the pigz tool (a tool for compressing data) to perform multi-threaded compression and rename the text, and then transmit it through the file bus, shortening the time from the three perspectives of transmission, compression, and decompression. Here, you can specifically export the processing results into text or other formats of data files, and conditionally compress them according to the transmission requirements and push them to the specified server and specified file directory of the application system.

[0096] Correspondingly, after the application system receives the file, during the data loading phase, multi-threaded data loading is performed to improve loading efficiency while ensuring data integrity. After parsing the file and importing it into the local database, subsequent business batch processing is performed in combination with business needs and original data. During the business batch processing phase, the elastic scaling characteristics of the container can be used to execute large amounts of data and high-concurrency rule batches.

[0097] In some embodiments, a scheme is provided for a data bus system to extract data from a source system.

[0098] The platform also includes: a data bus system;

[0099] The source posting system includes: at least one source server; each source server includes: at least one business table;

[0100] The method further comprises:

[0101] The source system sends the operation data to the database through the data bus system, including:

[0102] The data bus system extracts data from the source server corresponding to each business table according to the data extraction time of each business table;

[0103] The extracted data is sent to the database.

[0104] In some embodiments, the method further comprises:

[0105] The data bus system determines a data update characteristic of a service table of each source server in the at least one source server, and determines a data extraction time of each service table according to the data update characteristic of each service table.

[0106] Here, the data update characteristic is used to reflect the time when the source server updates the service table, the data update content, etc.

[0107] The data bus system may extract data in the following ways: timing trigger and polling flag trigger.

[0108] ① For the time-triggered business table, without affecting the data integrity, you can choose to advance the bus extraction time according to the table data update characteristics. For example, for a system with a service time of 5x8 (x represents multiplication) hours and no master batch, the extraction time can be advanced to 21:00 on the same day at the earliest; for a system with a service time of 24 hours and no master batch, the bus extraction time can be advanced to 0:00 the next morning at the earliest.

[0109] ② For business tables triggered by polling flags, which are generally tables that rely on main batch updates, a completion flag will be inserted into the table after the main batch of the system is finished, so that the data bus system can identify and start extracting data based on polling.

[0110] For different business tables, data can be extracted at different times and in different data extraction methods.

[0111] In some embodiments, the method further includes: each source server in the source system organizes the tables included in itself.

[0112] The sorting method may include: regularly archiving data that is no longer updated in the source system and infrequently used data into a history table to reduce the pressure and time consumption of daily extraction of the current table.

[0113] In one example, a source server includes a credit classification record table, which records the classification result data of each loan note according to the five-level classification rules. The data in the table only updates the classification results of the current month; therefore, for this table, only the classification results of the current month need to be sent or extracted, and other data in the table can be archived in the history table.

[0114] Accordingly, when extracting data, the data bus system can extract the classification result data once a month.

[0115] In another example, the source server includes a credit business information record table, which records data required by downstream business scenarios. The format of the table can be designed based on the data content required by the downstream business scenarios.

[0116] Correspondingly, the data bus system can directly extract the data in the credit business information record table and send it to the database for use by downstream data processing systems, business systems, etc.

[0117] The sorting method may also include: evaluating the sampling method of the business table. If the business table has or can provide fields such as create_time (creation time) and update_time (update time), the source system will add the above fields to the business table as incremental sampling marks to reduce the sampling range and time consumption.

[0118] In one example, the post source system has a customer table with huge content and a long loading time. By adding the update_time field, the updated part can be determined according to the update_time field each time the data is extracted, and only the updated part of the data is extracted, which greatly reduces the extraction time.

[0119] In some embodiments, the database receives the operation data, processes the operation data according to a first processing rule, and obtains at least one data set, including:

[0120] Clean and standardize the operational data to obtain the historical layer (SHDATA, Source history data);

[0121] According to the principle of minimum dependency, the historical layer data are associated to obtain at least one data set; the at least one data set is used to provide data required for business needs and target business needs.

[0122] The minimum dependency principle indicates that the dependency between any two data sets in at least one data set is the smallest; the dependency indicates the calling relationship between a data set and other data sets, that is, the dependency indicates whether a data set needs to call other data sets.

[0123] Here, the historical layer data is the most complete and comprehensive layer of storage, and then the historical layer data can be divided into multiple data sets according to business needs to facilitate access by various application units.

[0124] Here, the database may adopt a star model or a snowflake model structure.

[0125] The database can be called a data warehouse; the data warehouse model refers to a structured model used to store and organize data in the database. Here, a star model or a snowflake model is used to design the structure of the data warehouse to support complex query and analysis requirements.

[0126] In some embodiments, the method may further include: the application unit sending at least one target data set to the application system;

[0127] Correspondingly, the application system performs business processing according to the at least one processing result to obtain a business processing result, including:

[0128] The application system performs business processing according to the at least one target data set and the at least one processing result to obtain a business processing result.

[0129] Here, considering that the application system may need to use some specific operational data, it is proposed that the application unit sends at least one target data set to the application system. In this way, the application system can perform business processing according to the at least one target data set and the at least one processing result to obtain a business processing result.

[0130] Of course, if the processing result already contains the data required by the application system, the at least one target data set may not be sent. The specific design can be based on the actual application scenario.

[0131] Figure 2 A schematic diagram of the structure of a business processing platform provided by an embodiment of the present disclosure; Figure 2 As shown, the business processing platform includes: a post source system, a database, a data processing system, and an application system; the post source system, the data processing system, and the application system are connected to the database via a data bus system respectively; the data processing system is connected to the application system;

[0132] The source system is used to send the operation data to the database through the data bus system according to a preset period;

[0133] The database is used to receive the operation data and process the operation data according to a first processing rule to obtain at least one data set;

[0134] The data processing system is used to obtain at least one business requirement of the application system, obtain at least one target data set according to the at least one business requirement, perform data processing on the at least one target data set, and obtain at least one processing result;

[0135] The application system is used to perform business processing according to the at least one processing result to obtain a business processing result.

[0136] In some embodiments, the data processing system is used to receive at least one business requirement of the application system, and then perform demand relationship analysis according to the at least one business requirement to obtain at least one target business requirement; each of the target business requirements is used to implement business processing of multiple business requirements;

[0137] Determine a second processing rule corresponding to each of the target business requirements; the second processing rule is used to at least indicate a data set required for business processing and a processing strategy for the data set.

[0138] In some embodiments, the second processing rule is further used to indicate an intermediate process table corresponding to each target business requirement; the intermediate process table is used to record data and / or processing results required for business processing according to the second processing rule;

[0139] The data processing system is used to establish an intermediate process table according to the second processing rule.

[0140] In some embodiments, the data processing system includes: at least one application unit;

[0141] The second processing rule is further used to indicate the application unit corresponding to each target business requirement;

[0142] The business unit corresponding to the target business requirement is used to obtain at least one target data set from the database according to a second processing rule;

[0143] Performing data processing on the at least one target data set according to the second processing rule to obtain a processing result, and saving the processing result to an intermediate process table corresponding to the second processing rule;

[0144] The business unit corresponding to the target business requirement is also used to send the processed intermediate process table to the application system.

[0145] In some embodiments, the data processing system includes a business analysis unit configured to perform one of the following:

[0146] Determine at least one target business requirement corresponding to at least one business requirement according to the requirement relationship table;

[0147] The at least one business requirement is identified by using a preset recognition model to determine at least one target business requirement corresponding to the at least one business requirement; the recognition model is obtained by training a neural network model based on a training data set; the training data set includes multiple training data, each training data includes: multiple business requirements and target business requirements corresponding to the multiple business requirements.

[0148] In some embodiments, the data processing system is used to divide the at least one processing result into N slices; N is greater than or equal to 1;

[0149] Configure multiple export jobs;

[0150] Each slice is compressed using an online compression tool, and the compressed slices are transmitted to the application system through a data bus system using the multiple export jobs.

[0151] In some embodiments, the platform further comprises: a data bus system;

[0152] The source posting system includes: at least one source server; each source server includes: at least one business table;

[0153] The data bus system is used to extract data from the source server corresponding to each business table according to the data extraction time of each business table;

[0154] The extracted data is sent to the database.

[0155] In some embodiments, the data bus system is used to determine the data update characteristics of the business table of each source server in the at least one source server, and determine the data extraction time of each business table according to the data update characteristics of each business table.

[0156] In some embodiments, the database is used to perform data cleaning and standardization on the operational data to obtain historical layer data;

[0157] According to the principle of minimum dependency, the historical layer data is associated to obtain at least one data set; the at least one data set is used to provide data required for business needs and target business needs;

[0158] The minimum dependency principle indicates that the dependency between any two data sets in at least one data set is the smallest;

[0159] The dependency relationship represents the calling relationship between a data set and other data sets.

[0160] It should be noted that the business processing method provided in the above embodiment belongs to the same concept as the embodiment of the business processing system, and can also execute other operations performed by the system. The specific implementation process is detailed in the system embodiment and will not be repeated here.

[0161] The business processing method and business processing system provided by the embodiments of the present disclosure can be applied to the financial field. Figure 3 A schematic diagram of a business processing platform provided for an application embodiment of the present disclosure includes:

[0162] The source system includes various source servers. Each source server generates data during its normal daily operation. At the end of each day, the daily generated or historical data will be sent to the data warehouse (equivalent to the above-mentioned database) through the data bus system in the form of files or interfaces.

[0163] For example, various source servers include: servers of the credit system, servers of the core system, servers of the enterprise customer information management system (ECIF, Enterprise Customer Information File System), servers of the retail internal rating system, etc.; operational data include: loan data, retail internal rating data, Internet accounting data, online loan data, other data, etc.

[0164] The data bus system serves as the data connection channel between the source system and the data warehouse. The data bus system loads the end-of-day data processed by the source system into the original layer (SDATA, Source data) of the database in the form of data interface or data file at the end of each day. The original layer retains the original appearance of the source system data without any processing.

[0165] The database, also known as a data warehouse, can form a historical layer (SHDATA, Source history data) data after a certain degree of cleaning and standardization of the original layer data. It is the most complete and comprehensive layer of bank data storage. Then, according to actual needs, the historical layer data is processed and associated in a preset organizational form to form large and comprehensive data sets, such as customer personal data (PDATA, Physical data), to facilitate the data processing system to access.

[0166] Here, the processed data set follows the principle of minimum dependency to minimize job dependency. For example, data from multiple data sources and multiple source servers can be aggregated. Taking the basic information of loan notes as an example, the data will come from credit card, core, online loan, credit and other servers; when the data set is realized, in order to follow the principle of minimum dependency, the original single source server's operating data can be split and recombined to obtain the required basic information of loan notes. In this way, the impact of different source servers on the correctness of the data set is reduced (for example, problems with credit card data will only affect the loan note information of the credit card business part); and each part of the business does not need to rely on the data of other businesses (for example, the credit card job no longer relies on the batch running of the core and other source servers), and the batch running can be done earlier every day.

[0167] The data processing system, also known as the risk data mart, includes a summary processing layer. The summary processing layer is business scenario-oriented and calls application units according to its own usage scenarios. The common logic of processing is deposited in the summary processing layer for processing to avoid repeated processing and waste of computing resources.

[0168] The data processing system also includes an application market layer, including: various application units, which are used to meet various business needs. There is no calling relationship between each application unit in the application market layer. All of them obtain data from the data warehouse, process it accordingly, and then send it to the risk application system. After each business unit processes the data, it exports the data and pushes it to the application system. Specifically, the processing results can be exported into text or other formats of data files, compressed according to the transmission requirements, and pushed to the designated server and designated file directory in the application system.

[0169] Correspondingly, after receiving the processing results processed by the application unit, the application system parses and imports them into the local database, and then performs subsequent business processing based on business needs and the original data in the data warehouse.

[0170] For example, the application system may include a risk application system, which can perform retail internal evaluation, post-loan demand, batch warning, credit risk, large risk control, anti-fraud and other businesses based on the processing results, and can also perform risk warnings.

[0171] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0172] In this way, through the above-mentioned business processing system, efficient, immediate and accurate business services can be provided for the credit business of the financial industry.

[0173] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0174] The above is only a specific embodiment of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person skilled in the art who is familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present disclosure, which should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A business processing method, characterized in that: The method is applied to a business processing platform; the platform includes: a post source system, a database, a data processing system, and an application system; the post source system, the data processing system, and the application system are connected to the database via a data bus system respectively; the data processing system is connected to the application system; The method comprises: The source system sends the operation data to the database through the data bus system according to a preset period; The database receives the operation data, and processes the operation data according to a first processing rule to obtain at least one data set; The data processing system obtains at least one business requirement of the application system, obtains at least one target data set according to the at least one business requirement, and performs data processing on the at least one target data set to obtain at least one processing result; The application system performs business processing according to the at least one processing result to obtain a business processing result; The method further comprises: After receiving at least one business requirement of the application system, the data processing system performs demand relationship analysis according to the at least one business requirement to obtain at least one target business requirement; each of the target business requirements is a common logic requirement, which is used to implement business processing of multiple business requirements; Determine a second processing rule corresponding to each of the target business requirements; the second processing rule is used to at least indicate a data set required for business processing and a processing strategy for the data set; The performing demand relationship analysis according to the at least one business demand to obtain at least one target business demand includes one of the following: Determine at least one target business requirement corresponding to at least one business requirement according to the requirement relationship table; The at least one business requirement is identified by using a preset recognition model to determine at least one target business requirement corresponding to the at least one business requirement; the recognition model is obtained by training a neural network model based on a training data set; the training data set includes a plurality of training data, each training data includes: a plurality of business requirements and a target business requirement corresponding to the plurality of business requirements; The second processing rule is further used to indicate an intermediate process table corresponding to each target business requirement; the intermediate process table is used to record data and / or processing results required for business processing according to the second processing rule; The method further comprises: establishing an intermediate process table according to the second processing rule; The data processing system comprises: at least one application unit; The second processing rule is further used to indicate the application unit corresponding to each target business requirement; The acquiring at least one target data set according to the at least one business requirement, and performing data processing on the at least one target data set to obtain at least one processing result includes: The business unit corresponding to the target business requirement obtains at least one target data set from the database according to a second processing rule; Performing data processing on the at least one target data set according to the second processing rule to obtain a processing result, and saving the processing result to an intermediate process table corresponding to the second processing rule; The method further comprises: The business unit corresponding to the target business requirement sends the processed intermediate process table to the application system; The database receives the operation data, processes the operation data according to a first processing rule, and obtains at least one data set, including: Clean and standardize operational data to obtain historical data; According to the principle of minimum dependency, the historical layer data is associated to obtain at least one data set; the at least one data set is used to provide data required for business needs and target business needs; The minimum dependency principle indicates that the dependency relationship between any two data sets in at least one data set is the smallest; and the dependency relationship indicates the calling relationship between a data set and other data sets.

2. The method according to claim 1, characterized in that The method further comprises: The data processing system divides the at least one processing result into N slices; N is greater than or equal to 1; Configure multiple export jobs; Each slice is compressed using an online compression tool, and the compressed slices are transmitted to the application system through a data bus system using the multiple export jobs.

3. The method according to claim 1, characterized in that The platform also includes: a data bus system; The source posting system includes: at least one source server; each source server includes: at least one business table; The source system sends the operation data to the database through the data bus system, including: The data bus system extracts data from the source server corresponding to each business table according to the data extraction time of each business table; The extracted data is sent to the database.

4. The method according to claim 3, characterized in that The method further comprises: The data bus system determines the data update characteristics of the service table of each source server in the at least one source server, and determines the data extraction time of each service table according to the data update characteristics of each service table.

5. A business processing platform, characterized in that: The business processing platform includes: a source system, a database, a data processing system, and an application system; the source system, the data processing system, and the application system are connected to the database via a data bus system; the data processing system is connected to the application system; The source system is used to send the operation data to the database through the data bus system according to a preset period; The database is used to receive the operation data and process the operation data according to a first processing rule to obtain at least one data set; The data processing system is used to obtain at least one business requirement of the application system, obtain at least one target data set according to the at least one business requirement, perform data processing on the at least one target data set, and obtain at least one processing result; The application system is used to perform business processing according to the at least one processing result to obtain a business processing result; The data processing system is used to receive at least one business requirement of the application system, and then perform demand relationship analysis according to the at least one business requirement to obtain at least one target business requirement; each of the target business requirements is a common logic requirement, and is used to implement business processing of multiple business requirements; Determine a second processing rule corresponding to each of the target business requirements; the second processing rule is used to at least indicate a data set required for business processing and a processing strategy for the data set; The data processing system includes a business analysis unit, configured to perform one of the following: Determine at least one target business requirement corresponding to at least one business requirement according to the requirement relationship table; The at least one business requirement is identified by using a preset recognition model to determine at least one target business requirement corresponding to the at least one business requirement; the recognition model is obtained by training a neural network model based on a training data set; the training data set includes a plurality of training data, each training data includes: a plurality of business requirements and a target business requirement corresponding to the plurality of business requirements; The second processing rule is further used to indicate an intermediate process table corresponding to each target business requirement; the intermediate process table is used to record data and / or processing results required for business processing according to the second processing rule; the data processing system is used to establish the intermediate process table according to the second processing rule; The data processing system includes: at least one application unit; the second processing rule is further used to indicate the application unit corresponding to each target business requirement; The business unit corresponding to the target business requirement is used to obtain at least one target data set from the database according to a second processing rule; Performing data processing on the at least one target data set according to the second processing rule to obtain a processing result, and saving the processing result to an intermediate process table corresponding to the second processing rule; The business unit corresponding to the target business requirement is also used to send the intermediate process table obtained by processing to the application system; The database is used to clean and standardize the operational data to obtain historical layer data; the historical layer data is associated according to the minimum dependency principle to obtain at least one data set; the at least one data set is used to provide data required for business needs and target business needs; The minimum dependency principle indicates that the dependency relationship between any two data sets in at least one data set is the smallest; and the dependency relationship indicates the calling relationship between a data set and other data sets.

Images