A method for providing a credit report and related products

Abstract

Embodiments of the present application provide a method for providing a credit report and related products, the method comprising: collecting original data for generating a credit report in a data source by a terminal device; performing real-time calculation on the original data by the terminal device to obtain a master massively parallel processing (MPP) cluster and a backup MPP cluster; the master MPP cluster and the backup MPP cluster are real-time synchronized MPP clusters; and generating the credit report according to the master MPP cluster or the backup MPP cluster by the terminal device. The present application has the advantage of high security.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of electronic and communication technology, and in particular to a method for providing a credit report and related products. BACKGROUND

[0002] The original credit report is provided by extracting data of industry and commerce, justice and intellectual property rights through a server, and then aggregating and managing the data through Oracle to form a credit report, which is convenient for customers to query. However, the method of obtaining a credit report through Oracle alone has the risk of losing all data in extreme cases (such as fire disasters), which affects the security of the credit report. SUMMARY

[0003] The embodiments of the present application disclose a method for providing a credit report, which can prevent data loss in extreme cases, improve data security, and improve user experience.

[0004] In a first aspect, a method for providing a credit report is provided, and the method includes the following steps:

[0005] A terminal device collects original data for generating a credit report in a data source;

[0006] The terminal device performs real-time calculation on the original data to obtain a master massively parallel processing (MPP) cluster and a backup MPP cluster; the master MPP cluster and the backup MPP cluster are real-time synchronized MPP clusters;

[0007] The terminal device generates a credit report according to the master MPP cluster or the backup MPP cluster.

[0008] In a second aspect, a system for providing a credit report is provided, and the system includes:

[0009] A collection unit is configured to collect original data for generating a credit report in a data source;

[0010] A processing unit is configured to perform real-time calculation on the original data to obtain a master massively parallel processing (MPP) cluster and a backup MPP cluster; the master MPP cluster and the backup MPP cluster are real-time synchronized MPP clusters; and a credit report is generated according to the master MPP cluster or the backup MPP cluster.

[0011] In a third aspect, an electronic device is provided, which includes a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor. The program includes instructions for performing the steps in the method of the first aspect.

[0012] In a fourth aspect, a computer readable storage medium storing a computer program for electronic data exchange is provided, wherein the computer program causes a computer to perform the method of the first aspect.

[0013] In a fifth aspect, a computer program product is provided, which includes a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps described in the first aspect of embodiments of the present application. The computer program product can be a software installation package.

[0014] The technical solution provided in the present application is that the terminal device collects and generates original data of a credit report in a data source; the terminal device performs real-time calculation on the original data to obtain an MPP primary cluster and an MPP backup cluster; the MPP primary cluster and the MPP backup cluster are real-time different MPP clusters; and the terminal device generates a credit report according to the MPP primary cluster or the MPP backup cluster. Since the technical solution provided in the present application provides real-time and mutually synchronized MPP primary cluster and MPP backup cluster, as long as any one of the MPP primary cluster and the MPP backup cluster is normal, the generation of the credit report can be realized, the reliability of the credit report is improved, and the security of data is improved. BRIEF DESCRIPTION OF DRAWINGS

[0015] The following describes the drawings used in the embodiments of the present application.

[0016] Figure 1 is a schematic diagram of a system architecture of the present application;

[0017] Figure 2 is a schematic diagram of a functional architecture provided by the present application;

[0018] Figure 3 is a schematic diagram of a method for providing a credit report provided by the present application;

[0019] Figure 4 is a schematic diagram of a data processing method provided by the present application;

[0020] Figure 5 is a schematic diagram of a system for providing a credit report provided by an embodiment of the present application;

[0021] Figure 6 is a schematic diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0022] The embodiments of the present application are described below with reference to the drawings.

[0023] The term "and / or" in the present application is only used to describe the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B can represent three cases of A alone, A and B together, and B alone. In addition, the character " / " in this paper represents that the associated objects before and after are an "or" relationship.

[0024] The "multiple" appearing in the embodiments of the present application means two or more. The first, second, etc. appearing in the embodiments of the present application are only used for description and distinction of the described objects, and there is no order difference, nor do they represent a special limitation on the number of devices in the embodiments of the present application, which cannot constitute any limitation on the embodiments of the present application. The "connection" appearing in the embodiments of the present application means direct connection or indirect connection and various connection modes to achieve communication between devices, which is not limited in the embodiments of the present application.

[0025] Referring to Figure 1 , Figure 1 A system architecture schematic diagram provided by the present application is shown in Figure 1 , which includes the following on the hardware resource: physical machine, switch, broadband, machine room, cabinet leasing, etc.; the environment includes: physical machine deployment (production environment) and virtual environment management (test environment); the system can also include multiple platforms, which can specifically include: basic platform, scheduling platform, data warehouse, data access and data governance system, wherein the basic platform can include: data cluster construction; the data warehouse can include: MPP (Massively Parallel Processor) database. The system shown in Figure 1 can include BI report, relationship graph application, risk control model training, enterprise portrait, etc.

[0026] Referring to Figure 2 , Figure 2 A functional architecture schematic diagram provided by the present application is shown in Figure 2As shown, the functional framework includes: data source, data access, data research and development, data governance and data application; wherein the data source can include the source of obtaining data, including but not limited to: judicial data, business data, tax data, invoice data, intellectual property data, property data (such as power and water data), social security data, etc. Data access can include: DataGrid (DataGrid) collection, offline collection (T+1), real-time collection (T+0). Data research and development can include: data development, operation and maintenance management and data storage, wherein the data development includes but is not limited to: offline processing, task scheduling, data modeling, warehouse layering, streaming development, collaborative development; operation and maintenance management includes but is not limited to: cluster management, component management, monitoring and alarm; data storage can specifically include: MPP database storage, file storage, relational database, graph data, HDFS data, Hbases data. Data governance can include: data assets, data quality, data security, wherein the data assets include but are not limited to: asset directory, data map; data quality includes but is not limited to: data standardization, rule configuration, regular inspection, task monitoring; data security includes but is not limited to: data desensitization, data audit, data permission. Data application can specifically include: risk control analysis, credit reporting, graph application, BI report, customer portrait.

[0027] The above-mentioned functional framework can specifically implement the following functions, as follows:

[0028] Data integration: support for heterogeneous data sources, through real-time, offline multiple scene collection to the data platform.

[0029] Data development: including data warehouse construction and stream processing application development.

[0030] Operation and maintenance management: manage Hadoop cluster online and offline, expansion, version upgrade. At the same time, component service management, real-time monitoring.

[0031] Data storage: support for business data, graph data, file report unstructured data storage and service.

[0032] Data quality: data standard formulation, business rule configuration and binding with target, real-time alarm and quality report output.

[0033] Data security: data desensitization, online audit, permission management.

[0034] Data assets: manage data details, establish data map through blood relationship.

[0035] Data service: provide reliable data service for business scenarios.

[0036] Reference Figure 3 , Figure 3A flowchart of a method for providing a credit report is provided in the present application, as shown in Figure 3 The above method can be implemented under a system architecture as shown in Figure 1 The functional architecture can be as shown in Figure 2 The above method can be executed by a terminal device, including the following steps: Figure 3

[0037] Step S301, the terminal device collects original data for generating a credit report in a data source;

[0038] Step S302, the terminal device performs real-time calculation on the original data to obtain an MPP primary cluster and an MPP backup cluster; the MPP primary cluster and the MPP backup cluster are real-time synchronized MPP clusters;

[0039] For example, the terminal device performs real-time calculation on the original data to obtain an MPP primary cluster and an MPP backup cluster, which can specifically include:

[0040] The terminal device saves the original data to obtain an ODS layer data warehouse, performs verification and desensitization on the ODS layer data warehouse to obtain a DW layer data warehouse, performs index processing on the DW layer data warehouse to obtain an ADS layer data warehouse, and obtains processed data from the original data through a kafka message engine, and exports the processed data and index data of the ADS layer data warehouse to obtain the MPP primary cluster and the MPP backup cluster.

[0041] ODS: operational data store, original data layer, storing business database data without any processing.

[0042] DWD: data warehouse detail, storing detailed data processed by standardized processes (cleaning, desensitization), such as tax detail tables.

[0043] DWS: data warehouse service, data is divided by theme domain, such as risk control, credit, etc. theme domain, which can be dimensionally pre-aggregated and support OLAP analysis.

[0044] ADS: application database service, storing data processed by indexes, which can be exported to a storage layer or used for index system display.

[0045] For example, the above method can further include:

[0046] Periodically cleaning index data in the ADS layer data warehouse according to a first preset period.

[0047] ​The MPP master cluster and the MPP backup cluster that are real-time synchronized can specifically include, for example:

[0048] The verification operation is performed on all data in the MPP master cluster to obtain a master verification code, and the same verification operation is performed on all data in the MPP backup cluster to obtain a backup verification code. If the master verification code is the same as the backup verification code, it is determined that the MPP master cluster and the MPP backup cluster are real-time synchronized. If the master verification code is different from the backup verification code, it is determined that the MPP master cluster and the MPP backup cluster are real-time unsynchronized, and a synchronization process of the MPP master cluster and the MPP backup cluster is performed.

[0049] The synchronization process of the MPP master cluster and the MPP backup cluster can specifically include, for example:

[0050] The MPP master cluster and the MPP backup cluster are arranged in ascending or descending order of stored time to obtain a master time sequence and a backup time sequence. The master time sequence is divided into x time intervals, and the backup time sequence is also divided into x time intervals. The x time intervals of the master time sequence and the x time intervals of the backup time sequence contain the same time period. The x time intervals of the master time sequence are subjected to sub-verification to obtain x master sub-verification codes, and the x time intervals of the backup time sequence are subjected to sub-verification to obtain x backup sub-verification codes. The x master sub-verification codes and the x backup sub-verification codes are compared one by one to determine different sub-verification codes. The part of data of the MPP master cluster corresponding to the different sub-verification codes and the part of data of the MPP backup cluster are compared one by one to determine missing data. The missing data is copied to the MPP cluster that does not have the missing data.

[0051] For example, the different sub-verification code is the first time interval in the x time intervals. The part of data (master) of the MPP master cluster corresponding to the first time interval and the part of data (backup) of the MPP backup cluster corresponding to the first time are compared one by one to determine missing data (for example, the MPP master cluster contains data 1, but the MPP backup cluster does not contain data 1, so the data 1 is determined to be missing data). The data 1 is copied to the MPP backup cluster to achieve synchronization.

[0052] In step S303, the terminal device generates a credit report according to the MPP master cluster or the MPP backup cluster.

[0053] The generation of the credit report can be achieved by using an existing credit report generation method. The application does not limit the specific manner of the generation.

[0054] The technical scheme provided in the application comprises the following steps: a terminal device collects original data for generating a credit report in a data source; the terminal device performs real-time calculation on the original data to obtain an MPP primary cluster and an MPP backup cluster; the MPP primary cluster and the MPP backup cluster are real-time different MPP clusters; and the terminal device generates the credit report according to the MPP primary cluster or the MPP backup cluster. Since the technical scheme provided in the application provides the real-time and mutually synchronized MPP primary cluster and MPP backup cluster, as long as any one of the MPP primary cluster and the MPP backup cluster is normal, the generation of the credit report can be realized, the reliability of the credit report is improved, and the security of data is improved.

[0055] For example, referring to Figure 4 , Figure 4 The flowchart of the data processing method provided in the application, the method can further comprise the following steps:

[0056] The terminal device periodically extracts cluster data from the MPP primary cluster or the MPP backup cluster, periodically extracts mixed data from an original credit library (such as an Oracle database) and a transaction library, performs cleaning, aggregation and index processing on the cluster data and the mixed data to obtain processed data, and performs risk control analysis on the processed data and the data of the MPP primary cluster or the MPP backup cluster to obtain a risk control report.

[0057] The cleaning, aggregation and index processing can be processed in the existing manner, which will not be described herein. The method of the risk control analysis can also be processed in the existing manner, which will not be described herein.

[0058] For example, in a specific implementation, tax data, invoice data, business and judicial data and the like are collected from a DataGrid to send into a credit library MPP cluster main and a credit library MPP cluster backup of a data platform function, and then report services / HS queries and other applications are performed, and the data of the credit library MPP cluster backup can also be used for risk control analysis.

[0059] The credit library MPP cluster backup can also extract a Hive data warehouse at T+1, the data in the Hive data warehouse can be subjected to cleaning, aggregation and the like, and the data in the Hive data warehouse comes from an original credit library Oracle and a transaction library Mysql, the original credit library Oracle data comes from background services, for example, background service data of business and judicial affairs, intellectual property rights, product application orders and the like, the original credit library Oracle can also be used for customer queries, and the original credit library Oracle can also be used to extract the Hive data warehouse at T+1. The data in the transaction library Mysql comes from transaction data of a business system.

[0060] For example, referring to Figure 5 , Figure 5 A system for providing a credit report is provided, and the system comprises:

[0061] The collection unit 501 is configured to collect original data for generating a credit report in a data source.

[0062] The processing unit 502 is configured to perform real-time calculation on the original data to obtain an MPP master cluster and an MPP backup cluster. The MPP master cluster and the MPP backup cluster are real-time synchronized MPP clusters. The credit report is generated according to the MPP master cluster or the MPP backup cluster.

[0063] In an example,

[0064] The processing unit is specifically configured to save the original data to obtain an ODS layer data warehouse, perform verification and desensitization on the ODS layer data warehouse to obtain a DW layer data warehouse, perform index processing on the DW layer data warehouse to obtain an ADS layer data warehouse, and obtain processed data by the terminal device through a kafka message engine. The terminal device exports the processed data and index data of the ADS layer data warehouse to obtain the MPP master cluster and the MPP backup cluster.

[0065] In an example,

[0066] The MPP master cluster and the MPP backup cluster are real-time synchronized MPP clusters, and specifically include:

[0067] The verification operation is performed on all data in the MPP master cluster to obtain a master verification code, the same verification operation is performed on all data in the MPP backup cluster to obtain a backup verification code, if the master verification code is the same as the backup verification code, it is determined that the MPP master cluster and the MPP backup cluster are real-time synchronized, if the master verification code is different from the backup verification code, it is determined that the MPP master cluster and the MPP backup cluster are real-time unsynchronized, and a synchronization process of the MPP master cluster and the MPP backup cluster is performed.

[0068] In an example,

[0069] The processing unit is further configured to periodically clean index data in the ADS layer data warehouse according to a first preset period.

[0070] In an example,

[0071] The processing unit is further configured to periodically extract cluster data from the MPP master cluster or the MPP backup cluster, periodically extract mixed data from the original credit library and the transaction library, perform cleaning, aggregation and index processing on the cluster data and the mixed data to obtain processed data, and perform risk control analysis on the processed data and data of the MPP master cluster or the MPP backup cluster to obtain a risk control report.

[0072] It can be understood that, in order to achieve the above functions, the above apparatus includes hardware and / or software modules corresponding to each function. The algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in hardware or a combination of hardware and computer software. Whether a certain function is implemented in hardware or computer software driven hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of the present application.

[0073] The present embodiment can divide the functional modules of the electronic device according to the above method examples. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The integrated module can be implemented in the form of hardware. It should be noted that the division of modules in the present embodiment is illustrative and is only a logical functional division. Actual implementation can have another division method.

[0074] It should be noted that all related content of each step involved in the above method embodiments can be cited in the functional description of the corresponding functional module, which will not be repeated here.

[0075] In the case of using integrated units, the user device can include a processing module and a storage module. The processing module can be used to control and manage the actions of the user device, for example, it can be used to support the electronic device to execute the steps performed by the above acquisition unit, communication unit and processing unit. The storage module can be used to support the electronic device to execute the storage of program code and data, etc.

[0076] The processing module can be a processor or a controller. It can implement or execute various exemplary logical blocks, modules and circuits described in conjunction with the disclosure of the present application. The processor can also be a combination of computing functions, such as one or more microprocessor combinations, digital signal processing (DSP) and microprocessor combinations, etc. The storage module can be a memory. The communication module can be a device for interacting with other electronic devices, such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, etc.

[0077] It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only illustrative and does not constitute a structural limitation on the user device. In some other embodiments of the present application, the user device can also use different interface connection methods or a combination of multiple interface connection methods in the above embodiments.

[0078] Please refer to Figure 6 , Figure 6An electronic device 60 provided by an embodiment of the present application, the electronic device 60 comprising a processor 601, a memory 602, a communication interface 603 and a display screen 604, the processor 601, the memory 602 and the communication interface 603 being connected to each other through a bus, the display screen being powered for the electronic device, and the electronic device can further comprise:

[0079] The memory 602 comprises, but is not limited to, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read only memory (EPROM), or a compact disc read-only memory (CD-ROM), and is used for relevant computer programs and data. The communication interface 603 is used for receiving and sending data.

[0080] The processor 601 can be one or more central processing units (CPUs), and in the case that the processor 601 is a CPU, the CPU can be a single-core CPU or a multi-core CPU.

[0081] The processor 601 can include one or more processing units, for example: the processing units can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent components, or can be integrated in one or more processors. In some embodiments, the user equipment can also include one or more processing units. Among them, the controller can generate operation control signals according to instruction operation codes and timing signals to complete the control of fetching and executing instructions. In other embodiments, a memory can also be provided in the processing unit for storing instructions and data. Exemplarily, the memory in the processing unit can be a cache memory. The memory can save instructions or data that the processing unit has just used or repeatedly uses. If the processing unit needs to use the instructions or data again, it can directly call from the memory. In this way, repeated access is avoided, the waiting time of the processing unit is reduced, and the efficiency of the user equipment in processing data or executing instructions is improved.

[0082] In some embodiments, the processor 601 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM card interface, and / or a USB interface, etc. Among them, the USB interface is an interface conforming to the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface can be used to connect a charger to charge the user equipment, and can also be used to transmit data between the user equipment and the peripheral equipment. The USB interface can also be used to connect earphones to play audio through the earphones.

[0083] If the electronic device 60 is a user device or terminal device, such as a smart phone, a computer device, a server, the processor 601 in the electronic device 60 is configured to read the computer program code stored in the memory 602, and perform the following operations:

[0084] Collecting original data for generating the credit investigation report in the data source;

[0085] Real-time computing the original data to obtain a master MPP cluster and a backup MPP cluster; the master MPP cluster and the backup MPP cluster are real-time synchronized MPP clusters;

[0086] Generating the credit investigation report according to the master MPP cluster or the backup MPP cluster

[0087] All related contents of each scene involved in the method embodiments can be cited to the function description of the corresponding function module, and will not be repeated here.

[0088] The embodiment of the application further provides a computer readable storage medium, the computer readable storage medium stores a computer program, when the computer program runs on a network device, Figure 3 The method flow shown is implemented.

[0089] The embodiment of the application further provides a computer program product, when the computer program product runs on a terminal, Figure 3 The method flow shown is implemented.

[0090] The embodiment of the application further provides an electronic device, including a processor, a memory, a communication interface, and one or more programs, the one or more programs are stored in the memory and are configured to be executed by the processor, the program includes instructions for executing Figure 3 The steps in the method of the embodiment shown.

[0091] The above mainly introduces the scheme of the embodiment of the application from the perspective of the execution process of the method. It can be understood that the electronic device contains the hardware structure and / or software template corresponding to the execution of each function in order to realize the above functions. Those skilled in the art should easily realize that the units and algorithm steps of each example described in connection with the embodiments provided in the present application can be realized in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the application.

[0092] The embodiments of the present application can divide the functional units of the electronic device according to the above method examples. For example, each functional unit can be divided according to each function, or two or more functions can be integrated in one processing unit. The integrated unit can be realized in the form of hardware or software functional unit. It should be noted that the division of the units in the embodiments of the present application is illustrative, and is only a logical function division. Actual implementation can have another division manner.

[0093] It should be noted that, for the foregoing method embodiments, in order to simply describe, they are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited to the order of the actions described, because according to the present application, some steps can be performed in other order or simultaneously. Secondly, those skilled in the art should know that the embodiments described in the specification all belong to preferred embodiments, and the actions and templates involved are not necessarily necessary for the present application.

[0094] In the above embodiments, the description of each embodiment has its own emphasis, and the parts not described in detail in a certain embodiment can be referred to the related description of other embodiments.

[0095] In the several embodiments provided by the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the above units is only a logical function division. There can be another division manner in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interface, device or unit, and can be electrical or other form.

[0096] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiments of the present application.

[0097] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or software functional unit.

[0098] The integrated unit described above, if realized in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable memory. Based on such understanding, the technical solutions of the present application, essentially or in other words, the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a memory and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server or a network device, etc.) to execute all or part of the steps of the above-mentioned method of each embodiment of the present application. The aforementioned memory includes: a U disk, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and various media that can store program codes.

[0099] A person of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by a program instructing relevant hardware, and the program can be stored in a computer readable memory, which can include a flash disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

Claims

1. A method for providing credit reports, characterized in that, The method includes the following steps: The terminal device collects the raw data from the data source to generate the credit report; The terminal device performs real-time calculations on the raw data to obtain a large-scale parallel processing MPP master cluster and an MPP backup cluster. The aforementioned MPP primary cluster and MPP backup cluster are MPP clusters that are synchronized with each other in real time. The terminal device generates a credit report based on the MPP primary cluster or the MPP backup cluster. The terminal device performs real-time calculations on the raw data to obtain the MPP primary cluster and MPP backup cluster, specifically including: The terminal device saves the raw data to obtain the ODS layer data warehouse. It then performs verification and data anonymization on the ODS layer data warehouse to obtain the DW layer data warehouse. Finally, it processes the DW layer data warehouse to obtain the ADS layer data warehouse. The terminal device then uses a Kafka message engine to obtain processed data from the raw data. Finally, it exports the processed data and the indicator data from the ADS layer data warehouse to obtain the MPP primary cluster and MPP secondary cluster. The MPP primary cluster and MPP secondary cluster are MPP clusters that are synchronized with each other in real time. Specifically, they include: Perform a verification operation on all data in the MPP master cluster to obtain the master verification code, and perform the same verification operation on all data in the MPP backup cluster to obtain the backup verification code. If the master verification code and the backup verification code are the same, it is determined that the MPP master cluster and the MPP backup cluster are synchronized in real time. If the master verification code and the backup verification code are different, it is determined that the MPP master cluster and the MPP backup cluster are not synchronized in real time, and the synchronization process of the MPP master cluster and the MPP backup cluster is executed. The specific steps involved in executing the synchronization process between the MPP primary cluster and the MPP backup cluster are as follows: The MPP primary cluster and MPP backup cluster are arranged in ascending or descending order of storage time to obtain the primary time series and backup time series. The primary time series is divided into x time intervals, and the backup time series is also divided into x time intervals. The x time intervals of the primary time series and the x time intervals of the backup time series contain the same time period. The x time intervals of the primary time series are subjected to partial verification to obtain x primary partial verification codes, and the x time intervals of the backup time series are subjected to partial verification to obtain x backup partial verification codes. The x primary partial verification codes and x backup verification codes are compared one by one to identify the different partial verification codes. For the partial data of the MPP primary cluster corresponding to the different partial verification codes, the partial data of the MPP backup cluster are compared one by one to identify the missing data. The missing data is copied to the MPP cluster that does not have the missing data.

2. The method according to claim 1, characterized in that, The method further includes: The indicator data in the ADS layer data warehouse is cleaned periodically according to the first preset cycle.

3. The method according to claim 1, characterized in that, The method further includes: Terminal devices periodically extract cluster data from the MPP main cluster or MPP backup cluster, and periodically extract mixed data from the original credit database and transaction database. The cluster data and mixed data are cleaned, aggregated, and processed to obtain processed data. Risk control analysis is performed based on the processed data and the data from the MPP main cluster or MPP backup cluster to obtain a risk control report.

4. A system for providing credit reports, characterized in that, The system includes: The data collection unit is used to collect the raw data for generating credit reports from the data source. The processing unit is used to perform real-time calculations on the raw data to obtain a large-scale parallel processing MPP master cluster and an MPP backup cluster; the aforementioned MPP master cluster and MPP backup cluster are MPP clusters that are synchronized with each other in real time; and a credit report is generated based on the MPP master cluster or the MPP backup cluster. The processing unit is specifically used to save the original data to obtain the ODS layer data warehouse, perform verification and desensitization on the ODS layer data warehouse to obtain the DW layer data warehouse, perform indicator processing on the DW layer data warehouse to obtain the ADS layer data warehouse, and the terminal device obtains the processed data from the original data through the Kafka message engine, and exports the processed data and the indicator data of the ADS layer data warehouse to obtain the MPP main cluster and MPP secondary cluster. Perform a verification operation on all data in the MPP master cluster to obtain the master verification code, and perform the same verification operation on all data in the MPP backup cluster to obtain the backup verification code. If the master verification code and the backup verification code are the same, it is determined that the MPP master cluster and the MPP backup cluster are synchronized in real time. If the master verification code and the backup verification code are different, it is determined that the MPP master cluster and the MPP backup cluster are not synchronized in real time, and the synchronization process of the MPP master cluster and the MPP backup cluster is executed. The specific steps involved in executing the synchronization process between the MPP primary cluster and the MPP backup cluster are as follows: The MPP primary cluster and MPP backup cluster are arranged in ascending or descending order of storage time to obtain the primary time series and backup time series. The primary time series is divided into x time intervals, and the backup time series is also divided into x time intervals. The x time intervals of the primary time series and the x time intervals of the backup time series contain the same time period. The x time intervals of the primary time series are subjected to partial verification to obtain x primary partial verification codes, and the x time intervals of the backup time series are subjected to partial verification to obtain x backup partial verification codes. The x primary partial verification codes and x backup verification codes are compared one by one to identify the different partial verification codes. For the partial data of the MPP primary cluster corresponding to the different partial verification codes, the partial data of the MPP backup cluster are compared one by one to identify the missing data. The missing data is copied to the MPP cluster that does not have the missing data.

5. An electronic device comprising a processor, a memory, a communication interface, and one or more programs, said one or more programs being stored in the memory and configured to be executed by the processor, said programs comprising instructions for performing the steps of the method as claimed in any one of claims 1-3.

6. A computer-readable storage medium storing a computer program that, when run on a user device, performs the method as described in any one of claims 1-3.

Images