Asset screening system and method based on big data and oracle massive data

Abstract

The present invention relates to an asset screening system based on big data and ORACLE mass data, including a big data processing module, an ORACLE data storage module, a job scheduling module and a WEB application module; the big data processing module can be constructed offline based on Hadoop+Hive+HDFS Processing clusters for offline data processing; the ORACLE data storage module can create asset information tables through SQL table creation statements, and create bitmap indexes for the fields that need to be retrieved; the job scheduling module can regularly trigger big data by configuring corresponding scheduling scripts and scheduling time Processing and ORACLE data import; the WEB application module can receive data from the ORACLE data storage module and output information that can be directly used by the asset securitization management system. The invention also discloses an asset screening method based on big data and ORACLE massive data. Through the processing of big data, the attributes of massive assets are more detailed; through the bitmap index of ORACLE, the retrieval speed of massive asset data is faster.

Description

Technical field [0001] The present invention relates to the financial field, which is an asset securitization management technology, which is specifically based on large data and an asset screening system and method for massive data of Oracle. Background technique [0002] At present, the credit card asset securitization asset screening is generally data screening of assets by SAS analysis software. SAS software is independent software and cannot be used directly with the asset securitization management system. It needs manually imported data, and each screening requires manual writing script pair. Data processing, statistics, analysis, requires user programming capabilities, in general, SAS has a large number of manual operations, data security and accuracy cannot be guaranteed, and users use high use thresholds. [0003] In order to solve the above problem, the present invention passes the operation scheduling automation to call the large data cluster to access source data, and...

AI Technical Summary

Problems solved by technology

[0002] At present, asset screening of credit card asset securitization generally uses SAS analysis software for data screening of assets. SAS software is an independent software that cannot be directly used in combination with asset securitization management systems. Data needs to be imported manually, and scripts need to be manually written for each screening. Data processing, statistics, and analysis require users to have certain programming skills. In general, SAS has a lot of manual operations, data security and accuracy cannot be guaranteed, and users have high barriers to use.

Images