Unlock instant, AI-driven research and patent intelligence for your innovation.

Real-time data warehouse risk control linkage early warning method, system and equipment and storage medium

A risk control and linkage technology, applied in program control design, forecasting, multi-dimensional databases, etc., can solve the problems of imperfect big data indicator monitoring mechanism, lack of early warning monitoring mechanism, etc., and achieve the effect of program safety and robustness

Active Publication Date: 2021-08-06
上海钢银科技发展有限公司
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to improve the above-mentioned problem that the big data indicator monitoring mechanism is not perfect and lacks a perfect early warning monitoring mechanism, this application provides a real-time data warehouse risk control linkage early warning method , systems, equipment and storage media

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time data warehouse risk control linkage early warning method, system and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The application will be described in further detail below in conjunction with the accompanying drawings.

[0052] This application first provides a real-time data warehouse automatic ETL method, including:

[0053] Data extraction, the data in the mysql database is extracted to the message queue Kafka, specifically including:

[0054] Obtain the binlog log of the data through the slave disguised as mysql, analyze it, and send the parsed data to the Kafka queue;

[0055] In order to ensure that the data is safe and not lost, the status of the parsed binlog log progress is saved in Redis, and the maintainer can switch the binlog parsing progress at will by changing the corresponding value in redis to switch the binlog parsing progress, thereby improving flexibility; At the same time, the distribution of multiple nodes is realized through Zookeeper; if the dam that is parsing the binlog fails due to reasons such as the network, then the standby dam will seamlessly take ov...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of quasi-real-time data warehouse construction of an e-commerce platform, and discloses a real-time data warehouse risk control linkage early warning method and system. The real-time data warehouse risk control linkage early warning methodcomprises the following steps: performing early warning model configuration: configuring risk control early warning models of different businesses in advance based on the businesses; performing data early warning index definition: based on a standard mysql database, defining risk indexes of different risk intervals of the data, including a credit index, a blacklist index and a white list index; accessing the early warning indexes, wherein corresponding data early warning indexes are configured for the risk control early warning models of different businesses; extracting data; performing data conversion; loading the data; performing risk index calculation: calculating the risk index of the data; and performing early warning monitoring: monitoring the risk index of the data based on the risk control early warning model of the corresponding service configuration and the data early warning index corresponding to the risk control early warning model. A big data index risk control linkage mechanism is realized, and security control of abnormal transaction orders and fund risks of the platform is realized.

Description

technical field [0001] This application relates to the technical field of construction of quasi-real-time data warehouses on e-commerce platforms, in particular to a risk control linkage early warning method, system, equipment and storage medium for real-time data warehouses. Background technique [0002] The data warehouse is a strategic collection that provides all system data support for all decision-making processes of the enterprise. Through the analysis of the data in the data warehouse, it can help enterprises improve business processes, control costs, and improve product quality. The data warehouse prepares for the final destination of the data, and these preparations include data cleaning, escaping, classification, reorganization, merging, splitting, statistics, etc. [0003] The real-time data warehouse collects, synchronizes, and calculates real-time data, and obtains the result data for use by the business side. The real-time data warehouse can provide query sol...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/04G06Q10/06G06F16/28G06F9/54
CPCG06Q10/04G06Q10/0635G06Q10/06393G06F16/283G06F16/284G06F9/546G06F2209/548
Inventor 葛昊
Owner 上海钢银科技发展有限公司