Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

ETL method and system based on Internet financial data

A financial data and Internet technology, applied in the ETL method and system field based on Internet financial data, can solve problems that affect system stability, cannot be processed in a timely manner, cannot meet timeliness and accuracy, and meet the needs of timeliness, The effect of ensuring stability

Pending Publication Date: 2020-08-25
上海维信荟智金融科技有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the era of big data, a large amount of data is generated at high speed and in a variety of ways. In some scenarios, the business needs to monitor the business status in real time and make operational decisions. The traditional ETL method can no longer meet the requirements of timeliness and accuracy; Due to the rapid expansion of volume, T+1 day may not be able to process the data of T day in time, which will affect the stability of the system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • ETL method and system based on Internet financial data
  • ETL method and system based on Internet financial data
  • ETL method and system based on Internet financial data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0016] Such as figure 1 As shown, the present embodiment provides an ETL method based on Internet financial data, comprising the following steps:

[0017] The scheduler obtains scheduling instructions according to the ETL task dependencies, and executes the steps of offline scheduling operations;

[0018] And / or, the scheduler obtains the scheduling instruction according to the ETL task dependency, and executes the steps of the quasi-real-time scheduling operation.

[0019] Those skilled in the art can understand that there are dependencies among ETL tasks. To ensure that the tasks are executed in order, we use a scheduler to coordinate the execution of the tasks. The scheduler follows the time-triggered and event-triggered mechanisms, and executes ETL scheduling scripts according to ETL task scheduling dependencies.

[0020] This embodiment provides an ETL method based on Internet financial data. The real-time processing module is used to collect business data relying on re...

Embodiment 2

[0053] This embodiment provides a kind of ETL system based on internet financial data, including:

[0054] The scheduler obtains scheduling instructions according to the ETL task dependencies, and performs offline scheduling operations;

[0055] And / or, the scheduler obtains scheduling instructions according to ETL task dependencies, and executes a module of quasi-real-time scheduling operations.

[0056] Those skilled in the art can understand that there are dependencies among ETL tasks. To ensure that the tasks are executed in order, we use a scheduler to coordinate the execution of the tasks. The scheduler follows the time-triggered and event-triggered mechanisms, and executes ETL scheduling scripts according to ETL task scheduling dependencies.

[0057] This embodiment provides an ETL system based on Internet financial data, which uses real-time processing modules to collect business data based on real-time capture tools, and uses quasi-real-time computing technology to p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an ETL method and system based on Internet financial data. The method comprises the following steps that a scheduler obtains a scheduling instruction according to an ETL task dependence relation, and carries out the offline scheduling operation; and / or, the scheduler acquires a scheduling instruction according to the ETL task dependency relationship, and executes a quasi-real-time scheduling operation. Thus, according to the ETL method and system based on the internet financial data, the real-time processing module is used for collecting the service data by means of thereal-time capturing tool, the quasi-real-time computing technology is used for conducting quasi-real-time processing on the data, the stability of the system is guaranteed, and the requirement of service for data timeliness is met.

Description

technical field [0001] The invention relates to the technical field of computer software, in particular to an ETL method and system based on Internet financial data. Background technique [0002] ETL (Extract-Transform-Load) is used to describe the process of extracting, transforming, and loading data from the source to the destination. With the popularization of mobile Internet, Internet finance, an emerging industry in my country, has developed rapidly. Overall, Internet finance and traditional finance are quite different at the data level. Traditional financial services are relatively stable and mature, such as banking, securities, insurance, etc. After decades or hundreds of years of development, the business model is mature, so the data based on the business model is relatively stable, while the Internet financial business iteratively changes quickly, and its own data The difference is large; traditional finance has standardized and strict business and IT processes, s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/2458G06F16/25G06Q40/00
CPCG06F16/2465G06F16/254G06Q40/00
Inventor 金家芳李宁赵劲春蒙开强
Owner 上海维信荟智金融科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com