Unlock instant, AI-driven research and patent intelligence for your innovation.

Real-time index data processing method and big data cloud platform

A technology for real-time processing and index data, applied in the field of data processing, can solve problems such as the inability to effectively guarantee the timeliness of indicators

Pending Publication Date: 2021-07-30
CHINA CONSTRUCTION BANK
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Based on the deficiencies of the above-mentioned prior art, this application provides a real-time processing method of index data and a big data cloud platform to solve the problem that the prior art cannot effectively guarantee the timeliness of the index

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time index data processing method and big data cloud platform
  • Real-time index data processing method and big data cloud platform
  • Real-time index data processing method and big data cloud platform

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach

[0066] Optionally, in another embodiment of the present application, a specific implementation of step S102 includes:

[0067] The stream computing component parses the data to be processed into tabular data, and extracts data in specified fields from the tabular data to form a fact table.

[0068] It should be noted that since the data is processed in the form of tables in the embodiment of this application, and only part of the data needs to be processed, it is necessary to parse the data to be processed into table data, and extract the specified fields from the table data. The data that make up the fact table. For example, if the real-time data is data in json format provided by the EDA, then the real-time data in json format needs to be parsed into tabular data, that is, data in tabular format. Then the data in the fields required for processing can be extracted from the form data, for example, the installment amount, installment type and other fields.

[0069] Optionall...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an index data real-time processing method and a big data cloud platform. The big data cloud platform at least comprises a data acquisition component, a stream computing component and an index factory. The processing method is applied to the big data cloud platform and comprises the steps that a data acquisition component acquires real-time data; the stream computing component preprocesses the real-time data to obtain a fact table, wherein to-be-processed data obtained after preprocessing the real-time data is stored in the fact table; the index factory associates the fact table with the dimension table based on the configured statistical dimension and measurement field information to obtain associated data, wherein the associated data comprises data stored in a fact table and a dimension table; the information of the statistical dimension and the measurement field is configured through the index factory; the index factory transmits the associated data to the stream computing component; and the stream computing component summarizes and calculates the associated data based on the index definition information configured by the index factory to obtain a key index.

Description

technical field [0001] This application relates to the technical field of data processing, in particular to a method for real-time processing of index data and a big data cloud platform. Background technique [0002] With the rapid development of the economy, the banking industry has higher and higher requirements for the timeliness of bank product index data acquisition. [0003] With the promotion and application of emerging tools and technologies such as Storm, Spark, and Apache, banks have also begun to use these emerging tools and technologies to automate data processing, thereby gradually realizing the acquisition of real-time data on asset changes in simple banking products. [0004] However, for the calculation process of the complex key performance indicator data of banking products, since it involves more business components and data to be processed, it is necessary to search, obtain and integrate the data to be processed by the agent, and then perform statistical ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/27G06F16/2455G06F16/25G06Q40/02G06Q10/06
CPCG06Q10/06393G06Q40/02G06F16/2282G06F16/24568G06F16/252G06F16/27
Inventor 张鹏迟骋王磊王杰明刘高宋丹蒂
Owner CHINA CONSTRUCTION BANK