Unlock instant, AI-driven research and patent intelligence for your innovation.

Real-time data display method based on hbase table

A technology for real-time data and display methods, applied in database indexing, electronic digital data processing, structured data retrieval, etc., can solve problems such as delay and time-consuming, and achieve the effect of improving acquisition speed and satisfying real-time display.

Active Publication Date: 2020-07-03
SICHUAN XW BANK CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, it is often very time-consuming for the front-end equipment to access the back-end database to obtain various data, and it may even take several minutes. This makes the data displayed on the front-end large screen no longer the current real-time data, and there is a delay. It will have a great impact on the financial industry

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time data display method based on hbase table
  • Real-time data display method based on hbase table
  • Real-time data display method based on hbase table

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] Such as figure 1 Shown the present invention is based on the real-time data display method of HBase table, comprises:

[0019] A. Establish the storage structure and corresponding storage space of the Kafka message queue in the storage medium of the system;

[0020] B. Collect real-time data in the back-end business server through the processor, such as Binlog logs in the MySQL database of the business server. And store the collected real-time data into the storage structure of the Kafka message queue, and transmit the real-time data to the HBase schedule through the storage structure of the Kafka message queue. The real-time data includes the transaction flow of the financial industry data and credit work order data. It is necessary to perform multi-dimensional calculation and analysis on these business data, which can be used in downstream systems for real-time decision-making analysis, dynamic adjustment of credit conditions, etc.;

[0021] C. Through the Spark...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a real-time data display method based on an HBase table. The method comprises the following steps: A, establishing a Kafka message queue; B, acquiring real-time data in a service server, and transmitting the real-time data to an HBase detail list through the Kafka message queue; C, performing multi-dimensional calculation on the real-time data in the HBase detail list; D,establishing a storage structure of the HBase table, and respectively storing the calculation result into each field, wherein an index primary key, an index name, a channel name, a product name, a dimension code, a dimension value and a calculation value field are respectively arranged in the storage structure of the HBase table, and the index primary key is formed by splicing the contents of other fields through separators; and E, reading the index primary key and splitting the index primary key by front-end equipment, and displaying split character strings on the front-end equipment. The front-end equipment can quickly acquire the data from a rear-end database at a millisecond or second-level speed for display, the acquisition speed of the real-time data is increased by multiple orders of magnitudes, and the requirement of real-time display of the data is completely met.

Description

technical field [0001] The invention relates to a data display method, in particular to a real-time data display method based on an HBase table. Background technique [0002] In the context of financial big data, banking institutions need clear data to let business personnel and developers understand the current business situation, so more and more financial institutions / enterprises will display data through some large data screens. In data display, there is a high requirement for real-time data, and everyone wants to see dynamically changing values, so as to quickly understand the business situation. At present, when displaying data on a large screen, the front end needs to access the database at the back end, query the required data from multiple databases, and then display it on the large screen. However, it is often very time-consuming for the front-end equipment to access the back-end database to obtain various data, and it may even take several minutes. This makes the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/22G06F16/2455G06F16/2458G06F16/248G06F16/27
CPCG06F16/2264G06F16/2272G06F16/24568G06F16/2458G06F16/248G06F16/27
Inventor 田浩兵张奎陈思成
Owner SICHUAN XW BANK CO LTD