Unlock instant, AI-driven research and patent intelligence for your innovation.

Data consumption method and device using KAFKA, terminal equipment and medium

A technology of consumption and data, applied in the field of financial technology, can solve the problem of high cost of data consumption

Pending Publication Date: 2021-11-26
WEBANK (CHINA)
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The main purpose of the present invention is to provide a data consumption method, device, terminal equipment and computer storage medium using KAFKA, aiming to solve the data consumption cost caused by the real-time stream computing framework based on big data components when using KAFKA for data consumption high technical issues

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data consumption method and device using KAFKA, terminal equipment and medium
  • Data consumption method and device using KAFKA, terminal equipment and medium
  • Data consumption method and device using KAFKA, terminal equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0026] refer to figure 1 , figure 1 It is a schematic diagram of the device structure of the hardware operating environment of the terminal device involved in the solution of the embodiment of the present invention.

[0027] In the embodiment of the present invention, the terminal device may be a terminal device configured as a KAFKA consumer terminal for data consumption by a data consumption instance, and the terminal device may be a server, a smart phone, a PC (Personal Computer, a personal computer), a tablet computer, a portable computer, etc. Wait.

[0028] Such as figure 1 As shown, the terminal device may include: a processor 1001 , such as a CPU, a communication bus 1002 , a user interface 1003 , a network interface 1004 , and a memory 1005 . Wherein, the communication bus 1002 is used to realize connecti...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the technical field of financial science and technology, and discloses a data consumption method and device using KAFKA, terminal equipment and a computer storage medium. According to the data consumption method using the KAFKA, a KAFKA consumption end registers a data consumption instance according to an instance registration rule, and the instance registration rule comprises of enabling a single part of a single KAFKA theme to correspond to a consumption thread of a data consumption instance; carrying out load balancing operation according to the weight of the data consumption instance and the partition of the KAFKA theme corresponding to the data consumption instance; and keeping a load balance state for the data consumption instance to perform data consumption. According to the invention, a lightweight and high-availability data consumption scheme using KAFKA is realized.

Description

technical field [0001] The present invention relates to the technical field of financial technology (Fintech), in particular to a data consumption method, device, terminal equipment and computer storage medium using KAFKA. Background technique [0002] With the development of computer technology, more and more technologies are applied in the financial field, and the traditional financial industry is gradually transforming into financial technology. However, due to the security, real-time and stability requirements of the financial industry, more and more technical requirements high demands. [0003] At present, Kafka (an open source stream processing platform, a high-throughput distributed publish-subscribe message system that can handle all action stream data of consumers in the website) is used as the mainstream in the field of big data. Real-time or quasi-real-time consumption data, It is mainly based on spark streaming (a stream processing system for high-throughput and...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/50
CPCG06F9/505G06F9/5027G06F9/5016G06F9/5083G06F2209/5018
Inventor 李勇卢道和罗锶黄叶飞边元乔陈晓峰常亮姬岑晨胡思文郑喜生
Owner WEBANK (CHINA)