Batch data query method and device in real-time computing and computer equipment

A batch data, real-time computing technology, applied in the computer field, can solve problems such as poor performance, instability, deadlock, etc., to achieve the effect of improving performance, avoiding deadlock, and optimizing computing time

Pending Publication Date: 2022-01-14
杭州玳数科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although asynchronous communication is adopted, the average calculation time of massive data is optimized, but the C3P0 database connection pool technology has a deadlock problem, is unstable, and has particularly poor performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Batch data query method and device in real-time computing and computer equipment
  • Batch data query method and device in real-time computing and computer equipment
  • Batch data query method and device in real-time computing and computer equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0046] figure 1 It is a flowchart of a batch data query method in real-time computing according to an embodiment of the present invention.

[0047] Such as figure 1 As shown, the method includes the following steps:

[0048] S1, build a Druid connection pool, and obtain the asynchronous communicator VertX and the Flink computing framework.

[0049] Specifically, build a Druid connection pool that can interface with the asynchronous communicator VertX, and o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a batch data query method and device in real-time computing and computer equipment, and the method comprises the steps: constructing a Druid connection pool, and obtaining an asynchronous communicator VertX and Flink computing framework; performing first connection on the Druid connection pool and the asynchronous communicator VertX to obtain a connection device; carrying out second connection on the connection device and the Flink computing framework; based on the first connection and the second connection, generating connection information, and integrating and then storing the connection information in a specified directory of the Flink computing framework; constructing a real-time computing task of the Flink computing framework, and starting the real-time computing task; and inputting the batch data to be queried into the Flink computing framework, so that the Flink computing framework queries the batch data through the integrated connection information. Therefore, the problems of deadlock and poor stability caused by C3P0 can be avoided, and the data query performance in real-time computing can be improved on the premise of optimizing the computing time, so that the performance of the whole real-time computing is improved.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a batch data query method in real-time computing, a batch data query device in real-time computing, and a computer device. Background technique [0002] With the development of enterprise digital transformation, enterprises have higher and higher requirements for real-time data processing, especially the real-time processing of massive data. Real-time processing of massive data Among the current open source code projects, Flink has the best functions and performance. After massive data enters the Flink system, the results will be calculated in milliseconds. This system can be used in various fields such as real-time recommendation, real-time monitoring, and real-time intelligence analysis. One of the keys affecting real-time computing performance is reading remote data over the network during computing. The waiting time for reading network data is quite time-consuming. For ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/22G06F16/2457G06F8/30
CPCG06F16/252G06F16/2291G06F16/2457G06F8/315
Inventor 王鲁宁
Owner 杭州玳数科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap