Unlock instant, AI-driven research and patent intelligence for your innovation.

Real-time streaming data query method and device

A data query and real-time streaming technology, applied in the field of data query, can solve the problems of manual analysis, error-prone, manpower and material resources, etc., and achieve the effects of improving accuracy, efficient query, and saving manpower and physics

Active Publication Date: 2021-01-15
TAIKANG LIFE INSURANCE CO LTD
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

After obtaining these aggregated results, data analysts need to manually analyze and screen one by one, which consumes manpower and material resources, and is also prone to errors during manual analysis.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time streaming data query method and device
  • Real-time streaming data query method and device
  • Real-time streaming data query method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention more clear, the embodiments of the present invention will be further described in detail below in conjunction with the accompanying drawings. Here, the exemplary embodiments and descriptions of the present invention are used to explain the present invention, but not to limit the present invention.

[0027] As mentioned earlier, when Flink-SQL uses the aggregation scenario (that is, group by), because the data is a continuous flow, the aggregation result is also dynamically changed in real time. For this changed data, Flink uses flags to label the invalid result data with a false label, and label the current valid result data with a true label, and present it to the user. However, general data analysts are only proficient in SQL syntax, but they are not clear about the principle of Flink. For example, in the real-time streaming scenario, after Flink-SQL is execut...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a real-time streaming data query method and device, and the method comprises the steps: receiving a query instruction, sent by a user, of current real-time streaming data, thequery instruction carrying query dimension field information, and the query dimension field information comprising one or more query dimensions; according to the query instruction, extracting aggregated data corresponding to the current real-time streaming data from a database, wherein the aggregated data is data carrying flag bit information after the current real-time streaming data is subjectedto Flink-SQL processing; sorting the aggregated data carrying the flag bit information according to the query dimension field information; screening the sorted aggregated data according to zone bit information carried by the aggregated data; and feeding back a real-time streaming data query result to the user according to a screening result. Real-time streaming data can be efficiently queried, manpower and physics are saved, and the accuracy is improved.

Description

technical field [0001] The invention relates to the technical field of data query, in particular to a real-time streaming data query method and device. Background technique [0002] At present, some insurance products are sold through live broadcast channels. Many customers watch the live broadcast. These customers continuously visit the live broadcast, watch, exit, and visit again. If you want to check in real time how many customers are watching the live broadcast , How many insurance products are purchased in each region in real time, etc., it is necessary to connect to the real-time streaming data in Kafka, use Flink-SQL, aggregate regions and other dimensions, and obtain statistical results. The above scenario is just one of many real-time computing scenarios. In the past, a large amount of data was processed offline. However, with the increase of customers and the introduction of new Internet methods, there are more and more real-time scenarios. Flink is the leading te...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2455G06F16/248
CPCG06F16/24568G06F16/248Y02D10/00
Inventor 韩佩利施小江
Owner TAIKANG LIFE INSURANCE CO LTD