Unlock instant, AI-driven research and patent intelligence for your innovation.

Streaming data processing method and device

A technology of streaming data and processing method, applied in the field of information processing, can solve the problems of no table structure, field appearance and order of appearance, and computing efficiency drop, etc., to achieve the effect of improving computing efficiency

Pending Publication Date: 2022-04-15
南京赋乐科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Streaming data is different from ordinary database table data in that it does not have a fixed table structure, whether or not fields appear and the order of appearance is not fixed, and streaming data can only reach the SQL engine in the order of records (blocks), and the engine cannot Use the index to perform quick filtering or retrieval on it
[0004] Related technologies traverse the SQL commands in the SQL statement according to the streaming data after receiving the streaming data and buffering it for a short time. However, as the number of SQL commands in the SQL statement increases, streaming data is required to traverse a large number of SQL commands and calculate Efficiency will drop drastically

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Streaming data processing method and device
  • Streaming data processing method and device
  • Streaming data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0095] The application will be described in further detail below in conjunction with the accompanying drawings.

[0096] This specific embodiment is only an explanation of this application, and it is not a limitation of this application. Those skilled in the art can make modifications to this embodiment without creative contribution according to needs after reading this specification, but as long as the rights of this application All claims are protected by patent law.

[0097] Related technologies traverse the SQL commands in the SQL statement according to the streaming data after receiving the streaming data and buffering it for a short time. However, as the number of SQL commands in the SQL statement increases, streaming data is required to traverse a large number of SQL commands and calculate Efficiency will drop drastically.

[0098] In order to solve the above technical problems, the present application provides a streaming data processing method, device, device and med...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a streaming data processing method and device, the streaming data processing method and device are arranged in an SQL engine, no fixed calculation process is arranged in the SQL engine, only pre-stored SQL configuration is provided to provide a modularized calculation mechanism, specific calculation services of the SQL engine are all input by external SQL statements, and the SQL engine is more convenient to use. In the SQL engine, according to SQL commands and logic keywords in the SQL statements, pre-stored SQL node configuration is used for combination, and an SQL graph is generated and used for expressing semantics of the input SQL statements; according to the method, the to-be-processed streaming data is processed by utilizing the SQL graph, and the processed streaming data is output, so that the calculation efficiency is greatly improved, and the problem of low calculation efficiency caused by utilizing the streaming data to traverse the SQL statement due to the increase of SQL commands in the related technology is avoided.

Description

technical field [0001] The present application relates to the technical field of information processing, and in particular to a stream data processing method and device. Background technique [0002] SQL statement (Structured Query Language, Structured Query Language) is the current mainstream description form of database calculation logic, which has strong descriptive ability, easy to read, and can realize flexible configuration of calculation logic. [0003] Streaming data has the characteristics of massive transmission, high information density, high real-time computing requirements, and various field attributes. Streaming data is different from ordinary database table data in that it does not have a fixed table structure, whether or not fields appear and the order of appearance is not fixed, and streaming data can only reach the SQL engine in the order of records (blocks), and the engine cannot Use the index to perform quick filtering or retrieval on it. [0004] Relat...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/242G06F16/2455G06F16/28
Inventor 郝振华马驰超王翔
Owner 南京赋乐科技有限公司