Real-time data subscription method and device based on time sequence database and medium

By building data subscription scheduling tasks in a timing database and using the Raft log mechanism data change capture module, the problem of poor real-time performance and high resource consumption in massive data processing is solved, and an efficient and real-time data processing process is achieved.

CN120011437APending Publication Date: 2025-05-16上海沄熹科技有限公司
0 Cites 4 Cited by

Patent Information

Application Number
CN202510139253.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-02-08
Publication Date
2025-05-16

AI Technical Summary

Technical Problem

The existing timing databases have poor real-time real-time and high resource consumption in real-time acquisition of required timing data in massive data storage and processing.

Method used

Data subscription scheduling tasks are constructed through predefined SQL statements, combined with an efficient data change capture module based on the Raft logging mechanism, the data subscribed by the user is obtained in real time, and filtered according to customized rules, and the filtered data is automatically transferred to the preset target sink component in a specified format.

Benefits of technology

Real-time, accuracy and high availability data processing processes are realized, and the problems of high latency and resource consumption in the traditional polling mode are overcome, and the timeliness of data processing and resource utilization efficiency are improved.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention discloses a real-time data subscription method and device based on a time sequence database and a medium, belongs to the technical field of databases, and aims to solve the technical problems that the real-time performance is poor, the resource consumption is large and the time sequence data required by the current time sequence database in real time acquisition in mass data storage and processing is poor. According to the technical scheme, the method comprises the steps that a data subscription scheduling task is constructed through a predefined SQL statement, in combination with an efficient data change capture module based on a Raft log mechanism, data subscribed by a user is obtained in real time, and the data subscribed by the user is filtered according to a customization rule; then the screened data is automatically transmitted to a preset target sink component in a specified format, so that the whole data processing flow has the characteristics of real-time performance, accuracy and high availability; the method specifically comprises the following steps: constructing a data subscription scheduling task; executing the data subscription scheduling task; and capturing data change based on the raft log.
Need to check novelty before this filing date? Find Prior Art