Common fast migration method for time sequence data

A time-series data and data technology, applied in electronic digital data processing, structured data retrieval, database management systems, etc., can solve problems such as being confined between relational databases and security risks, achieving strong versatility and reducing human factors Effect

Inactive Publication Date: 2018-06-29
CHINA REALTIME DATABASE +1
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Document 2 (Liu Tianshi's information system data migration method research and application [J]. Northwest University Journal, 2006,36(1):25-28) The advantage of the information system data migration method is to design a general data export format, and the disadvantage is that Its backup file is a plain text file, which has potential security risks
[0005] Document 3 (Real

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Common fast migration method for time sequence data

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0024] Example 1:

[0025] An embodiment of the present invention discloses a universal rapid migration method of time series data.

[0026] In this embodiment, a data migration interface adapter (HighSoon Interface Adaptor, HIA) architecture is used to complete the rapid migration of time series data. Such as figure 1 As shown, the HIA architecture includes a management layer module (Transmission Layer), a driver layer module (Driver Layer), and a device layer module (Device Layer).

[0027] The management layer module (Transmission Layer) is mainly used to manage the drive layer, control business logic, and direct the drive layer module to perform data migration. The metadata management and maintenance submodule (Tracker) and the distributed coordination service submodule ( figure 1 It is implemented by ZooKeeper) and business data distribution and sharing sub-module (Transmission).

[0028] Tracker is the center of metadata management and maintenance, such as the management and c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of power system databases and discloses a common fast migration method for time sequence data. The method includes the steps of creating a data migration channel, configuring data source information and target database information, configuring a testing point mapping relation between data sources and a target database, initiating the data migration channel, monitoring data in the data migration channel, and starting data collection, wherein the collected data flows into the data migration channel; when there is data flowing into the data migration channel, compressing the data into a data message queue to wait for processing by a stream processor thread; monitoring the data message queue in real time through the stream processor thread, enablinga stream processing thread to work when the data message queue is not void, adopting a corresponding data processing method for processing the data, and transferring the data into the target database. A common migration technical scheme of the time sequence data is achieved.

Description

technical field [0001] The invention belongs to the technical field of electric power system databases, and in particular relates to a general fast migration method of time series data. Background technique [0002] With the continuous improvement of the informatization and automation level of the production system, and the continuous development and wide application of data collection technology, the demand for the collection and migration of corresponding time series data is also becoming more and more vigorous. For example, the centralized management and control system of the power generation group, the real-time plant-level monitoring system of the power plant, and other power plant informatization fields, energy conservation and environmental protection fields, automation and informatization fields of steel and petrochemical process production enterprises, etc., all of which will involve the collection and migration of time series data. Existing data migration mainly in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/25G06F16/27
Inventor 张珂珩周于超粟勇史英杰周淳蒋树嵩唐双红许媛
Owner CHINA REALTIME DATABASE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap