Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Common fast migration method for time sequence data

A time-series data and data technology, applied in electronic digital data processing, structured data retrieval, database management systems, etc., can solve problems such as being confined between relational databases and security risks, achieving strong versatility and reducing human factors Effect

Inactive Publication Date: 2018-06-29
CHINA REALTIME DATABASE +1
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Document 2 (Liu Tianshi's information system data migration method research and application [J]. Northwest University Journal, 2006,36(1):25-28) The advantage of the information system data migration method is to design a general data export format, and the disadvantage is that Its backup file is a plain text file, which has potential security risks
[0005] Document 3 (Realization of Data Migration and Data Sharing between Liao Lihui Databases [c], Proceedings of the 24th Academic Annual Conference of Power System and Automation in Chinese Universities, 2010, 1684-1688) proposed the use of ORACLE,imp / exp and sqlplus tools to realize data migration between relational databases, its shortcoming is that it can only be limited to relational databases

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Common fast migration method for time sequence data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0025] An embodiment of the present invention discloses a general fast migration method for time series data.

[0026] In this embodiment, a data migration interface adapter (HighSoon Interface Adaptor, HIA) architecture is used to complete the rapid migration of time series data. Such as figure 1 As shown, the HIA architecture includes the management module (Transmission Layer), the driver layer module (Driver Layer) and the device layer module (Device Layer).

[0027] The management module (Transmission Layer) is mainly used to manage the driver layer, control the business logic, and direct the driver layer module to perform data migration. The metadata management and maintenance sub-module (Tracker) and the distributed coordination service sub-module ( figure 1 implemented by ZooKeeper) and business data distribution and sharing sub-module (Transmission).

[0028] Tracker is the center of metadata management and maintenance, such as management and configuration of communi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of power system databases and discloses a common fast migration method for time sequence data. The method includes the steps of creating a data migration channel, configuring data source information and target database information, configuring a testing point mapping relation between data sources and a target database, initiating the data migration channel, monitoring data in the data migration channel, and starting data collection, wherein the collected data flows into the data migration channel; when there is data flowing into the data migration channel, compressing the data into a data message queue to wait for processing by a stream processor thread; monitoring the data message queue in real time through the stream processor thread, enablinga stream processing thread to work when the data message queue is not void, adopting a corresponding data processing method for processing the data, and transferring the data into the target database. A common migration technical scheme of the time sequence data is achieved.

Description

technical field [0001] The invention belongs to the technical field of electric power system databases, and in particular relates to a general fast migration method of time series data. Background technique [0002] With the continuous improvement of the informatization and automation level of the production system, and the continuous development and wide application of data collection technology, the demand for the collection and migration of corresponding time series data is also becoming more and more vigorous. For example, the centralized management and control system of the power generation group, the real-time plant-level monitoring system of the power plant, and other power plant informatization fields, energy conservation and environmental protection fields, automation and informatization fields of steel and petrochemical process production enterprises, etc., all of which will involve the collection and migration of time series data. Existing data migration mainly in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
CPCG06F16/25G06F16/27
Inventor 张珂珩周于超粟勇史英杰周淳蒋树嵩唐双红许媛
Owner CHINA REALTIME DATABASE
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com