Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Data storage system and method

A data storage system and data storage technology, applied in the direction of file system, file system type, structured data retrieval, etc., can solve the problems of increased input rate, inability to store in time, failure to achieve the highest performance, etc., to ensure integrity, The effect of guaranteed storage performance

Active Publication Date: 2019-12-24
BEIJING HUADIAN TIANREN ELECTRIC POWER CONTROL TECH
View PDF9 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

At present, mainstream time-series databases ensure data storage efficiency by improving hardware performance and increasing software memory space, which also brings a huge hidden danger.
Whether it is the improvement of hardware performance or the use of a distributed architecture to share the pressure of storage, a large amount of money is required to purchase hardware equipment, and professional operation and maintenance personnel are required for long-term maintenance, and the investment rate has increased significantly.
However, due to the use of a large amount of memory, when the server has abnormal conditions such as power outages and crashes, it cannot be stored to the disk in time, and the resulting data loss is irreparable.
If the received data is directly stored in the disk without using the memory as the data memory, the data storage speed will also be affected by the frequent calls to the disk IO operation, which is far from reaching the highest performance.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data storage system and method
  • Data storage system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The technical solution of the present invention will be described in further detail below in conjunction with the accompanying drawings. A data storage system such as figure 1 Shown, comprise data acquisition module and time series database, it is characterized in that:

[0033] The time series database includes: a receiving module, a monitoring and scheduling module and a storage module;

[0034] The data acquisition module is connected to the time series database; the data acquisition module is connected to the receiving module, the receiving module is connected to the monitoring and scheduling module, and the scheduling module is connected to the storage module;

[0035] The data acquisition module collects the data of the underlying control system according to the name of the collection point, compresses the collected data, and transmits it to the receiving module in the time series database;

[0036] The receiving module is used to receive the data delivered by t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a data storage system and a data storage method, and belongs to the field of data storage. The data storage system comprises a data collection module and a time sequence database. According to the data storage method, after a time sequence database receives data and before the data is written into a disk, the data is independently stored as a log, real storage operation is carried out after the log is successfully stored, and the data is written into the disk. If the whole storage operation is interrupted due to a certain reason, when the system is restarted, the storageoperation before interruption can be recovered according to the data of the data log file, and it is guaranteed that the received data cannot be lost. When real data storage operation is carried out,multiple random writes are combined into one sequential write operation, the frequency of calling disk write operation and the moving range of a magnetic head and a mechanical arm are reduced, and the highest disk write speed of a rotating speed hard disk is achieved. One data log file is deleted after the storage operation is completed, and the occupied hard disk space can be recycled.

Description

technical field [0001] The application belongs to the technical field of data storage in time series databases, and in particular relates to a data storage system and method. Background technique [0002] Time-series database products are the basic platform of enterprise informatization and the bridge of management and control integration. A large amount of real-time data generated in the production process is one of the valuable resources of process enterprises. These data need long-term storage, fast retrieval, and serve as the basis for production data analysis, data mining, optimization control and optimization management. A typical process enterprise usually has thousands to hundreds of thousands of data collection points to be integrated. Since the data of the collection points changes dynamically in time sequence and the refresh rate is fast (millisecond level), such large-scale massive data is difficult to use. Time-series database is a new technology specially des...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/16G06F16/18G06F16/21G06F16/2458
CPCG06F16/2474G06F16/1815G06F16/211G06F16/162
Inventor 康芳李志强程睿君吴长东
Owner BEIJING HUADIAN TIANREN ELECTRIC POWER CONTROL TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products