Historical data storage and indexing method

A technology for historical data and data, applied in database indexing, structured data retrieval, electronic digital data processing, etc., can solve problems such as insufficient access efficiency of historical data, reduce the number of disk operations, prevent data loss, and improve query efficiency Effect

Active Publication Date: 2014-10-08
HUAZHONG UNIV OF SCI & TECH
View PDF3 Cites 56 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] With the in-depth development of industrial informatization, decision makers have higher and higher requirements for historical data storage efficiency and data access speed. Therefore, the problem of insufficient historical data access efficiency in current real-time historical databases has become more and more prominent.
Faced with the increasingly high demand for historical data access efficiency, there is currently no complete and available implementation solution that can not only meet the current data access requirements, but also ensure that the system has dynamic scalability to cope with the continuous growth of data storage and processing. need

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Historical data storage and indexing method
  • Historical data storage and indexing method
  • Historical data storage and indexing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039]In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0040] Since the storage of industrial historical data does not require high precision, it is not necessary to store all the data, and it needs to be compressed. In order to reduce the number of disk writes when historical data is persistently stored, it is necessary to cache the historical data first, so that historical data for a period of time can be written to the disk data file at one time. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a historical data storage and indexing method and belongs to the field of real-time historical databases. According to the characteristics of industrial historical data storage formats, a simple and efficient historical data storage method and an efficient indexing mechanism are given. According to the historical data storage method, on the one hand, the I / O of a magnetic disk is reduced as much as possible by performing compression and cache on historical data and optimizing the data archiving sorting process; on the other hand, the I / O load of the magnetic disk in the data archiving sorting process is distributed to all time points in a balanced mode, and thus it is guaranteed that the requirement for storage of current historical data is met, and meanwhile the storage method has the dynamic extension characteristic. Through the indexing mechanism, the historical data can be fast accessed, and when a database is dynamically extended, the system can be not influenced by data access by dynamically modifying indexing files.

Description

technical field [0001] The invention belongs to the technical field of real-time historical databases, and more specifically relates to a method for storing and indexing historical data. Background technique [0002] Industrial informatization has become the main theme of the global industrial field in the 21st century. In recent years, the process of informatization has begun to deepen with a momentum of common development in depth and breadth. With the rise of the Internet of Things, a large number of sensors and smart terminals are widely used in traditional industrial fields, further promoting the development of industrial informatization. [0003] In traditional industrial production processes, real-time databases have been widely used. It is mainly used for real-time monitoring and data persistence of some industrial production systems with a small amount of data. The industries involved include electric power, petroleum, metallurgy, and chemical industry. Real-time ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/22G06F16/2228G06F16/2477
Inventor 王非刘涛
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products