A block data storage and reading method based on hdf5

A data storage and block-based technology, applied in the direction of electrical digital data processing, data processing input/output process, instruments, etc., to achieve the effect of efficient and flexible I/O mechanism, diversified data types, and flexible data storage mechanism

Active Publication Date: 2021-09-28
HEFEI INSTITUTES OF PHYSICAL SCIENCE - CHINESE ACAD OF SCI
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Such a huge amount of data, and signal storage with pulse characteristics, relational databases or non-relational databases cannot meet the needs, while MDSplus and HDF5 are both databases for storing long-pulse big data. The International Thermonuclear Fusion ITER (International Thermonuclear Experimental Reactor) uses HDF5 stores data, in order to be in line with international standards, we will also use HDF5 to store all data of EAST poloidal field power supply system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A block data storage and reading method based on hdf5
  • A block data storage and reading method based on hdf5
  • A block data storage and reading method based on hdf5

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] Such as figure 1 , 2 As shown in , 3 and 4, a block-based data storage and reading method based on HDF5, by designing a block attribute data set of composite data type, the length of a discharge is divided according to the length of 1s, and the block-type storage is carried out and reading to realize real-time data storage and reading, the specific steps are:

[0024] (1) When the discharge starts, create an HDF5 file, create a data space, set the block attribute, create a composite data type 5, and use the block attribute and composite data type to create a dataset 4;

[0025] (2) Divide the duration of a discharge according to the length of 1s, and store the data in a loop. The storage thread 2 records the currently stored data as the Nth block, and the receiving data thread 1 receives the data according to the TCP protocol and stores it in the cache. When the 1s data is collected When completed, the storage thread 2 writes the Nth block of data to the HDF5 file, th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a block-type data storage and reading method based on HDF5, which runs on a Linux operating system, uses the HDF5 layered data format, and designs a block attribute data set of a composite data type. Divide the length, store and read in blocks to realize real-time data storage and data reading; use the HDF5 visualization tool Hdfview to view the stored data and attributes, Qt reads the HDF5 file, and performs waveform display and analysis. The present invention applies the layered data format HDF5 to the model of storing and managing data, and its data storage scale can be infinitely large and has portability.

Description

technical field [0001] The invention relates to data storage and reading of a power supply, in particular to a block-based data storage and reading method based on HDF5. Background technique [0002] EAST (Experimental Advanced Super-conducting Tokamak) superconducting tokamak fusion experimental device is a national major scientific project during the Ninth Five-Year Plan. The poloidal field power supply system is one of the core subsystems of the EAST device. , heating, and the control of plasma current, position, and shape provide the necessary engineering foundation and control means. The poloidal field power supply system consists of 12 sets of power supplies, and each set of power supplies mainly consists of AC / DC rectifiers, thyristor switch networks, quench protection systems, and isolating switches. [0003] At present, the poloidal field power supply system does not have an independent data storage and display system, and the poloidal field power supply plays a ve...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/064G06F3/067
Inventor 王广红黄连生高格傅鹏何诗英王泽京
Owner HEFEI INSTITUTES OF PHYSICAL SCIENCE - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products