Radio astronomical data storage performance optimization method and device, server and storage medium

A storage server and radio astronomy technology, applied in the field of astronomy technology and computer application, can solve the problems of lack of professionals in data storage, insufficient understanding of the astronomy field, and few professionals in computers, so as to avoid a large amount of movement, realize simplicity and convenience, and reduce The effect of storage performance

Active Publication Date: 2021-04-09
GUANGZHOU UNIVERSITY
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are mainly two problems in the field of astronomy: 1) There are few computer professionals in the field of astronomy, and the computer talents do not have a deep understanding of the field of astronomy, which leads to the lack of professionals in data storage in this field, which leads to intelligence relying on existing, general-purpose 2) Traditional performance optimization is based on the improvement of the underlying software and hardware systems, and these optimizations rely on computer expertise

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Radio astronomical data storage performance optimization method and device, server and storage medium
  • Radio astronomical data storage performance optimization method and device, server and storage medium
  • Radio astronomical data storage performance optimization method and device, server and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0074] Such as figure 1 As shown, this embodiment provides a radio astronomy data collection system, which includes a data collection terminal 101 , a collection server 102 and a storage server 103 .

[0075] The data acquisition terminal 101 is mainly a data acquisition device connected to astronomical telescope equipment, typically such as a CCD (Charge Coupled Device, Charge Coupled Device) or sCMOS (Complementary Metal Oxide Semiconductor, Complementary Metal Oxide Semiconductor) observation camera, used to collect radio astronomy Raw data.

[0076] The collection server 102 is connected to the data collection terminal 101 and generally includes software such as a driver program of the data collection terminal 101 and a data collection program.

[0077] The storage server 103 is connected with the acquisition server 102, and is used for storing the data processed by the acquisition server 102. Further, the storage server 103 of this embodiment adopts distributed storage t...

Embodiment 2

[0102] Such as Figure 6 As shown, this embodiment provides a radio astronomy data storage performance optimization device, the device is applied to the acquisition server, which includes a receiving module 601, an initialization module 602, a filling module 603, a synthesis module 604, a writing module 605, a dynamic monitoring Module 606, first judgment module 607, second judgment module 608, calculation module 609, third judgment module 610 and return module 611, the specific functions of each module are as follows:

[0103] The receiving module 601 is configured to receive the raw radio astronomy data collected by the data collection terminal.

[0104] The initialization module 602 is configured to initialize the memory space according to the original radio astronomy data, and complete the initialization of the first FITS header segment.

[0105] The filling module 603 is configured to fill the FITS header and the data segment according to the original radio astronomy dat...

Embodiment 3

[0117] Such as Figure 7 As shown, this embodiment provides an acquisition server, the acquisition server includes a processor 702 connected through a system bus 701, a memory and a network interface 703, the processor is used to provide computing and control capabilities, and the memory includes non-volatile storage medium 704 and internal memory 705, the non-volatile storage medium 704 stores computer programs and databases, the internal storage 705 provides an environment for the operation of the computer programs in the non-volatile storage medium, and the processor 702 executes the When computer program, realize the radio astronomy data storage performance optimization method of above-mentioned embodiment 1, as follows:

[0118] Receive the raw radio astronomy data collected by the data collection terminal;

[0119] According to the original radio astronomy data, initialize the memory space and complete the initialization of the first FITS header segment;

[0120] Fill ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a radio astronomy data storage performance optimization method and device, a server and a storage medium. The method comprises the steps of receiving radio astronomy original data collected by a data collection terminal; filling the FITS head and the data segment; synthesizing into a radio astronomical data FITS file; writing the FITS file into a storage server; dynamically monitoring the network output performance of the acquisition server in the writing process; judging whether to detect the I/O performance of the storage server or not according to the condition of the network output performance of the collection server; if so, judging whether to add one to the FITS header segment data or not according to the I/O performance of the storage server; if so, calculating FITS file data in the current memory; according to the FITS file data in the current memory, judging whether to subtract one from the FITS header segment data or not, if so, returning to calculate the FITS file data in the current memory, and executing subsequent operations. According to the invention, the performance optimization threshold can be greatly reduced, and the performance overhead caused by random I/O can be prevented.

Description

technical field [0001] The invention relates to a radio astronomy data storage performance optimization method, device, server and storage medium, and belongs to the technical fields of astronomical technology and computer application. Background technique [0002] In recent years, the research and development of China's radio observation equipment has made great progress. Hundreds of terabytes of data each year need to be quickly stored, managed and maintained, and made available to scientists. The high-speed storage of massive data has become a prominent feature of radio observation data. For the ever-expanding massive astronomical data, there is an urgent need for better solutions for high-speed storage, reading and processing of massive data. It not only meets the needs of the current stage, but also considers future development, improves the scientific research output rate and utilization rate of observation results, and ultimately improves the use value of equipment....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F16/182H04L29/08
CPCG06F3/061G06F3/067G06F16/182H04L67/1097
Inventor 梅盈王锋邓辉刘应波王金戴伟梁波
Owner GUANGZHOU UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap