Radio astronomical data storage consistency guaranteeing method, device and system and storage medium

A technology for data storage and radio astronomy, applied in the field of astronomy technology and computer application, can solve the problems of technical difficulty, poor application effect, lack of consistency guarantee methods, etc., to achieve the effect of simple and good scalability

Active Publication Date: 2021-04-09
GUANGZHOU UNIVERSITY
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Lack of a complete set of consistency guarantee methods
[0005] In addition, although there are mature consensus algorithms in the computer field, these algorithms have technical difficulties, complex implementation, and poor application effects when they are implemented in specific fields, especially in the field of astronomy. How to achieve simple and easy-to-manage consensus Sexual guarantee method is the important contribution of the present invention

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Radio astronomical data storage consistency guaranteeing method, device and system and storage medium
  • Radio astronomical data storage consistency guaranteeing method, device and system and storage medium
  • Radio astronomical data storage consistency guaranteeing method, device and system and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0060] Such as figure 1 As shown, the present embodiment provides a radio astronomy data storage consistency guarantee system, the system includes a collection server 101, a metadata server 102, a data server 103, a publishing data server 104, a Zookeeper server 105 and a calculation server 106, and the collection server 101, the metadata server 102, the data server 103, the publishing data server 104, the Zookeeper server 105 and the computing server 106 are interconnected through a network.

[0061] Wherein, the acquisition server 101 is connected to the antenna array 108 of the radio telescope through the digital receiver 107, the data observed by the antenna array 107 of the radio telescope is received by the digital receiver 108, and the received radio astronomy data is stored on the acquisition server 101, The metadata server 102 is used for storing metadata information of UVFITS file headers, and the data server 103 is used for storing UVFITS original data files.

[00...

Embodiment 2

[0098] Such as Figure 5 As shown, this embodiment provides a radio astronomy data storage consistency guarantee device, the device is applied to the collection server, which includes a receiving unit 501, a first obtaining unit 502, a second obtaining unit 503, a sending unit 504, a sending unit 505, judging unit 506 and processing unit 507, the specific functions of each unit are as follows:

[0099] The receiving unit 501 is configured to receive the radio astronomy data of the digital receiver and connect to the Zookeeper server after the metadata server, the data server and the publishing data server are connected to the Zookeeper server.

[0100] The first obtaining unit 502 is configured to obtain available metadata servers and data servers through a load balancing module.

[0101] The second obtaining unit 503 is configured to obtain the globally unique ID through the Zookeeper server according to the filled UVFITS header information.

[0102] The sending unit 504 is...

Embodiment 3

[0108] Such as Figure 6 As shown, this embodiment provides an acquisition server, the acquisition server includes a processor 602 connected through a system bus 601, a memory and a network interface 603, the processor is used to provide computing and control capabilities, the memory includes a non-volatile A storage medium 604 and an internal memory 605, the non-volatile storage medium 604 stores computer programs and databases, the internal memory 605 provides an environment for the operation of the computer programs in the non-volatile storage medium, and the processor 602 executes the program stored in the memory In the computer program, the radio astronomy data storage consistency guarantee method of the above-mentioned embodiment 1 is realized, as follows:

[0109] When the metadata server, data server, and publishing data server are connected to the Zookeeper server, receive the radio astronomy data of the digital receiver and connect to the Zookeeper server;

[0110] ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a radio astronomical data storage consistency guaranteeing method, device and system and a storage medium, and the method comprises the steps: receiving radio astronomical data of a digital receiver, and connecting the radio astronomical data with a Zookeeper server; obtaining an available metadata server and a data server through a load balancing module; according to the filled UVFITS header information, obtaining a globally unique ID through a Zookeeper; sending the ID and the UVFITS header information to a metadata server and a data server; according to the state configuration node of the metadata server and the ID value of the state configuration node of the data server, judging whether the UVFITS header information and the data segment of the unified data exist or not, and marking; and if the UVFITS header information and the data segment of the unified data are not judged, performing corresponding processing according to the marking result. The consistency problem of radio astronomical data metadata, original data and processed data can be solved, and basic support is provided for upper-layer application services of various radio observation application systems.

Description

technical field [0001] The invention relates to a method, device, system and storage medium for ensuring the consistency of radio astronomical data storage, and belongs to the technical fields of astronomical technology and computer application. Background technique [0002] Radio astronomy is an important research field in astronomy. Large-scale radio telescopes were first established at home and abroad, such as the "Sky Eye" 500-meter-aperture radio telescope (FAST) in Guizhou, my country, and the centimeter-decimeter wave radioheliograph in Ming'antu, Inner Mongolia. (MUSER), foreign radio telescopes such as the Canadian Hydrogen Intensity Mapping Experiment (CHIME) cylindrical antenna; the Jansky Very Large Array (VLA) in the United States. These radio telescopes can measure physical quantities such as the intensity, frequency spectrum and polarization of celestial radio. In recent years, with the development of information technology, many observation equipment with hig...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08G06F16/182G06F3/06
CPCH04L67/1097G06F3/0619G06F3/067G06F16/182
Inventor 王锋梅盈邓辉刘应波王金戴伟梁波
Owner GUANGZHOU UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap