DPDK-based astronomy data acquisition and real-time processing method

A real-time processing and data acquisition technology, applied in data exchange network, digital transmission system, electrical components, etc.

Active Publication Date: 2018-11-27
KUNMING UNIV OF SCI & TECH
View PDF4 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, there is currently no effective method that can effectively solve the pr...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • DPDK-based astronomy data acquisition and real-time processing method
  • DPDK-based astronomy data acquisition and real-time processing method
  • DPDK-based astronomy data acquisition and real-time processing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0045] Embodiment 1: as Figure 1-5 As shown, an Intel DPDK-based astronomical data acquisition and real-time processing method, the specific steps are as follows:

[0046] Step1. Build the DPDK operating environment and the first ring buffer queue for receiving network card data working in DPDK mode;

[0047] Step2, continue to read data frames from the first ring buffer queue, and analyze the frame header, construct corresponding messages for different message types analyzed, manipulate DPDK to send response packets, and at the same time, send UDP to the local machine The validity of the data is verified, and the data part of the UDP message is extracted;

[0048] Step3, construct the second ring buffer queue, put the data extracted in Step2 into the second ring buffer queue, the CUDA program reads the data from the second ring buffer queue, and performs real-time processing, and the processed data is read from the second ring buffer Dequeue from the queue.

[0049] Furth...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a DPDK-based astronomy data acquisition and real-time processing method and belongs to the field of network data pack processing. The method comprises step of constructing a DPDK operation environment; creating a memory pool; reading data frames from an annular cache, analyzing frame heads and constructing response reports; carrying out legal verification on UDP data packsand extracting data parts in the reports; placing extracted data into a second annular buffering region; and reading data and carrying out real-time processing from the annular buffering region through a CUDA program. According to the invention, by fully using performance advantages of a DPDK in case of processing of high speed IO compared with traditional performance advantages based on a kernelTCP/IP protocol stack, through a lock-free annular buffering array, parts of the TCP/IP protocol stack are achieved under the user state, so lossless receiving of data in a 10 gigabit network environment is achieved; and compared with the data pack receiving based on the traditional protocol stack, the performance is greatly improved.

Description

technical field [0001] The invention relates to a method for collecting and real-time processing of astronomical data based on DPDK, and belongs to the technical field of network data packet processing. Background technique [0002] The study of radio pulsars is an important content and hot field of modern astronomy. Using radio pulsars as tools, high-precision timing and punctuality, astrodynamics and astrometry, gravitational physics under strong fields, extrasolar planets, galaxies and interstellar media, ultra-dense matter, and plasma physics in extreme environments, etc. aspects of research. With the rise of gravitational wave detection research and pulsar navigation using millisecond pulsars in recent years, the demand for higher observation bandwidth has been put forward for pulsar observation equipment, so that the collection of high-speed data streams , processing and transmission put forward higher performance index requirements. [0003] Since the observation r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/24H04L12/863H04L29/06H04L29/12
CPCH04L41/083H04L47/622H04L61/103H04L63/12H04L69/16H04L69/22
Inventor 戴伟朱彦飞王锋张晓丽罗静
Owner KUNMING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products