High-reliability and lossless data acquisition and storage method

A data acquisition and lossless technology, applied in hardware redundancy for data error detection, electrical digital data processing, digital transmission system, etc., can solve the problems of complex composition of system equipment, unresolved data loss, low precision, etc.

Inactive Publication Date: 2018-03-13
湖南胜云光电科技有限公司
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Chinese patent CN201610959821.7 reveals the design of an integrated high-reliability and high-precision long-term monitoring system, including two commutation acquisition and editing units, two integrated controllers, switches, and two monitoring computers, which solves the complex composition of system equipment and low precision , The problem of insufficient long-term reliability has realized the function of high reliability, high precision and long-term monitoring of the system. This invention adopts dual-machine backup on hardware to achieve high reliability. However, the system mainly uses hardware backup to achieve high reliability. There is no Solve the problem of data loss in the process of dual-machine switching

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High-reliability and lossless data acquisition and storage method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] The technical solution of this patent will be further described in detail below in conjunction with specific embodiments.

[0023] see figure 1 , a highly reliable and lossless data acquisition and storage method, the specific steps are as follows:

[0024] (1) Start the system. After the server receives the network data from the client, it first inserts the data into the tail of the sending data cache queue, and notifies the database storage thread, and then stores the network data according to the massive storage overhead cache algorithm;

[0025] (2) Then notify the data sending module to send, the data sending module is an infinite loop sending processing thread, connects to the current main collection and transmission server, and uses an asynchronous non-blocking method to send network data;

[0026] (3) When there is data in the sending data buffer queue, read the sendable data from the head of the sending data buffer queue, call the underlying API function async...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a high-reliability and lossless data acquisition and storage method. After receiving network data sent by a client, a server inserts the data into the tail of a message sendingqueue, informs a database storage thread and then stores the network data according to a massive storage overhead caching algorithm; the database storage thread reads the data from the head of the message sending queue and inserts the data into a background database; and a heartbeat message is sent between a main acquisition and transmission server and a slave acquisition and transmission serverregularly to detect the survivability of the main server. According to the method, the data can be sent to a server module in a high stability and high reliability mode in the high traffic and outburst huge traffic environment, and meanwhile it is guaranteed that the acquired data is losslessly forwarded to the background database on the abnormal condition generated in the switching process of a main server module and a slave server module.

Description

technical field [0001] The invention relates to the technical field of information collection and analysis, in particular to a highly reliable and lossless data collection and storage method. Background technique [0002] During the operation of the data acquisition system, it is necessary to record the parameters, status and other information of the system operation for future analysis of the system status. The military data acquisition system operates on airborne equipment in the field. It mainly operates in the field, and the external environment is harsh. situation. [0003] At present, the dual-machine backup technology is used to ensure the high reliability of data collection. The dual-machine backup includes the backup of the collection process and the backup of background data. Engine and database storage backup purpose; and the collection process backup is due to the different application purposes of each system. Currently, there are relatively few architectures d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L1/22G06F11/20
CPCG06F11/2028G06F11/2094H04L1/22
Inventor 王军民潘磊王文奇
Owner 湖南胜云光电科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products