Massive measurement data near-real-time storage method
A quasi-real-time technology for measuring data, applied in the direction of electrical digital data processing, special data processing applications, instruments, etc., can solve the problem of unrealistic parameters, data centralized management data analysis, unable to meet real-time processing, storage requirements, and prone to leakage Problems such as installation and wrong installation can be solved to achieve the effect of improving storage efficiency and reliability, reliable storage, and increasing utilization rate
Active Publication Date: 2015-05-27
BEIJING INST OF ASTRONAUTICAL SYST ENG +1
View PDF6 Cites 3 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The traditional real-time processing and storage software for 2Mbps telemetry data cannot meet the real-time processing and storage requirements due to the use of memory cache and SQL statement insertion
As the number of parameters increases exponentially, it takes at least two weeks for one person to complete all the binding work in the way of manual binding parameters, and it is very easy to have missing and wrong loading problems.
At the same time, the parameters and data of the measurement system are distributed in various information systems, and there is no interface between them, forming an information island, which cannot realize centralized management of parameters and data and effective data analysis
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment 1
[0039] Based on this method, the original code data of the measurement system with a frequency of 50 Hz and a data volume of 10 Mbps is stored in real time. The hardware environment is shown in Table 1. When the number of warehousing result tables is 60, and the number of parameters contained in each result table is 20, the warehousing performance under different threshold conditions is tested, and the test results are shown in Table 2.
[0040] Table 1 Hardware environment
[0041]
[0042] Table 2 Test results
[0043] threshold
[0044] The test results show that when the threshold is set at 3000-10000, the performance is optimal. When the threshold is less than 3000, the smaller the threshold, the higher the frequency of calling Oracle SQL*Loader, resulting in a decline in storage performance. When the threshold is greater than 10000 At this time, the execution time of each call to Oracle SQL*Loader is prolonged, which obviously affects the storage performan...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to a massive measurement data near-real-time storage method which is implemented by virtue of a massive measurement data near-real-time storage system. The massive measurement data near-real-time storage system comprises a data service sub-module, a data processing sub-module, a parameter definition sub-module, a database table mapping sub-module, a network communication sub-module, an IP (Internet Protocol) allocation sub-module, a database parameter allocation sub-module, a buffer file library and an Oracle database. Aiming at the massive data storage problem, the invention innovatively designs the massive data storage system. By virtue of the parallel cooperative operation of all the modules in the system and a batched storage mode, real-time treatment and storage of massive telemeasuring data are realized; according to the method, the storage efficiency is obviously improved, rapid, accurate and reliable storage for massive data of a measuring system is realized, and the integrated and unified management of measurement information is facilitated.
Description
technical field [0001] The invention relates to a quasi-real-time storage method for massive measurement data, which belongs to the technical field of informatization and integrated management of aerospace vehicle measurement systems. Background technique [0002] The measurement system is an indispensable and important part of the aerospace vehicle. As an engineering application type information system, it includes three major links of information collection, transmission and processing, among which telemetry parameter binding, real-time processing and management of telemetry data are the processing links. one of the key tasks. In recent years, with the application of the 10Mbps high bit rate data transmission technology of the measurement system and the 1553B bus data transmission technology of the control system, the telemetry test parameters have quadrupled to 5,000, and the measurement data types are various, including slowly changing parameters, Various data types suc...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More IPC IPC(8): G06F17/30
CPCG06F16/258
Inventor 亓朝玉何信华徐华丽叶成敏程博赵雷蔡剑波连彦泽韩亮颜廷贵蓝鲲李世鹏沈志军
Owner BEIJING INST OF ASTRONAUTICAL SYST ENG