Memory map-based mass data preprocessing method

A massive data, memory mapping technology, applied in the direction of electrical digital data processing, special data processing applications, semi-structured data retrieval, etc., can solve problems such as design examples of spacecraft gigabit-level massive data preprocessing methods, and reduce the proportion , Improve the efficiency of interpretation, improve the effect of reading and writing speed

Active Publication Date: 2015-02-04
BEIJING LINJIN SPACE AIRCRAFT SYST ENG INST +1
View PDF5 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Judging from the literature, domestic and foreign spacecraft use databases to manage data magnitudes of hundreds of megabytes, and there are no examples of design methods for spacecraft gigabytes of massive ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Memory map-based mass data preprocessing method
  • Memory map-based mass data preprocessing method
  • Memory map-based mass data preprocessing method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] The present invention is described in detail below in conjunction with accompanying drawing and specific embodiment:

[0051] Such as figure 1 As shown, a massive data preprocessing method based on memory mapping, which includes a data table generation module, a massive data fast import module, a massive data fast preprocessing module and a massive data fast retrieval module. Among them, the mass data fast import module includes a memory mapping submodule.

[0052] The data table generation module copies the new data storage table according to the designed data table format, and automatically generates the current data index information in the database index table according to the test information. The index information is used as the basis and basis for the rapid retrieval of massive data.

[0053] After the data import starts, the mass data fast import module reads the original data address, reads the original TXT files sequentially according to the original file con...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to a database reading and writing method for aerospace, and particularly relates to a memory map-based mass data preprocessing method. The method relates to a data table generation module, a mass data fast import module, a mass data fast preprocessing module and a mass data fast retrieval module, wherein the mass data fast import module comprises a memory map sub-module. The method has the advantages that a rational efficient read-write mode and a database structure are established for mass data preprocessing of a spacecraft, a data table with an identifier is generated for telemetry information each time according to a test state and an index is created to facilitate fast retrieval and reading of specific parameters in databases; the gigabit information of the spacecraft is classified and sequentially and quickly inserted into the corresponding databases according to subsystems, parameter names, parameter types and the like, and the insertion completion time frame is second.

Description

technical field [0001] The invention belongs to a database reading and writing method for aerospace, in particular to a method for preprocessing massive data based on memory mapping. Background technique [0002] With the continuous development of space technology, the functions and structures of spacecraft are becoming more and more complex, the sampling frequency is getting higher and higher, and the flight time is getting longer and longer, resulting in the exchange of information and monitoring information generated during the operation of the spacecraft. many. For information interpretation work, using traditional text storage and reading methods, it is becoming more and more difficult for interpreters to locate fault points in massive data, and the proportion of data preprocessing in the interpretation process is increasing, which seriously affects the efficiency of interpretation , and it is not conducive to the development of interpretation automation tools. Therefo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/2282G06F16/24552G06F16/24569G06F16/84
Inventor 窦小明杨飞吴晓蕊谭佳琳李亮
Owner BEIJING LINJIN SPACE AIRCRAFT SYST ENG INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap