Method for optimizing compressed storage format in data processing process

A compression storage format, data processing technology, applied in the direction of electrical digital data processing, special data processing applications, memory systems, etc., can solve the problems of inconvenient data secondary development and in-depth application, optimization, large data volume

Inactive Publication Date: 2020-10-30
AVIATION ARMY INST PEOPLES LIBERATION ARMY AIR FORCE RES INST +1
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to record and generate a large amount of data for the current flight reference system, and the data format is not optimized in the data processing process, which is not convenient for secondary development and deep application of data, especially under the technical conditions of big data, it cannot be realized For the comprehensive processing of multiple sorties data among different models, a method of optimizing the compressed storage format in the data processing process is proposed, so that it is easy to read one or some parameters in any sort of data, and the volume of single sortie data after processing is obvious Reduced, and at the same time, the preprocessed data format is basically uniform among different models

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for optimizing compressed storage format in data processing process
  • Method for optimizing compressed storage format in data processing process
  • Method for optimizing compressed storage format in data processing process

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] The technical solution of the present invention will be further described below in conjunction with the accompanying drawings.

[0025] A method for optimizing the compressed storage format in the data processing process of the present invention, such as Figure 6 As shown, including the following process:

[0026] data collation

[0027] Assuming that each part of the compressed data blocks in the data area has been formed, in order to address each data block, the start address of each data block is sequentially stored with a length of 4 bytes to generate an address area.

[0028] Generate corresponding parameter information for each data block (non-time data block) of recorded data to obtain a parameter dictionary area. The time index and data index in the parameter information are the position of the address in the address area, both of which are represented by 4 bytes, and the bus packet identification is represented by numbers and underlines, directly encode them...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for optimizing a compressed storage format in a data processing process, which comprises the following steps of: 1, data arrangement: mainly dividing data formats of different models into an address area, a parameter dictionary area and a data area; furthermore, different data packets share a time sequence, and the same time sequence is set for different data packets from the same bus or different buses; and 2, compressing data, namely compressing the data by adopting a differential encoding technology and using ZLIB. According to the method, a certain parameter or some parameters can be conveniently read from any sort of data, the reading and storage efficiency of the data is obviously improved, and less computer resources are occupied during deep development and utilization of the data; the method is convenient for data storage and transfer; according to the method, the unification of data formats among multiple models can be realized, and the comparison application of multiple models and multiple sorts of data is facilitated.

Description

technical field [0001] The invention relates to a method for optimizing a compressed storage format during data processing, which belongs to the field of flight parameter data processing and storage, and is used to determine the definition of the data format in the process of processing flight parameter data, as well as the compression and storage of data, so as to facilitate the processing The secondary development and utilization of the post-flight parameter data is suitable for the processing and storage of the flight parameter system data and other bus data of fixed-wing, helicopter and UAV systems. Background technique [0002] The flight parameter recording system (referred to as flight reference) is a device that automatically records the working status of the aircraft and its airborne equipment. It can continuously monitor the working conditions of the entire aircraft system in real time at a fixed sampling rate when the aircraft is powered on. Acquired and recorded,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F12/02G06F16/174G06F16/951G06F16/9537
CPCG06F12/0223G06F16/9537G06F16/951G06F16/1744
Inventor 胡树正汤剑张瑞峰周伟吴正礼廉淙张为民杨海林王卫刚肖从云惠怀海
Owner AVIATION ARMY INST PEOPLES LIBERATION ARMY AIR FORCE RES INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products