A Highly Efficient Fast-View Recording System and Method for Agile Multi-Mode Observation Satellites

Abstract

This invention discloses an efficient fast-view recording system and method for agile multi-mode observation satellites. The system includes a raw data recording module, a raw data playback module, a data decompression module, and a formatted data recording module. The raw data recording module receives the raw data recording plan start file, reads the raw data stream, writes the raw data stream to a file, and sends it to the raw data playback module. The raw data playback module plays back the raw data and sends the raw data to the data decompression module, which then decompresses it and sends it to the formatted data recording module. The formatted data recording module uses a two-level caching method to perform formatted recording processing and generates a standardized set of level 0 data files, simultaneously generating image fast-view data and auxiliary data information. This invention solves the problem of excessive file numbers causing recording delays or inability to record in real time when recording level 0 datasets for existing agile satellites.

Description

Technical Field

[0001] This invention relates to an efficient recording fast-view system and method for agile multi-mode observation satellites, belonging to the field of remote sensing satellite ground processing technology. Background Technology

[0002] Currently, the main function of the fast-view recording system of remote sensing satellite ground systems is to receive and track the raw data sent by the receiving system, and process the raw data as level 0 strip data in real time, displaying the strip data in fast view during the real-time processing. Chinese patent CN114465652A discloses a scheduling system for real-time fast-view processing of remote sensing satellites, but does not describe the specific content and working method of the background algorithm unit. Chinese patent CN114966691B discloses a satellite SAR data recording fast-view and application system, introducing the working principle and workflow of the algorithm module, but does not describe the working principle and workflow of fast-view for remote sensing optical satellites. Summary of the Invention

[0003] The technical problem solved by this invention is to overcome the shortcomings of the prior art and propose an efficient recording fast-view system and method for agile multi-mode observation satellites. By designing the satellite image fast-view display process and the threshold design method for memory caching, the problem of excessive number of files causing recording delays or inability to record in real time when recording existing agile satellite level 0 datasets is solved.

[0004] The technical solution of this invention is:

[0005] A high-efficiency recording and fast-viewing system for agile multi-mode observation satellites includes a raw data recording module, a raw data playback module, a data decompression module, and a formatted data recording module.

[0006] The raw data recording module receives the raw data recording plan start file, reads the raw data stream sent by the tracking and receiving system, writes the raw data stream to a file according to the information in the raw data recording plan start file, and sends it to the raw data playback module.

[0007] The raw data playback module plays back the raw data according to the raw data playback plan and sends the raw data to the data decompression module; the data decompression module decompresses the raw data and sends it to the formatted data recording module.

[0008] The formatted data recording module receives data, performs formatted recording processing using a two-level caching method, and generates a set of level 0 data files. At the same time, it generates image quick-view data and auxiliary data information.

[0009] Preferably, the Level 0 data file set includes image data, raw auxiliary data (i.e., camera auxiliary data transmitted by the satellite along with the images), line count file data (i.e., line timing information corresponding to satellite imaging), calculated auxiliary data (i.e., the binary file transmitted by the satellite is parsed into the corresponding text file according to the satellite-to-ground interface content), and header file information (i.e., a description file of the content of this dataset).

[0010] Preferably, a level 0 data file set is generated after formatting the records using a two-level caching method. The formatting record processing method is as follows:

[0011] Real-time data frame synchronization, auxiliary data extraction, line count extraction, image data extraction, and image data stitching are performed to obtain image data, raw auxiliary data, line count file data, calculated auxiliary data, and header file information data.

[0012] Image data is written to the level 0 data file set in real time, while the original auxiliary data, line count file data, calculated auxiliary data, and header information data are temporarily written to memory. When the image data transmission is completed or when memory usage exceeds the memory threshold, the original auxiliary data, line count file data, calculated auxiliary data, and header information data are written to the level 0 data file set in blocks.

[0013] Preferably, after image data transmission is completed or when memory usage exceeds a memory threshold, the original auxiliary data, line count file data, calculated auxiliary data, and header file information data are then written into the level 0 data file set in blocks. The method for determining the memory threshold is as follows:

[0014]

[0015] Preferably, the original data stream is written to a file according to the information in the original data recording plan start file, the file is divided into fixed-size sub-files and each sub-file is numbered, and the divided sub-files are sent to the original data playback module using the FTP protocol.

[0016] Preferably, it also includes a quick-view display module to display the image quick-view data and auxiliary data information generated by the formatted data recording module.

[0017] Preferably, the fast-view display module is a spliced ​​CCD. The splicing method is as follows: each CCD uses a receiving buffer. When the receiving buffer is full, the corresponding absolute line count in other CCDs is searched based on the smallest absolute line count in each CCD. The images are then spliced ​​into a whole line of fast-view images according to the order of the CCD chip numbers for display.

[0018] Preferably, the difference between the spectral segments of the multispectral imaging at the same time is added to the absolute row count before stitching, and then displayed according to the blue, green and red bands to obtain a pseudo-color multispectral fast image.

[0019] An efficient fast-view recording method for agile multi-mode observation satellites includes:

[0020] Receive the raw data recording plan start file, read the raw data bitstream, and write the raw data bitstream to the file according to the information in the raw data recording plan start file;

[0021] Receive the original data playback plan and play back the original data at the specified rate;

[0022] After decompressing the raw data, it is combined with the received records to generate a set of level 0 data files, image quick-view data and auxiliary data information according to the standard product format specifications, and then stored.

[0023] Displays quick-view image data and auxiliary data information.

[0024] The preferred method for performing combined received record processing is as follows:

[0025] Image data is written in real time, while raw auxiliary data, line count file data, calculated auxiliary data, and header information data are temporarily written to memory. When the image data transmission is complete or when memory usage exceeds a threshold, the raw auxiliary data, line count file data, calculated auxiliary data, and header information data are written to the file in blocks.

[0026] The advantages of this invention compared to the prior art are:

[0027] (1) This invention solves the problem of recording delay or inability to record in real time caused by the excessive number of files when recording the existing Agile Satellite Level 0 dataset by utilizing memory caching and creatively proposing a threshold design method, and realizes the function of real-time recording of Level 0 data file sets for Agile Satellite multi-target multi-mode data downlink.

[0028] (2) The present invention optimizes the existing satellite image quick-view display process and performs real-time satellite image quick-view display while recording the level 0 data file set. Attached Figure Description

[0029] Various other advantages and benefits will become apparent to those skilled in the art upon reading the following detailed description of preferred embodiments. The accompanying drawings are for illustrative purposes only and are not intended to limit the invention. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings:

[0030] Figure 1This is a flowchart of an efficient recording fast-view method for agile multi-mode observation satellites according to an embodiment of the present invention;

[0031] Figure 2 This is a block diagram of the efficient recording fast-view system for agile multi-mode observation satellites according to an embodiment of the present invention. Detailed Implementation

[0032] Exemplary embodiments of the present disclosure will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

[0033] A high-efficiency recording fast-view system for agile multi-mode observation satellites, such as Figure 2 As shown, it includes a raw data recording module, a raw data playback module, a data decompression module, a formatted data recording module, and a fast-view display module.

[0034] The raw data recording module is a resident memory service software. After parsing the data recording plan start file issued by the scheduling system to the raw data recording module, it opens the network service and begins receiving and tracking the raw data stream sent by the receiving subsystem. Based on the information in the plan start file (satellite designation, receiving station information, payload information, imaging information, etc.), it writes the raw data stream to a file. To meet the real-time requirements of subsequent processing, the file is split into fixed-size files, and the file numbers are automatically incremented. Simultaneously, the split files are sent to the raw data playback module using the FTP protocol. Once data reception is complete, a reception completion status is sent to the monitoring and management subsystem, along with a report of the specific information received.

[0035] The raw data playback module parses the task start plan issued by the scheduling module and sends the raw data to the decompression module using the TCP protocol based on the information in the start plan (raw data path, playback rate, playback network address). To meet real-time requirements, the raw data playback module supports a simultaneous recording and playback mode, as well as a read-and-playback mode. Furthermore, to ensure the decompression module completes its task correctly, a task completion message needs to be sent to the decompression module after data playback is finished.

[0036] The decompression module is a resident memory service software. When the link receiving port receives data, it performs deinterleaving, descrambling, and decompression functions in real time, and then sends the decompressed data to the link sending port in real time. When the link receiving port receives a task completion message, it disconnects the front-end and back-end links and resets the decompression module.

[0037] The formatting and recording module parses the task start plan issued by the scheduling module. Based on the information in the start plan (data storage path, satellite / payload information, decompression network address), it uses the TCP protocol to receive the decompressed data sent by the decompression module. It performs real-time data frame synchronization, auxiliary data extraction, line count extraction, image data extraction, and image data stitching. It also calculates auxiliary data and sampled image data in real-time and sends the fast-view data to the fast-view display module. When the decompression module disconnects the network link, the task ends. The formatting and recording module then compiles task information (imaging time, number of images, data quality, etc.) and reports it to the scheduling module.

[0038] The QuickView display module is a resident memory service software. After configuring and formatting the network information, it begins receiving QuickView data sent by the formatting recording module and displays the image and auxiliary data in the QuickView data in real time. Simultaneously, it sends status information about the QuickView display module to the formatting recording module. The QuickView display is complete once the formatting recording port is connected.

[0039] Efficient recording fast-viewing methods based on efficient recording fast-viewing systems for agile multi-mode observation satellites, such as... Figure 1 As shown, it specifically includes:

[0040] (1) After receiving the original data recording plan issued by the parsing scheduling system, the original data recording module receives the original data transmitted by the front-end data transmission system, records the original data, and sends the original data to the original data playback module via FTP.

[0041] (2) After receiving the original data playback plan issued by the scheduling system, the original data playback module reads the original data transmitted by FTP and sends the original data to the data acquisition and transmission module at the specified rate to realize the original data playback. The original data is then sent to the decompression module for data decompression processing via the network.

[0042] The raw data playback module also supports raw data in various formats, including raw data folders recorded in 100MB blocks, with data storage in a format where the file number increments by 1. It also supports a raw data recording mode where one track contains one large file.

[0043] (3) The data decompression module receives the raw satellite data sent by the raw data playback module and decompresses the data according to the data transmission rate of the raw data playback module. Simultaneously, it sends the decompressed data to the formatted recording module.

[0044] (4) The formatted data recording module receives and records the decompressed data stream or data file output by the decompression module, and generates a level 0 data file set according to the standard product format specification, including image data, auxiliary data, line count, and level 0 header file. At the same time, it generates image quick-view data and auxiliary data information and sends them to the quick-view display module;

[0045] For multi-mode agile satellite data optimization processing: Level 0 dataset files contain image data, raw auxiliary data, line count files, calculated auxiliary data, and header information. Furthermore, there are multiple CCD slices; for example, 4 CCDs in strip imaging mode result in 4*5=20 files. When the satellite is in staring mode, at least 6 images of the same location are required, resulting in 4*5*6=120 files. When a single track contains 5 imaging targets, 4*5*6*5=600 files are needed. Processing 600 files within the same track in formatted recording places a significant burden on the storage system and results in high latency. Therefore, this invention proposes a method using memory as a secondary cache for multi-mode agile satellite formatted recording, i.e., real-time writing of image files. Since image files occupy more than 98% of the total data volume in a single transmission, real-time writing of image files is crucial. Other files are temporarily written to memory. Once the data transfer is complete or memory usage exceeds a threshold, the other files are written to the file in chunks. This satisfies the real-time requirements of formatting processing while also reducing the problem of high file write latency, thus efficiently handling multi-mode agile satellite formatting records.

[0046] Determining the memory threshold is crucial for efficient recording of fast-moving images. An excessively large threshold will negatively impact real-time write efficiency and cause excessive system latency, while an excessively small threshold will fail to achieve the desired multi-file caching effect. Based on extensive experimentation and analysis, a method for calculating this value is proposed:

[0047]

[0048] The threshold calculated in this way ensures that image data can be written in real time every second without causing excessive latency to the system. For example, the maximum satellite downlink rate is 450Mbps, the maximum compression ratio is 8, the number of CCDs is 4, and the panchromatic multispectral ratio is 1:4. The threshold for each panchromatic CCD is 450Mbps * 8 / 4 * (4 / (1 + 4)) = 720Mbps = 90MBps.

[0049] (5) The QuickView display module receives the converted auxiliary data and sampled image data and displays them on the screen. Users can intuitively monitor the reception status and view the camera shooting area through QuickView. Operators can switch between three display modes: refresh, scroll, and slideshow, and can adjust the display ratio and brightness. At the same time, the QuickView display module can display the auxiliary data corresponding to the image at this location in real time.

[0050] The QuickView display module supports multi-CCD stitching for display. The stitching principle involves using a certain amount of receiver buffer for each CCD. When the buffer is full, the module uses the smallest absolute row count in each CCD as a reference, searches for the corresponding absolute row count in other CCDs, and then stitches the images into a single line of QuickView images according to the CCD chip numbers for display. The QuickView display module also supports multispectral pseudo-color display. Because there are differences between spectral bands when multispectral imaging occurs simultaneously, and this difference is a fixed value for each satellite, the difference is added to the absolute row count during multispectral imaging before stitching, and then displayed according to the blue, green, and red bands to obtain a pseudo-color multispectral QuickView image.

[0051] The embodiments described above are merely preferred embodiments of the present invention. Ordinary variations and substitutions made by those skilled in the art within the scope of the technical solution of the present invention should be included within the protection scope of the present invention.

Claims

1. A high-efficiency recording fast-view system for agile multi-mode observation satellites, characterized in that, It includes a raw data recording module, a raw data playback module, a data decompression module, and a formatted data recording module; The raw data recording module receives the raw data recording plan start file, reads the raw data stream sent by the tracking and receiving system, writes the raw data stream to a file according to the information in the raw data recording plan start file, and sends it to the raw data playback module. The raw data playback module plays back the raw data according to the raw data playback plan and sends the raw data to the data decompression module; the data decompression module decompresses the raw data and sends it to the formatted data recording module. The formatted data recording module receives data, performs formatted recording processing using a two-level caching method, and generates a set of level 0 data files. At the same time, it generates image quick-view data and auxiliary data information. After formatting records using a two-level caching method, a level 0 data file set is generated. The formatting record processing method is as follows: Real-time data frame synchronization, auxiliary data extraction, line count extraction, image data extraction, and image data stitching are performed to obtain image data, raw auxiliary data, line count file data, calculated auxiliary data, and header file information data. Image data is written to the level 0 data file set in real time, while the original auxiliary data, line count file data, calculated auxiliary data, and header file information data are temporarily written to memory. Once the image data transmission is complete or when memory usage exceeds the memory threshold, the original auxiliary data, line count file data, calculated auxiliary data, and header file information data are written into the level 0 data file set in blocks. After image data transmission is complete, or when memory usage exceeds the memory threshold, the original auxiliary data, line count file data, calculated auxiliary data, and header file information data are then written into the level 0 data file set in blocks. The method for determining the memory threshold is as follows: 。 2. The efficient recording fast-view system for agile multi-mode observation satellites according to claim 1, characterized in that, The Level 0 data file set includes image data, raw auxiliary data (i.e., camera auxiliary data transmitted by the satellite along with the images), line count file data (i.e., line timing information corresponding to satellite imaging), calculated auxiliary data (i.e., the binary files transmitted by the satellite are parsed into corresponding text files based on the satellite-to-ground interface content), and header file information (i.e., a description file of the contents of this dataset).

3. The efficient recording fast-view system for agile multi-mode observation satellites according to claim 1, characterized in that, The original data stream is written to a file based on the information in the original data recording plan start file. The file is then divided into fixed-size sub-files, each of which is numbered. The divided sub-files are then sent to the original data playback module using the FTP protocol.

4. The efficient recording fast-view system for agile multi-mode observation satellites according to claim 1, characterized in that, It also includes a quick-view display module, which displays the image quick-view data and auxiliary data information generated by the formatted data recording module.

5. The efficient recording fast-view system for agile multi-mode observation satellites according to claim 4, characterized in that, The fast-view display module uses spliced ​​CCDs. The splicing method is as follows: each CCD uses a receiving buffer. When the receiving buffer is full, the minimum absolute line count in each CCD is used as the reference to find the corresponding absolute line count in other CCDs. The images are then spliced ​​into a whole line of fast-view images according to the order of the CCD chip numbers for display.

6. The efficient recording fast-view system for agile multi-mode observation satellites according to claim 5, characterized in that, The difference between the spectral bands of the multispectral imaging at the same time is added to the absolute row count and then stitched together. The images are then displayed according to the blue, green and red bands to obtain a pseudo-color multispectral fast image.

7. A highly efficient fast-view recording method for agile multi-mode observation satellites, characterized in that, include: Receive the raw data recording plan start file, read the raw data bitstream, and write the raw data bitstream to the file according to the information in the raw data recording plan start file; Receive the original data playback plan and play back the original data at the specified rate; After decompressing the raw data, it is combined with the received records to generate a set of level 0 data files, image quick-view data and auxiliary data information according to the standard product format specifications, and then stored. Displays quick-view image data and auxiliary data information; After formatting records using a two-level caching method, a level 0 data file set is generated. The formatting record processing method is as follows: Real-time data frame synchronization, auxiliary data extraction, line count extraction, image data extraction, and image data stitching are performed to obtain image data, raw auxiliary data, line count file data, calculated auxiliary data, and header file information data. Image data is written to the level 0 data file set in real time, while the original auxiliary data, line count file data, calculated auxiliary data, and header file information data are temporarily written to memory. Once the image data transmission is complete or when memory usage exceeds the memory threshold, the original auxiliary data, line count file data, calculated auxiliary data, and header file information data are written into the level 0 data file set in blocks. After image data transmission is complete, or when memory usage exceeds the memory threshold, the original auxiliary data, line count file data, calculated auxiliary data, and header file information data are then written into the level 0 data file set in blocks. The method for determining the memory threshold is as follows: 。

Images