Methods, systems, and storage media for payload data processing of meteorological satellites

By parsing, deduplicating, and converting the format of payload data on the intelligent computer of the meteorological satellite, the problem of low processing efficiency of meteorological satellite payload data was solved, and real-time meteorological forecast results were generated.

CN123115058APending Publication Date: 2026-11-17ZHEJIANG LAB
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202611627993.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-10-21
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

The current data processing methods for meteorological satellite payloads result in delayed weather forecasts that lack real-time performance and have low processing efficiency.

Method used

On the intelligent computer of the meteorological satellite, payload data files are obtained from solid-state storage, merged with historical unprocessed data files, parsed and a file index structure is built, the index structure is used for deduplication, and converted into a hierarchical data format file, which is finally input into the meteorological forecasting algorithm to generate results.

Benefits of technology

It improved the efficiency of meteorological satellite payload data processing and enabled the generation of real-time weather forecast results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123115058A_ABST
    Figure CN123115058A_ABST
Patent Text Reader

Abstract

This application relates to a method, system, and storage medium for processing payload data of a meteorological satellite. The method includes: retrieving payload data files from the meteorological satellite's solid-state memory; merging the payload data files with historically unprocessed payload data files to obtain a payload data file set; parsing each payload data file to obtain multiple packet groups; constructing a file index structure and an hourly index structure based on the multiple packet groups; using the file index structure to prune and remove duplicates from the multiple packet groups to obtain multiple valid packet groups; updating the file index structure and hourly index structure based on the valid packet groups; using the updated hourly index structure, the updated file index structure, and a preset script, converting the valid packet groups corresponding to each intermediate hour into corresponding hierarchical data format files; and inputting the multiple hierarchical data format files into a preset meteorological forecasting algorithm to obtain meteorological forecast results.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of payload data processing technology for meteorological satellites, and in particular to methods, systems and storage media for payload data processing of meteorological satellites. Background Technology

[0002] Meteorological satellites carry multiple payloads to continuously observe the Earth's atmosphere, and the collected payload data is transmitted in real time to the satellite's solid-state storage. These payloads can include various meteorological instruments such as microwave detectors, infrared detectors, and ultraviolet ozone detectors.

[0003] Current meteorological satellite payload data processing technologies often employ a downlink-then-process approach, downloading large amounts of payload data from the meteorological satellite's solid-state storage to the ground and then processing it using ground resources. This method results in delayed weather forecasts, lacking real-time accuracy. Therefore, this approach suffers from low efficiency in processing meteorological satellite payload data.

[0004] There is currently no effective solution to the problem of low data processing efficiency of meteorological satellite payloads in related technologies. Summary of the Invention

[0005] This embodiment provides a method, system, and storage medium for processing payload data of a meteorological satellite, in order to solve the problem of low efficiency in processing payload data of meteorological satellites in related technologies.

[0006] Firstly, this embodiment provides a method for processing payload data of a meteorological satellite, used in the intelligent computing system of the meteorological satellite, comprising:

[0007] The payload data file is retrieved from the solid-state storage of the meteorological satellite; and the payload data file is merged with historical unprocessed payload data files to obtain a payload data file set.

[0008] The individual load data files in the load data file set are parsed to obtain multiple packet groups;

[0009] Based on the multiple package groups, construct a file index structure and an hour index structure;

[0010] Using the file index structure, the multiple package groups are pruned and deduplicated to obtain multiple valid package groups; and the file index structure and the hour index structure are updated according to the valid package groups.

[0011] Using the updated hour index structure, the updated file index structure, and the preset script, the valid packet groups corresponding to each intermediate hour are converted into corresponding hierarchical data format files;

[0012] Multiple hierarchical data format files are input into a preset weather forecasting algorithm to obtain weather forecast results.

[0013] In some embodiments, parsing the various payload data files in the payload data file set to obtain multiple packet groups includes:

[0014] Frame protocol parsing is performed on each payload data file in the payload data file set to obtain multiple complete master packets with timestamps;

[0015] The multiple complete master packets with timestamps are classified and merged to obtain the multiple packet groups.

[0016] In some embodiments, constructing the file index structure and hour index structure based on the plurality of package groups includes:

[0017] Based on the first frame header address, last frame tail address, first frame broadcast time, and last frame broadcast time of the multiple packet groups, construct the file index structure and the hour index structure.

[0018] In some embodiments, the step of using the file index structure to prune and deduplicate the multiple package groups to obtain multiple valid package groups includes:

[0019] Using the file index structure, overlap detection is performed on the multiple packet groups to obtain overlapping packet group pairs;

[0020] Based on the packet pair, determine the overlap type and clipping position;

[0021] Based on the overlap type and the clipping position, the packet pairs are clipped and deduplicated to obtain the plurality of valid packet pairs.

[0022] In some embodiments, the step of converting the valid packet groups corresponding to each intermediate hour into corresponding hierarchical data format files using the updated hour index structure, the updated file index structure, and a preset script includes:

[0023] Using the updated hour index structure and the updated file index structure, the valid packet group corresponding to each intermediate hour is determined;

[0024] Using a pre-set script, the valid packet groups corresponding to each intermediate hour are converted into the corresponding hierarchical data format files.

[0025] In some of these embodiments, it also includes:

[0026] Based on the preset key area configuration information, the meteorological information of the key areas is extracted from the weather forecast results; and the meteorological information is reported to the associated integrated electronic system.

[0027] In some of these embodiments, it also includes:

[0028] The payload data file converted to the aforementioned hierarchical data format file is marked as processed;

[0029] The payload data file that has not been converted to the aforementioned hierarchical data format is marked as unprocessed.

[0030] Secondly, this embodiment provides a payload data processing system for a meteorological satellite, including a payload data acquisition module, a payload data parsing module, an index structure construction module, a payload data deduplication module, a payload data conversion module, and a meteorological forecast result generation module, wherein:

[0031] The payload data acquisition module is used to acquire payload data files from the solid-state storage of the meteorological satellite; and merge the payload data files with historical unprocessed payload data files to obtain a payload data file set;

[0032] The load data parsing module is used to parse each load data file in the load data file set to obtain multiple packet groups;

[0033] The index structure construction module is used to construct a file index structure and an hour index structure based on the multiple package groups;

[0034] The payload data deduplication module is used to use the file index structure to trim and deduplicat the multiple packet groups to obtain multiple valid packet groups; and to update the file index structure and the hour index structure according to the valid packet groups.

[0035] The payload data conversion module is used to convert the effective packet groups corresponding to each intermediate hour into corresponding hierarchical data format files using the updated hour index structure, the updated file index structure, and a preset script.

[0036] The weather forecast result generation module is used to input multiple hierarchical data format files into a preset weather forecast algorithm to obtain weather forecast results.

[0037] Thirdly, this embodiment provides an electronic device including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the payload data processing method for the meteorological satellite described in the first aspect.

[0038] Fourthly, this embodiment provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the meteorological satellite payload data processing method described in the first aspect.

[0039] Compared with related technologies, the meteorological satellite payload data processing method provided in this embodiment obtains payload data files from the meteorological satellite's solid-state memory; merges the payload data files with historical unprocessed payload data files to obtain a payload data file set; parses each payload data file in the payload data file set to obtain multiple packet groups; constructs a file index structure and an hourly index structure based on the multiple packet groups; uses the file index structure to trim and deduplicate the multiple packet groups to obtain multiple valid packet groups; updates the file index structure and hourly index structure based on the valid packet groups; uses the updated hourly index structure, the updated file index structure, and a preset script to convert the valid packet groups corresponding to each intermediate hour into corresponding hierarchical data format files; and inputs the multiple hierarchical data format files into a preset meteorological forecasting algorithm to obtain meteorological forecast results. This method enables payload data processing on the meteorological satellite's intelligent computer, efficiently deduplicating payload data using the file index structure and efficiently converting payload data formats using the hourly index structure, thereby efficiently generating meteorological forecast results, thus improving the efficiency of meteorological satellite payload data processing.

[0040] Details of one or more embodiments of this application are set forth in the following drawings and description to make other features, objects and advantages of this application more readily apparent. Attached Figure Description

[0041] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0042] Figure 1 This is a hardware structure block diagram of the terminal of the meteorological satellite payload data processing method in this embodiment;

[0043] Figure 2 This is a flowchart of the payload data processing method for the meteorological satellite in this embodiment;

[0044] Figure 3 This is a preferred flowchart of the payload data processing method for a meteorological satellite in this embodiment;

[0045] Figure 4 This is a structural block diagram of the payload data processing system of the meteorological satellite in this embodiment;

[0046] Figure 5This is a preferred structural block diagram of the payload data processing system of the meteorological satellite in this embodiment. Detailed Implementation

[0047] To better understand the purpose, technical solution, and advantages of this application, the application is described and illustrated below in conjunction with the accompanying drawings and embodiments.

[0048] Unless otherwise defined, the technical or scientific terms used in this application shall have the general meaning understood by one of ordinary skill in the art to which this application pertains. Words such as “a,” “an,” “an,” “the,” “the,” and “these” used in this application do not indicate quantitative limitation and may be singular or plural. The terms “comprising,” “including,” “having,” and any variations thereof used in this application are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or device that comprises a series of steps or modules (units) is not limited to the listed steps or modules (units) but may include steps or modules (units) not listed, or may include other steps or modules (units) inherent to these processes, methods, products, or devices. Words such as “connected,” “linked,” and “coupled” used in this application are not limited to physical or mechanical connections but may include electrical connections, whether direct or indirect. “Multiple” used in this application refers to two or more. “And / or” describes the relationship between related objects, indicating that three relationships may exist; for example, “A and / or B” can represent: A alone, A and B simultaneously, and B alone. Normally, the character " / " indicates that the objects before and after it are in an "or" relationship. The terms "first," "second," "third," etc., used in this application are merely to distinguish similar objects and do not represent a specific order of objects.

[0049] The method embodiments provided in this example can be executed on a terminal, computer, or similar computing device. For example, it can run on a terminal. Figure 1 This is a hardware structure block diagram of the terminal for the meteorological satellite payload data processing method in this embodiment. (See diagram for example.) Figure 1 As shown, a terminal may include one or more ( Figure 1 Only one is shown in the diagram. A processor 102 and a memory 104 for storing data are also included. The processor 102 may be, but is not limited to, a microprocessor (MCU) or a programmable logic device (FPGA). The terminal may also include a transmission device 106 for communication functions and an input / output device 108. Those skilled in the art will understand that… Figure 1 The structure shown is for illustrative purposes only and does not limit the structure of the terminal described above. For example, the terminal may also include components that are larger than... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown are illustrated.

[0050] The memory 104 can be used to store computer programs, such as application software programs and modules, like the computer program corresponding to the meteorological satellite payload data processing method in this embodiment. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, thereby implementing the above-described method. The memory 104 may include high-speed random access memory and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 104 may further include memory remotely located relative to the processor 102, and these remote memories can be connected to the terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof.

[0051] The transmission device 106 is used to receive or send data via a network. This network includes a wireless network provided by the terminal's communication provider. In one example, the transmission device 106 includes a Network Interface Controller (NIC), which can connect to other network devices via a base station to communicate with the Internet. In another example, the transmission device 106 can be a Radio Frequency (RF) module used for wireless communication with the Internet.

[0052] This embodiment provides a method for processing payload data from a meteorological satellite. Figure 2 This is a flowchart of the payload data processing method for the meteorological satellite in this embodiment, as shown below. Figure 2 As shown, the process includes the following steps:

[0053] Step S201: Obtain payload data files from the solid-state storage of the meteorological satellite; and merge the payload data files with historical unprocessed payload data files to obtain a payload data file set.

[0054] Specifically, the payload data file is the data file collected by the payload carried by the meteorological satellite and transmitted to the solid-state storage of the meteorological satellite. This payload can be an onboard terahertz ice cloud meteorological instrument, microwave detector, infrared detector, ultraviolet ozone detector, etc. The meteorological satellite's intelligent computer retrieves the payload data file from the meteorological satellite's solid-state storage and saves it to a designated file directory. This designated file directory contains historical result status files. Based on these historical result status files, historically unprocessed payload data files can be obtained. The new payload data file is merged with the historically unprocessed payload data files to obtain a payload data file set, and a parameter file is generated. This parameter file includes parameters for whether to split the last hour's data for subsequent processing, whether to filter out outdated data earlier than one week of the system time, the maximum number of parallel processing threads, the input file list, the temporary hour file directory, the hierarchical data format file directory, the split file directory, and the result status file path.

[0055] Step S202: Parse each load data file in the load data file set to obtain multiple packet groups.

[0056] Specifically, frame protocol parsing is performed on each payload data file in the payload data file set to obtain multiple complete master packets with timestamps. This frame protocol includes elements such as frame header identifier, frame tail identifier, fixed frame length, and time broadcast field. Different frame protocols can be used depending on the payload type. For example, the frame protocol for a spaceborne terahertz ice cloud meteorological instrument is a frame header identifier of 0x6806, a frame tail identifier of 00000000A7F8AAAA, and a fixed frame length of 832 bytes. Each payload data file in the payload data file set is read sequentially. All valid frame data is identified according to the preset frame protocol rules. All valid master packets are identified according to the master packet and sub-packet rules. Incomplete master packets are discarded. The time information and the corresponding natural hour of the valid frames are extracted according to the time broadcast field. For example, a complete master packet consists of 4 sub-packets. The group identifier is located in bits 17-18, where "01" indicates the first packet of the group, "00" indicates the middle packet, and "10" indicates the last packet, totaling 3328 bytes. The time broadcast field is located in bytes 7-12 of the frame, using a non-segmented cumulative timecode format. The first 4 bytes represent the integer number of seconds since the J2000 epoch, and the last 2 bytes represent the fractional part of the seconds. The time broadcast field is consistent across the 4 sub-packets within the same master packet. Valid master packets with consecutive physical addresses and belonging to the same natural hour are grouped into packet groups, and the header address of the first frame, the trailer address of the last frame, the broadcast time of the first frame, and the broadcast time of the last frame are recorded for each packet group. A parameter is also included to indicate whether to filter out outdated data that is one week earlier than the system time. If the value is true and the first frame broadcast time of the current packet group is more than one week earlier than the current intelligent computing system time, it is determined to be expired data, the current file processing is stopped and the processing status is marked as processing completed.

[0057] Step S203: Construct a file index structure and an hour index structure based on multiple package groups.

[0058] Specifically, the file index structure is a three-level index of payload data file—natural hour—multiple packet groups. The hour index structure is a two-level index of natural hour—multiple payload data files. The file index structure and hour index structure are constructed based on the first frame header address, last frame tail address, first frame broadcast time, last frame broadcast time, and the natural hour to which the multiple packet groups belong.

[0059] Step S204: Using the file index structure, multiple packet groups are trimmed and deduplicated to obtain multiple valid packet groups; and the file index structure and hour index structure are updated according to the valid packet groups.

[0060] Specifically, using a file index structure, overlap detection is performed on multiple packet groups to identify overlapping packet pairs. Based on these pairs, the overlap type and trimming position are determined. Then, based on the overlap type and trimming position, the packet pairs are trimmed to remove duplicates, resulting in multiple valid packet groups. Let the currently parsed packet group be... Using the file index structure, find the set of historical packet groups that intersect with the current file's time range. Traversal Judge one by one Time interval [ ]and Time interval [ Does overlap exist? The overlap determination criterion is: Less than or equal to and Greater than or equal to If time overlap is determined, then the time interval of the overlapping portion is calculated. ],in Represented as:

[0061] ;

[0062] Represented as:

[0063] ;

[0064] Based on the overlapping interval and The relative positions within the text determine the overlap type and the cropping strategy. When the headers overlap, i.e. equal and Less than At that time, cutting Redundant headers, retain Unchanged, i.e. updated The first frame header address and the first frame broadcast time. The last frame's end address and last frame's broadcast time remain unchanged. When the ends overlap, i.e. Greater than and equal At that time, cutting The redundant tail section is retained. Unchanged, i.e. updated The last frame end address and the last frame broadcast time. The first frame header address and the first frame broadcast time remain unchanged. When there is an overlap in the middle, i.e. Less than and Greater than When, will be covered Remove or mark as invalid, retain Unchanged. When they completely overlap, that is... equal and equal When discarding The remaining valid packet groups after trimming, along with the updated time and physical address metadata, are inserted into the file index structure and the hour index structure, thus updating the file index structure and the hour index structure.

[0065] For example, the history file contains data from 0:00 to 2:00, and the current file contains data from 1:00 to 3:00. The current file contains packets from 1:00 to 2:00. The header overlaps with historical packet groups. The system scans frame by frame, finds the first frame with a time exactly greater than 2:00, and updates it. The header address of the first frame points to the physical address of that frame, and the broadcast time of the first frame is updated to the time of the first frame after 2:00. Only redundant physical frames before 2:00 are discarded, and new data from 2:00 to 3:00 is retained and inserted into the file index structure and hour index structure. The historical file contains data from 0:00 to 1:05:30, and the current file contains data from 1:05:00 to 2:00. The first packet group of the current file overlaps with the last packet group of the historical file in the header, with the overlap only between 1:05:00 and 1:05:30. The system locates the first frame with a time greater than 1:05:30 and updates the starting address and time of the current packet group. The historical file contains data from 0:00 to 1:00, and the transmission stoppage resulted in the loss of data from 1:00 to 1:10. The current file records from 1:10 to 2:00. The current file's packet time interval [1:10, 2:00] is compared with the historical interval [0:00, 1:00], and no overlap is found. Insert data into the file index structure and hourly index structure. The time gap from 1:00 to 1:10 is preserved accurately; the system does not falsify or fill data, ensuring the authenticity of the data input to the meteorological model and avoiding forecast errors caused by false data. The historical file contains data from 0:00 to 1:00, and the current file contains data from 1:00 to 2:00. The start time 1:00 of the current file and the end time 1:00 of the historical file are contiguous, and no time interval overlap is determined. All current packet groups are directly retained and inserted into the file index structure and hourly index structure.

[0066] Step S205: Using the updated hour index structure, the updated file index structure, and the preset script, convert the valid packet groups corresponding to each intermediate hour into the corresponding hierarchical data format files.

[0067] Specifically, the intermediate hour is the hour between the first and last hour. Using the updated hour index structure and the updated file index structure, the valid packet groups corresponding to each intermediate hour are determined. These valid packet groups are then aggregated into a temporary file directory. Using a pre-defined script, the valid packet groups corresponding to each intermediate hour are converted into corresponding hierarchical data format files. This conversion process employs a multi-threaded parallel approach. Valid packet groups corresponding to the first hour are not processed. For the last hour, processing is based on parameters determining whether to split the data from the last hour for subsequent processing. Processing is required when When true, all packet group data from the last hour and one packet group from the last hour of the previous hour are aggregated into a payload data split file and stored in the split directory. This file is marked as unprocessed and will be used for future processing. If the result is false, discard the data from the last hour.

[0068] Step S206: Input the multi-level data format files into the preset weather forecast algorithm to obtain the weather forecast results.

[0069] Specifically, the weather forecasting algorithm can be the Fuxi Big Data Model, the Pangu Big Data Model, or a graph neural network weather forecasting model, etc. Multiple layers of data format files are input into the preset weather forecasting algorithm to obtain weather forecast results. Based on preset key area configuration information, meteorological information for key areas is extracted from the weather forecast results and reported to the associated integrated electronic system. This key area configuration information includes a unique regional identifier, regional name, latitude range, longitude range, and a list of meteorological elements. This configuration information can be updated via satellite-to-ground links. The ground can transmit new key area configuration commands through the telemetry and control channel based on actual conditions such as changes in typhoon paths and sudden disasters. The satellite receives these commands and updates the configuration file, enabling dynamic adjustment of key monitoring areas. For example, when a typhoon approaches a coastal city, the ground can transmit new key area configurations for the area surrounding that city. After the weather forecast module generates nationwide forecast results, the key region forecast extraction program reads the key region configuration file, iterates through each key region, and cuts out the corresponding grid data from the nationwide forecast results based on its latitude and longitude range. It then extracts key meteorological elements such as precipitation, 2m temperature, air pressure, and 10m wind speed. The extracted results are structured and encoded according to the region's unique identifier, timestamp, meteorological element type, and value, significantly reducing the data volume compared to the nationwide forecast results. The structured and encoded key region meteorological element information is reported to the integrated electronic system via the telemetry interface between the intelligent computer and the integrated electronic system. The integrated electronic system embeds the key region meteorological element information into satellite telemetry frames and transmits it to the ground in real time via the space-to-ground telemetry and control channel.

[0070] In this embodiment, payload data files are retrieved from the solid-state memory of the meteorological satellite; these payload data files are then merged with historically unprocessed payload data files to obtain a payload data file set; each payload data file in the payload data file set is parsed to obtain multiple packet groups; based on these packet groups, a file index structure and an hourly index structure are constructed; using the file index structure, the multiple packet groups are trimmed and deduplicated to obtain multiple valid packet groups; and based on the valid packet groups, the file index structure and the hourly index structure are updated; using the updated hourly index structure, the updated file index structure, and a preset script, the valid packet groups corresponding to each intermediate hour are converted into corresponding hierarchical data format files; and the multiple hierarchical data format files are input into a preset meteorological forecasting algorithm to obtain meteorological forecast results. This method enables payload data processing on the meteorological satellite's intelligent computing platform, efficiently deduplicating payload data using the file index structure, and efficiently converting payload data formats using the hourly index structure, thereby efficiently generating meteorological forecast results, thus improving the payload data processing efficiency of the meteorological satellite.

[0071] In some embodiments, the individual payload data files in the payload data file set are parsed to obtain multiple packet groups, including:

[0072] The frame protocol is parsed for each payload data file in the payload data file set to obtain multiple complete master packets with timestamps; the multiple complete master packets with timestamps are classified and merged to obtain multiple packet groups.

[0073] Specifically, the frame protocol includes elements such as frame header identifier, frame tail identifier, fixed frame length, and time broadcast field. Different frame protocols can be adopted according to the payload type. For example, the frame protocol of the spaceborne terahertz ice cloud meteorological instrument is a frame header identifier of 0x6806, a frame tail identifier of 00000000A7F8AAAA, and a fixed frame length of 832 bytes. The system reads each payload data file in the payload data file set sequentially, identifies all valid frame data according to the preset frame protocol rules, identifies all valid main packets according to the main packet and sub-packet rules, discards incomplete main packets, and extracts the time information and natural hour of the valid frames according to the time broadcast field. For example, a complete master packet consists of 4 sub-packets. The group identifier is located in bits 17-18. "01" indicates the first packet of the group, "00" indicates the middle packet of the group, and "10" indicates the last packet of the group, totaling 3328 bytes. The time broadcast field is located in bytes 7-12 of the frame, using a non-segmented cumulative time code format. The first 4 bytes are the integer number of seconds since the J2000 epoch, and the last 2 bytes are the fractional part of the seconds. The time broadcast field is consistent for all 4 sub-packets within the same master packet. Valid master packets with consecutive physical addresses and belonging to the same natural hour are grouped into a packet group, and the first frame header address, last frame trailer address, first frame broadcast time, and last frame broadcast time of each packet group are recorded.

[0074] In some embodiments, a file index structure and an hour index structure are constructed based on multiple package groups, including:

[0075] Based on the first frame header address, last frame tail address, first frame broadcast time, and last frame broadcast time of multiple packet groups, construct a file index structure and an hour index structure.

[0076] Specifically, the file index structure is a three-level index of payload data file—natural hour—multiple packet groups. The hour index structure is a two-level index of natural hour—multiple payload data files. The file index structure and hour index structure are constructed based on the first frame header address, last frame tail address, first frame broadcast time, last frame broadcast time, and the natural hour to which the multiple packet groups belong.

[0077] In some embodiments, a file index structure is used to prune and deduplicate multiple packet groups to obtain multiple valid packet groups, including:

[0078] Using a file index structure, overlap detection is performed on multiple packet groups to obtain overlapping packet pairs; based on the packet pairs, the overlap type and clipping position are determined; based on the overlap type and clipping position, the packet pairs are clipped to remove duplicates, resulting in multiple valid packet groups.

[0079] Specifically, let the packet group currently being parsed be... Using the file index structure, find the set of historical packet groups that intersect with the current file's time range. Traversal Judge one by one Time interval [ ]and Time interval [ Does overlap exist? The overlap determination criterion is: Less than or equal to and Greater than or equal to If time overlap is determined, then the time interval of the overlapping portion is calculated. ],in Represented as:

[0080] ;

[0081] Represented as:

[0082] ;

[0083] Based on the overlapping interval and The relative positions within the text determine the overlap type and the cropping strategy. When the headers overlap, i.e. equal and Less than At that time, cutting Redundant headers, retain Unchanged, i.e. updated The first frame header address and the first frame broadcast time. The last frame's end address and last frame's broadcast time remain unchanged. When the ends overlap, i.e. Greater than and equal At that time, cutting The redundant tail section is retained. Unchanged, i.e. updated The last frame end address and the last frame broadcast time. The first frame header address and the first frame broadcast time remain unchanged. When there is an overlap in the middle, i.e. Less than and Greater than When, will be covered Remove or mark as invalid, retain Unchanged. When they completely overlap, that is... equal and equal When discarding The remaining valid packet groups after trimming, along with the updated time and physical address metadata, are inserted into the file index structure and the hour index structure, thus updating the file index structure and the hour index structure.

[0084] For example, the history file contains data from 0:00 to 2:00, and the current file contains data from 1:00 to 3:00. The current file contains packets from 1:00 to 2:00. The header overlaps with historical packet groups. The system scans frame by frame, finds the first frame with a time exactly greater than 2:00, and updates it. The header address of the first frame points to the physical address of that frame, and the broadcast time of the first frame is updated to the time of the first frame after 2:00. Only redundant physical frames before 2:00 are discarded, and new data from 2:00 to 3:00 is retained and inserted into the file index structure and hour index structure. The historical file contains data from 0:00 to 1:05:30, and the current file contains data from 1:05:00 to 2:00. The first packet group of the current file overlaps with the last packet group of the historical file in the header, with the overlap only between 1:05:00 and 1:05:30. The system locates the first frame with a time greater than 1:05:30 and updates the starting address and time of the current packet group. The historical file contains data from 0:00 to 1:00, and the transmission stoppage resulted in the loss of data from 1:00 to 1:10. The current file records from 1:10 to 2:00. The current file's packet time interval [1:10, 2:00] is compared with the historical interval [0:00, 1:00], and no overlap is found. Insert data into the file index structure and hourly index structure. The time gap from 1:00 to 1:10 is preserved accurately; the system does not falsify or fill data, ensuring the authenticity of the data input to the meteorological model and avoiding forecast errors caused by false data. The historical file contains data from 0:00 to 1:00, and the current file contains data from 1:00 to 2:00. The start time 1:00 of the current file and the end time 1:00 of the historical file are contiguous, and no time interval overlap is determined. All current packet groups are directly retained and inserted into the file index structure and hourly index structure.

[0085] In some embodiments, the updated hour index structure, the updated file index structure, and a preset script are used to convert the valid packet groups corresponding to each intermediate hour into corresponding hierarchical data format files, including:

[0086] Using the updated hour index structure and the updated file index structure, determine the valid packet groups corresponding to each intermediate hour; using a preset script, convert the valid packet groups corresponding to each intermediate hour into the corresponding hierarchical data format files.

[0087] Specifically, the intermediate hour is the hour between the first and last hour. Using the updated hour index structure and the updated file index structure, the valid packet groups corresponding to each intermediate hour are determined. These valid packet groups belonging to that intermediate hour are then aggregated into a temporary file directory. Using a pre-defined script, the valid packet groups corresponding to each intermediate hour are converted into the corresponding hierarchical data format files. This conversion process employs a multi-threaded parallel approach. This method can significantly shorten the generation time of the hierarchical data format files.

[0088] In some of these embodiments, Figure 3This is a preferred flowchart of the meteorological satellite payload data processing method in this embodiment, as follows: Figure 3 As shown, the method includes Figure 2 All the steps shown also include step S301: extracting meteorological information of key areas from the weather forecast results based on preset key area configuration information; and reporting the meteorological information to the associated integrated electronic system.

[0089] Specifically, the key area configuration information includes a unique regional identifier, regional name, latitude range, longitude range, and a list of meteorological elements. This configuration information can be updated via satellite-to-ground link. The ground can transmit new key area configuration commands via telemetry and control channels based on actual conditions such as typhoon path changes and sudden disasters. The satellite receives these commands and updates the configuration file, enabling dynamic adjustment of key monitoring areas. For example, when a typhoon approaches a coastal city, the ground can transmit new key area configurations for the area surrounding that city. After the meteorological forecast module generates nationwide forecast results, the key area forecast extraction program reads the key area configuration file, iterates through each key area, and extracts grid data for the corresponding area from the nationwide forecast results based on its latitude and longitude range. It then extracts key meteorological element information such as precipitation, 2m temperature, air pressure, and 10m wind speed. The extracted results are structured and encoded according to the unique regional identifier, timestamp, meteorological element type, and value, significantly reducing the data volume compared to the nationwide forecast results. The structured and encoded key area meteorological element information is then reported to the integrated electronic system via the telemetry interface between the intelligent computer and the integrated electronic system. The integrated electronic system embeds meteorological element information of key areas into satellite telemetry frames, which are then transmitted to the ground in real time via the space-to-ground telemetry and control channel.

[0090] For example, when a typhoon approaches a coastal area, the ground-based system configures the predicted landfall area as a critical region. The satellite continuously extracts and remotely transmits precipitation, wind speed, and air pressure information for that region, allowing the ground to monitor the typhoon's intensity in real time. If a region experiences a sudden downpour, the ground-based system designates the affected area as a critical region, and the satellite extracts real-time precipitation and temperature forecasts for that region, providing minute-level meteorological decision support for disaster relief and rescue efforts.

[0091] In some of these embodiments, it also includes:

[0092] Payload data files converted to hierarchical data format are marked as processed; payload data files not converted to hierarchical data format are marked as unprocessed.

[0093] Specifically, payload data files converted to hierarchical data format are marked as processed; payload data files not converted to hierarchical data format are marked as unprocessed if they are the only file or the last file in time, serving as the front or back boundary for new data in the next processing; if they are the earliest file in time, they are marked as processed; generated segmented files are marked as unprocessed; when the parameter for filtering outdated data earlier than one week of the system time is true, and the broadcast time of the first frame of the current packet group is more than one week earlier than the current intelligent computing system time, it is marked as processed.

[0094] This embodiment also provides a payload data processing system for a meteorological satellite, which implements the methods described in the above embodiments; details already explained will not be repeated. The terms "module," "unit," and "subunit," etc., used below refer to combinations of software and / or hardware that perform predetermined functions. Although the apparatus described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.

[0095] Figure 4 This is a structural block diagram of the payload data processing system of the meteorological satellite in this embodiment, as shown below. Figure 4 As shown, the payload data processing system 40 of the meteorological satellite includes: a payload data acquisition module 401, a payload data parsing module 402, an index structure construction module 403, a payload data deduplication module 404, a payload data conversion module 405, and a meteorological forecast result generation module 406, wherein:

[0096] The payload data acquisition module 401 is used to acquire payload data files from the solid-state storage of the meteorological satellite; and merge the payload data files with historical unprocessed payload data files to obtain a payload data file set;

[0097] The load data parsing module 402 is used to parse each load data file in the load data file set to obtain multiple packet groups;

[0098] The index structure building module 403 is used to build file index structure and hour index structure based on multiple package groups;

[0099] The payload data deduplication module 404 is used to prune and deduplicat multiple packet groups using the file index structure to obtain multiple valid packet groups; and to update the file index structure and hour index structure according to the valid packet groups.

[0100] The payload data conversion module 405 is used to convert the valid packet groups corresponding to each intermediate hour into corresponding hierarchical data format files using the updated hour index structure, the updated file index structure, and the preset script; the intermediate hour is the hour between the first hour and the last hour.

[0101] The weather forecast result generation module 406 is used to input multi-level data format files into a preset weather forecast algorithm to obtain weather forecast results.

[0102] Figure 5 This is a preferred structural block diagram of the payload data processing system of the meteorological satellite in this embodiment, as shown below. Figure 5 As shown, the payload data processing system 40 of the meteorological satellite includes Figure 4 All the modules shown also include a meteorological information extraction module 501, which is used to extract meteorological information of key areas from the weather forecast results based on preset key area configuration information; and to report the meteorological information to the associated integrated electronic system.

[0103] It should be noted that the above modules can be functional modules or program modules, and can be implemented through software or hardware. For modules implemented through hardware, the above modules can reside in the same processor; or the above modules can be located in different processors in any combination.

[0104] This embodiment also provides an electronic device, including a memory and a processor, wherein the memory stores a computer program and the processor is configured to run the computer program to perform any of the above-described meteorological satellite payload data processing methods.

[0105] Furthermore, in conjunction with the meteorological satellite payload data processing method provided in the above embodiments, this embodiment can also provide a computer storage medium for implementation. The storage medium stores a computer program; when executed by a processor, the computer program implements the steps of any of the meteorological satellite payload data processing methods in the above embodiments.

[0106] It should be understood that the specific embodiments described herein are merely illustrative of the application and not intended to limit it. All other embodiments derived by those skilled in the art based on the embodiments provided in this application without inventive effort are within the scope of protection of this application.

[0107] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0108] Obviously, the accompanying drawings are merely some examples or embodiments of this application. Those skilled in the art can apply this application to other similar situations based on these drawings without any creative effort. Furthermore, it is understood that although the work done in this development process may be complex and lengthy, for those skilled in the art, certain design, manufacturing, or production modifications made based on the technical content disclosed in this application are merely conventional technical means and should not be considered as insufficient disclosure of this application.

[0109] The term "embodiment" in this application refers to a specific feature, structure, or characteristic described in connection with an embodiment that may be included in at least one embodiment of this application. The appearance of this phrase in various places in the specification does not necessarily imply the same embodiment, nor does it imply that it is mutually exclusive with or independent of other embodiments. It will be clearly or implicitly understood by those skilled in the art that the embodiments described in this application may be combined with other embodiments without conflict.

[0110] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of patent protection. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the appended claims.

Claims

1. A method of processing load data of a meteorological satellite, characterized by, Intelligent computing systems used in meteorological satellites include: The payload data file is retrieved from the solid-state storage of the meteorological satellite; and the payload data file is merged with historical unprocessed payload data files to obtain a payload data file set. The individual load data files in the load data file set are parsed to obtain multiple packet groups; Based on the multiple package groups, construct a file index structure and an hour index structure; Using the file index structure, the multiple package groups are trimmed and deduplicated to obtain multiple valid package groups; and the file index structure and the hour index structure are updated according to the valid package groups. Using the updated hour index structure, the updated file index structure, and the preset script, the valid packet groups corresponding to each intermediate hour are converted into corresponding hierarchical data format files; Multiple hierarchical data format files are input into a preset weather forecasting algorithm to obtain weather forecast results.

2. The meteorological satellite payload data processing method according to claim 1, characterized in that, The process of parsing each payload data file in the payload data file set yields multiple packet groups, including: Frame protocol parsing is performed on each payload data file in the payload data file set to obtain multiple complete master packets with timestamps; The multiple complete master packets with timestamps are classified and merged to obtain the multiple packet groups.

3. The meteorological satellite payload data processing method of claim 1, wherein, The step of constructing a file index structure and an hour index structure based on the multiple package groups includes: Based on the first frame header address, last frame tail address, first frame broadcast time, and last frame broadcast time of the multiple packet groups, construct the file index structure and the hour index structure.

4. The meteorological satellite payload data processing method of claim 1, wherein, The process of using the file index structure to prune and deduplicate the multiple package groups to obtain multiple valid package groups includes: Using the file index structure, overlap detection is performed on the multiple packet groups to obtain overlapping packet group pairs; Based on the packet pair, determine the overlap type and clipping position; Based on the overlap type and the clipping position, the packet pairs are clipped and deduplicated to obtain the plurality of valid packet pairs.

5. The meteorological satellite payload data processing method of claim 1, wherein, The step of converting the valid packet groups corresponding to each intermediate hour into corresponding hierarchical data format files using the updated hour index structure, the updated file index structure, and a preset script includes: Using the updated hour index structure and the updated file index structure, the valid packet group corresponding to each intermediate hour is determined; Using a pre-set script, the valid packet groups corresponding to each intermediate hour are converted into the corresponding hierarchical data format files.

6. The meteorological satellite payload data processing method of claim 1, wherein, Also includes: Based on the preset key area configuration information, extract meteorological information of key areas from the meteorological forecast results; The meteorological information will then be reported to the associated integrated electronic system.

7. The meteorological satellite payload data processing method of claim 1, wherein, Also includes: The payload data file converted to the aforementioned hierarchical data format file is marked as processed; The payload data file that has not been converted to the aforementioned hierarchical data format is marked as unprocessed.

8. A payload data processing system for a meteorological satellite, characterized by, It includes a payload data acquisition module, a payload data parsing module, an index structure construction module, a payload data deduplication module, a payload data conversion module, and a weather forecast result generation module, among which: The payload data acquisition module is used to acquire payload data files from the solid-state storage of the meteorological satellite; and merge the payload data files with historical unprocessed payload data files to obtain a payload data file set; The load data parsing module is used to parse each load data file in the load data file set to obtain multiple packet groups; The index structure construction module is used to construct a file index structure and an hour index structure based on the multiple package groups; The payload data deduplication module is used to use the file index structure to trim and deduplicat the multiple packet groups to obtain multiple valid packet groups; and to update the file index structure and the hour index structure according to the valid packet groups. The payload data conversion module is used to convert the effective packet groups corresponding to each intermediate hour into corresponding hierarchical data format files using the updated hour index structure, the updated file index structure, and a preset script. The weather forecast result generation module is used to input multiple hierarchical data format files into a preset weather forecast algorithm to obtain weather forecast results. 9.An electronic device comprising a memory and a processor, the electronic device characterized by, The memory stores a computer program, and the processor is configured to run the computer program to perform the payload data processing method of the meteorological satellite according to any one of claims 1 to 7.

10. A computer-readable storage medium having stored thereon a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the payload data processing method for the meteorological satellite according to any one of claims 1 to 7.