Workflow-based satellite relay data processing method, system, medium and device
By decoupling the data processing of the source satellite and the satellite that transmits the data, and establishing a feedback scheduling mechanism, the problem of low efficiency of a single workflow in satellite data processing is solved, and efficient multi-satellite and multi-task parallel processing is achieved, improving the ease of use and maintainability of the system.
Patent Information
- Application Number
- CN202511393660.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-09-28
- Publication Date
- 2025-12-16
- Estimated Expiration
- 2045-09-28
AI Technical Summary
In existing satellite data processing workflows, satellite data transmission processing methods are limited to a single workflow, resulting in low processing efficiency, high development difficulty, complex operation and maintenance, and difficulty in adapting to the needs of multi-satellite and multi-task parallel processing.
By monitoring the status of the transmitted data frames, scheduling the corresponding data processing workflow, and combining array frame splicing technology, the data processing of the source satellite and the transmitted satellite is decoupled, and a feedback scheduling mechanism is established to achieve the decoupling of the data processing of the source satellite and the transmitted satellite.
It improves the efficiency of satellite data transmission processing, reduces development difficulty and operation and maintenance complexity, and enhances the ease of use and maintainability of the system.
Smart Images

Figure CN120915369B_ABST
Abstract
Description
Technical Field
[0001] This invention belongs to the field of aerospace data processing technology, and in particular relates to a workflow-based satellite data transmission processing method, system, medium and equipment. Background Technology
[0002] The statements in this section are merely background information related to the present invention and do not necessarily constitute prior art.
[0003] Satellite data transmission refers to data transmitted by some satellites using their own communication capabilities on behalf of other satellites or equipment. With the successful implementation of the constellation series project, inter-satellite links play a crucial role in next-generation satellite networks. Meanwhile, satellite laser communication can achieve transmission rates of gigabits per second, posing new challenges to satellite ground application systems, especially in processing satellite data transmission based on inter-satellite communication, requiring systems with more efficient processing capabilities.
[0004] Real-time processing of transmitted data is one of the core technologies of satellite ground application systems. Its main responsibility is to parse, store, and preprocess received transmitted data for subsequent analysis and processing. Workflow technology can process real-time data transmission tasks more efficiently and better adapt to the leapfrog increase in transmission rate and the new demands of multi-satellite, multi-task parallel processing. As an advanced business process management technology, workflow can decompose complex tasks into a series of collaborative steps and automate and optimize tasks through a process engine. In satellite ground scheduling and processing systems, workflow technology significantly improves the flexibility and automation of scheduling by abstracting and modeling tasks. Transmitted data processing workflows typically include data preprocessing, data parsing, and data storage. After decoding by the ground receiving subsystem, the transmitted data preprocessing module further processes Advanced Orbiting Systems (AOS) frames, completes source packet processing, and distributes the results to subsequent stages.
[0005] However, the current satellite data processing workflow has certain limitations in the way satellite data is processed. Specifically, the data preprocessing module in a typical workflow will parse the transmitted data and then call back to reprocess the parsed source satellite AOS data. However, there is a lack of interaction between different satellite service processing workflows, which limits the processing of satellite data to a fixed workflow. This means that a single workflow must be able to process data transmitted from multiple satellites at the same time, which requires a single workflow to be able to process data from multiple satellite sources.
[0006] This approach not only reduces overall processing efficiency but also increases the burden on development and maintenance. Specifically, on the one hand, the development team needs to implement complex functions in a single module, which significantly increases the development difficulty and development cycle, and reduces development efficiency. On the other hand, since multi-satellite data processing tasks are concentrated in the same workflow, the running efficiency and parallel processing of multiple tasks are also limited, and the complexity and coupling are increased, making later maintenance and upgrades more difficult. Summary of the Invention
[0007] To address the technical problems mentioned above, this invention provides a workflow-based satellite data transmission processing method, system, medium, and device. This decouples the source satellite data processing service from the satellite transmission data processing service, so that the satellite data transmission service processing is no longer limited to a single workflow, thus improving processing efficiency.
[0008] To achieve the above objectives, the present invention adopts the following technical solution:
[0009] The first aspect of the present invention provides a workflow-based satellite data transmission processing method, comprising:
[0010] Monitor the status of the PDXP data frames transmitted by the satellite, schedule the data processing workflow of the satellite based on the status, and trigger the start of each processing software in the data processing workflow of the satellite.
[0011] The data processing workflow of the satellite transfers data extracts several frames of satellite AOS data from the transfer data PDXP data frame, further extracts the effective data field from the satellite AOS data, and restores the source satellite AOS data frame by combining array frame splicing technology. At the same time, it sends the transfer feedback and encapsulates the source satellite AOS data frame into a source satellite PDXP data frame, which is then sent to the source satellite's data processing workflow.
[0012] Upon receiving feedback from the proxy, the source star's data processing workflow is initiated;
[0013] The source star's data processing workflow performs business processing on source star PDXP data frames.
[0014] Furthermore, the status of the PDXP data frame being transmitted includes a task flag, an information flag, and a data type.
[0015] Furthermore, the extraction step of the AOS data of the proxy satellite includes: after verifying the PDXP data frames of the proxy data and removing abnormal frames, separating the AOS data of the proxy channel by identifying and judging the spacecraft identifier and channel identifier, and obtaining the proxy satellite AOS data.
[0016] Furthermore, the array framing technique is based on the synchronization code and the source star AOS protocol format in the effective data field.
[0017] Furthermore, the transmitted PDXP data frames are obtained by the data receiving and distribution module parsing the satellite transmitted data according to the PDXP protocol format.
[0018] Furthermore, the PDXP data frame for data transmission includes protocol header information and a data field, and the data field contains several frames of AOS data for data transmission.
[0019] Furthermore, the source star PDXP data frame is sent to the source star's data processing workflow through a message middleware.
[0020] A second aspect of the present invention provides a workflow-based satellite data transmission processing system, comprising:
[0021] The first workflow startup module is configured to: monitor the status of the PDXP data frames transmitted, schedule the data processing workflow of the transmitted satellite according to the status, and trigger the startup of each processing software in the data processing workflow of the transmitted satellite.
[0022] The satellite data processing module is configured to: extract several frames of satellite AOS data from the satellite PDXP data frame, further extract the effective data field from the satellite AOS data, and restore the source satellite AOS data frame by combining array framing technology. At the same time, it sends out satellite transmission feedback and encapsulates the source satellite AOS data frame into a source satellite PDXP data frame, which is then sent to the source satellite's data processing workflow.
[0023] The second workflow startup module is configured to: start the source star's data processing workflow after listening to the feedback from the proxy;
[0024] The SourceStar data processing module is configured to perform business processing on SourceStar PDXP data frames using the SourceStar data processing workflow.
[0025] A third aspect of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the workflow-based satellite data transmission processing method described above.
[0026] A fourth aspect of the present invention provides a computer device including a computer-readable storage medium, a processor, and a computer program stored on the computer-readable storage medium and executable on the processor, wherein the processor executes the program to implement the steps of the workflow-based satellite data transmission processing method described above.
[0027] Compared with the prior art, the beneficial effects of the present invention are:
[0028] This invention decouples the source satellite data processing service from the satellite data transmission service, so that the processing of satellite data transmission is no longer limited to a single workflow, thus improving processing efficiency.
[0029] This invention establishes a feedback scheduling mechanism through scheduling commands and feedback scheduling information between the workflow and the scheduling platform, which is more suitable for processing satellite data transmission. Attached Figure Description
[0030] The accompanying drawings, which form part of this invention, are used to provide a further understanding of the invention. The illustrative embodiments of the invention and their descriptions are used to explain the invention and do not constitute an improper limitation of the invention.
[0031] Figure 1 This is a flowchart of the workflow-based satellite data transmission processing method according to Embodiment 1 of the present invention;
[0032] Figure 2 This is a workflow scheduling flowchart of Embodiment 1 of the present invention;
[0033] Figure 3 This is a flowchart of the workflow A satellite data transmission processing in Embodiment 1 of the present invention;
[0034] Figure 4 This is a schematic diagram of the structure of a computer device according to Embodiment 4 of the present invention. Detailed Implementation
[0035] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings.
[0036] It should be noted that the following detailed description is illustrative and intended to provide further explanation of the invention. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains.
[0037] Example 1
[0038] This embodiment provides a workflow-based satellite data transmission processing method.
[0039] In the existing satellite data processing workflow, the AOS transmission frame structure is shown in Table 1. Here, 8×n bit (or 8×m bit) means that the bit is the basic unit of binary data, that is, the binary digit in a computer. 8×n means that the number of bits occupied by this data area (insertion area BPDU) is a multiple of 8. Therefore, 8×n is the number of bits occupied by the insertion area BPDU. Similarly, 8×m is the number of bits occupied by the error control field.
[0040] Table 1. AOS Frame Format
[0041]
[0042] The workflow-based satellite data transmission processing method provided in this embodiment, such as... Figure 1 As shown, it includes the following steps:
[0043] Step 1: Satellite-transmitted data is received by the data receiving and distribution module in the form of data packets, and is initially parsed according to the Packet Data Exchange Protocol (PDXP) format. The parsed PDXP data frames are then distributed frame by frame to downstream business processing through the message middleware.
[0044] Step 101: Satellite Data Transmission It is transmitted to the satellite ground application system in the form of binary datagrams through the communication link and received by the data receiving and distribution module.
[0045] The data packets follow a specific PDXP frame format, as shown in Table 2, in order to correctly identify and extract the data content.
[0046] Step 102: The data receiving and distribution module performs preliminary parsing according to the corresponding PDXP protocol format, and judges the task flag MID, information flag BID, data length L, data integrity, etc. The verified PDXP data frames are distributed to downstream business processing frame by frame through the message middleware.
[0047] As shown in Table 2, PDXP data frames It consists of protocol header information such as protocol version and mission flag, and a data field. The data field contains several AOS data frames, i.e., A-star AOS data. Source Star Data Located in the valid data field of the AOS frame, i.e. However, due to data length limitations, the data here... It is not a complete AOS data frame, so it needs to be framed.
[0048] Table 2. PDXP Frame Format
[0049]
[0050] In this context, the message middleware plays a role in data transmission and auxiliary scheduling. It sends data frames to different business processing modules according to predefined routing rules, preparing for subsequent data processing.
[0051] Step 2: The workflow scheduling platform schedules the corresponding satellite A data processing workflow A based on the task flag and other information in the PDXP data frame, and starts the processing software in the workflow.
[0052] It should be noted that when data from satellite B cannot be directly transmitted, it is transmitted to the ground via satellite A. In this case, satellite B is the source satellite, and satellite A is the transmitting satellite.
[0053] like Figure 2 As shown, the scheduling process of workflow A specifically includes:
[0054] Step 201: The workflow scheduling platform monitors the data status (including task flag, information flag, data type, data time, etc.) of the PDXP data frames transmitted by the data receiving and distribution module in real time. ), and pay attention to the task flag field MID and the information flag BID; the task flag field is used to identify the task type or business process to which the current data frame belongs, and the information flag BID and DATATYPE are used to identify information and data types.
[0055] Step 202: Based on MID, BID, and DATATYPE, the workflow scheduling platform will schedule the data processing workflow A for transmitting data from the satellite. And trigger the startup of each processing software in workflow A. .
[0056] In other words, when new data is detected, the corresponding satellite and data type data processing workflow ID is obtained, the data processing workflow is started, and the data processing workflow is stopped when the data interruption exceeds the maximum time limit.
[0057] A workflow is a set of predefined processing steps and software modules used to complete specific business tasks. These processing software include data parsing software, data conversion software, data verification software, etc., which are executed sequentially in a preset order to complete the processing of data frames.
[0058] Step 3: Workflow A processes the PDXP data frames, identifies and parses the satellite transmission data according to the corresponding data format and protocol, sends transmission feedback to the workflow scheduling platform, and sends the parsed source satellite data to data processing workflow B of source satellite B through message middleware. For example... Figure 3 As shown, the specific business processing flow includes:
[0059] Step 301: Based on the corresponding data format and protocol, the workflow... First, analyze the PDXP data frames. Verification and parsing are performed, and abnormal frames are removed. Several frames of AOS data from the PDXP frame data field are extracted. .
[0060] Specifically:
[0061] (1) Real-time parallel reception of PDXP data frames, and after processes such as synchronization code verification, data length verification, and frame sequence number verification, the data frames are checked for completeness and compliance and for transmission errors according to a specific verification algorithm. If any abnormalities are found, such as errors, damage, or non-compliance with the specified format, the data frames are discarded and only normal data frames are retained for subsequent processing.
[0062] (2) From the verified PDXP data frames, specific fields are extracted, converted, and verified to identify the spacecraft identifier SCID and channel identifier VCID, and the AOS data of satellite A is separated. .
[0063] Step 302: Based on the AOS protocol format, process the data extracted in step 301. Further identification and analysis are performed to extract the valid data fields of the AOS frame. .
[0064] A-Star AOS data is The valid data area of this data frame consists of AOS format data received by the relay satellite A from the source satellite B. However, due to data area length limitations, it will not exist completely within the relay satellite's AOS data area; that is, it is incomplete. .
[0065] For the reasons mentioned above, it is necessary to separate other channel data and obtain only the data from the secondary transmission channel by identifying and determining the spacecraft identifier SCID and channel identifier VCID based on the source satellite AOS transmission frame structure. Further extract the effective data domains from the data, and filter out the truly useful and effective data portions. .
[0066] Step 303: Search for the frame synchronization code in the valid data fields extracted in the previous step. Following the frame synchronization code, search for the frame sequence number, data length, data fields, and other valid information in sequence. Based on the SourceStar AOS protocol format, perform the following steps for the extracted data fields. By combining array frame stitching technology, the source satellite (Satellite B) AOS data frames were reconstructed. The array framing technique described above uses the synchronization code in the valid data field and the source AOS protocol format to reconstruct the source AOS data frame; at the same time, a new thread is started. Send feedback to the workflow scheduling platform, feedback information It includes key information such as the data transmission identifier, transmission carrier, source satellite, ground station information, and transmission channel.
[0067] Specifically, based on the source satellite's AOS frame data format and the valid data portion in step 302, combined with feature information such as the frame header (a specific sequence of bytes used to identify the start of the data frame) and frame length, the source satellite AOS data frame is concatenated from the valid data portion. Data content of the corresponding length is read sequentially, and frame verification is performed according to the corresponding verification method to finally obtain the complete source satellite AOS data. This provides a complete data foundation for subsequent packaging steps.
[0068] Step 304 The data is transferred to data conversion software, which then converts it according to... The required data format, combined with Information such as Source Identifier (SID) and Destination Identifier (DID) is used to... Encapsulation is performed to obtain the data to be transmitted (B-star PDXP data frames). After encapsulation, it is sent to via message middleware. To perform business processing.
[0069] Specifically, based on the source star AOS data frame obtained in step 303 and its Process the data frame format required by the workflow, encapsulate the data frame, add necessary information, construct a complete SourceStar PDXP data frame, and send it to [the relevant authority / organization]. .
[0070] Step 4: The workflow scheduling platform receives the feedback from the proxy and starts the data processing workflow B of Yuanxing.
[0071] Specifically, the workflow scheduling platform listens for and relays feedback. Start SourceStar's data processing workflow B ( According to the configuration provided by the workflow scheduling platform, Listen to the specified data channel and continuously receive workflow data. Data frames sent .
[0072] Step 5: Workflow B receives service data from Workflow A, processes the source PDXP data frames, and obtains the final result.
[0073] Specifically, Chinese software According to the corresponding protocol and configuration, PDXP data frames are processed in a certain order; first, AOS data frames are extracted. Identify the channel identifier (VCID) and data frame type, and create new threads based on different data types. Data framing and other processing are performed, and the results are pushed to other plugins, such as image processing software and engineering parameter analysis software, according to the data frame type for business processing. For example, the image processing software receives image encoded data frames, sends the image encoded data frames to the video or image decoder according to the image encoding method, parses and generates image data, and stores the data to realize the business processing of source satellite data.
[0074] This embodiment proposes a satellite data transmission processing method based on workflow technology. This method decouples different satellite data processing services and connects the source satellite and the transmission satellite workflows through a workflow scheduling platform and message middleware, thereby improving the processing efficiency of satellite data transmission.
[0075] The workflow-based satellite data transmission processing method provided in this embodiment decouples the source satellite data processing service and the satellite data transmission service. The satellite data transmission service processing is no longer limited to a single workflow, thus improving processing efficiency.
[0076] The workflow-based satellite data transmission processing method provided in this embodiment constructs a modular processing architecture, enhancing ease of use and maintainability.
[0077] The workflow-based satellite data transmission processing method provided in this embodiment establishes a feedback scheduling mechanism through scheduling commands and feedback scheduling information between the workflow and the scheduling platform, making it more suitable for processing satellite data transmission.
[0078] Example 2
[0079] This embodiment provides a workflow-based satellite data transmission processing system, which specifically includes a workflow scheduling platform, a satellite data transmission processing module, a source satellite data processing module, and a data receiving and distribution module. The workflow scheduling platform includes a first workflow initiation module and a second workflow initiation module.
[0080] The data receiving and distribution module is configured to parse the satellite transmission data according to the PDXP protocol format to obtain the transmission data PDXP data frames.
[0081] The first workflow startup module is configured to: monitor the status of the PDXP data frames transmitted, schedule the data processing workflow of the transmitted satellite according to the status, and trigger the startup of each processing software in the data processing workflow of the transmitted satellite.
[0082] The satellite data processing module is configured to: extract several frames of satellite AOS data from the satellite PDXP data frame, further extract the effective data field from the satellite AOS data, and restore the source satellite AOS data frame by combining array framing technology. At the same time, it sends out satellite transmission feedback and encapsulates the source satellite AOS data frame into a source satellite PDXP data frame, which is then sent to the source satellite's data processing workflow.
[0083] The second workflow startup module is configured to: start the source star's data processing workflow after listening to the feedback from the proxy;
[0084] The SourceStar data processing module is configured to perform business processing on SourceStar PDXP data frames using the SourceStar data processing workflow.
[0085] It should be noted that each module in this embodiment corresponds one-to-one with each step in Embodiment 1, and their specific implementation processes are the same, so they will not be repeated here.
[0086] Example 3
[0087] This embodiment provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the workflow-based satellite data transmission processing method described in Embodiment 1 above.
[0088] Example 4
[0089] This embodiment provides a computer device, such as... Figure 4 As shown, the system includes a computer-readable storage medium 1003, a processor 1001, a communication interface 1002, and a computer program stored on the computer-readable storage medium 1003 and executable on the processor 1001. The processor 1001, communication interface 1002, and computer-readable storage medium 1003 can be connected via a bus or other means. The communication interface 1002 is used to receive and transmit data. When the processor 1001 executes the program, it implements the steps of the workflow-based satellite data transmission processing method described in Embodiment 1 above.
[0090] The above description is merely a preferred embodiment of the present invention and is not intended to limit the invention. Various modifications and variations can be made to the present invention by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.
Claims
1. A workflow-based satellite data transmission processing method, characterized in that, include: Monitor the status of the PDXP data frames transmitted by the satellite, schedule the data processing workflow of the satellite based on the status, and trigger the start of each processing software in the data processing workflow of the satellite. The data processing workflow of the satellite transfers data extracts several frames of satellite AOS data from the transfer data PDXP data frame, further extracts the effective data field from the satellite AOS data, and restores the source satellite AOS data frame by combining array frame splicing technology. At the same time, it sends the transfer feedback and encapsulates the source satellite AOS data frame into a source satellite PDXP data frame, which is then sent to the source satellite's data processing workflow. Upon receiving feedback from the proxy, the source star's data processing workflow is initiated; The source star's data processing workflow performs business processing on source star PDXP data frames.
2. The workflow-based satellite data transmission processing method as described in claim 1, characterized in that, The status of the PDXP data frame being transmitted includes a task flag, an information flag, and a data type.
3. The workflow-based satellite data transmission processing method as described in claim 1, characterized in that, The steps for extracting the AOS data of the satellite transmission include: verifying the PDXP data frames of the satellite transmission and removing abnormal frames, then identifying and judging the spacecraft identifier and channel identifier to separate the AOS data of the satellite transmission channel and obtain the satellite transmission AOS data.
4. The workflow-based satellite data transmission processing method as described in claim 1, characterized in that, The array framing technique is based on the synchronization code in the valid data field and the source star AOS protocol format.
5. The workflow-based satellite data transmission processing method as described in claim 1, characterized in that, The PDXP data frames transmitted via satellite are obtained by the data receiving and distribution module parsing the satellite transmitted data according to the PDXP protocol format.
6. The workflow-based satellite data transmission processing method as described in claim 1, characterized in that, The PDXP data frame for data transmission includes protocol header information and a data field, and the data field contains several frames of AOS data for data transmission.
7. The workflow-based satellite data transmission processing method as described in claim 1, characterized in that, The source PDXP data frames are sent to the source star's data processing workflow via message middleware.
8. A workflow-based satellite data transmission processing system, characterized in that, include: The first workflow startup module is configured to: monitor the status of the PDXP data frames transmitted, schedule the data processing workflow of the transmitted satellite according to the status, and trigger the startup of each processing software in the data processing workflow of the transmitted satellite. The satellite data processing module is configured to: extract several frames of satellite AOS data from the satellite PDXP data frame, further extract the effective data field from the satellite AOS data, and restore the source satellite AOS data frame by combining array framing technology. At the same time, it sends out satellite transmission feedback and encapsulates the source satellite AOS data frame into a source satellite PDXP data frame, which is then sent to the source satellite's data processing workflow. The second workflow startup module is configured to: start the source star's data processing workflow after listening to the feedback from the proxy; The SourceStar data processing module is configured to perform business processing on SourceStar PDXP data frames using the SourceStar data processing workflow.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the steps in the workflow-based satellite data transmission processing method as described in any one of claims 1-7.
10. A computer device comprising a computer-readable storage medium, a processor, and a computer program stored on the computer-readable storage medium and executable on the processor, characterized in that, When the processor executes the program, it implements the steps in the workflow-based satellite data transmission processing method as described in any one of claims 1-7.
Citation Information
Patent Citations
Satellite data processing method and system
CN111241038A
Multi-source data processing system and method
CN116155362A