Inter-satellite network data storage conflict processing method and system

Abstract

The application provides an intersatellite network data storage conflict processing method and system, which comprises the following steps: dividing independent storage areas for intersatellite data according to images, instructions and telemetry types, and allocating unique virtual channel identifications for each type of data; establishing a three-level cache architecture, processing emergency data in a hot cache, accepting short-term data in a warm cache, and storing non-active data in a cold cache; creating a multi-channel cache mechanism, processing hot cache data in parallel, and preventing high-frequency emergency data from blocking; when intersatellite network data enters, caching according to timeliness and sequentially sorting according to cache priority; generating dynamic labels for the data entering the cache area according to data types, emergency degrees and timeliness, and guiding the data to corresponding VCID storage areas through label-driven routing, and the like. The automatic implementation of the process solves the problems of waste of traditional satellite storage resources, poor expansion capability and the like, and ensures the reliability and stability of satellite storage.

Description

Technical Field

[0001] This invention belongs to the field of aerospace technology, specifically relating to a method and system for handling data storage conflicts in inter-satellite networks. In particular, it relates to a method and system for handling data storage conflicts in inter-satellite networks based on virtual channel identifiers, which, through dynamic tag-driven routing technology, achieves elastic expansion of storage resources and intelligent scheduling of transmission links, significantly improving the efficiency of inter-satellite data management and mission reliability. Background Technology

[0002] Currently, inter-satellite data storage mainly adopts a fixed physical partition management model, which isolates different data types and stores them in preset storage areas. Preset fixed partitions cannot adapt to the surge in data volume caused by sudden tasks, and are prone to imbalances such as local exhaustion of storage space and global idleness. Single-satellite centralized storage architecture has the risk of single point of failure, and critical data cannot be quickly recovered after loss.

[0003] Patent document CN108365886A provides a time-division multiplexing inter-satellite network data storage and forwarding method. This method can meet the real-time storage and forwarding requirements of massive amounts of multi-type, multi-address data under limited satellite storage resources and processing capabilities, improving search efficiency and reducing storage footprint. The method includes: establishing a network datagram entity data pool, and creating a virtual memory dynamic preemption data structure based on the entity data pool to form a virtual container; obtaining idle virtual element nodes from the entity data pool, filling the storage unit pointed to by the virtual element node with inter-satellite data, and injecting the virtual element node into the virtual container; encapsulating the attributes of the virtual container, and obtaining the traffic information of the space information network nodes based on the frequency of overflow during encapsulation, adjusting the virtual container capacity based on the traffic information; performing a mapping search based on the valid element nodes in the virtual container, and forwarding data according to priority.

[0004] While patent document CN108365886A utilizes virtual containers to address the resource waste inherent in traditional storage to some extent, it can only discard data when the maximum capacity of the data pool, the upper limit of the virtual container, or the virtual element nodes of the data pool are exhausted. In particular, the ground can only be notified after the event occurs, which is not conducive to application scenarios where satellites are autonomously managed in orbit.

[0005] This invention monitors the health status of storage in real time, predicts capacity demand, and achieves elastic expansion through copy-on-write technology. It solves the problems of resource waste or sudden overflow caused by fixed capacity in traditional pre-allocated storage mode, and the need for service interruption and delayed response for manual expansion. Summary of the Invention

[0006] To address the shortcomings of existing technologies, the purpose of this invention is to provide a method and system for handling data storage conflicts in inter-satellite networks, enabling unified storage of payload data, on-demand data download, flexible adaptation to different needs, and improved data utilization efficiency. This solves the core problems of traditional methods, such as low storage space utilization and difficulty in adapting to dynamic changes in mission requirements.

[0007] A method for handling data storage conflicts in an inter-satellite network according to the present invention includes: Step S1: Divide the inter-satellite data into independent storage areas according to the data types of images, commands, and telemetry, and assign a unique virtual channel identifier (VCID) to each type of data; Step S2: Establish a three-level cache architecture of hot cache, warm cache, and cold cache. Hot cache handles urgent data, warm cache handles short-term data, and cold cache stores inactive data. Step S3: Create a multi-channel caching mechanism to process hot cached data in parallel; Step S4: When inter-satellite network data arrives, it is cached according to timeliness and sorted in sequence according to cache priority; Step S5: Generate dynamic tags for the data entering the cache area according to data type, urgency, and timeliness, and guide the data to the corresponding VCID storage area through tag-driven routing; Step S6: Monitor the load status of each VCID storage area, dynamically expand adjacent areas when the amount of a single type of data surges, and use copy-on-write technology to avoid service interruption; Step S7: The satellite receives the VCID specified command from the ground station to trigger direct transmission. When the storage capacity exceeds the limit, the data is transmitted back according to the data priority. Non-urgent data is transmitted using the inter-satellite link idle window.

[0008] Preferably, a physically isolated storage volume is created for each VCID, an access control list is set up, and the mapping relationship between VCID and storage location is registered in the central routing table.

[0009] Preferably, a three-level physical cache is established through memory mapping commands, and the data migration strategy is set as follows: when the access frequency of hot cache data is lower than the set frequency within a set first time period, it is migrated to warm cache; when warm cache data is not accessed within a set second time period, it is migrated to cold cache; wherein, the first time period is shorter than the second time period.

[0010] Preferably, the multi-channel cache is implemented by initializing multiple DMA channels, each configured with different priorities and buffers; When data arrives, the channel is selected based on the urgency field in the data packet header, and the data is allocated to different channels in descending order of urgency. If the channel queue depth exceeds the set ratio, the load redistribution mechanism is immediately triggered to divert the data to other channels in the multiple DMA channels.

[0011] Preferably, in step S4, the heap sort algorithm is called to insert the cached data into the global cache queue according to the index value, ensuring that the earliest expiring and highest priority data is always at the front of the queue; In step S5, route labels are constructed, and routing decisions are made based on the label values: data with urgency ≥ the set urgency is written to the hot cache, data with urgency < the set urgency and lifespan < the threshold is written to the warm cache, and the remaining data is written to the cold cache.

[0012] In step S6, a mapping record from the old block to the new block is added to the copy mapping table to achieve storage expansion with zero service interruption. In step S7, when downloading using an idle window, an interrupt-tolerant transmission protocol is adopted, allowing interrupted transmission to resume and automatically retry.

[0013] An inter-satellite network data storage conflict handling system provided by the present invention includes: Module M1: Divides inter-satellite data into independent storage areas according to data types such as images, commands, and telemetry, and assigns a unique virtual channel identifier (VCID) to each type of data; Module M2: Establishes a three-level caching architecture of hot cache, warm cache, and cold cache. Hot cache handles urgent data, warm cache handles short-term data, and cold cache stores inactive data. Module M3: Creates a multi-channel caching mechanism to process hot cached data in parallel; Module M4: When inter-satellite network data arrives, it is cached according to timeliness and sorted in sequence according to cache priority; Module M5: Generates dynamic tags for data entering the cache area according to data type, urgency, and timeliness, and guides the data to the corresponding VCID storage area through tag-driven routing; Module M6: Monitors the load status of each VCID storage area, dynamically expands adjacent areas when the amount of a single type of data surges, and uses copy-on-write technology to avoid service interruption; Module M7: The satellite receives the VCID-specified command from the ground station to trigger direct transmission. When the storage capacity exceeds the limit, it transmits back according to data priority and uses the inter-satellite link idle window to transmit non-urgent data.

[0014] Preferably, a physically isolated storage volume is created for each VCID, an access control list is set up, and the mapping relationship between VCID and storage location is registered in the central routing table.

[0015] Preferably, a three-level physical cache is established through memory mapping commands, and the data migration strategy is set as follows: when the access frequency of hot cache data is lower than the set frequency within a set first time period, it is migrated to warm cache; when warm cache data is not accessed within a set second time period, it is migrated to cold cache; wherein, the first time period is shorter than the second time period.

[0016] Preferably, the multi-channel cache is implemented by initializing multiple DMA channels, each configured with different priorities and buffers; When data arrives, the channel is selected based on the urgency field in the data packet header, and the data is allocated to different channels in descending order of urgency. If the channel queue depth exceeds the set ratio, the load redistribution mechanism is immediately triggered to divert the data to other channels in the multiple DMA channels.

[0017] Preferably, in module M4, the heap sort algorithm is called to insert cached data into the global cache queue according to the index value, ensuring that the earliest expiring and highest priority data is always at the front of the queue; In module M5, routing labels are constructed, and routing decisions are made based on the label values: data with urgency ≥ the set urgency is written to the hot cache, data with urgency < the set urgency and lifespan < the threshold is written to the warm cache, and the remaining data is written to the cold cache.

[0018] In module M6, a mapping record from the old block to the new block is added to the copy mapping table to achieve storage expansion with zero service interruption; In module M7, when downloading using an idle window, an interrupt-tolerant transmission protocol is adopted, allowing interrupted downloads to resume and automatically retrying.

[0019] Compared with the prior art, the present invention has the following beneficial effects: 1. This invention uses routing software to identify information types and constructs virtual channel isolated storage. It caches small amounts of data in bursts, solving the resource competition and priority confusion caused by traditional hybrid storage, avoiding information congestion, and improving the timeliness of critical data transmission.

[0020] 2. This invention monitors the health status of storage in real time, predicts capacity demand, and achieves elastic expansion through copy-on-write technology. It solves the problems of resource waste or sudden overflow caused by fixed capacity in traditional pre-allocated storage mode, and the need for service interruption and delayed response for manual expansion.

[0021] 3. This invention solves the problem of congestion during the transmission of a large number of urgent inter-satellite network data by injecting multi-dimensional identifiers in real time at the data entry point and adopting a parallel caching channel design. It ensures that high-priority services still meet low deterministic latency under high traffic bursts, and significantly improves the reliability of inter-satellite transmission. Attached Figure Description

[0022] Other features, objects, and advantages of the present invention will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings: Figure 1 This is a flowchart illustrating a method for handling data storage conflicts in an inter-satellite network according to the present invention. Detailed Implementation

[0023] The present invention will now be described in detail with reference to specific embodiments. These embodiments will help those skilled in the art to further understand the present invention, but do not limit the invention in any way. It should be noted that those skilled in the art can make several changes and improvements without departing from the concept of the present invention. These all fall within the protection scope of the present invention.

[0024] The dynamic weighted routing algorithm used in this invention supports real-time calculation of transmission priority and cross-satellite sharding storage to ensure high data availability. It effectively solves the problems of low storage efficiency, severe transmission congestion, and weak disaster recovery capabilities in traditional methods. This invention provides constellation networks with a highly reliable, low-latency, and adaptive inter-satellite data management infrastructure, and the automated implementation of the process solves the problems of wasteful satellite storage resources and poor scalability in traditional satellite storage, ensuring the reliability and stability of satellite storage.

[0025] Figure 1 This is a flowchart of the inter-satellite network data storage conflict handling method of the present invention. As shown in the figure, the inter-satellite network data storage conflict handling method provided by the present invention includes the following steps, and the specific scheme is as follows: Step S1: Parse the type field of bytes 3-5 in the header of the input data packet. Assign a virtual channel identifier (VCID) based on the type value: 0x10 for image data, 0x01 for command data, 0x02 for command data, and 0x03 for telemetry data. Then, call the storage management command to create an independent storage volume for each VCID and register the mapping relationship between the VCID and the physical storage location in the central routing table, completing the initialization of the isolated storage area. VCID stands for Virtual CAN Network ID.

[0026] Step S2: Establish a three-level physical cache using memory mapping commands. Allocate 2GB of NVMe space for the hot cache (address 0xFFFF0000), 20GB of SATA space for the warm cache (address 0x7FFF0000), and 200GB of NAND space for the cold cache (address 0x00010000). The hot cache handles urgent data, the warm cache handles short-term data, and the cold cache stores inactive data. Based on storage urgency and lifespan, data is categorized into urgent data, short-term data, and inactive data; for example, the access frequency of urgent data, short-term data, and inactive data decreases in that order.

[0027] Set a data migration strategy: when the access frequency of hot cache data is below 10Hz for 3 consecutive seconds, migrate it to warm cache; when warm cache data is not accessed for 30 seconds, migrate it to cold cache; finally, start the cache migration daemon process to continuously monitor and execute the migration operation at 1-second intervals.

[0028] Step S3: Create a multi-channel caching mechanism to process hot-buffered data in parallel and prevent high-frequency urgent data from blocking; initialize four DMA channels ch0-ch3, configuring different priorities and 512MB buffers respectively. Set the weighted round-robin scheduler to allocate weights of 40%, 20%, 20%, and 20% to channels ch0, ch1, ch2, and ch3 respectively. When data arrives, select a channel based on the packet header urgency field: urgency 7-8 is allocated to ch0, 5-6 to ch1, 3-4 to ch2, and 0-2 to ch3. If the queue depth of a channel exceeds 80%, immediately trigger the load redistribution mechanism to distribute the data to other channels among the four DMA channels.

[0029] Step S4: Extract the 8-byte UTC expiration timestamp from the packet header and calculate the remaining valid time T_remain = expiration time - current satellite time. Combine this with the 3-bit priority field in the packet header to generate a 64-bit sorted index, storing the T_remain value in the high 32 bits and the priority complement in the low 32 bits. Use the heap sort algorithm to insert the data into the global cache queue according to the index value, ensuring that the earliest expiring and highest priority data is always at the front of the queue.

[0030] Step S5: Construct an 8-byte routing label. Bits 0-1 store the data type: 00 = image, 01 = command, 10 = telemetry. Bits 2-4 store the urgency (0-7), and bits 5-7 store the lifetime (1-8). Perform routing decisions based on the label value. Data with an urgency ≥ 6 is written to the hot cache address 0xFFFF0000, data with a lifetime < the threshold is written to the warm cache address 0x7FFF0000, and the rest are written to the cold cache address 0x00010000. Simultaneously, extract the VCID field from the label, copy the data to the corresponding VCID storage area's write pointer position, and update the pointer.

[0031] Step S6: Poll the utilization rate of each VCID storage area every 5 seconds. When a partition's utilization rate is detected to be >85% for 10 seconds, execute the expansion command. After allocating adjacent physical storage blocks, add a mapping record from the old block to the new block in the copy-on-write mapping table and mount the redirection module. New data is automatically redirected to the new block when written, while existing data remains at its original address, achieving storage expansion with zero service interruption.

[0032] Step S7: Upon receiving the 0x55 command from the ground station, parse the VCID and time window parameters, and immediately read the data from the corresponding storage area for direct transmission. If the total storage utilization is >95%, initiate priority cleanup: query the database to obtain the oldest data with the lowest priority, and start transmission when the inter-satellite link is idle and bandwidth utilization is <10% for 5 seconds. After successful transmission, delete the local copy. Simultaneously, the background transmission process continuously monitors the link status and automatically transmits non-urgent data using idle windows.

[0033] The present invention also provides an inter-satellite network data storage conflict handling system, which can be implemented by executing the process steps of the inter-satellite network data storage conflict handling method. That is, those skilled in the art can understand the inter-satellite network data storage conflict handling method as a preferred embodiment of the inter-satellite network data storage conflict handling system.

[0034] An inter-satellite network data storage conflict handling system provided by the present invention includes: Module M1: Divides inter-satellite data into independent storage areas according to data types such as images, commands, and telemetry, and assigns a unique virtual channel identifier (VCID) to each type of data; Module M2: Establishes a three-level caching architecture of hot cache, warm cache, and cold cache. Hot cache handles urgent data, warm cache handles short-term data, and cold cache stores inactive data. Module M3: Creates a multi-channel caching mechanism to process hot cached data in parallel; Module M4: When inter-satellite network data arrives, it is cached according to timeliness and sorted in sequence according to cache priority; Module M5: Generates dynamic tags for data entering the cache area according to data type, urgency, and timeliness, and guides the data to the corresponding VCID storage area through tag-driven routing; Module M6: Monitors the load status of each VCID storage area, dynamically expands adjacent areas when the amount of a single type of data surges, and uses copy-on-write technology to avoid service interruption; Module M7: The satellite receives the VCID-specified command from the ground station to trigger direct transmission. When the storage capacity exceeds the limit, it transmits back according to data priority and uses the inter-satellite link idle window to transmit non-urgent data.

[0035] Those skilled in the art will understand that, besides implementing the system and its various devices, modules, and units provided by this invention in the form of purely computer-readable program code, the same functions can be achieved entirely through logical programming of the method steps, making the system and its various devices, modules, and units of this invention function in the form of logic gates, switches, application-specific integrated circuits, programmable logic controllers, and embedded microcontrollers. Therefore, the system and its various devices, modules, and units provided by this invention can be considered as a hardware component, and the devices, modules, and units included therein for implementing various functions can also be considered as structures within the hardware component; alternatively, the devices, modules, and units for implementing various functions can be considered as both software modules implementing the method and structures within the hardware component.

[0036] Specific embodiments of the present invention have been described above. It should be understood that the present invention is not limited to the specific embodiments described above, and those skilled in the art can make various changes or modifications within the scope of the claims, which do not affect the essence of the present invention. Unless otherwise specified, the embodiments and features described in this application can be arbitrarily combined with each other.

Claims

1. A method for handling data storage conflicts in an inter-satellite network, characterized in that, include: Step S1: Divide the inter-satellite data into independent storage areas according to the data types of images, commands, and telemetry, and assign a unique virtual channel identifier (VCID) to each type of data; Step S2: Establish a three-level cache architecture of hot cache, warm cache, and cold cache. Hot cache handles urgent data, warm cache handles short-term data, and cold cache stores inactive data. Step S3: Create a multi-channel caching mechanism to process hot cached data in parallel; Step S4: When inter-satellite network data arrives, it is cached according to timeliness and sorted in sequence according to cache priority; Step S5: Generate dynamic tags for the data entering the cache area according to data type, urgency, and timeliness, and guide the data to the corresponding VCID storage area through tag-driven routing; Step S6: Monitor the load status of each VCID storage area, dynamically expand adjacent areas when the amount of a single type of data surges, and use copy-on-write technology to avoid service interruption; Step S7: The satellite receives the VCID specified command from the ground station to trigger direct transmission. When the storage capacity exceeds the limit, the data is transmitted back according to the data priority. Non-urgent data is transmitted using the inter-satellite link idle window.

2. The inter-satellite network data storage conflict handling method according to claim 1, characterized in that, Create physically isolated storage volumes for each VCID, set up access control lists, and register the mapping relationship between VCID and storage location in the central routing table.

3. The inter-satellite network data storage conflict handling method according to claim 1, characterized in that, A three-level physical cache is established using memory mapping commands, and the data migration strategy is set as follows: when the access frequency of hot cache data is lower than the set frequency within a set first time period, it is migrated to the warm cache; when the warm cache data is not accessed within a set second time period, it is migrated to the cold cache; wherein, the first time period is shorter than the second time period.

4. The inter-satellite network data storage conflict handling method according to claim 1, characterized in that, Multi-channel caching is achieved by initializing multiple DMA channels, each configured with different priorities and buffers. When data arrives, the channel is selected based on the urgency field in the data packet header, and the data is allocated to different channels in descending order of urgency. If the channel queue depth exceeds the set ratio, the load redistribution mechanism is immediately triggered to divert the data to other channels in the multiple DMA channels.

5. The inter-satellite network data storage conflict handling method according to claim 1, characterized in that, In step S4, the heap sort algorithm is called to insert the cached data into the global cache queue according to the index value, ensuring that the earliest expiring and highest priority data is always at the front of the queue; In step S5, route labels are constructed, and routing decisions are made based on the label values: data with urgency ≥ the set urgency is written to the hot cache, data with urgency < the set urgency and lifespan < the threshold is written to the warm cache, and the remaining data is written to the cold cache. In step S6, a mapping record from the old block to the new block is added to the copy mapping table to achieve storage expansion with zero service interruption. In step S7, when downloading using an idle window, an interrupt-tolerant transmission protocol is adopted, allowing interrupted transmission to resume and automatically retry.

6. An inter-satellite network data storage conflict handling system, characterized in that, include: Module M1: Divides inter-satellite data into independent storage areas according to data types such as images, commands, and telemetry, and assigns a unique virtual channel identifier (VCID) to each type of data; Module M2: Establishes a three-level caching architecture of hot cache, warm cache, and cold cache. Hot cache handles urgent data, warm cache handles short-term data, and cold cache stores inactive data. Module M3: Creates a multi-channel caching mechanism to process hot cached data in parallel; Module M4: When inter-satellite network data arrives, it is cached according to timeliness and sorted in sequence according to cache priority; Module M5: Generates dynamic tags for data entering the cache area according to data type, urgency, and timeliness, and guides the data to the corresponding VCID storage area through tag-driven routing; Module M6: Monitors the load status of each VCID storage area, dynamically expands adjacent areas when the amount of a single type of data surges, and uses copy-on-write technology to avoid service interruption; Module M7: The satellite receives the VCID-specified command from the ground station to trigger direct transmission. When the storage capacity exceeds the limit, it transmits back according to data priority and uses the inter-satellite link idle window to transmit non-urgent data.

7. The inter-satellite network data storage conflict handling system according to claim 6, characterized in that, Create physically isolated storage volumes for each VCID, set up access control lists, and register the mapping relationship between VCID and storage location in the central routing table.

8. The inter-satellite network data storage conflict handling method according to claim 6, characterized in that, A three-level physical cache is established using memory mapping commands, and the data migration strategy is set as follows: when the access frequency of hot cache data is lower than the set frequency within a set first time period, it is migrated to the warm cache; when the warm cache data is not accessed within a set second time period, it is migrated to the cold cache; wherein, the first time period is shorter than the second time period.

9. The inter-satellite network data storage conflict handling system according to claim 6, characterized in that, Multi-channel caching is achieved by initializing multiple DMA channels, each configured with different priorities and buffers. When data arrives, the channel is selected based on the urgency field in the data packet header, and the data is allocated to different channels in descending order of urgency. If the channel queue depth exceeds the set ratio, the load redistribution mechanism is immediately triggered to divert the data to other channels in the multiple DMA channels.

10. The inter-satellite network data storage conflict handling system according to claim 6, characterized in that, In module M4, the heap sort algorithm is called to insert cached data into the global cache queue according to the index value, ensuring that the earliest expiring and highest priority data is always at the front of the queue; In module M5, routing labels are constructed, and routing decisions are made based on the label values: data with urgency ≥ the set urgency is written to the hot cache, data with urgency < the set urgency and lifespan < the threshold is written to the warm cache, and the remaining data is written to the cold cache. In module M6, a mapping record from the old block to the new block is added to the copy mapping table to achieve storage expansion with zero service interruption; In module M7, when downloading using an idle window, an interrupt-tolerant transmission protocol is adopted, allowing interrupted downloads to resume and automatically retrying.

Images