A metadata management method and system suitable for space-based distributed file system

By introducing file system event monitoring components and multi-level caching strategies in the space-based distributed file system, the problem of difficult to achieve efficient, stable and reliable metadata management in the space environment is solved, and the stability of the file system and the accuracy of data interaction are achieved, improving the user experience.

CN120353773BActive Publication Date: 2025-09-02ZHEJIANG LAB
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202510860855.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-06-25
Publication Date
2025-09-02
Estimated Expiration
2045-06-25

AI Technical Summary

Technical Problem

Traditional metadata management methods cannot meet the needs of space-based distributed file systems for efficient, stable and reliable in space environments, especially in the case of huge communication delays and data volumes, which affects the continuity and stability of the system.

Method used

A metadata management system and method suitable for space-based distributed file systems is designed, including file system event monitoring components, data collaborative management components and ground metadata management centers. Through multi-level caching and file metadata synchronization strategies that adapt to network conditions, we ensure the stability of the file system and the accuracy of data interaction.

Benefits of technology

It improves the real-time and availability of the file system, reduces data transmission pressure, ensures the accuracy and consistency of file metadata, realizes efficient file access and query integrated in satellite and earth, and improves the user's business system experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120353773B_ABST
    Figure CN120353773B_ABST
Patent Text Reader

Abstract

The present invention provides a metadata management method and system applicable to a space-based distributed file system, belonging to the technical field of space-based system data collaboration scenarios. It includes a file system event monitoring component for real-time monitoring of the satellite-borne computing unit file system and abnormality warning; a data collaboration management component for building single-satellite storage and data synchronization of file metadata; and a ground metadata management center for unified management of metadata of business files to be transmitted and satellite-borne computing unit files. Based on the above system components, a multi-level cache distributed metadata storage management method is proposed to ensure the ground business system's knowability and availability of the satellite distributed file system under conditions of unstable satellite-to-ground and satellite-to-satellite communications, short communication windows, and asymmetric links. At the same time, it significantly improves the accuracy and reliability of file metadata synchronization, providing effective support for the continuity and stability of the space-based information system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of space-based system data collaboration scenarios, and in particular relates to a metadata management method and system applicable to a space-based distributed file system. Background Art

[0002] With the rapid development of space technology, space-based information systems are becoming increasingly important in a variety of fields, including scientific research, national defense and security, and commercial applications. With the continuous advancement of satellite technology and the continued growth of application demand, satellite constellation distributed file systems have become a critical infrastructure for processing, storing, and managing massive amounts of space data.

[0003] However, the complex and ever-changing network conditions in the space environment pose a severe test to the stability and reliability of distributed file systems. Factors such as atmospheric influences, geographical distance, and the number of ground stations in satellite-to-ground communications lead to frequent communication delays, packet loss, and disconnections. Secondly, the amount of data that space-based distributed file systems need to process is huge, and the data types include images, videos, sensor data, etc. Finally, the metadata of space-based distributed file systems needs to be updated frequently to reflect the latest status of the data. Traditional metadata management methods, such as centralized storage and single-path access, can no longer meet these requirements. Faced with space satellite constellations, business systems struggle to access and control file systems in real time like ground clusters. Traditional file metadata management methods are difficult to achieve optimal results in satellite distributed file systems, limiting the continuity and stability of space-based computing tasks.

[0004] To address these issues, a metadata management method suitable for space-based distributed file systems is needed. This method needs to be adaptable to the unique characteristics of the space environment and be efficient, stable, and reliable. It must fully account for the impact of fluctuating network conditions on metadata management. It must be able to allow business systems to access offline satellite file metadata even when the satellite is far from the ground station and asynchronously process file transfer services and intersatellite applications submitted by business systems. Furthermore, this method must ensure the rational allocation and utilization of resources to meet the diverse needs of users. Summary of the Invention

[0005] The purpose of the present invention is to address the deficiencies of the existing technology and provide a metadata management method and system suitable for a space-based distributed file system.

[0006] The object of the present invention is achieved through the following technical solutions:

[0007] The present invention provides a metadata management system applicable to a space-based distributed file system, wherein the system comprises a ground control center and a satellite constellation within the space-based system;

[0008] The satellite constellation includes an onboard computing unit located on each satellite and a file system event monitoring component, a data collaborative management component and a distributed kv database deployed on the onboard computing unit;

[0009] The file system event monitoring component is used to perform real-time file metadata monitoring and file system anomaly detection and early warning on the onboard computing power unit;

[0010] The data collaborative management component is used to build a single-satellite storage of file metadata for all onboard computing units within a single satellite, and to achieve real-time data synchronization with adjacent satellites and the ground control center;

[0011] A ground metadata management center is deployed on the ground control center.

[0012] Furthermore, the file system event monitoring component includes an event monitoring module, an anomaly detection module and a log module;

[0013] The event monitoring module is used to monitor file creation, deletion, reading and writing operations on raw disks and CubeFS file disks;

[0014] The anomaly detection module is used to detect anomalies in the file system and issue early warning signals in a timely manner. The anomalies include file corruption, disk mount failure, permission issues, or insufficient storage space.

[0015] The log module is responsible for recording all operation logs of the file system and providing a metadata query interface for the management component.

[0016] Furthermore, the data collaborative management component includes a metadata management module, a satellite data synchronization module, a communication detection module and a file system metadata checker;

[0017] The metadata management module is responsible for managing the file metadata of all onboard computing units within a single satellite;

[0018] The satellite data synchronization module is responsible for achieving real-time data synchronization between a single satellite and adjacent satellites and the ground control center;

[0019] The communication detection module is responsible for real-time monitoring of the network status between a single satellite and the ground control center;

[0020] The file system metadata checker is used to prevent the generation of dirty data by regularly checking the consistency and integrity of metadata.

[0021] Furthermore, the ground metadata management center includes a ground data synchronization module, a file synchronization directory tree module, a metadata query engine and a task management module;

[0022] The ground data synchronization module is used to transmit file metadata with the satellite data synchronization module in the satellite constellation via the satellite-to-ground communication link;

[0023] The file synchronization directory tree module is used to cache the transmission task files initiated by the business system and the metadata of the files generated by a single satellite application at the same time;

[0024] The metadata query engine is used to provide efficient file metadata query engine functions, supporting users to quickly find required files based on multiple conditions;

[0025] The task management module is used to write the business demand information in the business system as file metadata into the file extension attributes of the transmission task file and to parse the file extension attributes of a file generated by a single satellite application.

[0026] The present invention also provides a metadata management method applicable to a space-based distributed file system. The method is based on the above-mentioned metadata management system applicable to a space-based distributed file system and includes the following steps:

[0027] S1. In the space-based system, the file system event monitoring component is used to perform real-time file metadata monitoring and file system anomaly detection and early warning for the onboard computing power unit;

[0028] S2, multi-level redundant caching of file metadata through satellite constellations and ground control centers;

[0029] S3. In the ground control center, a ground metadata management center is integrated based on the ground storage cluster.

[0030] Furthermore, the multi-level redundant cache includes local cache, single star cache, distributed cache and global cache levels;

[0031] The local cache monitors the file system kernel instructions on the onboard computing unit through the file system event monitoring component, stores file metadata in an incremental update manner to form a local cache of file metadata, and queries and traces information on all file operations through historical log records;

[0032] The single-satellite cache constructs a component management structure with a server-agent relationship by deploying a data collaborative management component and a file system event monitoring component on the management node of the onboard computing unit. The data collaborative management component constructs the file metadata of all onboard computing units within a single satellite to form a single-satellite cache of file metadata. The file metadata pushed by the real-time event of the file system event monitoring component and the file metadata obtained from historical log records in the form of periodic full pull are obtained and stored in a distributed KV database.

[0033] In the distributed cache, the data collaborative management component regularly broadcasts the file metadata of all onboard computing units within a single satellite to adjacent satellites via inter-satellite communication links, forming a distributed cache of file metadata between satellites within the satellite constellation. The initiator of the broadcast data selects the optimal link between different satellites for communication, and then the receiver of the broadcast data determines whether the locally stored file metadata needs to be updated by comparing the latest timestamps of the locally stored file metadata with the received file metadata.

[0034] The global cache is implemented by the data collaborative management component of the successfully linked satellite, which pushes the file metadata of the onboard computing units of each satellite in the satellite constellation to the ground metadata management center through the satellite-to-ground communication link, thereby forming a global cache of file metadata at the ground control center.

[0035] Furthermore, the file metadata includes file name, file size, file type, storage location, update time, file permissions and file extended attributes.

[0036] The present invention also includes a metadata management device applicable to a space-based distributed file system, comprising a memory and one or more processors, wherein the memory stores executable code, and when the one or more processors execute the executable code, they are used for the above-mentioned metadata management method applicable to a space-based distributed file system.

[0037] The present invention also includes a computer-readable storage medium on which a program is stored. When the program is executed by a processor, it implements the above-mentioned metadata management method applicable to a space-based distributed file system.

[0038] The beneficial effects of the present invention are:

[0039] 1) Ensure the real-time and availability of the distributed file system in complex space scenarios. The file system event monitoring component monitors the file system's operating status in real time, promptly identifies and handles abnormalities, and ensures stable file system operation. A multi-level cache distributed metadata storage design optimizes data storage structures and data communication links, improving system response speed and data access efficiency.

[0040] 2) Targeting complex scenarios in space, we ensure the accuracy and reliability of file metadata interactions. Through adaptive network-adaptive file metadata synchronization strategies, we reduce unnecessary data transmission and alleviate bandwidth pressure in weak network environments. Through file metadata management and data synchronization, we ensure consistency between the file metadata in the ground control center and the file metadata in the onboard computing unit, improving the accuracy of data query and retrieval.

[0041] 3) Through the metadata management services of the ground metadata management center, a space-based distributed file system that integrates the satellite and the ground is realized; ensuring that in a complex communication environment, the business system can still efficiently query and retrieve files, apply for services in real time, and asynchronously transmit data without being aware of the satellite's offline status, thereby ensuring the efficient flow of information interaction between distributed tasks, thereby significantly improving the user experience of the business system. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 This is an overall architecture diagram of a metadata management system suitable for space-based distributed file systems;

[0043] Figure 2 A flowchart of a metadata management method applicable to a space-based distributed file system;

[0044] Figure 3 This is a structural diagram of a metadata management device applicable to a space-based distributed file system in Example 3;

[0045] In the figure, 1-file system event monitoring component, 2-data collaborative management component, 3-distributed kv database, 4-CubeFS file disk, 5-bare disk, 6-ground data synchronization module, 7-file synchronization directory tree module, 8-metadata query engine, 9-task management module, 10-business system, 11-ground storage cluster set. DETAILED DESCRIPTION

[0046] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention is further described in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to illustrate the present invention, rather than to represent all embodiments. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments of the present invention without creative work are within the scope of protection of the present invention.

[0047] Example 1: Figure 1 As shown, the present invention provides a metadata management system applicable to a space-based distributed file system. The metadata management system applicable to a space-based distributed file system uses a space-based system framework composed of a ground control center and a satellite constellation as a basic operating environment.

[0048] The underlying layer of the metadata management system for the space-based distributed file system relies on basic runtime libraries such as the CubeFS distributed file system and distributed database. A self-developed software system is deployed on top of it to manage and control the file metadata of the onboard computing units. The ultimate goal is to provide the business system with a space-based distributed file system that integrates space and ground.

[0049] The metadata management system for space-based distributed file systems includes three main self-developed components: a file system event monitoring component 1 (DataAgent) that is deployed at the granularity of onboard computing units within the satellite and collects file system metadata; a data collaboration management component 2 (DataServer) that is deployed at the granularity of a single satellite and provides unified metadata services to the outside world; and a ground metadata management center (DataGround) that is deployed in the ground control center and forms a global file metadata map.

[0050] The above components are explained one by one below.

[0051] The file system event monitoring component (DataAgent) is deployed on each onboard computing unit and monitors the file system status and events at a frequency of seconds based on the Linux system kernel interface, including file creation, deletion, reading and writing operations. This component can define specifications and build an anomaly detection module based on the distributed file system planning of the space-based system, and monitor anomalies in the file system in real time, such as disk damage and mounting failure, permission conflicts or insufficient storage space, to ensure the stable operation of the file system.

[0052] The file system event monitoring component includes an event monitoring module, an anomaly detection module, and a log module. The event monitoring module MetadataSourceServer is responsible for the full-link control of file system metadata collection, monitoring file creation, deletion, reading, and writing operations in the bare disk 5 and the CubeFS file disk 4, and monitoring changes in the file system in real time. Exceptions thrown during the data collection process are received and analyzed by the anomaly detection module FSMonitorServer, which promptly alerts the abnormal state of the file system and triggers the corresponding processing mechanism to ensure the stability and security of the file system. The abnormal conditions include file corruption, disk mount failure, permission issues, or insufficient storage space. In addition, the anomaly detection module FSMonitorServer supports setting monitoring rules according to the file system specifications and issues early warnings for situations such as insufficient disk space. At the end of the file system event monitoring component, the log module MetadataLogServer is responsible for recording all operation logs of the file system. These logs help track historical changes in the file system and provide important basis for subsequent metadata recovery and troubleshooting. At the same time, the log module MetadataLogServer also provides a metadata query interface for the management component, making it convenient for other components to quickly obtain the required metadata information.

[0053] The data collaborative management component (DataServer) includes a metadata management module, a satellite data synchronization module, a communication detection module, and a file system metadata verifier. It is responsible for coordinating and managing the file system and storage resources composed of various onboard computing units, and providing strongly consistent distributed file system services. The metadata management module, MetadataManageServer, manages the file metadata of all onboard computing units within a single satellite. The satellite data synchronization module, MetadataSyncServer, uses efficient synchronization algorithms and the QUIC transmission protocol to achieve real-time data synchronization between a single satellite and adjacent satellites, as well as between a single satellite and the ground control center. The communication detection module, NetworkAssessServer, monitors the network status between a single satellite and the ground control center in real time. By evaluating key indicators such as network latency and bandwidth, it can provide the optimal path selection for data synchronization and transmission, ensuring efficient and stable data transmission. The file system metadata verifier prevents the generation of dirty data in the links of the metadata management system components for the space-based distributed file system by regularly verifying the consistency and integrity of metadata.

[0054] The ground metadata management center (DataGround) is deployed at the ground control center and includes a ground data synchronization module 6, a file synchronization directory tree module 7, a metadata query engine 8, and a task management module 9. The ground data synchronization module, MetadataSyncServer, transmits file metadata with satellite data synchronization modules within the satellite constellation via satellite-to-ground communication links, ensuring accurate transmission and synchronization of metadata from satellite to ground. The ground data synchronization module is also responsible for writing business requirement information for transmission task files into file extension attributes, allowing the data collaboration management component to parse the file attributes and perform business operations such as file content processing and file synchronization between a single satellite and adjacent satellites. The file synchronization directory tree module, FSSyncTreeServer, caches metadata for both transmission task files initiated by the business system 10 and files generated by individual satellite applications. The metadata query engine provides efficient file metadata query capabilities, allowing users to quickly find required files based on a variety of criteria.

[0055] The above system deployment structure provides support for the implementation of a multi-level cache distributed metadata storage solution.

[0056] Example 2: Figure 2 As shown, the present invention provides a metadata management method applicable to a space-based distributed file system. The method is based on the metadata management system applicable to a space-based distributed file system and includes the following steps:

[0057] S1. In the space-based system, the file system event monitoring component is used to perform real-time file metadata monitoring and file system anomaly detection and early warning for the onboard computing power unit;

[0058] S2, multi-level redundant caching of file metadata through satellite constellations and ground control centers;

[0059] S3. In the ground control center, a ground metadata management center is integrated with the ground storage cluster 11.

[0060] Multi-level redundant caching of file metadata is implemented at all levels of the space-based environment to increase file system availability in weak network environments. The multi-level redundant caching includes local caching, per-satellite caching, distributed caching, and global caching.

[0061] The local cache is specifically provided by the file system event monitoring component deployed in each satellite computing unit, which stores file metadata in an incremental update manner, including file name, file size, file type, storage location, update time, file permissions, file extension attributes, etc.; it can also query and trace information on all file operations through historical log records.

[0062] Specifically, the per-satellite cache consists of a data collaborative management component deployed on the management node of the onboard computing unit and establishing a component management structure with a server-agent relationship with the file system event monitoring component. The data collaborative management component uniformly establishes per-satellite storage for file metadata from all onboard computing units within a single satellite, ensuring data consistency within each satellite. The data collaborative management component acquires file metadata pushed by the file system event monitoring component in real-time events, as well as file metadata periodically retrieved from historical log records in a full-data pull, and stores them in a distributed KV database 3. This redundant data backup improves data reliability and availability.

[0063] The distributed cache is specifically: a distributed cache of file metadata of satellites in a satellite constellation is deployed on adjacent satellites, and the full metadata is quickly synchronized and shared through inter-satellite communication links. The satellite data synchronization module in the data collaborative management component regularly broadcasts the file metadata of a single satellite to the adjacent satellites of the satellite, ensuring that each satellite can obtain the latest status information of the file metadata of each satellite in the satellite constellation in a timely manner. The initiator of the broadcast data selects the optimal link for communication between different satellites (the optimal link refers to the link after screening communication conditions such as the choice of microwave or laser, the inclination angle of the satellite), and then the receiver of the broadcast data determines whether the locally stored file metadata needs to be updated by comparing the latest timestamp of the locally stored file metadata with the received file metadata.

[0064] Specifically, the global cache receives and persists global file metadata 24 / 7 at the ground-based metadata management center via satellite-to-ground communication links. Once a satellite establishes a link with the ground control center, it pushes file metadata from all satellites in its constellation to the ground-based metadata management center. This enables the ground control center to form a complete and closed-loop view of intersatellite file metadata. Global file metadata storage supports automatic data sharding and load balancing, ensuring efficient management and access of large-scale data.

[0065] The link begins with a small amount of local file metadata cached by the onboard computing unit. The data collaborative management component uses incremental events to monitor updates to the satellite's file metadata. Regular full synchronization and verification mechanisms ensure the consistency and accuracy of the file system metadata. A distributed cache is formed by broadcasting the satellite's metadata to neighboring satellites via intersatellite communication links. In the event of metadata conflicts, the old version is discarded and the new version is merged based on the update time. The ground control center receives the data pushed by the satellite and monitors its accuracy and latency to form a globally consistent view of the file metadata.

[0066] Example 3: Corresponding to Example 2 of the aforementioned metadata management method applicable to a space-based distributed file system, the present invention also provides an embodiment of a metadata management device applicable to a space-based distributed file system.

[0067] See also Figure 3 An embodiment of the present invention provides a metadata management device applicable to a space-based distributed file system, including one or more processors, for implementing a metadata management method applicable to a space-based distributed file system in the above embodiment.

[0068] An embodiment of the metadata management device of the present invention applicable to a space-based distributed file system can be applied to any device with data processing capabilities, and the device with data processing capabilities can be a device or apparatus such as a computer. The device embodiment can be implemented through software, or through hardware or a combination of software and hardware. Taking software implementation as an example, as a device in a logical sense, it is formed by the processor of any device with data processing capabilities in which it is located reading the corresponding computer program instructions in the non-volatile memory into the memory for execution. From the hardware level, if Figure 3 As shown in the figure, it is a hardware structure diagram of a metadata management device applicable to a space-based distributed file system of the present invention, which is a device with data processing capability. Figure 3 In addition to the processor, memory, network interface, and non-volatile memory shown, any device with data processing capabilities in which the apparatus in the embodiment is located may also include other hardware, generally based on the actual functions of the device with data processing capabilities, which will not be described in detail.

[0069] The implementation process of the functions and effects of each unit in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and will not be repeated here.

[0070] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to the partial description of the method embodiments. The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present invention. A person of ordinary skill in the art can understand and implement the present invention without inventive work.

[0071] An embodiment of the present invention also provides a computer-readable storage medium storing a program. When executed by a processor, the program implements a metadata management method applicable to a space-based distributed file system according to the above-mentioned embodiment. The computer-readable storage medium can be an internal storage unit of any device with data processing capabilities described in any of the above-mentioned embodiments, such as a hard disk or memory. The computer-readable storage medium can also be an external storage device of any device with data processing capabilities, such as a plug-in hard disk, Smart Media Card (SMC), SD card, or flash memory card equipped with the device. Furthermore, the computer-readable storage medium can include both an internal storage unit and an external storage device of any device with data processing capabilities. The computer-readable storage medium is used to store the computer program and other programs and data required by any device with data processing capabilities. It can also be used to temporarily store data that has been output or is to be output.

[0072] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A metadata management system suitable for a space-based distributed file system, characterized in that: In a space-based system, the system comprises a ground control centre and a satellite constellation; The satellite constellation includes an onboard computing unit located on each satellite and a file system event monitoring component, a data collaborative management component and a distributed kv database deployed on the onboard computing unit; The file system event monitoring component is used to perform real-time file metadata monitoring and file system anomaly detection and early warning on the onboard computing power unit; The data collaborative management component is used to build a single-satellite storage of file metadata for all onboard computing units within a single satellite, and to achieve real-time data synchronization with adjacent satellites and the ground control center; A ground metadata management center is deployed on the ground control center.

2. The metadata management system applicable to a space-based distributed file system according to claim 1, characterized in that: The file system event monitoring component includes an event monitoring module, an anomaly detection module and a log module; The event monitoring module is used to monitor file creation, deletion, reading and writing operations on raw disks and CubeFS file disks; The anomaly detection module is used to detect anomalies in the file system and issue early warning signals in a timely manner. The anomalies include file corruption, disk mount failure, permission issues, or insufficient storage space. The log module is responsible for recording all operation logs of the file system and providing a metadata query interface for the management component.

3. The metadata management system applicable to a space-based distributed file system according to claim 1, characterized in that: The data collaborative management component includes a metadata management module, a satellite data synchronization module, a communication detection module and a file system metadata checker; The metadata management module is responsible for managing the file metadata of all onboard computing units within a single satellite; The satellite data synchronization module is responsible for achieving real-time data synchronization between a single satellite and adjacent satellites and the ground control center; The communication detection module is responsible for real-time monitoring of the network status between a single satellite and the ground control center; The file system metadata checker is used to prevent the generation of dirty data by regularly checking the consistency and integrity of metadata.

4. The metadata management system applicable to a space-based distributed file system according to claim 1, characterized in that: The ground metadata management center includes a ground data synchronization module, a file synchronization directory tree module, a metadata query engine and a task management module; The ground data synchronization module is used to transmit file metadata with the satellite data synchronization module in the satellite constellation via the satellite-to-ground communication link; The file synchronization directory tree module is used to cache the transmission task files initiated by the business system and the metadata of the files generated by a single satellite application at the same time; The metadata query engine is used to provide efficient file metadata query engine functions, supporting users to quickly find required files based on multiple conditions; The task management module is used to write the business demand information in the business system as file metadata into the file extension attributes of the transmission task file and to parse the file extension attributes of a file generated by a single satellite application.

5. A metadata management method applicable to a space-based distributed file system, characterized in that: The method is based on a metadata management system applicable to a space-based distributed file system as described in any one of claims 1 to 4, and comprises the following steps: S1. In the space-based system, the file system event monitoring component is used to perform real-time file metadata monitoring and file system anomaly detection and early warning for the onboard computing power unit; S2, multi-level redundant caching of file metadata through satellite constellations and ground control centers; S3. In the ground control center, a ground metadata management center is integrated based on the ground storage cluster.

6. The metadata management method applicable to a space-based distributed file system according to claim 5, characterized in that: The multi-level redundant cache includes local cache, single star cache, distributed cache and global cache levels; The local cache monitors the file system kernel instructions on the onboard computing unit through the file system event monitoring component, stores file metadata in an incremental update manner to form a local cache of file metadata, and queries and traces information on all file operations through historical log records; The single-satellite cache builds a component management structure with a server-agent relationship by deploying a data collaborative management component and a file system event monitoring component on the management node of the onboard computing unit; The data collaborative management component constructs the file metadata of all onboard computing units within a single satellite to form a single-satellite cache of file metadata; Obtain file metadata pushed by the real-time event monitoring component of the file system and file metadata obtained from historical log records in the form of periodic full pulls and store them in the distributed KV database; The distributed cache is composed of a data collaborative management component that regularly broadcasts the file metadata of all onboard computing units within a single satellite to adjacent satellites via inter-satellite communication links, forming a distributed cache of file metadata between satellites within the satellite constellation; The broadcast data initiator selects the optimal link between different satellites for communication, and then the broadcast data receiver determines whether the locally stored file metadata needs to be updated by comparing the latest timestamp of the locally stored file metadata with the received file metadata; The global cache is implemented by the data collaborative management component of the successfully linked satellite, which pushes the file metadata of the onboard computing units of each satellite in the satellite constellation to the ground metadata management center through the satellite-to-ground communication link, thereby forming a global cache of file metadata at the ground control center.

7. The metadata management method applicable to a space-based distributed file system according to claim 6, characterized in that: The file metadata includes file name, file size, file type, storage location, update time, file permissions and file extended attributes.

8. A metadata management device suitable for a space-based distributed file system, characterized in that: The system comprises one or more processors for implementing the metadata management method applicable to a space-based distributed file system as described in any one of claims 5 to 7.

9. A computer-readable storage medium having a program stored thereon, characterized in that: When the program is executed by a processor, it is used to implement the metadata management method applicable to a space-based distributed file system as described in any one of claims 5 to 7.

Citation Information

Patent Citations

  • Satellite cloud-oriented distributed file system

    CN116401225A

  • Middle ware security layer for cloud computing services

    WO2017156497A1