A cross-domain sharing system and method for earth data resources
By building a cross-domain sharing system and integrating earth data resources, we can achieve efficient and secure acquisition and utilization of resources, solve the problem of data silos, and improve resource utilization efficiency.
Patent Information
- Application Number
- CN202411656463.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-19
- Publication Date
- 2025-10-21
- Estimated Expiration
- 2044-11-19
Smart Images

Figure CN119807150B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of geographic information technology, and in particular to a cross-domain sharing system and method for earth data resources. Background Art
[0002] In recent years, with the development of remote sensing technology, the Global Positioning System (GPS), the Geographic Information System (GIS), and the mobile internet, Earth data resources are growing at an unprecedented rate. Considering the storage, computing, and network resource demands of these massive Earth data resources, numerous research organizations and institutions have established Earth data resource centers of considerable scale to centrally manage Earth data resources within their respective domains. However, as the volume of Earth data resources continues to expand and their applications deepen, this relatively independent traditional organizational model has resulted in a certain degree of resource waste. On the one hand, Earth data resource centers in different domains may repeatedly process and store the same data, resulting in unnecessary consumption of human resources, computing resources, and storage space. Furthermore, the independence of Earth data resource centers in different domains may lead to a lack of unified mechanisms and platforms for data sharing, limiting the flow and utilization of data across domains and creating data silos.
[0003] Therefore, there is an urgent need to provide a cross-domain data sharing solution to address the issue of sharing earth data resources across the entire region, improve resource utilization efficiency by establishing a cross-regional coordination mechanism, and promote in-depth sharing of earth data resources. Summary of the Invention
[0004] The purpose of the present invention is to provide a cross-domain sharing system and method for earth data resources.
[0005] The technical solution to achieve the purpose of the present invention is: a cross-domain sharing system for earth data resources, including:
[0006] The Earth Data Resource Catalog Service is used to perform structured analysis on Earth data resources of different sources and types, extract core metadata of Earth data resources, and establish a unified Earth data resource model using ontology technology. Through text data processing and cleaning, metadata is extracted and semantically converted from Earth data resources of different sources, and the Earth data resource model is instantiated. Earth resource data within each domain and across the entire domain are associated and integrated to construct an Earth data resource catalog. Unique identifiers for data are established using data type, spatial range, spatial hierarchy, and time range.
[0007] The cross-domain resource acquisition module is used to dynamically locate earth data resources while balancing resources and efficiency, and achieve efficient cross-domain acquisition of earth data resources based on reverse proxy technology. It constrains users' cross-domain acquisition behavior from two aspects: permission hierarchical control and risk behavior restriction. It intercepts user acquisition that exceeds the permission definition and implements access restrictions for acquisition behaviors with potential risks to ensure the security of cross-domain earth data resource acquisition.
[0008] The hybrid backup mechanism for earth data resources is used to comprehensively consider the acquisition efficiency and security factors in the process of backing up earth data resources, and provide a hybrid earth data resource partitioning strategy and replica migration strategy. The hybrid earth data resource partitioning strategy designs a multi-node resource criticality partitioning scheme. Core critical resources and restricted access resources use local backup storage, and basic public data resources and open shared data use multi-node off-site master-slave. The replica migration strategy design considers the differentiated replica migration process of data volume. Periodic incremental replicas are actively migrated across domains through the global directory service, and real-time differential replicas are passively migrated within the domain after the cross-domain acquisition of earth data resources is completed.
[0009] Furthermore, the Earth Data Resource Directory Service includes two parts: the Earth Data Resource Model and the Cross-Domain Resource Publishing Service.
[0010] The Earth Data Resource Model conducts structured analysis on Earth Data Resources of different sources and types, extracts core metadata of Earth Data Resources, and establishes a unified model structure using ontology technology. Through text information processing and cleaning operations, metadata extraction and semantic conversion are performed on Earth Data Resources of different domains to complete the instantiation of the Earth Data Resource Model. Specifically, it includes:
[0011] 1) Read the spatial coordinate system and time zone in the metadata to complete the extraction of spatiotemporal reference information;
[0012] 2) Read the origin and affine coefficients in the meta-information, calculate the spatial range, and complete the spatial information extraction;
[0013] 3) Read the time version information in the meta information and complete the time information extraction;
[0014] 4) Read the sensor identification, product level, reference system, projection parameters, and band in the metadata to extract other attribute information;
[0015] 5) Filling the earth data resource model with the information extracted in 1)-4) to complete the instantiation process of the earth data resource model;
[0016] Cross-domain resource publishing services establish a mapping relationship between the earth data resource model structure and the earth data resource directory at the attribute level, perform similarity analysis on earth data resources in different domains, associate and aggregate earth data resources with high similarity, and build a unified global earth data resource directory; use the data type, spatial range, spatial hierarchy, and time range of earth data resources to establish a unique identifier for earth data resources to ensure the uniqueness requirements of earth data resource discovery, specifically including:
[0017] Determine the contents of the Earth data resource catalog and complete attribute mapping. The Earth data resource catalog provides retrieval and description capabilities for Earth data resources across the entire domain and within each domain, primarily including Earth data resource identification, resource registration time, resource coverage, resource product level, and source unit information. Attribute mapping is performed between the Earth data resource model structure and the Earth data resource catalog. For example, spatial information in the Earth data resource model is mapped to resource coverage in the Earth data resource catalog, time information is mapped to resource registration time, and product numbers are mapped to resource product levels.
[0018] Using the spatial and attribute information of earth data resources, data association is established to complete the aggregation of earth data resources. That is, the spatial and attribute associations between different earth data resources registered in the earth resource directory are calculated. Spatial association is the calculation of the spatial association between the data from the perspective of spatial topology and spatial distance measurement; attribute association is the calculation of the association of earth data resources based on whether the attributes of different earth data resources match and whether the attribute values are consistent. Earth data resources with high spatial and attribute associations (such as spatial association values close to 1) are aggregated in the directory to provide unified resource acquisition capabilities.
[0019] Establish a unique identifier for earth data resources, that is, to sequentially combine the type code, Hilbert curve code, maximum spatial level, time code, and 4-bit random code of the earth data resources to form an identifier for the earth data resources, which is convenient for quick retrieval.
[0020] Furthermore, the cross-domain resource acquisition system includes two parts: a cross-domain earth data resource acquisition module and a resource acquisition hierarchical control module, wherein:
[0021] The cross-domain earth data resource acquisition module defines a cross-domain earth data resource acquisition process that includes a user authentication process. The forwarding of inter-domain resource acquisition requests is implemented through a cross-domain resource gateway, which is implemented by integrating an external proxy service (such as nginx). The user authentication process is completed by integrating an external user service (hereinafter referred to as a unified user service). The process for users in the current domain (domain 2) to cross-domain acquire earth data resources in the target domain (domain 1) includes:
[0022] 1) The terminal user of the current domain (domain 2) initiates a service acquisition request to the earth data resource service of the target domain (domain 1) through the cross-domain resource gateway, and the request carries the user token information;
[0023] 2) The Earth Data Resource Service of the target domain (Domain 1) requests the unified user service to verify the identity information;
[0024] 3) The user service of the target domain (domain 1) requests addressing from the earth data resource directory of the domain (domain 1) and obtains the addressing result;
[0025] 4) The unified user service of the target domain (domain 1) requests identity verification from the unified user service of the entire domain via the cross-domain resource gateway;
[0026] 5) The unified user service of the entire domain verifies the identity information and performs authentication control based on the identity authority, and then returns the result to the unified user service of the target domain (domain 1) through the cross-domain resource gateway;
[0027] 6) After the target domain (domain 1) unified user service obtains the return result, it returns the authentication verification result to the target domain (domain 1) earth data resource service;
[0028] 7) If the verification is successful and the requested service is within the user's authorized scope, the target domain (domain 1) earth data resource service will release the earth data resource service request and return the earth data resource to the terminal in the current domain (domain 2) via the cross-domain resource gateway; if the verification is unsuccessful or the requested service is not within the user's authorized scope, the target domain (domain 1) earth data resource service will refuse to provide resource acquisition services, and the terminal in the current domain (domain 2) will not be able to obtain the earth data resource;
[0029] The resource acquisition hierarchical control module defines data acquisition strategies that match the differences in user roles and permissions, restricting users from acquiring earth data resources outside their permissions. Specifically, the resource acquisition assessment results are calculated based on three indicators: user role level, operation risk level, and earth data resource criticality level. When the assessment result is 1, access is allowed, and when it is 0, access is not allowed.
[0030] The User Role Level (UL) represents the level of the user's role, which is divided into three categories: Resource Administrator (RA), Resource Producer (RP), and Resource User (RU). Possible role level values are 0.1, 0.5, and 0.9. The Operation Risk Level (ORL) represents the risk impact of the resource acquisition operation attempted by the user. The risk impact levels of resource acquisition, resource update, resource editing, and resource deletion are 0.1, 0.5, 0.8, and 0.9, respectively. The Resource Criticality Level (RCL) is determined based on factors such as the spatial resolution, acquisition time, and data quality of the earth data resource. The higher the spatial resolution, the later the acquisition time, and the higher the data quality, the higher the criticality level. It is obtained by weighting the expert scores, and possible values are 0.25, 0.5, 0.75, and 1. The Resource Access Score (RAS) can be expressed as
[0031]
[0032] Furthermore, the cross-domain earth data resource acquisition module defines a set of adjustable resource positioning strategies. By combining resource acquisition evaluation indicators, it dynamically updates effective acquisition resources according to environmental conditions, completing user-imperceptible dynamic positioning of earth data resources.
[0033] Resource location strategies include the Efficiency-first Access Strategy (EFS), the Stability-first Access Strategy (SFAS), the Multi-factor Balanced Strategy (MFBS), and the Access Locked Strategy to Special Resources (ALSSR). These strategies rank Earth data resources based on a set of custom resource acquisition evaluation metrics. A higher score indicates a resource's greater compliance with the resource location strategy. Resource acquisition metrics include Normalized Distance (ND), Normalized Response Time (NRT), Success Rate (SR), Cross-domain Status (RCDS), and Load Index (RLI). The value range of RCDS is 0 and 1, that is, RCDS of data within the domain is 0, and RCDS of cross-domain data is 1; the value range of RLI is 0 to 1, that is, the greater the load, the closer the RLI is to 1, otherwise the RLI is closer to 0.
[0034] EFS is an efficiency score that evaluates indicators such as resource distance, resource acquisition response time, resource cross-domain status, and resource current load index. Specifically, EFS can be expressed as
[0035]
[0036] Here, α is a constant ranging from 0 to 1.
[0037] SFAS is a stability score after evaluating indicators such as resource acquisition success rate, resource cross-domain status, and resource current load index. It can be specifically expressed as
[0038] SFAS=(α+RCDS)RCDS·SR·RLI
[0039] MFBS is a balance score after evaluating indicators such as resource distance, resource acquisition success rate, resource acquisition response time, resource cross-domain status, and resource current load index. It is a balance between network bandwidth usage, acquisition reliability, and acquisition efficiency. It can be specifically expressed as
[0040]
[0041] ALSSR refers to some special earth data resources that only provide services to specific users or clients. This is achieved by binding with user permissions. Other non-bound users cannot discover and use the earth data resources during cross-domain resource positioning.
[0042] Furthermore, the resource acquisition classification control module also calculates the user acquisition risk index based on the user's acquisition behavior, and reduces the level of data available to users with a higher risk index. When calculating the user acquisition risk index, the user's acquisition frequency, acquisition duration, and resource level are taken into account.
[0043] User acquisition risk index UARL corresponding to the i-th user i It can be expressed as
[0044]
[0045] Where N is the total number of earth data resources, M is the total number of earth data resources accessed by the i-th user, They represent the acquisition frequency, acquisition duration, and resource level of the mth earth data resource accessed by the i-th user.
[0046] Furthermore, the hybrid backup mechanism for earth data resources includes a hybrid earth data resource partitioning strategy and a replica migration strategy, wherein:
[0047] A hybrid strategy for dividing earth data resources: core and key resources and restricted access resources use local backup storage, and data backup nodes are set up within the domain. When acquiring core and key resources, priority is given to obtaining data from the local master node. When data acquisition on the master node fails, data is switched to the data from the local backup node. Basic public data resources and open shared data use remote master-slave mode, and data backup nodes are set up in multiple domains. When acquiring basic public data resources and open shared data, priority is given to obtaining data from the local master node. When data acquisition on the master node fails, data from backup nodes in other domains is acquired based on the cross-domain data service acquisition function.
[0048] The replica migration strategy first detects the dynamic changes of the global earth data resource directory at dynamic time intervals to extract incremental earth data resources, builds incremental replicas, and then synchronizes the incremental replicas to the backup nodes through the underlying data synchronization service to complete the periodic incremental replica migration process. For asynchronous data within the transformation detection interval, the differential data should be cached to the backup node after the cross-domain acquisition is completed, and the real-time differential replica migration process is completed through real-time caching of differential data.
[0049] Furthermore, in the replica migration strategy, the detection time interval RMCDI is a dynamic result obtained by weighting the update intervals RCDI of different earth data resources by key levels within a certain period of time in the past. The calculation method is:
[0050]
[0051] Among them, RCL i and RCDI i are the critical level and update interval of the i-th updated earth data resource, and M is the total number of updated earth data resources.
[0052] A cross-domain sharing method for earth data resources, utilizing the cross-domain sharing system for earth data resources to achieve cross-domain sharing of earth data resources, comprising:
[0053] Utilize the Earth Data Resource Directory Service to conduct structured analysis of Earth Data Resources from different sources and types, extract core metadata of Earth Data Resources, and establish a unified Earth Data Resource model using ontology technology. Through text data processing and cleaning, perform metadata extraction and semantic conversion on Earth Data Resources from different sources, and instantiate the Earth Data Resource model. Associate and integrate Earth Resource Data within each domain and across the entire domain to construct an Earth Data Resource Directory, and establish unique identifiers for data using data type, spatial range, spatial hierarchy, and time range.
[0054] Utilizing the cross-domain resource acquisition module, Earth data resources are dynamically located while balancing resources and efficiency. Efficient cross-domain acquisition of Earth data resources is achieved based on reverse proxy technology. Users' cross-domain acquisition behaviors are constrained through permission hierarchical control and risk behavior restrictions. Access attempts that exceed defined permissions are intercepted, and access restrictions are implemented for potentially risky acquisition behaviors, ensuring the security of cross-domain Earth data resource acquisition.
[0055] Leveraging a hybrid backup mechanism for Earth data resources, this approach comprehensively considers both acquisition efficiency and security during the backup process, providing a hybrid Earth data resource partitioning and replica migration strategy. The hybrid Earth data resource partitioning strategy incorporates a multi-node resource criticality partitioning scheme, with core critical resources and restricted access resources using local backup storage, and basic public data resources and open shared data using multi-node off-site master / slave replication. The replica migration strategy also incorporates a differentiated replica migration process based on data volume. Periodic incremental replicas are actively migrated across domains using a global directory service, while real-time differential replicas are passively migrated within a domain after cross-domain acquisition of Earth data resources is complete.
[0056] A computer device includes a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the cross-domain sharing system for earth data resources is implemented to realize cross-domain sharing of earth data resources.
[0057] A computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the cross-domain sharing system for earth data resources is implemented to realize cross-domain sharing of earth data resources.
[0058] Compared with the existing technology, the present invention has the following significant advantages: 1) by constructing an earth data resource directory, the effective integration and utilization of earth data resources can be achieved; 2) a dynamic resource positioning mechanism is provided to improve the efficiency of obtaining earth data resources, and controllable sharing is achieved by combining user permissions and behavioral risk analysis, thereby ensuring the security of cross-domain earth data resource acquisition; 3) based on the differences in the degree of openness and importance of data, a hybrid backup mechanism for earth data resources is adopted. When the information system of a certain domain suffers an accident and cannot provide data, it can still obtain data from other domains through a cross-domain agent, thereby ensuring high reliability of data acquisition; 4) based on the above means, the present invention solves the problem of cross-domain sharing of large-scale earth data resources, opens up the link between earth data resource acquisition and rapid application between different domains, and effectively improves the utilization efficiency of earth data resources. BRIEF DESCRIPTION OF THE DRAWINGS
[0059] Figure 1 It is the overall structural diagram of the cross-domain sharing system for earth data resources.
[0060] Figure 2 It is a structural diagram of the earth data resource model.
[0061] Figure 3 It is a flow chart of cross-domain earth data resource services.
[0062] Figure 4 It is a flowchart for cross-domain acquisition of earth data resources.
[0063] Figure 5 This is the differential copy migration flow chart. DETAILED DESCRIPTION
[0064] In order to make the purpose, technical solutions and advantages of this application more clear, the following further describes this application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application.
[0065] The present invention aims to solve the problem of sharing earth data resources across the entire region, integrates technologies such as earth data resource directory services, cross-domain earth data resource acquisition systems, and earth data resource hybrid backup mechanisms, and realizes earth data resource sharing by establishing a cross-regional coordination mechanism.
[0066] A cross-domain sharing system for earth data resources, the overall structure is as follows Figure 1 As shown, it includes earth data resource directory service, cross-domain resource acquisition system, and earth data resource hybrid backup mechanism.
[0067] 1. Earth Data Resource Catalog Service
[0068] The Earth Data Resource Catalog Service performs structured analysis of Earth data resources from various sources and types, extracting their core metadata and establishing a unified Earth Data Resource model using ontology technology. Through text data processing and cleansing, metadata is extracted and semantically converted from Earth data resources from various sources, instantiating the Earth Data Resource model. Earth resource data within each domain and globally are linked and integrated to construct an Earth Data Resource Catalog. Unique identifiers are established for data using information such as data type, spatial extent, spatial hierarchy, and temporal range.
[0069] The earth data resource directory service includes two parts: earth data resource model and cross-domain earth data resource service. The specific implementation steps are as follows:
[0070] (1) Earth Data Resource Model
[0071] The Earth data resource model is an abstract model of Earth data resources established using ontology technology. Through a structured approach, it comprehensively characterizes Earth data resources from the aspects of spatial dimension, temporal dimension, data quality dimension, attribute dimension, etc., which is conducive to the establishment of a unified Earth data resource directory for the entire domain. It conducts structured analysis on Earth data resources of different sources and types, extracts the core metadata of Earth data resources, and establishes a unified Earth data resource model using ontology technology. Through text information processing, cleaning and other operations, it extracts metadata from Earth data resources in different domains, completes the filling of the Earth data resource model, and constructs the Earth data resource directory. Specifically, it includes:
[0072] 1) Read the spatial coordinate system, time zone, etc. in the metadata to complete the extraction of spatiotemporal reference information;
[0073] 2) Read the origin, affine coefficients, etc. in the meta-information, calculate the spatial range, and complete the spatial information extraction;
[0074] 3) Read the time version information in the meta information and complete the time information extraction;
[0075] 4) Read the sensor identification, product level, reference system, projection parameters, band and other information in the meta-information to complete the extraction of other attribute information;
[0076] 5) Using the information extracted in 1)-4), fill in the attributes of the earth data resource model to complete the instantiation process of the earth data resource model.
[0077] (2) Cross-domain earth data resource services
[0078] Cross-domain earth data resource services establish a mapping relationship between the earth data resource model structure and the earth data resource directory at the attribute level, conduct similarity analysis on earth data resources in different domains, associate and aggregate earth data resources with high similarity, and build a unified global earth data resource directory; use the data type, spatial range, spatial hierarchy, time range, etc. of earth data resources to establish a unique identifier for earth data resources to ensure the uniqueness requirements of earth data resource discovery.
[0079] 2. Cross-domain resource acquisition system
[0080] The cross-domain resource acquisition system uses reverse proxy technology to implement the cross-domain earth data resource acquisition process. It dynamically locates earth data resources while balancing resources and efficiency, achieving efficient cross-domain acquisition of earth data resources. It constrains users' cross-domain acquisition behavior through two aspects: permission hierarchical control and risk behavior restrictions. It intercepts user acquisition that exceeds permission definitions and implements access restrictions for acquisition behaviors that pose potential risks, ensuring the security of cross-domain earth data resource acquisition.
[0081] The cross-domain resource acquisition system includes two parts: cross-domain earth data resource acquisition and resource acquisition hierarchical control. The cross-domain resource acquisition behavior of users is constrained from two aspects: permission hierarchical control and risk behavior restriction. The specific implementation steps are as follows:
[0082] (1) Cross-domain earth data resource acquisition
[0083] Cross-domain Earth data resource acquisition defines a cross-domain Earth data resource acquisition process, including user authentication. This process is illustrated using the example of a user in the current domain (Domain 2) acquiring Earth data resources from the target domain (Domain 1). User authentication is primarily accomplished through integration with an external user service (hereafter referred to as the unified user service).
[0084] 1) The terminal user of the current domain (domain 2) initiates a service acquisition request (carrying user token information) to the earth data resource service of the target domain (domain 1) through the cross-domain resource gateway;
[0085] 2) The Earth Data Resource Service of the target domain (Domain 1) requests the unified user service to verify the identity information;
[0086] 3) The user service of the target domain (domain 1) requests addressing from the earth data resource directory of the domain (domain 1) and obtains the addressing result;
[0087] 4) The unified user service of the target domain (domain 1) requests identity verification (token verification) from the unified user service of the entire domain via the cross-domain resource gateway;
[0088] 5) The unified user service of the entire domain verifies the identity information and performs authentication control based on the identity authority, and then returns the result to the unified user service of the target domain (domain 1) through the cross-domain resource gateway;
[0089] 6) After the target domain (domain 1) unified user service obtains the return result, it returns the authentication verification result to the target domain (domain 1) earth data resource service;
[0090] 7) If the verification is successful and the requested service is within the user's authorization scope, the target domain (domain 1) earth data resource service will release the earth data resource service business request and return the earth data resources to the current domain (domain 2) terminal through the cross-domain resource gateway; if the verification is unsuccessful or the requested service is not within the user's authorization scope, the target domain (domain 1) earth data resource service will refuse to provide resource acquisition services, and the terminal in the current domain (domain 2) will not be able to obtain earth data resources.
[0091] To meet the requirements of cross-domain earth data resource acquisition, including network resources and acquisition efficiency, a set of adjustable resource location strategies is defined. Effective acquisition resources are dynamically updated according to environmental conditions during the use of earth data resources, achieving dynamic location of earth data resources without user awareness. Resource location strategies include the Efficiency-first Access Strategy (EFS), the Stability-first Access Strategy (SFAS), the Multi-factor Balanced Strategy (MFBS), and the Access Locked Strategy to Special Resources (ALSSR). These strategies rank earth data resources based on a combination of custom resource acquisition evaluation indicators. A higher score indicates that the earth data resource is more consistent with the resource location strategy. These resource acquisition indicators include Normalized Distance (ND), Normalized Response Time (NRT), Success Rate (SR), Resource Cross-domain Status (RCDS), and Resource Load Index (RLI). The value range of RCDS is 0 and 1, that is, RCDS of data within the domain is 0, and RCDS of cross-domain data is 1; the value range of RLI is 0 to 1, that is, the greater the load, the closer RLI is to 1, otherwise the closer RLI is to 0. EFS is an efficiency score after evaluating indicators such as resource distance, resource acquisition response time, resource cross-domain status, and resource current load index. It can be specifically expressed as
[0092]
[0093] Among them, α is a constant ranging from 0 to 1. SFAS is the stability score after evaluating indicators such as resource acquisition success rate, resource cross-domain status, and resource current load index. It can be specifically expressed as
[0094] SFAS=(α+RCDS)RCDS·SR·RLI
[0095] MFBS is a balance score after evaluating indicators such as resource distance, resource acquisition success rate, resource acquisition response time, resource cross-domain status, and resource current load index. It is a balance between network bandwidth usage, acquisition reliability, and acquisition efficiency. It can be specifically expressed as
[0096]
[0097] ALSSR refers to the provision of services to specific users or clients for certain special earth data resources, which is achieved by binding them to user permissions. Other non-bound users cannot discover and use the earth data resources during cross-domain resource location.
[0098] (2) Hierarchical control of resource acquisition
[0099] Hierarchical resource access control for Earth data resources defines data access policies based on user roles and permissions, restricting users from accessing Earth data resources outside of their authorized scope. Resource access assessment results are calculated using three indicators: user role level, operational risk level, and Earth data resource criticality level. A 1 indicates access is permitted, while a 0 indicates access is denied. The User Role Level (UL) represents the level of a user's role and distinguishes between three categories: Resource Administrator (RA), Resource Producer (RP), and Resource User (RU). Possible role level values are 0.1, 0.5, and 0.9. The Operational Risk Level (ORL) represents the potential risk impact of a user's attempted resource access operation. Possible risk impact values are 0.1, 0.5, 0.8, and 0.9 for resource acquisition, resource update, resource edit, and resource deletion, respectively. The Resource Criticality Level (RCL) of Earth data resources is determined based on factors such as the spatial resolution, shooting time, and data quality of the Earth data resources. The higher the spatial resolution, the later the shooting time, and the higher the data quality, the higher the criticality level. It can be obtained by weighting the expert scores. Possible values are 0.25, 0.5, 0.75, and 1. The Resource Access Score (RAS) can be expressed as
[0100]
[0101] In addition, the hierarchical access control of earth data resources also includes calculating the User Access Risk Level (UARL) based on the user's access behavior. For users with a higher risk index, the level of data that can be obtained is reduced. When the user's access behavior is too frequent, intervention is carried out to reduce the user's access level, restricting the user to only access low-level public resources and not important resources or core resources. When calculating the User Access Risk Index, it is necessary to consider the User Access Frequency (UAF), the User Access Time (UAT), the Resource Level (RL), etc. The User Access Risk Index UARL corresponding to the i-th user i It can be expressed as
[0102]
[0103] Where N is the total number of earth data resources, M is the total number of earth data resources accessed by the i-th user, They represent the acquisition frequency, acquisition duration, and resource level of the mth earth data resource accessed by the i-th user.
[0104] 3. Hybrid Backup Mechanism for Earth Data Resources
[0105] The hybrid Earth data resource backup mechanism comprehensively considers acquisition efficiency and security factors during the Earth data resource backup process, adopting a hybrid Earth data resource partitioning and replica migration strategy. A multi-node resource criticality partitioning scheme is designed, with core critical resources and restricted access resources using local backup storage. Basic public data resources and open shared data provide multi-node off-site master-slave functionality. A differentiated replica migration process is designed to account for data volume. Periodic incremental replicas are actively migrated across domains via a global directory service, while real-time differential replicas are passively migrated within a domain after cross-domain acquisition of Earth data resources is completed.
[0106] (1) Resource criticality division strategy
[0107] Resource criticality division strategy: core key resources and restricted access resources use local backup storage, and data backup nodes are set up in this domain. Different acquisition methods are selected based on the criticality of earth data resources, node distance, and resource positioning strategy results. When acquiring core key resources, priority is given to acquiring local master node data. When the master node data acquisition is abnormal, switch to the data of the local backup node. Basic public data resources and open shared data adopt an off-site master-backup strategy, and set up data backup nodes in multiple different domains. When acquiring basic public data resources and open shared data, priority is given to acquiring local master node data. When the master node data acquisition is abnormal, data from backup nodes in other domains is acquired based on the cross-domain data service acquisition function. After selecting the node, the resource positioning strategy is adopted to select the most suitable earth data resource for access to provide efficient access.
[0108] (2) Differentiated copy migration process
[0109] First, the dynamic changes of the global earth data resource directory are detected at dynamic time intervals to extract incremental earth data resources, build incremental copies, and then synchronize the incremental copies to the backup node through the underlying data synchronization service to complete the periodic incremental copy migration process. Taking into account the characteristics of earth data resources such as frequent changes and large volume, the change detection time interval is dynamically adjusted according to the historical changes of earth data resources. For non-synchronized data within the change detection interval (difference data discovered in real time through cross-domain acquisition), the difference data should be cached to the backup node after the cross-domain acquisition is completed, and the real-time difference copy migration process should be completed through real-time caching of the difference data. The specific process is as follows Figure 5 As shown in the figure, the Resource Mean Change Detection Interval (RMCDI) is the dynamic result obtained by weighting the different earth data resource update intervals (RCDI) according to the key level within a certain period of time in the past. The RMCDI calculation method is:
[0110]
[0111] Among them, RCL i and RCDI i are the critical level and update interval of the i-th updated earth data resource, and M is the total number of updated earth data resources.
[0112] exist Figure 5In the periodic incremental copy migration, when new earth data resources are added to domain A (domain 1), the earth data resource directory is updated and the service is published to the earth service resource directory; the earth data resource directory of domain A (domain 1) automatically synchronizes the metadata of the newly added data directory to the earth data resource directory of domain B (domain 2) through the service gateway agent; the newly added entity data of domain A (domain 1) is synchronized to domain B (domain 2), and the entity data is stored in the domain B (domain 2) environment by calling the earth data resource directory service of domain B (domain 2), realizing incremental entity data synchronization; after data synchronization is completed, it is automatically published in the earth service resource directory of domain B (domain 2) to provide external service calls.
[0113] exist Figure 5 In the real-time differential copy migration, when the service user of domain B (domain 2) obtains the earth data resource service, it addresses it through the earth service resource directory and gives priority to obtaining the earth data resource service of this domain; in the case of missing data in domain B (domain 2), it automatically obtains the earth data resource service published across domains of domain A (domain 1) across domains, and automatically obtains the earth data resource service published across domains of domain A (domain 1) across domains through the service gateway proxy. Through the reverse proxy of the service gateway, the acquisition request is mapped to the earth data resource service of domain A (domain 1); the earth data resource obtained from domain A (domain 1) is returned and stored in the data cache pool of domain B (domain 2) through the earth data resource service of domain B (domain 2), so that it can quickly respond to the returned data when it is obtained next time.
[0114] The technical features of the above embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0115] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.
Claims
1. A cross-domain sharing system for earth data resources, characterized by: include: The Earth Data Resource Catalog Service is used to perform structured analysis on Earth data resources of different sources and types, extract core metadata of Earth data resources, and establish a unified Earth data resource model using ontology technology. Through text data processing and cleaning, metadata is extracted and semantically converted from Earth data resources of different sources, and the Earth data resource model is instantiated. Earth data resources within each domain and across the entire domain are associated and integrated to construct an Earth data resource catalog. Unique identifiers for data are established using data type, spatial range, spatial hierarchy, and time range. The cross-domain resource acquisition module is used to dynamically locate earth data resources while balancing resources and efficiency, and to achieve efficient cross-domain acquisition of earth data resources based on reverse proxy technology; Constrain users' cross-domain access behaviors from two aspects: permission hierarchical control and risk behavior restriction. Block users' access that exceeds the permission definition and implement access restrictions for access behaviors with potential risks to ensure the security of cross-domain access to earth data resources. A hybrid backup mechanism for Earth data resources comprehensively considers both efficiency and security factors during the backup process, providing a hybrid Earth data resource partitioning strategy and replica migration strategy. The hybrid Earth data resource partitioning strategy incorporates a multi-node resource criticality partitioning scheme, with core critical resources and restricted access resources using local backup storage, and basic public data resources and open shared data using multi-node off-site primary and secondary backup. The replica migration strategy design considers the differentiated replica migration process based on data volume. Periodic incremental replicas are actively migrated across domains through the global directory service, while real-time differential replicas are passively migrated within the domain after the cross-domain acquisition of earth data resources is completed. The cross-domain earth data resource acquisition module defines a set of adjustable resource positioning strategies. By combining resource acquisition evaluation indicators, it dynamically updates effective acquisition resources according to environmental conditions, completing user-imperceptible dynamic positioning of earth data resources. Resource location strategies include efficiency priority strategy (EFS), stability priority strategy, multi-factor balance strategy, and special resource acquisition locking strategy. Earth data resources are ranked based on the results of a set of customized resource acquisition evaluation indicators. The higher the score, the more consistent the earth data resource is with the resource location strategy. Resource acquisition evaluation indicators include normalized resource distance, normalized resource acquisition response time, resource acquisition success rate, resource cross-domain status, and resource current load index, expressed as ND, NRT, SR, RCDS, and RLI. The efficiency priority strategy is an efficiency score after evaluating resource distance, resource acquisition response time, resource cross-domain status, and resource current load index, which is expressed as Among them, α is a constant ranging from 0 to 1; The stability priority strategy is a stability score after evaluating the resource acquisition success rate, resource cross-domain status, and resource current load index, expressed as SFAS=(α+RCDS)RCDS·SR·RLI The multi-factor balancing strategy is a balance score after evaluating resource distance, resource acquisition success rate, resource acquisition response time, resource cross-domain status, and resource current load index, expressed as The special resource acquisition locking strategy means that some special earth data resources only provide services to specific users or clients, which is achieved by binding with user permissions. For other non-bound users, they cannot discover and use the earth data resources during cross-domain resource positioning.
2. The cross-domain sharing system for earth data resources according to claim 1, characterized in that: The Earth Data Resource Directory Service includes two parts: the Earth Data Resource Model and the Cross-Domain Resource Publishing Service. The Earth Data Resource Model conducts structured analysis on Earth Data Resources of different sources and types, extracts core metadata of Earth Data Resources, and establishes a unified model structure using ontology technology. Through text information processing and cleaning operations, metadata extraction and semantic conversion are performed on Earth Data Resources of different domains to complete the instantiation of the Earth Data Resource Model. Specifically, it includes: 1) Read the spatial coordinate system and time zone in the metadata to complete the extraction of spatiotemporal reference information; 2) Read the origin and affine coefficients in the meta-information, calculate the spatial range, and complete the spatial information extraction; 3) Read the time version information in the meta information and complete the time information extraction; 4) Read the sensor identification, product level, reference system, projection parameters, and band in the metadata to extract other attribute information; 5) Filling the earth data resource model with the information extracted in 1)-4) to complete the instantiation process of the earth data resource model; Cross-domain resource publishing services establish a mapping relationship between the earth data resource model structure and the earth data resource directory at the attribute level; perform similarity analysis on earth data resources in different domains, associate and aggregate earth data resources with high similarity, and build a unified global earth data resource directory; use the data type, spatial range, spatial hierarchy, and time range of earth data resources to establish a unique identifier for earth data resources to ensure the uniqueness requirements of earth data resource discovery, specifically including: Determine the contents of the Earth data resource catalog and complete attribute mapping. The Earth data resource catalog provides retrieval and description capabilities for Earth data resources across the entire domain and within each domain, including Earth data resource identification, resource registration time, resource coverage, resource product level, and source unit information. Attribute mapping is performed between the Earth data resource model structure and the Earth data resource catalog, mapping spatial information in the Earth data resource model to resource coverage in the Earth data resource catalog, mapping time information to resource registration time, and mapping product numbers to resource product levels. Using the spatial and attribute information of Earth data resources, data association is established to complete the aggregation of Earth data resources. The spatial and attribute associations between different Earth data resources registered in the Earth resource directory are calculated. Spatial association is the calculation of the spatial association between data from the perspective of spatial topology and spatial distance measurement. Attribute association is the calculation of the association of Earth data resources based on whether the attributes of different Earth data resources match and whether the attribute values are consistent. Earth data resources with high spatial and attribute associations are aggregated in the directory to provide unified resource acquisition capabilities. Establish a unique identifier for earth data resources by sequentially concatenating the type code, Hilbert curve code, maximum spatial level, time code, and 4-bit random code of the earth data resources to form the identifier of the earth data resources.
3. The cross-domain sharing system for earth data resources according to claim 1, characterized in that: The cross-domain resource acquisition system consists of two parts: the cross-domain earth data resource acquisition module and the resource acquisition hierarchical control module. The cross-domain earth data resource acquisition module defines a cross-domain earth data resource acquisition process including the user authentication process. The forwarding of inter-domain resource acquisition requests is implemented through the cross-domain resource gateway and the integration of external proxy services. The user authentication process is completed by integrating external unified user services. The process for users in the current domain to cross-domain obtain earth data resources in the target domain includes: 1) The current domain terminal user initiates a service acquisition request to the target domain earth data resource service through the cross-domain resource gateway, and the request carries the user token information; 2) The target domain earth data resource service requests the unified user service to verify the identity information; 3) The target domain user service requests addressing from the earth data resource directory of the domain and obtains the addressing result; 4) The target domain unified user service requests identity verification from the global unified user service via the cross-domain resource gateway; 5) The unified user service in the entire domain verifies the identity information and performs authentication control based on the identity permissions, and then returns the result to the unified user service in the target domain through the cross-domain resource gateway; 6) After receiving the return result, the target domain unified user service returns the authentication result to the target domain earth data resource service; 7) If the verification is successful and the requested service is within the user's authorized scope, the target domain earth data resource service will release the earth data resource service request and return the earth data resource to the current domain terminal via the cross-domain resource gateway; if the verification is unsuccessful or the requested service is not within the user's authorized scope, the target domain earth data resource service will refuse to provide resource acquisition services, and the current domain terminal will not be able to obtain earth data resources; The resource acquisition hierarchical control module defines data acquisition strategies that match the differences in user roles and permissions, restricting users from acquiring earth data resources outside their permissions. Specifically, the resource acquisition assessment results are calculated based on three indicators: user role level, operation risk level, and earth data resource criticality level. When the assessment result is 1, access is allowed, and when it is 0, access is not allowed. The user role level UL represents the level of the user's role, including three categories: earth data resource administrator, earth data resource producer, and earth data resource user, with values of 0.1, 0.5, and 0.9 respectively; the operation risk level ORL represents the risk impact of the resource acquisition operation attempted by the user, and the risk impact levels of resource acquisition, resource update, resource editing, and resource deletion are 0.1, 0.5, 0.8, and 0.9 respectively; the earth data resource criticality level RCL is determined based on the spatial resolution, shooting time, and data quality of the earth data resource. The higher the spatial resolution, the later the shooting time, and the higher the data quality, the higher the criticality level. It is obtained by weighting the expert scores and has values of 0.25, 0.5, 0.75, and 1; the resource acquisition assessment result is expressed as 4. The cross-domain sharing system for earth data resources according to claim 3, characterized in that: The resource acquisition classification control module also calculates the user acquisition risk index based on the user's acquisition behavior, and reduces the level of data available to users with higher risk indexes. The user acquisition risk index is calculated by considering the user's acquisition frequency, acquisition duration, and resource level. User acquisition risk index UARL corresponding to the i-th user i Expressed as Where N is the total number of earth data resources, M is the total number of earth data resources accessed by the i-th user, They represent the acquisition frequency, acquisition duration, and resource level of the mth earth data resource accessed by the i-th user.
5. The cross-domain sharing system for earth data resources according to claim 1 is characterized in that: The hybrid backup mechanism for Earth data resources includes a hybrid Earth data resource partitioning strategy and a replica migration strategy, where: A hybrid strategy for dividing earth data resources: core and key resources and restricted access resources use local backup storage, and data backup nodes are set up within the domain. When acquiring core and key resources, priority is given to obtaining data from the local master node. When data acquisition on the master node fails, data is switched to the data from the local backup node. Basic public data resources and open shared data use remote master-slave mode, and data backup nodes are set up in multiple domains. When acquiring basic public data resources and open shared data, priority is given to obtaining data from the local master node. When data acquisition on the master node fails, data from backup nodes in other domains is acquired based on the cross-domain data service acquisition function. The replica migration strategy first detects the dynamic changes of the global earth data resource directory at dynamic time intervals to extract incremental earth data resources, builds incremental replicas, and then synchronizes the incremental replicas to the backup nodes through the underlying data synchronization service to complete the periodic incremental replica migration process. For asynchronous data within the transformation detection interval, the differential data should be cached to the backup node after the cross-domain acquisition is completed, and the real-time differential replica migration process is completed through real-time caching of differential data.
6. The cross-domain sharing system for earth data resources according to claim 5, characterized in that: In the replica migration strategy, the detection interval RMCDI is a dynamic result obtained by weighting the update interval RCDI of different earth data resources by key level within a certain period of time in the past. The calculation method is: Among them, RCL i and RCDI i are the critical level and update interval of the i-th updated earth data resource, and M is the total number of updated earth data resources.
7. A cross-domain sharing method for earth data resources, characterized in that: The cross-domain sharing system for earth data resources according to any one of claims 1 to 6 is used to realize cross-domain sharing of earth data resources, including: Utilize the Earth Data Resource Directory Service to conduct structured analysis of Earth Data Resources from different sources and types, extract core metadata of Earth Data Resources, and establish a unified Earth Data Resource model using ontology technology. Through text data processing and cleaning, perform metadata extraction and semantic conversion on Earth Data Resources from different sources, and instantiate the Earth Data Resource model. Associate and integrate Earth Resource Data within each domain and across the entire domain to construct an Earth Data Resource Directory, and establish unique identifiers for data using data type, spatial range, spatial hierarchy, and time range. Utilizing the cross-domain resource acquisition module, Earth data resources are dynamically located while balancing resources and efficiency. Efficient cross-domain acquisition of Earth data resources is achieved based on reverse proxy technology. Users' cross-domain acquisition behaviors are constrained through permission hierarchical control and risk behavior restrictions. Access attempts that exceed defined permissions are intercepted, and access restrictions are implemented for potentially risky acquisition behaviors, ensuring the security of cross-domain Earth data resource acquisition. By utilizing the hybrid backup mechanism of earth data resources and comprehensively considering the acquisition efficiency and security factors in the earth data resource backup process, a hybrid earth data resource division strategy and replica migration strategy are provided. The hybrid earth data resource division strategy designs a multi-node resource criticality division scheme. Core key resources and restricted access resources use local backup storage, and basic public data resources and open shared data use multi-node off-site master-slave. The replica migration strategy design considers the differentiated replica migration process of data volume. Periodic incremental replicas are actively migrated across domains through the global directory service, and real-time differential replicas are passively migrated within the domain after the cross-domain acquisition of earth data resources is completed.
8. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the cross-domain sharing system for earth data resources according to claim 7 is implemented to realize cross-domain sharing of earth data resources.
9. A computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the cross-domain sharing system for earth data resources according to claim 7 is implemented to realize cross-domain sharing of earth data resources.
Citation Information
Patent Citations
Earth geographic information data sharing method
CN106202415A
Cross-domain access control method and system
CN106341428A