A GIS system and management method for integrating multi-source heterogeneous data

Abstract

The application discloses a GIS system integrated with multi-source heterogeneous data and a management method thereof, and relates to the technical field of geographic information systems.The system comprises a data service layer, a multi-source heterogeneous GIS platform and a business application system; a data resource library provides online or offline map data service data; the multi-source heterogeneous GIS platform is compatible with and integrated with loading of two-dimensional data, three-dimensional data, space-time data and business big data; a business application layer comprises application products or projects, and the business application layer calls the published data service to load and display, and carries out business application.The application can load two-dimensional data, three-dimensional data, space-time data and business big data, solves the problem that an ordinary GIS cannot simultaneously support all the problems, and cannot load business big data or cannot load business big data and causes lag or collapse.

Description

Technical Field

[0001] This invention relates to the field of Geographic Information System (GIS) technology, and in particular to a GIS system and management method that integrates multi-source heterogeneous data. Background Technology

[0002] With the development of science and technology and society, GIS (Geographic Information Science) systems are being used more and more frequently in various fields such as smart towns and streets, smart investment promotion, smart government affairs, smart water management, smart lighting, smart urban management, and grassroots social governance. GIS can display the location of basic and business data, perform information statistics, conduct geographic analysis, and support decision-making. It also provides real-time display, regional statistics, analysis, and trend judgment of real-time business operation information. The combined use of business systems and GIS has significantly improved the way two-dimensional data, three-dimensional data, spatiotemporal data, and big data from different business applications are presented, while increasing efficiency and reducing management costs.

[0003] The existing business systems still have the following problems in displaying basic geographic data, dynamic data, basic business data, and real-time business data in GIS:

[0004] 1. Geographic data includes two-dimensional, three-dimensional, and four-dimensional (three-dimensional + time) data. The data sources and types are complex, and the formats and structures are different. Ordinary GIS software can generally only load one or two types of data, such as two-dimensional, three-dimensional, and four-dimensional (three-dimensional + time) data. It cannot support all of them at the same time, and it can only support a limited amount of business big data. This makes ordinary GIS software powerless in deeper business applications, and its existing functions cannot even meet actual needs. As the business application fields expand and deepen, the limitations of ordinary GIS software become increasingly prominent.

[0005] 2. Business data has spatiotemporal characteristics and needs to be dynamically displayed in a GIS system. However, ordinary GIS systems cannot display spatiotemporal big data, or they often lag or crash when displaying spatiotemporal big data, which cannot meet the needs of business applications or provide a poor user experience. Summary of the Invention

[0006] This invention provides a GIS system management method for integrating multi-source heterogeneous data, comprising:

[0007] Build a GIS system that integrates multi-source heterogeneous data, including a data service layer, a multi-source heterogeneous GIS platform, and a business application system;

[0008] The data service layer is used to collect large amounts of dynamically changing spatiotemporal big data.

[0009] The multi-source heterogeneous GIS platform splits spatiotemporal big data according to the attributes of geospatial objects, packages the resulting geospatial object attributes into CZML packages, and the packages are relatively independent of each other and are stored in parallel.

[0010] The business application layer controls the number of CZML packets sent to different clients based on their processing capabilities.

[0011] The client triggers a corresponding event each time it receives a CZML packet.

[0012] The above-described method for managing a GIS system that integrates multi-source heterogeneous data includes spatiotemporal big data, which comprises two-dimensional data, three-dimensional data, spatiotemporal data, and business big data.

[0013] The above-described method for managing a GIS system that integrates multi-source heterogeneous data involves packaging the CZML attributes of different geospatial objects into one or more CZML packages of appropriate data volume.

[0014] In the GIS system management method for integrating multi-source heterogeneous data as described above, the client triggers corresponding events according to the priority carried in the CZML packet or according to the order in which the CZML packets are received.

[0015] The present invention also provides a GIS system integrating multi-source heterogeneous data, comprising: a data service layer, a multi-source heterogeneous GIS platform, and a business application system;

[0016] The data resource library provides online or offline map data services;

[0017] A multi-source heterogeneous GIS platform that is compatible with and can integrate and load two-dimensional data, three-dimensional data, spatiotemporal data, and business big data;

[0018] The business application layer includes application products or projects. The business application layer calls the published data services for loading, display, and business applications.

[0019] The GIS system that integrates multi-source heterogeneous data as described above includes map data service data such as elevation data, image data, vector data, oblique photogrammetry data, artificial model data, BIM data, and point cloud data.

[0020] As described above, a GIS system integrating multi-source heterogeneous data includes the following: elevation data (DEM, TIF) is converted to terrain tile .TERRAIN format data; image data (PNG, JPEG, TIF) is converted to image tile .PNG; vector data (.shp) points, lines, and polygons are converted to GEOJSON format data; vector data (.shp) points are converted to I3DM format data; vector data (.shp) polygons are converted to B3DM format data; model data and BIM data are converted to B3DM format data; and data contained in point cloud data is converted to PNTS format data.

[0021] The GIS system integrating multi-source heterogeneous data as described above is logically divided into a security layer, a common layer, a display layer, an interaction layer, and a service layer.

[0022] Security layer: Used to set up a unified framework encapsulation interface layer, enabling encapsulated calls to different map interfaces;

[0023] Common layer: Includes configurations or modules for common functions, such as general configuration, initialization module, general module, coordinate transformation module;

[0024] Presentation layer: Used for visualization, specifically including map module, control module, annotation module, information window module and layer module, using CZML for spatiotemporal data organization and transmission;

[0025] Interaction layer: This layer consists of interactive functional modules, specifically including event modules, menu modules, measurement modules, and positioning modules.

[0026] Service Layer: Functional modules used to request data from the map service layer and display it, including route planning, search services, and cloud service modules.

[0027] The beneficial effects achieved by this invention are as follows: This invention can integrate and load two-dimensional data, three-dimensional data, spatiotemporal data and business big data, solving the problem that ordinary GIS cannot support all of them at the same time, as well as the problems of not being able to load business big data or experiencing lag and crashes when loading business big data. Attached Figure Description

[0028] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For those skilled in the art, other drawings can be obtained based on these drawings.

[0029] Figure 1 This is a flowchart of a management method for a GIS system that generates multi-source heterogeneous data, provided in Embodiment 1 of the present invention.

[0030] Figure 2 This is a schematic diagram of a GIS system that generates multi-source heterogeneous data. Detailed Implementation

[0031] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0032] Example 1

[0033] like Figure 1 As shown, Embodiment 1 of the present invention provides a management method for a GIS system integrating multi-source heterogeneous data, comprising:

[0034] Step 110: Build a GIS system that integrates multi-source heterogeneous data, including a data service layer, a multi-source heterogeneous GIS platform, and a business application system.

[0035] like Figure 2 As shown, the GIS system provided in this application embodiment includes a data service layer, a multi-source heterogeneous GIS platform, and a business application system, wherein...

[0036] (1) The data service layer provides online or offline map data services, including two-dimensional data, three-dimensional data and spatiotemporal data, specifically including elevation data (dem, tif), image data (jpeg, tif), vector data (shp), oblique photogrammetry data (osgb), artificial model data (fbx, obj, dae, 3ds, gltf), BIM data (ifc, clm), point cloud data (las, cvs) and other data; or provides back-end services such as spatial editing and analysis based on PostGIS.

[0037] Specifically, elevation data (DEM, TIF) is converted to terrain tile (.TERRAIN) format; image data (PNG, JPEG, TIF) is converted to image tile (.PNG); vector data (.shp) points, lines, and polygons can be converted to GEOJSON format; vector data (.shp points) can be converted to I3DM format; vector data (.shp polygons) can be converted to B3DM format; model data and BIM data can be converted to B3DM format; and point cloud data can be converted to PNTS format. Then, data organization and service publishing are performed. The coordinate-system-consistent data is organized and placed in folders or a database, and then published as a data service through a web server.

[0038] (2) A multi-source heterogeneous GIS platform that can integrate and load multi-dimensional data such as two-dimensional data, three-dimensional data, and spatiotemporal data (i.e., four-dimensional data, spatial three-dimensional data plus time dimension). Logically, it is divided into a security layer, a public layer, a presentation layer, an interaction layer, and a service layer. Modules with similar functions will be grouped into the same layer.

[0039] Security layer: Used to set up a unified framework encapsulation interface layer, which can realize the encapsulation and calling of different map interfaces.

[0040] Common layer: Includes configurations or modules for common functions, such as general configuration (used to store map-related configuration parameters, such as URL, KEY, etc.), initial module, general module (general services such as script loading, AJAX requests, etc.), coordinate transformation module, etc.

[0041] Presentation layer: Used for visualization, specifically including map module, control module, annotation module, information window module and layer module. It uses CZML for the organization and transmission of spatiotemporal data. CZML is a JSON-based language used to describe dynamic scenes and can be used to display 3D GIS in a browser.

[0042] Interaction Layer: This layer consists of interactive functional modules, including event (map, marker) module, menu module, measurement module, and positioning module.

[0043] Service layer: This mainly includes functional modules that need to request data from the map service layer and display it, such as route planning, search services, and cloud service modules.

[0044] (3) The business application layer includes application products or projects, such as smart investment promotion, smart towns and streets, and grassroots governance. The business application layer calls the published data services for loading, display, and business application.

[0045] Step 120: Collect a large amount of dynamically changing spatiotemporal big data using the data service layer;

[0046] Spatiotemporal big data includes, but is not limited to, two-dimensional data, three-dimensional data, spatiotemporal data (i.e., four-dimensional and above data), and business big data.

[0047] Step 130: The multi-source heterogeneous GIS platform splits spatiotemporal big data according to the attributes of geospatial objects, packages the split geospatial object attributes into CZML packages, and the packages are relatively independent of each other and are stored in parallel.

[0048] The aforementioned spatiotemporal big data are all Earth spatial objects that change dynamically over time. Their spatial location and other attributes also change over time, and the amount of data collected and recorded by the data service layer increases accordingly. Therefore, how to transmit this gradually increasing Earth spatial information to the front-end 3D digital earth platform and display it in real time or near real time has always been a problem faced by the 3D digital earth platform in expressing and analyzing Earth spatial information.

[0049] Considering that these spatiotemporal big data have common Earth space object attributes, this embodiment packages the CZML attributes of different Earth space objects into one or more CZML packages of appropriate data size. The packages are relatively independent of each other and are stored in a parallel manner.

[0050] Step 140: The business application layer controls the number of CZML packets sent to different clients according to their processing capabilities;

[0051] Different client applications include smart investment promotion platforms, smart town / street platforms, and grassroots governance platforms; specifically, the processing capacity of each client application is calculated using the following formula:

[0052] ;

[0053] in, This indicates the client's processing capability for CZML packets; This represents the frequency of use of the i-th virtual machine in the client, where i ranges from 1 to N, and N is the total number of virtual machines in the client. This represents the total amount of data for the task corresponding to the i-th virtual machine; This represents the data processing rate of the i-th virtual machine; This represents the data processing completion time for the task corresponding to the i-th virtual machine; This represents the time it takes for the i-th virtual machine to process other tasks while handling its corresponding task.

[0054] After calculating the processing capabilities of different clients, the number of CZML packets to be distributed to different clients is calculated according to the proportion of their processing capabilities, and it is estimated that... Send the next CZML packet group at time point / 2.

[0055] Step 150: The client triggers a corresponding event for each CZML packet it receives;

[0056] After sending a CZML packet group to the client, the CZML packet group contains at least one CZML packet. The client triggers corresponding events according to the priority carried by the CZML packet or according to the order in which the CZML packets are received, such as triggering the client to display a map.

[0057] Example 2

[0058] Embodiment 2 of the present invention provides a GIS system integrating multi-source heterogeneous data, including: a data service layer, a multi-source heterogeneous GIS platform, and a business application system; the data resource library provides online or offline map data services; the multi-source heterogeneous GIS platform is compatible with and can integrate and load two-dimensional data, three-dimensional data, spatiotemporal data, and business big data; the business application layer includes application products or projects, and the business application layer calls the published data services for loading, display, and business applications.

[0059] Specifically, a GIS system integrating multi-source heterogeneous data includes a system building module, a spatiotemporal big data acquisition module, a spatiotemporal big data splitting and packaging module, and a data distribution control module;

[0060] The system building module is used to build a GIS system that integrates multi-source heterogeneous data, including a data service layer, a multi-source heterogeneous GIS platform, and a business application system;

[0061] The spatiotemporal big data acquisition module is used to collect a large amount of dynamically changing spatiotemporal big data using the data service layer; spatiotemporal big data includes two-dimensional data, three-dimensional data, spatiotemporal data, and business big data.

[0062] The spatiotemporal big data splitting and packaging module is used to split spatiotemporal big data according to the attributes of Earth spatial objects, and package the split Earth spatial object attributes into CZML packages. The packages are relatively independent and are stored in parallel. Specifically, the CZML attributes of different Earth spatial objects are packaged into one or more CZML packages of appropriate data size.

[0063] The data distribution control module is used to control the number of CZML packets distributed to different clients according to their processing capabilities.

[0064] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of the present invention. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc., made on the basis of the technical solution of the present invention should be included within the scope of protection of the present invention.

Claims

1. A GIS system management method for integrating multi-source heterogeneous data, characterized in that, Comprise: Build a GIS system integrating multi-source heterogeneous data, including a data service layer, a multi-source heterogeneous GIS platform, and a business application system; The data service layer provides online or offline map data service data, wherein the map data service data includes elevation data, image data, vector data, oblique photography data, artificial model data, BIM data, and point cloud data; The elevation data DEM and TIF are converted into terrain slice TERRAIN format data, the image data PNG, JPEG, and TIF are converted into image slice PNG, the vector data shp points, lines, and surfaces are converted into GEOJSON format data, the vector data shp points are converted into I3DM format data, the vector data shp surfaces are converted into B3DM format data, the model data and BIM data are converted into B3DM format data, and the data contained in the point cloud data is converted into PNTS format data; A large amount of dynamically changing spatio-temporal big data is collected using the data service layer; The multi-source heterogeneous GIS platform splits the spatio-temporal big data according to the attributes of earth space objects, packages the attributes of the earth space objects obtained by splitting into CZML packages, the packages are relatively independent from each other, and a parallel storage is adopted; The business application layer controls the number of CZML packages issued to different clients according to the processing capacity of the different clients; The processing capacity of the client is calculated using the following formula: ； wherein, represents a processing capability value of the client to the CZML package; represents a frequency value of the i-th virtual machine in the client, i is valued from 1 to N, and N is the total number of virtual machines in the client; represents the total amount of data of the task corresponding to the i-th virtual machine; represents the data processing rate of the i-th virtual machine; represents the data processing completion time length of the task corresponding to the i-th virtual machine; represents the time length of the i-th virtual machine in processing other tasks in the process of processing the corresponding task. The client triggers a corresponding event for each CZML package received; wherein the client triggers the corresponding event according to the priority carried by the CZML package or according to the order in which the CZML package is received.

2. The GIS system management method of claim 1, wherein, The spatio-temporal big data includes two-dimensional data, three-dimensional data, spatio-temporal data, and business big data.

3. The method of claim 1, wherein the GIS system management method integrates multi-source heterogeneous data. The CZML attributes of different earth space objects are packaged into one or more CZML packages with moderate data volume.

4. A GIS system integrating multi-source heterogeneous data, characterized in that, Comprise: A data service layer, a multi-source heterogeneous GIS platform, and a business application system; The data resource library provides online or offline map data service data; wherein the map data service data includes elevation data, image data, vector data, oblique photography data, artificial model data, BIM data, and point cloud data; The elevation data DEM and TIF are converted into terrain slice TERRAIN format data, the image data PNG, JPEG, and TIF are converted into image slice PNG, the vector data shp points, lines, and surfaces are converted into GEOJSON format data, the vector data shp points are converted into I3DM format data, the vector data shp surfaces are converted into B3DM format data, the model data and BIM data are converted into B3DM format data, and the data contained in the point cloud data is converted into PNTS format data; The multi-source heterogeneous GIS platform is compatible and integrated to load two-dimensional data, three-dimensional data, spatio-temporal data, and business big data; The business application layer includes application products or projects, and the business application layer calls the published data service for loading and display, business application; The business application layer controls the number of CZML packages issued to different clients according to the processing capacity of the different clients; The processing capacity of the client is calculated using the following formula: ； wherein, represents a processing capability value of the client to the CZML package; represents a frequency value of the i-th virtual machine in the client, i is valued from 1 to N, and N is the total number of virtual machines in the client; represents the total amount of data of the task corresponding to the i-th virtual machine; represents the data processing rate of the i-th virtual machine; represents the data processing completion time length of the task corresponding to the i-th virtual machine; represents the time length of the i-th virtual machine in processing other tasks in the process of processing the corresponding task.

5. The GIS system of claim 4, wherein, The multi-source heterogeneous GIS platform is logically divided into a security layer, a public layer, a display layer, an interaction layer, and a service layer; Security layer: used to set up a uniform framework encapsulation interface layer, which can realize the encapsulation call of different map interfaces; Public layer: including the configuration or module of public functions, such as general configuration, initial module, general module, coordinate conversion module; Display layer: used for visual display, specifically including map module, control module, annotation module, information window module and layer module, using CZML for spatio-temporal data organization and transmission; Interactive layer: a functional module for interactive functions, specifically including event module, menu module, measurement module and positioning module; Service layer: a functional module for requesting data from the map service layer and displaying, including path planning, search service, cloud service module.

Images