Geographic Information System and Visualization Method Based on Modern Graphics and Image Technology

Through the geographic information system based on modern graphic image technology, the problem that the existing system is difficult to access traditional data in the ground mining industry has been solved, fast and efficient data processing and display have been achieved, and production efficiency and user freedom have been improved.

CN116993935BActive Publication Date: 2025-09-19TIBET JULONG COPPER CO LTD +1
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202310807170.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-06-30
Publication Date
2025-09-19
Estimated Expiration
2043-06-30

AI Technical Summary

Technical Problem

The existing geographic information system is difficult to directly connect with the traditional two-dimensional vector data and three-dimensional system data accumulated by the mining industry over the years, resulting in low production efficiency.

Method used

Using a geographic information system based on modern graphics and image technology, the user interface subsystem receives asset information. The core subsystem calls the script module to process the assets and sends the processed assets to the 3D visualization subsystem for display. The subsystems communicate through message queues and files.

Benefits of technology

It achieves fast and efficient data connection in the geological and mining industries, reduces the complexity of developers' work, and improves users' data processing freedom and system application flexibility.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116993935B_ABST
    Figure CN116993935B_ABST
Patent Text Reader

Abstract

The present invention discloses a geographic information system and visualization method based on modern graphics and image technology, belonging to the field of geographic information technology. The system includes: a user interface subsystem for receiving asset information and related parameters sent by users, where the asset information includes external asset location information or internal asset identification information; a core subsystem for calling the corresponding script file of the script module based on the asset information and related parameters to perform asset processing, and sending the processed assets to the three-dimensional visualization subsystem, where the processing includes asset baking and asset transformation; and a three-dimensional visualization subsystem for generating models and texture files based on the processed asset files and performing three-dimensional display. The system decouples the data itself from the visualization, allowing the systems responsible for visualization and the data itself to be developed independently. As long as the core subsystem meets the specifications of the visualization subsystem after "baking", correct visualization can be performed, reducing the complexity of the developer's work.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of geographic information technology, and in particular to a geographic information system and a visualization method based on modern graphic image technology. Background Art

[0002] A geographic information system (GIS) is a system used to depict the Earth and other geographic features, highlighting their characteristics and displaying and analyzing spatially registered information. This is typically performed primarily with the help of maps. Currently, there are numerous GIS systems, including: everyday mobile map applications such as Google Maps, Amap, and Baidu Maps; general-purpose professional software not targeted at specific industries, such as ArcGIS, SuperMap, and MapGIS; specialized software for specific industries, such as MicroMine, SURPAC, LeapFrog, 3DMine, and DIMINE for the geological and mining industries; and ENVI for remote sensing data analysis.

[0003] Currently, there are a number of 3D information systems specifically designed for the geology and mining industry. These systems typically have limited functionality overlap with 2D geographic information systems, focusing on describing the morphological characteristics of ore bodies and related geological structures in three dimensions. These systems typically use a fixed rendering pipeline for 3D rendering, simply rendering a triangular model to the screen with specific colors or textures.

[0004] However, over the past few decades, the geological and mining industry has accumulated a large amount of data based on traditional two-dimensional vector geographic information systems and three-dimensional systems based on traditional fixed pipelines. The existing systems are unable to directly connect this data to modern three-dimensional geographic information systems represented by various digital twin systems. Instead, developers need to spend a lot of effort to achieve this, which greatly limits the improvement of production efficiency in the geological and mining industry. Summary of the Invention

[0005] The main purpose of this invention is to quickly, efficiently and intuitively connect the geological and mining information data accumulated by the geological and mining industry over the years to the modern three-dimensional geographic information system represented by various digital twin systems.

[0006] The present invention provides a geographic information system based on modern graphic image technology, comprising: a user interface subsystem for receiving asset information and related parameters of assets to be displayed sent by a user, wherein the asset information includes location information of external assets or identification information of internal assets, wherein the assets are geographic information data files that can be processed and visualized as an independent whole; a core subsystem for calling corresponding script files of a script module to perform asset processing based on the asset information and the related parameters, and sending the processed assets to a three-dimensional visualization subsystem, wherein the asset processing includes asset baking and transforming the assets according to the related parameters, and the script module encapsulates multiple asset processing script files; a three-dimensional visualization subsystem for generating model and texture files based on the processed asset files in combination with an existing three-dimensional earth model, and performing three-dimensional display based on the model and texture files; wherein each subsystem communicates with each other through message queues and files.

[0007] In the geographic information system based on modern graphic image technology of the present invention, the core subsystem includes an asset management module, a layer management module, a data processing module and a script module; the asset management module is used for asset maintenance, and the asset maintenance includes providing an asset import interface to the outside and providing an asset access interface to other modules or subsystems; the layer management module is used to set the visualization parameters of the asset in combination with the relevant parameters, and send the visualization parameters to the three-dimensional visualization subsystem, so that the three-dimensional visualization subsystem can perform visualization on the asset according to the visualization parameters; the data processing module is used to provide a script execution interface, and send the assets to be processed and related parameters corresponding to the asset information to the script module; the script module is used to call the corresponding script to perform asset processing on the assets to be processed according to the relevant parameters.

[0008] In the geographic information system based on modern graphic image technology of the present invention, the layer management module is also used to determine each layer and corresponding layer information based on asset information and related parameters; wherein the layer information includes all asset information bound to the layer and visualization parameters of each layer.

[0009] In the geographic information system based on modern graphic image technology of the present invention, the layer management module is also used to provide the three-dimensional visualization subsystem with a layer enumeration interface and a layer binding interface, so that the three-dimensional visualization subsystem can generate models and texture files and perform three-dimensional display according to the layer enumeration interface and the layer binding interface; the layer enumeration interface is used to list the file paths and layer parameters of all layer-processed assets; and the layer binding interface is used to bind the processed assets to a specified layer.

[0010] In the geographic information system based on modern graphic image technology of the present invention, the three-dimensional visualization subsystem includes a digital earth module and a layer interpretation module; the digital earth module is used to provide a three-dimensional earth model and integrate the processed assets with the three-dimensional earth model for display; the layer interpretation module is used to convert various parameters in the layer into a data format that can be recognized by the three-dimensional visualization subsystem.

[0011] In the geographic information system based on modern graphic image technology of the present invention, the asset management module is specifically used to provide an asset enumeration interface, an asset import interface and an asset baking interface; the asset enumeration interface is used to list the paths and description information of all assets; the asset import interface is used to call the script module to convert external geological and mining information data files into assets; the asset baking interface is used to call the script module to convert asset files into temporary files recognized and rendered by the three-dimensional visualization subsystem.

[0012] In the geographic information system based on modern graphic image technology of the present invention, the script module is a Python module based on Python language.

[0013] In the geographic information system based on modern graphic image technology of the present invention, each subsystem communicates with each other through message queues and files.

[0014] In the geographic information system based on modern graphic image technology of the present invention, the types of assets include tables and images.

[0015] The present invention also provides a geographic information system visualization method based on modern graphic image technology, including: receiving asset information and related parameters of assets to be displayed sent by users, the asset information including location information of external assets, or identification information of internal assets, wherein the assets are geographic information data files that can be processed and visualized as an independent whole; according to the asset information and the related parameters, calling the corresponding script file pre-encapsulated in the script module to perform asset processing, wherein the asset processing includes asset baking and transforming the assets according to the related parameters; according to the processed asset file, combined with the existing three-dimensional earth model, generating a model and a texture file, and performing three-dimensional display based on the model and texture file.

[0016] The beneficial effects of this invention are: it organically combines the data processing capabilities of scripting languages ​​with the data representation capabilities of a three-dimensional digital globe, decoupling data from visualization. The visualization subsystem responsible for visualization and the core subsystem responsible for the data itself can be developed independently. As long as the core subsystem conforms to the specifications of the visualization subsystem after "baking," correct visualization can be achieved, reducing the complexity of the developer's work. Users can customize data processing flows using scripting languages ​​without having to understand the system's internal operating principles or study complex API documentation. By simply "baking" the processed data into a format interpretable by the visualization subsystem through scripting languages, customized data display methods can be implemented. This greatly increases the flexibility of system applications and provides users in the geological and mining industries with greater data processing freedom. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following is a brief introduction to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0018] Figure 1 This is one of the structural diagrams of a geographic information system based on modern graphic image technology according to an embodiment of the present invention;

[0019] Figure 2 This is a schematic diagram of asset baking according to an embodiment of the present invention;

[0020] Figure 3 This is a schematic diagram of asset transformation according to an embodiment of the present invention;

[0021] Figure 4 This is the second structural diagram of the geographic information system based on modern graphic image technology according to an embodiment of the present invention.

[0022] Figure 5 is a schematic diagram of the image content of an asset according to an embodiment of the present invention;

[0023] Figure 6 is a schematic diagram of an image file after baking according to an embodiment of the present invention;

[0024] Figure 7 This is one of the schematic diagrams of the layer overlay display on the digital globe according to an embodiment of the present invention;

[0025] Figure 8 This is the second schematic diagram of layers superimposed and displayed on a digital globe according to an embodiment of the present invention;

[0026] Figure 9This is a schematic diagram of a partial page of a user interface subsystem according to an embodiment of the present invention;

[0027] Figure 10 This is an asset preview of the Cu element intensity map of an embodiment of the present invention;

[0028] Figure 11 This is one of the schematic diagrams of the Cu element intensity map superimposed and displayed on the digital globe according to an embodiment of the present invention;

[0029] Figure 12 This is the second schematic diagram of the Cu element intensity map superimposed and displayed on the digital globe according to an embodiment of the present invention. DETAILED DESCRIPTION

[0030] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0031] The following combination Figures 1 to 12 The present invention describes a geographic information system and a visualization method based on modern graphics and image technology. Figure 1 This is one of the structural diagrams of the geographic information system based on modern graphic image technology according to an embodiment of the present invention. Figure 1 As shown, the present invention provides a geographic information system based on modern graphic image technology, comprising:

[0032] The user interface subsystem 10 is used to receive asset information and related parameters of the assets to be displayed sent by the user, wherein the asset information includes the location information of external assets or the identification information of internal assets, wherein the assets are geographic information data files that can be processed and visualized as an independent whole; the core subsystem 20 is used to call the corresponding script file of the script module to perform asset processing based on the asset information and the related parameters, and send the processed assets to the three-dimensional visualization subsystem, wherein the asset processing includes asset baking and transforming the assets according to the related parameters; the three-dimensional visualization subsystem 30 generates models and texture files based on the processed asset files, and performs three-dimensional display based on the models and texture files.

[0033] Specifically, the user interface subsystem 10 is responsible for displaying the main graphical user interface and receiving user input, equivalent to the view and controller in the MVC architecture. It reflects all aspects of the project information stored in the core subsystem 20. User input in this subsystem is also converted into message instructions and sent to the 3D visualization subsystem 30 or the core subsystem 20.

[0034] An asset refers to one or a group of files that can be processed and visualized as an independent entity, including but not limited to geological and mining information data files. An asset contains at least the following elements: 1. Asset file, which is one or a group of files; 2. Asset description, which is a description of the asset file recorded in the form of key-value pairs.

[0035] An asset can be both the starting point and the endpoint of data processing and visualization. Data can be directly input by the user or obtained by processing other assets. For example, if a user inputs a data table as an asset, then interpolating this data table to create an interpolated image is also an asset.

[0036] Figure 2 This is a schematic diagram of asset baking according to an embodiment of the present invention. Figure 3 Schematic diagram of asset transformation according to an embodiment of the present invention. Figure 2 and 3 As shown, the core subsystem 20 calls the corresponding script files of the script module to perform asset baking and asset transformation processing. Among them, the asset description includes asset attributes.

[0037] Core subsystem 20 is responsible for asset management. It lacks a user interface and does not directly accept user input. It preferably communicates with user interface subsystem 10 and 3D visualization subsystem 30 via message queues and files. Core subsystem 20 receives user commands from user interface subsystem 10 and generates data model files based on these commands for display by 3D visualization subsystem 30.

[0038] The 3D visualization subsystem 30 may be constructed based on a third-party 3D graphics engine and is responsible for the visualization of various assets in 3D space.

[0039] Furthermore, each subsystem communicates with each other via message queues and files. The subsystems of the present invention are loosely coupled, meaning there are no direct ABI calls, but rather communication via message queues and files. Therefore, the system facilitates network-based distributed deployment, allowing different subsystems to be deployed on different computers, thus providing users with access via cloud services and enabling distributed operation of the system.

[0040] For example, the user interface subsystem 10 sends asset information and related parameters to the core subsystem 20 through the message queue. The assets processed by the core subsystem 20 are sent to the 3D visualization subsystem 30 through the message queue and file format.

[0041] The present invention's geographic information system, based on modern graphics and image technology, organically combines the data processing capabilities of scripting languages ​​with the data expression capabilities of a three-dimensional digital globe, decoupling data from visualization. Simultaneously, each subsystem communicates with each other via message queues and files, allowing the visualization subsystem responsible for visualization and the core subsystem responsible for the data itself to be independently developed. As long as the core subsystem conforms to the visualization subsystem's specifications after "baking," correct visualization can be performed, reducing the complexity of the developer's work. Users can customize data processing flows using scripting languages ​​without having to understand the system's internal operating principles or study complex API documentation. By simply "baking" the processed data into a format interpretable by the visualization subsystem using scripting languages, they can implement customized data display methods. This greatly increases the flexibility of system applications and provides users in the geological and mining industries with greater freedom in data processing.

[0042] In addition, since the system fully decouples each subsystem, it can be implemented on a single computer, or different systems can be deployed on different computers (such as data processing deployed on a powerful server, while visualization and interface deployed on a client with slightly weaker performance) to achieve distributed operation.

[0043] In one embodiment, the script module is a Python module based on the Python language.

[0044] In addition to advances in rendering technology, data processing methods have also undergone significant changes over the past decade. Python has become the most popular data processing language in scientific research and engineering. Because Python is easy to learn, even ordinary researchers can use it to develop their own data processing workflows. Traditional mining software algorithms are almost always written in languages ​​like C / C++, allowing users to perform limited customization by passing parameters to provided methods through user interfaces or APIs. However, due to the high barrier to entry for C / C++, most users are unable to develop truly customized data processing methods based on the existing software functionality. However, with the popularity of Python, popular data processing tools across nearly every industry now have corresponding Python module packages, such as OpenCV and GDAL. Python modules are the core for implementing various data processing logic. These modules execute Python scripts within a process by calling the Python C API. Through these modules, the system establishes connections with various Python modules, enabling the system to directly call modules such as OpenCV, NumPy, GDAL, and Pandas to perform complex calculations. The asset management module relies on Python modules for asset baking. The data processing module relies on Python modules for asset transformation.

[0045] Therefore, in the embodiment of the present invention, the script module uses the Python module based on the Python language, which can bring higher convenience.

[0046] In one embodiment, the core subsystem 20 includes: an asset management module 201, a layer management module 202, a data processing module 203 and a script module 204; the asset management module 201 is used for asset maintenance, and the asset maintenance includes providing an asset import interface to the outside and providing an asset access interface to other modules or subsystems; the layer management module 202 is used to set the visualization parameters of the asset in combination with the relevant parameters, and send the visualization parameters to the three-dimensional visualization subsystem, so that the three-dimensional visualization subsystem can perform visualization on the asset according to the visualization parameters; the data processing module is used to provide a script execution interface, and send the asset to be processed and related parameters corresponding to the asset information to the script module; the script module is used to call the corresponding script to perform asset processing on the asset to be processed according to the relevant parameters.

[0047] Figure 4 This is the second structural diagram of the geographic information system based on modern graphic image technology according to the embodiment of the present invention. Figure 4 As shown, considering that the script module is preferably a Python module, Figure 4 The Python module replaces the script module. Specifically, the core subsystem 20, comprising four submodules, is the most critical component of the entire system and a key embodiment of its flexibility. These four submodules decouple the different stages of the data processing and visualization process, using different data structures for storage at each stage to maximize processing efficiency. Each module also has the necessary interfaces to allow data to be transferred between them, essentially enabling data flow within each stage.

[0048] The asset management module 201 is designed for storing and querying these assets. It provides a series of interfaces that allow the data processing module 203 and the layer management module 202 to read or store data. This allows other modules to obtain data from the asset management module 201 using the specified interfaces, without having to worry about the asset format. The asset management module 201 abstracts the concept of assets, freeing other modules from the impact of asset diversity and enhancing the flexibility of the system's asset formats.

[0049] The layer management module 202 is a module that connects assets and the visualization subsystem 30, in which the visualization parameters are information that provides display methods. Assets are usually large amounts of data stored in external storage (such as a hard disk), but in actual use, usually only a portion of the assets need to be displayed, and an asset may be displayed in different ways. For example, when we want to display the sampling points in a table on the digital earth, we may want some points to be displayed in different colors (for example, sometimes we want points with values ​​greater than 1 to be displayed in yellow, and sometimes we want points with values ​​greater than 1 to be displayed in red). These information related to the display method is not suitable for storage in the asset, because this is only a change in the display method, not a change in the data (i.e., the asset) itself. Then this information should be stored by the layer management module when it is displayed. Therefore, the layer management module essentially provides a list that records which assets to display and in what way.

[0050] Because the layer display module 202 decouples assets from visualization, it allows users to flexibly control which assets are displayed and which are not. It also allows users to display the same asset multiple times in different ways (i.e., by binding the same asset to different layers and setting different visualization parameters for those layers). These visualization settings do not affect the asset itself. Because of the layer management module 202, the visualization subsystem 10 does not need to directly process assets; it only needs to query the layer management module 202.

[0051] The purpose of the data processing module 203 is to connect the script module and the asset management module. Taking Python as an example, the script module itself is only a simple encapsulation of the Python engine, and it does not directly process the assets in this system. At the same time, the processing flow in the script module is essentially just the operation of some scripting languages. For ordinary users, it cannot be accessed in the form of "objects". The data processing module 203 abstracts the script into processing objects, which are similar to functions. When using it, the user uses different parameters to execute different functions according to different processing requirements. User parameters and asset information are all substituted into the processing process in the form of parameters. In this way, the data processing mode is unified and data processing and asset storage are decoupled. The asset part does not need to care about what the processing script is like, and the processing script can also understand the content of the asset according to the established protocol.

[0052] The data processing module 203 is specifically responsible for transforming assets, generating one or more new assets from one or more existing assets by executing a script. Because Python scripts must be called through the data processing module 203, user scripts must implement a function interface that conforms to the function calling conventions specified by the data processing module 203. The data processing module 203 provides at least the following interfaces to other subsystems: 1. Script enumeration, which lists all user Python scripts; 2. Script execution, which executes the corresponding script based on the script name, input asset list, output asset list, and parameter list entered by the user.

[0053] Script module 204 is essentially a simple encapsulation of a scripting language, such as the Python language engine. The data processing module transmits the assets to be processed and related parameters to the Python module, which then executes the corresponding Python script to complete the actual processing. The reason for not incorporating it into the data processing module is that Python's CAPI may vary between versions. If it were incorporated directly into the data processing module, updates to the Python engine would inevitably require updates to the data processing module. Encapsulating it as a Python module maintains the stability of its interface. Regardless of the Python engine version, this will not affect how the data processing module calls the Python module, making the system more flexible.

[0054] In one embodiment, the layer management module 202 is further configured to determine each layer and corresponding layer information based on asset information and related parameters; wherein the layer information includes all asset information bound to the layer and visualization parameters of each layer.

[0055] A project typically contains multiple layers, each of which should contain at least the following information: 1. Asset reference: which asset is bound to the layer; 2. Layer parameters: key-value pairs that record the visualization parameters of the layer. The layer management module 202 is agnostic to the layer content and provides at least the aforementioned interfaces for other subsystems.

[0056] In one embodiment, the layer management module 202 is further used to provide a layer enumeration interface and a layer binding interface to the three-dimensional visualization subsystem 30, so that the three-dimensional visualization subsystem 30 can generate models and texture files and perform three-dimensional display according to the layer enumeration interface and the layer binding interface; the layer enumeration interface is used to list the file paths and layer parameters of all layer-processed assets; the layer binding interface is used to bind the processed assets to a specified layer.

[0057] Due to the diversity of assets, they must be baked before visualization into a data format understandable by the 3D visualization subsystem 30. This is typically accomplished during layer binding. The 3D visualization subsystem 30 can obtain current layer information for visualization by calling the layer enumeration interface of the layer management module 202 in the core subsystem 20.

[0058] In one embodiment, the three-dimensional visualization subsystem 30 includes a digital earth module 301 and a layer interpretation module 302; the digital earth module 301 is used to provide a three-dimensional earth model and integrate the processed assets with the three-dimensional earth model for display; the layer interpretation module 302 is used to convert various parameters in the layer into a data format that can be recognized by the three-dimensional visualization subsystem.

[0059] The digital earth module 301 can be based on any third-party digital earth. The module provides the system with a three-dimensional earth model based on a tile map and allows users to overlay images onto the terrain through a GPU-based material system to achieve a fusion display of baked user assets and the earth.

[0060] The scene structure and rendering logic of the three-dimensional engine cannot be directly matched with the layer concept in the geographic information system. Usually, after rasterization, the two-dimensional data in the assets should be mixed and superimposed as the layers of the digital earth module, and the three-dimensional models in the assets should be placed in the corresponding positions on the digital earth after coordinate conversion. In addition, the interpretation of various parameters in the layer should also be completed by the layer interpretation module 302. For example, parameters such as the transparency of the layer and the overlay order. The layer interpretation module 302 should define the data format and parameters it accepts, and the asset management module 201 in the core subsystem 20 is responsible for baking various assets into a data format acceptable to the layer interpretation module 302.

[0061] In one embodiment, the asset management module 201 is specifically used to provide an asset enumeration interface, an asset import interface and an asset baking interface; the asset enumeration interface is used to list the paths and description information of all assets; the asset import interface is used to call the script module to convert the external geological and mining information data file into an asset; the asset baking interface is used to call the script module to convert the asset file into a temporary file recognized and rendered by the three-dimensional visualization subsystem 30.

[0062] Specifically, the user interacts directly with the user interface subsystem 10. When an external asset is needed, the user interface subsystem 10 calls the asset import interface to the asset management module 201 of the core subsystem 20 in the form of a message queue. The asset management module 201 imports the external geographic information data file based on the location information of the external asset to form the asset. When an internal asset is needed, the user calls the asset enumeration interface to the asset management module 201 of the core subsystem 20 in the form of a message queue through the user interface subsystem 10. The asset management module 201 lists the asset details in the form of a message queue and returns them to the user through the user interface subsystem 10. The user then selects the asset to be displayed through the user interface subsystem 10 and enters the relevant parameters, thereby inputting the asset information and relevant parameters of the asset to be displayed.

[0063] Specifically, the core subsystem 20 calls a Python module and runs a Python script to convert and import external files into the project. The asset baking interface calls a Python module and runs a Python script that, combined with the asset description, converts the asset file into a temporary file that can be recognized and rendered by the 3D visualization subsystem 30.

[0064] In one embodiment, the relevant parameters include a script name and a script parameter list for processing an asset script. Accordingly, the script module is specifically used to call a corresponding script according to the script name and perform asset processing on the asset to be processed according to the script parameter list.

[0065] For example, the data processing module 203 may provide the script module 204 with the script name, input asset list, output asset list, and script parameter list, and the script module 204 executes the corresponding script according to the script name, input asset list, output asset list, and parameter list.

[0066] In one embodiment, the types of assets include tables and images. Table assets are visualized in the form of labeled points placed on the earth, so each row of information in the table must include coordinates. The baked table asset file consists of the following two files: 1. A description file, which uses the JSON format to describe the default parameters of the table, such as the default point color, the default displayed columns, etc., as well as the location of the table data file; 2. A table data file, which uses the JSON format to record the data in the table and the geographic coordinates of each column of data. During visualization, the layer interpretation module reads the table data file, creates an Actor for each row at the coordinate position of the row, and displays the data information of the point in the form of UMG.

[0067] Image assets are visualized as material layers. The baked image asset file consists of two files: 1. A description file, which uses JSON format to describe the image's default parameters, such as opacity and the location of the image data file; 2. An image data file, which is a TIFF-formatted image. During visualization, the layer interpretation module loads the TIFF-formatted image as a texture into the specified CavansRenderTarget2D and sets its corresponding alpha blending value to 1. Cesium's material system then overlays the image onto the terrain.

[0068] The system can be generally used in the geological and mining industries, and can be applied in various stages of exploration as well as in the mining stage.

[0069] In addition, the present invention also provides a visualization method for a geographic information system based on modern graphic image technology, including: receiving asset information and related parameters of an asset to be displayed sent by a user, the asset information including location information of an external asset, or identification information of an internal asset, wherein the asset is a geographic information data file that can be processed and visualized as an independent whole; based on the asset information and the related parameters, calling a corresponding script file pre-encapsulated in a script module to perform asset processing, wherein the asset processing includes asset baking and transforming the asset according to the related parameters; based on the processed asset file, combined with an existing three-dimensional earth model, generating a model and a texture file, and performing a three-dimensional display based on the model and texture file.

[0070] The implementation principle and technical effects of the geographic information system visualization method based on modern graphic image technology provided in the embodiment of the present invention are the same as those of the aforementioned geographic information system embodiment based on modern graphic image technology. For the sake of brief description, for the parts not mentioned in the embodiment of the geographic information system visualization method based on modern graphic image technology, reference may be made to the corresponding contents in the aforementioned geographic information system embodiment based on modern graphic image technology.

[0071] For example, based on the above embodiment, a file created by an external system is visualized through the following process:

[0072] 1. The user enters the path and attribute information of the external file through the user interface subsystem.

[0073] 2. The user interface subsystem calls the asset import interface of the core subsystem asset management module through messages, instructs it to import external files and set corresponding properties.

[0074] 3. The asset import interface of the core subsystem asset management module calls the Python module to execute a Python script, converting the external file into an asset and setting its properties. The asset import is complete.

[0075] 4. The user enters the assets bound to the layer through the user interface subsystem.

[0076] 5. The user interface subsystem calls the asset baking interface of the core subsystem asset management module and the layer binding interface of the layer management module through messages to bake the assets to a temporary folder and bind them to the specified layer.

[0077] 6. The core subsystem notifies the 3D visualization subsystem of layer updates via messages. The 3D visualization subsystem calls the layer enumeration interface of the core subsystem layer management module via messages to obtain the asset path and layer parameters of the current layer.

[0078] 7. The layer interpretation module 302 of the 3D visualization subsystem 30 creates a corresponding 3D object based on the baked assets and layer parameters of the layer, and places it at the corresponding position on the digital globe.

[0079] 8. Visualization is completed.

[0080] For example, based on the above embodiment, for an existing asset in the project, data processing is completed through the following process:

[0081] 1. Through the user interface subsystem, the user selects the asset to be processed and the processing method to be used, enters the parameters and output asset name, and clicks Execute.

[0082] 2. The user interface subsystem calls the script execution interface of the core subsystem data processing module through messages and passes in various parameters provided by the user.

[0083] 3. The script execution interface of the core subsystem data processing module calls the Python module to execute the corresponding Python script, perform asset transformation, and output the new asset with the specified name.

[0084] 4. Asset disposal is completed.

[0085] In the above embodiment, the 3D visualization subsystem can be implemented using Unreal Engine 4, Cesium Digital Earth, and C++. The user interface subsystem can be implemented using TypeScript based on the antd framework. To provide the best user experience, the 3D visualization subsystem can integrate the CEF framework, allowing the user interface to be directly overlaid on the 3D visualization window. Essentially, this is like overlaying a browser on the 3D window, allowing the user interface to be displayed on any browser, whether embedded or standalone. In the core subsystem, Go can be used to primarily implement the basic architecture, while Python can be used to handle the specific business logic.

[0086] In order to describe the present application scheme in detail, further examples are given below.

[0087] In the asset management module, each asset object is defined as follows:

[0088]

[0089] In the layer management module, each layer object is defined as follows:

[0090]

[0091]

[0092] In the data processing module, each processing script object is defined as follows:

[0093]

[0094] For Python modules, we encapsulate the Python C API and provide the following interfaces to other modules, enabling them to use the functions provided by Python:

[0095] Asset baking interface:

[0096] func AssetCook(typ string,pData string,attributes core.GenericForm,pCook string)(core.GenericForm,core.GenericError)

[0097] Data processing script execution interface:

[0098] func ProgramExecute(name string,arguments core.GenericForm,workspacecore.GenericForm)([]ProgramOutput,core.GenericError)

[0099] Coordinate transformation interface:

[0100] func TransformCoordinate(systemSrc string,systemDst string,coordinates...Coordinate)([]Coordinate,core.GenericError)

[0101] 3D visualization subsystem:

[0102] The 3D visualization subsystem communicates with the user interface subsystem and core subsystem via WebSocket. Because the baked assets in the layers are large, WebSocket communication is inefficient. Therefore, baked assets are obtained using direct disk file access.

[0103] Its Digital Earth module uses Cesium for Unreal. Cesium provides a relatively complete coordinate conversion interface that can convert longitude and latitude coordinates into the rectangular coordinate system of the 3D engine in real time.

[0104] The layer interpretation module is developed using C++ and Unreal Engine 4's native Blueprint and material editing systems. Currently, two asset types are supported: tables and images, both of which must be provided as files.

[0105] User interface subsystem:

[0106] The user interface subsystem is developed in TypeScript and is essentially an HTML5 webpage. The primary use case for this implementation is in a desktop environment, where the user interface subsystem and the 3D visualization subsystem are deployed on the same computer. To provide the best user experience, the 3D visualization subsystem integrates the CEF framework, allowing the user interface to be directly overlaid on top of the 3D visualization window. This essentially overlays a browser on the 3D window, allowing the user interface to be displayed on any browser, whether embedded or standalone.

[0107] The process of visualizing image assets:

[0108] The user interactively specifies in the user interface subsystem a remote sensing anomaly image in PNG format and instructs it to be imported as an asset. The user interface subsystem sends the following message to the core subsystem:

[0109] {"command":"asset_create","name":"Remote Sensing Anomaly","type":"ASSET_TYPE_IMAGE","arguments":{"filepath":"D:\\Remote Sensing Anomaly.PNG"}}

[0110] After receiving the above message, the core subsystem calls the image asset import function image_Commit in the Python language, uses OpenCV to convert the PNG format image to a TIFF format image file and save it to the project, creating related files to form assets:

[0111] 1. Remote sensing anomaly / DATA / IMAGE.TIFF: image file.

[0112] 2. Remote sensing anomaly / META: asset description file.

[0113] Since only the image within the abnormal map drawing area is needed, the area outside the drawing area needs to be cropped. Therefore, an external component is used to interactively allow users to create a cropping box to specify the drawing area range. The cropping box is stored as an attribute in the attributes.crop file of the asset description file. The content of the asset description file is as follows:

[0114]

[0115]

[0116] The image content of the asset is as follows Figure 5 As shown, the user then binds the asset to a layer in the UI subsystem, and the UI subsystem sends the following message to the core subsystem:

[0117] {"command":"layer_bind","name":"Layer 1","asset":"Remote Sensing Anomaly"}

[0118] After receiving the message, the core subsystem completes layer binding and instructs the asset management module to bake the "Remote Sensing Anomaly" asset. The asset management module runs the image_cook Python interface for image asset baking to begin baking. During baking, OpenCV crops and corrects the original asset according to the cropping box specified by attributes.crop in the asset description, retaining only the mapped area. The cropped and corrected image, along with the baking description information, is stored in a temporary directory with the following file structure:

[0119] 1. Remote Sensing Anomaly / COOK / IMAGE.TIFF: The baked image file, that is, the image after cropping and correction according to the attributes.

[0120] 2. Remote Sensing Anomaly / COOK / DESCRIPTION: baking description file.

[0121] The contents of the baking description file are as follows:

[0122] {

[0123] "image":"D:\\TEMP\\Remote Sensing Anomaly\\COOK\\IMAGE.TIFF",

[0124] "opacity":1.0,

[0125] }

[0126] The baked image file is as follows Figure 6 As shown, you can see that the area outside the drawing area has been clipped. After the baking is completed, the core subsystem notifies the 3D visualization system to update the layer. The 3D visualization system sends the following message to enumerate the layers:

[0127] {"command":"layer_list"}

[0128] After obtaining the layer information, the 3D visualization system first parses the baking description file to obtain the initial opacity parameters and image file path. The TIFF file is loaded into memory using libtiff and then submitted to the video memory area of ​​the CavansRenderTarget2D corresponding to the layer. The pixel format is PF_R8G8B8A8. The Opacity value is then set to the initial value 1 in the description file through UMaterialParameterCollectionInstance. This value will indirectly control the alpha blending weight of the layer in the Cesium material, allowing the layer to be displayed as a superimposed layer on the digital globe. Figure 7 and Figure 8 shown.

[0129] The process of geochemical data processing:

[0130] Before processing, the file "Geochemical Exploration_1457.xlsx" has been imported as a table asset. This asset consists of the following files:

[0131] 1. Geochemical data / META: asset description file in JSON format.

[0132] 2. Geochemical data / DATA: Tabular data stored in the LevelDB database.

[0133] The description information is as follows:

[0134]

[0135] In the properties of this description file, coordinate_system is the coordinate system of the data in this table. Because this table stores coordinates in the Gauss-Krüger Beijing 54 coordinate system, which does not have a zone number, the coordinate_zone property specifies the zone number of the table's coordinates. coordinate_col_x and coordinate_col_y specify which columns of the table contain the X and Y coordinates.

[0136] After the user selects the above assets on the relevant page of the user interface subsystem and sets the relevant parameters, click "Execute" and the results will be displayed as follows: Figure 9 shown.

[0137] After clicking Execute, the interface sends the following message to the core subsystem:

[0138] {"command":"program_execute","name":"geochemical","arguments":{"src":"geochemical data","contrast":false,"col_z":["Cu"]}}

[0139] After the core subsystem receives the above message, the data processing module calls the Python module to execute the data processing script named geochemical. This Python script uses GDAL Grid to interpolate the table data and obtain the interpolated image. The image will then be automatically imported into a new asset named "Cu Element Intensity Map". The preview of this asset is as follows Figure 10 As shown in the figure, this asset is an image asset, so the same visualization method as in the previous section can be used to overlay visualization on the digital globe, such as Figure 11 and Figure 12 shown.

[0140] The structural embodiments described above are merely illustrative. For example, the division of systems or modules is merely a logical functional division, and actual implementations may employ different divisions. Furthermore, the couplings or direct couplings or communication connections shown or discussed may be indirect couplings or communication connections through interfaces, structures, or units, and may be electrical, mechanical, or other forms.

[0141] The systems or modules described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0142] In addition, the functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware or software functional units.

[0143] The above content is only a specific implementation method of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with this technical field can easily think of changes or replacements within the technical scope disclosed in this application, and they should all be covered by the protection scope of the present application.

Claims

1. A geographic information system based on modern graphic image technology, characterized by: include: The user interface subsystem, equivalent to the view and controller in the MVC architecture, is used to receive asset information and related parameters of the asset to be displayed sent by the user. The asset information includes the location information of external assets or the identification information of internal assets. The asset is a geological information data file that can be processed and visualized as an independent whole. The core subsystem is configured to call the corresponding script file of the script module to perform asset processing based on the asset information and the relevant parameters, and send the processed assets to the 3D visualization subsystem, wherein the asset processing includes asset baking and asset transformation based on the relevant parameters. The script module encapsulates multiple script files for asset processing; A 3D visualization subsystem is used to generate model and texture files based on the processed asset files and in combination with an existing 3D earth model, and to perform 3D display based on the model and texture files; Among them, each subsystem communicates with each other through message queues and files; Asset types include tables and images. Table assets are visualized in the form of label points placed on the earth. Each row of information in the table includes coordinates. The baked table asset file consists of the following two files: (1) a description file, which uses the JSON format to describe the default parameters of the table, including the default point color, the default displayed column, and the location of the table data file; (2) a table data file, which uses the JSON format to record the data in the table and the geographic coordinates of each column of data. During visualization, the table data file is read through the layer interpretation module of the 3D visualization subsystem, and an Actor is created for each row at the coordinate position of the row, and the data information of the point is displayed in the form of UMG; The process of visualizing files created by external systems through the GIS includes: The user inputs the path and attribute information of the external file through the user interface subsystem; The user interface subsystem calls the asset import interface of the core subsystem asset management module through messages, instructing it to import external files and set corresponding properties; The core subsystem calls the Python module through the asset import interface of the asset management module to execute the Python script, converts the external file into an asset, and sets the attributes. The asset import is completed; The user inputs the assets bound to the layer through the user interface subsystem; The user interface subsystem calls the asset baking interface of the asset management module and the layer binding interface of the layer management module in the core subsystem through messages to bake the assets into a temporary folder and bind them to the specified layer. The core subsystem notifies the 3D visualization subsystem of layer updates through messages. The 3D visualization subsystem calls the layer enumeration interface of the core subsystem's layer management module through messages to obtain the asset path and layer parameters of the current layer. The layer interpretation module of the 3D visualization subsystem creates corresponding 3D objects based on the baked assets and layer parameters of the layer, and places them at the corresponding positions on the digital globe to complete the visualization.

2. The geographic information system based on modern graphic image technology according to claim 1 is characterized in that: The core subsystem includes an asset management module, a layer management module, a data processing module and a script module; The asset management module is used for asset maintenance, which includes providing an asset import interface to the outside world and an asset access interface to other modules or subsystems; The layer management module is configured to set visualization parameters of the asset in combination with the relevant parameters, and send the visualization parameters to the 3D visualization subsystem so that the 3D visualization subsystem can visualize the asset according to the visualization parameters; The data processing module is used to provide a script execution interface and send the assets to be processed and related parameters corresponding to the asset information to the script module; The script module is used to call the corresponding script and perform asset processing on the assets to be processed according to the relevant parameters.

3. The geographic information system based on modern graphic image technology according to claim 2 is characterized in that: The layer management module is further used to determine each layer and corresponding layer information based on asset information and related parameters; The layer information includes all asset information bound to the layer and visualization parameters of each layer.

4. The geographic information system based on modern graphic image technology according to claim 3 is characterized in that: The layer management module is further configured to provide the 3D visualization subsystem with a layer enumeration interface and a layer binding interface, so that the 3D visualization subsystem generates models and texture files and performs 3D display according to the layer enumeration interface and the layer binding interface. The layer enumeration interface is used to list the file paths and layer parameters of all layer-processed assets; The layer binding interface is used to bind the processed assets to a specified layer.

5. The geographic information system based on modern graphic image technology according to claim 1 is characterized in that: The three-dimensional visualization subsystem includes a digital earth module and a layer interpretation module; The Digital Earth module is used to provide a 3D Earth model and allow users to overlay images onto the terrain using a GPU-based material system, achieving a fusion display of baked user assets and the 3D Earth. The layer interpretation module is used to convert various parameters in the layer into a data format that can be recognized by the three-dimensional visualization subsystem.

6. The geographic information system based on modern graphic image technology according to claim 2 is characterized in that: The asset management module is specifically used to provide asset enumeration interface, asset import interface and asset baking interface; The asset enumeration interface is used to list the paths and description information of all assets; The asset import interface is used to call the script module to convert the external geological and mining information data file into assets; The asset baking interface is used to call the script module to convert the asset file into a temporary file that is recognized and rendered by the 3D visualization subsystem.

7. The geographic information system based on modern graphic image technology according to any one of claims 1 to 6, characterized in that: The script module is a Python module based on the Python language.

8. The geographic information system based on modern graphic image technology according to claim 2 is characterized in that: The relevant parameters include a script name and a script parameter list for processing an asset script. Accordingly, the script module is specifically used to call a corresponding script according to the script name and perform asset processing on the asset to be processed according to the script parameter list.

9. A geographic information system based on modern graphic image technology according to any one of claims 1 to 6, characterized in that ,The types of the assets include tables and images.

10. A geographic information system visualization method based on modern graphic image technology, characterized in that: The method is based on the geographic information system visualization system based on modern graphic image technology as described in claim 1, comprising: Receive asset information and related parameters of an asset to be displayed sent by a user, wherein the asset information includes location information of an external asset or identification information of an internal asset, wherein the asset is a geographic information data file that can be processed and visualized as an independent entity; Based on the asset information and the relevant parameters, calling a corresponding script file pre-encapsulated in a script module to perform asset processing, wherein the asset processing includes asset baking and transforming the asset based on the relevant parameters; Based on the processed asset file and in combination with the existing three-dimensional earth model, a model and texture file are generated, and a three-dimensional display is performed based on the model and texture file.

Citation Information

Patent Citations

  • Satellite constellation simulation visualization display and control system based on container cloud

    CN112800621A