HarmonyOS-based spatiotemporal data foundation platform construction method, system, and storage media

By building a spatiotemporal data base platform on the HarmonyOS platform, using HTTP servers and twin construction units, the problems of large data volume, multi-source and complex structure in the digital twin platform are solved, and efficient data management and three-dimensional twin scenario construction are realized, improving the construction of the three-dimensional twin scenarios. Data security and display efficiency are achieved.

CN118885528BActive Publication Date: 2025-02-07TIANJIN SURVEYING & MAPPING INST CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411355831.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-09-27
Publication Date
2025-02-07
Estimated Expiration
2044-09-27

AI Technical Summary

Technical Problem

When building a digital twin platform, the existing technology faces problems such as large data volume, multiple sources and complex structure, especially the security and display efficiency of high-precision surveying and mapping of geographic information data are difficult to meet the needs.

Method used

The spatial and temporal data base platform construction method based on HarmonyOS is adopted. By creating an HTTP server in the HarmonyOS system, local spatio-temporal data are released for service, and a three-dimensional twin scenario is constructed through a twin construction unit to connect to IoT-aware data.

Benefits of technology

It realizes efficient spatio-temporal data management and three-dimensional twin scene construction, supports a variety of digital twin visual application scenarios, is compatible with the existing Cesium front-end system, and improves data security and display efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118885528B_ABST
    Figure CN118885528B_ABST
Patent Text Reader

Abstract

The present invention relates to the technical field of digital twin construction, and discloses a method, system and storage medium for constructing a spatiotemporal data base platform based on HarmonyOS, comprising the following steps: receiving basic spatiotemporal data, storing the basic spatiotemporal data in a local database in the form of a file or a Spatialite spatial database; a data service unit publishes the basic spatiotemporal data as a service, and publishes the local data as a service by creating an HTTP server in the Harmony system; constructing a three-dimensional twin scene based on the published data, constructing the three-dimensional twin scene through a twin construction unit, and publishing and running it through the HTTP server; accessing Internet of Things perception data in the three-dimensional twin scene, and the Internet of Things perception data includes data transmitted in real time by Internet of Things perception devices; supporting service outputs such as standard WMTS and TMS systems, being fully compatible with existing Cesium front-end systems, and being able to reuse existing Web-based three-dimensional engines such as Cesium to improve the construction efficiency of three-dimensional twin scenes.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of digital twin construction, and specifically to a method, system and storage medium for constructing a spatiotemporal data base platform based on HarmonyOS. Background Art

[0002] Based on the Hongmeng system, there are three main existing technical solutions: one is to use the BS structure, based on the Web framework as a twin display platform, the data part needs to be stored in the remote server and called through the form of remote data services; the second is to use the Hongmeng native development of the three-dimensional engine (such as OSG), which can store data locally and read and access it in the form of files; the third is to build it based on the secondary development method provided by commercial GIS software such as SuperMap, and the cost is higher as the number of deployed authorized applications increases. Surveying and mapping geographic information data has the characteristics of large data volume, multi-source data, and complex structure. At the same time, high-precision surveying and mapping geographic information data is also state confidential data, and data security is of vital importance. For the B / S structure, all or part of the spatiotemporal data needs to be stored in a remote server and called through a remote data service. For three-dimensional data with a large amount of data, display efficiency problems will arise. At the same time, confidential data cannot be directly deployed to a network server for remote Internet access. For the method of developing a three-dimensional engine with Hongmeng native, the workload is large and requires additional development costs. Currently, mainstream digital twins and three-dimensional GIS rendering engines such as Cesium, MapboxGL, and Thing3D are all based on the B / S architecture of WebGL. Hongmeng native development cannot directly reuse existing B / S systems or platform results. Summary of the invention

[0003] In view of the shortcomings of the prior art, the purpose of the present invention is to provide a method, system and storage medium for constructing a spatiotemporal data base platform based on HarmonyOS.

[0004] In order to achieve the above object, the present invention provides the following technical solutions:

[0005] The method for constructing a spatiotemporal data base platform based on HarmonyOS includes the following steps:

[0006] Receive basic spatiotemporal data, which are stored in the local database in the form of files or Spatialite spatial databases;

[0007] The data service unit publishes basic spatiotemporal data as a service, and publishes local data as a service by creating an HTTP server in the Hongmeng system;

[0008] Build a 3D twin scene based on the published data, build a 3D twin scene through the twin construction unit, and publish and run it through the HTTP server;

[0009] The Internet of Things perception data is accessed in the three-dimensional twin scene, and the Internet of Things perception data includes data transmitted in real time by the Internet of Things perception device.

[0010] In the present invention, preferably, the IoT sensing data includes text data, and the steps of accessing the text data include:

[0011] Load the 3D twin scene published by HTTP in Webview;

[0012] The IoT sensing unit builds a WebSocket service, connects to the server in real time, obtains text data in real time in the callback method and parses it into real-time IoT data;

[0013] The IoT perception unit executes Webview.loadUrl to transfer the real-time IoT data received by the IoT perception unit to the digital twin unit for display.

[0014] In the present invention, preferably, the sensor control interface API can be directly called in HTTP mode through the front-end page to control the IoT sensor and collect IoT perception data.

[0015] In the present invention, preferably, the IoT perception data also includes video data, and the video data is accessed by loading a page with a Video tag in Webview for playback.

[0016] In the present invention, preferably, the video data such as RTSP and RTMP video streams are played using the VitamioBundle playback component.

[0017] In the present invention, preferably, the basic spatiotemporal data includes vector data, raster data and three-dimensional data.

[0018] In the present invention, preferably, HTTP services are constructed according to the standards of the corresponding formats for different local data.

[0019] In the present invention, preferably, it also includes the construction of business applications, and customized development of data services based on Hongmeng native development, Spatialite spatial database API or Cesium three-dimensional engine.

[0020] The system is built based on the HarmonyOS spatiotemporal data base platform, including data management unit, data service unit, IoT perception unit, twin construction unit and business application unit;

[0021] The data management units are connected to the data service unit and the IoT sensing unit, the IoT sensing unit is connected to the twin construction unit, the IoT sensing unit is also communicatively connected to the IoT sensor, and the data service units are connected to the business application unit and the twin construction unit;

[0022] The data management unit is used to manage and store basic spatiotemporal data, business management data and IoT perception data.

[0023] The data service unit is used to read the data in the data management unit and publish it as a standard data service to provide service support for the twin construction unit.

[0024] The twin construction unit constructs a three-dimensional twin scene of the smart city based on multi-source spatiotemporal data.

[0025] The IoT sensing unit receives and stores IoT sensing data, and connects the IoT sensing data to the three-dimensional twin scene.

[0026] The business application unit provides basic business application functions based on business scenario requirements and in combination with business management data.

[0027] Compared with the prior art, the present invention has the following beneficial effects:

[0028] The method of the present invention builds a data service unit in the Hongmeng system, publishes and runs basic spatiotemporal data, business management data and IoT perception data through an HTTP server, builds a three-dimensional twin scene through a twin construction unit, and adds perception data to the three-dimensional twin scene through an IoT perception unit. The overall function is comprehensive and can be adapted to a variety of digital twin visualization application scenarios. All of them are open source implementations, support standard WMTS, TMS system and other service outputs, are fully compatible with existing Cesium front-end systems, and can reuse existing Web-based Cesium and other three-dimensional engines to improve the construction efficiency of three-dimensional twin scenes. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 This is a flowchart of the method for building a spatiotemporal data base platform based on HarmonyOS.

[0030] Figure 2 A structural diagram of the system for building a spatiotemporal data base platform based on HarmonyOS. DETAILED DESCRIPTION

[0031] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0032] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which the present invention belongs. The terms used herein in the specification of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The term "and / or" used herein includes any and all combinations of one or more of the related listed items.

[0033] See also Figure 1 A preferred embodiment of the present invention provides a method for constructing a spatiotemporal data base platform based on HarmonyOS. Based on the existing surveying and mapping geographic information data, a spatiotemporal data twin base is quickly constructed on HarmonyOS (Hongmeng system) and applied to smart city construction and management. This can further broaden the application scenarios of surveying and mapping geographic information data, give full play to the value of data, activate the potential of elements, and play the role of surveying and mapping geographic information spatiotemporal data element guarantee.

[0034] The construction method specifically includes the following steps:

[0035] S1. Receive basic spatiotemporal data. The basic spatiotemporal data is stored in the local database in the form of files or Spatialite spatial databases. Basic spatiotemporal data is mainly divided into three forms according to data type: vector data (Geojson, Shapefile), raster data (mainly map slices), and three-dimensional data (mainly 3D tiles). They are all stored in the local database in the form of files or Spatialite spatial databases. Basic spatiotemporal data specifically include image maps, electronic maps, administrative divisions, real-life three-dimensional models, building white models, three-dimensional point clouds and other data. At the same time, business management data is also received. Business management data is related data involved in the construction and management of smart cities, such as planning data, municipal data, urban management data, traffic management data, community data, park industry data, public security data, etc. Business management data is directly displayed and not stored according to specific business needs, or stored in a local Sqlite relational database.

[0036] S2. The data service unit receives basic spatiotemporal data for service publishing. The data service unit publishes local data services by creating an HTTP server in the Hongmeng system. For Geojson, Shapefile, and 3Dtiles data, HTTP standard data services are directly built based on the original data files; for other data stored in the local database, the data content can be read based on the API interface provided by the local database and standard data services can be provided through the HTTP server. For map slice data, HTTP services are built according to TMS, WMTS and other standards; for other business data, if the business data has coordinate information, the service is directly published. If the business data has no coordinate information, it can provide associated query services with existing spatial data through business relationships.

[0037] In this embodiment, NanoHttpd is embedded in the Hongmeng system to create an HTTP server, which runs in the Hongmeng system and provides HTTP services. For 3Dtiles data, it is a three-dimensional model tile data format. In 3DTiles, a set of data is organized by Tileset (tile data set). Each Tileset is described by at least one JSON file (tileset.json). The HTTP server extracts the JSON file for service publishing. For Geojson, it is a format of geographic data encoded in JSON, which represents geometry, features, and feature sets. Shapefile uses the shpjs library to convert to GeoJSON files in real time. Then the HTTP server uses the Cesium.GeoJsonDataSource (url: 'path / to / your / geojsonfile.geojson') method to read the URL address of the GeoJSON file and directly publish services.

[0038] S3. Build a 3D twin scene based on the published data, build a 3D twin scene through the twin construction unit, and then publish and run it through the HTTP server. The twin construction unit can use the Cesium 3D engine to realize data visualization, and directly display and query HTTP data services in Geojson, Shapefile, and 3DTiles formats, and can also directly display TMS and WMTS standard map services; and develop certain visualization analysis functions based on Cesium.

[0039] In this embodiment, the twin construction unit obtains metadata information related to the construction of a three-dimensional twin scene through the GetCapabilities operation, including the operations supported by the WMTS service, the layers that provide the WMTS service and their own slice strategies, output formats, and other information. The twin construction unit obtains slices related to the construction of a three-dimensional twin scene through the GetTile operation. For pre-produced map slices, the access method is known, and the target slice can be accessed according to the row (TileRow) column (TileCol) number and layer (TileMatrix) request parameters.

[0040] Hongmeng system cannot directly reuse the existing Cesium B / S architecture based on WebGL. This application can be directly reused by publishing through the constructed HTTP server. The HTTP server publishes the data by loading the html file in the Assets folder. At the same time, the NanoHttpd function library can publish the Assets folder via HTTP, copy the Cesium website on the PC directly to Assets, and load the html file through Webview.loadUrl("http: / / localhost:8081 / cesium / index.html"). It can be directly accessed and used without modifying any content on the website, which is convenient to operate.

[0041] S4. In the three-dimensional twin scene, the IoT sensing data is accessed through the IoT sensing unit, and the IoT sensing data includes data transmitted in real time by the IoT sensing device. The IoT sensing data includes text data, and the steps of accessing the text data include:

[0042] Load the 3D twin scene published by HTTP in Webview;

[0043] The IoT perception unit builds a WebSocket service based on the native development method of Hongmeng, connects to the IoT server in real time, obtains text data in real time in the callback method and parses it into real-time IoT data;

[0044] The IoT perception unit executes Webview.loadUrl to transfer the real-time IoT data received by the IoT perception unit to the three-dimensional twin scene of the digital twin unit for display.

[0045] Define the JavaScript method function showIOTData(iotData) in the twin building unit to display real-time IoT data;

[0046] In this embodiment, through the twin construction unit, the HTTP server can also be directly used to call the sensor control interface API to control the IoT sensor and collect IoT perception data.

[0047] In this embodiment, taking the construction of a smart park as an example, the IoT sensing data of the smart park includes temperature, humidity, lighting, air quality, etc., receives the three-dimensional data of the park, publishes the three-dimensional data through the HTTP server, and builds the three-dimensional twin scene of the smart park. The IoT data collected by each sensor is received through the IoT sensing unit, and the sensors are displayed in the twin platform according to the actual location. By clicking on different types of IoT sensors in different location areas in the twin construction unit, various data of the building can be obtained and viewed in real time, and adjusted through the intelligent control system to make the energy consumption of the building more efficient. By combining the three-dimensional scene of the park with real-time IoT data, it can help park managers manage and operate the park more intelligently, thereby improving the efficiency and competitiveness of the park.

[0048] In this embodiment, the IoT sensing data also includes video data, and the video data is accessed by loading a page with a Video tag in Webview for playback.

[0049] In this embodiment, the video data, such as RTSP or RTMP video stream, is played using the VitamioBundle playback component.

[0050] S5. Build business applications. Customize and develop data services based on Hongmeng native development, Spatialite spatial database API or Cesium 3D engine. Build business applications through front-end frameworks such as Cesium, such as spatial query, attribute query, space-time comparison and other business functions.

[0051] See also Figure 2Another preferred embodiment of the present invention provides a system for building a spatiotemporal data base platform based on HarmonyOS, which is established based on the HarmonyOS system and mainly includes a data management unit, a data service unit, an Internet of Things sensing unit, a twin construction unit and a business application unit. The data management unit is connected to the data service unit and the Internet of Things sensing unit. The Internet of Things sensing unit transmits the Internet of Things sensing data it receives to the data management unit for storage and management. The data service unit extracts the data of the data management unit for publishing and other processing. The Internet of Things sensing unit is connected to the twin construction unit. The Internet of Things sensing unit connects the Internet of Things sensing data to the three-dimensional twin scene constructed by the twin construction unit. The Internet of Things sensing unit is also communicatively connected to an Internet of Things sensor for receiving Internet of Things sensing data. The data service unit is connected to the business application unit and the twin construction unit. The twin construction unit uses the data published by the data service unit to build a three-dimensional twin scene. The business application unit provides related business functions based on the three-dimensional twin scene.

[0052] The data management unit is used to manage and store basic spatiotemporal data, business management data and IoT perception data. The data management unit receives and stores, and has the ability to aggregate, store and manage multi-dimensional data, including several different databases, such as file database, Spatialite spatial database, Sqlite database, etc. Different data are stored in the corresponding databases. Basic spatiotemporal data mainly include image maps, electronic maps, administrative divisions, real-life three-dimensional models, building white models, three-dimensional point clouds, etc.; business management data refers to relevant data involved in the construction and management of smart cities, such as planning data, municipal data, urban management data, traffic management data, community data, park industry data, public security data, etc.; IoT perception data mainly includes data transmitted in real time through IoT perception devices, such as video surveillance data, ecological environment data, traffic data, meteorological data, etc.

[0053] The data service unit is provided with a NanoHttpd function library, which is used to build an HTTP service publishing service. The data service unit is used to read the data in the data management unit and publish it as a standard data service, providing service support for the twin construction unit and the business application unit.

[0054] The twin construction unit includes the Shpjs library, which is a javascript library that can be used to parse shapefile file services. The twin construction unit constructs a three-dimensional twin scene for the smart city based on multi-source spatiotemporal data, and provides basic data visualization and three-dimensional analysis.

[0055] The IoT perception unit receives and stores IoT perception data. It can quickly access and output IoT perception data based on the WebSocket communication protocol or Server-SentEvents. It can perform data storage management based on the Sqlite relational database and perform visualization and business scenario applications based on the twin construction unit.

[0056] The business application unit provides basic business application functions based on business scenario needs and combined with business management data. Based on the Spatialite database and API, various data services are developed through the native method of Hongmeng, and business support is provided for Cesium. Business application units are built through front-end frameworks such as Cesium.

[0057] In some other preferred embodiments of the present invention, a computer-readable storage medium is provided, storing a computer program. When the computer program is executed by a processor, the processor executes the steps of the method described in the above embodiment.

[0058] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc., which can store program codes.

[0059] The above description is a detailed description of the preferred feasible embodiments of the present invention, but the embodiments are not intended to limit the scope of the patent application of the present invention. All equivalent changes or modified changes completed under the technical spirit suggested by the present invention should fall within the patent scope covered by the present invention.

Claims

1. A method for constructing a spatiotemporal data base platform based on HarmonyOS, characterized in that: The steps include: Receive basic spatiotemporal data, which are stored in the local database in the form of files or Spatialite spatial databases; The data service unit publishes basic spatiotemporal data as a service. By creating an HTTP server in the Hongmeng system, the local data is published as a service. When the basic spatiotemporal data is Geojson, Shapefile, or 3Dtiles data, the HTTP standard data service is directly built based on the original data file. When the basic spatiotemporal data is other data stored in the local database, the data content is read based on the API interface provided by the local database and standard data services are provided through the HTTP server. When the basic spatiotemporal data is map slice data, HTTP services are built according to TMS and WMTS standards. When the basic spatiotemporal data is other business data with coordinate information, the service is published directly. When the basic spatiotemporal data is business data without coordinate information, it provides associated query services with existing spatial data through business relationships. Build a 3D twin scene based on the published data, build a 3D twin scene through the twin construction unit, and publish and run it through the HTTP server; the twin construction unit uses the Cesium 3D engine to realize data visualization, directly display and query HTTP data services in Geojson, Shapefile, and 3DTiles formats, and directly display TMS and WMTS standard map services, and develop visualization analysis functions based on Cesium; the twin construction unit obtains the slices related to the construction of the 3D twin scene through the GetTile operation. For the pre-produced map slices, the target slices are accessed according to the row and column numbers and layer request parameters; The Internet of Things perception data is accessed in the three-dimensional twin scene, and the Internet of Things perception data includes data transmitted in real time by the Internet of Things perception device.

2. The method for constructing a spatiotemporal data base platform based on HarmonyOS according to claim 1, characterized in that: The IoT sensing data includes text data, and the steps of accessing the text data include: Load the 3D twin scene published by HTTP in Webview; The IoT sensing unit builds a WebSocket service, connects to the server in real time, obtains text data in real time in the callback method and parses it into real-time IoT data; The IoT perception unit executes Webview.loadUrl to transfer the real-time IoT data received by the IoT perception unit to the digital twin unit for display.

3. The method for constructing a spatiotemporal data base platform based on HarmonyOS according to claim 1, characterized in that: Through the front-end page, you can also directly use HTTP to call the sensor control interface API to control the IoT sensors and collect IoT perception data.

4. The method for constructing a spatiotemporal data base platform based on HarmonyOS according to claim 1, characterized in that: The IoT sensing data also includes video data, and the video data is accessed by loading a page with a Video tag in Webview for playback.

5. The method for constructing a spatiotemporal data base platform based on HarmonyOS according to claim 4, characterized in that: The video data, such as RTSP or RTMP video stream, is played using the VitamioBundle playback component.

6. The method for constructing a spatiotemporal data base platform based on HarmonyOS according to claim 1, characterized in that: The basic spatiotemporal data includes vector data, raster data and three-dimensional data.

7. The method for constructing a spatiotemporal data base platform based on HarmonyOS according to claim 1, characterized in that: For different local data, HTTP services are constructed based on the data format using the corresponding format standards.

8. The method for constructing a spatiotemporal data base platform based on HarmonyOS according to claim 1, characterized in that: It also includes the construction of business applications and customized development of data services based on Hongmeng native development, Spatialite spatial database API or Cesium 3D engine.

9. A system for implementing the method for constructing a spatiotemporal data base platform based on HarmonyOS as described in any one of claims 1 to 8, characterized in that: It includes data management unit, data service unit, IoT perception unit, twin construction unit and business application unit; The data management units are connected to the data service units and the IoT sensing units, the IoT sensing units are connected to the twin construction units, the IoT sensing units are also communicatively connected to the IoT sensors, and the data service units are connected to the business application units and the twin construction units; The data management unit is used to manage and store basic spatiotemporal data, business management data and IoT perception data. The data service unit is used to read the data in the data management unit and publish it as a standard data service to provide service support for the twin construction unit. The twin construction unit constructs a three-dimensional twin scene of the smart city based on multi-source spatiotemporal data. The IoT sensing unit receives and stores IoT sensing data, and connects the IoT sensing data to the three-dimensional twin scene. The business application unit provides basic business application functions based on business scenario requirements and in combination with business management data.

10. A storage medium, characterized in that: A computer program is stored, and when the computer program is executed by a processor, the processor executes the steps of the method for constructing a spatiotemporal data base platform based on HarmonyOS as described in any one of claims 1 to 8.

Citation Information

Patent Citations

  • Urban digital intelligent base platform

    CN117610283A

  • Equipment interaction method and device based on OpenHarmony system, server and storage medium

    CN118101635A