Marine knowledge graph data storage method and system based on space-time grid

Abstract

The invention belongs to the technical field of big data storage, and particularly discloses an offshore knowledge graph data storage method and system based on a space-time grid, and the method comprises the steps: obtaining offshore space-time knowledge graph data, carrying out the data preprocessing of the offshore space-time knowledge graph data, and obtaining a preprocessed data source; creating a data storage task according to the preprocessed data source, and creating a data storage index table based on the data storage task; on the basis of the marine space-time knowledge graph data and the storage task, coding by using a space-time coding standard to obtain a space-time grid code, and storing the marine space-time knowledge graph data into an index database by using the storage index table and the space-time grid code; and receiving real-time fusion track data sent by the data fusion platform, and storing the real-time fusion track data into an index database by using the storage index table and the real-time fusion track codes. According to the invention, the retrieval efficiency and the storage efficiency of the data are improved.

Description

Technical Field

[0001] The present application belongs to the field of big data storage technology, and more specifically, to a method and system for storing marine knowledge graph data based on spatiotemporal grids. Background Art

[0002] With the continuous development of information technology, the maritime information perception system is continuously generating massive amounts of data, including professional data from early warning detection and reconnaissance surveillance equipment, data from the ship automatic identification system (AIS), data from civil information systems such as automatic dependent surveillance-broadcast (ADS-B), meteorological data, and open source data from the Internet. It covers not only structured data such as various target point tracks / track messages and electromagnetic characteristic data messages, but also unstructured data such as text, images, audio, video, and real-time streams. How to process and analyze these multi-source and multi-type massive perception big data is of great significance for further situation understanding.

[0003] Traditional storage management systems are unable to meet the growing needs of massive storage, fusion sharing and situation analysis at sea in terms of data storage management, data update and processing analysis, resulting in problems such as difficulty in data storage and low retrieval efficiency. Summary of the invention

[0004] In view of the defects of the prior art, the purpose of this application is to provide a method and system for storing marine knowledge graph data based on spatiotemporal grid, aiming to solve the problems of data storage difficulties and low retrieval efficiency.

[0005] To achieve the above objectives, the present application provides a method for storing marine knowledge graph data based on spatiotemporal grids, including: Acquire maritime spatiotemporal knowledge graph data, and perform data preprocessing on the maritime spatiotemporal knowledge graph data to obtain a preprocessed data source; Create a data storage task according to the preprocessed data source, and create a data storage index table based on the data storage task; Based on the marine spatiotemporal knowledge graph data and storage tasks, the spatiotemporal coding standard is used for encoding to obtain a spatiotemporal grid code, and the marine spatiotemporal knowledge graph data is stored in an index library using the storage index table and the spatiotemporal grid code; Receive the real-time fused track data sent by the data fusion platform, encode the real-time fused track data and the storage task using the spatiotemporal coding standard to obtain the real-time fused track code, and use the storage index table and the real-time fused track code to store the real-time fused track data in the index library.

[0006] Optionally, the performing data preprocessing on the marine spatiotemporal knowledge graph data to obtain a preprocessed data source includes: Check whether the longitude and latitude of the data needed to complete the grid coding and storage are missing, and check whether the elevation data needed to complete the three-dimensional space-time coding and storage are missing, and delete the missing data; Check whether the geographical information of the data to be coded and stored is within the valid range, and modify the data counting method to non-scientific notation. The geographical information includes longitude, latitude, altitude and heading. Check all data to be stored and delete duplicate data records to obtain the preprocessed data source.

[0007] Optionally, the creating a data storage task according to the preprocessed data source includes: Creating a data storage task based on the original track data, fused track data, AIS data, maritime warning area data, meteorological data and image data of the pre-processed data source; The task identifier of the data storage task is determined according to the task ID, task name, grid construction level, data source, index library name and task construction time of the storage task.

[0008] Optionally, the creating a data storage index table based on the data storage task includes: Construct a point data storage index library corresponding to the original track data or AIS data based on the data ID, coordinate system, GeoSOT grid subdivision coding level, grid code, grid code range, point data geographic coordinates, creation time, data type and attribute set of the original track data or AIS data; Construct the line data storage index library corresponding to the fused track data based on the data ID, coordinate system, GeoSOT grid subdivision code level, grid code set, grid code range set, line data, creation time, data type, and attribute set of the fused track data; Based on the data ID, coordinate system, GeoSOT grid subdivision code level, grid code set, grid code range set, surface data, creation time, data type, and attribute set of the maritime warning area data, a surface data storage index library corresponding to the maritime warning area data is constructed; An image storage index library corresponding to the image data is constructed based on the image data ID, image name, resolution, image height, image width, image coordinate range, creation time, image timestamp, preview image address, image address, number of bands, coordinate system, GeoSOT grid coding level, grid coding range, and image data type.

[0009] Optionally, encoding based on the marine spatiotemporal knowledge graph data and storage tasks using a spatiotemporal coding standard to obtain a spatiotemporal grid code includes: Determining a grid coding level of the original track data according to the storage task; According to the fused track data set and the grid coding level, the point data, line data, surface data and image data of the maritime spatiotemporal knowledge graph data are encoded respectively to obtain the grid subdivision code corresponding to each data type.

[0010] Optionally, the storing the marine spatiotemporal knowledge graph data in an index library by using the storage index table and the spatiotemporal grid code includes: For the point data, line data, surface data and image data, the generated grid subdivision code is stored in a database field; According to the grid subdivision code, the geographical range of the geographical objects of the point data, line data, surface data and image data is obtained, and the geographical range code is stored in a database; According to the storage task, the parameter data is stored in the data storage index table, wherein the parameter data includes the coding level; The attribute data other than the geographical location of the fused track data and image data is stored in the data storage index table of the database.

[0011] Optionally, the encoding and storage process of the real-time fused track data includes: Receive real-time fusion track data sent by the fusion platform and store it in the MySql database; By monitoring the log file of the MySql database, the insertion event of the MySql database is obtained to obtain the newly added data; The newly added data and storage tasks are encoded using a spatiotemporal coding standard to obtain a real-time fused track code, and the real-time fused track data is stored in an index library using the storage index table and the real-time fused track code.

[0012] The present application also provides a marine knowledge graph data storage system based on spatiotemporal grid, including: An acquisition module, used to acquire maritime spatiotemporal knowledge graph data, and perform data preprocessing on the maritime spatiotemporal knowledge graph data to obtain a preprocessed data source; A creation module, used to create a data storage task according to the preprocessed data source, and create a data storage index table based on the data storage task; An encoding module is used to encode the marine spatiotemporal knowledge graph data and the storage task using a spatiotemporal encoding standard to obtain a spatiotemporal grid code, and to store the marine spatiotemporal knowledge graph data in an index library using the storage index table and the spatiotemporal grid code; The real-time encoding module is used to receive the real-time fused track data sent by the data fusion platform, encode the real-time fused track data and the storage task using the spatiotemporal coding standard to obtain the real-time fused track code, and use the storage index table and the real-time fused track code to store the real-time fused track data in the index library.

[0013] In a third aspect, the present application provides an electronic device comprising: at least one memory for storing programs; and at least one processor for executing the programs stored in the memory. When the program stored in the memory is executed, the processor is used to execute the method described in the first aspect or any possible implementation of the first aspect.

[0014] In a fourth aspect, the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the method described in the first aspect or any possible implementation of the first aspect.

[0015] In a fifth aspect, the present application provides a computer program product. When the computer program product runs on a processor, the processor executes the method described in the first aspect or any possible implementation of the first aspect.

[0016] It can be understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here.

[0017] In general, the above technical solutions conceived by this application have the following beneficial effects compared with the prior art: (1) This application can significantly improve the data retrieval efficiency by creating data storage tasks and storage index tables, and can effectively organize and manage marine spatiotemporal knowledge graph data, making the data storage process more efficient. During retrieval, the required data can be quickly located through the index table, reducing the query time; the control graph data is encoded using the spatiotemporal coding standard, providing a unified organization method and storage method for different data sources and formats, reducing the complexity of data integration, and thus improving the data retrieval efficiency and storage efficiency.

[0018] (2) This application can achieve the fusion and integration of data from multiple sources by coding the real-time data at sea online, so as to dynamically update the information according to the real-time situation; by combining the real-time online data and the offline stored data, the integrity of the data is ensured through the integrated spatiotemporal storage and update, and the information loss caused by the dispersion of data is avoided. In addition, the integrated storage and update mechanism enables the latest data to be quickly reflected in the search results, providing real-time feedback to users, and meeting the requirements of the integrity of the storage of real-time data at sea and the real-time query.

[0019] (3) Preprocessing the maritime spatiotemporal knowledge graph data means cleaning, deduplication, and normalization of the raw data to improve the integrity and accuracy of the data, ensuring that subsequent analysis and utilization are based on high-quality data. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is one of the flow diagrams of the method for storing marine knowledge graph data based on spatiotemporal grids provided in an embodiment of the present application; Figure 2 This is the second flow chart of the method for storing marine knowledge graph data based on spatiotemporal grids provided in an embodiment of the present application; Figure 3 This is the third flow chart of the method for storing marine knowledge graph data based on spatiotemporal grids provided in the embodiment of the present application; Figure 4 It is a structural schematic diagram of a marine knowledge graph data storage device based on a spatiotemporal grid provided in an embodiment of the present application; Figure 5 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0021] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0022] The term "and / or" in this article is a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The symbol " / " in this article indicates that the associated objects are in an or relationship, for example, A / B means A or B.

[0023] The terms "first" and "second" in the specification and claims herein are used to distinguish different objects rather than to describe a specific order of the objects. For example, a first response message and a second response message are used to distinguish different response messages rather than to describe a specific order of the response messages.

[0024] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0025] In the description of the embodiments of the present application, unless otherwise specified, "multiple" means two or more than two. For example, multiple processing units refer to two or more processing units, etc.; multiple elements refer to two or more elements, etc.

[0026] Next, the technical solutions provided in the embodiments of the present application are introduced.

[0027] Reference Figure 1 , the present application provides a method for storing marine knowledge graph data based on spatiotemporal grid, including: S101. Acquire maritime spatiotemporal knowledge graph data, perform data preprocessing on the maritime spatiotemporal knowledge graph data, and obtain a preprocessed data source; S102. Creating a data storage task according to the preprocessed data source, and creating a data storage index table based on the data storage task; S103. Based on the marine spatiotemporal knowledge graph data and the storage task, the spatiotemporal coding standard is used for encoding to obtain the spatiotemporal grid code, and the marine spatiotemporal knowledge graph data is stored in the index library using the storage index table and the spatiotemporal grid code; S104. Receive the real-time fused track data sent by the data fusion platform, encode the real-time fused track data and the storage task using the spatiotemporal coding standard to obtain the real-time fused track code, and use the storage index table and the real-time fused track code to store the real-time fused track data in the index library.

[0028] Specifically, first, through S101, it is necessary to collect marine spatiotemporal knowledge graph data from multiple sources, such as satellite remote sensing, ocean sensors, ship AIS systems, etc. These data may include ship tracks, meteorological data, ocean conditions, terrain images, etc.

[0029] Preprocessing the data may involve removing duplicate records, correcting data errors, processing missing values, etc. to ensure high data quality. Finally, a cleaned and standardized marine spatiotemporal knowledge dataset is formed, which is suitable for further analysis and storage.

[0030] Secondly, through S102, based on the pre-processed data source, a data storage task is defined. This may include specifying the location, format, frequency, permissions, etc. of data storage, and by clarifying the storage requirements, ensure that the data can be effectively organized and quickly accessed. Based on the storage task, an index table is generated to record the location, format, and other metadata of the data.

[0031] Furthermore, the maritime spatiotemporal knowledge graph data is encoded using a spatiotemporal coding standard. This encoding associates each data item with its corresponding temporal and spatial features, generating a unique spatiotemporal grid code for each data record. For example, using a spatiotemporal coding rule such as GeoSOT, the data is divided into spatial grids of a certain size, and a code is assigned to each grid.

[0032] Combined with the storage tasks and index tables created previously, the processed maritime spatiotemporal knowledge graph data is stored in the specified index library using spatiotemporal grid coding. When storing data, it can be quickly located according to the rules of the index table to ensure efficient data access.

[0033] Finally, the track data from the data fusion platform is received in real time through S105. The received real-time track data is preprocessed to ensure that its format is consistent with the previous knowledge graph data. The real-time fusion track data is encoded using the spatiotemporal coding standard to generate the corresponding real-time fusion track code. Through the created storage tasks and storage index tables, the data is stored in the index library using the real-time fusion track code.

[0034] It should be noted that the data fusion platform in this embodiment can be regarded as a data processing center for real-time collection and processing of real-time track data.

[0035] Optionally, the performing data preprocessing on the marine spatiotemporal knowledge graph data to obtain a preprocessed data source includes: Check whether the longitude and latitude of the data needed to complete the grid coding and storage are missing, and check whether the elevation data needed to complete the three-dimensional space-time coding and storage are missing, and delete the missing data; Check whether the geographical information of the data to be coded and stored is within the valid range, and modify the data counting method to non-scientific notation. The geographical information includes longitude, latitude, altitude and heading. Check all data to be stored and delete duplicate data records to obtain the preprocessed data source.

[0036] Specifically, this embodiment is a detailed process of data preprocessing.

[0037] The maritime spatiotemporal knowledge graph data includes original track data, fused track data, AIS data, meteorological data, regional data, satellite image data sets, etc., and the data preprocessing is completed. The main steps are as follows: S11. Processing of missing data. For data that needs to be stored in grid coding, check whether the longitude and latitude values ​​are missing and delete the missing data; for data that needs to complete the three-dimensional space-time coding task, check whether the elevation data is missing one by one and delete the missing data.

[0038] S12, invalid data processing. For the data that needs to be coded and stored, check whether the longitude, latitude, altitude, heading and other data are within the valid range; and, if the numbers are stored in scientific notation, modify them to non-scientific notation.

[0039] S13, duplicate data processing: Check all data to be stored and remove all duplicate data records.

[0040] The embodiment of the present application can ensure that the data in the preprocessed data source is complete by checking and deleting missing longitude, latitude and elevation data, thereby reducing misleading conclusions caused by missing values. Performing validity checks on geographic information to ensure that data points are within an acceptable geographic range can prevent useless or erroneous records from affecting subsequent analysis. Ensure that all geographic information (longitude, latitude, altitude, heading) is under the same standard to avoid incorrect interpretation and calculation due to non-standard data formats. By cleaning up duplicate records, data redundancy is reduced, thereby saving storage space and improving the efficiency of subsequent data processing.

[0041] Optionally, the step of creating a data storage task according to the preprocessed data source includes: Creating a data storage task based on the original track data, fused track data, AIS data, maritime warning area data, meteorological data and image data of the pre-processed data source; The task identifier of the data storage task is determined according to the task ID, task name, grid construction level, data source, index library name and task construction time of the storage task.

[0042] For the above pre-processed original track data, fused track data, AIS data, meteorological data and image data, create a data storage task, marked as , which represent the task ID, task name, grid construction level, data source, index library name and task construction time of the storage task respectively Optionally, the creating a data storage index table based on the data storage task includes: Construct a point data storage index library corresponding to the original track data or AIS data based on the data ID, coordinate system, GeoSOT grid subdivision coding level, grid code, grid code range, point data geographic coordinates, creation time, data type and attribute set of the original track data or AIS data; Construct the line data storage index library corresponding to the fused track data based on the data ID, coordinate system, GeoSOT grid subdivision code level, grid code set, grid code range set, line data, creation time, data type, and attribute set of the fused track data; Based on the data ID, coordinate system, GeoSOT grid subdivision code level, grid code set, grid code range set, surface data, creation time, data type, and attribute set of the maritime warning area data, a surface data storage index library corresponding to the maritime warning area data is constructed; An image storage index library corresponding to the image data is constructed based on the image data ID, image name, resolution, image height, image width, image coordinate range, creation time, image timestamp, preview image address, image address, number of bands, coordinate system, GeoSOT grid coding level, grid coding range, and image data type.

[0043] Specifically, the index library of this embodiment is constructed as follows: S31, constructing the original track point data index library. The index field structure of the original track index library is as follows:

[0044]

[0045] In the above formula, the English characters represent data id, coordinate system, GeoSOT grid subdivision code level, grid code, grid code range, point data geographic coordinates, creation time, data type, and attribute set of original track data. The index field structure of AIS data is the same as above.

[0046] S32. Construct a fusion line data index library. The index field structure of the fusion track index library is as follows:

[0047]

[0048] In the above formula, the English characters represent data id, coordinate system, GeoSOT grid subdivision code level, grid code set, grid code range set, line data, creation time, data type, and attribute set of fused track data.

[0049] S33, constructing an offshore data index library. The index field structure of the offshore data index library is as follows:

[0050]

[0051] In the above formula, the English characters represent data id, coordinate system, GeoSOT grid subdivision code level, grid code set, grid code range set, surface data, creation time, data type, and data attribute set.

[0052] S34, construct an image data index library. The index structure fields of the image data index library are as follows:

[0053]

[0054]

[0055] In the above formula, each English character represents data ID, image name, resolution, image height, image width, image coordinate range, creation time, image timestamp, preview image address, image address, number of bands, coordinate system, GeoSOT grid code level, grid code range, and image data type.

[0056] Optionally, encoding based on the marine spatiotemporal knowledge graph data and storage tasks using a spatiotemporal coding standard to obtain a spatiotemporal grid code includes: Determining a grid coding level of the original track data according to the storage task; According to the fused track data set and the grid coding level, the point data, line data, surface data and image data of the maritime spatiotemporal knowledge graph data are encoded respectively to obtain the grid subdivision code corresponding to each data type.

[0057] Specifically, in the embodiment of the present application, according to the constructed storage task, based on the GeoSOT spatiotemporal coding standard, a unique spatiotemporal grid code is constructed and generated. The data that needs to be encoded can be divided into four categories: point data, line data, surface data, and image data. The specific encoding steps are as follows: S41, point data encoding. The original track data can be classified as point data encoding, according to the grid encoding level specified when creating the task in S2 And fuse the track data set to start the encoding process. Generate the GeoSOT grid unit subdivision code for the latitude, longitude and altitude data of the track point. The quaternary 1D code of the GeoSOT grid starts with G, and the degree, minute and second codes are separated by "-", and the codes below seconds are separated by ".". Its format is "Gddddddddd-mmmmmm-ssssss.uuuuuuuuuuuu". Among them, d, m, s, and u are all 0, 1, 2, and 3. Through this encoding method, each GeoSOT grid unit is encoded, and this code is globally unique. After the precision, latitude and altitude of each original point are encoded, a grid subdivision data code is generated.

[0058] S42, Line Data Coding. The fused track data can be classified as track line data coding, according to the grid coding level specified when creating the task in S2. And fuse the track data set to start the encoding process. Line data can be mapped to represent a set of point data, so the line data encoding can be converted into the point data encoding process in step S41. Each track can generate a series of grid subdivision codes to form a coding group.

[0059] S43, Surface data coding. Regional data can be classified as surface data coding, according to the grid coding level specified when creating the task. And the area data, start the encoding process. The surface data can be subdivided and represented as a set of grid fillings. Therefore, the surface data can be represented as a grid subdivision encoding sequence, which constitutes an encoding group.

[0060] S44, Image data encoding. According to the grid encoding level specified when creating the task As well as the image data set, the grid segmentation encoding process is completed. In order to better balance the back-end storage and front-end query pressure, the image data encoding level is generally set to level 19 with an accuracy of 128 meters. For each segmented image, a grid segmentation code is generated.

[0061] Optionally, the storing the marine spatiotemporal knowledge graph data in an index library by using the storage index table and the spatiotemporal grid code includes: For the point data, line data, surface data and image data, the generated grid subdivision code is stored in a database field; According to the grid subdivision code, the geographical range of the geographical objects of the point data, line data, surface data and image data is obtained, and the geographical range code is stored in a database; According to the storage task, the parameter data is stored in the data storage index table, wherein the parameter data includes the coding level; The attribute data other than the geographical location of the fused track data and image data is stored in the data storage index table of the database.

[0062] Specifically, according to the created index table and the obtained coded data, the initially acquired massive track data is stored in the index library. The specific steps are as follows: S51. Grid subdivision codes are stored in the database. For point data, line data, surface data, and image data, the generated grid subdivision codes are stored in the database field geoNum. Each point data corresponds to 1 grid subdivision code, and each line data, surface data, and image data corresponds to N grid subdivision codes, which are stored as a code array.

[0063] S52, storing the grid subdivision code range. For point data, line data, surface data, and image data, the geographic range of these geographic objects is obtained according to the grid subdivision code generated in step S51, and the geographic range code is stored in the database.

[0064] S53, storage of parameter and attribute data. According to the storage task constructed in step S2, parameter data such as coding level are stored in the index table; according to the index table structure constructed in step S3, attribute data other than the geographical location of the fused track data and image data are stored in the index table.

[0065] Optionally, the encoding and storage process of the real-time fused track data includes: Receive real-time fusion track data sent by the fusion platform and store it in the MySql database; By monitoring the log file of the MySql database, the insertion event of the MySql database is obtained to obtain the newly added data; The newly added data and storage tasks are encoded using a spatiotemporal coding standard to obtain a real-time fused track code, and the real-time fused track data is stored in an index library using the storage index table and the real-time fused track code.

[0066] Specifically, this embodiment completes grid coding based on the real-time fused track data sent by the fusion platform and stores it in the index library. The specific steps are as follows: S61. The real-time fusion track data sent by the fusion platform is stored in the MySql database; S62. By monitoring the log file bin.log of the MySql database, the insertion event of the MySql database can be monitored and the newly added data can be obtained.

[0067] S63. According to the newly added data monitored in S62, the grid division and encoding method in step S4 and the data storage process in S5 are used to complete the storage process of the online data stream.

[0068] Reference Figure 2 , the maritime knowledge graph data storage method based on spatiotemporal grid provided in the embodiment of the present application includes: S1. Obtain maritime spatiotemporal knowledge graph data and complete data preprocessing.

[0069] S2. Create an offshore data storage task based on the data source preprocessed in step S1.

[0070] S3. For the storage task created in step S2, create a data storage index table.

[0071] S4. Based on the offshore dataset obtained in step S1 and the storage task constructed in step S2, a unique spatiotemporal grid code is constructed based on the GeoSOT spatiotemporal coding standard.

[0072] S5. According to the index table created in step S3 and the coded data obtained in step S4, the massive track data obtained in step S1 is stored in the index library.

[0073] S6. After encoding, the real-time fused track data sent by the fusion platform is stored in the index library.

[0074] Reference Figure 3 , Figure 3 It is an integrated coding and storage process of offline / online data based on GeoSOT; Offline data storage; Create a storage task; Create an index library, including: Original track index library; Fusion track index library; AIS data index library; Image index library; Weather data index library; GeoSOT spatiotemporal grid coding; Online data storage; Basic warehousing, including: Grid division coding is stored in the database; The mesh division coding range is stored in the database; Parameters and attribute data are stored in the database.

[0075] Reference Figure 4 , the present application also provides a marine knowledge graph data storage system based on spatiotemporal grid, including: An acquisition module 410 is used to acquire maritime spatiotemporal knowledge graph data, and perform data preprocessing on the maritime spatiotemporal knowledge graph data to obtain a preprocessed data source; A creation module 420, configured to create a data storage task according to the preprocessed data source, and to create a data storage index table based on the data storage task; The encoding module 430 is used to encode the marine spatiotemporal knowledge graph data and the storage task using the spatiotemporal encoding standard to obtain the spatiotemporal grid code, and store the marine spatiotemporal knowledge graph data into the index library using the storage index table and the spatiotemporal grid code; The real-time encoding module 440 is used to receive the real-time fused track data sent by the data fusion platform, encode the real-time fused track data and the storage task using the space-time coding standard to obtain the real-time fused track code, and use the storage index table and the real-time fused track code to store the real-time fused track data in the index library.

[0076] Optionally, the performing data preprocessing on the marine spatiotemporal knowledge graph data to obtain a preprocessed data source includes: Check whether the longitude and latitude of the data needed to complete the grid coding and storage are missing, and check whether the elevation data needed to complete the three-dimensional space-time coding and storage are missing, and delete the missing data; Check whether the geographical information of the data to be coded and stored is within the valid range, and modify the data counting method to non-scientific notation. The geographical information includes longitude, latitude, altitude and heading. Check all data to be stored and delete duplicate data records to obtain the preprocessed data source.

[0077] Optionally, the step of creating a data storage task according to the preprocessed data source includes: Creating a data storage task based on the original track data, fused track data, AIS data, maritime warning area data, meteorological data and image data of the pre-processed data source; The task identifier of the data storage task is determined according to the task ID, task name, grid construction level, data source, index library name and task construction time of the storage task.

[0078] Optionally, the creating a data storage index table based on the data storage task includes: Construct a point data storage index library corresponding to the original track data or AIS data based on the data ID, coordinate system, GeoSOT grid subdivision coding level, grid code, grid code range, point data geographic coordinates, creation time, data type and attribute set of the original track data or AIS data; Construct the line data storage index library corresponding to the fused track data based on the data ID, coordinate system, GeoSOT grid subdivision code level, grid code set, grid code range set, line data, creation time, data type, and attribute set of the fused track data; Based on the data ID, coordinate system, GeoSOT grid subdivision code level, grid code set, grid code range set, surface data, creation time, data type, and attribute set of the maritime warning area data, a surface data storage index library corresponding to the maritime warning area data is constructed; An image storage index library corresponding to the image data is constructed based on the image data ID, image name, resolution, image height, image width, image coordinate range, creation time, image timestamp, preview image address, image address, number of bands, coordinate system, GeoSOT grid coding level, grid coding range, and image data type.

[0079] Optionally, encoding based on the marine spatiotemporal knowledge graph data and storage tasks using a spatiotemporal coding standard to obtain a spatiotemporal grid code includes: Determining a grid coding level of the original track data according to the storage task; According to the fused track data set and the grid coding level, the point data, line data, surface data and image data of the maritime spatiotemporal knowledge graph data are encoded respectively to obtain the grid subdivision code corresponding to each data type.

[0080] Optionally, the storing the marine spatiotemporal knowledge graph data in an index library by using the storage index table and the spatiotemporal grid code includes: For the point data, line data, surface data and image data, the generated grid subdivision code is stored in a database field; According to the grid subdivision code, the geographical range of the geographical objects of the point data, line data, surface data and image data is obtained, and the geographical range code is stored in a database; According to the storage task, the parameter data is stored in the data storage index table, wherein the parameter data includes the coding level; The attribute data other than the geographical location of the fused track data and image data is stored in the data storage index table of the database.

[0081] Optionally, the encoding and storage process of the real-time fused track data includes: Receive real-time fusion track data sent by the fusion platform and store it in the MySql database; By monitoring the log file of the MySql database, the insertion event of the MySql database is obtained to obtain the newly added data; The newly added data and storage tasks are encoded using a spatiotemporal coding standard to obtain a real-time fused track code, and the real-time fused track data is stored in an index library using the storage index table and the real-time fused track code.

[0082] It can be understood that the detailed functional implementation of each of the above-mentioned units / modules can be found in the introduction of the aforementioned method embodiment, and will not be repeated here.

[0083] It should be understood that the above-mentioned device is used to execute the method in the above-mentioned embodiment. The implementation principle and technical effect of the corresponding program module in the device are similar to those described in the above-mentioned method. The working process of the device can refer to the corresponding process in the above-mentioned method, which will not be repeated here.

[0084] Reference Figure 5Based on the method in the above embodiment, the embodiment of the present application provides an electronic device, which may include: a processor (processor) 510, a communication interface (Communications Interface) 520, a memory (memory) 530 and a communication bus 540, wherein the processor 510, the communication interface 520, and the memory 530 communicate with each other through the communication bus 540. The processor 510 can call the logic instructions in the memory 530 to execute the method in the above embodiment.

[0085] In addition, the logic instructions in the above-mentioned memory 530 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application.

[0086] Based on the method in the above embodiment, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. When the computer program runs on a processor, the processor executes the method in the above embodiment.

[0087] Based on the method in the above embodiment, an embodiment of the present application provides a computer program product. When the computer program product runs on a processor, the processor executes the method in the above embodiment.

[0088] It is understandable that the processor in the embodiment of the present application may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0089] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.

[0090] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions may be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

[0091] It should be understood that the various numerical numbers involved in the embodiments of the present application are only used for the convenience of description and are not used to limit the scope of the embodiments of the present application.

[0092] It will be easily understood by those skilled in the art that the above description is only a preferred embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A method for storing marine knowledge graph data based on spatiotemporal grid, characterized in that: include: Acquire maritime spatiotemporal knowledge graph data, and perform data preprocessing on the maritime spatiotemporal knowledge graph data to obtain a preprocessed data source; Create a data storage task according to the preprocessed data source, and create a data storage index table based on the data storage task; Based on the marine spatiotemporal knowledge graph data and storage tasks, the spatiotemporal coding standard is used for encoding to obtain a spatiotemporal grid code, and the marine spatiotemporal knowledge graph data is stored in an index library using the storage index table and the spatiotemporal grid code; Receive the real-time fused track data sent by the data fusion platform, encode the real-time fused track data and the storage task using the spatiotemporal coding standard to obtain the real-time fused track code, and use the storage index table and the real-time fused track code to store the real-time fused track data in the index library.

2. The method for storing maritime knowledge graph data according to claim 1, characterized in that: The data preprocessing of the marine spatiotemporal knowledge graph data to obtain the preprocessed data source includes: Check whether the longitude and latitude of the data needed to complete the grid coding and storage are missing, and check whether the elevation data needed to complete the three-dimensional space-time coding and storage are missing, and delete the missing data; Check whether the geographical information of the data to be coded and stored is within the valid range, and modify the data counting method to non-scientific notation. The geographical information includes longitude, latitude, altitude and heading. Check all data to be stored and delete duplicate data records to obtain the preprocessed data source.

3. The method for storing marine knowledge graph data according to claim 1, characterized in that: The creating a data storage task according to the preprocessed data source comprises: Creating a data storage task based on the original track data, fused track data, AIS data, maritime warning area data, meteorological data and image data of the pre-processed data source; The task identifier of the data storage task is determined according to the task ID, task name, grid construction level, data source, index library name and task construction time of the storage task.

4. The method for storing maritime knowledge graph data according to claim 3, characterized in that: The creating a data storage index table based on the data storage task includes: Construct a point data storage index library corresponding to the original track data or AIS data based on the data ID, coordinate system, GeoSOT grid subdivision coding level, grid code, grid code range, point data geographic coordinates, creation time, data type and attribute set of the original track data or AIS data; Construct the line data storage index library corresponding to the fused track data based on the data ID, coordinate system, GeoSOT grid subdivision code level, grid code set, grid code range set, line data, creation time, data type, and attribute set of the fused track data; Based on the data ID, coordinate system, GeoSOT grid subdivision code level, grid code set, grid code range set, surface data, creation time, data type, and attribute set of the maritime warning area data, a surface data storage index library corresponding to the maritime warning area data is constructed; An image storage index library corresponding to the image data is constructed based on the image data ID, image name, resolution, image height, image width, image coordinate range, creation time, image timestamp, preview image address, image address, number of bands, coordinate system, GeoSOT grid coding level, grid coding range, and image data type.

5. The method for storing marine knowledge graph data according to claim 4, characterized in that: The method of encoding the marine spatiotemporal knowledge graph data and storage tasks using a spatiotemporal coding standard to obtain a spatiotemporal grid code includes: Determining a grid coding level of the original track data according to the storage task; According to the fused track data set and the grid coding level, the point data, line data, surface data and image data of the maritime spatiotemporal knowledge graph data are encoded respectively to obtain the grid subdivision code corresponding to each data type.

6. The method for storing marine knowledge graph data according to claim 5, characterized in that: The storing of the marine spatiotemporal knowledge graph data in the index library by using the storage index table and the spatiotemporal grid code includes: For the point data, line data, surface data and image data, the generated grid subdivision code is stored in a database field; According to the grid subdivision code, the geographical range of the geographical objects of the point data, line data, surface data and image data is obtained, and the geographical range code is stored in a database; According to the storage task, the parameter data is stored in the data storage index table, wherein the parameter data includes the coding level; The attribute data other than the geographical location of the fused track data and image data is stored in the data storage index table of the database.

7. The method for storing marine knowledge graph data according to claim 1, characterized in that: The encoding and storage process of the real-time fused track data includes: Receive real-time fusion track data sent by the fusion platform and store it in the MySql database; By monitoring the log file of the MySql database, the insertion event of the MySql database is obtained to obtain the newly added data; The newly added data and storage tasks are encoded using a spatiotemporal coding standard to obtain a real-time fused track code, and the real-time fused track data is stored in an index library using the storage index table and the real-time fused track code.

8. A marine knowledge graph data storage system based on spatiotemporal grid, characterized in that: include: An acquisition module, used to acquire maritime spatiotemporal knowledge graph data, and perform data preprocessing on the maritime spatiotemporal knowledge graph data to obtain a preprocessed data source; A creation module, used to create a data storage task according to the preprocessed data source, and create a data storage index table based on the data storage task; An encoding module is used to encode the marine spatiotemporal knowledge graph data and the storage task using a spatiotemporal encoding standard to obtain a spatiotemporal grid code, and to store the marine spatiotemporal knowledge graph data in an index library using the storage index table and the spatiotemporal grid code; The real-time encoding module is used to receive the real-time fused track data sent by the data fusion platform, encode the real-time fused track data and the storage task using the spatiotemporal coding standard to obtain the real-time fused track code, and use the storage index table and the real-time fused track code to store the real-time fused track data in the index library.

9. An electronic device, characterized in that: include: at least one memory for storing a computer program; At least one processor is used to execute the program stored in the memory. When the program stored in the memory is executed, the processor is used to execute the method according to any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program runs on a processor, the processor is caused to execute the method according to any one of claims 1 to 7.

Images