Spatial data management system for digital city multi-source data

By designing a spatial data management system for digital cities, the integration and distributed management of multi-source spatial data is realized, the data synchronization and independence problems in digital cities are solved, and data management efficiency and compatibility are improved.

CN118967067AInactive Publication Date: 2024-11-15JINGCAI FUTURE INTELLIGENT TECH CO LTD
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411442723.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-16
Publication Date
2024-11-15
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

How to integrate and distributed management of multi-source spatial data in digital cities to achieve data synchronization and independence while improving data management efficiency.

Method used

Design a spatial data management system for digital cities, including data source module, data processing module, data integration module and data storage module. Through real-time acquisition, standardized processing, multi-source data synchronization, data integration and encrypted storage, multi-source data Data retrieval strategy to ensure data compatibility and independence.

Benefits of technology

It improves the comprehensive management efficiency and independence of spatial data at different data sources, realizes data compatibility and distributed management, and enhances the efficiency and security of data management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118967067A_ABST
    Figure CN118967067A_ABST
Patent Text Reader

Abstract

The invention discloses a digital city multi-source data-oriented spatial data management system, which relates to the technical field of data management, and comprises a management center, and the management center is in communication connection with a data source module, a data processing module, a data integration module and a data storage module; the data source module is used for accessing different types of data source ends, and the data source ends upload corresponding spatial data to the data source module in real time; the data processing module is used for processing the obtained spatial data to obtain a corresponding standardized data stream, and performing multi-source data synchronization on the obtained standardized data stream to obtain a multi-source synchronous data stream; the data integration module is used for carrying out data integration on the multi-source synchronous data stream to obtain a data compression packet; and the data storage module is used for carrying out encrypted storage on the obtained data compression package, and constructing a multi-source data retrieval strategy after the encrypted storage is completed, so that the management efficiency of the multi-source spatial data is realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the technical field of data management, in particular to a spatial data management system for multi-source data of digital cities. Background Art

[0002] The digital city is based on the building information model and the urban three-dimensional geographic information system. It uses the Internet of Things technology to digitize all the elements of the physical city, such as people, objects, events, water, electricity, gas, etc., and then constructs a "virtual city" in cyberspace that is completely corresponding to it, forming a situation in which the physical city in the physical dimension and the digital city in the information dimension coexist and the virtual and the real blend.

[0003] How to integrate multi-source spatial data so that multi-source data can complete data synchronization while distributing the spatial data of each source, thereby improving the independence of spatial data of each source and comprehensively managing spatial data from different sources to improve data management efficiency is a problem we need to solve. To this end, a spatial data management system for multi-source data of digital cities is now provided. Summary of the invention

[0004] The purpose of the present invention is to provide a spatial data management system for multi-source data of digital cities.

[0005] The object of the present invention can be achieved by the following technical solutions: A spatial data management system for multi-source data of digital cities, comprising a management center, wherein the management center is communicatively connected with a data source module, a data processing module, a data integration module and a data storage module;

[0006] The data source module is used to access different types of data source terminals, and the data source terminals upload corresponding spatial data to the data source module in real time;

[0007] The data processing module is used to process the obtained spatial data to obtain a corresponding standardized data stream, and to perform multi-source data synchronization on the obtained standardized data stream to obtain a multi-source synchronized data stream;

[0008] The data integration module is used to integrate the multi-source synchronous data streams to obtain a data compression package;

[0009] The data storage module is used to encrypt and store the obtained data compression package, and after completing the encrypted storage, construct a multi-source data retrieval strategy.

[0010] Furthermore, the process of the data source end uploading the corresponding spatial data to the data source module in real time includes:

[0011] Data source terminals are set up at different locations in the city, and corresponding data source identification codes are set for each data source terminal, so that spatial data of the location can be collected in real time through the set data source terminals;

[0012] The basic information of the data source associated with the set data source identification code; the basic information of the data source includes the location coordinates of the data source, the type of spatial data collected, and the data transmission protocol;

[0013] The spatial data of the location is obtained in real time through each data source, and a corresponding timestamp is generated according to the time when the spatial data is obtained;

[0014] The generated timestamp is associated with the corresponding spatial data.

[0015] Furthermore, the process of the data processing module processing the acquired spatial data includes:

[0016] According to the basic information of each data source, a corresponding blank data sequence is constructed;

[0017] Generate a corresponding time series according to the timestamps associated with the spatial data, and map the obtained time series into the blank data series;

[0018] Convert the obtained spatial data into a corresponding spatial data stream, and import the obtained spatial data stream into a blank data sequence according to a time series;

[0019] A standardized data sequence is constructed, and the spatial data streams in each blank data sequence are standardized through the standardized data sequence to obtain the corresponding standardized data streams.

[0020] Furthermore, the process of normalizing the spatial data streams in each blank data sequence to obtain the corresponding normalized data streams includes:

[0021] Generate corresponding coordinate labels, type labels and protocol labels according to the location coordinates of the data source end in the basic information of the data source end corresponding to the data flow in the blank data sequence, the type of spatial data collected and the data transmission protocol;

[0022] Obtain corresponding coordinate data stream segments, type data stream segments, and protocol data stream segments according to the generated coordinate tags, type tags, and protocol tags;

[0023] The coordinate data stream segments, the type data stream segments and the protocol data stream segments are converted and assigned to categories to obtain corresponding category values, and a corresponding standardized category sequence is obtained according to the obtained category values;

[0024] Converting the spatial data stream into a binary data stream composed of binary unit codes, and fitting the obtained standardized category sequence to the binary data stream to obtain a fitting data stream;

[0025] The fitting data stream is divided into a number of data stream segments with the same data length, and the obtained data stream segments are associated with the corresponding time series, and the obtained data stream segments are recorded as standardized data streams.

[0026] Furthermore, the obtained standardized data stream is synchronized with multiple sources, and the process of obtaining the multi-source synchronized data stream includes:

[0027] Read the time series associated with each data stream fragment, and establish a data transmission thread according to the read time series;

[0028] According to the number of data source terminals, set the threshold of the number of associated sequences of the data transmission thread;

[0029] Get the number of time series associated with the data transmission thread and compare it with the threshold of the number of associated series;

[0030] When the number of time series associated with the data transmission thread is consistent with the threshold of the number of associated series, the standardized data streams associated with each time series are aggregated to obtain a multi-source synchronous data stream.

[0031] Furthermore, the process of the data integration module integrating the multi-source synchronous data streams includes:

[0032] Extract each multi-source synchronous data stream, restore the data stream fragments at the same data source end, and obtain the corresponding fitting data stream;

[0033] Reading the type data stream segments and the protocol data stream segments in the standardized category sequence in the fitting data stream, and constructing corresponding integration items according to the read type data stream segments and the protocol data stream segments;

[0034] Traverse all integration items and establish corresponding data storage space according to the integration items;

[0035] Import the fitting data stream into the corresponding data storage space according to the integration item, generate a corresponding data source end index sequence according to each coordinate data stream segment in the fitting data stream imported into the data storage space, and associate the data source end index sequence with the corresponding fitting data stream;

[0036] Each data storage space is compressed to obtain a corresponding data compression package, and the data compression package is uploaded to the data storage module.

[0037] Furthermore, the process of the data storage module encrypting and storing the data compression package includes:

[0038] Constructing a data storage space in the data storage module, and setting an encryption port for the constructed data storage space;

[0039] Importing the obtained data compression package into the data storage space through the encryption port, and during the importing process, reading the size of the data compression package and the remaining capacity of the data storage space;

[0040] If the size of the data compression package is not greater than the remaining capacity of the data storage space, the data compression package is imported into the data storage space, otherwise it is not imported;

[0041] Obtaining a data source end index sequence and a time span sequence of data stream segments in the imported data compression package;

[0042] Fitting the obtained data source index sequence and time span sequence to obtain a storage space loading sequence;

[0043] Performing cyclic redundancy encryption on the obtained storage space loading sequence to obtain a corresponding cyclic redundancy code;

[0044] The obtained cyclic redundancy code is uploaded to the management center for storage and backup, and the cyclic redundancy code is used as the source verification code.

[0045] Furthermore, the process of constructing a multi-source data retrieval strategy by the data storage module includes:

[0046] When a data source needs to query the data stored in the data storage space, the data source is recorded as the application end, and the data source corresponding to the data storage space to be queried is recorded as the query end. The application end creates a data query application and sends the data query application to the management center;

[0047] When the query end is consistent with the application end, the management center sends a source verification code to the encryption port of the corresponding data storage space, and builds a data export channel for the encryption port of the data storage space according to the source verification code of the management center. The application end obtains the data in the data storage space through the constructed data export channel;

[0048] When the query end is inconsistent with the application end, the management center generates query verification information and sends the query verification information to the query end. After the query end verifies the query verification information, the management center sends the source verification code corresponding to the query end to the encrypted port of the data storage space. According to the source verification code of the management center, a data export channel is constructed for the encrypted port of the data storage space, and the application end obtains the data in the data storage space through the constructed data export channel.

[0049] Compared with the prior art, the present invention has the following beneficial effects:

[0050] 1. By standardizing the spatial data obtained from different data sources, the corresponding standardized data stream is obtained. Therefore, even if the basic information of the data sources of different data sources is different, the spatial data obtained from each data source can reach a consistent data nature before being uploaded to the data storage module, thereby improving the compatibility of the data and further improving the comprehensive management efficiency of the spatial data from different data sources;

[0051] 2. By setting different data storage spaces in the data storage module for different data sources, and classifying the spatial data of the same data source, the same type of spatial data from the same data source is stored through the data storage space, thereby realizing distributed management of different data sources and improving the relative independence of spatial data management of each data source. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For ordinary technicians in this field, other drawings can also be obtained based on these drawings.

[0053] Figure 1 It is a schematic diagram of the present invention. DETAILED DESCRIPTION

[0054] like Figure 1 As shown, a spatial data management system for multi-source data of digital cities includes a management center, wherein the management center is communicatively connected with a data source module, a data processing module, a data integration module and a data storage module;

[0055] The data source module is used to access different types of data source terminals, and the data source terminals upload corresponding spatial data to the data source module in real time. The specific process includes:

[0056] Data source terminals are set up at different locations in the city, and corresponding data source identification codes are set for each data source terminal, so that spatial data of the location can be collected in real time through the set data source terminals;

[0057] The basic information of the data source associated with the set data source identification code; it should be further explained that, in the specific implementation process, the basic information of the data source includes the location coordinates of the data source, the type of spatial data collected, and the data transmission protocol;

[0058] The spatial data of the location is obtained in real time through each data source, and a corresponding timestamp is generated according to the time when the spatial data is obtained;

[0059] Associating the generated timestamp with the corresponding spatial data;

[0060] A loading communication link connected to the data source module is constructed according to the basic information of the data source end, and the data source end loads the acquired spatial data into the data source module through the constructed loading communication link.

[0061] The data processing module is used to process the acquired spatial data, and the specific process includes:

[0062] According to the basic information of each data source, a corresponding blank data sequence is constructed;

[0063] Generate a corresponding time series according to the timestamps associated with the spatial data, and map the obtained time series into the blank data series;

[0064] Convert the obtained spatial data into a corresponding spatial data stream, and import the obtained spatial data stream into a blank data sequence according to a time series;

[0065] Constructing a standardized data sequence, and performing standardized processing on the spatial data streams in each blank data sequence through the standardized data sequence to obtain a corresponding standardized data stream;

[0066] It should be further explained that, in the specific implementation process, the spatial data streams in each blank data sequence are standardized to obtain the corresponding standardized data streams, including:

[0067] Generate corresponding coordinate labels, type labels and protocol labels according to the location coordinates of the data source end in the basic information of the data source end corresponding to the data flow in the blank data sequence, the type of spatial data collected and the data transmission protocol;

[0068] Obtain corresponding coordinate data stream segments, type data stream segments, and protocol data stream segments according to the generated coordinate tags, type tags, and protocol tags;

[0069] The coordinate data stream segments, the type data stream segments and the protocol data stream segments are converted and assigned to categories to obtain corresponding category values, and a corresponding standardized category sequence is obtained according to the obtained category values;

[0070] Converting the spatial data stream into a binary data stream composed of binary unit codes, and fitting the obtained standardized category sequence to the binary data stream to obtain a fitting data stream;

[0071] Divide the fitting data stream into a number of data stream segments with the same data length, associate the obtained data stream segments with the corresponding time series, and record the obtained data stream segments as standardized data streams;

[0072] Performing multi-source data synchronization on the obtained standardized data stream to obtain a multi-source synchronized data stream;

[0073] It should be further explained that, in the specific implementation process, the obtained standardized data stream is synchronized with multiple sources, and the process of obtaining the multi-source synchronized data stream includes:

[0074] Read the time series associated with each data stream segment, and establish a data transmission thread according to the read time series; it should be further explained that, in the specific implementation process, the same time series is associated with the same data transmission thread;

[0075] According to the number of data source terminals, set the threshold of the number of associated sequences of the data transmission thread;

[0076] Get the number of time series associated with the data transmission thread and compare it with the threshold of the number of associated series;

[0077] When the number of time series associated with the data transmission thread is consistent with the threshold of the number of associated series, the standardized data streams associated with each time series are aggregated to obtain a multi-source synchronous data stream;

[0078] The obtained multi-source synchronous data stream is uploaded to the data integration module through the data transmission thread, and the obtained multi-source synchronous data stream is integrated through the data integration module. After the data transmission thread completes the transmission of the multi-source synchronous data stream, the data transmission thread is invalidated and cleared.

[0079] It should be further explained that, in a specific implementation process, the process of the data integration module integrating the multi-source synchronous data streams includes:

[0080] Extract each multi-source synchronous data stream, restore the data stream fragments at the same data source end, and obtain the corresponding fitting data stream;

[0081] Read the type data stream segments and the protocol data stream segments in the standardized category sequence in the fitting data stream, and construct corresponding integration items according to the read type data stream segments and the protocol data stream segments; it should be further explained that, in the specific implementation process, the same type data stream segments are one integration item, and the same protocol data stream segments are one integration item;

[0082] Traverse all integration items and establish corresponding data storage space according to the integration items;

[0083] Import the fitting data stream into the corresponding data storage space according to the integration item, generate a corresponding data source end index sequence according to each coordinate data stream segment in the fitting data stream imported into the data storage space, and associate the data source end index sequence with the corresponding fitting data stream;

[0084] Each data storage space is compressed to obtain a corresponding data compression package, and the data compression package is uploaded to the data storage module. The data storage module encrypts and stores the data compression package, and after the encrypted storage is completed, a multi-source data retrieval strategy is constructed.

[0085] It should be further explained that, in the specific implementation process, the process of the data storage module encrypting and storing the data compression package includes:

[0086] Constructing a data storage space in the data storage module, and setting an encryption port for the constructed data storage space;

[0087] Importing the obtained data compression package into the data storage space through the encryption port, and during the importing process, reading the size of the data compression package and the remaining capacity of the data storage space;

[0088] If the size of the data compression package is not greater than the remaining capacity of the data storage space, the data compression package is imported into the data storage space, otherwise it is not imported;

[0089] Obtaining the data source end index sequence and the time span sequence of the data stream fragment in the imported data compression package; it should be further explained that, in the specific implementation process, the time span sequence is specifically a time sequence generated by combining the earliest time and the latest time in the time corresponding to the time sequence of the data stream fragment;

[0090] Fitting the obtained data source index sequence and time span sequence to obtain a storage space loading sequence;

[0091] Performing cyclic redundancy encryption on the obtained storage space loading sequence to obtain a corresponding cyclic redundancy code;

[0092] The obtained cyclic redundancy code is uploaded to the management center for storage and backup, and the cyclic redundancy code is used as the source verification code.

[0093] It should be further explained that, in the specific implementation process, when a new compressed data packet is imported into the data storage space and the time span sequence changes, the cyclic redundancy code is regenerated, and the cyclic redundancy code stored in the backup in the management center is updated, and the latest cyclic redundancy code is used as the source verification code.

[0094] It should be further explained that, in the specific implementation process, the process of the data storage module constructing a multi-source data retrieval strategy includes:

[0095] When a data source needs to query the data stored in the data storage space, the data source is recorded as the application end, and the data source corresponding to the data storage space to be queried is recorded as the query end. The application end creates a data query application and sends the data query application to the management center;

[0096] When the query end is consistent with the application end, the management center sends a source verification code to the encryption port of the corresponding data storage space, and builds a data export channel for the encryption port of the data storage space according to the source verification code of the management center. The application end obtains the data in the data storage space through the constructed data export channel;

[0097] When the query end is inconsistent with the application end, the management center generates query verification information and sends the query verification information to the query end. After the query end verifies the query verification information, the management center sends the source verification code corresponding to the query end to the encrypted port of the data storage space. According to the source verification code of the management center, a data export channel is constructed for the encrypted port of the data storage space, and the application end obtains the data in the data storage space through the constructed data export channel.

[0098] The above embodiments are only used to illustrate the technical method of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical method of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical method of the present invention.

Claims

1. A spatial data management system for multi-source data of digital cities, comprising a management center, characterized in that: The management center is communicatively connected with a data source module, a data processing module, a data integration module and a data storage module; The data source module is used to access different types of data source terminals, and the data source terminals upload corresponding spatial data to the data source module in real time; The data processing module is used to process the obtained spatial data to obtain a corresponding standardized data stream, and to perform multi-source data synchronization on the obtained standardized data stream to obtain a multi-source synchronized data stream; The data integration module is used to integrate the multi-source synchronous data streams to obtain a data compression package; The data storage module is used to encrypt and store the obtained data compression package, and after completing the encrypted storage, construct a multi-source data retrieval strategy.

2. A spatial data management system for multi-source data of digital cities according to claim 1, characterized in that: The process of uploading corresponding spatial data to the data source module in real time includes: Data source terminals are set up at different locations in the city, and corresponding data source identification codes are set for each data source terminal, so that spatial data of the location can be collected in real time through the set data source terminals; The basic information of the data source associated with the set data source identification code; the basic information of the data source includes the location coordinates of the data source, the type of spatial data collected, and the data transmission protocol; The spatial data of the location is obtained in real time through each data source, and a corresponding timestamp is generated according to the time when the spatial data is obtained; The generated timestamp is associated with the corresponding spatial data.

3. A spatial data management system for multi-source data of digital cities according to claim 2, characterized in that: The process of the data processing module processing the acquired spatial data includes: According to the basic information of each data source, a corresponding blank data sequence is constructed; Generate a corresponding time series according to the timestamps associated with the spatial data, and map the obtained time series into the blank data series; Convert the obtained spatial data into a corresponding spatial data stream, and import the obtained spatial data stream into a blank data sequence according to a time series; A standardized data sequence is constructed, and the spatial data streams in each blank data sequence are standardized through the standardized data sequence to obtain the corresponding standardized data streams.

4. A spatial data management system for multi-source data of digital cities according to claim 3, characterized in that: The process of standardizing the spatial data streams in each blank data sequence to obtain the corresponding standardized data streams includes: Generate corresponding coordinate labels, type labels and protocol labels according to the location coordinates of the data source end in the basic information of the data source end corresponding to the data flow in the blank data sequence, the type of spatial data collected and the data transmission protocol; Obtain corresponding coordinate data stream segments, type data stream segments, and protocol data stream segments according to the generated coordinate tags, type tags, and protocol tags; The coordinate data stream segments, the type data stream segments and the protocol data stream segments are converted and assigned to categories to obtain corresponding category values, and a corresponding standardized category sequence is obtained according to the obtained category values; Converting the spatial data stream into a binary data stream composed of binary unit codes, and fitting the obtained standardized category sequence to the binary data stream to obtain a fitting data stream; The fitting data stream is divided into a number of data stream segments with the same data length, and the obtained data stream segments are associated with the corresponding time series, and the obtained data stream segments are recorded as standardized data streams.

5. A spatial data management system for multi-source data of digital cities according to claim 4, characterized in that: The obtained standardized data stream is synchronized with multiple sources. The process of obtaining the multi-source synchronized data stream includes: Read the time series associated with each data stream fragment, and establish a data transmission thread according to the read time series; According to the number of data source terminals, set the threshold of the number of associated sequences of the data transmission thread; Obtain the number of time series associated with the data transmission thread and compare it with the threshold of the number of associated series; When the number of time series associated with the data transmission thread is consistent with the threshold of the number of associated series, the standardized data streams associated with each time series are aggregated to obtain a multi-source synchronous data stream.

6. A spatial data management system for multi-source data of digital cities according to claim 5, characterized in that: The process of data integration of multi-source synchronous data streams by the data integration module includes: Extract each multi-source synchronous data stream, restore the data stream fragments at the same data source end, and obtain the corresponding fitting data stream; Reading the type data stream segments and the protocol data stream segments in the standardized category sequence in the fitting data stream, and constructing corresponding integration items according to the read type data stream segments and the protocol data stream segments; Traverse all integration items and establish corresponding data storage space according to the integration items; Import the fitting data stream into the corresponding data storage space according to the integration item, generate a corresponding data source end index sequence according to each coordinate data stream segment in the fitting data stream imported into the data storage space, and associate the data source end index sequence with the corresponding fitting data stream; Each data storage space is compressed to obtain a corresponding data compression package, and the data compression package is uploaded to the data storage module.

7. A spatial data management system for multi-source data of digital cities according to claim 6, characterized in that: The process of encrypting and storing the data compression package by the data storage module includes: Constructing a data storage space in the data storage module, and setting an encryption port for the constructed data storage space; Importing the obtained data compression package into the data storage space through the encryption port, and during the importing process, reading the size of the data compression package and the remaining capacity of the data storage space; If the size of the data compression package is not greater than the remaining capacity of the data storage space, the data compression package is imported into the data storage space, otherwise it is not imported; Obtaining a data source end index sequence and a time span sequence of data stream segments in the imported data compression package; Fitting the obtained data source index sequence and time span sequence to obtain a storage space loading sequence; Performing cyclic redundancy encryption on the obtained storage space loading sequence to obtain a corresponding cyclic redundancy code; The obtained cyclic redundancy code is uploaded to the management center for storage and backup, and the cyclic redundancy code is used as the source verification code.

8. A spatial data management system for multi-source data of digital cities according to claim 7, characterized in that: The process of constructing a multi-source data retrieval strategy by the data storage module includes: When a data source needs to query the data stored in the data storage space, the data source is recorded as the application end, and the data source corresponding to the data storage space to be queried is recorded as the query end. The application end creates a data query application and sends the data query application to the management center; When the query end is consistent with the application end, the management center sends a source verification code to the encryption port of the corresponding data storage space, and builds a data export channel for the encryption port of the data storage space according to the source verification code of the management center. The application end obtains the data in the data storage space through the constructed data export channel; When the query end is inconsistent with the application end, the management center generates query verification information and sends the query verification information to the query end. After the query end verifies the query verification information, the management center sends the source verification code corresponding to the query end to the encrypted port of the data storage space. According to the source verification code of the management center, a data export channel is constructed for the encrypted port of the data storage space, and the application end obtains the data in the data storage space through the constructed data export channel.

Citation Information

Patent Citations

  • Urban multi-source data whole-process comprehensive management system

    CN114282903A

  • Fusion method of digital city multi-source data

    CN116503705A

  • Multi-source heterogeneous data fusion method and system capable of being used for digital twinning

    CN117056867A

  • Transmission processing storage system based on regional level monitoring data

    CN118132631A