Multi-source heterogeneous data storage method, device and medium for territorial space planning
By constructing a first index table and a second index table, the problems of redundancy and inconsistency of multi-source heterogeneous data in territorial spatial planning were solved, achieving efficient and unified storage and management of data and enhancing data connectivity.
Patent Information
- Application Number
- CN202210247959.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-14
- Publication Date
- 2026-01-02
- Estimated Expiration
- 2042-03-14
AI Technical Summary
In land spatial planning, the redundancy, inconsistency, and weak correlation of data quality among multi-source heterogeneous data lead to low data management efficiency.
By constructing a first index table and a second index table, spatial data and non-spatial data are stored and managed respectively. Data storage and retrieval are performed using unified index information, including detailed information such as coordinate information, storage path, and timestamp of spatial data.
It enables data from different sources and structures to be stored and managed in a unified manner, enhancing the connection between data and management efficiency.
Smart Images

Figure CN116795906B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of GIS, in particular, the present application relates to a multi-source heterogeneous data storage method, device and medium for land space planning BACKGROUND
[0002] An important part of land space planning is to establish a smart city, and the smart city is a new concept and mode of city development in the world today, and is a product of the deep integration of new generation information technology innovation application and city economic and social development. The smart city is based on new generation information technology such as Internet of Things, cloud computing, mobile Internet and big data, dynamically obtains, perceives, analyzes and integrates city data in a networked and interconnected way, promotes the efficient and convenient operation of various industries such as transportation, safety, service and medical treatment in modern cities, and improves the intelligent and fine management level of city operation and management.
[0003] Under this background, the types and quantities of managed data are growing. These data not only include spatial data and non-spatial data, but also include structured data and unstructured data. However, due to the non-uniformity of the compiling organization and standard, the obtained data has the problems of redundancy, inconsistency and weak data quality connection. SUMMARY
[0004] The embodiment of the present application provides a multi-source heterogeneous data storage method, device and medium for land space planning. The technical scheme is as follows:
[0005] According to one aspect of the embodiment of the present application, a multi-source heterogeneous data storage method for land space planning is provided, which comprises: acquiring spatial data and at least one non-spatial data of each geographical region, determining the region identifier of each geographical region and the data identifier of each non-spatial data;
[0006] Creating first index information corresponding to each geographical region in the first index table, the first row key of the first index information is the region identifier of the corresponding geographical region, and the first column family includes the data identifier of the non-spatial data of the corresponding geographical region;
[0007] Creating second index information corresponding to each geographical region in the second index table, the second index information includes a plurality of second row keys, each second row key is the data identifier of one non-spatial data of the corresponding geographical region, and the second column family includes at least one of the data type and the data name of the corresponding non-spatial data.
[0008] In one possible implementation, the first column family in the first index table further includes: coordinate information of the spatial data of the each geographical region.
[0009] In a possible implementation, the obtaining the spatial data and the at least one non-spatial data of each geographic region further includes:
[0010] According to the data types of the spatial data and the at least one non-spatial data, the storage modes of the spatial data and the at least one non-spatial data are determined correspondingly;
[0011] The spatial data and the at least one non-spatial data are stored respectively according to the storage modes.
[0012] In a possible implementation, the storing the spatial data and the at least one non-spatial data respectively according to the storage modes further includes:
[0013] Obtaining first storage path information of the spatial data and second storage path information of the at least one non-spatial data;
[0014] Creating first index information corresponding to each geographic region in a first index table further includes:
[0015] Recording the first storage path information of the corresponding spatial data in a first column family in the first index table;
[0016] Creating second index information corresponding to each geographic region in a second index table further includes:
[0017] Recording the second storage path information of the corresponding non-spatial data in a second column family in the second index table.
[0018] In a possible implementation, the obtaining the spatial data and the at least one non-spatial data of each geographic region further includes:
[0019] Obtaining a first time stamp for creating the spatial data;
[0020] Creating first index information corresponding to each geographic region in a first index table further includes:
[0021] Recording the first time stamp of the corresponding spatial data in the first index information.
[0022] According to another aspect of the embodiments of the present application, a method for multi-source heterogeneous data retrieval of land space planning is provided, which includes:
[0023] Obtaining a retrieval request, the retrieval request including a target area identifier of a geographic region to be queried;
[0024] Retrieving first target index information with a first row key being the target area identifier in a first index table established in advance, and determining data identifiers of each non-spatial data included in a first column family of the first target index information;
[0025] retrieving, in a pre-established second index table, second target index information with second row keys as data identifiers of the respective non-spatial data, and determining that at least one of a data type and a data name of non-spatial data included in a second column family of the second target index information;
[0026] obtaining a retrieval result including at least one of the data type and the data name of the non-spatial data;
[0027] The first index table and the second index table are created according to the multi-source heterogeneous data storage method for national space planning.
[0028] In a possible implementation, the first column family in the first index table further includes coordinate information of the spatial data of the respective geographic regions.
[0029] The retrieval result further includes coordinate information of the respective spatial data.
[0030] In a possible implementation, the determining of the data identifiers of the respective non-spatial data included in the first column family of the first target index information further includes:
[0031] determining first storage path information of the respective spatial data included in the first column family in the first index table;
[0032] The determining of at least one of the data type and the data name of the non-spatial data included in the second column family of the second target index information further includes:
[0033] determining second storage path information of the respective non-spatial data included in the second column family in the second index table;
[0034] The obtaining of the retrieval result further includes:
[0035] obtaining the spatial data according to the first storage path information;
[0036] obtaining the non-spatial data according to the second storage path information.
[0037] In a possible implementation, the retrieval request further includes time information to be queried.
[0038] The determining of the data identifiers of the respective non-spatial data included in the first column family of the first target index information further includes:
[0039] determining a target timestamp conforming to the time information to be queried in the first index table;
[0040] determine first storage path information of target spatial data in the first column family corresponding to the target timestamp according to the first storage path information; and determine the target spatial data according to the first storage path information.
[0041] In a possible implementation, after the first index table determines the target timestamp that meets the time information to be queried, the method further includes:
[0042] determine data identifier of target non-spatial data in the first column family corresponding to the target timestamp;
[0043] determine second storage path information of the target non-spatial data in the second column family corresponding to the data identifier of the target non-spatial data in the second index table according to the data identifier of the target non-spatial data;
[0044] determine the target non-spatial data according to the second storage path information.
[0045] According to another aspect of the embodiments of the present application, a device for multi-source heterogeneous data storage of land space planning is provided, and the device includes:
[0046] a first obtaining module, configured to obtain spatial data and at least one kind of non-spatial data of each geographical region, and determine region identifier of each geographical region and data identifier of each non-spatial data;
[0047] a first constructing module, configured to create first index information corresponding to each geographical region in a first index table, wherein a first row key of the first index information is region identifier of the corresponding geographical region, and a first column family includes data identifier of the non-spatial data of the corresponding geographical region;
[0048] a second constructing module, configured to create second index information corresponding to each geographical region in a second index table, wherein the second index information includes a plurality of second row keys, each second row key is data identifier of one kind of non-spatial data of the corresponding geographical region, and a second column family includes at least one of data type and data name of the corresponding non-spatial data.
[0049] According to another aspect of the embodiments of the present application, a device for multi-source heterogeneous data retrieval of land space planning is provided, and the device includes:
[0050] a second obtaining module, configured to obtain a retrieval request, wherein the retrieval request includes target region identifier of a geographical region to be queried;
[0051] a first retrieving module, configured to retrieve first target index information with the target region identifier as a first row key in a first index table established in advance, and determine data identifier of each non-spatial data included in a first column family of the first target index information;
[0052] The second retrieval module is configured to retrieve second target index information with a second row key being a data identifier of the non-spatial data from a second index table established in advance, and determine at least one of a data type and a data name of the non-spatial data included in a second column family of the second target index information.
[0053] The determining module is configured to obtain a retrieval result including at least one of the data type and the data name of the non-spatial data, wherein the first index table and the second index table are created according to the multi-source heterogeneous data storage method for land space planning.
[0054] According to another aspect of the embodiments of the present application, an electronic device is provided, which includes:
[0055] The memory, the processor and the computer program stored in the memory are characterized in that the processor executes the computer program to implement the steps of the multi-source heterogeneous data storage method for land space planning and the multi-source heterogeneous data retrieval method for land space planning.
[0056] According to another aspect of the embodiments of the present application, a computer readable storage medium is provided, which, when executed by a processor, implements the steps of the multi-source heterogeneous data storage method for land space planning and the multi-source heterogeneous data retrieval method for land space planning.
[0057] The technical scheme provided by the embodiments of the present application has the beneficial effects that different sources and different structures of data are stored and managed in a unified manner, and the connection between different sources and different structures of data is enhanced. BRIEF DESCRIPTION OF DRAWINGS
[0058] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the description of the embodiments of the present application will be briefly introduced.
[0059] Figure 1 The system architecture diagram for implementing the multi-source heterogeneous data storage method for land space planning provided by the embodiments of the present application is shown.
[0060] Figure 2 The flowchart of the multi-source heterogeneous data storage method for land space planning provided by the embodiments of the present application is shown.
[0061] Figure 3 The first index representation provided by the embodiments of the present application is shown.
[0062] Figure 4 The second index representation provided by the embodiments of the present application is shown.
[0063] Figure 5 A flowchart of a multi-source heterogeneous data retrieval method for land space planning provided by an embodiment of the present application is shown in FIG. 1.
[0064] Figure 6 A structural diagram of a multi-source heterogeneous data storage device for land space planning provided by an embodiment of the present application is shown in FIG. 2.
[0065] Figure 7 A structural diagram of a multi-source heterogeneous data retrieval device for land space planning provided by an embodiment of the present application is shown in FIG. 3.
[0066] Figure 8 A structural diagram of an electronic device for multi-source heterogeneous data storage for land space planning provided by an embodiment of the present application is shown in FIG. 4. DETAILED DESCRIPTION
[0067] Embodiments of the present application will be described below in conjunction with the accompanying drawings. It should be understood that the embodiments described below in conjunction with the accompanying drawings are exemplary descriptions of the technical solutions of the embodiments of the present application, and do not limit the technical solutions of the embodiments of the present application.
[0068] Those skilled in the art can understand that, unless specifically stated otherwise, the singular forms "a", "an" and "the" used herein can also include the plural forms. It should be further understood that the terms "comprise" and "include" used in the embodiments of the present application mean that the corresponding features can be implemented as the presented features, information, data, steps, operations, elements and / or components, but do not exclude other features, information, data, steps, operations, elements, components and / or combinations thereof supported by the present technology. It should be understood that when we say that an element is "connected" or "coupled" to another element, the element can be directly connected or coupled to the other element, or it can mean that the element and the other element are connected through an intermediate element. In addition, "connected" or "coupled" used herein can include wireless connection or wireless coupling. The term "and / or" used herein means that at least one of the items defined by the term, for example, "A and / or B" can be implemented as "A", or as "B", or as "A and B".
[0069] To make the purposes, technical solutions and advantages of the present application clearer, the embodiments of the present application will be described in further detail below in conjunction with the accompanying drawings.
[0070] First, several terms related to the present application are introduced and explained:
[0071] Multi-source heterogeneous data: data with diverse sources and different data structures.
[0072] Spatial data: Spatial data is the description of spatial things. Spatial data is essentially data that uses the spatial position of the earth's surface as a reference to describe the position, shape, size, and distribution characteristics of spatial entities. Spatial data is a kind of data with spatial coordinates, including text, numbers, graphics, images, sound, and other forms.
[0073] Non-spatial data: Non-spatial data is a geographical variable or geographical meaning associated with geographical entities.
[0074] Structured data: Structured data, also known as row data, is data logically represented and implemented by two-dimensional table structure, strictly following data format and length specifications, mainly stored and managed by relational databases.
[0075] Unstructured data: Unstructured data is data with irregular or incomplete structure, without a predefined data model, and is not convenient to represent with a two-dimensional logical table of a database.
[0076] The application provides a multi-source heterogeneous data storage method for land space planning, a device storage medium, and aims to solve the technical problems existing in the prior art.
[0077] Figure 1 The system architecture diagram for implementing the multi-source heterogeneous data storage for land space planning provided by the embodiments of the application, wherein the multi-source heterogeneous data is obtained at the data source layer, the multi-source heterogeneous data includes spatial data and non-spatial data, the spatial data includes structured data and unstructured data, and the non-spatial data includes structured data and unstructured data. The data at the data source layer is processed through the data processing layer, and the processed data is stored in the data storage layer. At the same time, the data management and application layer is designed to manage data, perform data analysis, and perform visual processing on the stored data.
[0078] As shown in Figure 2 The application provides a multi-source heterogeneous data storage method for land space planning, which can include:
[0079] S201, obtaining spatial data and at least one non-spatial data of each geographical region, determining the region identifier of each geographical region and the data identifier of each non-spatial data.
[0080] In the embodiments of the present application, after the spatial data and the at least one non-spatial data of each geographical area are acquired, the area identifier of each geographical area is determined, the area identifier corresponds to the spatial data of a unique geographical area, for example, the geographical area can be a specific geographical landmark, such as Yellow Crane Tower, or a region, such as Wuhan University, Lao Shi Road Street, etc., the specific form of the geographical area is not limited in the present application, and the non-spatial data identifier of the same geographical area is determined, the data represents a unique non-spatial data, wherein the specific form of the area identifier and the data identifier is not limited in the present application, as long as the area identifier or the data identifier can identify the spatial data of a unique geographical area or the non-spatial data of the geographical area.
[0081] S202, first index information corresponding to each geographical area is created in the first index table, the first row key of the first index information is the area identifier of the corresponding geographical area, and the first column family includes the data identifier of the non-spatial data of the corresponding geographical area.
[0082] In the embodiments of the present application, the first index table can be constructed based on the spatial data of each geographical area, and the index table can be stored in Hbase, wherein the first row key of the first index table can be the area identifier corresponding to the spatial data of a geographical area, and the first column family can be the data identifier of the non-spatial data of the geographical area.
[0083] S203, second index information corresponding to each geographical area is created in the second index table, the second index information includes a plurality of second row keys, each second row key is the data identifier of a non-spatial data of a corresponding geographical area, and the second column family includes at least one of the data type and the data name of the corresponding non-spatial data.
[0084] In the embodiments of the present application, the second index table can be constructed based on the non-spatial data of each geographical area, and the second index table can take the data identifier of each non-spatial data as the row key and take the data name and the data type of the non-spatial data as the second column family.
[0085] Further, the first column family in the first index table can further include the coordinate information of the spatial data of the geographical area.
[0086] In the embodiments of the present application, when the first index table is constructed, the coordinate information of the spatial data of each geographical area can be taken as the first column family.
[0087] On the basis of the above embodiments, as an optional embodiment, the application can obtain coordinate information in the spatial data when obtaining the spatial data of each geographic region, that is, the longitude and latitude coordinate information corresponding to the geographic region. The coordinate information of the spatial data of each geographic region obtained is coordinate information in different coordinate systems to some extent, so after obtaining the coordinate information, it can also be converted into corresponding coordinate information in a unified coordinate system, for example, the CSCG2000 national geodetic coordinate system can be used as the unified coordinate system. After obtaining the coordinate information in the coordinate system, it can be encoded to manage the spatial data of each geographic region. The specific form of encoding is not limited in the application, as long as it can represent a spatial data corresponding to a unique code.
[0088] Specifically, the spatial data and at least one non-spatial data of each geographic region can further include:
[0089] According to the data types of the spatial data and at least one non-spatial data, the storage mode of the spatial data and at least one non-spatial data is determined.
[0090] In the embodiment of the application, before constructing the first index table and the second index table, it is also necessary to determine the data types of the spatial data and non-spatial data of each geographic region, and according to the different data types, different storage modes are determined, for example, according to the storage type of the data, the spatial data can be divided into structured data and unstructured data, and the non-spatial data can be divided into structured data and unstructured data. The spatial data can also be further divided into raster data, graphic data and vector data.
[0091] According to the storage mode, the spatial data and at least one non-spatial data are stored respectively.
[0092] In the embodiment of the application, for the unstructured data of the spatial data and the non-spatial data, it can be stored in a non-relational database, and for the structured data of the spatial data and the non-spatial data, it can be stored in a relational database. Further, according to the three types of spatial data, the corresponding storage mode can be determined, for example, the vector data in the spatial data can be stored in an Oracle database. The relational database and the non-relational database are not limited in the application, as long as they can store the structured data and the unstructured data.
[0093] On the basis of the above embodiments, as an optional embodiment, the application can obtain the metadata of all data when storing the spatial data and non-spatial data of each geographic region, and store the metadata in a relational database.
[0094] Further, the storing the spatial data and the at least one non-spatial data according to the storage mode can further include:
[0095] obtaining first storage path information of the spatial data and second storage path information of the at least one non-spatial data.
[0096] In the embodiments of the present application, the storage path information can be obtained when the spatial data and the non-spatial data are stored according to different data types.
[0097] The first index information corresponding to each geographical region is created in the first index table, and the first index information further includes:
[0098] The first storage path information of the corresponding spatial data is recorded in the first column family in the first index table.
[0099] In the embodiments of the present application, when the first index table is constructed, the first storage path information, i.e., the storage path information of the spatial data, can be used as the first column family of the first index table.
[0100] The second index information corresponding to each geographical region is created in the second index table, and the second index information further includes:
[0101] The second storage path information of the corresponding non-spatial data is recorded in the second column family in the second index table.
[0102] In the embodiments of the present application, when the second index table is constructed, the second storage path information, i.e., the storage path information of the spatial data, can be used as the second column family of the second index table.
[0103] On the basis of the above embodiments, as an optional embodiment, when the second index table is constructed, the data value corresponding to the non-spatial data can also be used as the second column family. If the data type of the non-spatial data is structured data, the cell Cell corresponding to the second storage path information in the second column family is empty, and the cell Cell corresponding to the data value is not empty. For example, if the data name of the non-spatial data is the floor area, the data type is structured, the cell Cell corresponding to the second storage path information in the second column family of the second index table is empty, and the value of the cell Cell corresponding to the data value can be 1800 square meters. If the data type of the non-spatial data is unstructured data, the cell Cell corresponding to the second storage path information in the second column family is not empty, and the cell Cell corresponding to the data value is empty.
[0104] Further, the obtaining the spatial data and the at least one non-spatial data of each geographical region can further include:
[0105] acquire a first time stamp of creating the spatial data, create first index information corresponding to each geographical area in a first index table, and further include:
[0106] record the first time stamp of the corresponding spatial data in the first index information.
[0107] In constructing the first index table, the application can also set the time stamp information corresponding to the spatial data, and set different first time stamps according to different data types of the spatial data. For example, the data type of the spatial data is raster data, which can be aerial survey influence, remote sensing image and scanned raster map in JPG and TIF formats, etc., and the raster data can generate corresponding time information when created, such as the time of image shooting or map scanning as the first time stamp; if the data type of the spatial data is graphic data, such as engineering drawing data in non-GIS field and design drawing in DWG format, etc., the drawing time information of the graphic can be taken as the first time stamp of the graphic data; if the data type of the spatial data is vector data, such as vector data in GIS field, the time information of vector data drawing generation can be taken as the first time stamp of the vector data.
[0108] On the basis of the above embodiments, as an optional embodiment, in constructing the second index table, the application can acquire the time information when different non-spatial data is stored to the corresponding position, and take the time information as the time stamp of the second index table.
[0109] On the basis of the above embodiments, as an optional embodiment, the application provides a multi-source heterogeneous data storage method for territorial space planning. First, a plurality of non-spatial data and spatial data of a geographic region or object are acquired. Considering that the data sources are different, the data types are different, and the data itself contains sensitive information and redundant information, the data needs to be preprocessed. The preprocessing method can be data deduplication, data desensitization, data regularization and data fusion. The data deduplication is to remove the redundant information of the data itself; the data desensitization is to deform the data by desensitization rules for some sensitive information in the data, so as to protect the data containing sensitive information; the data regularization is to normalize the spatial data collected in different periods, so that it can be stored or updated, for example, the raster data in the spatial data is made into standard IMG or TIF format raster data, the graphics data in the spatial data is rasterized, the vector data in the spatial data is standardized, and then the graphics closed section, attribute connection and data quality check are sequentially performed, and then converted into standard SHP format GIS data. The data fusion is to fuse multiple dimensions of data by a BP neural network to obtain more accurate and more complete and reliable data, for example, a large amount of original data containing artificial annotation, such as manually annotating the street information of a certain geographic region, training the neural network model, inputting the data corresponding to a certain geographic region into the trained neural network model, and obtaining the original data containing street information. The specific implementation process of the preprocessing method of the above spatial data and non-spatial data does not belong to the protection scope of the application. The preprocessed spatial data and non-spatial data are stored in corresponding databases or distributed file systems according to their different data types.
[0110] On the basis of the above embodiments, as an optional embodiment, as Figure 3As shown, the present application constructs a first index table, which is composed of a first row key, a first column family and a first timestamp. In order to better illustrate, FID1, FID2 and FID3 are taken as the region identifiers of the respective geographic regions, and fid1, fid2 and fid3 are taken as the data identifiers of the respective non-spatial data. The first row key corresponds to the region identifiers of the respective geographic regions, and the first column family contains a plurality of columns, wherein the column identifiers of the plurality of columns can be data types, elements, first storage path information, spatial indexes, coordinate information encodings and data identifiers of non-spatial data, etc. The data types can be raster data, graphic data and vector data, wherein the vector data contains three elements of points, lines and surfaces, the point can be a specific geographic landmark such as Yellow Crane Tower, the line can be street information or boundary information of a certain region, and the surface can be a region containing a certain geographic landmark such as the region corresponding to Wuhan University. If the data type of the spatial data is vector data, the value of the cell corresponding to the column identifier of the element is not empty, otherwise, it is empty, i.e. no relevant information is stored. The column identifier of the column storing the spatial index of the respective spatial data, such as raster data, can use the GeoHash spatial index technology based on Z-order filling curve to obtain, and the spatial indexes of the graphic data and the vector data can be obtained by R-tree index technology. The column identifier of the column storing the coordinate information encoding is the encoding of the coordinate information of the respective spatial data in the unified coordinate system, such as the coordinate information encoding of the spatial data of the element point in the unified coordinate system is the encoding of the coordinate information of the corresponding point; the coordinate information encoding of the spatial data of the element line in the unified coordinate system is the encoding of the coordinate information of the corresponding point of the line; the coordinate information encoding of the spatial data of the element surface in the unified coordinate system is the encoding of the coordinate information of the corresponding region line. The column identifier of the column storing the first storage path information is the storage path information of the respective spatial data. The column identifier of the column storing the data identifier of the non-spatial data is the data identifier corresponding to the respective non-spatial data. The first timestamp is the time information when the respective spatial data is created, and the first timestamp can correspond to the spatial data under different time information.
[0111] On the basis of the above embodiments, as an optional embodiment, as shown in Figure 4 As shown, the present application constructs a second index table, which is composed of a second row key, a second column family and a second timestamp. In order to better illustrate, fid1, fid2 and fid3 are taken as the data identifiers of the respective non-spatial data. The second row key corresponds to the data identifiers of the respective non-spatial data of the geographic regions, and the second column family contains a plurality of columns, wherein the column identifier of each column can be a data name such as land area and land type; a data type such as structured data and unstructured data; second storage path information; and a data value such as the data value of the land area being 1800 square meters.
[0112] On the basis of the above embodiments, as an optional embodiment, the same geographical area of the present application, such as a certain financial street, the office building A and the office building B contained in the financial street can be stored as two different objects in the first index table and the second index table. Specifically, the spatial data of the office building A and the office building B is vector data, the element is a point, and the coordinate information code is the encoding of the coordinate information of the corresponding place. The data identifier of the non-spatial data of the office building A can be the floor area fid1, the floor height fid2 and the land type fid3, and the data identifier of the non-spatial data of the office building B can be the land type fid3, the floor area fid4 and the floor height fid5, wherein fid3 is used to represent the common non-spatial data with the same data name and the same data value or the same second storage path information under the same time information, for example, the land type of the office building A and the land type of the office building B have the same data name and the same data value under the same time information, and both are commercial land.
[0113] As shown in Figure 5 , the present application also provides a multi-source heterogeneous data retrieval method for land space planning, which can include:
[0114] S501, acquiring a retrieval request, the retrieval request including a target area identifier of a geographical area to be queried.
[0115] In the embodiments of the present application, the retrieval request of the data can be acquired, and the retrieval request can include the target area identifier corresponding to the geographical area to be queried.
[0116] S502, retrieving first target index information with the first row key being the target area identifier in the first index table established in advance, and determining the data identifier of each non-spatial data included in the first column family of the first target index information.
[0117] In the embodiments of the present application, according to the target area identifier, the first target index information corresponding to the target area identifier is retrieved in the first index table, that is, the first column family information of the first row key corresponding to the target area identifier is determined in the first index table, and the data identifier of each non-spatial data corresponding to the target area is determined in the first column family.
[0118] S503, retrieving second target index information with the second row key being the data identifier of each non-spatial data in the second index table established in advance, and determining at least one of the data type and the data name of the non-spatial data included in the second column family of the second target index information.
[0119] In the embodiment of the present application, according to the determined data identifier of the non-spatial data, the second target index information corresponding to the data identifier of each non-spatial data in the second index table is retrieved, that is, the second column family information corresponding to the data identifier of each non-spatial data in the second index table is determined, and at least one of the data type and the data name of the data identifier of each non-spatial data can be determined in the second column family.
[0120] S504, obtaining a retrieval result, the retrieval result including at least one of the data type and the data name of the non-spatial data.
[0121] In the embodiment of the present application, according to the target area identifier of the geographic area to be queried, the corresponding retrieval result can be obtained, which can include the data information of each non-spatial data corresponding to the current geographic area to be queried, for example, the data type and the data name of the non-spatial data.
[0122] The first index table and the second index table are created according to the multi-source heterogeneous data storage method for land space planning of any one of claims 1-5.
[0123] In the embodiment of the present application, the first index table and the second index table are created according to the above-mentioned multi-source heterogeneous data storage method for land space planning, and the specific creation method will not be described herein.
[0124] Further, the first column family in the first index table further includes coordinate information of the spatial data of each geographic area, and the retrieval result can further include the coordinate information of each spatial data.
[0125] In the embodiment of the present application, the first column family of the first index table further includes coordinate information of the spatial data of each geographic area, and according to the target area identifier of the geographic area to be queried, the coordinate information corresponding to the geographic area to be queried can be obtained in the first index table.
[0126] Specifically, the data identifier of each non-spatial data included in the first column family of the first target index information can further include:
[0127] The first storage path information of each spatial data included in the first column family in the first index table is determined.
[0128] In the embodiment of the present application, the first column family in the first index table further includes the first storage path information, and according to the target area identifier of the geographic area to be queried, the first storage path information of the spatial data of the geographic area to be queried can be determined in the first index table.
[0129] The determining at least one of the data type and the data name of the non-spatial data included in the second column family of the second target index information further includes:
[0130] The second storage path information of each non-spatial data included in the second column family in the second index table is determined.
[0131] In the embodiments of the present application, the second column family in the second index table further includes second storage path information, the data identifier of the non-spatial data is determined in the first column family of the first index table according to the target area identifier of the geographic area to be queried, and the second storage path information of the spatial data of the geographic area to be queried is determined in the second index table according to the data identifier of the non-spatial data.
[0132] The obtaining the search result further includes:
[0133] The spatial data is acquired according to the first storage path information;
[0134] The non-spatial data is acquired according to the second storage path information.
[0135] In the embodiments of the present application, after the first storage path information and the second storage path information are determined, the corresponding spatial data and non-spatial data of the geographic area to be queried are determined according to the corresponding storage path information.
[0136] Further, the search request further includes time information to be queried; the determining the data identifier of each non-spatial data included in the first column family of the first target index information further includes: determining a target timestamp in the first index table that meets the time information to be queried; determining the first storage path information of the target spatial data in the first column family corresponding to the target timestamp; and determining the target spatial data according to the first storage path information.
[0137] In the embodiments of the present application, the search request obtained can further include time information to be queried, and the target first column family is determined in the first row key and the first timestamp in the first index table according to the time information and the target area identifier of the geographic area to be queried, and the first storage path information of the target spatial data under the time information is determined in the first column family, and the target spatial data corresponding to the geographic area to be queried under the time information to be queried is determined according to the first storage path information.
[0138] Further, after the target timestamp in the first index table that meets the time information to be queried is determined, the following further includes:
[0139] determining a data identifier of target non-spatial data in the first column family corresponding to the target timestamp; determining, according to the data identifier of the target non-spatial data, second storage path information of target non-spatial data in the second column family corresponding to the data identifier of the target non-spatial data in the second index table; and determining the target non-spatial data according to the second storage path information.
[0140] In the embodiments of the present application, the search request obtained can further include time information to be queried, and according to the time information and the target region identifier of the geographic region to be queried, the data identifier of the target non-spatial data in the target first column family is determined in the first row key and the first timestamp in the first index table, so as to determine the data identifier of the target non-spatial data under the time information, and according to the data identifier of the target non-spatial data, the target non-spatial data corresponding to the geographic region to be queried under the time information to be queried is determined in the second index table.
[0141] The embodiments of the present application provide a multi-source heterogeneous data storage device for land space planning, as shown in the accompanying drawings. Figure 6 The multi-source heterogeneous data storage device 60 for land space planning can include a first obtaining module 601, a first constructing module 602, and a second constructing module 603, wherein,
[0142] The first obtaining module 601 is configured to obtain spatial data and at least one kind of non-spatial data of each geographic region, determine a region identifier of each geographic region and a data identifier of each non-spatial data.
[0143] The first constructing module 602 is configured to create first index information corresponding to each geographic region in a first index table, wherein a first row key of the first index information is a region identifier of a corresponding geographic region, and a first column family includes data identifiers of the non-spatial data of the corresponding geographic region.
[0144] The second constructing module 603 is configured to create second index information corresponding to each geographic region in a second index table, wherein the second index information includes a plurality of second row keys, each second row key is a data identifier of a kind of non-spatial data of a corresponding geographic region, and a second column family includes at least one of a data type and a data name of the corresponding non-spatial data.
[0145] The device provided in the embodiments of the present application can perform the method provided in the embodiments of the present application for multi-source heterogeneous data storage of territorial space planning, and the implementation principles are similar. The actions performed by each module in the device of the embodiments of the present application correspond to the steps in the method of the embodiments of the present application. For the detailed function description of each module of the device, refer to the description in the corresponding method shown in the foregoing, which will not be repeated here. Compared with the related art, different sources and different structures of data can be stored and managed in a unified manner, and the connection between different sources and different structures of data is enhanced.
[0146] The embodiments of the present application provide a device for multi-source heterogeneous data retrieval of territorial space planning, as shown in the following Figure 7 The device for multi-source heterogeneous data retrieval of territorial space planning 70 can include a second acquisition module 701, a first retrieval module 702, a second retrieval module 703, and a determination module 704, wherein
[0147] The second acquisition module 701 is configured to acquire a retrieval request, wherein the retrieval request includes a target area identifier of a geographic area to be queried.
[0148] The first retrieval module 702 is configured to retrieve first target index information with a first row key being the target area identifier in a pre-established first index table, and determine data identifiers of each non-spatial data included in a first column family of the first target index information.
[0149] The second retrieval module 703 is configured to retrieve second target index information with a second row key being the data identifier of each non-spatial data in a pre-established second index table, and determine at least one of a data type and a data name of non-spatial data included in a second column family of the second target index information.
[0150] The determination module 704 is configured to obtain a retrieval result, wherein the retrieval result includes at least one of the data type and the data name of the non-spatial data.
[0151] The device provided in the embodiments of the present application can perform the method provided in the embodiments of the present application for multi-source heterogeneous data retrieval of territorial space planning, and the implementation principles are similar. The actions performed by each module in the device of the embodiments of the present application correspond to the steps in the method of the embodiments of the present application. For the detailed function description of each module of the device, refer to the description in the corresponding method shown in the foregoing, which will not be repeated here.
[0152] In the embodiments of the present application, an electronic device is provided, which includes a memory, a processor, and a computer program stored in the memory. The processor executes the computer program to implement the steps of the method for multi-source heterogeneous data storage of territorial space planning and the method for multi-source heterogeneous data retrieval of territorial space planning.
[0153] An electronic device is provided in an optional embodiment, such as Figure 8 As shown in Figure 8 The electronic device 8000 shown includes a processor 8001 and a memory 8003. The processor 8001 and the memory 8003 are connected, such as through a bus 8002. Optionally, the electronic device 8000 can also include a transceiver 8004, which can be used for data interaction between the electronic device and other electronic devices, such as data transmission and / or data reception, etc. It should be noted that the transceiver 8004 is not limited to one in actual application, and the structure of the electronic device 8000 does not constitute a limitation on the embodiments of the present application.
[0154] The processor 8001 can be a CPU (Central Processing Unit, central processor), a general-purpose processor, a DSP (Digital Signal Processor, data signal processor), an ASIC (Application Specific Integrated Circuit, application specific integrated circuit), an FPGA (Field Programmable Gate Array, field programmable gate array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It can implement or execute various exemplary logical blocks, modules and circuits described in combination with the disclosure. The processor 8001 can also be a combination of computing functions, such as one or more microprocessor combinations, combinations of DSP and microprocessor, etc.
[0155] The bus 8002 can include a channel for transmitting information between the above-mentioned components. The bus 8002 can be a PCI (Peripheral Component Interconnect, peripheral component interconnect) bus or an EISA (Extended Industry Standard Architecture, extended industry standard architecture) bus, etc. The bus 8002 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 Only one thick line is used in the middle, but it does not mean that there is only one bus or one type of bus.
[0156] The memory 8003 can be a ROM (Read Only Memory) or other type of static storage device that can store static information and instructions, a RAM (Random Access Memory) or other type of dynamic storage device that can store information and instructions, an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical disk storage, a magnetic disk storage or other magnetic storage device, or any other medium capable of storing computer instructions and capable of being read by a computer, without limitation.
[0157] The memory 8003 is configured to store a computer program for implementing the embodiments of the present application, and the processor 8001 is configured to control the execution of the computer program stored in the memory 8003. The processor 8001 is configured to execute the computer program stored in the memory 8003 to implement the steps shown in the foregoing method embodiments.
[0158] The embodiments of the present application provide a computer readable storage medium, and the computer readable storage medium stores a computer program. The computer program is executed by a processor to implement the steps and corresponding contents of the foregoing method embodiments.
[0159] The embodiments of the present application also provide a computer program product, and the computer program product includes a computer program. The computer program is executed by a processor to implement the steps and corresponding contents of the foregoing method embodiments.
[0160] The terms "first", "second", "third", "fourth", "1", "2", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish similar objects, and do not necessarily have to be used to describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than that shown or described.
[0161] It should be understood that although each operation step in the flowchart of the embodiments of the present application is indicated by an arrow, the implementation order of the steps is not limited to the order indicated by the arrow. Unless explicitly stated herein, in some implementation scenarios of the embodiments of the present application, the implementation steps in each flowchart can be executed in other orders as required. In addition, part or all of the steps in each flowchart can include multiple sub-steps or multiple stages based on the actual implementation scenario. Part or all of these sub-steps or stages can be executed at the same time, and each of these sub-steps or stages can also be executed at different times. In the scenario where the execution times are different, the execution order of these sub-steps or stages can be flexibly configured as required, and the embodiments of the present application do not limit this.
[0162] The above is only an optional implementation of some implementation scenarios of the present application. It should be pointed out that, for ordinary skilled persons in the technical field, other similar implementation means based on the technical idea of the present application without departing from the technical concept of the present application also belong to the protection scope of the embodiments of the present application.
Claims
1. A multi-source heterogeneous data storage method for territorial space planning, characterized by, The method comprises: acquiring spatial data and at least one kind of non-spatial data of each geographical area, preprocessing the spatial data and the at least one kind of non-spatial data, determining area identifiers of each geographical area and data identifiers of each non-spatial data; the area identifier corresponds to spatial data corresponding to a unique geographical area, and the data identifier corresponds to non-spatial data corresponding to a unique geographical area; creating first index information corresponding to each geographical area in a first index table, the first row key of the first index information being an area identifier of the corresponding geographical area, and the first column family including data identifiers of the non-spatial data of the corresponding geographical area; creating second index information corresponding to each geographical area in a second index table, the second index information including a plurality of second row keys, each second row key being a data identifier of a non-spatial data of the corresponding geographical area, and the second column family including at least one of a data type and a data name of the corresponding non-spatial data; after acquiring the spatial data and the at least one kind of non-spatial data, the method further comprises: determining a storage mode of the spatial data and the at least one kind of non-spatial data according to data types of the spatial data and the at least one kind of non-spatial data, wherein the storage mode includes storing structured data in a relational database and storing unstructured data in a distributed file system; storing the spatial data and the at least one kind of non-spatial data according to the storage mode.
2. The multi-source heterogeneous data storage method for territorial space planning according to claim 1, characterized in that, The first column family in the first index table further includes coordinate information of the spatial data of the each geographical area.
3. The multi-source heterogeneous data storage method for territorial space planning according to claim 1, characterized in that, After storing the spatial data and the at least one kind of non-spatial data according to the storage mode, the method further comprises: acquiring first storage path information of the spatial data and second storage path information of the at least one kind of non-spatial data; creating the first index information corresponding to each geographical area in the first index table further comprises: recording the first storage path information of the corresponding spatial data in the first column family in the first index table; creating the second index information corresponding to each geographical area in the second index table further comprises: recording the second storage path information of the corresponding non-spatial data in the second column family in the second index table.
4. The multi-source heterogeneous data storage method for territorial space planning according to claim 1 or 3, characterized in that, After acquiring the spatial data and the at least one kind of non-spatial data, the method further comprises: acquiring a first timestamp of creating the spatial data; creating the first index information corresponding to each geographical area in the first index table further comprises: recording the first timestamp of the corresponding spatial data in the first index information.
5. A multi-source heterogeneous data retrieval method for territorial space planning, characterized in that, The method comprises: acquiring a search request, the search request including a target area identifier of a geographical area to be queried; searching for first target index information with a first row key being the target area identifier in a first index table established in advance, and determining data identifiers of non-spatial data included in a first column family of the first target index information; searching for second target index information with a second row key being the data identifiers of the non-spatial data in a second index table established in advance, and determining at least one of a data type and a data name of non-spatial data included in a second column family of the second target index information; obtain a search result, the search result including at least one of a data type and a data name of the non-spatial data; The first index table and the second index table are created by the multi-source heterogeneous data storage method for territorial space planning according to any one of claims 1-4.
6. The multi-source heterogeneous data retrieval method for territorial spatial planning according to claim 5, characterized in that, The first column family in the first index table further includes coordinate information of the spatial data of each geographical area; The search result further includes coordinate information of the spatial data.
7. The multi-source heterogeneous data retrieval method for territorial space planning according to claim 5, wherein The data identifier of each non-spatial data included in the first column family of the first target index information further includes: Determine the first storage path information of each spatial data included in the first column family in the first index table; The at least one of the data type and the data name of the non-spatial data included in the second column family of the second target index information further includes: Determine the second storage path information of each non-spatial data included in the second column family in the second index table; The search result further includes: According to the first storage path information, the spatial data is obtained; According to the second storage path information, the non-spatial data is obtained.
8. The multi-source heterogeneous data retrieval method for territorial spatial planning according to claim 7, characterized in that, The search request further includes time information to be queried; The data identifier of each non-spatial data included in the first column family of the first target index information further includes: Determine the target timestamp in the first index table that meets the time information to be queried; Determine the first storage path information of the target spatial data in the first column family corresponding to the target timestamp; and determine the target spatial data according to the first storage path information.
9. The multi-source heterogeneous data retrieval method for territorial spatial planning according to claim 8, characterized in that, After determining the target timestamp in the first index table that meets the time information to be queried, further includes: Determine the data identifier of the target non-spatial data in the first column family corresponding to the target timestamp; According to the data identifier of the target non-spatial data, determine the second storage path information of the target non-spatial data in the second column family corresponding to the data identifier of the target non-spatial data in the second index table; According to the second storage path information, determine the target non-spatial data.
10. A multi-source heterogeneous data storage device for territorial space planning, characterized by, Comprise: The first acquisition module is used for acquiring spatial data and at least one non-spatial data of each geographical area, pre-processing the spatial data and at least one non-spatial data, determining the region identifier of each geographical area and the data identifier of each non-spatial data; The region identifier corresponds to the spatial data of a unique geographical area, and the data identifier corresponds to the non-spatial data of a unique geographical area; The first construction module is used for creating first index information corresponding to each geographical area in the first index table, the first row key of the first index information being the region identifier of the corresponding geographical area, and the first column family including the data identifier of the non-spatial data of the corresponding geographical area; The second construction module is configured to create second index information corresponding to each geographical region in a second index table, the second index information including a plurality of second row keys, each second row key being a data identifier of a non-spatial data of a corresponding geographical region, and a second column family including at least one of a data type and a data name of the corresponding non-spatial data; The data storage module is configured to determine a storage mode of the spatial data and the at least one non-spatial data according to the data type of the spatial data and the at least one non-spatial data, wherein the storage mode includes storing structured data in a relational database and storing unstructured data in a distributed file system; The spatial data and the at least one non-spatial data are stored according to the storage mode.
11. A multi-source heterogeneous data retrieval device for territorial space planning, characterized by, The second acquisition module is configured to acquire a search request, the search request including a target region identifier of a geographical region to be queried. The first search module is configured to search, in a first index table established in advance, first target index information in which a first row key is the target region identifier, and determine data identifiers of non-spatial data included in a first column family of the first target index information. The second search module is configured to search, in a second index table established in advance, second target index information in which a second row key is the data identifier of the non-spatial data, and determine at least one of a data type and a data name of non-spatial data included in a second column family of the second target index information. The determination module is configured to obtain a search result, the search result including at least one of the data type and the data name of the non-spatial data, wherein the first index table and the second index table are created according to the method for storing multi-source heterogeneous data of national space planning in any one of claims 1-4. The processor executes the computer program to implement the steps of the method in any one of claims 1-4 or 5-9.
12. An electronic device comprising a memory, a processor, and a computer program stored on the memory, wherein the computer program, when executed by the processor, is arranged to perform the method of any one of claims 1 to 11. The computer program is executed by the processor to implement the steps of the method in any one of claims 1-4 or 5-9.
13. A computer readable storage medium having stored thereon a computer program, characterized in that,
Citation Information
Patent Citations
Georaster physical data model for storing georeferenced raster data
US20050055376A1