Geographic Data Partitioning in Distributed Databases
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Distributed databases face inefficiencies in associating and storing geographical data objects across multiple database devices, leading to unequal resource utilization and increased search complexity due to the lack of efficient partitioning and data location strategies.
Innovation Solution
A data object identifier (ID) is generated for geographical data objects, comprising a grid ID for spatial grouping, a shardlet ID for partitioning, and a sequence ID for data placement within a shardlet, allowing for efficient storage and location of data across a distributed database system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If generic distributed databases are used to store geographical data, then data storage capacity is improved, but data association efficiency and search performance deteriorate
Solution Approach 1:
The patent segments geographical data into hierarchical units (geoshards containing geoshardlets) and assigns them to different database devices using a structured ID system. This segmentation allows efficient routing and association of data objects to specific storage locations, resolving the contradiction between storage capacity and association efficiency.
Solution Approach 2:
The patent introduces a composite ID structure with specific parameters (grid ID, shardlet ID, sequence ID) that changes the organization paradigm from generic to structured. This parameter-based organization enables efficient data location and association while maintaining scalable storage capacity.
2Adaptability or versatility
If geographical data is distributed across multiple database devices, then storage scalability is improved, but search complexity and resource usage increase
Solution Approach 1:
The patent performs preliminary organization of geographical data into hierarchical sharding structures with assigned IDs before data retrieval operations. This pre-organization enables direct computation of data locations during searches, reducing search complexity while maintaining storage scalability.
Solution Approach 2:
The composite ID structure acts as an intermediary that bridges the gap between distributed storage and efficient retrieval. By encoding spatial and hierarchical information in the ID itself, the system enables direct data location without complex search algorithms across multiple devices.
3Ease of operation
If data is partitioned without spatial awareness, then distribution evenness is improved, but spatial data access efficiency deteriorates
Solution Approach 1:
The patent applies local quality by incorporating grid ID (spatial information) into the data partitioning structure. This allows spatially related data to be grouped together in specific geoshardlets, improving spatial data access efficiency while maintaining even distribution across the distributed system through the hierarchical structure.
Data Source
AI summary
Improving the efficiency of distributed database systems in providing geographically related information is provided by generating a data object identifier (ID) in association with geographical data. A geographical data object is received for storage in the distributed database system. A grid ID is generated based on spatial information contained in the geographical data object, a shardlet ID is generated indicating a shardlet location in a given shard on which the geographical data object is stored, and a sequence ID is generated indicating data placement within the shardlet location. The data object ID is assigned to the geographical data object, the data object ID comprising the grid ID, the shardlet ID, and the sequence ID.