Direct-Connect Distributed Database Grid for Low-Latency Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Distributed database systems face challenges in providing a single image of data across multiple mid-tier database systems, limiting scalability and requiring direct-connect functionality to reduce network-based delays.
Innovation Solution
A scalable grid architecture is implemented, allowing direct-connect functionality between database grid elements and applications, with each element hosting a database shard and supporting both direct mode and remote connect mode, enabling transparent access to distributed database operations while maintaining ACID compliance and low latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple mid-tier database systems are used to distribute data, then data accessibility and system capacity are improved, but maintaining a single image of data across systems becomes complex and scalability is limited
Solution Approach 1:
The database system is segmented into multiple independent mid-tier database systems, each holding a portion of the overall data. This segmentation allows the system to scale horizontally by adding more database systems while maintaining data accessibility. Each database system operates independently but contributes to the collective functionality of the distributed database system.
2Speed
If direct mode is implemented in single mid-tier system, then access speed is improved by reducing network overhead, but scalability to multiple systems becomes challenging
Solution Approach 1:
The system segments database operations into direct mode operations (for local, high-speed access within a single mid-tier system) and network-based operations (for distributed access across multiple systems). This allows the system to utilize direct mode for optimal speed when applicable while maintaining scalability through network-based coordination when accessing distributed data.
Solution Approach 2:
The patent introduces network-based communication as an intermediary mechanism that enables multiple mid-tier database systems to coordinate and share data images. This intermediary layer allows direct mode operations to function within individual systems while providing a pathway for scalable distribution across the network, resolving the conflict between speed and adaptability.
Data Source
AI summary
A database is stored as a plurality of database shards in a distributed database grid comprising a plurality of grid elements, each including a mid-tier database system. A first grid element receives, from an application executing in the same memory as a mid-tier database system of the first grid element, a first database transaction including at least one database operation on specific data stored in a first database shard that belongs to the first grid element. The first grid element performs and commits the first database transaction without participation of another grid element of the plurality of grid elements. The first grid element receives a second database transaction that requires access to another database shard that does not belong to the first grid element. Multiple grid elements of the plurality of grid elements perform the second database transaction and commit the second database transaction using a two-phase commit protocol.