Shard Migration for Cloud Database Ownership
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
As a company grows, its database becomes less efficient due to bottlenecks in data requests, necessitating a solution for managing increasing data storage across multiple servers.
Innovation Solution
Implementing a cloud-based platform that uses horizontally partitioned shard databases, where data is divided based on ownership and migrated online when ownership changes, utilizing a mapping database to track data locations and perform transactions across multiple shard databases.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If all information is stored in a single database, then data storage is simple and manageable, but the database becomes less efficient due to bottlenecks at the server handling all data requests
Solution Approach 1:
The patent divides a single database into multiple shard databases distributed across different servers. Each shard database stores a subset of the total data, allowing data requests to be parallelized across multiple servers rather than bottlenecked at a single server, thus improving data request efficiency while maintaining manageable database structures through automated sharding logic
2Productivity
If data is divided across multiple shard databases, then data request efficiency improves through parallel processing, but the system complexity increases due to distributed data management
Solution Approach 1:
The patent introduces a data access layer with an object-relational mapping (ORM) component that acts as an intermediary between the application and the distributed shard databases. This ORM automatically handles data routing, shard identification, and coordination across multiple databases, masking the underlying distributed system complexity from the application while maintaining high data request efficiency through parallel processing
3Adaptability or versatility
If data ownership changes, then collaboration capabilities improve, but query performance degrades due to data migration across shards
Solution Approach 1:
The patent performs data migration proactively when ownership changes occur, using the ORM to automatically identify and transfer data between shard databases before queries are executed. This preliminary action ensures that data is already in the optimal location when collaboration events occur, preventing performance degradation during actual query operations while maintaining flexible ownership changes
Data Source
AI summary
Systems and methods of maintaining a horizontally scaled database based on data ownership for a cloud-based platform (e.g., cloud-based collaboration and/or storage platform/service) are disclosed. The system database comprises multiple shard databases, and all files and folders owned by a user are stored on a single shard database. When a user transfers ownership of a file and/or a folder to a second user, the transferred file and/or folder is stored on the shard database that stores all of the data for the second user.