Database System Dynamic Scaling with Pre-provisioned Nodes

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing database systems face challenges in scaling processing capacity to match workload demands, leading to disruptions and high costs associated with capacity changes, especially in managed relational database services.

Innovation Solution

A database system that supports both client-managed and system-managed tables within a common database, allowing for intelligent query routing, dynamic resource allocation, and scalable computing resources to optimize performance and flexibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If database systems use fixed processing capacity, then system stability is maintained, but the system cannot scale to match workload demands

Engineering Contradiction:

Improvescaling capacityVSAvoidsystem stability

Core Design Contradiction:

Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements dynamic scaling of database processing capacity by allowing the system to automatically adjust the number of processing nodes based on workload demands. The system monitors performance metrics and dynamically adds or removes computing resources without requiring system reconfiguration or causing service interruptions, thus resolving the contradiction between adaptability and stability.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The database system is divided into independent, modular processing nodes that can be individually added or removed from the cluster. Each node operates autonomously and can be scaled independently based on specific workload requirements, allowing the system to maintain stability while adapting capacity through granular node management rather than monolithic system changes.

Inventive Principle:

Principle #1Segmentation

2Productivity

If database systems scale processing capacity, then workload demands are met, but disruptions and high costs occur

Engineering Contradiction:

Improveprocessing capacityVSAvoiddisruption time

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-provisioning standby processing nodes and maintaining connection pools in advance. When scaling is needed, these pre-prepared resources are immediately activated and integrated into the workload, eliminating the need for time-consuming provisioning and configuration during scaling events, thus reducing disruption time while maintaining high productivity.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent ensures continuous database operations during scaling by implementing connection pooling and request routing mechanisms that maintain active connections throughout the scaling process. New nodes are gradually integrated into the workload while existing nodes continue processing, ensuring uninterrupted service and eliminating downtime associated with capacity changes.

Inventive Principle:

Principle #20Continuity of useful action

3Ease of operation

If database systems use managed services, then ease of operation is improved, but scaling flexibility is reduced

Engineering Contradiction:

Improvemanaged service operationVSAvoidscaling flexibility

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

The database system implements self-service automated scaling capabilities that monitor workload metrics and automatically provision, configure, and integrate new processing nodes without manual intervention. This self-managed approach provides both the ease of automated operation and the flexibility of custom scaling, allowing the system to adapt capacity dynamically while maintaining simple operational interfaces.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent creates a universal database architecture that can operate in multiple modes - fully managed automated scaling, semi-managed hybrid operation, or fully manual control. This multi-functional design allows the same system to provide ease of operation through automation when needed while simultaneously offering scaling flexibility through manual configuration options, serving different operational requirements within a single platform.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS12292881B1Distributed transaction execution across shards of scalable database tables

Publication Date: 2025.05.06 AMAZON TECH INC

AI summary

Distributed execution of transactions may be performed across shards of a scalable database table. Instructions to perform as part of a transaction with respect to one or more database tables may be received. The instructions may be evaluated with respect to metadata obtained for the database tables to determine an assignment distribution of computing resources of the database system to data that can satisfy the access request. The commit protocol for the transaction may be determined according to the assignment distribution of the computing resources. After a request to commit the transaction is received, the transaction may be committed according to the determined commit protocol.