Query Retry via Quiesce Notifications in Cloud Database
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional database management systems require significant resources and are prone to data loss during power outages or disasters, limiting scalability and increasing costs.
Innovation Solution
The implementation of a cloud-based database system that allows organizations to store, manage, and retrieve data from the cloud, utilizing a compute service manager to schedule and manage query executions and provide automated query retry mechanisms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional database management systems are used with on-premises infrastructure, then data control and security are improved, but resource costs and operational complexity increase significantly
Solution Approach 1:
The patent introduces a cloud service provider as an intermediary between the organization and the database infrastructure. The provider manages the physical database servers, storage systems, and network infrastructure in data centers, allowing organizations to access database services without directly managing the complex underlying infrastructure while maintaining data security through controlled access mechanisms
2Reliability
If traditional database systems are deployed on-premises, then data security is improved, but resource costs and maintenance requirements increase
Solution Approach 1:
The patent implements automated service management where the cloud database system automatically handles provisioning, configuration, maintenance, and optimization of database resources. This self-service model eliminates the need for organizations to invest in specialized infrastructure while maintaining security through automated access control and encryption mechanisms
3Adaptability or versatility
If cloud-based database systems are implemented, then scalability and cost-efficiency are improved, but query execution reliability may deteriorate due to compute service manager quiescence
Solution Approach 1:
The patent implements a mechanism where the compute service manager proactively notifies the query execution engine before quiescing or shutting down. This preliminary notification allows the system to complete or redirect ongoing query executions before the compute service manager becomes unavailable, preventing query failures and ensuring reliable execution even during scaling operations
Solution Approach 2:
The patent establishes a feedback loop where the compute service manager monitors its own state and provides real-time notifications to the query execution engine about upcoming quiescence events. This feedback mechanism enables the system to dynamically adjust query execution plans and maintain reliability while performing scalability operations
Data Source
AI summary
The subject technology selects a candidate compute service manager from a set of instances of compute service managers to issue a query restart by selecting an execution node, the execution node being included in a particular virtual warehouse associated with the candidate compute service manager, the selecting facilitating improving utilization of cluster resources and improving query execution on the selected candidate compute service manager. The subject technology receives a notification indicating that a particular compute service manager has been quiesced. The subject technology determines a set of jobs that are not yet scheduled for execution and eligible for query retry. The subject technology determines a second set of jobs from the set of jobs to send at least another compute service manager for execution. The subject technology sends the second set of jobs to at least another compute service manager for execution.