Shared Query Statistics Across Computing Nodes for Timely Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing optimizers in database systems, such as rule-based and cost-based optimizers, face challenges in dynamically adjusting optimization policies for real-time data updates and suffer from outdated statistical information due to asynchronous polling and partial temporary collection methods, leading to inefficient query processing and increased computing overheads.
Innovation Solution
A data query method and system that utilizes shared memory across multiple computing nodes to collect, store, and synchronize statistical information, allowing nodes to share timely data, reducing redundant collections and ensuring consistency and efficiency in query processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If statistical information is collected independently by each computing node, then each node has access to its own statistical information, but computing overheads increase due to repeated collections and statistical information becomes outdated due to lack of sharing
Solution Approach 1:
The patent merges the statistical information collection function across multiple computing nodes by introducing a coordinator node that centrally collects and manages statistical information. Instead of each node independently collecting statistics, the coordinator consolidates these collection efforts, eliminating redundant work while ensuring all nodes access up-to-date statistical information through the shared coordinator.
2Use of energy by moving object
If statistical information is shared across all computing nodes, then computing overheads are reduced by avoiding repeated collections, but system complexity increases due to synchronization requirements
Solution Approach 1:
The patent introduces a coordinator node as an intermediary between computing nodes and statistical information. The coordinator acts as a central mediator that collects, updates, and distributes statistical information to all computing nodes. This intermediary approach simplifies the system architecture by centralizing management responsibilities and reducing the complexity of direct peer-to-peer synchronization between nodes.
3Ease of operation
If asynchronous polling is used to collect statistical information, then nodes can operate independently, but statistical information becomes outdated and query processing efficiency decreases
Solution Approach 1:
The patent implements a feedback mechanism where the coordinator node continuously monitors and collects updated statistical information from computing nodes, then distributes this fresh information back to all nodes. This feedback loop ensures that statistical information remains current and accurate, enabling efficient query processing while maintaining coordinated operation across the distributed system.
Data Source
AI summary
Embodiments of this disclosure provide a database query method and system, a device cluster, a medium, and a program product. In embodiments of this disclosure, a first computing node collects statistical information related to the target data. The first computing node stores the collected statistical information as first statistical information in a first shared memory, to update global statistical information in the first shared memory, and sends the first statistical information to a second computing node, for the second computing node to store the first statistical information in a second shared memory, to update global statistical information in the second shared memory. The global statistical information is used to query for statistical information for a query request of a system including a plurality of computing nodes. In this way, computing overheads can be significantly reduced by avoiding a large quantity of repeated collections, while ensuring timeliness of the statistical information.