Database Maintenance Using Virtual Buckets for Parallel Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional SQL server maintenance processes are inefficient due to serial execution of commands, leading to increased maintenance time and resource utilization, which conflicts with business operations and requires more resources, especially as data storage grows exponentially.
Innovation Solution
Implementing a parallel processing approach that segments database objects into virtual buckets and schedules maintenance over time, allowing for simultaneous execution of multiple processes and dynamic resource allocation, thereby reducing maintenance windows and leveraging server resources more effectively.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional serial execution of maintenance commands is used, then maintenance processes can be executed sequentially, but maintenance time increases significantly and server resources are not leveraged effectively
Solution Approach 1:
The patent segments database objects into virtual buckets based on size, then divides maintenance tasks into parallel channels that can execute simultaneously. This segmentation allows multiple maintenance operations to run in parallel rather than sequentially, directly reducing the maintenance window duration while increasing processing speed.
Solution Approach 2:
The patent introduces a virtual bucket dimension to organize database objects by size, then maps these buckets to parallel processing channels. This dimensional transformation enables the system to leverage multiple server resources simultaneously, converting a single-threaded serial process into a multi-threaded parallel process that completes maintenance faster.
2Productivity
If more server resources are allocated to maintenance processing, then maintenance can be performed more efficiently, but system operation costs increase
Solution Approach 1:
The patent dynamically allocates maintenance channels based on the actual size and requirements of database objects. Smaller objects can be processed with fewer channels while larger objects receive appropriate channel allocation. This dynamic resource allocation ensures that server resources are used efficiently rather than being over-provisioned for all maintenance tasks, reducing overall system operation costs.
Solution Approach 2:
The patent changes the parameter of resource allocation from fixed to variable based on object size categories. By categorizing database objects into virtual buckets and assigning different numbers of parallel channels to each bucket based on its size, the system optimizes resource consumption to match actual maintenance needs, avoiding waste of server energy and costs.
3Speed
If maintenance processes are executed simultaneously on all database objects, then processing speed increases, but collisions and conflicts during maintenance occur
Solution Approach 1:
The patent segments database objects into distinct virtual buckets based on size, then assigns dedicated parallel channels to each bucket. This segmentation ensures that maintenance operations on different object size categories proceed simultaneously without interfering with each other, eliminating collisions while maximizing processing speed.
Solution Approach 2:
The patent applies local quality by dedicating specific channels to specific virtual buckets, ensuring that each bucket receives focused attention from its assigned channels. This dedicated assignment prevents channel conflicts and ensures stable, collision-free maintenance execution while maintaining high throughput through parallel processing.
Data Source
AI summary
A database maintenance process using virtual buckets of segmented object groups to spread out processing over a period of time to minimize the time for maintenance processing in a controlled fashion. The maintenance process creates a plurality of groups or virtual buckets that are assigned database objects by size in an attempt to level the load over the plurality of groups. The database maintenance is performed according to a predetermined maintenance schedule set over a period of days.