OLTP Throttling via Staggered Thread Delays

The patent segments the transaction processing into multiple batches, where each batch is processed separately within the throttling window. This allows the system to maintain high throughput by processing multiple batches sequentially, while each individual batch respects the transaction processing time limit. The segmentation of processing workload resolves the contradiction between overall throughput and individual transaction timing constraints.

The patent implements periodic processing cycles with defined throttling windows and inter-window delays. Within each throttling window, the system processes data at maximum throughput rate, then pauses for a specified delay period. This periodic action pattern allows the system to achieve high average throughput while ensuring that no single transaction processing exceeds the time limit, as processing is reset with each new window cycle.

The patent eliminates idle retry periods by implementing continuous processing across multiple throttling windows. Instead of stopping processing when the throttling limit is reached and waiting for retries, the system continuously submits new batches in subsequent windows without interruption. This continuous useful action maximizes throughput while maintaining compliance with transaction time limits through the structured window-delay pattern.

The patent transforms the throttling constraint from a throughput-reducing limitation into a rhythmic processing pattern. By organizing processing into periodic windows with predictable delays, the system achieves consistent throughput that respects time limits while avoiding the inefficiency of random retries. The periodic structure converts what would be wasted idle time into a predictable, manageable processing rhythm.

The patent segments the large data storage operation into multiple smaller batches, each submitted within a throttling window. This segmentation ensures that no single storage request exceeds the database's processing capacity, preventing request drops while maintaining high overall storage rates. Each batch is independently processed and acknowledged, ensuring reliable completion while achieving bulk storage efficiency.

The patent prepares and structures data into batches before submission, organizing the data in advance to optimize throughput. By pre-processing and batching data before encountering the throttling constraint, the system maximizes the utilization of available throughput capacity while ensuring that each batch is ready for immediate processing, thereby maintaining both high storage rates and reliable completion.