Governance Thread for Asynchronous Job Resource Throttling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In computing workloads involving multiple asynchronous jobs, resource over-utilization by one job can prevent its completion and hinder the timely completion of other jobs, leading to resource constraints and inefficiencies.
Innovation Solution
A governance thread within the jobs manager process monitors and controls resource utilization by identifying and shutting down threads associated with jobs that exceed a threshold, thereby throttling back resource-intensive jobs and preserving resources for others.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple asynchronous jobs run simultaneously on shared computing resources, then workload completion speed is improved, but resource over-utilization by a single job can prevent other jobs from completing
Solution Approach 1:
The governance thread continuously monitors resource utilization metrics (CPU usage, memory consumption, I/O operations) for each job and provides feedback to the job manager. When a job exceeds allocated resources, the system detects this through the monitoring thread and responds by throttling or terminating the offending job's threads, ensuring fair resource distribution and preventing any single job from blocking others.
Solution Approach 2:
The governance thread acts as an intermediary between the job manager and individual job threads. It intercepts resource allocation decisions, monitors actual resource usage, and mediates conflicts by controlling thread lifecycle (starting, pausing, terminating threads) based on overall system resource availability and job priorities.
2Speed
If a job utilizes greater share of computing resources, then its processing speed is improved, but other jobs cannot complete on time or at all
Solution Approach 1:
The system dynamically adjusts resource allocation to each job based on real-time monitoring of resource utilization metrics. The governance thread can pause, resume, or terminate threads of individual jobs dynamically, allowing resource-hungry jobs to slow down when resources are constrained while ensuring critical jobs maintain their processing speed. This dynamic control prevents any single job from monopolizing resources and causing delays for others.
3Ease of operation
If resource utilization threshold is enforced strictly, then fair resource distribution is improved, but job throughput may be reduced
Solution Approach 1:
The system changes operational parameters (thread priority, thread count, resource limits) based on system state and job characteristics. For high-priority or time-critical jobs, the governance thread may allow temporary resource over-utilization or allocate more threads. For lower-priority jobs, it enforces stricter resource limits. This parameter adjustment strategy maintains fairness while preserving overall system throughput by being flexible rather than rigid in resource enforcement.
Data Source
AI summary
Systems, methods, and software technology for governing resource utilization in a computing environment. In an implementation, a governance thread started by a job manager process identifies threads running within the job manager process and associates each of the threads with one of various jobs. The governance thread then tracks a resource utilization level of each of the jobs based on the resource utilization level of each of the threads associated with the job. When the resource utilization level of any of the jobs exceeds a threshold, the governance thread is able to shut down at least one of the threads associated with the job.