Resource Scheduler Dependency Acceleration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing resource schedulers in computing systems face challenges in efficiently managing requests for physical resources, particularly when applications have dependent transactions, as they often prioritize fairness and throughput over completing dependent transactions, leading to suboptimal system performance.

Innovation Solution

Implementing a system-aware scheduling technique that identifies dependent transactions and switches between normal and dependency acceleration modes, prioritizing requests associated with dependent transactions to enhance system performance by ensuring timely completion and resource allocation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional resource schedulers prioritize fairness and throughput among all applications, then resource allocation is balanced, but system performance deteriorates when dependent transactions are not completed timely

Engineering Contradiction:
Improvesystem performanceVSAvoididle time for applications
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The scheduler dynamically switches between normal scheduling mode and dependency acceleration mode based on system state. In dependency acceleration mode, the scheduler identifies and prioritizes I/O requests that are part of dependent transactions, allowing the scheduling behavior to adapt to transactional workloads and reduce application idle time

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The scheduler uses feedback from transaction dependency information to adjust scheduling decisions. By tracking which I/O requests belong to dependent transactions and monitoring their completion status, the scheduler can prioritize subsequent requests in the dependency chain, creating a feedback loop that improves overall system performance

Inventive Principle:
Principle #23Feedback

2Ease of operation

If resource schedulers use FIFO queues and round-robin selection to ensure fairness, then resource allocation is equitable, but disk throughput and response time deteriorate

Engineering Contradiction:
Improvefairness among applicationsVSAvoiddisk throughput
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The scheduler applies different scheduling qualities to different types of requests. While maintaining fair treatment for general requests through round-robin selection, it applies priority treatment specifically to I/O requests that are part of dependent transactions, allowing local optimization without sacrificing overall fairness

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The scheduler segments the I/O request queue into different categories: requests from dependent transactions and regular requests. This segmentation allows the scheduler to apply specialized handling to the dependent transaction requests while maintaining standard fair scheduling for other requests

Inventive Principle:
Principle #1Segmentation

3Productivity

If schedulers prioritize I/O requests to maximize disk throughput, then resource utilization improves, but I/O latency for individual applications increases

Engineering Contradiction:
Improvedisk throughputVSAvoidI/O latency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The scheduler performs preliminary identification of I/O requests that are part of dependent transactions before scheduling them. By pre-marking these requests with dependency information, the scheduler can quickly prioritize them when encountered, reducing latency for critical transactional I/O without requiring complex real-time analysis

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8347302B1System-aware resource scheduling
Publication Date: 2013.01.01 AMAZON TECH INC
  • US8347302B1 patent drawing
  • US8347302B1 patent drawing
  • US8347302B1 patent drawing

AI summary

Technology is provided to manage requests for physical resources in computing systems using system-aware scheduling techniques. Transactions having two or more dependent requests for a physical resource are identified by the computing system. Information identifying the requests as part of a dependent transaction is passed with the requests for the physical resource. In at least one mode of operation, a scheduler corresponding to the physical resource allocates submission of the requests to the physical resource using the dependent transaction information.