Bindless Thread Dispatch Hardware for Low-Latency Mid-Thread Preemption

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current graphics processors rely on software-assisted context switching for mid-thread preemption, which introduces latency and reduces performance and efficiency.

Innovation Solution

Implement hardware-based mid-thread preemption in graphics processors using thread dispatch hardware to save and restore thread states without software intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If software-assisted context switching is used for mid-thread preemption, then preemption can be achieved, but latency overhead increases and performance decreases

Engineering Contradiction:

Improvepreemption capabilityVSAvoidlatency overhead

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The patent replaces the software-based context switching mechanism with a hardware-based preemption mechanism. The graphics processor includes dedicated hardware components (preemption detection logic, state save/restore circuits) that enable mid-thread preemption without requiring software intervention, thereby eliminating the latency overhead associated with software-assisted context switching while maintaining preemption capability

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The graphics processor performs self-preemption through hardware-based mechanisms that automatically detect preemption conditions, save thread state, and switch contexts without external software assistance. This self-service approach eliminates the need for software drivers to intervene in the preemption process, reducing latency and improving performance

Inventive Principle:

Principle #25Self-service

2Reliability

If software-assisted context switching is used for mid-thread preemption, then preemption can be achieved, but processing efficiency decreases

Engineering Contradiction:

Improvepreemption capabilityVSAvoidprocessing efficiency

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The patent substitutes software-based context switching with hardware-based preemption mechanisms embedded in the graphics processor. The hardware components automatically handle thread state management and context switching, eliminating the performance penalty and efficiency loss associated with software intervention, thereby maintaining preemption capability while improving processing efficiency

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20250231769A1Bindless thread dispatch mid-thread preemption on a graphics processor

Publication Date: 2025.07.17 INTEL CORP

AI summary

Techniques are provided to enable mid-thread (instruction level) preemption in a graphics processor without requiring software intervention by a graphics driver associated with the graphics processor. Hardware based mid-thread preemption is facilitated using the thread dispatch hardware of the graphics processor to trigger execution of a kernel program by the graphics processor that saves the thread state of preempted processing resources and facilitates the subsequent restoration of that thread state to the same or a different set of processing resources.