Processor Thread Migration for Single-Mode Performance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Simultaneous multithreading mode in computing environments leads to resource contention and performance degradation due to shared hardware resources, where individual threads execute less efficiently compared to single thread mode.

Innovation Solution

A method for detecting changes in thread states and migrating threads between processors to transition from multithreading mode to single thread mode, allowing processors to optimize performance by running in single thread mode when possible, thereby improving overall system efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If simultaneous multithreading mode is used to share hardware resources among multiple threads, then hardware resource utilization efficiency is improved, but individual thread execution performance deteriorates due to resource contention

Engineering Contradiction:
Improvehardware resource utilization efficiencyVSAvoidindividual thread execution performance
Core Design Contradiction:
Use of energy by moving objectVSProductivity

Solution Approach 1:

The system dynamically switches processor operating modes between single-thread mode and simultaneous multithreading mode based on real-time thread state monitoring. When threads enter inactive states, the processor transitions to single-thread mode to maximize execution performance for active threads, and switches to SMT mode when multiple threads are active, creating a dynamic adaptation mechanism that resolves the performance contradiction

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The invention changes the operational parameters of the processor by adjusting the threading mode (single-thread vs. multithreaded) based on thread activity states. This parameter change allows the system to optimize between resource utilization and individual thread performance by selecting the appropriate operational mode at different times

Inventive Principle:
Principle #35Parameter changes

2Productivity

If threads share execution resources in SMT mode, then hardware efficiency is improved, but resource contention increases causing performance degradation

Engineering Contradiction:
Improvehardware efficiencyVSAvoidresource contention
Core Design Contradiction:
ProductivityVSObject-generated harmful factors

Solution Approach 1:

The invention extracts inactive threads from the processor by migrating them to other processors or terminating them, thereby removing the source of resource contention. This allows remaining active threads to execute without contention in single-thread mode, eliminating the harmful effect while preserving hardware efficiency benefits when multiple threads are genuinely needed

Inventive Principle:
Principle #2Taking out (Extraction)

3Productivity

If a processor runs in single thread mode, then individual thread execution speed is improved, but hardware resource utilization efficiency deteriorates

Engineering Contradiction:
Improvethread execution speedVSAvoidhardware resource utilization efficiency
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The system employs dynamic mode switching that transitions the processor between single-thread and multithreaded modes based on real-time thread activity monitoring. This dynamic approach ensures that single-thread mode (high performance) is used only when necessary, while multithreaded mode (high utilization) is used when multiple threads are active, thus resolving the contradiction between execution speed and resource utilization

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The hardware controller periodically monitors thread states and triggers mode transitions at appropriate intervals. This periodic monitoring and switching mechanism ensures that the system adapts to changing thread activity patterns, maintaining optimal performance by switching to single-thread mode when threads become inactive and returning to SMT mode when new threads are launched

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS8935698B2Management of migrating threads within a computing environment to transform multiple threading mode processors to single thread mode processors
Publication Date: 2015.01.13 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US8935698B2 patent drawing
  • US8935698B2 patent drawing
  • US8935698B2 patent drawing

AI summary

Threads of a computing environment are managed to improve system performance. Threads are migrated between processors to take advantage of single thread processing mode, when possible. As an example, inactive threads are migrated from one or more processors, potentially freeing-up one or more processors to execute an active thread. Active threads are migrated from one processor to another to transform multiple threading mode processors to single thread mode processors.