Workload Manager Dynamic Thread Mode Switch

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for employing simultaneous multi-threaded (SMT) cores on general purpose processors in servers fail to recognize the heterogeneous mixture of workloads, leading to inefficient resource utilization and performance degradation due to static processor configurations that cannot adapt to workload variations.

Innovation Solution

A workload manager dynamically switches processor cores between single-threaded and multi-threaded modes based on workload priorities and resource demands, using a hypervisor to manage core switches and optimize thread mode operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If processor cores operate in multi-threaded mode to increase system capacity, then overall throughput is improved, but response time for sensitive workloads deteriorates

Engineering Contradiction:
Improvesystem capacityVSAvoidresponse time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system dynamically switches processor cores between single-threaded and multi-threaded modes based on real-time workload characteristics. The workload manager monitors workload properties and triggers mode changes to match the operational state of cores with current demands, allowing the system to adapt between throughput optimization and response time requirements

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Different processor cores are assigned different threading modes based on the specific workload requirements. Response-sensitive workloads are allocated to single-threaded cores while throughput-oriented workloads use multi-threaded cores, creating a heterogeneous processing environment where each core operates in the optimal mode for its assigned tasks

Inventive Principle:
Principle #3Local quality

2Device complexity

If static processor configuration is used to simplify system management, then device complexity is reduced, but adaptability to workload variations deteriorates

Engineering Contradiction:
Improvesystem management complexityVSAvoidworkload adaptation
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The workload manager autonomously monitors workload characteristics and automatically triggers core mode switches without requiring manual intervention. The system self-adjusts the threading mode of processor cores based on detected workload patterns, eliminating the need for complex manual configuration while maintaining high adaptability

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors workload properties and uses this feedback to dynamically adjust processor core modes. The workload manager receives information about workload characteristics and responds by switching cores between single-threaded and multi-threaded modes, creating a closed-loop control system that adapts to changing conditions

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10713075B2Workload manager control of dynamic thread mode switch
Publication Date: 2020.07.14 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10713075B2 patent drawing
  • US10713075B2 patent drawing
  • US10713075B2 patent drawing

AI summary

Embodiments include method, systems and computer program products for operating a computer system using a workload manager to control a dynamic thread mode switch. The method includes receiving a plurality of workloads. A workload manager determines which of the plurality of workloads are eligible to use a processor core operating in a multi-threaded mode and which workloads are response sensitive and use a processor core operating in a single-thread mode. A hypervisor determines a state of operation for one or more cores of one or more processors and causes a core switch for at least one or more cores in response to a determination that workloads eligible to use a processor core operating in a multi-threaded mode exist or workloads that are response sensitive and a determination that the state of operation for one or more cores of one or more processors should change to facilitate handling the associated workloads.