Virtualized Control Threads in Multi-Core Processors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Symmetric multi-core processors (MCPs) suffer from low utilization and power wastage due to design inflexibility, leading to continuous leakage current in stand-by sub-processing elements, resulting in inefficient power usage and challenging optimization as processor dimensions increase.

Innovation Solution

The implementation of virtualized control threads within main processing elements to manage and control groups of sub-processing elements, allowing for dynamic power management and optimized resource allocation by assigning virtualized control threads to specific groups of sub-processing elements, enabling efficient power usage and improved performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If stand-by sub-processing elements are maintained in a symmetric MCP, then design inflexibility is avoided, but continuous leakage current causes power wastage

Engineering Contradiction:
Improvepower wastageVSAvoiddesign inflexibility
Core Design Contradiction:
Loss of energyVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic power management by allowing sub-processing elements to transition between active and stand-by states based on workload demands. The main processing element can dynamically allocate and de-allocate sub-processing elements, enabling the system to adapt its power consumption profile to actual computational needs rather than maintaining a fixed symmetric configuration.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The main processing element serves multiple functions: it acts as a full processing element when needed and simultaneously functions as a controller for sub-processing elements. This multi-functionality allows the system to optimize power usage by having the MPE manage both computation and resource allocation, eliminating the need for dedicated control hardware while reducing overall power consumption.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Productivity

If a larger number of sub-processing elements are utilized, then processing capacity increases, but MCP utilization becomes difficult to optimize

Engineering Contradiction:
Improveprocessing capacityVSAvoidMCP design complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces virtualization threads as intermediary software layers that manage the allocation and control of sub-processing elements. These virtualization threads act as mediators between the main processing element and multiple sub-processing elements, simplifying the control architecture by providing a standardized interface for resource management regardless of the number of SPEs involved.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the processing elements into one main processing element and multiple sub-processing elements with different functional capabilities. This segmentation allows the system to scale processing capacity by adding specialized SPEs while keeping the control logic centralized in the MPE, thereby managing complexity through functional differentiation rather than uniform replication.

Inventive Principle:
Principle #1Segmentation

3Speed

If stand-by sub-processing elements are maintained, then rapid activation is possible, but high levels of power are consumed continuously

Engineering Contradiction:
Improveactivation speedVSAvoidcontinuous power consumption
Core Design Contradiction:
SpeedVSLoss of energy

Solution Approach 1:

The patent implements periodic power management where sub-processing elements are activated only when needed based on workload demands. Instead of maintaining continuous stand-by power, the system periodically evaluates the need for additional processing capacity and activates or deactivates SPEs accordingly, creating a rhythm of power consumption that matches actual computational requirements.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS8775840B2Virtualization in a multi-core processor (MCP)
Publication Date: 2014.07.08 KYNDRYL INC
  • US8775840B2 patent drawing
  • US8775840B2 patent drawing
  • US8775840B2 patent drawing

AI summary

This invention describes an apparatus, computer architecture, method, operating system, compiler, and application program products for MPEs as well as virtualization in a symmetric MCP. The disclosure is applied to a generic microprocessor architecture with a set (e.g., one or more) of controlling elements (e.g., MPEs) and a set of groups of sub-processing elements (e.g., SPEs). Under this arrangement, MPEs and SPEs are organized in a way that a smaller number MPEs control the behavior of a group of SPEs. The apparatus enables virtualized control threads within MPEs to be assigned to different groups of SPEs for controlling the same. The apparatus further includes a MCP coupled to a power supply coupled with cores to provide a supply voltage to each core (or core group) and controlling-digital elements and multiple instances of sub-processing elements.