Fractional Multi-Core Virtualization for Power Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Multi-core processors experience low utilization and inefficiency due to design inflexibility, leading to wasted power and challenges in optimizing software performance as the number of cores increases, particularly in symmetric MCPs where only a portion of processing elements are utilized, resulting in high power consumption and inefficiency.

Innovation Solution

The fractionalization of multi-core systems and memory systems using virtualization techniques, where a group of cores or memory modules are configured as fractional cores or caches, allowing for dynamic reconfiguration and efficient utilization of resources, such as fractional address translation tables and fractional cache controllers, to improve power efficiency and flexibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Power

If multi-core processors are designed with symmetric processing elements, then processing capability is improved, but utilization efficiency deteriorates due to inflexible design preventing optimal resource allocation

Engineering Contradiction:
Improveprocessing capabilityVSAvoidutilization efficiency
Core Design Contradiction:
PowerVSProductivity

Solution Approach 1:

The patent segments processing elements into heterogeneous groups with different capabilities (e.g., high-performance cores and power-efficient cores). This segmentation allows the system to allocate specific processing elements to specific tasks based on their individual characteristics, improving overall utilization efficiency while maintaining high processing capability through the combined strengths of different core types.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic reconfiguration capabilities that allow the processing elements to be dynamically allocated and reassigned based on workload requirements. This dynamic adjustment enables the system to optimize utilization efficiency by activating only the processing elements needed for current tasks, while maintaining the ability to handle diverse workloads through the heterogeneous architecture.

Inventive Principle:
Principle #15Dynamics

2Power

If more processing elements are added to multi-core processors, then processing capability is improved, but power consumption increases due to continuous operation of all cores

Engineering Contradiction:
Improveprocessing capabilityVSAvoidpower consumption
Core Design Contradiction:
PowerVSUse of energy by moving object

Solution Approach 1:

The patent divides processing elements into segments with different power characteristics. Power-efficient processing elements can be activated only when needed for specific tasks, while high-performance cores remain in lower-power states. This segmentation enables the system to achieve high processing capability when required while minimizing power consumption during idle or low-demand periods.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial action by activating only the necessary portion of processing elements for current workloads rather than all cores. This allows the system to provide sufficient processing capability for current tasks while avoiding the power consumption penalty of keeping all processing elements in high-performance states, effectively using partial resources when full resources are not needed.

Inventive Principle:
Principle #16Partial or excessive action

3Speed

If processing elements are kept in high-performance state continuously, then response time is improved, but power consumption increases

Engineering Contradiction:
Improveresponse timeVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The patent implements dynamic state management where processing elements can be transitioned between different performance states based on workload predictions and requirements. This allows the system to maintain low response times for critical tasks by keeping essential cores in appropriate states while powering down or clocking down less-needed processing elements, achieving a balance between response time and power consumption.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies preliminary action by pre-warming critical processing elements or keeping them in low-power ready states based on predicted workload patterns. This ensures that when tasks need to execute, the necessary processing elements are already in or near optimal states, maintaining acceptable response times while reducing the duration of high-power consumption compared to continuous high-performance operation.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20210042138A1Computing devices
Publication Date: 2021.02.11 P4TENTS1 LLC
  • US20210042138A1 patent drawing
  • US20210042138A1 patent drawing
  • US20210042138A1 patent drawing

AI summary

A system, method, and computer program product are provided for a processing unit including a plurality of processing cores including a first processing core and a second processing core. In use, the processing unit is configured such that a virtual processing core is capable of being virtualized utilizing at least a portion of the first processing core and at least a portion of the second processing core. Such virtualization is further carried out such that at least one of the at least portion of the first processing core or the at least portion of the second processing core includes only a part thereof.