In-Memory Configuration State Registers for Context Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing number of latch-based control registers in computing environments leads to performance, chip area, and power consumption issues, particularly during context switching and updates, as they are switched and updated in program order.

Innovation Solution

Implementing configuration state registers in-memory instead of in-processor, allowing for out-of-order and speculative processing by converting in-processor access operations to in-memory access operations, and allocating memory units for frequently accessed registers to improve performance and reduce complexity during context switching.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If latch-based control registers are implemented in-processor, then access speed is fast, but chip area increases and context switching cost increases

Engineering Contradiction:
Improveregister access speedVSAvoidchip area
Core Design Contradiction:
SpeedVSArea of stationary object

Solution Approach 1:

The patent extracts configuration state registers from the processor chip and places them in external memory. This removes the registers from the processor core, reducing chip area while maintaining the ability to access configuration states. The extraction principle directly addresses the contradiction by separating the register storage function from the processor hardware.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces a memory interface and address translation mechanism as intermediaries between the processor and configuration state registers. These intermediaries enable efficient access to registers in external memory without requiring the registers to be physically present on the chip, thus reducing chip area while maintaining access capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If latch-based control registers are implemented in-processor, then access speed is fast, but context switching cost increases

Engineering Contradiction:
Improveregister access speedVSAvoidcontext switching time
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

By extracting configuration state registers from the processor, the patent enables context switching to occur without the overhead of switching physical latch-based registers on the chip. The registers remain in external memory, allowing the processor to switch contexts more efficiently by simply changing address pointers rather than physically switching register contents.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent implements preliminary allocation of memory regions for configuration state registers during system initialization. This preliminary action establishes a stable memory mapping that can be efficiently switched between contexts without requiring complex register switching operations during context switches, thereby reducing context switching time.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If latch-based control registers are used, then updates occur in program order, but performance is affected

Engineering Contradiction:
Improveupdate simplicityVSAvoidprocessing performance
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent replaces the mechanical latch-based register update mechanism with a memory-based update system. Instead of physically updating latches in program order, the system uses memory stores with address translation, which can be performed out-of-order and speculatively. This substitution enables performance improvements while maintaining the simplicity of the update interface.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces dynamic address translation and memory management for configuration state registers. This allows the system to adaptively manage register updates, enabling out-of-order execution and speculative processing of register updates. The dynamic nature of the memory-based system allows for performance optimization while maintaining ease of operation through standardized memory access instructions.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10761983B2Memory based configuration state registers
Publication Date: 2020.09.01 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10761983B2 patent drawing
  • US10761983B2 patent drawing
  • US10761983B2 patent drawing

AI summary

One or more configuration state registers are provided in-memory rather than in-processor. A request to access a configuration state register is obtained. A determination is made that the configuration state register is in-memory rather than in-processor. Based on determining that the configuration state register is in-memory, the access is converted from an in-processor access operation to an in-memory access operation.