Processor Memory Sharing via Idle State Query

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In multiple processing unit systems, existing technologies limit memory sharing among processors, allowing only coarse workload distribution and restricting the size of shared memory, which hinders efficient memory access and utilization.

Innovation Solution

A method is introduced where processors are placed in an idle state, queried for their memory spaces, and a shared physical memory address space is updated, enabling each processor to access the physical memory, thereby overcoming memory access limitations and enhancing memory sharing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If processors access memory through host physical memory mapping, then memory sharing between processors is enabled, but the size of shared memory is limited by system memory constraints

Engineering Contradiction:

Improvememory sharing capabilityVSAvoidshared memory size

Core Design Contradiction:

Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent transitions from a single-dimensional host memory mapping approach to a multi-dimensional memory access model where processors can directly access both host memory and device memory spaces. This dimensional expansion allows memory sharing beyond the constraints of host physical memory limits, enabling access to larger total memory capacity through direct device memory addressing.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Productivity

If processors remain in active state continuously, then work execution is immediate, but energy consumption increases

Engineering Contradiction:

Improvework execution readinessVSAvoidprocessor energy consumption

Core Design Contradiction:

ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent implements dynamic state transitions for processors, allowing them to switch between active and idle states based on workload requirements. Processors can be placed in idle state to conserve energy when not actively processing, and transitioned back to active state when work needs to be executed, optimizing the balance between productivity and energy consumption.

Inventive Principle:

Principle #15Dynamics

3Reliability

If memory is not shared between processors, then each processor has dedicated access to its memory, but data copying between processors is required

Engineering Contradiction:

Improvememory access independenceVSAvoiddata copying time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The patent merges previously separate memory spaces (host memory and device memory) into a unified accessible memory namespace where multiple processors can simultaneously access the same physical memory regions. This consolidation eliminates the need for data copying between processors while maintaining reliable direct access, thereby reducing time loss associated with data transfer operations.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS12117934B2Method and system for sharing memory between processors by updating shared memory space including funtionality to place processors into idle state

Publication Date: 2024.10.15 ATI TECHNOLOGIES ULC

AI summary

A method and system for sharing memory in a computer system includes placing one or more processors in the computer system in an idle state. The one or more processors are queried for associated memory space, and a shared physical memory address space is updated, wherein each processor in the system has access to the physical memory in the shared physical memory address space. The one or more processors is removed from the idle state, and work is submitted to the one or more processors for execution.