Memory Priority Framework for Computing Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current memory scheduling schemes in computing systems lack an efficient mechanism to prioritize memory access requests, leading to suboptimal performance and increased latency due to the lack of explicit priority assignment and propagation across different levels of the computing hierarchy.

Innovation Solution

A memory priority framework that assigns and propagates priority indicators across various levels of a computing system, allowing the memory controller to schedule memory access requests based on determined priorities, ensuring higher priority requests are executed before lower priority ones.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a first-in-first-out scheduling scheme is used for memory requests, then the scheduling mechanism is simple, but memory access latency increases and system performance deteriorates

Engineering Contradiction:
Improvescheduling mechanism complexityVSAvoidmemory access latency
Core Design Contradiction:
Device complexityVSLoss of time

Solution Approach 1:

The patent changes the scheduling parameter from simple FIFO ordering to priority-based ordering. The memory controller now considers priority indicators associated with each memory request, allowing high-priority requests to be serviced before low-priority requests, thereby reducing memory access latency without significantly increasing system complexity

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The scheduling mechanism transitions from a static FIFO approach to a dynamic priority-based approach. The memory controller dynamically adjusts the servicing order of memory requests based on their priority indicators, enabling the system to adapt to different performance requirements and reduce latency for critical operations

Inventive Principle:
Principle #15Dynamics

2Productivity

If priority indicators are propagated across all levels of the computing hierarchy, then memory access prioritization is improved, but system complexity increases

Engineering Contradiction:
Improvememory access efficiencyVSAvoidpriority propagation mechanism complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent uses the memory controller as an intermediary that receives and processes priority indicators from higher levels of the computing hierarchy. The memory controller maintains the priority information and uses it to schedule memory requests, thereby improving memory access efficiency without requiring complex priority propagation mechanisms at every level of the system

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent extracts the priority indication function from the complex hierarchy of computing levels and concentrates it at the memory controller level. The memory controller receives priority indicators and handles the scheduling decisions, simplifying the overall system architecture while maintaining the ability to prioritize memory requests effectively

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10191868B2Priority framework for a computing device
Publication Date: 2019.01.29 AMPERE COMPUTING LLC
  • US10191868B2 patent drawing
  • US10191868B2 patent drawing
  • US10191868B2 patent drawing

AI summary

Proving for a framework for propagating priorities to a memory subsystem in a computing system environment is disclosed herein. By way of example, a memory access handler is provided for managing memory access requests and determining associated priorities. The memory access handler includes logic configured for propagating memory requests and the associated priorities to lower levels of a computer hierarchy. A memory subsystem receives the memory access requests and the priorities.