Memory System Workload Balancing Using Processor Activity Logs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing memory systems face challenges in efficiently determining and balancing workloads across processors, leading to potential bottlenecks and reduced overall performance.

Innovation Solution

The implementation of an execution log that tracks activity records for each processor, allowing a workload manager to analyze idle time slots and redistribute tasks to balance workloads across processors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If workload distribution across processors is not actively monitored and balanced, then the system structure remains simple, but processor utilization becomes inefficient and bottlenecks occur

Engineering Contradiction:
Improveprocessor utilization efficiencyVSAvoidworkload management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements feedback mechanisms where the workload manager continuously monitors processor states through execution logs and activity records. This feedback loop enables dynamic detection of idle processors and automatic redistribution of tasks from overloaded to underutilized processors, resolving the contradiction by making workload management adaptive rather than static.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system enables processors to self-report their status through execution logs and activity records that automatically track idle time slots. The workload manager uses this self-generated information to make balancing decisions, reducing the need for complex external control while improving utilization efficiency.

Inventive Principle:
Principle #25Self-service

2Productivity

If tasks are redistributed to balance workloads, then overall system performance improves, but the complexity of task management increases

Engineering Contradiction:
Improvesystem performanceVSAvoidtask management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The workload manager serves as an intermediary component that simplifies task management complexity. It receives task requests, consults execution logs to identify suitable processors, and automatically performs redistribution. This intermediary approach improves system performance while containing complexity within a dedicated management layer rather than distributing it across all processors.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system maintains execution logs that pre-record processor activity and idle time slots before task redistribution is needed. This preliminary documentation of processor states enables the workload manager to make rapid balancing decisions without complex real-time analysis, improving performance while managing complexity through advance preparation.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If execution logs are maintained to track processor activity, then workload determination becomes accurate, but memory usage increases

Engineering Contradiction:
Improveworkload measurement accuracyVSAvoidmemory consumption
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential information needed for workload balancing from processor activity - specifically idle time slots and activity records - into execution logs. By selecting and storing only these critical data points rather than complete processor state information, the system achieves accurate workload measurement while minimizing memory consumption through selective data extraction.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS12346748B2Determination of workload distribution across processors in a memory system
Publication Date: 2025.07.01 MICRON TECHNOLOGY INC
  • US12346748B2 patent drawing
  • US12346748B2 patent drawing
  • US12346748B2 patent drawing

AI summary

A memory system having a set of media, a set of resources, and a controller configured via firmware to use the set of resources in processing requests from a host system to store data in the media or retrieve data from the media. The memory system has a workload manager that analyzes activity records in an execution log for a time period where each of the activity records can indicate whether a processor of the controller is in an idle state during a time slot in the time period. The workload manager identifies idle time slots within the time period during which time slots one or more lightly-loaded processors in the plurality of processors are in the idle state, and adjusts a configuration of the controller to direct tasks from one or more heavily-loaded processors to the one or more lightly-loaded processors.