Scheduler Compression Logic for Micro-Operation Dispatch

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In electronic devices, the scheduler bottleneck in micro-operation decoding and preparation circuitry leads to dispatch stalls due to limited scheduler entries, which is exacerbated by area constraints on semiconductor dies, making it difficult to increase capacity or reduce latency.

Innovation Solution

The implementation of scheduler compression logic that compresses pairs of micro-operations into single scheduler entries, allowing more micro-operations to be stored and dispatched efficiently by repurposing entry portions and using an opcode table to manage operational codes, thereby avoiding unnecessary delays and improving dispatch rates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the number of scheduler entries is increased to reduce dispatch stalls, then the dispatch rate improves, but the area required on the semiconductor die increases and latency increases

Engineering Contradiction:
Improvedispatch rateVSAvoidscheduler circuit area
Core Design Contradiction:
ProductivityVSArea of stationary object

Solution Approach 1:

The patent merges pairs of micro-operations into a single scheduler entry by storing multiple micro-operations in different portions of the same entry. This combining approach allows the scheduler to hold more micro-operations without increasing the number of entries, thereby improving dispatch rate while avoiding additional area consumption and latency from expanded scheduler structures.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent makes scheduler entries multi-functional by enabling each entry to store multiple micro-operations (specifically pairs of micro-operations) in different portions. This universalization of entry capacity allows the same hardware structure to handle increased workload without physical expansion, resolving the contradiction between productivity and area.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Productivity

If the number of scheduler entries is increased to reduce dispatch stalls, then the dispatch rate improves, but the latency for accessing micro-operations increases

Engineering Contradiction:
Improvedispatch rateVSAvoidmicro-operation access latency
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

By merging pairs of micro-operations into single scheduler entries, the patent reduces the total number of entries that need to be scanned and accessed. This combining strategy decreases access latency while maintaining higher dispatch rate, as the scheduler can retrieve multiple micro-operations from fewer entries more quickly.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If more micro-operations are stored in scheduler entries to avoid dispatch stalls, then productivity improves, but the complexity of managing scheduler entries increases

Engineering Contradiction:
Improvedispatch rateVSAvoidscheduler entry management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments scheduler entries into different portions that can independently store different micro-operations. This segmentation allows systematic organization of multiple micro-operations within a single entry, making management predictable and structured. The segmentation approach improves productivity while keeping complexity manageable through regular, pattern-based storage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the storage capacity parameter of scheduler entries from one micro-operation per entry to multiple micro-operations per entry. This parameter change enables higher dispatch rate without proportionally increasing management complexity, as the same basic entry structure is reused with modified capacity rather than introducing fundamentally new management mechanisms.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11513802B2Compressing micro-operations in scheduler entries in a processor
Publication Date: 2022.11.29 ADVANCED MICRO DEVICES INC
  • US11513802B2 patent drawing
  • US11513802B2 patent drawing
  • US11513802B2 patent drawing

AI summary

An electronic device includes a processor having a micro-operation queue, multiple scheduler entries, and scheduler compression logic. When a pair of micro-operations in the micro-operation queue is compressible in accordance with one or more compressibility rules, the scheduler compression logic acquires the pair of micro-operations from the micro-operation queue and stores information from both micro-operations of the pair of micro-operations into different portions in a single scheduler entry. In this way, the scheduler compression logic compresses the pair of micro-operations into the single scheduler entry.