Size Mismatch Hazard Detection in Out-of-Order Processors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In pipelined data processing systems, size mismatch hazards between operands of different sizes lead to inefficiencies in circuit area, cost, and processing efficiency, as existing solutions require fine-grained tagging and routing, which is costly and inefficient.

Innovation Solution

The system detects size mismatch hazards within groups of instructions and flushes and re-dispatches them, dividing the group into smaller units to handle size mismatches, reducing circuit overhead and maintaining low performance impact by identifying hazards within instruction groups and re-dispatching separately.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If fine-grained tagging is used to handle operand forwarding with different operand sizes, then operand forwarding capability is improved, but circuit area and cost increase

Engineering Contradiction:
Improveoperand forwarding capabilityVSAvoidcircuit area
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The patent segments the tagging mechanism into two parts: a common tag that identifies the producer instruction and a size field that encodes the operand size. This segmentation allows the system to handle multiple operand sizes without requiring separate tags for each possible size combination, thereby reducing the total number of tags needed while maintaining full operand forwarding capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a universal tagging system where a single tag structure serves multiple functions: identifying the producer instruction, encoding the operand size, and enabling forwarding decisions. This multi-functional tag replaces what would otherwise require multiple specialized tags for different operand size scenarios, reducing circuit area while maintaining versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If fine-grained tagging is used to handle operand forwarding with different operand sizes, then operand forwarding capability is improved, but device cost increases

Engineering Contradiction:
Improveoperand forwarding capabilityVSAvoiddevice cost
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

By segmenting the tag into a common producer identifier and a compact size encoding, the patent reduces the total bit width required for tags. This segmentation directly translates to lower manufacturing costs by reducing the number of physical bits, routing wires, and switching elements that must be fabricated in the hardware.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameter representation by encoding operand size as a compact field within the tag rather than requiring separate full-sized tags for each operand. This parameter change reduces the overall tag size and consequently reduces the hardware resources required, leading to lower device manufacturing costs.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If fine-grained tagging is used to handle operand forwarding with different operand sizes, then operand forwarding capability is improved, but processing efficiency decreases

Engineering Contradiction:
Improveoperand forwarding capabilityVSAvoidprocessing efficiency
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

The patent performs preliminary action by encoding the operand size information within the producer tag itself, rather than requiring separate size determination steps. This allows the consumer instruction to immediately determine the correct operand size from the producer tag without additional lookup or computation, maintaining high processing efficiency while supporting multiple operand sizes.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The size field within the tag acts as an intermediary that bridges the producer and consumer instructions. It carries the necessary size information directly from the producer to the consumer, enabling efficient forwarding decisions without requiring complex routing logic or multiple tags, thus maintaining processing efficiency.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9081581B2Size mis-match hazard detection
Publication Date: 2015.07.14 ARM LTD
  • US9081581B2 patent drawing
  • US9081581B2 patent drawing
  • US9081581B2 patent drawing

AI summary

An out-of-order processor 4 groups program instructions together to control their commitment to complete processing. If an instruction within a group has a source operand dependent upon a plurality of destination operands of other instructions then this is identified as a size mismatch hazard. When the program instruction having the size mismatch hazard reaches a commit point within the processor, then it is flushed together with any speculatively executed succeeding program instructions. Furthermore, the group of program instructions containing the program instruction containing the program instruction having the size mismatch is divided into a plurality of groups of program instructions each containing a single program instruction which are then replayed through the processing mechanisms.