Load Store Unit Bit-Vector Tracking for Store Sub-Operation Replay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing processor architectures face challenges in efficiently tracking and optimizing the completion and replayability of sub-micro-operations associated with store instructions, leading to suboptimal performance in out-of-order processors.

Innovation Solution

Implementing a load store unit (LSU) with bit vectors to track the issue, unroll, and replay status of sub-micro-operations, allowing for efficient management and retirement of store micro-operations by monitoring the completion and replayability of individual and grouped sub-micro-operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional processor architectures are used without dedicated tracking mechanisms, then device complexity is reduced, but tracking precision and optimization of sub-micro-operation completion status deteriorates

Engineering Contradiction:
Improvetracking precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the tracking mechanism into multiple bit vectors, each dedicated to tracking specific aspects of sub-micro-operation status (completion, replayability, grouping). This segmentation allows precise tracking of individual sub-micro-operations while maintaining manageable complexity through modular organization of tracking data structures.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces bit vectors as intermediary data structures between the execution units and the retirement logic. These bit vectors serve as mediators that efficiently communicate the completion and replayability status of sub-micro-operations, enabling precise tracking without requiring complex direct monitoring between execution and retirement components.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If detailed tracking of individual sub-micro-operations is implemented, then productivity and optimization are improved, but device complexity increases

Engineering Contradiction:
Improveprocessor performanceVSAvoidtracking mechanism complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges multiple tracking functions into a unified bit vector structure that simultaneously tracks completion status, replayability, and group associations of sub-micro-operations. This consolidation improves processor performance by enabling comprehensive tracking while reducing overall complexity compared to maintaining separate tracking mechanisms for each function.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The bit vector structure serves multiple functions: tracking completion of individual sub-micro-operations, monitoring replayability conditions, and managing group-level retirement. This multi-functionality enables detailed tracking of sub-micro-operations to improve productivity while avoiding the complexity overhead of separate specialized tracking mechanisms.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If group-level tracking of sub-micro-operations is implemented, then ease of operation for retirement management is improved, but measurement precision of individual operation status may be reduced

Engineering Contradiction:
Improveretirement management easeVSAvoidindividual operation tracking accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent adds a group-level dimension to the tracking structure by organizing bit vectors to represent both individual sub-micro-operations and their parent groups. This dimensional organization enables easy group-level retirement management while preserving precise individual operation tracking, as the hierarchical structure allows operations to be monitored and retired at appropriate granularities.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20250251933A1Tracking of store operations
Publication Date: 2025.08.07 SIFIVE INC
  • US20250251933A1 patent drawing
  • US20250251933A1 patent drawing
  • US20250251933A1 patent drawing

AI summary

Apparatus and methods for tracking sub-micro-operations and groups thereof are described. An integrated circuit includes a load store unit configured to receive store micro-operations cracked from a vector store instruction. The load store unit is configured to unroll multiple store sub-micro-operations from each of the store micro-operations. The load store unit includes an issue status vector to track issuance of each sub-micro-operation, an unroll status vector to track unrolling of each sub-micro-operation associated with a group of sub-micro-operations, and a replay status vector to track a replayability of sub-micro-operations associated with the group of sub-micro-operations.