Vector Load-Store Handshaking for Exception-Safe Micro-Ops

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vector processing units (VPUs) face challenges in efficiently executing load-store instructions due to the complexity of handling micro-operations that may generate exceptions, leading to potential software-observable side effects and security vulnerabilities, especially when micro-operations are executed out-of-order.

Innovation Solution

A handshaking protocol is implemented between the control unit, vector processing unit (VPU), and load-store unit (LSU) to ensure that micro-operations are only executed after receiving an allow signal, with exception information being communicated to coordinate safe architectural updates, preventing side effects and ensuring secure data handling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If micro-operations are executed out-of-order to improve performance, then productivity increases, but reliability deteriorates due to potential exception handling errors and security vulnerabilities

Engineering Contradiction:
Improveinstruction execution throughputVSAvoidexception handling correctness
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent applies preliminary action by having the VPU predict exception outcomes for micro-operations before they are fully executed. The exception prediction unit evaluates micro-ops ahead of time and generates prediction results that guide subsequent execution decisions, allowing the system to prepare for potential exceptions in advance while maintaining out-of-order execution benefits

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an exception prediction unit as an intermediary between the micro-operation execution units and the architectural state. This intermediary component predicts whether micro-ops will generate exceptions and communicates these predictions to the execution pipeline, enabling reliable out-of-order execution without directly compromising exception handling correctness

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If micro-operations are executed as soon as possible to improve performance, then productivity increases, but harmful factors increase due to software-observable side effects

Engineering Contradiction:
Improvemicro-op execution speedVSAvoidsoftware-observable side effects
Core Design Contradiction:
ProductivityVSObject-generated harmful factors

Solution Approach 1:

The patent implements feedback mechanisms where exception prediction results are fed back into the execution pipeline to control micro-op commitment. The system continuously monitors prediction outcomes and adjusts execution decisions accordingly, allowing fast execution while preventing harmful side effects through informed feedback about potential exceptions

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary exception prediction before micro-operations are committed to execution. By evaluating potential exceptions in advance and using those predictions to gate execution, the system enables rapid micro-op processing while preventing software-observable side effects from occurring inappropriately

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20260111231A1Processing Vector Instructions
Publication Date: 2026.04.23 IMAGINATION TECH LTD
  • US20260111231A1 patent drawing
  • US20260111231A1 patent drawing
  • US20260111231A1 patent drawing

AI summary

A handshaking protocol is implemented between a control unit, a vector processing unit (VPU) and a load-store unit (LSU). Micro-ops of an instruction will only be executed by the LSU if it is guaranteed not to generate an exception and no earlier micro-ops will generate an exception. The handshaking protocol guarantees this using signals passed between the control unit, VPU and LSU.