Out-of-Order Issue Queue Serialization via Slave Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Data processing systems face challenges in managing queues of processing operations, particularly in enforcing serialization instructions across multiple issue queues within out-of-order processors, where ensuring the correct ordering of instructions is crucial but complex due to varying requirements across different program instruction sets and processor architectures.

Innovation Solution

The system employs first and second processing circuitries to manage respective queues, with slave generation circuitry creating a slave processing operation in response to a master operation in another queue, and dependency control circuitry coordinating the processing of these operations based on their status to enforce serialization requirements, ensuring that instructions are issued only when their serialization conditions are met.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple issue queues are used to improve instruction throughput, then processing capacity increases, but ensuring correct serialization ordering across queues becomes more complex

Engineering Contradiction:
Improveinstruction throughputVSAvoidserialization management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent creates a slave copy of the serialization instruction in a second issue queue when a master serialization instruction is added to a first issue queue. This copying mechanism ensures that serialization ordering is enforced across multiple queues without requiring complex inter-queue coordination logic, as each queue independently manages its own serialization instructions.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The slave serialization instruction acts as an intermediary that mediates the serialization requirement between the master queue and the second queue. By introducing this intermediate representation, the system can enforce ordering constraints across queues without direct complex interaction between the queues themselves.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If serialization instructions are strictly enforced across all queues, then correct instruction ordering is maintained, but processing speed may be reduced due to additional control overhead

Engineering Contradiction:
Improveinstruction ordering accuracyVSAvoidprocessing speed
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

Each issue queue independently manages its own serialization instructions through the master-slave mechanism. The dependency control circuitry within each queue autonomously handles the enforcement of serialization ordering without requiring external intervention from other queues, reducing control overhead and improving processing speed while maintaining ordering accuracy.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The serialization control function is segmented and distributed across multiple independent issue queues, each with its own dependency control circuitry. This segmentation allows each queue to enforce serialization locally and independently, avoiding the need for a centralized control mechanism that would create bottlenecks and reduce processing speed.

Inventive Principle:
Principle #1Segmentation

3Adaptability or versatility

If different circuit designs are used for master and slave operations, then specific functionality is optimized, but device complexity and design difficulty increase

Engineering Contradiction:
Improvefunctional optimizationVSAvoidcircuit design complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The same issue queue circuit design is used to handle both master and slave serialization instructions. The universal queue structure can process both types of instructions through the same entry and execution paths, with the dependency control circuitry automatically distinguishing between master and slave operations based on their properties, thereby reducing design complexity while maintaining functional versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10042640B2Processing queue management
Publication Date: 2018.08.07 ARM LTD
  • US10042640B2 patent drawing
  • US10042640B2 patent drawing
  • US10042640B2 patent drawing

AI summary

A data processing system 2 includes multiple out-of-order issue queues 8, 10. A master serialization instruction MSI received by a first issue queue 8 is detected by slave generation circuitry 24 which generates a slave serialization instruction SSI added to a second issue queue 10. The master serialization instruction MSI manages serialization relative to the instructions within the first issue queue 8. The slave serialization instruction SSI manages serialization relative to the instructions within the second issue queue 10. The master serialization instruction MSI and the slave serialization instruction SSI are removed when both have met their serialization conditions and are respectively the oldest instructions within their issue queues.