Parallel Processor Command Stream Synchronization Control

Solution Overview

Problem

Existing parallel processing systems face challenges in efficiently controlling synchronization in command stream based processing, leading to increased processing time and energy consumption due to complex data dependencies and cross-queue interactions.

Innovation Solution

The method involves analyzing command streams to detect dependencies, generating timeline dependency points, determining completion stream timeline points, comparing these points to determine the latest stream timeline point, and generating synchronization control instructions based on this analysis to optimize synchronization in command stream processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional synchronization control methods are used in command stream based parallel processing, then correct synchronization between execution units is maintained, but processing time and energy consumption increase due to complex data dependencies and cross-queue interactions

Engineering Contradiction:

Improvesynchronization correctnessVSAvoidprocessing time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary analysis of the command stream to detect dependencies and generate timeline dependency points before execution. By determining completion stream timeline points and generating synchronization control instructions in advance, the system avoids runtime synchronization overhead while maintaining correctness.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent introduces timeline dependency points as intermediary markers within the command stream. These points act as synchronization checkpoints that mediate between different execution units and queues, enabling coordinated parallel execution without requiring complex direct synchronization protocols.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Reliability

If traditional synchronization control methods are used in command stream based parallel processing, then correct synchronization between execution units is maintained, but energy consumption increases due to complex data dependencies and cross-queue interactions

Engineering Contradiction:

Improvesynchronization correctnessVSAvoidenergy consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary analysis of the command stream to detect dependencies and generate timeline dependency points before execution. By determining completion stream timeline points and generating synchronization control instructions in advance, the system avoids runtime synchronization overhead while maintaining correctness.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent introduces timeline dependency points as intermediary markers within the command stream. These points act as synchronization checkpoints that mediate between different execution units and queues, enabling coordinated parallel execution without requiring complex direct synchronization protocols.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Productivity

If the number of synchronizations is reduced in command stream processing, then processing overhead and energy consumption are minimized, but maintaining correct synchronization becomes more difficult

Engineering Contradiction:

Improveprocessing efficiencyVSAvoidsynchronization control complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The system transforms the synchronization control problem by changing parameters from traditional barrier-based synchronization to timeline-based synchronization. By representing dependencies as timeline dependency points with associated completion times, the system simplifies the synchronization model while maintaining correctness through temporal ordering.

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The system performs preliminary analysis of the command stream to detect dependencies and generate timeline dependency points before execution. By determining completion stream timeline points and generating synchronization control instructions in advance, the system avoids runtime synchronization overhead while maintaining correctness.

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS20250110747A1Parallel processing control

Publication Date: 2025.04.03 ARM LTD

AI summary

A method of preparing a command stream for a parallel processor, comprising: analysing the command stream to detect at least a first dependency; generating at least one timeline dependency point responsive to detecting the first dependency; determining a latest action for the first dependency to derive a completion stream timeline point for the first dependency; comparing the completion stream timeline point for the first dependency with a completion stream timeline point for a second dependency to determine a latest stream timeline point; generating at least one command stream synchronization control instruction according to the latest stream timeline point; and providing the command stream and the at least one command stream synchronization control instruction to an execution unit of the parallel processor.