Ring Bus Trace Report Packet Collection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Monitoring the activity of various components in processing devices, particularly in multi-tile processing units used for machine intelligence applications, is challenging due to the complexity of data exchange and synchronization between tiles, which hinders effective data collection and analysis.

Innovation Solution

A device and method utilizing a bus with a ring path to circulate trace report packets with a fixed time period, allowing each component to insert trace data, enabling systematic collection and analysis of trace data from multiple components attached to the bus.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a processing device includes multiple components for different functions, then the processing capability and functionality are improved, but the difficulty of monitoring and collecting trace data from various components increases

Engineering Contradiction:
Improveprocessing capabilityVSAvoidmonitoring difficulty
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent merges trace data collection from multiple components into a unified ring-based bus system. Instead of separate monitoring mechanisms for each component, all components attach to a common ring bus that circulates trace report packets, allowing centralized and standardized data collection across the entire multi-component system.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The ring bus acts as an intermediary between multiple components and the trace data collection system. The circulating trace report packet serves as a mediator that visits each component in sequence, collecting trace data without requiring direct monitoring connections between each component pair, thus simplifying the monitoring architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If trace data is collected from multiple components simultaneously, then comprehensive monitoring is achieved, but the complexity of data synchronization and circulation increases

Engineering Contradiction:
Improvetrace data completenessVSAvoiddata circulation complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The trace report packet circulates periodically around the ring bus, visiting each component in a fixed sequence at regular intervals. This periodic circulation ensures that trace data from all components is collected systematically and completely, while the fixed time period simplifies synchronization compared to arbitrary simultaneous collection from all components.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The trace report packet is prepared in advance with a fixed circulation schedule before data collection begins. Each component knows when to expect the packet and when to insert its trace data, eliminating the need for complex real-time coordination during actual data collection operations.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If a ring bus is used to circulate trace report packets with fixed time periods, then systematic data collection is improved, but the time required for complete data circulation increases

Engineering Contradiction:
Improvedata collection precisionVSAvoidcirculation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

By establishing a fixed periodic circulation schedule, the system achieves precise and predictable data collection timing. Each component knows exactly when to expect the trace report packet, enabling synchronized and precise data insertion, while the regular intervals optimize the balance between completeness and time efficiency.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11675686B2Tracing activity from multiple components of a device
Publication Date: 2023.06.13 GRAPHCORE LTD
  • US11675686B2 patent drawing
  • US11675686B2 patent drawing
  • US11675686B2 patent drawing

AI summary

A device comprising: a bus forming a ring path for circulation of one or more data packets around the bus, wherein the one or more data packets comprises a trace report packet for collecting trace data from a plurality of components attached to the bus, wherein the bus is configured to repeatedly circulate the trace report packet with a fixed time period taken for each circulation of the ring path performed by the trace report packet; and the plurality of components, each of which comprises circuitry configured to, upon reception of the trace report packet at the respective component, insert one or more items of the trace data that have been obtained by the respective component.