Cache Coherent Command Queue Controller Protocol

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In cache coherent systems, broadcasting global maintenance commands across multiple core clusters is inefficient due to the lack of a standardized protocol for ensuring all cores execute these commands effectively, leading to potential inconsistencies and incomplete execution acknowledgments.

Innovation Solution

A system where an originating core detects a global maintenance command and sends it to a command queue controller, which broadcasts the command to all relevant clusters, ensuring each core executes the command and sends acknowledgments back through the controller, which then provides a final acknowledgment to the originating core upon completion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If global maintenance commands are broadcast across multiple core clusters without a standardized protocol, then command propagation speed is improved, but execution consistency and reliability deteriorate

Engineering Contradiction:
Improvecommand propagation speedVSAvoidexecution consistency
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The patent implements an acknowledgment mechanism where receiving cores send feedback signals back to the originating core upon executing maintenance commands. This feedback loop ensures that the originating core can verify command execution status across all clusters, resolving the contradiction by maintaining both fast propagation and reliable execution verification.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent establishes a standardized protocol framework in advance that defines command formats, transmission rules, and acknowledgment procedures. This preliminary structuring enables efficient command propagation while ensuring execution consistency, as all cores follow pre-defined rules for receiving and executing commands.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If a standardized protocol with acknowledgment mechanisms is implemented, then execution reliability is improved, but system complexity increases

Engineering Contradiction:
Improveexecution verificationVSAvoidprotocol structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the acknowledgment process into discrete, manageable components: individual acknowledgment signals from each receiving core, and systematic tracking by the originating core. This segmentation makes the complex verification process more manageable and implementable without overwhelming system complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent designs a universal acknowledgment mechanism that can handle various types of maintenance commands across different core clusters through a standardized interface. This multi-functional approach reduces overall system complexity by using a single protocol framework for diverse command types rather than implementing separate protocols for each command.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Stability of the object's composition

If all cores execute maintenance commands with full verification, then cache coherency is improved, but processing time increases

Engineering Contradiction:
Improvecache coherencyVSAvoidcommand execution time
Core Design Contradiction:
Stability of the object's compositionVSLoss of time

Solution Approach 1:

The patent implements periodic acknowledgment signaling where cores send verification signals at defined intervals after executing maintenance commands. This periodic verification maintains cache coherency through systematic checks while minimizing time loss by using regular, predictable verification cycles rather than continuous monitoring.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS9418010B2Global maintenance command protocol in a cache coherent system
Publication Date: 2016.08.16 APPLE INC
  • US9418010B2 patent drawing
  • US9418010B2 patent drawing
  • US9418010B2 patent drawing

AI summary

A system may include a command queue controller coupled to a number of clusters of cores, where each cluster includes a cache shared amongst the cores. An originating core of one of the clusters may detect a global maintenance command and send the global maintenance command to the command queue controller. The command queue controller may broadcast the global maintenance command to the clusters including the originating core's cluster. Each of the cores of the clusters may execute the global maintenance command. Each cluster may send an acknowledgement to the command queue controller upon completed execution of the global maintenance command by each core of the cluster. The command queue controller may also send, upon receiving an acknowledgement from each cluster, a final acknowledgement to the originating core's cluster.