Interconnect Transaction Bypass Buffer for Lower Routing Overhead

Solution Overview

Problem

Complex System on Chip (SoC) designs require efficient management of memory access and routing to minimize latency and bandwidth overhead, especially in multi-core architectures where high performance and scalability are critical for applications like robotics and cloud computing.

Innovation Solution

Implementing a packet-based switch fabric with a central routing module that includes a bypass buffer to store and route only necessary control information, reducing routing overhead by eliminating unnecessary data transmission and optimizing data flow between processor modules and shared memory.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a management protocol with overhead information is used to control routing of packets through an interconnect fabric, then routing control is achieved, but routing overhead increases

Engineering Contradiction:

Improverouting controlVSAvoidrouting overhead

Core Design Contradiction:

Ease of operationVSLoss of substance

Solution Approach 1:

The patent extracts only the essential control information from the complete management protocol packet. Instead of transmitting full protocol packets with all overhead information through the interconnect fabric, the system identifies and transmits only the minimum necessary control fields required for routing and transaction completion, thereby reducing routing overhead while maintaining routing control capability

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by transmitting a subset of the full management protocol information. Rather than sending complete protocol packets with all control fields, the system sends only the partial control information necessary for routing decisions and transaction management, eliminating unnecessary overhead while preserving essential routing control functions

Inventive Principle:

Principle #16Partial or excessive action

2Measurement precision

If complete control information is transmitted through the interconnect fabric, then routing accuracy is maintained, but data throughput decreases

Engineering Contradiction:

Improverouting accuracyVSAvoiddata throughput

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

The patent extracts only the essential control information from the complete management protocol packet. Instead of transmitting full protocol packets with all overhead information through the interconnect fabric, the system identifies and transmits only the minimum necessary control fields required for routing and transaction completion, thereby reducing routing overhead while maintaining routing control capability

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by transmitting a subset of the full management protocol information. Rather than sending complete protocol packets with all control fields, the system sends only the partial control information necessary for routing decisions and transaction management, eliminating unnecessary overhead while preserving essential routing control functions

Inventive Principle:

Principle #16Partial or excessive action

3Productivity

If routing overhead is minimized by transmitting only essential control information, then data throughput increases, but routing control capability may be reduced

Engineering Contradiction:

Improvedata throughputVSAvoidrouting control capability

Core Design Contradiction:

ProductivityVSEase of operation

Solution Approach 1:

The patent introduces an intermediary mechanism where a buffer stores transaction information and control fields. This buffer acts as a mediator that holds the minimal essential control information needed for routing decisions, allowing the system to maintain routing control capability while transmitting reduced overhead packets through the interconnect fabric

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent applies preliminary action by pre-storing transaction control information in a buffer before transmission. The essential control fields are prepared and held in advance in the buffer, enabling the system to transmit only necessary routing information while maintaining full routing control capability when needed

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS9195610B2Transaction info bypass for nodes coupled to an interconnect fabric

Publication Date: 2015.11.24 TEXAS INSTRUMENTS INC

AI summary

A shared resource within a module may be accessed by a request from an external requester. An external transaction request may be received from an external requester outside the module for access to the shared resource that includes control information, not all of which is needed to access the shared resource. The external transaction request may be modified to form a modified request by removing a portion of the locally unneeded control information and storing the unneeded portion of control information as an entry in a bypass buffer. A reply received from the shared resource may be modified by appending the stored portion of control information from the entry in the bypass buffer before sending the modified reply to the external requester.