Control Crossbar Dedicated Channels Reduce Main Load

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In computing systems, the inefficiency in data transport mechanisms leads to wasted bandwidth due to the use of a single physical channel for transmitting different types of data, where the design is optimized for the majority data traffic type, resulting in suboptimal performance for other types of data traffic.

Innovation Solution

A parallel processing unit with a control crossbar unit that implements dedicated transmission channels optimized for different types of control information, reducing the load on the main crossbar unit and minimizing bandwidth waste by using one-to-one, one-to-many, valid-to-one, valid-to-many, wire-to-one, and wire-to-many connections with optional flow control mechanisms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single physical channel is used to transmit different types of data, then device complexity is reduced, but bandwidth is wasted due to suboptimal performance for certain data types

Engineering Contradiction:
Improvedata transport mechanismVSAvoidbandwidth waste
Core Design Contradiction:
Device complexityVSLoss of energy

Solution Approach 1:

The patent divides the data transport mechanism into separate physical channels for different data types (control data, vertex data, fragment data, etc.). Each channel is dedicated to transmitting specific types of data, eliminating the need to share bandwidth across multiple data types and thus reducing bandwidth waste while maintaining manageable system complexity through structured segmentation.

Inventive Principle:
Principle #1Segmentation

2Productivity

If the physical channel is optimized for the majority data traffic type, then productivity for that data type is improved, but performance deteriorates for other data types

Engineering Contradiction:
Improvedata transmission performanceVSAvoidperformance across different data types
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent implements local quality by optimizing each dedicated physical channel for its specific data type. For example, control data channels are optimized for low latency and flow control requirements, while vertex and fragment data channels are optimized for their specific transmission patterns. This allows each channel to achieve optimal performance for its designated data type without compromising other types, thereby maintaining high adaptability across diverse data transmission needs.

Inventive Principle:
Principle #3Local quality

3Loss of energy

If dedicated transmission channels are implemented for different control information types, then bandwidth waste is reduced, but device complexity increases

Engineering Contradiction:
Improvebandwidth wasteVSAvoidtransmission channel structure
Core Design Contradiction:
Loss of energyVSDevice complexity

Solution Approach 1:

The patent applies universality by designing a unified control crossbar unit that manages multiple dedicated transmission channels for different control information types (one-to-one, one-to-many, valid-to-one, valid-to-many connections). This control crossbar unit serves multiple functions: it routes control data, manages flow control, and coordinates between different channel types, thereby reducing overall system complexity despite the presence of multiple dedicated channels.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9367487B1Mitigating main crossbar load using dedicated connections for certain traffic types
Publication Date: 2016.06.14 NVIDIA CORP
  • US9367487B1 patent drawing
  • US9367487B1 patent drawing
  • US9367487B1 patent drawing

AI summary

One embodiment of the invention sets forth a control crossbar unit that is designed to transmit control information from control information generators to destination components within the computer system. The control information may belong to various traffic paradigms, such as short-latency data traffic, narrow-width data traffic or broadcast data traffic. The physical connections within the control crossbar unit are categorized based on the different types of control information being transmitted through the control crossbar unit. The physical connections belong to the following categories: one-to-one (OTO) connections, one-to-many (OTM) connections, valid-to-one (VTO) connections, valid-to-many (VTM) connections wire-to-one (WTO) connections and wire-to-many (WTM) connections.