Control Crossbar Dedicated Connections for Traffic Load

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In computing systems, the physical design of data transport mechanisms is often optimized for the majority data traffic type, leading to wasted bandwidth and performance impact when transmitting different types of data, as the same channel is used for various data types, resulting in inefficient data transmission.

Innovation Solution

A parallel processing unit with a control crossbar unit that implements different types of dedicated connections to efficiently transmit control information, reducing the load on the main crossbar unit and minimizing bandwidth waste by optimizing each channel for specific types of data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the same physical channel is used to transmit different types of data between two components, then the device complexity is reduced, but the bandwidth utilization efficiency deteriorates due to wasted bandwidth for non-majority traffic types

Engineering Contradiction:

Improvedata transport mechanism structureVSAvoidbandwidth utilization efficiency

Core Design Contradiction:

Device complexityVSLoss of energy

Solution Approach 1:

The patent segments the data transport mechanism into multiple physical channels, each optimized for specific data traffic types. The crossbar switch is divided into a main crossbar unit for majority traffic and dedicated connection units for minority traffic types, allowing each channel to operate at optimal efficiency without compromising the other.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Different physical channels are assigned different characteristics optimized for their specific traffic types. The main crossbar is designed with high bandwidth for large data packets, while dedicated connections are optimized for control information and state data, ensuring each channel has the appropriate quality for its intended use.

Inventive Principle:

Principle #3Local quality

2Productivity

If the physical design is optimized for the majority data traffic type, then the productivity for majority traffic is improved, but the adaptability to handle various data types deteriorates

Engineering Contradiction:

Improvedata transmission speedVSAvoiddata traffic type flexibility

Core Design Contradiction:

ProductivityVSAdaptability or versatility

Solution Approach 1:

The transport mechanism is segmented into specialized channels that maintain high productivity for their respective traffic types while collectively providing versatility for all data types. Each segment handles specific traffic patterns efficiently.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The system achieves universality by combining multiple specialized channels, each optimized for specific functions. The main crossbar handles majority traffic while dedicated connections handle minority traffic, creating a multi-functional system that adapts to various data types without sacrificing optimization for any single type.

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Loss of energy

If dedicated connections are implemented for different data types, then the bandwidth utilization efficiency is improved, but the device complexity increases due to multiple crossbar units

Engineering Contradiction:

Improvebandwidth wasteVSAvoidcrossbar unit structure

Core Design Contradiction:

Loss of energyVSDevice complexity

Solution Approach 1:

The patent extracts the minority traffic handling function from the main crossbar unit and places it in dedicated connection units. This separation reduces the load on the main crossbar and eliminates bandwidth waste for minority traffic, while the extracted components are designed to be as simple as possible for their specific function.

Inventive Principle:

Principle #2Taking out (Extraction)

4Ease of operation

If the same channel is used for all data types, then the ease of operation is maintained, but the loss of time occurs due to bandwidth waiting and retransmission

Engineering Contradiction:

Improvechannel management simplicityVSAvoiddata transmission delay

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The channel segmentation automatically routes different data types to appropriate channels, eliminating the need for complex manual management while reducing transmission delays. Each channel operates independently with optimized speed for its traffic type.

Inventive Principle:

Principle #1Segmentation

Data Source

PatentUS8065465B1Mitigating main crossbar load using dedicated connections for certain traffic types

Publication Date: 2011.11.22 NVIDIA CORP

AI summary

One embodiment of the invention sets forth a control crossbar unit that is designed to transmit control information from control information generators to destination components within the computer system. The control information may belong to various traffic paradigms, such as short-latency data traffic, narrow-width data traffic or broadcast data traffic. The physical connections within the control crossbar unit are categorized based on the different types of control information being transmitted through the control crossbar unit. The physical connections belong to the following categories: one-to-one (OTO) connections, one-to-many (OTM) connections, valid-to-one (VTO) connections, valid-to-many (VTM) connections wire-to-one (WTO) connections and wire-to-many (WTM) connections.