Low Latency Ethernet Virtual Lanes for Data Center Storage Consolidation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Data center networks face complexity and high costs due to the need for redundant connectivity and separate Ethernet and Fibre Channel networks, which are inefficient and costly to maintain, especially with increasing server numbers and the desire for high availability and low latency.

Innovation Solution

Implementing a Low Latency Ethernet (LLE) solution that transforms Fibre Channel frames into a format suitable for Ethernet transport, using multiple virtual lanes with 'drop' and 'no-drop' behaviors, and active buffer management to achieve high reliability and low latency while reducing hardware costs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If separate Ethernet and Fibre Channel networks are used for server connectivity and storage traffic, then reliability and performance are improved, but device complexity and cost increase

Engineering Contradiction:
Improvenetwork reliabilityVSAvoidnetwork connectivity complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges Ethernet and Fibre Channel networks into a single unified network infrastructure. Storage traffic is encapsulated within Ethernet frames, allowing both server connectivity and storage traffic to share the same physical network infrastructure, thereby reducing device complexity while maintaining the reliability benefits of FC through virtual lane isolation.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent segments the unified network into multiple virtual lanes, where at least one virtual lane is dedicated to storage traffic. This segmentation allows storage traffic to receive priority treatment and isolation from general Ethernet traffic, maintaining FC-like reliability guarantees within the Ethernet network.

Inventive Principle:
Principle #1Segmentation

2Reliability

If redundant Ethernet connections are implemented for high availability, then system availability is improved, but connectivity cost increases

Engineering Contradiction:
Improvesystem availabilityVSAvoidconnectivity cost
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent enables Ethernet switches to perform multiple functions: they handle both general server traffic and storage traffic through virtual lane encapsulation. This multi-functionality eliminates the need for separate FC switches and redundant FC connectivity, reducing overall connectivity cost while maintaining high availability through Ethernet redundancy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If Fibre Channel is used for storage traffic, then packet loss is avoided, but network cost and complexity increase

Engineering Contradiction:
Improvepacket loss preventionVSAvoidnetwork infrastructure cost
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces virtual lanes as an intermediary mechanism within Ethernet frames to provide FC-like reliable delivery guarantees. The virtual lanes act as a mediator that isolates storage traffic, manages buffering credits, and ensures ordered delivery, thereby achieving FC reliability without requiring actual FC infrastructure.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Speed

If Ethernet speed increases to 10 Gb/s, then bandwidth is improved, but buffer management complexity increases

Engineering Contradiction:
Improvenetwork bandwidthVSAvoidbuffer management complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The patent segments the high-speed Ethernet buffer into multiple virtual lanes, each with its own buffering credits and management. This segmentation allows independent buffer management for storage traffic versus general traffic, simplifying the overall buffer management complexity at 10 Gb/s by distributing the management burden across multiple isolated channels.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS7564869B2Fibre channel over ethernet
Publication Date: 2009.07.21 CISCO TECHNOLOGY INC
  • US7564869B2 patent drawing
  • US7564869B2 patent drawing
  • US7564869B2 patent drawing

AI summary

The present invention provides methods and devices for implementing a Low Latency Ethernet (“LLE”) solution, also referred to herein as a Data Center Ethernet (“DCE”) solution, which simplifies the connectivity of data centers and provides a high bandwidth, low latency network for carrying Ethernet and storage traffic. Some aspects of the invention involve transforming FC frames into a format suitable for transport on an Ethernet. Some preferred implementations of the invention implement multiple virtual lanes (“VLs”) in a single physical connection of a data center or similar network. Some VLs are “drop” VLs, with Ethernet-like behavior, and others are “no-drop” lanes with FC-like behavior. Some preferred implementations of the invention provide guaranteed bandwidth based on credits and VL. Active buffer management allows for both high reliability and low latency while using small frame buffers. Preferably, the rules for active buffer management are different for drop and no drop VLs.