Non-Kernel UDP Handler Bypassing OS Kernel for Direct Adapter Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

User mode software applications in computing devices experience performance drawbacks such as increased latency, processing power consumption, and reduced throughput due to indirect interaction with device components through the operating system kernel.

Innovation Solution

A non-kernel UDP protocol handler that bypasses the operating system kernel to directly access communication adapters, performing UDP operations using native semantics of the communication adapter, allowing user mode applications to interact directly with hardware components like InfiniBand or Ethernet adapters, thereby intercepting and handling UDP operations externally to the TCP-UDP/IP stack.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If user mode applications interact with device components through the operating system kernel, then system stability and security are maintained, but performance is degraded with increased latency and CPU utilization

Engineering Contradiction:
Improvesystem stabilityVSAvoidperformance
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

A non-kernel UDP protocol handler is introduced as an intermediary component that operates in user space to handle UDP operations. This handler intercepts UDP socket operations from user mode applications and processes them without requiring kernel mode transitions, thereby maintaining system stability through the OS interface while improving performance by eliminating kernel involvement in the critical UDP processing path.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The UDP protocol handling functionality is extracted from the operating system kernel and relocated to user space. By separating UDP operation handling from the kernel, the patent eliminates the performance overhead associated with kernel mode transitions while preserving the benefits of structured protocol processing through the extracted handler component.

Inventive Principle:
Principle #2Taking out (Extraction)

2Reliability

If UDP operations are processed through the operating system kernel, then protocol compliance is ensured, but processing overhead and latency increase

Engineering Contradiction:
Improveprotocol complianceVSAvoidlatency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The non-kernel UDP protocol handler serves as an intermediary that implements UDP protocol compliance in user space. It provides the necessary protocol processing functionality without requiring interactions with the kernel TCP-UDP/IP stack, thereby ensuring protocol compliance while minimizing latency by avoiding kernel mode transitions and associated context switches.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If user mode applications directly access communication adapters, then processing speed increases, but system security and stability may be compromised

Engineering Contradiction:
Improveprocessing speedVSAvoidsystem security
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The non-kernel UDP protocol handler acts as a controlled intermediary between user mode applications and communication adapters. It enables direct adapter access for performance while maintaining security through the structured handler interface that operates within user space, avoiding the need for applications to directly access hardware resources.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The UDP protocol handler enables user mode applications to self-serve their UDP processing needs without kernel intervention. By implementing the handling logic in user space, the system allows applications to directly manage their communication operations with adapters while maintaining appropriate boundaries through the handler abstraction layer.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS7848322B2Device, system and method of UDP communication
Publication Date: 2010.12.07 MELLANOX TECH TLV
  • US7848322B2 patent drawing
  • US7848322B2 patent drawing
  • US7848322B2 patent drawing

AI summary

Device, system and method of UDP communication. For example, an apparatus in accordance with an embodiment of the invention includes a non-kernel UDP protocol handler adapted to perform a UDP operation of a user mode application by bypassing the operating system kernel and directly accessing a communication adapter having an operating system bypass capability.