Message-Based TCP Packet Segmentation for Latency Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional systems for transmitting data over TCP streams require dedicated parsers to interpret incoming data and split it into distinct messages, leading to increased computational overhead and end-to-end latency.

Innovation Solution

The system introduces a new option to TCP packets, allowing them to be treated as message-based packets, eliminating the need for parsers on the receive side and enabling efficient message-based communication without additional overhead.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional TCP stream protocols are used, then data can be transmitted over the network, but dedicated parsers are required which increase computational overhead and latency

Engineering Contradiction:
Improvedata transmission reliabilityVSAvoidend-to-end latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent segments the TCP stream into distinct message-based packets by introducing a message boundary indicator option in the TCP packet header. This segmentation allows the receiver to identify message boundaries without requiring complex parsing logic, thereby reducing computational overhead and latency while maintaining reliable data transmission.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary mechanism (the message boundary indicator option) that mediates between the TCP stream protocol and the application layer. This intermediary enables message-based communication over TCP without requiring dedicated parsers, thus reducing computational overhead and end-to-end latency while preserving transmission reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If dedicated parsers are implemented to interpret TCP streams, then messages can be distinguished, but computational overhead increases

Engineering Contradiction:
Improvemessage boundary identificationVSAvoidcomputational overhead
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The patent extracts the message boundary identification function from the application layer and embeds it directly in the TCP packet header as an option. This extraction eliminates the need for dedicated parsers at the receiver, reducing computational overhead while ensuring accurate message boundary identification.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The TCP protocol itself provides message boundary identification through the newly introduced option, making the system self-sufficient. The receiver can identify message boundaries using the information embedded in the packet headers without requiring external parsing logic, thereby reducing computational overhead.

Inventive Principle:
Principle #25Self-service

3Productivity

If message-based communication is implemented over TCP, then communication efficiency improves, but protocol complexity increases

Engineering Contradiction:
Improvedata transmission efficiencyVSAvoidprotocol complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent makes the TCP protocol multi-functional by adding an option that enables both traditional stream-based communication and message-based communication using the same protocol foundation. This universality allows message-based communication to be implemented without creating a separate protocol, thus improving transmission efficiency while minimizing protocol complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent changes the parameters of the TCP packet header by adding an option field that indicates message boundaries. This parameter change enables message-based communication semantics without fundamentally altering the TCP protocol structure, thereby improving communication efficiency while keeping protocol complexity manageable.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250159054A1Systems and methods of message-based packets
Publication Date: 2025.05.15 MELLANOX TECHNOLOGIES LTD(IL)
  • US20250159054A1 patent drawing
  • US20250159054A1 patent drawing
  • US20250159054A1 patent drawing

AI summary

A system for transmitting data is described, among other things. An illustrative system is disclosed to include one or more circuits to perform transmitting message-based data over packets. The circuits are capable of identifying a first message, transmitting a first portion of the first message in a first packet, the first packet including a bit indicating the first packet is message-based, and transmitting an end portion of the first message in a second packet, the second packet including a first bit indicating the second packet is message-based and a second bit indicating the second packet comprises the end portion of the first message.