Fanout Processor Circuit for Low-Latency Market Data Streaming

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current solutions fail to simultaneously address latency, throughput, and data stream errors in real-time data processing for continuous big data streams with varying transmission and consumption rates across multiple recipients.

Innovation Solution

A processor architecture with TCP client and server circuits, a fanout circuit, and a register that configures transmission rates and message sizes to efficiently interleave and fan out data streams to multiple recipients, ensuring reliability, order, and error correction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If data streams are processed and fanned out to multiple recipients in real-time, then throughput is improved, but latency increases

Engineering Contradiction:

ImprovethroughputVSAvoidlatency

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The system segments incoming data streams into individual data messages that can be independently routed to different recipients. The fanout circuit divides the continuous data stream into discrete units that can be processed and transmitted simultaneously to multiple destinations, improving throughput while maintaining low latency through parallel processing.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces a temporal dimension to data processing by using a register to store transmission rates over time. This allows the system to dynamically adjust fanout rates based on recipient consumption rates, enabling high throughput during periods of high demand while maintaining low latency when recipients can process data faster.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Productivity

If transmission rates are increased to handle large data volumes, then throughput is improved, but data stream errors increase

Engineering Contradiction:

ImprovethroughputVSAvoiddata stream errors

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system implements feedback mechanisms where the fanout circuit monitors transmission rates and adjusts them based on recipient consumption rates stored in the register. This closed-loop control ensures that data is transmitted at optimal rates that maximize throughput while maintaining reliability by preventing overwhelming recipients with data they cannot process, thereby reducing errors.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent employs dynamic transmission rates that can be adjusted in real-time based on system conditions. The configurable register allows transmission rates to be modified without hardware changes, enabling the system to adapt to varying data volumes and recipient capabilities, thus maintaining high throughput while minimizing errors through rate optimization.

Inventive Principle:

Principle #15Dynamics

3Adaptability or versatility

If multiple TCP server circuits are used to send data to different recipients, then adaptability is improved, but device complexity increases

Engineering Contradiction:

Improverecipient compatibilityVSAvoidcircuit architecture

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The fanout circuit is designed as a universal component that can route data to multiple different recipients through multiple TCP server circuits. This single circuit performs the function of multiple dedicated routing circuits, providing adaptability to different recipients while maintaining relatively simple device architecture through functional consolidation.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The fanout circuit acts as an intermediary between the data source and multiple recipients. It mediates the data flow by receiving data from TCP client circuits and distributing it to appropriate TCP server circuits based on configured transmission rates, thereby simplifying the overall architecture while maintaining high adaptability to different recipient requirements.

Inventive Principle:

Principle #24Intermediary (Mediator)

4Reliability

If configurable transmission rates are implemented to match recipient consumption rates, then reliability is improved, but device complexity increases

Engineering Contradiction:

Improvedelivery accuracyVSAvoidconfiguration management

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The system changes the parameter of transmission rate dynamically based on recipient consumption rates. The register stores configurable rate parameters that can be adjusted to match different recipient capabilities, improving reliability by ensuring data is transmitted at appropriate rates without requiring complex control logic, thus maintaining relatively simple device architecture.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS20250373676A1Fanout processor

Publication Date: 2025.12.04 BGC PARTNERS LP

AI summary

Disclosed herein is a processor to process streaming data. The processor includes a TCP client circuit and a TCP server circuit. A fanout circuit is communicatively coupled to the TCP client circuit and the TCP server circuit. The fanout circuit receives data from the TCP client circuit, determines a rate at which to transmit the received market data, and instructs the TCP server circuit to send the received data at the determined rate.