Dataflow Graph Context Records for Unmodified Data Transmission

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing data processing systems face inefficiencies in managing context data within dataflow graphs, requiring modifications to records or additional data flows to transmit context data, which can lead to system downtime and reduced flexibility.

Innovation Solution

A method for transmitting context data alongside data records within the same dataflow without modifying the records, using implicit data records to associate context data with specific records, allowing components to handle context data automatically and maintain context without altering the dataflow graph structure.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If context data is transmitted using additional data flows, then context data can be transmitted between nodes, but the dataflow graph structure becomes more complex and requires modifications

Engineering Contradiction:

Improvecontext data transmissionVSAvoiddataflow graph structure

Core Design Contradiction:

Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges context data transmission with the existing data record flow by embedding context data within implicit data records that travel alongside explicit data records through the same dataflow graph edges, eliminating the need for separate context data transmission channels

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces implicit data records as intermediary carriers that embed context data about explicit data records, allowing context information to be transmitted without creating separate data flows or modifying the core dataflow graph structure

Inventive Principle:

Principle #24Intermediary (Mediator)

2Loss of information

If records are modified to include context data, then context data can be associated with records, but the record structure becomes more complex and processing overhead increases

Engineering Contradiction:

Improvecontext data associationVSAvoidrecord structure

Core Design Contradiction:

Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments data into two distinct types - explicit data records containing actual data and implicit data records containing context information - allowing each to maintain its own optimized structure while traveling together through the dataflow graph

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent uses implicit data records as intermediary carriers that hold context data without modifying the structure of explicit data records, enabling context association while preserving the original record formats

Inventive Principle:

Principle #24Intermediary (Mediator)

3Adaptability or versatility

If the dataflow graph is modified to handle context data, then context data processing capability is improved, but system downtime increases and flexibility is reduced

Engineering Contradiction:

Improvecontext data processing capabilityVSAvoidsystem downtime

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent makes the dataflow graph universally capable of handling both explicit data records and implicit context data records through the same edges and nodes, allowing the system to process context data without modifying the graph structure or incurring downtime

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent enables the dataflow graph to automatically handle context data transmission and processing through its existing infrastructure, with nodes and edges naturally accommodating both explicit and implicit records without requiring external modifications or system downtime

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS20250307220A1Sending Contextual Data on Dataflows of Dataflow Graphs

Publication Date: 2025.10.02 AB INITIO TECHNOLOGY LLC

AI summary

A method implemented by a data processing system for processing records with a dataflow graph that includes transmitting the records over a dataflow of the dataflow graph and transmitting, among the records, information, associated with the processing of the records, over the same dataflow without modifying the records. The information can include trace data describing how the records are being processed.