Coordinator for Batch Transmission Timing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Processing batch transmissions in real-time is challenging due to resource constraints and irregular transmission patterns, leading to inefficiencies in maintaining constantly available processing applications.

Innovation Solution

A coordinator is used to coordinate the execution of a data processing application with batch transmissions from a data publishing application, determining optimal startup and shutdown times based on registration information and analyzing previous transmissions to adjust resource allocation and priority levels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a data processing application is kept constantly available to process batch transmissions in real-time, then processing reliability is improved, but resource consumption increases

Engineering Contradiction:

Improveprocessing reliabilityVSAvoidresource consumption

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The coordinator performs preliminary actions by predicting batch transmission times based on historical patterns and proactively starting the data processing application before the actual batch arrives. This ensures the application is ready to process immediately when data arrives, maintaining reliability without requiring constant availability. The system analyzes past transmission patterns and schedules startup in advance, avoiding both resource waste from continuous operation and delays from cold starts.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts the operational state of the data processing application based on predicted workload. Instead of a static constant-on approach, the application transitions between stopped and running states based on real-time predictions from the coordinator. This dynamic behavior optimizes resource usage while ensuring the application is active when batches are expected, resolving the contradiction between reliability and resource consumption.

Inventive Principle:

Principle #15Dynamics

2Use of energy by moving object

If the data processing application is started only when a batch transmission arrives, then resource consumption is reduced, but processing delay increases

Engineering Contradiction:

Improveresource consumptionVSAvoidprocessing delay

Core Design Contradiction:

Use of energy by moving objectVSLoss of time

Solution Approach 1:

The coordinator analyzes historical batch transmission patterns and predicts future arrival times. Based on these predictions, it proactively starts the data processing application before the actual batch arrives, eliminating cold-start delays while avoiding unnecessary prolonged operation. This preliminary action ensures the application is ready when needed, reducing processing delay without the resource waste of constant availability.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system implements feedback loops where the coordinator continuously monitors actual batch arrival times against predictions, and adjusts future predictions based on observed patterns. This learning mechanism improves the accuracy of startup timing over time, ensuring minimal processing delay while optimizing resource consumption by avoiding both premature and delayed startups.

Inventive Principle:

Principle #23Feedback

3Speed

If batch transmissions are processed as they arrive without coordination, then processing speed is maintained, but system efficiency decreases due to irregular patterns

Engineering Contradiction:

Improveprocessing speedVSAvoidsystem efficiency

Core Design Contradiction:

SpeedVSProductivity

Solution Approach 1:

The coordinator identifies periodic patterns in batch transmission arrivals and schedules the data processing application to operate during these periodic intervals. By aligning application operation with the periodic nature of batch arrivals, the system maintains processing speed when batches are present while avoiding resource consumption during idle periods, thereby improving overall system efficiency.

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

The coordinator uses feedback from historical transmission patterns to optimize the timing and duration of application operation. By continuously learning from actual batch arrival patterns and adjusting predictions accordingly, the system achieves both fast processing response and high overall efficiency, resolving the contradiction between maintaining processing speed and improving system-wide productivity.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS11016803B2Coordination of batch transmissions and processing between transmitting and receiving computing systems

Publication Date: 2021.05.25 PAYPAL INC

AI summary

Techniques are disclosed relating to coordinating processing data transmissions between computing systems over a network. In various embodiments, a system includes a coordinator that receives information about an expected batch transmission between a data publishing application at a first computing system and a data processing application at a second computing system. Based on the received information, the coordinator determines a time when the data publishing application is expected to publish the batch transmission to the data processing application and causes the second computing system to initiate execution of the data processing application in conjunction with the determined time to receive and process the batch transmission from the data publishing application.