Stream Computing Window Management via Dynamic Resource Adaptation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In stream computing environments, managing increasing data volumes efficiently is challenging due to the need for dynamic window management that adapts to system resources, as existing methods fail to effectively adjust window sizes based on available resources, leading to suboptimal performance and throughput.

Innovation Solution

The solution involves dynamically adjusting the window sizes of stream operators in a stream computing environment based on system usage and available resources, with modifications made according to thresholds, and eviction operations to optimize resource utilization and performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If window sizes of stream operators are increased to process more data, then data processing capacity improves, but system resource consumption increases

Engineering Contradiction:

Improvedata processing capacityVSAvoidsystem resource consumption

Core Design Contradiction:

ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent implements dynamic window size adjustment where the window configuration of stream operators is modified based on monitored system resources. When resources are abundant, window sizes increase to boost throughput; when resources are constrained, window sizes decrease to conserve resources. This dynamic adaptation resolves the contradiction by making the system flexible rather than static.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent changes the window size parameter of stream operators based on system resource conditions. By adjusting this key parameter dynamically, the system can optimize between processing capacity and resource consumption, directly addressing the technical contradiction through parameter optimization.

Inventive Principle:

Principle #35Parameter changes

2Adaptability or versatility

If fixed window configurations are used in stream computing, then system simplicity is maintained, but adaptability to varying resource conditions deteriorates

Engineering Contradiction:

Improveadaptability to resource conditionsVSAvoidwindow management complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements self-service through automatic window configuration adjustment. The system monitors its own resource conditions and autonomously modifies window sizes without external intervention. This self-managing approach enhances adaptability while keeping operational complexity low, as the system handles its own optimization.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent employs feedback mechanisms where system resource usage is continuously monitored and fed back to the window management system. Based on this feedback, window configurations are automatically adjusted. This closed-loop control enables adaptability to changing conditions while maintaining manageable complexity through automated decision-making.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS10572276B2Window management based on a set of computing resources in a stream computing environment

Publication Date: 2020.02.25 INTERNATIONAL BUSINESS MACHINE CORPORATION

AI summary

Disclosed aspects relate to window management in a stream computing environment. A set of computing resources may be detected with respect to the stream computing environment. Based on the set of computing resources, a set of window configurations in the stream computing environment may be determined. In response to determining the set of window configurations in the stream computing environment, the set of window configurations may be established in the stream computing environment.