Stream Segment Scaling via Load Trend Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing stream storage systems inaccurately determine when to increase or decrease the number of segments in a data stream based on communication load measurements, leading to unnecessary changes.
Innovation Solution
A system that predicts future communication load using trend analysis, such as moving average convergence divergence (MACD), and adjusts segment sizes based on threshold conditions, either splitting or merging segments accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If segment scaling is based on present communication load measurements, then the system can respond to current conditions, but the number of segments is unnecessarily increased or decreased due to inaccurate timing
Solution Approach 1:
The system performs preliminary actions by predicting future communication load before actually making segment scaling decisions. The prediction component analyzes current and historical load data to forecast future conditions, allowing the system to proactively adjust segments in advance of actual load changes, thereby avoiding reactive over-adjustments based on transient fluctuations.
2Adaptability or versatility
If the number of segments is increased to handle high communication load, then the system can manage peak loads better, but unnecessary segment increases occur when load measurements are inaccurate
Solution Approach 1:
The system implements feedback mechanisms where segment scaling decisions are continuously evaluated against actual communication load outcomes. The prediction component provides feedback loops that compare predicted versus actual load, allowing the system to learn from past decisions and refine future scaling choices, thereby reducing unnecessary segment changes while maintaining appropriate load handling capacity.
Data Source
AI summary
The described technology is generally directed towards automatically scaling segments of a stream of data. According to an embodiment, a system can comprise a memory that can store computer executable components, and a processor that can execute the computer executable components stored in the memory. The computer executable components can comprise a predictor that can predict a future communication load of a stream of data provided by a stream provider device, the stream comprising segments of a size. The computer executable components can further comprise a size changer that can receive an indication that a present communication load of the stream of data has transitioned a threshold, and change the size of a segment of the segments based on the indication and the future communication load of the stream of data.