Adaptive Dispatcher for Dynamic Data Collection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data collection solutions in information handling systems are inefficient and ineffective in dynamic storage environments, particularly due to reliance on fixed paths to and retrieval from preferred servers, which can lead to performance limitations and unnecessary delays.
Innovation Solution
A data collection system that leverages real-time and historical data collection performance statistics and server performance data to adapt and optimize data collection processes, using an adaptive dispatcher that configures initial settings based on past performance characteristics and server status, and adjusts dynamically to environmental changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If fixed paths to preferred servers are used for data collection, then system simplicity is maintained, but data collection efficiency deteriorates in dynamic environments
Solution Approach 1:
The patent implements dynamic server selection by continuously monitoring server performance metrics (response time, throughput, load) and adapting data collection paths in real-time based on current system conditions, rather than using static fixed paths
Solution Approach 2:
The system incorporates feedback mechanisms where data collection performance statistics are collected and analyzed to inform future server selection decisions, creating a closed-loop control system that optimizes data collection efficiency
2Reliability
If data collection continues without adaptation, then operational simplicity is maintained, but server performance deteriorates due to overloads
Solution Approach 1:
The system performs preliminary monitoring of server performance metrics and predicts potential overloads before they occur, allowing proactive adjustment of data collection rates to prevent server stress
Solution Approach 2:
Real-time feedback on server performance metrics enables the system to detect degradation patterns and adjust data collection parameters dynamically to maintain reliable server operation
3Loss of time
If static server preferences are used, then configuration simplicity is maintained, but data collection time increases due to environmental changes
Solution Approach 1:
The patent makes the data collection system dynamic by continuously adapting server selection based on real-time environmental conditions and performance metrics, reducing delays caused by static configurations
Solution Approach 2:
The system changes operational parameters (server selection, data collection rate, batch size) based on monitored performance statistics and environmental conditions to optimize data collection time
Data Source
AI summary
This disclosure describes systems, methods, and computer-readable media for optimizing data collection in a distributed environment by leveraging real-time and historical data collection performance statistics and server performance data. In some configurations, a computing device can be initially configured for data collection. In such configurations, the initial configuration can include preferred target servers for a particular task. The computing device can request batches of data from the preferred target servers, and process the information through a buffer. Techniques and technologies described herein collect the batches of data from servers as well as corresponding data collection statistics (e.g., server performance per task, server historical performance, etc.) and server performance data (e.g. server status).