Automated Asset Placement in Stream Computing Clusters
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In distributed computing environments, particularly in stream computing, managing asset placement efficiently becomes challenging as the volume of stream computing data increases, leading to a need for automated solutions that can dynamically adjust to application prerequisites and resource availability.
Innovation Solution
An automated dynamic tagging solution that allows for the placement and relocation of processing elements based on application-defined prerequisites, using self-declaring host tags within a dynamic cluster or cloud environment, enabling monitoring and proactive relocation to ensure resource compatibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual asset placement management is used, then placement control is simple, but management efficiency deteriorates as data volume increases
Solution Approach 1:
The system enables self-service through automated placement decisions where the placement manager automatically selects hosts based on host tags and asset requirements without manual intervention. The automated placement manager monitors host conditions, evaluates eligibility based on tags, and executes placement decisions autonomously, allowing the system to manage itself as data volumes increase.
Solution Approach 2:
The system changes parameters by dynamically assigning and updating host tags that describe host capabilities and conditions. These tags serve as changeable parameters that the placement manager reads and evaluates to make placement decisions, allowing the system to adapt to changing host states without manual reconfiguration.
2Adaptability or versatility
If static host tagging is used, then implementation is simple, but adaptability to changing resource conditions deteriorates
Solution Approach 1:
The system implements dynamics by enabling host tags to change over time based on monitored host conditions. Tags are not fixed but are updated dynamically as host resources change state, allowing the placement manager to respond to real-time conditions. This dynamic tagging mechanism enables the system to adapt to varying resource availability and host capabilities.
Solution Approach 2:
The system uses feedback through continuous monitoring of host conditions that triggers tag updates. The placement manager receives feedback about host state changes and adjusts tags accordingly, creating a closed-loop system that adapts to changing conditions. This feedback mechanism ensures the tagging system remains accurate and useful despite dynamic host states.
3Reliability
If automated placement based on host tags is implemented, then placement accuracy improves, but system complexity increases
Solution Approach 1:
The system applies segmentation by dividing the complex placement decision process into discrete components: host tagging, asset requirement definition, and placement manager execution. Each component handles a specific aspect independently, making the overall complex system manageable through modular functional separation.
Data Source
AI summary
A method, computer system, and a computer program product for managing asset placement with respect to a distributed computing environment having a set of hosts is provided. The present invention may include detecting a set of host computing resource requirement data for an asset, wherein the distributed computing environment includes a stream computing environment and the asset includes a rookie asset in the stream computing environment. The present invention may include identifying a set of computing resource profile data for a set of hosts in the distributed computing environment. The present invention may include determining, by comparing the set of host computing resource requirement data for the asset and the set of computing resource profile data for the set of hosts, an asset placement arrangement. The present invention may include establishing, based on the asset placement arrangement, the asset in the distributed computing environment.