Dynamic Program Execution Capacity Management

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Managing program execution capacity in large-scale computing environments is complex due to the need for dynamic adjustments in response to varying user demands and system performance, with existing solutions lacking efficient mechanisms for real-time modifications and attribution of responsibility for capacity changes.

Innovation Solution

A system that dynamically modifies the quantity of computing nodes based on user-defined triggers and automated determinations, aggregating modifications to optimize resource allocation and attribute causality for capacity changes, allowing for proactive and reactive adjustments to maintain desired performance levels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If computing resources are shared among multiple users using virtualization technologies, then resource utilization efficiency is improved, but system complexity and management difficulty increase

Engineering Contradiction:
Improveresource utilization efficiencyVSAvoidsystem management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system implements self-service through automated resource provisioning and management. The virtualization platform automatically allocates computing resources to users based on predefined policies and triggers, eliminating the need for manual intervention in resource management tasks while maintaining efficient resource utilization across multiple users

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system incorporates feedback mechanisms that continuously monitor resource usage patterns, system performance, and user demands. This feedback drives automated decision-making for resource allocation, scaling, and optimization, allowing the system to adapt dynamically while reducing management complexity through intelligent automation

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If program execution capacity is dynamically modified in response to user demands, then system adaptability is improved, but temporary unavailability and system instability increase

Engineering Contradiction:
Improvesystem adaptabilityVSAvoidsystem stability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system performs preliminary actions by pre-configuring resource pools and establishing predefined adjustment triggers before dynamic modifications are needed. Resource provisioning templates, scaling policies, and trigger conditions are set in advance, enabling rapid response to changing demands while maintaining system stability through pre-planned modification strategies

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements dynamic resource capacity modification through adjustable computing node groups that can be scaled up or down based on monitored performance metrics and user demands. The dynamics are controlled through configurable parameters that allow flexible adjustment while maintaining system reliability through gradual, managed changes rather than abrupt modifications

Inventive Principle:
Principle #15Dynamics

3Productivity

If automated determinations are used to modify computing node quantities, then operational efficiency is improved, but loss of control and attribution difficulty increase

Engineering Contradiction:
Improveoperational efficiencyVSAvoidattribution information
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The automated determination system incorporates comprehensive feedback loops that track and record all capacity modifications. Each automated decision is logged with attribution information identifying the triggering condition, the modification made, and the rationale. This feedback mechanism maintains operational efficiency through automation while preventing information loss by systematically capturing causality data for audit and analysis purposes

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11762693B1Dynamically modifying program execution capacity
Publication Date: 2023.09.19 AMAZON TECH INC
  • US11762693B1 patent drawing
  • US11762693B1 patent drawing
  • US11762693B1 patent drawing

AI summary

Techniques are described for managing program execution capacity, such as for a group of computing nodes that are provided for executing one or more programs for a user. In some situations, dynamic program execution capacity modifications for a computing node group that is in use may be performed periodically or otherwise in a recurrent manner, such as to aggregate multiple modifications that are requested or otherwise determined to be made during a period of time, and with the aggregation of multiple determined modifications being able to be performed in various manners. Modifications may be requested or otherwise determined in various manners, including based on dynamic instructions specified by the user, and on satisfaction of triggers that are previously defined by the user. In some situations, the techniques are used in conjunction with a fee-based program execution service that executes multiple programs on behalf of multiple users of the service.