Instance Group Termination via Maximum Lifetime

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional computing platforms face inefficiencies in resource utilization and are not effectively scalable to accommodate increasing numbers of customers, leading to complex management of instances and resources.

Innovation Solution

The system and method for terminating instances and autoscaling instance groups involve determining eligibility for termination based on predetermined criteria, such as maximum lifetime, and dynamically adjusting the number of instances in response to resource demands and utilization thresholds.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If instances are continuously running to maintain service availability, then reliability is improved, but resource utilization efficiency deteriorates due to idle instances

Engineering Contradiction:

Improveservice availabilityVSAvoidresource utilization efficiency

Core Design Contradiction:

ReliabilityVSLoss of energy

Solution Approach 1:

The system dynamically adjusts instance runtime by implementing a maximum lifetime parameter. Instances are automatically terminated after reaching this lifetime threshold, transforming the static continuous-running model into a dynamic lifecycle management model that balances availability with resource efficiency.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system discards instances that have reached their maximum lifetime by detaching them from instance groups and terminating them. This allows the computing platform to recover resources from aged instances and reallocate them to new instances, maintaining service continuity while improving overall resource utilization.

Inventive Principle:

Principle #34Discarding and recovering

2Productivity

If the number of instances is increased to accommodate more customers, then productivity is improved, but device complexity worsens due to instance management overhead

Engineering Contradiction:

Improvecustomer capacityVSAvoidinstance management complexity

Core Design Contradiction:

ProductivityVSDevice complexity

Solution Approach 1:

The system implements self-service through automated instance management. The instance group controller automatically determines when to terminate instances based on maximum lifetime criteria, and the system autonomously replaces terminated instances with new ones, eliminating the need for manual instance management and reducing operational complexity.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system uses feedback mechanisms to monitor instance runtime and automatically trigger termination when instances reach their maximum lifetime. This closed-loop control ensures that instance populations are continuously optimized without manual intervention, scaling management complexity automatically with instance count.

Inventive Principle:

Principle #23Feedback

3Loss of energy

If instances are terminated to improve resource efficiency, then loss of energy is reduced, but reliability deteriorates due to potential service disruption

Engineering Contradiction:

Improveresource utilization efficiencyVSAvoidservice continuity

Core Design Contradiction:

Loss of energyVSReliability

Solution Approach 1:

The system performs preliminary actions by pre-configuring maximum lifetime parameters for instances before they are terminated. This allows the system to plan instance termination in advance and automatically provision replacement instances, ensuring that service continuity is maintained while achieving resource efficiency goals.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system provides beforehand cushioning by maintaining instance groups with configured sizes that ensure service availability. When instances are terminated due to maximum lifetime, the instance group structure and automated replacement mechanisms provide a cushion that prevents service disruption, allowing aggressive resource optimization without compromising reliability.

Inventive Principle:

Principle #11Beforehand cushioning (Prior cushioning)

Data Source

PatentUS20250199864A1Systems and methods for terminating instances and autoscaling instance groups of computing platforms

Publication Date: 2025.06.19 PALANTIR TECHNOLOGIES INC

AI summary

System and method for terminating instances and autoscaling instance groups of computing platforms. For example, a method includes determining whether an instance of an instance group is identified as eligible for termination. The method further includes, in response to determining that the instance of the instance group is identified as eligible for termination, terminating the eligible instance. The terminating the eligible instance includes, in response to a runtime of the eligible instance being equal to or larger than a predetermined maximum lifetime, terminating the eligible instance. The terminating the eligible instance further includes, in response to the runtime being smaller than the predetermined maximum lifetime, detaching the eligible instance from the instance group to allow a new instance to be associated with the instance group, and in response to the eligible instance being detached from the instance group: waiting for the new instance to be associated with the instance group, and evicting each pod associated with the detached instance. The method is performed using one or more processors.