Cloud Deployment Optimization via Daisy Chain Image Distribution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cloud-based computing faces challenges in rapidly and reliably deploying applications and provisioning resources to meet increased demand, resulting in delayed response times and unreliable operational efficiency.

Innovation Solution

A cloud deployment system that uses a daisy chain copying technique to distribute optimized base images and application images across additional servers, generating memory snapshots, and performing optimizations such as garbage collection and memory compression to ensure efficient deployment and minimize downtime.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If traditional deployment methods are used, then deployment process is simple, but deployment time is long and response to demand increase is delayed

Engineering Contradiction:
Improvedeployment speedVSAvoiddeployment time
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The system performs preliminary actions by creating optimized base images and application images in advance, preparing deployment packages before they are needed. This allows the deployment process to start immediately when demand increases, rather than creating and optimizing images during the deployment process itself.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The deployment process is segmented into distinct phases: base image creation, application image creation, optimization, and distribution. Each phase can be executed independently and in parallel, significantly reducing total deployment time compared to sequential traditional methods.

Inventive Principle:
Principle #1Segmentation

2Speed

If resources are quickly provisioned to meet demand, then response time improves, but operational efficiency and reliability may be compromised

Engineering Contradiction:
Improveprovisioning speedVSAvoidoperational efficiency
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

Optimization operations such as garbage collection and memory compression are performed in advance on the base images before distribution. This ensures that newly provisioned resources start in an optimized state, guaranteeing operational efficiency from the moment they begin serving requests, not after some settling period.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates optimized copies of base images and application images that can be rapidly distributed and deployed. These pre-optimized copies ensure consistent, reliable performance across all new instances while enabling fast provisioning through efficient copying rather than building from scratch.

Inventive Principle:
Principle #26Copying

3Productivity

If application instances are increased to meet demand, then service capacity increases, but deployment complexity and resource distribution challenges increase

Engineering Contradiction:
Improveservice capacityVSAvoiddeployment complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system merges base image and application image creation into a unified deployment package. This consolidation simplifies the deployment process by reducing the number of separate operations and dependencies, making it easier to scale from a few to thousands of instances without proportionally increasing complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The base image serves as an intermediary that contains all necessary optimizations and configurations. This intermediary layer simplifies distribution by allowing standardized, pre-configured images to be copied and deployed across multiple machines without repeating complex setup procedures for each instance.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11503118B2System and method for cloud deployment optimization
Publication Date: 2022.11.15 EBAY INC
  • US11503118B2 patent drawing
  • US11503118B2 patent drawing
  • US11503118B2 patent drawing

AI summary

Systems and methods of cloud deployment optimization are disclosed. In some example embodiments, a method comprises running original instances of an application concurrently on original servers to implement an online service, receiving, by the original instances of the application original requests for one or more functions of the online service, receiving a command to deploy a number of additional instances of the application, transmitting synthetic requests for the function(s) of the online service to one of the original servers according to a predetermined optimization criteria, deploying the number of additional instances of the application on additional servers using a copy of the original instance of the application, and running the deployed additional instances of the application on their corresponding additional servers concurrently with the original instances of the application being run on their corresponding original servers.