Proxy Server On-Demand Startup Offline Servers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The inefficiency of running servers when they are not in use leads to wasted resources and potential errors for client computing devices attempting to access offline servers, especially in scenarios where predictive models fail to account for unexpected data requests or network security complexities.

Innovation Solution

A system where a proxy server maintains a connection with a client computing device and initiates the startup of an offline server, allowing direct communication once the server is online, thereby eliminating the need for constant server uptime and simplifying access for users.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If servers are constantly running to handle unexpected data requests, then client computing devices can access servers without errors, but server resource usage is wasted and costs increase

Engineering Contradiction:
Improveserver accessibilityVSAvoidserver resource waste
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The system performs preliminary actions by maintaining a connection pool and pre-warming servers before actual data requests arrive. Connection pool entries are created and kept ready in advance, and servers are spun up and kept warm with minimal traffic before needing to handle full workloads, eliminating the need for constant server operation while ensuring immediate responsiveness.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system dynamically adjusts server states based on actual demand rather than maintaining static constant operation. Servers transition between offline, warming, and active states as needed, and connection pool entries are dynamically created and invalidated based on connection success or failure, optimizing resource usage while maintaining reliability.

Inventive Principle:
Principle #15Dynamics

2Productivity

If servers are spun up based on predictive models, then future overload can be handled, but companies pay for unused server capacity when predictions are inaccurate

Engineering Contradiction:
Improveserver capacity utilizationVSAvoidunused server capacity cost
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The system applies partial action by spinning up only the minimum necessary server capacity needed to handle current and immediate future requests, rather than provisioning for maximum potential load. The connection pool mechanism allows the system to handle requests with a limited pool of connections, spinning up additional servers only when the pool is exhausted, avoiding excessive server provisioning.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system uses feedback from actual connection attempts and server response times to dynamically adjust server provisioning. When connections succeed and servers respond quickly, the system maintains current capacity. When connection pool entries are exhausted or response times increase, the system spins up additional servers, creating a feedback-driven adaptive capacity management system.

Inventive Principle:
Principle #23Feedback

3Adaptability or versatility

If manual or automatic server activation processes are used, then servers can be spun up when needed, but the process is cumbersome and requires multiple steps

Engineering Contradiction:
Improveserver activation flexibilityVSAvoiduser operation complexity
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The system implements self-service by automatically managing the entire server activation process without user intervention. When connection pool entries are exhausted or connection failures occur, the system automatically detects the need for additional capacity, spins up new servers, and integrates them into the connection pool, eliminating cumbersome manual activation steps while maintaining flexibility.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The connection pool acts as an intermediary layer between client computing devices and servers, abstracting away the complexity of server management. The pool manages connection states, handles server spin-up coordination, and provides a simplified interface for request routing, reducing operational complexity while maintaining adaptability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10462265B2On-demand startup of offline servers and connection routing
Publication Date: 2019.10.29 PLEX INC
  • US10462265B2 patent drawing
  • US10462265B2 patent drawing
  • US10462265B2 patent drawing

AI summary

A method and apparatus for providing remote access to an unavailable server is provided. In an embodiment, a proxy server computer receives a request to access data over a network from a client computing device. The proxy server computer identifies a particular server computer that is separate from the client computing device to fulfill the request. The proxy server computer then determines that the particular server computer is unavailable to a client computing device. In response to determining the particular server is unavailable to the client computing device, the proxy server computer maintains a transport layer connection from the client computing device. While maintaining the transport layer connection, the proxy server computer initiates startup of the particular server computer. In response to receiving an indication that the particular server computer is available to the client computing device, the proxy server computer passes the connection from the client computing device to the particular server computer.