Hierarchical Orchestrator Dynamic Service Allocation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing cloud data centers face challenges in ensuring low latency, high reliability, and compatibility with services under unideal conditions, particularly when managing high workloads and traffic, which affects performance and reliability.

Innovation Solution

A hierarchical architecture for computing devices that dynamically allocates service components across multiple levels, including cloud servers, telecommunication servers, and edge devices, using orchestrators to track resources and apply rules for optimal allocation and real-time updates based on detected events.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If service components are concentrated on a single data center server, then service functionality is simplified to manage, but latency increases and reliability decreases under high workload conditions

Engineering Contradiction:

Improveservice management simplicityVSAvoidservice performance reliability

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The patent segments service components into multiple independent virtual machine instances distributed across different physical servers within a data center. This segmentation allows the service to be divided into manageable parts that can be independently deployed, monitored, and relocated, thereby maintaining management simplicity while improving reliability through distribution.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent implements local quality by allocating service components to specific servers based on local resource availability, workload conditions, and performance requirements. Each server hosts service components with qualities tailored to its capabilities, optimizing overall service reliability while maintaining manageable complexity through localized decision-making.

Inventive Principle:

Principle #3Local quality

2Reliability

If service components are distributed across multiple servers, then reliability and latency are improved, but system complexity increases making management difficult

Engineering Contradiction:

Improveservice performance reliabilityVSAvoidcomputing device management complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent employs a universal service management system that can handle multiple service types, deployment scenarios, and server configurations through a single standardized interface. This multi-functional approach allows the system to manage distributed service components across diverse servers without increasing operational complexity, as the same management mechanisms apply universally regardless of specific configuration.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary service management layer that sits between the distributed service components and the administrators. This intermediary handles the complexity of monitoring, coordinating, and managing service components across multiple servers, presenting a simplified view to users while managing the underlying distributed complexity through automated processes and standardized protocols.

Inventive Principle:

Principle #24Intermediary (Mediator)

3Ease of manufacture

If service components are statically allocated to servers, then deployment is simple, but adaptability to changing workload conditions and events deteriorates

Engineering Contradiction:

Improveservice deployment simplicityVSAvoidservice allocation adaptability

Core Design Contradiction:

Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic service component allocation where service components can be automatically relocated, scaled, and reconfigured based on real-time workload conditions, server performance, and detected events. This dynamic approach maintains deployment simplicity through automated processes while providing high adaptability to changing conditions, eliminating the need for manual reconfiguration.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The patent incorporates feedback mechanisms that continuously monitor service performance, server workload, and system events. This feedback information is used to automatically adjust service component allocation and configuration, enabling the system to adapt to changing conditions while maintaining simple deployment processes through closed-loop control that requires no manual intervention.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS10693704B2Dynamic allocation of service components of information service in hierarchical telecommunication architecture

Publication Date: 2020.06.23 B YOND INC

AI summary

Embodiments relate to allocating resources of computing devices for providing information service in a network. The computing devices may be hierarchically structured and may include, for instance, cloud servers, telecommunication servers, edge edges, gateways, and client devices. A system environment may include a hierarchical orchestrator coordinating with one or more local orchestrators to allocate service components (for example, a discrete functional software or hardware component) to computing devices. The orchestrators can automatically reallocate resources responsive to detecting update events such as a change in traffic or payload on the network.