Microservice Orchestration with Process-Isolated Service Groups

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The high communication overhead in microservice architectures due to frequent interactions between independently deployed microservices is a significant challenge.

Innovation Solution

The creation of service isolation groups, where microservices within the same group are deployed in the same process and different groups are deployed in different processes, with a service runtime module managing intra-process and network communication based on belonging relationships.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If microservices are deployed independently, then deployment flexibility is improved, but communication overhead increases

Engineering Contradiction:

Improvedeployment flexibilityVSAvoidcommunication overhead

Core Design Contradiction:

Adaptability or versatilityVSLoss of energy

Solution Approach 1:

The system segments microservices into service isolation groups, where each group is deployed in an isolated process environment. This segmentation allows independent deployment of each group while enabling efficient intra-group communication through shared memory mechanisms, thus resolving the contradiction between deployment flexibility and communication overhead.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent introduces a service runtime module as an intermediary that manages service isolation groups and handles communication routing. This intermediary coordinates between independently deployed microservices, enabling efficient communication pathways while maintaining deployment independence, thus reducing communication overhead without sacrificing flexibility.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If microservices communicate through network, then deployment independence is maintained, but communication cost increases

Engineering Contradiction:

Improvedeployment independenceVSAvoidcommunication cost

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

By segmenting microservices into isolation groups that can be deployed independently on the same physical machine, the system enables low-cost communication within groups while maintaining deployment independence. Network communication is reserved for inter-group communication, reducing overall communication costs.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent applies different communication quality levels to different scenarios: intra-group microservices use efficient local communication mechanisms (shared memory, inter-process communication), while inter-group microservices use network communication. This local quality differentiation reduces communication costs for the majority of interactions.

Inventive Principle:

Principle #3Local quality

3Productivity

If microservices are deployed in same process, then communication efficiency is improved, but fault isolation deteriorates

Engineering Contradiction:

Improvecommunication efficiencyVSAvoidfault isolation

Core Design Contradiction:

ProductivityVSReliability

Solution Approach 1:

The system segments microservices into separate service isolation groups, each running in an isolated process. This segmentation provides fault isolation between groups while maintaining high communication efficiency within groups through shared memory and inter-process communication mechanisms.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The patent uses process isolation as a flexible boundary that provides fault containment between service groups while allowing efficient communication within each group. This thin film of isolation (process boundary) protects against faults spreading across the entire system while maintaining performance.

Inventive Principle:

Principle #30Flexible shells and thin films

Data Source

PatentUS20250335225A1Microservice orchestration and calling method, and apparatus, device, microservice system and medium

Publication Date: 2025.10.30 BEIJING VOLCANO ENGINE TECH CO LTD

AI summary

The present disclosure provides a microservice orchestration and calling method and apparatus, a device, a microservice system and a medium. The microservice orchestration method implements microservice orchestration by creating a plurality of service isolation groups and establishing a belonging relationship between each microservice to be orchestrated and the service isolation groups. In addition, the belonging relationship indicates that microservices in the same service isolation group are deployed in a same process when being deployed on a physical machine cluster, and microservices belonging to different service isolation groups are deployed in different processes when being deployed on the physical machine cluster, so that during the running process of the microservice system obtained based on the microservice orchestration method, faults can be isolated between the microservices in the different service isolation groups, and the communication cost of microservice calling can be reduced.