Virtual Disk Message Passing for Large Container Data Transfers

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing communication mechanisms between containerized microservices in virtualized computing systems consume excessive network and memory resources, particularly when transferring large amounts of data, often depleting these resources or requiring more than what is available.

Innovation Solution

A method involving microservices in containers sending a request to create a communication channel to a broker daemon in the hypervisor, which assigns a virtual disk for message exchange, allowing data transfer without relying on the network stack, thus conserving resources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If large amounts of data are transferred between microservices using REST API and HTTPS connections, then communication between microservices is achieved, but network and memory resources are quickly depleted

Engineering Contradiction:

Improvedata transfer volumeVSAvoidnetwork and memory resource consumption

Core Design Contradiction:

Quantity of substanceVSUse of energy by moving object

Solution Approach 1:

The patent introduces a broker daemon as an intermediary component that manages communication between microservices. Instead of direct peer-to-peer communication that consumes network resources, the broker mediates message passing by writing messages to a shared virtual disk and notifying receiving microservices, thereby eliminating the need for continuous network stack usage and reducing network and memory resource consumption during large data transfers

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the network-based communication mechanism (REST API, HTTPS connections) with a file-based communication mechanism using virtual disks. Messages are written as files to a shared virtual disk accessible by multiple microservices, substituting the network stack with a storage-based approach that does not consume network resources and uses minimal memory for message buffering

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Adaptability or versatility

If network stack is used for communication between microservices, then standard communication protocols are supported, but memory resources are consumed

Engineering Contradiction:

Improvecommunication protocol supportVSAvoidmemory resource usage

Core Design Contradiction:

Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent substitutes the network stack mechanism with a file system-based mechanism. Instead of using network protocols that require buffer memory for packet handling, the system writes messages directly to virtual disk files, eliminating the need for network stack memory allocation and reducing overall memory consumption while maintaining communication functionality

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS12373233B2Large message passing between containers in a virtualized computing system

Publication Date: 2025.07.29 VMWARE INC

AI summary

Large message passing between containers in a virtualized computing system is described. A method of communication between microservices executing in containers, which execute in at least one virtual machines (VM) of a host having a hypervisor supporting the at least one VM, includes: sending, by each of a first microservice in a first container and a second microservice in a second container, a request to create a communication channel to a broker daemon executing in the hypervisor; receiving, at each of the first and second microservices, an identifier of a virtual disk attached to the at least one VM by the broker daemon; writing, by the first microservice, a message to the virtual disk; and reading, by the second microservice, the message from the virtual disk.