Cross-Security-Region Virtual Block Device RPC for Low-Latency I/O
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing cloud computing systems face challenges in achieving low latency for input/output (IO) operations across security regions due to centralized forwarding mechanisms, which are inadequate for latency-sensitive applications with massive and concurrent IOs.
Innovation Solution
Implement a cross-security-region resource access method using a virtio protocol-based BLK service to simulate an RPC mechanism, allowing virtual block devices to encapsulate IO requests into RPC calls, thereby initiating distributed access through an RPC channel, reducing IO latency and avoiding performance bottlenecks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a centralized IO forwarding mechanism is used for cross-security-region resource access, then bandwidth requirements for applications are met, but IO latency increases and cannot meet requirements for latency-sensitive applications with massive concurrent IOs
Solution Approach 1:
The patent segments the centralized IO forwarding mechanism into distributed IO forwarding across multiple computing nodes. Each computing node independently handles IO requests for its local virtual machines, eliminating the single-point bottleneck and reducing latency while maintaining bandwidth capacity through parallel processing across the cluster.
Solution Approach 2:
The patent introduces a new dimensional approach by implementing IO forwarding at the edge (local computing nodes) rather than through a central hub. This dimensional shift from centralized to distributed architecture allows simultaneous IO operations to proceed in parallel, reducing latency without compromising bandwidth utilization.
2Reliability
If network virtualization technology is used to implement cross-security-region resource access, then security isolation between regions is maintained, but IO forwarding paths become lengthy and latency increases
Solution Approach 1:
The patent extracts the IO forwarding function from the centralized network virtualization layer and places it directly at the computing node level. This extraction eliminates unnecessary intermediate forwarding hops while maintaining security isolation through preserved virtual machine and security region boundaries, thereby reducing latency without compromising security.
Solution Approach 2:
The patent introduces a distributed IO forwarding mechanism as an intermediary layer between virtual machines and storage resources. This intermediary operates locally at each computing node, maintaining security region boundaries while providing direct, low-latency access paths that bypass lengthy centralized forwarding routes.
3Ease of operation
If all IOs are forwarded through a centralized mechanism, then resource access control is simplified, but performance bottlenecks occur in scenarios with massive concurrent IOs
Solution Approach 1:
The patent segments the IO forwarding responsibility from a single centralized point to multiple distributed computing nodes. Each node independently manages its local IO requests, enabling parallel processing of massive concurrent IOs while maintaining simplified access control through consistent security region and virtual machine boundary enforcement at each node.
Solution Approach 2:
The patent enables each computing node to self-serve its local virtual machines by handling IO requests independently without requiring centralized coordination. This self-service approach dramatically increases concurrent IO handling capacity while maintaining access control through local enforcement of security policies and virtual machine boundaries.
Data Source
AI summary
In a cross-security-region resource access method in a cloud computing system, a virtual block device, which is simulated by a virtio protocol-based BLK front-end driver in the cloud computing system and taken as an RPC calling client, receives an IO access request for data resources maintained by a resource service program triggered by a business application installed on each virtual node through a simulated RPC channel on the virtual block device; in response to the IO access request, encapsulates the IO access request into an RPC request for performing an RPC calling for target data resources, sends the RPC request to a RPC calling server program simulated by a virtio protocol-based BLK service through the RPC channel, so that the RPC calling server program submits the RPC request to a resource access agent program, which submits the RPC request to the resource service program to complete cross-security region resource access.


