Virtual Network Card for Serverless Cold Start Optimization

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The slow attaching speed of elastic network interfaces in serverless platforms prolongs the cold start time of computing services, affecting resource utilization and efficiency when accessing virtual private clouds.

Innovation Solution

A data processing method that creates a virtual network card to enable communication between a function instance and a gateway node, allowing for faster data interactions and decapsulation of packets to forward them to a virtual private cloud, thereby improving cold start speed and resource utilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If an elastic network interface is attached to a machine executing a computing service to enable communication with a virtual private cloud, then the computing service can access user resources, but the cold start time is prolonged due to slow attaching speed

Engineering Contradiction:

Improvecommunication capabilityVSAvoidcold start time

Core Design Contradiction:

ReliabilityVSLoss of time

Solution Approach 1:

The patent creates the virtual network card and establishes communication paths with gateway nodes in advance, before the computing service actually needs to access the virtual private cloud. This preliminary setup eliminates the need for slow elastic network interface attachment at cold start, as the communication infrastructure is already in place and ready for immediate use.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent separates the network communication function into a distinct virtual network card component that can be independently created and configured. This segmentation allows the computing service to start without waiting for the traditional elastic network interface attachment process, as the virtual network card provides immediate network connectivity through pre-established gateway connections.

Inventive Principle:

Principle #1Segmentation

2Reliability

If traditional elastic network interface attachment is used to connect computing service to virtual private cloud, then network communication is established, but resource utilization is reduced due to slower cold start speed

Engineering Contradiction:

Improvenetwork connectivityVSAvoidresource utilization

Core Design Contradiction:

ReliabilityVSProductivity

Solution Approach 1:

The virtual network card and its communication paths to gateway nodes are created in advance, before the computing service needs to access the virtual private cloud. This preliminary setup eliminates the need for slow elastic network interface attachment at cold start, as the communication infrastructure is already in place and ready for immediate use.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent creates a virtual network card as a software-based copy or abstraction of a physical network interface. This virtual card can be instantiated rapidly without the hardware-level attachment delays of traditional elastic network interfaces, enabling faster cold start while maintaining full network connectivity capabilities to the virtual private cloud.

Inventive Principle:

Principle #26Copying

3Reliability

If elastic network interface attachment is used for computing service to access virtual private cloud, then communication is enabled, but the attaching speed is slow affecting overall system efficiency

Engineering Contradiction:

Improvecommunication capabilityVSAvoidattaching speed

Core Design Contradiction:

ReliabilityVSSpeed

Solution Approach 1:

The virtual network card and its communication paths to gateway nodes are created in advance, before the computing service actually needs to access the virtual private cloud. This preliminary setup eliminates the need for slow elastic network interface attachment at cold start, as the communication infrastructure is already in place and ready for immediate use.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent replaces the traditional mechanical/hardware-based elastic network interface attachment process with a software-based virtual network card system. This substitution eliminates the slow attachment mechanism in favor of rapid virtualization-based network card creation, dramatically improving attachment speed while maintaining communication reliability through pre-established gateway connections.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20240031309A1Data Processing Method, Apparatus, Device and Storage Medium

Publication Date: 2024.01.25 CLOUD INTELLIGENCE ASSETS HOLDING (SINGAPORE) PTE LTD

AI summary

Data processing method, apparatus, device, and storage medium are provided, so as to improve the efficiency of data processing. The method includes: receiving a function call request; creating a function instance and a virtual network card thereof according to the function call request, to enable the virtual network card to establish communication with at least one gateway node, wherein a gateway service instance of the gateway node is attached with a virtual network card; and sending a data packet corresponding to the function instance after being encapsulated to the gateway node through the virtual network card of the function instance, to enable the gateway node to forward thereof to a virtual private cloud. Based on the virtual network card, data interactions between two instances can be realized, so as to realize the separation of function computing and gateway, and ensure the speed of cold start of function computing.