Method for eliminating cold start of server-free computing container

A serverless, cold-start technology, applied in computing, energy-saving computing, instruments, etc., can solve problems such as reducing the user experience of FaaS, increasing the delay of function calls, and exacerbating the cold-start problem, reducing physical resource overhead, eliminating overhead, Avoid the effect of repeated execution

Pending Publication Date: 2022-05-24
JINAN UNIVERSITY
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Compared with the short execution time of the function, the above-mentioned cold start phase may take a lot of time, thereby increasing the delay when the function is called, and reducing the experience of FaaS users
In addition, when multiple functions form a function chain to deploy applications, the cold start problem will be exacerbated, because the function chain may cause cascading cold starts
Therefore, the cold start of functions is a problem that FaaS providers need to overcome, and reducing the impact of cold start problems is a key challenge for FaaS platforms

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for eliminating cold start of server-free computing container
  • Method for eliminating cold start of server-free computing container
  • Method for eliminating cold start of server-free computing container

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0044] as Figure 1 Shown, is an application architecture diagram that eliminates the method of serverless computing container cold start, and the application is optimized for the container cold start and high latency caused by the function execution process when the function is called, under the serverless computing architecture. For computational functions, the cold start of the function is bypassed by caching the calculation results; for I / O related functions, the end-to-end latency of function execution is reduced by caching external requests to the local file system. The present invention compares and tests this optimization strategy, evaluating the effect of the present invention on the cold start optimization of the serverless platform from multiple angles.

[0045] In order to more clearly illustrate the application scenario of the present invention, the following combined with the application architecture diagram is analyzed in detail, mainly divided into three steps:

[0...

Embodiment 2

[0051]The present embodiment from the single-step function and multi-step function two functions load pair of the proposed technology to do the function end-to-end latency and resource usage of the two aspects of the test, wherein the single-step function refers to an application that contains only one function, as shown in the table; and the multi-step function refers to an application containing multiple functions, as shown in Table 2. The present invention uses a function dataset disclosed by the academic community for effect evaluation. The present invention relates to a parameter T during operation, that is, the function is judged to be a computational function or an environment-related function by the data after the execution of the function continuous T, and the T parameter is set to 3 in the experimental evaluation.

[0052] Table 1 Single-step function categories and descriptions

[0053]

[0054] Table 2.Description of multi-step functions

[0055] function d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for eliminating cold start of a server-free computing container, and aims to eliminate cold start of the container by bypassing repeated computation in a process of calling a function by a server-free platform; and (2) external files are prevented from being requested by functions, and calling delay during function execution is reduced. According to the method, a real-time monitoring mechanism based on container runtime is designed, functions are divided into three types according to monitoring information, namely a calculation type function, an I / O type function and an environment related function, and for the calculation type function, execution of the functions is bypassed by caching and directly returning a calculation result; and for the I / O type function, external files required by the function are maintained in the local file system, so that the delay overhead caused by accessing an external network by the function is reduced. The method eliminates container cold start and reduces end-to-end delay of function call. In addition, due to the fact that function execution and container starting can be bypassed, the calculation result of the calculation type function can be directly returned, and physical resources needed for processing the function request are further reduced.

Description

Technical field [0001] The present invention relates to the technical field of serverless computing architecture, specifically to a method of eliminating a serverless computing container cold start. Background [0002] Serverless Computing architectures are the preferred way to deploy large-scale distributed applications in data centers. Serverless computing mainly uses the Function-as-a-Service (FaaS) model to provide developers with a convenient way to deploy and improve the scalability of applications. However, there are many problems that need to be improved on the FaaS platform side, especially the cold-start optimization of functions. [0003] When the FaaS platform first receives a call request for a function, it needs to prepare the corresponding container runtime environment for the function request. Typically, building a container runtime environment involves (1) creating and starting a base runtime environment, and (2) pulling the function code and installing the corre...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/455
CPCG06F9/45558G06F2009/45575G06F2009/45579Y02D10/00
Inventor 邓玉辉吴朝锐
Owner JINAN UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap