Unlock instant, AI-driven research and patent intelligence for your innovation.

Invoker pooling method and system in serverless computing system

A computing system and serverless technology, applied in memory systems, computing, instruments, etc., can solve problems such as waste of resources and long processing delays

Active Publication Date: 2022-03-29
SHANGHAI JIAOTONG UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the problems of resource waste and long processing delay caused by cold start and idle occupancy in the existing computing system without service period, the present invention proposes a method and system for invoking pooling in the serverless computing system, which can Realize the pool management of callers through the redirection table, break through the upper limit of the capacity of a single caller, and also realize the aggregation processing of the same type of application, and realize the dynamic flexibility of the caller pool capacity through caller replication, shutdown and load migration Tweaked to reduce performance penalty from cold start and idle wait

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Invoker pooling method and system in serverless computing system
  • Invoker pooling method and system in serverless computing system
  • Invoker pooling method and system in serverless computing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] Such as figure 1 Shown is the pooling module involved in this embodiment and the serverless computing system connected thereto. The serverless computing system includes a controller and an invoker including several containers.

[0035] When the load reaches the controller of the serverless computing system, the controller selects a healthy caller according to the load type, that is, the caller that has not lost response due to network failure and other reasons, and the controller is selected through the redirection table in the pooling module Redirect to point to a new caller N. The controller puts the specific execution information of the load into the message queue of the caller N as an execution queue waiting for the caller N to process. When the container it belongs to is idle, The load at the top of the queue will be selected for processing. When selecting a container, the container that depends on the environment matching will be selected for processing. When the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method and system for pooling callers in a serverless computing system. By setting a redirection table in the serverless computing system, after a controller of the serverless computing system selects a caller, the redirection table is based on the selected caller by the controller. In the group where the caller is located, randomly locate a caller with an available state, and control the output of the selected caller information instead of the initial selection information, so as to achieve load balancing of the callers in the same pool. The invention can significantly improve the efficiency of the serverless computing system, save memory resources and reduce application waiting time.

Description

technical field [0001] The present invention relates to a technology in the field of Internet information processing, in particular to an invoker pooling method and system in a serverless computing system. Background technique [0002] Serverless computing means that users do not need to pay attention to the deployment configuration of the server, but only need to pay attention to the specific required services. The operator is specifically responsible for the underlying operating system and hardware facilities, and runs the user in the software container environment. services. [0003] An invoker is an entity that processes calls in serverless computing. There are several invokers in a serverless computing system, and the invoker maintains an internal container. The application runs in the container inside the invoker. However, different applications require different container environments, and the container environment needs to be configured before running, which is call...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F9/00
CPCG06F9/00
Inventor 路煜张路李超
Owner SHANGHAI JIAOTONG UNIV