Courier: Delivering Serverless Functions across Multi-FaaS Cloud Deployments

Image credit: Serverless Architecture Conference

Abstract

With the advent of serverless computing in different domains, there is a growing need for dynamic adaption to handle diverse and heterogeneous functions. However, serverless computing is currently limited to single Function-as-a-Service (FaaS) cloud deployment (such as AWS Lambda or Google Cloud Functions). Extending serverless computing to support functions deployments across multiple FaaS cloud deployments and dynamically load balancing the invocations of the functions across these multi-cloud deployments can provide an optimal way for handling such serverless functions. We call the network of these multi-FaaS cloud deployments as Function Delivery Network (FDN). In this talk, we introduce FDN and present a software system: Courier responsible for optimally distributing the invocations of the functions (called delivering of serverless functions) across the multiple FaaS cloud deployments based on the execution time of the functions on the single FaaS cloud deployment. We developed multiple approaches which use latency-aware scheduling to deliver serverless functions. We demonstrate the functioning of our developed tool using three FaaS platforms: 1) on-premise Open-Whisk, 2) AWS Lambda, and 3) Google Cloud Functions (GCF). We show the advantages of Courier in improving the overall performance and cost of the invocations of the functions.

Date
Apr 5, 2022 2:15 PM — 3:00 PM
Location
The Hague or Online
The Hague Marriott Hotel, The Hague, Netherlands 25177

Anshul Jindal
Anshul Jindal
Ph.D. Student

My research interests include cloud computing, specifically focussing on serverless computing for heterogeneous systems, edge computing, and AIOps.

Related