Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Mitigating serverless cold starts through predicting computational resource demand: Predicting function invocations based on real-time user navigation
Jönköping University, School of Engineering, JTH, Department of Computer Science and Informatics.
Jönköping University, School of Engineering, JTH, Department of Computer Science and Informatics.
2023 (English)Independent thesis Basic level (degree of Bachelor), 180 HE creditsStudent thesis
Sustainable development
Sustainable Development
Abstract [en]

Serverless functions have emerged as a prominent paradigm in software deployment, providing automated resource scaling, resulting in demand-based operational expenses. One of the most significant challenges associated with serverless functionsis the cold start delay, preventing organisations with latency-critical web applications from adopting a serverless technology.

Existing research on the cold start problem primarily focuses on mitigating the delay by modifying and optimising serverless platform technologies. However, these solutions have predominantly yielded modest reductions in time delay. Consequently, the purpose of this study is to establish conditions and circumstances under which the cold start issue can be addressed through the type of approach presented in this study.

Through a design science research methodology, a software artefact named AdaptiveServerless Invocation Predictor (ASIP) was developed to mitigate the cold start issue through monitoring web application user traffic in real-time. Based on the user traffic, ASIP preemptively pre-initialises serverless functions likely to be invoked, to avoid cold start occurrences. ASIP was tested against a realistic workload generated by test participants.

Evaluation of ASIP was performed through analysing the reduction in time delay achieved and comparing this against existing cold start mitigation strategies. The results indicate that predicting serverless function invocations based on real-time traffic analysis is a viable approach, as a tangible reduction in response time was achieved. Conclusively, the cold start mitigation strategy assessed and presented in this study may not provide a sufficiently significant mitigation effect relative to the required implementation effort and operational expenses. However, the study has generated valuable insights regarding circumstantial factors concerning cold start mitigation. Consequently, this study provides a proof of concept for a more sophisticated version of the mitigation strategy developed in this study, with greater potential to provide a significant delay reduction without requiring substantial computational resources. 

Place, publisher, year, edition, pages
2023. , p. 76
Keywords [en]
serverless functions, cold start, provisioned concurrency, adaptive scaling, mitigation, predicting function invocations, monitoring real-time user navigation
National Category
Software Engineering Computer Sciences Computer and Information Sciences Human Computer Interaction Information Systems
Identifiers
URN: urn:nbn:se:hj:diva-61983ISRN: JU-JTH-DTA-1-20230197OAI: oai:DiVA.org:hj-61983DiVA, id: diva2:1781864
External cooperation
Knowit
Subject / course
JTH, Computer Engineering
Supervisors
Examiners
Available from: 2023-08-08 Created: 2023-07-11 Last updated: 2025-10-13Bibliographically approved

Open Access in DiVA

2023_V3_DMP_GustavP_WilliamB_Knowit(1882 kB)564 downloads
File information
File name FULLTEXT01.pdfFile size 1882 kBChecksum SHA-512
cee1ad3c98a4f3764cca2e9cf831b2ebff861b5c704a8813e81db2e66dcf4e40e04ce88acfbda302a516ca57aa1595494d109961be984beb78501f856f957753
Type fulltextMimetype application/pdf

By organisation
JTH, Department of Computer Science and Informatics
Software EngineeringComputer SciencesComputer and Information SciencesHuman Computer InteractionInformation Systems

Search outside of DiVA

GoogleGoogle Scholar
Total: 567 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 1996 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf