Handling Long-Running Tasks in a Serverless Architecture
DOI:
https://doi.org/10.63397/ISCSITR-IJCC_2025_06_05_001Keywords:
Serverless Architecture, Long-Running Tasks, AWS Lambda, Azure Functions, Google Cloud Functions, Event-Driven, Large-Scale Data Processing, AWS Step Functions, Azure Durable Functions, Google Workflows, Cost-EffectivenessAbstract
Serverless architectures, powered by cloud providers like AWS Lambda, Azure Functions, and Google Cloud Functions, have revolutionized the way we build and scale applications. Their event-driven nature, auto-scaling capabilities, and pay-per-use model make them highly attractive for many workloads. However, one challenge persists: handling long-running tasks. Serverless functions are designed to be short-lived, often limited to a few minutes per execution. This limitation requires rethinking how we process tasks that take longer than a single function invocation.
In this article, we’ll explore strategies to handle long-running tasks efficiently in a serverless environment, while maintaining scalability, reliability, and cost-effectiveness.
References
Asama Kulvanitchaiyanunt A. (2025). A Theoretical and Practical Exploration of Generative AI in AWS Architectures Enhancing Cloud-Based Data Processing and Intelligent Service Deployment, ISCSITR- INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND ENGINEERING (ISCSITR-IJCSE), 6(1), 13–23.
The Role of Serverless Architecture in Scalable and Efficient Web Development. (2025). International Journal of Scientific Research in Science and Technology, 12(2), 34-40. https://doi.org/10.32628/IJSRST25121206
Saji, Jodhan and Kumar, Ashish, A Review Paper on Serverless Architecture of Web Applications (May 5, 2023). Proceedings of the KILBY 100 7th International Conference on Computing Sciences 2023 (ICCS 2023), Available at SSRN: https://ssrn.com/abstract=4495958 or http://dx.doi.org/10.2139/ssrn.4495958
Vaibhav Vudayagiri, “Demystifying Serverless Architecture for Scalable Web Applications”, Int. J. Sci. Res. Comput. Sci. Eng. Inf. Technol, vol. 10, no. 6, pp. 254–263, Nov. 2024, doi: 10.32628/CSEIT24106176.
Gelvez-Almeida, E., Mora, M., Barrientos, R. J., Hernández-García, R., Vilches-Ponce, K., & Vera, M. (2024). A Review on Large-Scale Data Processing with Parallel and Distributed Randomized Extreme Learning Machine Neural Networks. Mathematical and Computational Applications, 29(3), 40. https://doi.org/10.3390/mca29030040
P. Bhambu, R. Kumar, P. Sharmila, V. D. Patil, S. Khurana and V. V, "Exploring Reinforcement Learning in Large-Scale Data Processing," 2023 3rd International Conference on Smart Generation Computing, Communication and Networking (SMART GENCON), Bangalore, India, 2023, pp. 1-7, doi: 10.1109/SMARTGENCON60755.2023.10442194.
Bharti, U., Goel, A. & Gupta, S.C. ReactiveFnJ: A choreographed model for Fork-Join Workflow in Serverless Computing. J Cloud Comp 12, 63 (2023). https://doi.org/10.1186/s13677-023-00429-3
Suliman Mohamed Fati, Mamdouh Alenezi,Transforming Application Development With Serverless Computing, International Journal of Cloud Applications and Computing, Volume 14, Issue 1,2024, https://doi.org/10.4018/IJCAC.365288
Vaishnavi Kulkarni, 2022, A Research Paper on Serverless Computing, INTERNATIONAL JOURNAL OF ENGINEERING RESEARCH & TECHNOLOGY (IJERT) Volume 11, Issue 09 (September 2022),351-353
Bebortta, S., Das, S. K., Kandpal, M., Barik, R. K., & Dubey, H. (2020). Geospatial Serverless Computing: Architectures, Tools and Future Directions. ISPRS International Journal of Geo-Information, 9(5), 311. https://doi.org/10.3390/ijgi9050311
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Akshay Pratinav (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
