Scalable Event Driven Architectures for High Throughput and Low Latency in Distributed Cloud Environments
Keywords:
Event-Driven Architecture (EDA), High Throughput, Low Latency, Distributed Cloud, Serverless Computing, Message Brokers, Event Sourcing, Scalability, Real-time Systems, MicroservicesAbstract
Event-driven architectures (EDAs) have emerged as a cornerstone for building scalable and efficient distributed systems, particularly in the cloud computing landscape. Achieving high throughput and low latency is paramount for modern applications requiring real-time responsiveness and dynamic scalability. This paper explores critical advancements, challenges, and practical implementations of EDAs in cloud environments. It emphasizes mechanisms that enable elasticity, resilience, and performance optimization while discussing trends in serverless computing, message brokers, and event sourcing. A comprehensive literature review of original studies published before 2024 is presented to support the analysis, supplemented by empirical data through tables, graphs, and charts. The paper concludes by identifying future directions for evolving event-driven models toward even greater scalability and efficiency.
References
Hellerstein, Joseph M., et al. "Serverless computing: One step forward, two steps back." Communications of the ACM, vol. 62, no. 12, 2019, pp. 36–44.
Wang, L., et al. "Peeking behind the curtains of serverless platforms." Proceedings of the USENIX Annual Technical Conference, 2020.
Nardelli, Marco, et al. "Optimizing Kafka for Event-Driven Cloud Applications." IEEE Transactions on Cloud Computing, 2021.
Vohra, Deepak. Serverless Event Streaming in the Cloud. Apress, 2022.
Han, Dong, et al. "Hybrid event sourcing models for cloud-native applications." Journal of Systems and Software, vol. 169, 2020, 110709.
Lee, Sunghwan, et al. "Dynamic Partitioning in Distributed Event Streaming Systems." Proceedings of ACM Middleware, 2021.
Sharma, Rohan, et al. "Scalable Event-Driven Architectures Using Kubernetes Autoscaling." ACM Transactions on Internet Technology, vol. 23, no. 4, 2023.
Gogia, Atul, and Pooja Arora. "EDA in Healthcare: A Multi-cloud Perspective." Healthcare Informatics Research, vol. 28, no. 1, 2022, pp. 55-64.
Jonas, Eric, et al. "Cloud Programming Simplified: A Berkeley View on Serverless Computing." Technical Report, UC Berkeley, 2019.
Spillner, Josef. Foundations of Serverless Computing. Springer, 2022.
