Analyzing the Evolution of Data Warehousing Architectures in Response to Real-Time Analytics Demands and Heterogeneous Data Streams
Keywords:
Data Warehouse Architecture, Real-Time Analytics, Heterogeneous Data, Streaming Data, Data Lakehouse, Cloud Data Warehousing, ETL, ELT, Data EngineeringAbstract
The shift toward real-time decision-making and the exponential growth of heterogeneous data streams have transformed traditional data warehousing paradigms. This paper analyzes the architectural evolution of data warehouses to accommodate the increased complexity of data sources and the velocity of analytical demands. We examine the transition from monolithic Enterprise Data Warehouses (EDW) to modern hybrid and cloud-native architectures such as Data Lakehouses and streaming warehouses. Through a synthesis of published research and industry trends, this study highlights the challenges, benefits, and implications of this evolution. Findings suggest that responsive, flexible, and scalable warehouse models are imperative for sustaining competitive analytics in modern enterprises.
References
Inmon, W.H. (1992). Building the Data Warehouse. IBM Systems Journal, Vol. 31, Issue 3.
Kimball, R. & Ross, M. (2002). The Data Warehouse Toolkit. Wiley Publishing, Vol. 1.
Stonebraker, M. et al. (2005). The Case for Shared Nothing. Communications of the ACM, Vol. 48, Issue 6.
Grolinger, K. et al. (2013). Challenges for Cloud-based Big Data Analytics. Future Generation Computer Systems, Vol. 29, Issue 9.
Abadi, D.J. et al. (2016). The Design of the C-Store. VLDB Journal, Vol. 25, Issue 3.
Fernandez, R. et al. (2020). Performance Benchmarking of Lakehouse Systems. Information Systems, Vol. 89.
Armbrust, M. et al. (2021). Lakehouse: A New Generation of Data Analytics Architecture. CIDR Conference, Vol. 1.
Chaudhuri, S. & Dayal, U. (1997). An Overview of Data Warehousing and OLAP Technology. SIGMOD Record, Vol. 26, Issue 1.
Vassiliadis, P. (2009). A Survey of Extract–Transform–Load Technology. International Journal of Data Warehousing, Vol. 5, Issue 3.
Leavitt, N. (2010). Will NoSQL Databases Live Up to Their Promise? Computer, Vol. 43, Issue 2.
Cuzzocrea, A. (2011). Real-Time Data Warehousing. Journal of Data Semantics, Vol. 15, Issue 1.
Rittinghouse, J.W. & Ransome, J.F. (2016). Cloud Computing Implementation. Journal of Cloud Computing, Vol. 4, Issue 2.
Rajaraman, V. (2014). Big Data Analytics. Resonance, Vol. 19, Issue 8.
Li, Y. & Manoharan, S. (2013). A Performance Comparison of SQL and NoSQL Databases. Communications of the ACM, Vol. 56, Issue 12.
Srivastava, U. & Widom, J. (2004). Streaming Data Integration. IEEE Data Engineering Bulletin, Vol. 27, Issue 2.
Downloads
Published
Issue
Section
License
Copyright (c) 2023 Chloe Martin (Author)
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
