Building Intelligent Data Warehouses: AI and Machine Learning Techniques for Enhanced Data Management and Analytics
Keywords:
Intelligent data warehouses, artificial intelligence, machine learningAbstract
Intelligent data warehouses enhance analytics and management. This research analyzes how AI and ML may improve data management and intelligent data warehouses. Data-driven decision-making is faster and more accurate with an intelligent data warehouse that adapts to shifting data demands and complex analytical queries.
Intelligent data warehouse architecture frameworks are investigated first. AI/ML automate data integration, filtering, and transformation. They guarantee data quality and analytical dependability. This article discusses how NLP and neural networks speed up data processing. These technologies may improve intelligent data warehouse data management and operational efficiency, allowing sophisticated analytics.
References
J. Han, J. Pei, and Y. Yin, "Mining frequent patterns without candidate generation," ACM SIGMOD Record, vol. 29, no. 2, pp. 1-12, Jun. 2000.
A. Kumar, M. L. D. de Campos, and R. M. S. de Oliveira, "A survey of machine learning techniques for big data analytics," IEEE Access, vol. 8, pp. 103642-103658, 2020.
Y. LeCun, Y. Bengio, and G. Hinton, "Deep learning," Nature, vol. 521, no. 7553, pp. 436-444, May 2015.
T. M. Mitchell, Machine Learning. New York, NY, USA: McGraw-Hill, 1997.
S. K. Gupta, R. R. Nair, and V. Kumar, "Artificial intelligence and machine learning in data management: A comprehensive review," Journal of Data and Information Science, vol. 3, no. 4, pp. 50-73, Oct. 2018.
D. J. Abadi, S. R. Madden, and N. Hachem, "Column-oriented database systems," Proceedings of the VLDB Endowment, vol. 2, no. 2, pp. 1664-1665, Aug. 2009.
D. L. Poole and A. K. Mackworth, Artificial Intelligence: Foundations of Computational Agents. Cambridge, U.K.: Cambridge University Press, 2017.
J. C. S. Santos, J. A. Jorge, and A. C. B. de Souza, "On the use of federated learning for privacy-preserving analytics," IEEE Transactions on Knowledge and Data Engineering, vol. 34, no. 3, pp. 1359-1372, Mar. 2022.
A. K. Singh, R. K. Gupta, and S. R. Rao, "Real-time data processing and analytics: A case study on IoT and edge computing," IEEE Internet of Things Journal, vol. 8, no. 7, pp. 5306-5319, Jul. 2021.
H. Wang, C. C. Aggarwal, and J. Han, "A survey of data warehousing and OLAP technology," ACM Computing Surveys (CSUR), vol. 34, no. 2, pp. 143-188, Jun. 2002.
N. A. M. Yusof, R. Ibrahim, and R. S. Leong, "Optimizing data warehouse queries using machine learning techniques," IEEE Transactions on Big Data, vol. 7, no. 1, pp. 14-26, Jan.-Mar. 2021.
L. Zheng, X. Liu, and K. Wang, "Explainable AI: A survey on techniques, applications, and challenges," IEEE Access, vol. 9, pp. 19791-19805, 2021.
K. C. Chang, P. C. Chen, and C. K. Ng, "Data warehouse architecture and design for intelligent systems," International Journal of Computer Applications, vol. 182, no. 9, pp. 10-18, Dec. 2019.
P. G. G. Silva, A. L. A. Pereira, and M. R. Almeida, "Efficient data integration techniques for large-scale intelligent data warehouses," IEEE Transactions on Data and Knowledge Engineering, vol. 33, no. 4, pp. 2246-2259, Apr. 2021.
S. Kumar and V. B. Gupta, "Challenges and solutions in integrating machine learning tools in data warehouses," Journal of Computer Science and Technology, vol. 36, no. 2, pp. 303-317, Mar. 2021.
C. H. Wu, J. H. Chou, and T. C. Lai, "Advances in real-time analytics for big data processing using AI," IEEE Transactions on Parallel and Distributed Systems, vol. 31, no. 6, pp. 1317-1329, Jun. 2020.
Y. Y. Chen, Y. S. Yang, and X. Y. Wang, "Federated learning: A new approach to privacy-preserving data analysis," IEEE Transactions on Neural Networks and Learning Systems, vol. 33, no. 1, pp. 4-17, Jan. 2022.
M. A. H. S. Nogueira, J. C. A. Santos, and L. C. S. Castro, "Neural networks for anomaly detection in data warehouses," IEEE Transactions on Network and Service Management, vol. 18, no. 3, pp. 2224-2236, Sep. 2021.
S. N. Patel and M. L. Krishnan, "Big data management and analytics with machine learning: An industry perspective," IEEE Software, vol. 39, no. 5, pp. 52-60, Sep./Oct. 2022.
M. L. Dehghanian, D. S. Park, and A. M. Adams, "Data warehouse self-optimization using machine learning techniques," IEEE Transactions on Emerging Topics in Computing, vol. 8, no. 1, pp. 12-25, Jan.-Mar. 2020.
