Deep Learning Driven Big Data Architecture for Scalable Intelligent Network Threat Detection
DOI:
https://doi.org/10.33050/vc0kmq21Keywords:
Artificial Intelligence, Cybersecurity, Intrusion Detection, Big Data, Deep LearningAbstract
This study proposes a deep learning driven big data architecture designed to enable scalable and intelligent network threat detection in high volume traffic environments. Increasing network traffic volume and heterogeneity generated by enterprise systems, cloud services, and Internet of Things devices require more adaptive and intelligent security mechanisms beyond traditional signature-based approaches. This study aims to develop an intelligent threat-detection framework that leverages deep-learning models and big data analytics to enhance detection accuracy, scalability, and real-time response capabilities in large-scale network environments. A distributed big data architecture is integrated with advanced deep neural networks to process high-dimensional network traffic features, perform automated feature learning, and classify malicious activities using optimized training and validation strategies. The proposed framework is evaluated using benchmark intrusion detection datasets and simulated real-world network traffic scenarios to ensure robustness and generalizability. Experimental findings demonstrate that the proposed approach achieves superior detection accuracy, lower False-Positive Rates, and improved processing efficiency compared with conventional machine learning-based intrusion-detection systems. The integration of deep learning and big data analytics provides a scalable and adaptive solution for intelligent threat detection in computer networks, contributing to the development of next-generation cybersecurity systems capable of addressing evolving and sophisticated cyber attacks.
References
M. A. Ameedeen, R. A. Hamid, T. H. Aldhyani, L. A. K. M. Al-Nassr, S. O. Olatunji, and P. Subramanian,“A framework for automated big data analytics in cybersecurity threat detection,” Mesopotamian Journalof Big Data, vol. 2024, pp. 175–184, 2024.
A. H. Salem, S. M. Azzam, O. E. Emam, and A. A. Abohany, “Advancing cybersecurity: a comprehensive review of ai-driven detection techniques,” Journal of Big Data, vol. 11, no. 1, p. 105, 2024.
U. Rahardja, Q. Aini, A. S. Bist, S. Maulana, and S. Millah, “Examining the interplay of technology readiness and behavioural intentions in health detection safe entry station,” JDM (Jurnal Dinamika Manajemen), vol. 15, no. 1, pp. 125–143, 2024.
Z. B. Akhtar and A. T. Rawol, “Enhancing cybersecurity through ai-powered security mechanisms,” IT journal research and development, vol. 9, no. 1, pp. 50–67, 2024.
U. Rahardja, I. D. Hapsari, P. H. Putra, and A. N. Hidayanto, “Technological readiness and its impact on mobile payment usage: A case study of go-pay,” Cogent Engineering, vol. 10, no. 1, p. 2171566, 2023.
Y. Wu, B. Zou, and Y. Cao, “Current status and challenges and future trends of deep learning-based intrusion detection models,” Journal of Imaging, vol. 10, no. 10, p. 254, 2024.
M. H. R. Chakim, Q. Aini, P. A. Sunarya, N. P. L. Santoso, D. A. R. Kusumawardhani, and U. Rahardja, “Understanding factors influencing the adoption of ai-enhanced air quality systems: A utaut perspective,” in 2023 Eighth International Conference on Informatics and Computing (ICIC). IEEE, 2023, pp. 1–6.
M. Uddin, M. S. Irshad, I. A. Kandhro, F. Alanazi, F. Ahmed, M. Maaz, S. Hussain, and S. S. Ullah, “Generative ai revolution in cybersecurity: a comprehensive review of threat intelligence and operations,” Artificial Intelligence Review, vol. 58, no. 8, p. 236, 2025.
R. Indrawan, E. D. Very, D. Tribuana, and E. A. Nabila, “Aiot driven smart solar system for real time predictive sustainable energy management,” International Transactions on Artificial Intelligence, vol. 4, no. 1, pp. 105–114, 2025.
D. S. Mary, L. J. S. Dhas, A. Deepa, M. A. Chaurasia, and C. J. J. Sheela, “Network intrusion detection: An optimized deep learning approach using big data analytics,” Expert Systems with Applications, vol. 251, p. 123919, 2024.
D. Robert, F. P. Oganda, A. Sutarman, W. Hidayat, and A. Fitriani, “Machine learning techniques for predicting the success of ai-enabled startups in the digital economy,” CORISINTA, vol. 1, no. 1, pp. 61– 69, 2024.
R. Regin and S. S. Rajest, “Comprehensive exploratory data analysis of the netflix dataset: Uncovering viewer preferences and content trends,” Central Asian Journal of Mathematical Theory and Computer Sciences, vol. 5, no. 4, pp. 388–400, 2024.
I. P. Gustiah and H. Newell, “Enhancing human resource management efficiency through scalable blockchain networks with an adaptive ai approach,” Startupreneur Business Digital (SABDA Journal), vol. 4, no. 2, pp. 114–123, 2025.
S. Bar, P. Prasad, and M. S. Sayeed, “Enhancing internet of things intrusion detection using artificial intelligence,” Computers, Materials and Continua, vol. 81, no. 1, pp. 1–23, 2024.
H. Nufus, B. Hermansah, R. T. H. Safariningsih, S. Wibowo, and N. Rangi, “Blockchain for enhancing data traceability in digital supply chain management,” Blockchain Frontier Technology, vol. 5, no. 2, pp. 194–206, 2026.
M. Amine Ferrag, F. Alwahedi, A. Battah, B. Cherif, A. Mechri, N. Tihanyi, T. Bisztray, and M. Debbah, “Generative ai in cybersecurity: A comprehensive review of llm applications and vulnerabilities,” arXiv e-prints, pp. arXiv–2405, 2024.
A. Aprillia, A. Theriana, S. Syaifuddin, F. Amelia, and R. S. Ikhsan, “Development of blockchain based system for secure student data management,” Blockchain Frontier Technology, vol. 5, no. 2, pp. 147–157, 2026.
A. Alabdulatif, “A novel ensemble of deep learning approach for cybersecurity intrusion detection with explainable artificial intelligence,” Applied Sciences, vol. 15, no. 14, p. 7984, 2025.
R. Nuraeni, E. A. Natalia, C. T. Hua, N. Septiani, and I. Sasono, “Decentralized storage in smart city data infrastructure swot analysis,” Blockchain Frontier Technology, vol. 5, no. 2, pp. 112–123, 2026.
M. S. R. S. Raja, “The rise of ai-driven network intrusion detection systems: Innovations, challenges, and future directions,” International Journal of AI, BigData, Computational and Management Studies, vol. 6, no. 1, pp. 1–9, 2025.
D. Bennet, S. A. Anjani, O. P. Daeli, D. Martono, and C. S. Bangun, “Predictive analysis of startup ecosystems: Integration of technology acceptance models with random forest techniques,” CORISINTA, vol. 1, no. 1, pp. 70–79, 2024.
M. Mahdi Alhusseini and M. R. Feizi Derakhshi, “Hybrid ai-driven intrusion detection: Framework lever- aging novel feature selection for enhanced network security,” arXiv e-prints, pp. arXiv–2509, 2025.
N. Lutfiani, A. Ivanov, N. P. L. Santoso, S. V. Sihotang, and S. Purnama, “E-commerce growth plan for msmes’ sustainable development enhancement,” CORISINTA, vol. 1, no. 1, pp. 80–86, 2024.
C. Ki, R. Sivakumar, J. Mulerikkal, B. A, M. Gupta, and T. Jan, “A comprehensive survey of machine learning and deep learning approaches for anomaly detection in high-performance computing systems: C. ki et al.” The Journal of Supercomputing, vol. 81, no. 8, p. 1032, 2025.
T.-T.-T. Do, Q.-T. Huynh, K. Kim, and V.-Q. Nguyen, “A survey on video big data analytics: architecture, technologies, and open research challenges,” Applied Sciences, vol. 15, no. 14, p. 8089, 2025.
M. Mulyati, S. Zebua, D. Apriani, F. P. Oganda, A. Fitriani, S. V. Sihotang, and N. A. Santoso, “Optimiza- tion of community entrepreneurship through diversification and digitalization of locally based chocolate beverages,” ADI Journal on Recent Innovation, vol. 7, no. 1, pp. 88–99, 2025.
Z. Zhang, P. Wang, T. Zhang, M. Liu, and X. Zhou, “Trustworthy generative few-shot learning-based intrusion detection method in internet of things,” IEEE Transactions on Consumer Electronics, vol. 71, no. 1, pp. 1992–2002, 2024.
M. Seydali, F. Khunjush, and J. Dogani, “Streaming traffic classification: a hybrid deep learning and big data approach,” Cluster Computing, vol. 27, no. 4, pp. 5165–5193, 2024.
A. Erica, L. Gantari, O. Qurotulain, A. Nuche, and O. Sy, “Optimizing decision-making: Data analytics applications in management information systems,” APTISI Transactions on Management, vol. 8, no. 2, pp. 115–122, 2024.
A. Jain, “Ai-powered cloud security: A review of intrusion detection and prevention strategies.” International Journal of Advanced Research in Computer Science, vol. 16, no. 6, 2025.
P. Liu, L. Chen, H. Zhang, Y. Zhang, C. Liu, C. Li, and Z. Wang, “Pear: Positional-encoded asynchronous autoregression for satellite anomaly detection,” Pattern Recognition Letters, vol. 176, pp. 96–101, 2023.
R. Fahrudin, Y. F. DWI, F. A. YADI, A. Wilson, and T. Kuusk, “Addressing regulatory risks in fintech through decentralized technologies,” APTISI TRANSACTIONS ON MANAGEMENT: iLearning Journal Center, vol. 8, no. 3, pp. 204–212, 2024.
H. J. D. S. De Queiroz and H. MacLennan, “Threat detection and anomaly identification using deep learning,” in Revolutionizing Cybersecurity With Deep Learning and Large Language Models. IGI Global Scientific Publishing, 2025, pp. 65–96.
P. Li, G. Wu, Y. Zhou, and J. Leng, “Enhancing random surface anomaly detection in real-world using a four-stage one-class approach,” Pattern Recognition Letters, vol. 194, pp. 32–40, 2025.
R. PUPUT and N. Sintesa, “The influence of financial literacy on the investment behavior of indonesian migrant workers in japan,” APTISI TRANSACTIONS ON MANAGEMENT : iLearning Journal Center, vol. 8, no. 3, pp. 175–185, 2024.
O. Aouedi, V. A. Le, K. Piamrat, and Y. Ji, “Deep learning on network traffic prediction: Recent advances, analysis, and future directions,” ACM computing surveys, vol. 57, no. 6, pp. 1–37, 2025.
M. M. Rathore, A. Ahmad, and A. Paul, “Real time intrusion detection system for ultra-high-speed big data environments,” The Journal of Supercomputing, vol. 72, no. 9, pp. 3489–3510, 2016.
E. Susetyono, D. S. Priyarsono, A. Sukmawati, and P. Nurhayati, “Improving risk management maturity in ultra micro soe holding companies,” Aptisi Transactions on Technopreneurship (ATT), vol. 8, no. 1, pp. 310–324, 2026.
H. B. Ahmad, H. Gao, and N. Latif, “Adaptive anomaly detection and classification in critical infrastructure systems: A real-time privacy-preserving multi-model framework,” High-Confidence Computing, p. 100360, 2025.
E. T. Rusmiati, L. Febrina, Y. Sari, and E. M. S. Sakti, “Adoption of ai driven ecological preaching systems using sem pls analysis,” Aptisi Transactions on Technopreneurship (ATT), vol. 8, no. 1, pp. 284– 295, 2026.
E. C. P. Neto, S. Iqbal, S. Buffett, M. Sultana, and A. Taylor, “Deep learning for intrusion detection in emerging technologies: a comprehensive survey and new perspectives,” Artificial Intelligence Review, vol. 58, no. 11, p. 340, 2025.
H. J. Hadi, Y. Cao, S. Li, Y. Hu, J. Wang, and S. Wang, “Real-time collaborative intrusion detection system in uav networks using deep learning,” IEEE Internet of Things Journal, vol. 11, no. 20, pp. 33 371–33 391, 2024.
I. H. Ji, J. H. Lee, M. J. Kang, W. J. Park, S. H. Jeon, and J. T. Seo, “Artificial intelligence-based anomaly detection technology over encrypted traffic: A systematic literature review,” Sensors, vol. 24, no. 3, p. 898, 2024.
E. Arif, S. Suherman, and A. P. Widodo, “Analyzing public sentiment on digital banks in indonesia via social media x,” Aptisi Transactions on Technopreneurship (ATT), vol. 8, no. 1, pp. 253–267, 2026.
J. R. Trillo, F. Gonz´alez-L´opez, J. A. Morente-Molinera, R. Mag´an-Carri´on, and P. Garc´ıa-S´anchez, “Evaluation of explainable, interpretable and non-interpretable algorithms for cyber threat detection,” Electronics, vol. 14, no. 15, p. 3073, 2025.
J. Vansiya, A. Chandi, and R. A. Khan, “Ai-based intrusion detection & prevention models for smart home iot systems: A literature review,” Journal of Computer Science and Technology Studies, vol. 7, no. 3, pp.982–996, 2025.
J. B. Hendrawidjaja, B. W. Soetjipto, R. D. Kusumastuti, and O. Jayanagara, “Ecosystem exchange, strategic capabilities, and firm performance with agility and innovation mediators,” Aptisi Transactions on Technopreneurship (ATT), vol. 8, no. 1, pp. 226–238, 2026.
N. Tatipatri and S. Arun, “A comprehensive review on cyber-attacks in power systems: Impact analysis, detection, and cyber security,” IEEe Access, vol. 12, pp. 18 147–18 167, 2024.
Y. Zhang, R. C. Muniyandi, and F. Qamar, “A review of deep learning applications in intrusion detection systems: overcoming challenges in spatiotemporal feature extraction and data imbalance,” Applied Sciences, vol. 15, no. 3, p. 1552, 2025.
Y. H. Dulanlebit, H. Hernani, L. Liliasari, M. B. Amran, and G. A. Pangilinan, “Technopreneurship and market feasibility of modified carrageenan hydrogel for industrial heavy metal remediation,” Aptisi Transactions on Technopreneurship (ATT), vol. 8, no. 1, pp. 199–210, 2026.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Sigit Anggoro, Palma Juanta, Ariesya Aprillia, Adele Valerry
This work is licensed under a Creative Commons Attribution 4.0 International License.
