Evaluating the Effectiveness of Machine Learning in Cyber Threat Detection

Authors

  • Aulia Khanza Association of Colleges of Informatics and Computer Science Author
  • Firdaus Dwi Yulian Alfabet Inkubator Indonesia Author
  • Novita Khairunnisa APTIKOM Author
  • Natasya Aprila Yusuf University of Raharja Author
  • Asher Nuche Ijiis Incorporation Author

DOI:

https://doi.org/10.33050/ysdncf05

Keywords:

Machine Learning, Cyber Threat Detection, Random Forest, Supervised Learning, Cybersecurity

Abstract

In today's digital era, cyber threats pose significant challenges to organizations, necessitating more advanced detection methods. This study aims to evaluate the effectiveness of machine learning (ML) techniques in detecting cyber threats, focusing on supervised, unsupervised, and reinforcement learning models. Using datasets such as CICIDS2017, the study trains models including Random Forest, Support Vector Machines (SVM), and Neural Networks. The evaluation is based on accuracy, precision, recall, and F1-score metrics. The results demonstrate that the Random Forest model outperforms others with an accuracy of 92.5\%, a precision of 91.8\%, and an F1-score of 92.4\%. This superior performance highlights its potential for real-time threat detection, as evidenced by a case study where the model effectively identified previously undetected cyber threats in a large technology company's network. However, the study also acknowledges challenges such as data quality and the need for continuous model updates. The findings suggest that integrating ML models into cybersecurity frameworks can significantly enhance threat detection efficiency. Future research should explore combining ML with traditional methods and improving model robustness against adversarial attacks to further advance cybersecurity measures.

References

U. Rahardja, Q. Aini, A. S. Bist, S. Maulana, and S. Millah, “Examining the interplay of technology readiness and behavioural intentions in health detection safe entry station,” JDM (Jurnal Dinamika Manajemen), vol. 15, no. 1, pp. 125–143, 2024.

F. Mulyanto, A. Purbasari et al., “Solusi arsitektur berbasis blockchain untuk manajemen rantai pasokan yang transparan,” Jurnal MENTARI: Manajemen, Pendidikan dan Teknologi Informasi, vol. 2, no. 2, pp. 197–206, 2024.

T. Hidayat, D. Manongga, Y. Nataliani, S. Wijono, S. Y. Prasetyo, E. Maria, U. Raharja, I. Sembiring et al., “Performance prediction using cross validation (gridsearchcv) for stunting prevalence,” in 2024 IEEE International Conference on Artificial Intelligence and Mechatronics Systems (AIMS). IEEE, 2024, pp. 1–6.

A. Delhi, E. Sana, A. A. Bisty, and A. Husain, “Innovation in business management exploring the path to competitive excellence,” APTISI Transactions on Management, vol. 8, no. 1, pp. 58–65, 2024.

U. Rusilowati, U. Narimawati, Y. R. Wijayanti, U. Rahardja, and O. A. Al-Kamari, “Optimizing human resource planning through advanced management information systems: A technological approach,” Aptisi Transactions on Technopreneurship (ATT), vol. 6, no. 1, pp. 72–83, 2024.

A. Kristian, T. S. Goh, A. Ramadan, A. Erica, and S. V. Sihotang, “Application of ai in optimizing energy and resource management: Effectiveness of deep learning models,” International Transactions on Artificial Intelligence, vol. 2, no. 2, pp. 99–105, 2024.

E. E. Djajasasana and J. R. K. Bokau, “Utilization of micro influencers and engagement in social media to gain cadet candidates,” ADI Journal on Recent Innovation, vol. 6, no. 1, pp. 1–7, 2024.

S. Wahyuningsih, A. Sutarman, I. N. Hikam et al., “Understanding purposeful leadership in en- trepreneurial contexts: A bibliometric analysis,” Aptisi Transactions on Technopreneurship (ATT), vol. 6, no. 2, pp. 213–230, 2024.

R. Azhari and A. N. Salsabila, “Analyzing the impact of quantum computing on current encryption techniques,” IAIC Transactions on Sustainable Digital Innovation (ITSDI), vol. 5, no. 2, pp. 148–157, 2024.

L. W. Ming, J. Anderson, F. Hidayat, F. D. Yulian, and N. Septiani, “Ai as a driver of efficiency in waste management and resource recovery,” International Transactions on Artificial Intelligence, vol. 2, no. 2, pp. 128–134, 2024.

N. S. Ainy, I. Mujadid, N. Hadi, and L. Sjahfirdi, “Increase in the abundance of invasive fish species in the ciliwung river, dki jakarta and west java provinces,” ADI Journal on Recent Innovation, vol. 6, no. 1, pp. 17–31, 2024.

K. A. A. Manurung, H. Siregar, I. Fahmi, and D. B. Hakim, “Value chain and esg performance as determinants of sustainable lending in commercial bank: A systematic literature review,” Aptisi Transactions on Technopreneurship (ATT), vol. 6, no. 1, pp. 41–55, 2024.

B. E. Sibarani, C. Anggreani, B. Artasya, and D. A. P. Harahap, “Unraveling the impact of self-efficacy, computer anxiety, trait anxiety, and cognitive distortions on learning mind your own business: The student perspective,” Aptisi Transactions on Technopreneurship (ATT), vol. 6, no. 1, pp. 29–40, 2024.

M. Annas, T. Handra, C. S. Bangun, U. Rahardja, and N. Septiani, “Reward and promotion: Sustainable value of post pandemic efforts in medical cold-supply chain,” Aptisi Transactions on Technopreneurship (ATT), vol. 6, no. 1, pp. 109–118, 2024.

Y. Shino, F. Utami, and S. Sukmaningsih, “Economic preneur’s innovative strategy in facing the economic crisis,” IAIC Transactions on Sustainable Digital Innovation (ITSDI), vol. 5, no. 2, pp. 117–126, 2024.

Q. Aini, D. Manongga, U. Rahardja, I. Sembiring, and Y. M. Li, “Understanding behavioral intention to use of air quality monitoring solutions with emphasis on technology readiness,” International Journal of Human–Computer Interaction, pp. 1–21, 2024.

M. Ahli, M. F. Hilmi, and A. Abudaqa, “Ethical sales behavior influencing trust, loyalty, green experience, and satisfaction in uae public entrepreneur firms,” Aptisi Transactions on Technopreneurship (ATT), vol. 6, no. 2, pp. 149–168, 2024.

A. Erica, L. Gantari, O. Qurotulain, A. Nuche, and O. Sy, “Optimizing decision-making: Data analytics applications in management information systems,” APTISI Transactions on Management, vol. 8, no. 2, pp. 115–122, 2024.

M. R. Anwar and L. D. Sakti, “Integrating artificial intelligence and environmental science for sustainable urban planning,” IAIC Transactions on Sustainable Digital Innovation (ITSDI), vol. 5, no. 2, pp. 179–191, 2024.

A. Ruangkanjanases, A. Khan, O. Sivarak, U. Rahardja, and S.-C. Chen, “Modeling the consumers’ flow experience in e-commerce: The integration of ecm and tam with the antecedents of flow experience,” SAGE Open, vol. 14, no. 2, p. 21582440241258595, 2024.

R. G. Munthe, Q. Aini, N. Lutfiani, I. Van Persie, and A. Ramadan, “Transforming scientific publication management in the era of disruption: Smartpls approach in innovation and efficiency analysis,” APTISI Transactions on Management, vol. 8, no. 2, pp. 123–130, 2024.

D. Nugroho and P. Angela, “The impact of social media analytics on sme strategic decision making,” IAIC Transactions on Sustainable Digital Innovation (ITSDI), vol. 5, no. 2, pp. 169–178, 2024.

N. Anwar, A. M. Widodo, B. A. Sekti, M. B. Ulum, M. Rahaman, and H. D. Ariessanti, “Comparative analysis of nij and nist methods for microsd investigations: A technopreneur approach,” Aptisi Transactions on Technopreneurship (ATT), vol. 6, no. 2, pp. 169–181, 2024.

G. S. Putra, I. I. Maulana, A. D. Chayo, M. I. Haekal, R. Syaharani et al., “Pengukuran efektivitas platform e-learning dalam pembelajaran teknik informatika di era digital,” Jurnal MENTARI: Manajemen, Pendidikan dan Teknologi Informasi, vol. 3, no. 1, pp. 19–29, 2024.

S. A. Hasan, W. N. Al-Zahra, A. S. Auralia, D. A. Maharani, R. Hidayatullah et al., “Implementasi teknologi blockchain dalam pengamanan sistem keuangan pada perguruan tinggi,” Jurnal MENTARI: Manajemen, Pendidikan dan Teknologi Informasi, vol. 3, no. 1, pp. 11–18, 2024.

M. Ajeng, A. Kirei, and K. Amanda, “Blockchain technology application for information system security in education,” Blockchain Frontier Technology, vol. 3, no. 1, pp. 26–31, 2023.

S. Purnama and C. S. Bangun, “Strategic management insights into housewives consumptive shopping behavior in the post covid-19 landscape,” APTISI Transactions on Management, vol. 8, no. 1, pp. 71–79, 2024.

I. Sembiring, U. Rahardja, D. Manongga, Q. Aini, and A. Wahab, “Enhancing aiku adoption: Insights from the role of habit in behavior intention,” Aptisi Transactions on Technopreneurship (ATT), vol. 6, no. 1, pp. 84–108, 2024.

J. Hom, B. Anong, K. B. Rii, L. K. Choi, and K. Zelina, “The octave allegro method in risk management assessment of educational institutions,” Aptisi Transactions on Technopreneurship (ATT), vol. 2, no. 2, pp. 167–179, 2020.

E. Ligia, K. Iskandar, I. K. Surajaya, M. Bayasut, O. Jayanagara, and K. Mizuno, “Cultural clash: Investigating how entrepreneural characteristics and culture diffusion affect international interns’ competency,” Aptisi Transactions on Technopreneurship (ATT), vol. 6, no. 2, pp. 182–198, 2024.

M. F. Nur and A. Siregar, “Exploring the use of cluster analysis in market segmentation for targeted advertising,” IAIC Transactions on Sustainable Digital Innovation (ITSDI), vol. 5, no. 2, pp. 158–168, 2024.

N. Lutfiani, N. P. L. Santoso, R. Ahsanitaqwim, U. Rahardja, and A. R. A. Zahra, “Ai-based strategies to improve resource efficiency in urban infrastructure,” International Transactions on Artificial Intelligence, vol. 2, no. 2, pp. 121–127, 2024.

D. Syaepudin et al., “Implementasi akad pembiayaan mudharabah pada koperasi syariah kspps bmt al fath ikmi,” Jurnal MENTARI: Manajemen, Pendidikan dan Teknologi Informasi, vol. 3, no. 1, pp. 1–10, 2024.

Y. S. Dewi, “Influence of type and dose of coagulants on vehicle wash wastewater,” ADI Journal on Recent Innovation, vol. 6, no. 1, pp. 8–16, 2024.

Z. Maharani, A. Saputra et al., “Strategic management of public health risks: Correlation between water quality and aedes sp. in south jakarta,” APTISI Transactions on Management, vol. 8, no. 1, pp. 66–70, 2024.

U. Rusilowati, H. R. Ngemba, R. W. Anugrah, A. Fitriani, and E. D. Astuti, “Leveraging ai for superior efficiency in energy use and development of renewable resources such as solar energy, wind, and bioenergy,” International Transactions on Artificial Intelligence, vol. 2, no. 2, pp. 114–120, 2024.

R. Sivaraman, M. H. Lin, M. I. C. Vargas, S. I. S. Al-Hawary, U. Rahardja, F. A. H. Al-Khafaji, E. V. Golubtsova, and L. Li, “Multi-objective hybrid system development: To increase the performance of diesel/photovoltaic/wind/battery system,” Mathematical Modelling of Engineering Problems, vol. 11, no. 3, 2024.

Downloads

Published

2024-08-31

Issue

Section

Articles

How to Cite

Evaluating the Effectiveness of Machine Learning in Cyber Threat Detection. (2024). CORISINTA, 1(2), 172–179. https://doi.org/10.33050/ysdncf05