Artificial Neural Network Hyperparameters Optimization: A Survey

Authors

  • Zahraa Saddi Kadhim university of technology
  • Hasanen S. Abdullah University of technology
  • Khalil Ibrahim Ghathwan University of technology

DOI:

https://doi.org/10.3991/ijoe.v18i15.34399

Keywords:

Hyperparameter Optimization, artificial neural network, Deep learning, machine learning

Abstract


Machine-learning (ML) methods often utilized in applications like computer vision, recommendation systems, natural language processing (NLP), as well as user behavior analytics. Neural Networks (NNs) are one of the most es-sential ways to ML; the most challenging element of designing a NN is de-termining which hyperparameters to employ to generate the optimal model, in which hyperparameter optimization improves NN performance. This study includes a brief explanation regarding a few types of NN as well as some methods for hyperparameter optimization, as well as previous work results in enhancing ANN performance using optimization methods that aid research-ers and data analysts in developing better ML models via identifying the ap-propriate hyperparameter configurations.

Author Biography

Zahraa Saddi Kadhim, university of technology

she obtained her B.Sc. in computer science from University of Technology, Iraq in 2015. Currently studying M.Sc.in computer science. she worked as a trainer for a non-governmental group teaching young people how to code robots in 2017-2019.her interested is mobile application, Artificial Intelligence, Machine Learning, Pattern Recognition, Data encryption and robotic(email: cs.20.44@grad.uotechnology.edu.iq)

Covr iJOE Vol. 18 No. 15 (2022)

Downloads

Published

2022-12-06

How to Cite

Kadhim, Z. S., Abdullah, H. S., & Ghathwan, K. I. (2022). Artificial Neural Network Hyperparameters Optimization: A Survey. International Journal of Online and Biomedical Engineering (iJOE), 18(15), pp. 59–87. https://doi.org/10.3991/ijoe.v18i15.34399

Issue

Vol. 18 No. 15 (2022)

Section

Papers

License

Copyright (c) 2022 zahraa kadhim, Dr. Hasanen S. Abdullah, Dr. Khalil Ibrahim Ghathwan

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

The submitting author warrants that the submission is original and that she/he is the author of the submission together with the named co-authors; to the extend the submission incorporates text passages, figures, data or other material from the work of others, the submitting author has obtained any necessary permission.
Articles in this journal are published under the Creative Commons Attribution Licence (CC-BY What does this mean?). This is to get more legal certainty about what readers can do with published articles, and thus a wider dissemination and archiving, which in turn makes publishing with this journal more valuable for you, the authors.
By submitting an article the author grants to this journal the non-exclusive right to publish it. The author retains the copyright and the publishing rights for his article without any restrictions.