Gradient descent algorithms are widely considered the primary choice for optimizing deep learning models. However, they often require adjusting various hyperparameters, like the learning rate, among ...