Neural Network with Adaptive Learning Rate

Loading...
Thumbnail Image

Date

2020-10

Journal Title

Journal ISSN

Volume Title

Type

Article

Publisher

Institute of Electrical and Electronics Engineers Inc.

Series Info

2nd Novel Intelligent and Leading Emerging Sciences Conference, NILES 2020;Article number 9257880, Pages 544-548

Doi

Abstract

Over the last two decades, the neural network has surprisingly arisen as an efficient tool for dealing with numerous real-life applications. Optimization of the hyperparameter of the neural network attracted many researchers in industrial and research areas because of its great effect on the quality of the solution. This paper presents a new adaptation for the learning rate with shock (ALRS) as the learning rate is considered one of the most important hyperparameters. The experimental results proved that the new adaptation leads to improved accuracy with a simpler structure for the neural network regardless of the initial value of the learning rate.

Description

Keywords

university, Adapive Learning Rate, Artificial Neural Network, Breast Cancer, Hyper-Parameter optimization

Citation