top
logo

Login Form



Visitors Counter

mod_vvisit_counterToday38
mod_vvisit_counterYesterday105
mod_vvisit_counterThis week143
mod_vvisit_counterThis month1793
mod_vvisit_counterAll123890

Who's Online

We have 12 guests online

Home
Error
  • Error loading feed data.
  • Error loading feed data.
A new class of nonmonotone conjugate gradient training algorithms PDF Print E-mail
I.E. Livieris and P. Pintelas, A new class of nonmonotone conjugate gradient training algorithms. Applied Mathematics and Computation, Volume 266, pp. 404-413, 2015.

Abstract - In this paper, we propose a new class of conjugate gradient algorithms for training neural networks which is based on a new modified nonmonotone scheme proposed by Shi and Wang. The utilization of a nonmonotone strategy enables the training algorithm to overcome the case where the sequence of iterates runs into the bottom of a curved narrow valley, a common occurrence in neural network training process. Our proposed class of methods ensures sufficient descent, avoiding thereby the usual inefficient restarts and it is globally convergent under mild conditions. Our experimental results provide evidence that the proposed nonmonotone conjugate gradient training methods are efficient, outperforming classical methods, proving more stable, efficient and reliable learning.

 

Search Engines




bottom
top

Department of Mathematics

Educational Software News

Call for papers

Newest Education Titles


bottom

Designed by Ioannis E. Livieris. | Validate XHTML | CSS