a set of C++ library classes
for neural networks development



class MomentumDescent

Gradient descent with momentum - HTML documentaiton under construction.

Inheritance:


Public Methods

[more] MomentumDescent (unsigned n_output, unsigned n_input, double x, double y=DEFAULT_ALPHA )
[more] MomentumDescent (unsigned n_output, unsigned n_hidden, unsigned n_input, double x, double y=DEFAULT_ALPHA)
[more] MomentumDescent (unsigned n_output, unsigned n_hidden1, unsigned n_hidden2, unsigned n_input, double x, double y=DEFAULT_ALPHA)
[more]virtual ~MomentumDescent ()
[more]void Update_weigths (unsigned n_layers, LayerNetTrain layer[] )

Protected Fields

[more]double alpha
[more]matrix* Delta_W_total [MAXLAYERS]
[more]vect* delta_bias_total [MAXLAYERS]

Protected Methods

[more]void Zero_Delta_W_total (unsigned n_layers)


Inherited from GradientDescent:

Public Methods

ovoid Update_delta_weights(unsigned n_layers, LayerNetTrain layer[] )
ovoid Update_param(double err, unsigned iter)

Protected Methods

ovoid Zero_Delta_W(unsigned n_layers, LayerNetTrain layer[])


Inherited from Learning:

Public Methods

ovoid Init_rate(double val=DEFAULT_ETA)
odouble Read_rate(void)

Protected Fields

ostatic const double DEFAULT_ETA
ostatic const double DEFAULT_DECR_FACTOR
ostatic const double MIN_ETA
ostatic const double DEFAULT_DECR_LIN_FACTOR
ostatic const double DEFAULT_ALPHA
ostatic const double DEFAULT_ETA_INCR
ostatic const double DEFAULT_ETA_DECR
odouble eta


Documentation

Gradient descent learning class with momentum
It updates weights through gradient descent with momentum term
odouble alpha

omatrix* Delta_W_total[MAXLAYERS]

ovect* delta_bias_total[MAXLAYERS]

ovoid Zero_Delta_W_total(unsigned n_layers)

o MomentumDescent(unsigned n_output, unsigned n_input, double x, double y=DEFAULT_ALPHA )

o MomentumDescent(unsigned n_output, unsigned n_hidden, unsigned n_input, double x, double y=DEFAULT_ALPHA)

o MomentumDescent(unsigned n_output, unsigned n_hidden1, unsigned n_hidden2, unsigned n_input, double x, double y=DEFAULT_ALPHA)

ovirtual ~MomentumDescent()

ovoid Update_weigths(unsigned n_layers, LayerNetTrain layer[] )


Direct child classes:
MomentumDescentDecrEtaLin
MomentumDescentDecrEtaExp
BoldMomentum

Alphabetic index HTML hierarchy of classes or Java


Last Updated February 2001
For comments and suggestions mail to Giorgio Valentini