org.joone.engine.extenders
Class MomentumExtender

java.lang.Object
  org.joone.engine.extenders.LearnerExtender
      org.joone.engine.extenders.DeltaRuleExtender
          org.joone.engine.extenders.MomentumExtender

public class MomentumExtender
extends DeltaRuleExtender

This extender implements the momentum term.

Author:

Boris Jansen

Constructor Summary

MomentumExtender()
Creates a new instance of MomentumExtender

Method Summary

double	getDelta(double[] currentGradientOuts, int j, double aPreviousDelta) Computes the delta value for a bias.
double	getDelta(double[] currentInps, int j, double[] currentPattern, int k, double aPreviousDelta) Computes the delta value for a weight.
void	postBiasUpdate(double[] currentGradientOuts) Gives extenders a change to do some post-computing after the biases are updated.
void	postWeightUpdate(double[] currentPattern, double[] currentInps) Gives extenders a change to do some post-computing after the weights are updated.
void	preBiasUpdate(double[] currentGradientOuts) Gives extenders a change to do some pre-computing before the biases are updated.
void	preWeightUpdate(double[] currentPattern, double[] currentInps) Gives extenders a change to do some pre-computing before the weights are updated.

Methods inherited from class org.joone.engine.extenders.LearnerExtender

getLearner, isEnabled, setEnabled, setLearner

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MomentumExtender

public MomentumExtender()

Creates a new instance of MomentumExtender

Method Detail

getDelta

public double getDelta(double[] currentGradientOuts,
                       int j,
                       double aPreviousDelta)

Description copied from class: DeltaRuleExtender

Computes the delta value for a bias.

Specified by:

getDelta in class DeltaRuleExtender

Parameters:

currentGradientOuts - the back propagated gradients.

j - the index of the bias.

aPreviousDelta - a delta value calculated by a previous delta extender.

getDelta

public double getDelta(double[] currentInps,
                       int j,
                       double[] currentPattern,
                       int k,
                       double aPreviousDelta)

Description copied from class: DeltaRuleExtender

Computes the delta value for a weight.

Specified by:

getDelta in class DeltaRuleExtender

Parameters:

currentInps - the forwarded input.

j - the input index of the weight.

currentPattern - the back propagated gradients.

k - the output index of the weight.

aPreviousDelta - a delta value calculated by a previous delta extender.

postBiasUpdate

public void postBiasUpdate(double[] currentGradientOuts)

Description copied from class: LearnerExtender

Gives extenders a change to do some post-computing after the biases are updated.

Specified by:

postBiasUpdate in class LearnerExtender

Parameters:

currentGradientOuts - the back propagated gradients.

postWeightUpdate

public void postWeightUpdate(double[] currentPattern,
                             double[] currentInps)

Description copied from class: LearnerExtender

Gives extenders a change to do some post-computing after the weights are updated.

Specified by:

postWeightUpdate in class LearnerExtender

Parameters:

currentPattern - the back propagated gradients.

currentInps - the forwarded input.

preBiasUpdate

public void preBiasUpdate(double[] currentGradientOuts)

Description copied from class: LearnerExtender

Gives extenders a change to do some pre-computing before the biases are updated.

Specified by:

preBiasUpdate in class LearnerExtender

Parameters:

currentGradientOuts - the back propagated gradients.

preWeightUpdate

public void preWeightUpdate(double[] currentPattern,
                            double[] currentInps)

Description copied from class: LearnerExtender

Gives extenders a change to do some pre-computing before the weights are updated.

Specified by:

preWeightUpdate in class LearnerExtender

Parameters:

currentPattern - the back propagated gradients.

currentInps - the forwarded input.