Backpropagator's Review

Copyright 1996-2000 by Donald R. Tveter, http://www.dontveter.com, commercial use is prohibited. Short quotations are permitted provided proper attribution is given.

Up to Backpropagator's Review

Basics

Last Change to This File: January 20, 2000

For people who need a really basic treatment of backprop including a simple numerical example and deriving the formulas I've put together the following:

There is a short online article by G. Thimm, P. Moerland and E. Fiesler that relates the gain to the learning rate and the size of the initial weights.

Backprop training can be quite complicated and to do it properly see the online article by Lutz Prechelt.

Lutz Prechelt has established a page on benchmarking algorithms at the University of Karlsruhe, Germany.

More background can be found in two online articles by Warren Sarle.

For an overview of some of the more well known variations on backprop see the article by Jondarr Gibb.

If you have any questions or comments, write me.

To Don's Home Page