Professional Basis of AI Backprop

Latest Windows 95/98/NT/2000/XP version: March 5, 2008
Latest Unix and Linux Tcl/Tk version: May 13, 2010
Latest Non-GUI DOS/Unix/Linux version: April 29, 2000


My student version of backprop is adequate for students in an AI course and for other people beginning to experiment with backprop however for users with more serious needs or who need to do a lot of backprop experiments the Professional version of the software has many more features than the student version. The price for regular users is $30/copy and $200/copy (see note farther on) for businesses and government agencies. The documentation consists of a collection of HTML files. My textbook, The Pattern Recognition Basis of Artificial Intelligence contains a lot about backprop applied to Artificial Intelligence type problems (less practical ones). It was originally published by IEEE Computer Society Press which was then bought by Wiley. My Backpropagator's Review page also has useful information on using backprop effectively.

All the versions allow you to save a network and then read that network into a program that you write yourself. To make it work you have to include a file forward.h and compile the routines in a file forward.cpp. For business users, if you incorporate this software into a program of your own and sell more than 100 copies using this software then for every copy over 100 there is a charge of US$1/copy sold. Write me for details or to negotiate terms.

Some of the Additions to the Professional Version

  • You can now use your own program to call the non-GUI backprop routines.
  • A variation on the SARPROP algorithm has been included, it can increase the chances of convergence and give better test set results.
  • You can now save parameters and weights with one command.
  • Super Self-Adjusting Backpropagation (SuperSAB)
  • Resilient Backprop (Rprop)
  • Linear scaling and log scaling of input and output values
  • The ability to incorporate a trained network within a C program
  • The ability to prune weights and nodes
  • The ability to make new networks without re-reading the patterns
  • The ability to handle variable size hidden layer recurrent networks without recoding and re-reading the patterns
  • The ability to loop through files containing a set of commands
  • More control over output formats
  • Dynamic Node Creation
  • A Confusion Matrix for Classification Problems
  • Averaging output units from many networks to possibly improve generalization.
  • Averaging output units from many patterns in a series to improve the classification performance of a recurrent network.

Windows 95/98/NT/2000/XP Version
See a Screen Image
To the Free Version
Browse the HTML Manual
Download the HTML Manual

The March 2008 binary has been compiled with Open Watcom 1.7a for 32-bit systems. Open Watcom is a FREE C++ compiler for DOS and Windows. Source is available upon request.

The Unix and Linux Tcl/Tk Version
See a Screen Image
To the Free Version
Browse the HTML Manual
Download the HTML Manual

This Unix/Linux version requires the use of the free Tcl/Tk 8.4 scripting language. Tcl/Tk is used to create the graphical user interface. This has been tested under Ubuntu 9.04 with gcc 4.3.3.

This version has extra code not yet put into the W95/W98/NT/XP version that implements a technique called bagging. So far I am in no hurry to add it to the Microsoftian versions because I have yet to find a problem where it improves results.

The Unix/DOS non-GUI Version
See a Screen Image
Browse the HTML Manual
Download the HTML Manual

This version uses the same source code as the Unix and Linux Tcl/Tk program but by changing the makefile parameters it can run without a GUI type interface. This means you can either type in commands in the style of the old non-GUI Unix/DOS program or incorporate the code into a program of your own design. No menus are available except the '?' command produces a listing of the current parameter values thus you need to understand the typed commands in order to use the program. Program commands can also be taken from a file or you can write your own Unix or DOS program to call up backprop functions. For example to have you C++ program run 100 iterations of backprop, printing resuts every 10 iterations use:

command("r 100 10",0);

Online help is currently available only in the Unix version by calling lynx, no online help is currently available in the DOS version. A 32-bit DOS binary is included compiled with Watcom 10.6.

Upgrade Policy
You are entitled to free upgrades if they occur but you do have to ask for them, I don't send them out automatically.

NOTICE: this is use at your own risk software. There is no guarantee that it is bug-free. Use of this software constitutes acceptance for use in an as is condition. There are no warranties with regard to this software. In no event shall the author be liable for any damages whatsoever arising out of or in connection with the use or performance of this software.

This version is copyrighted material and you must treat this software just like a book with the following single exception. You can make copies of the software for the sole purpose of backing-up your software and protecting your investment from loss. By saying "just like a book" it means that this software may be used by any number of people and may be freely moved from one computer location to another so long as there is NO POSSIBILITY of it being used at one location while it is being used at another.

Ordering Information
You can order using PayPal using the email option, you need to send me your email address, the price and if you're in Illinois then the Illinois tax applies.

Quantity discounts can be negotiated.

Illinois residents must add sales tax, so you need to send me a check or money order for $32.62 or $217.50.

In the rest of the US you need to send me a check or money order for $30 or $200.

Outside the US you need to get an international money order for US$30 or US$200. International money orders can be obtained from banks and post offices. This may cost another US$5-US$10. Electronic funds transfer is also possible but it may take up to 2 weeks.

I normally send out the files via email unless you want a copy sent by floppy. When you order send me an email note and I will send you a thank you note just to make sure I can reach you via email. If you want a floppy copy let me know, there is no extra charge.

Send your check or money order to:

Dr. Donald R. Tveter
5228 N. Nashville Ave.
Chicago, IL 60656-2233

If you have any questions or comments, write me.

To Don's Home Page