Regularization in Neural Networks

A modification of the error function to prevent over-fitting of training data by building in a penalty factor for network complexity. Typically, this is done by penalizing large weights, which correspond to networks modeling functions of high curvature. (Bishop, 1995); See STATISTICA Neural Networks.