Quick search Find article
Quick search
Find article

A Newton root-finding algorithm for estimating the regularization parameter for solving ill-conditioned least squares problems

Jodi L Mead1,3 and Rosemary A Renaut2,4

Show affiliations


We discuss the solution of numerically ill-posed overdetermined systems of equations using Tikhonov a priori based regularization. When the noise distribution on the measured data is available to appropriately weight the fidelity term, and the regularization is assumed to be weighted by inverse covariance information on the model parameters, the underlying cost functional becomes a random variable that follows a χ2 distribution. The regularization parameter can then be found so that the optimal cost functional has this property. Under this premise a scalar Newton root-finding algorithm for obtaining the regularization parameter is presented. The algorithm, which uses the singular value decomposition of the system matrix, is found to be very efficient for parameter estimation, requiring on average about 10 Newton steps. Additionally, the theory and algorithm apply for generalized Tikhonov regularization using the generalized singular value decomposition. The performance of the Newton algorithm is contrasted to standard techniques, including the L-curve, generalized cross validation and unbiased predictive risk estimation. This χ2-curve Newton method of parameter estimation is seen to be robust and cost effective in comparison to other methods, when white or colored noise information on the measured data is incorporated.


PACS

05.40.-a Fluctuation phenomena, random processes, noise, and Brownian motion

02.30.Zz Inverse problems

02.60.Gf Algorithms for functional approximation

02.70.Rr General statistical methods

MSC

60G50 Sums of independent random variables; random walks

15A18 Eigenvalues, singular values, and eigenvectors

15A29 Inverse problems

65F20 Overdetermined systems, pseudoinverses

65F22 Ill-posedness, regularization

Subjects

Mathematical physics

Computational physics

Statistical physics and nonlinear systems

Dates

Issue 2 (February 2009)

Received 6 August 2008, in final form 27 October 2008

Published 18 December 2008



  1. A Newton root-finding algorithm for estimating the regularization parameter for solving ill-conditioned least squares problems

    Jodi L Mead and Rosemary A Renaut 2009 Inverse Problems 25 025002

  2. Occam's razor and petascale visual data analysis

    E W Bethel et al 2009 J. Phys.: Conf. Ser. 180 012084

  3. Carbonyl mediated conductance through metal bound peptides: a computational study

    Trilisa M Perrine and Barry D Dunietz 2007 Nanotechnology 18 424003

View by subject




Export








Please login to access our web services, or create an account if you don't yet have one.

You must have cookies enabled in your web browser to be able to login.

Username
Password

Forgotten your password? Get a new one here.