Quick search Find article
Quick search
Find article

Statistical trajectory of an approximate EM algorithm for probabilistic image processing

Kazuyuki Tanaka1 and D M Titterington2

Show affiliations


We calculate analytically a statistical average of trajectories of an approximate expectation-maximization (EM) algorithm with generalized belief propagation (GBP) and a Gaussian graphical model for the estimation of hyperparameters from observable data in probabilistic image processing. A statistical average with respect to observed data corresponds to a configuration average for the random-field Ising model in spin glass theory. In the present paper, hyperparameters which correspond to interactions and external fields of spin systems are estimated by an approximate EM algorithm. A practical algorithm is described for gray-level image restoration based on a Gaussian graphical model and GBP. The GBP approach corresponds to the cluster variation method in statistical mechanics. Our main result in the present paper is to obtain the statistical average of the trajectory in the approximate EM algorithm by using loopy belief propagation and GBP with respect to degraded images generated from a probability density function with true values of hyperparameters. The statistical average of the trajectory can be expressed in terms of recursion formulas derived from some analytical calculations.


PACS

42.30.Va Image forming and processing

05.50.+q Lattice theory and statistics (Ising, Potts, etc.)

02.10.Ox Combinatorics; graph theory

75.10.Nr Spin-glass and other random models

05.20.-y Classical statistical mechanics

02.50.Cw Probability theory

MSC

62H35 Image analysis

82D30 Random media, disordered materials (including liquid crystals and spin glasses)

68U10 Image processing

82B20 Lattice systems (Ising, dimer, Potts, etc.) and systems on graphs

62C10 Bayesian problems; characterization of Bayes procedures

Subjects

Mathematical physics

Computational physics

Condensed matter: electrical, magnetic and optical

Optics, quantum optics and lasers

Statistical physics and nonlinear systems

Dates

Issue 37 (14 September 2007)

Received 4 June 2007, in final form 30 July 2007

Published 29 August 2007



  1. Statistical trajectory of an approximate EM algorithm for probabilistic image processing

    Kazuyuki Tanaka and D M Titterington 2007 J. Phys. A: Math. Theor. 40 11285

  2. Statistical-mechanical approach to image processing

    Kazuyuki Tanaka 2002 J. Phys. A: Math. Gen. 35 R81

  3. Accuracy of the Bethe approximation for hyperparameter estimation in probabilistic image processing

    Kazuyuki Tanaka et al 2004 J. Phys. A: Math. Gen. 37 8675

  4. Probabilistic image processing by means of the Bethe approximation for the Q-Ising model

    Kazuyuki Tanaka et al 2003 J. Phys. A: Math. Gen. 36 11023

  5. Experimental measurements of bifurcations, chaos and three cycle behaviour on a neutralized electron beam

    R W Boswell 1985 Plasma Phys. Control. Fusion 27 405

  6. Re'class'ification of 'quant'ified classical simulated annealing

    Toshiyuki Tanaka 2009 J. Phys.: Conf. Ser. 143 012020

  7. Particles, Feynman diagrams and all that

    Michael Daniel 2006 Phys. Educ. 41 119

  8. Analytic quadratic integration over the two-dimensional Brillouin zone

    Frank E Harris 2002 J. Phys.: Condens. Matter 14 621

  9. Atoms in an amplitude-modulated standing wave - dynamics and pathways to quantum chaos

    W K Hensinger et al 2000 J. Opt. B: Quantum Semiclass. Opt. 2 659

  10. Mass properties measurement for drag-free test masses

    John W Conklin et al 2009 J. Phys.: Conf. Ser. 154 012019

Users also read

What's this?
This innovative new feature generates a list of articles 'also read' by other users based on them reading the original article. Article abstracts citations and references are all considered and weighted accordingly. We hope that this will help you find relevant papers for your research.

  1. Hyperparameter estimation in image restoration
  2. An investigation of two-dimensional parameter-induced stochastic resonance and applications in nonlinear image processing
  3. Accuracy of the Bethe approximation for hyperparameter estimation in probabilistic image processing
More

View by subject




Export








Please login to access our web services, or create an account if you don't yet have one.

You must have cookies enabled in your web browser to be able to login.

Username
Password

Forgotten your password? Get a new one here.