Quick search Find article
Quick search
Find article

Inference algorithms and learning theory for Bayesian sparse factor analysis

Magnus Rattray1, Oliver Stegle2,3, Kevin Sharp1 and John Winn4

Show affiliations


Bayesian sparse factor analysis has many applications; for example, it has been applied to the problem of inferring a sparse regulatory network from gene expression data. We describe a number of inference algorithms for Bayesian sparse factor analysis using a slab and spike mixture prior. These include well-established Markov chain Monte Carlo (MCMC) and variational Bayes (VB) algorithms as well as a novel hybrid of VB and Expectation Propagation (EP). For the case of a single latent factor we derive a theory for learning performance using the replica method. We compare the MCMC and VB/EP algorithm results with simulated data to the theoretical prediction. The results for MCMC agree closely with the theory as expected. Results for VB/EP are slightly sub-optimal but show that the new algorithm is effective for sparse inference. In large-scale problems MCMC is infeasible due to computational limitations and the VB/EP algorithm then provides a very useful computationally efficient alternative.


PACS

87.80.-y Biophysical techniques (research methods)

02.50.Ga Markov processes

87.14.G- Nucleic acids

87.15.B- Structure of biomolecules

02.70.Uu Applications of Monte Carlo methods

02.70.Rr General statistical methods

Subjects

Computational physics

Instrumentation and measurement

Medical physics

Biological physics

Dates

Issue 1 (2009)



  1. Inference algorithms and learning theory for Bayesian sparse factor analysis

    Magnus Rattray et al 2009 J. Phys.: Conf. Ser. 197 012002

  2. A global (volume averaged) model of a chlorine discharge

    E G Thorsteinsson and J T Gudmundsson 2010 Plasma Sources Sci. Technol. 19 015001

  3. Magnetic properties of glass ceramic wire in Fe3O4-TiO2-SiO2 system

    T Abe et al 2009 J. Phys.: Conf. Ser. 191 012023

  4. Pattern formation during diffusional transformations in the presence of triple junctions and elastic effects

    E A Brener et al 2009 J. Phys.: Condens. Matter 21 464106

  5. Proposed method for searches of gravitational waves from PKS 2155-304 and other blazar flares

    S Desai et al 2008 Class. Quantum Grav. 25 184024

  6. Large-area protein nano-arrays patterned by soft lithography

    A Ruiz et al 2007 Nanotechnology 18 505306

  7. Operator with large spin and spinning D3-brane

    Dongmin Gang et al JHEP11(2009)024

  8. Theoretical and experimental study of high-magnetic-field XMCD spectra at the L2,3 absorption edges of mixed-valence rare-earth compounds

    Akio Kotani et al 2009 J. Phys.: Conf. Ser. 190 012013

  9. Information storage and extraction between atoms and cavities

    Qiu-Bo Fan and Ling Zhou 2009 J. Phys. B: At. Mol. Opt. Phys. 42 145509

  10. Synthesis of a CNT-grafted TiO2 nanocatalyst and its activity triggered by a DC voltage

    Chien-Sheng Kuo et al 2007 Nanotechnology 18 465607

View by subject




Export






Please login to access our web services, or create an account if you don't yet have one.

You must have cookies enabled in your web browser to be able to login.

Username
Password

Forgotten your password? Get a new one here.