Quick search Find article
Quick search
Find article

The statistical mechanics of constructive algorithms

Ansgar H L West-+,++ and David Saad-+

Show affiliations


The storage capacity of multilayer networks with overlapping receptive fields is studied for constructive algorithms using Boolean perceptrons as their basic building block which have been investigated within a replica framework. The assumption of weak coupling between subsequently constructed perceptrons is verified within a replica symmetric (RS) ansatz and shown to be negligible in most cases in comparison with correction due to replica symmetry breaking (RSB) in individual perceptrons. The capacities of a tiling-like and variants of the upstart algorithm are then calculated within RS and one-step RSB with the quenched average taken over the individual units separately for networks with up to K = 4000 and K = 600 units respectively. Within this treatment, the storage capacity seems to exhibit a power-law behaviour in with an exponent n that may depend on the algorithm and the stability. However, due to finite size effects in K reliable estimates of n could not be extracted. Nevertheless, the results strongly indicate that n should be strictly smaller than 1 within one-step RSB, whereas within RS the Mitchison-Durbin bound is violated for finite K and n>1 may hold asymptotically.


PACS

07.05.Mh Neural networks, fuzzy logic, artificial intelligence

02.10.Ab Logic and set theory

MSC

82C32 Neural nets (See also 68T05, 91E40, 92B20)

03G05 Boolean algebras (See also 06Exx)

Subjects

Mathematical physics

Instrumentation and measurement

Dates

Issue 45 (13 November 1998)

Received 29 January 1998, in final form 3 August 1998



  1. The statistical mechanics of constructive algorithms

    Ansgar H L West and David Saad 1998 J. Phys. A: Math. Gen. 31 8977

  2. Towards optimization in digital chest radiography using Monte Carlo modelling

    Gustaf Ullman et al 2006 Phys. Med. Biol. 51 2729

  3. Statistical mechanics of hypothesis evaluation

    A D Bruce and D Saad 1994 J. Phys. A: Math. Gen. 27 3355

  4. Sulfur incorporation in high level nuclear waste glass: A S K-edge XAFS investigation

    B Brendebach et al 2009 J. Phys.: Conf. Ser. 190 012186

  5. The generalized Wiener process II: Finite systems

    Adrián A Budini and M O Cáceres 1999 J. Phys. A: Math. Gen. 32 4005

  6. Fine and hyperfine structure of the (37, 35) state of the 4He+pbar atom

    V I Korobov and D Bakalov 2001 J. Phys. B: At. Mol. Opt. Phys. 34 L519

  7. Deposition of fluorocarbon thin films on outer and inner surfaces of stainless steel mini-tubes by pulsed plasma polymerization for stents

    V Nelea et al 2009 J. Phys. D: Appl. Phys. 42 225208

  8. Valence-selective XAFS spectroscopy using EuLγ4 emission

    H Hayashi et al 2009 J. Phys.: Conf. Ser. 190 012050

  9. Square lattice Ising model susceptibility: connection matrices and singular behaviour of χ(3) and χ(4)

    N Zenine et al 2005 J. Phys. A: Math. Gen. 38 9439

  10. Euclidean versus Non-Euclidean Gamma-Ray Bursts

    M. Tavani 1998 ApJ 497 L21

View by subject




Export








Please login to access our web services, or create an account if you don't yet have one.

You must have cookies enabled in your web browser to be able to login.

Username
Password

Forgotten your password? Get a new one here.