Ansgar H L West and David Saad 1998 J. Phys. A: Math. Gen. 31 8977 doi:10.1088/0305-4470/31/45/002
Ansgar H L West
,
and David Saad![]()
The storage capacity of multilayer networks with overlapping receptive fields is studied for constructive algorithms using Boolean perceptrons as their basic building block which have been investigated within a replica framework. The assumption of weak coupling between subsequently constructed perceptrons is verified within a replica symmetric (RS) ansatz and shown to be negligible in most cases in comparison with correction due to replica symmetry breaking (RSB) in individual perceptrons. The capacities of a tiling-like and variants of the upstart algorithm are then calculated within RS and one-step RSB with the quenched average taken over the individual units separately for networks with up to K = 4000 and K = 600 units respectively. Within this treatment, the storage capacity
seems to exhibit a power-law behaviour in
with an exponent n that may depend on the algorithm and the stability. However, due to finite size effects in K reliable estimates of n could not be extracted. Nevertheless, the results strongly indicate that n should be strictly smaller than 1 within one-step RSB, whereas within RS the Mitchison-Durbin bound is violated for finite K and n>1 may hold asymptotically.
07.05.Mh Neural networks, fuzzy logic, artificial intelligence
Issue 45 (13 November 1998)
Received 29 January 1998, in final form 3 August 1998
Ansgar H L West and David Saad 1998 J. Phys. A: Math. Gen. 31 8977
Gustaf Ullman et al 2006 Phys. Med. Biol. 51 2729
A D Bruce and D Saad 1994 J. Phys. A: Math. Gen. 27 3355
B Brendebach et al 2009 J. Phys.: Conf. Ser. 190 012186
Adrián A Budini and M O Cáceres 1999 J. Phys. A: Math. Gen. 32 4005
atom
V I Korobov and D Bakalov 2001 J. Phys. B: At. Mol. Opt. Phys. 34 L519
V Nelea et al 2009 J. Phys. D: Appl. Phys. 42 225208
H Hayashi et al 2009 J. Phys.: Conf. Ser. 190 012050
N Zenine et al 2005 J. Phys. A: Math. Gen. 38 9439
M. Tavani 1998 ApJ 497 L21