M Heerema and W A van Leeuwen 1999 J. Phys. A: Math. Gen. 32 263 doi:10.1088/0305-4470/32/2/004
M Heerema and W A van Leeuwen
Show affiliationsOn the basis of the general form for the energy needed to adapt the connection strengths
of a network in which learning takes place, a local learning rule is found for the changes
. This biologically realizable learning rule turns out to comply with Hebb's neuro-physiological postulate, but is not of the form of any of the learning rules proposed in the literature.
The learning rule possesses the property that the energy needed in each learning step is minimal, and is, as such, evolutionary attractive. Moreover, the pre- and post-synaptic neurons are found to influence the synaptic changes differently, resulting in an asymmetric connection matrix
, a fact which is in agreement with biological observation.
It is shown that if a finite set of the same patterns is presented over and over again to the network, the weights of the synapses converge to finite values.
Furthermore, it is proved that the final values found in this biologically realizable limit are the same as those found via a mathematical approach to the problem of finding the weights of a partially connected neural network that can store a collection of patterns. The mathematical solution is obtained via a modified version of the so-called method of the pseudo-inverse, and has the inverse of a reduced correlation matrix, rather than the usual correlation matrix, as its basic ingredient. Thus, a biological network might realize the final results of the mathematician by the energetically economic rule for the adaption of the synapses found in this article.
07.05.Mh Neural networks, fuzzy logic, artificial intelligence
92B20 Neural networks, artificial life and related topics (See also 68T05, 82C32, 94Cxx)
Issue 2 (15 January 1999)
Received 5 November 1997, in final form 16 September 1998
M Heerema and W A van Leeuwen 1999 J. Phys. A: Math. Gen. 32 263
Xiaoming Hu et al 1999 Nanotechnology 10 209
V S S Chan et al 2004 Meas. Sci. Technol. 15 N39
J G Rocha et al 2003 J. Micromech. Microeng. 13 S45
Giuseppe Bimonte et al 2004 Class. Quantum Grav. 21 647
Zhou Hui 2005 Chinese Phys. 14 257
C G Soares et al 2009 Metrologia 46 S80
E V Stefanovich and A L Shluger 1994 J. Phys.: Condens. Matter 6 4255
Otis C Wright 1999 Nonlinearity 12 1277
Marie Hansson and Mats Isaksson 2007 Phys. Med. Biol. 52 2009