Quick search Find article
Quick search
Find article

Derivation of Hebb's rule

M Heerema and W A van Leeuwen

Show affiliations


On the basis of the general form for the energy needed to adapt the connection strengths of a network in which learning takes place, a local learning rule is found for the changes . This biologically realizable learning rule turns out to comply with Hebb's neuro-physiological postulate, but is not of the form of any of the learning rules proposed in the literature.

The learning rule possesses the property that the energy needed in each learning step is minimal, and is, as such, evolutionary attractive. Moreover, the pre- and post-synaptic neurons are found to influence the synaptic changes differently, resulting in an asymmetric connection matrix , a fact which is in agreement with biological observation.

It is shown that if a finite set of the same patterns is presented over and over again to the network, the weights of the synapses converge to finite values.

Furthermore, it is proved that the final values found in this biologically realizable limit are the same as those found via a mathematical approach to the problem of finding the weights of a partially connected neural network that can store a collection of patterns. The mathematical solution is obtained via a modified version of the so-called method of the pseudo-inverse, and has the inverse of a reduced correlation matrix, rather than the usual correlation matrix, as its basic ingredient. Thus, a biological network might realize the final results of the mathematician by the energetically economic rule for the adaption of the synapses found in this article.


PACS

07.05.Mh Neural networks, fuzzy logic, artificial intelligence

02.10.Yn Matrix theory

87.18.Sn Neural networks and synaptic communication

MSC

40C05 Matrix methods

92B20 Neural networks, artificial life and related topics (See also 68T05, 82C32, 94Cxx)

62M45 Neural nets and related approaches

Subjects

Mathematical physics

Instrumentation and measurement

Biological physics

Dates

Issue 2 (15 January 1999)

Received 5 November 1997, in final form 16 September 1998



  1. Derivation of Hebb's rule

    M Heerema and W A van Leeuwen 1999 J. Phys. A: Math. Gen. 32 263

  2. Nano-patterning and single electron tunnelling using STM

    Xiaoming Hu et al 1999 Nanotechnology 10 209

  3. Optical considerations for time-resolved digital PIV measurement in a single bubble flow against heated boundaries

    V S S Chan et al 2004 Meas. Sci. Technol. 15 N39

  4. X-ray detector based on a bulk micromachined photodiode combined with a scintillating crystal

    J G Rocha et al 2003 J. Micromech. Microeng. 13 S45

  5. On the photon Green functions in curved spacetime

    Giuseppe Bimonte et al 2004 Class. Quantum Grav. 21 647

  6. Separability criteria for multipartite quantum mixed states

    Zhou Hui 2005 Chinese Phys. 14 257

  7. Primary standards and dosimetry protocols for brachytherapy sources

    C G Soares et al 2009 Metrologia 46 S80

  8. (100) GaP surface charges, potentials, and stoichiometry; a quantum-chemical study

    E V Stefanovich and A L Shluger 1994 J. Phys.: Condens. Matter 6 4255

  9. Near homoclinic orbits of the focusing nonlinear Schrödinger equation

    Otis C Wright 1999 Nonlinearity 12 1277

  10. A Monte Carlo (MC) based individual calibration method for in vivo x-ray fluorescence analysis (XRF)

    Marie Hansson and Mats Isaksson 2007 Phys. Med. Biol. 52 2009

View by subject




Export








Please login to access our web services, or create an account if you don't yet have one.

You must have cookies enabled in your web browser to be able to login.

Username
Password

Forgotten your password? Get a new one here.