A Local Learning Algorithm for Dynamic Feedforward and Recurrent Networks

Research output: Contribution to journalArticlepeer-review

56 Scopus citations

Abstract

Most known learning algorithms for dynamic neural networks in non-stationary environments need global computations to perform credit assignment. These algon'thms either are not local in time or nor local in space. Those algorithms which are local in both time and space usually cannot deal sensibly with ‘hidden units’. In contrast, as far as we can judge, learning rules in biological systems with many 'hidden units' are local in both space and time. In this paper we propose a parallel on-line learning algorithms which performs local computations only, yet still is designed to deal with hidden units and with units whose past activations are ‘hidden in time’. The approach is inspired by Holland's idea of the bucket brigade for classifier systems, which is transformed to run on a neural network with fixed topology. The result is a feedforward or recurrent ‘neural’ dissipative system which is consuming ‘weight-substance’ and permanently trying to dism'bute this substance onto its connections in an appropriate way. Simple experiments demonstrating the feasibility of the algorithm are reported. © 1989, Taylor & Francis Group, LLC. All rights reserved.
Original languageEnglish (US)
Pages (from-to)403-412
Number of pages10
JournalConnection Science
Volume1
Issue number4
DOIs
StatePublished - Jan 1 1989
Externally publishedYes

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computational Theory and Mathematics
  • Theoretical Computer Science
  • Control and Systems Engineering

Fingerprint

Dive into the research topics of 'A Local Learning Algorithm for Dynamic Feedforward and Recurrent Networks'. Together they form a unique fingerprint.

Cite this