Unsupervised coding with lococode

Sepp Hochreiter, Jürgen Schmidhuber

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations


Traditional approaches to sensory coding use code component-oriented objective functions (COCOFs) to evaluate code quality. Previous COCOFs do not take into account the information-theoretic complexity of the code-generating mapping itself. We do: “Low-complexity coding and decoding” (Lococode) generates so-called lococodes that (1) convey information about the input data, (2) can be computed from the data by a low-complexity mapping (LCM), and (3) can be decoded by a lcm. We implement lococode by training autoassociators with Flat Minimum Search (FMS), a general method for finding low-complexity neural nets. lococode extracts optimal codes for difficult versions of the "bars" benchmark problem. As a preprocessor for a vowel recognition benchmark problem it sets the stage for excellent classification performance.
Original languageEnglish (US)
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
PublisherSpringer Verlag
Number of pages6
ISBN (Print)3540636315
StatePublished - Jan 1 1997
Externally publishedYes


Dive into the research topics of 'Unsupervised coding with lococode'. Together they form a unique fingerprint.

Cite this