Sequence labelling in structured domains with hierarchical recurrent neural networks

Santiago Fernández, Alex Graves, Jürgen Schmidhuber

Research output: Chapter in Book/Report/Conference proceedingConference contribution

74 Scopus citations


Modelling data in structured domains requires establishing the relations among patterns at multiple scales. When these patterns arise from sequential data, the multiscale structure also contains a dynamic component that must be modelled, particularly, as is often the case, if the data is unsegmented. Probabilistic graphical models are the predominant framework for labelling unsegmented sequential data in structured domains. Their use requires a certain degree of a priori knowledge about the relations among patterns and about the patterns themselves. This paper presents a hierarchical system, based on the connectionist temporal classification algorithm, for labelling unsegmented sequential data at multiple scales with recurrent neural networks only. Experiments on the recognition of sequences of spoken digits show that the system outperforms hidden Markov models, while making fewer assumptions about the domain.
Original languageEnglish (US)
Title of host publicationIJCAI International Joint Conference on Artificial Intelligence
Number of pages6
StatePublished - Dec 1 2007
Externally publishedYes


Dive into the research topics of 'Sequence labelling in structured domains with hierarchical recurrent neural networks'. Together they form a unique fingerprint.

Cite this