A Diversified Attention Model for Interpretable Multiple Clusterings

Liangrui Ren, Guoxian Yu, Jun Wang, Lei Liu, Carlotta Domeniconi, Xiangliang Zhang

Research output: Contribution to journalArticlepeer-review


Multiple clusterings can explore the same set of data from different perspectives by discovering different and meaningful clusterings. However, most, if not all, of the existing approaches overwhelmingly focus on the diversity between clustering subspaces, and pay much less attention on the salience of the subspaces. As a consequence, the quality of the produced clusterings is an understudied aspect of the problem. Furthermore, existing methods cannot explain the unique internal subspace structure of each clustering, and cannot incorporate multi-facet knowledge to generate different clusterings. In this paper, we propose a solution named iMClusts (interpretable Multiple Clusterings by diversified attention). iMClusts makes use of the expressive representational power of deep autoencoders and multi-head attention to generate multiple salient embedding matrices, and multiple clusterings therein. In addition, it leverages multi-facet knowledge and enhances the diversity between heads to boost the quality and diversity of multiple clusterings. Experimental results on benchmark datasets show that iMClusts can generate multiple clusterings with quality, interpretability, and diversity.
Original languageEnglish (US)
Pages (from-to)8852-8864
Number of pages13
Issue number9
StatePublished - Sep 1 2023
Externally publishedYes


Dive into the research topics of 'A Diversified Attention Model for Interpretable Multiple Clusterings'. Together they form a unique fingerprint.

Cite this