TY - GEN
T1 - Isospectralization, or how to hear shape, style, and correspondence
AU - Cosmo, Luca
AU - Panine, Mikhail
AU - Rampini, Arianna
AU - Ovsjanikov, Maks
AU - Bronstein, Michael M.
AU - Rodola, Emanuele
N1 - KAUST Repository Item: Exported on 2022-06-24
Acknowledged KAUST grant number(s): OSR-CRG2017-3426
Acknowledgements: The authors wish to thank Alex Bronstein for useful discussions. ER and AR are supported by the ERC Starting Grant No. 802554 (SPECGEO). MB and LC are partially supported by ERC Consolidator Grant No. 724228 (LEMAN) and Google Research Faculty awards. MB is also partially supported by the Royal Society Wolfson Research Merit award and Rudolf Diesel industrial fellowship at TU Munich. Parts of this work were supported by a Google Focused Research Award, KAUST OSR Award No. OSR-CRG2017-3426, a gift from the NVIDIA Corporation and the ERC Starting Grant No. 758800 (EXPROTEA).
This publication acknowledges KAUST support, but has no KAUST affiliated authors.
PY - 2020/1/9
Y1 - 2020/1/9
N2 - The question whether one can recover the shape of a geometric object from its Laplacian spectrum ('hear the shape of the drum') is a classical problem in spectral geometry with a broad range of implications and applications. While theoretically the answer to this question is negative (there exist examples of iso-spectral but non-isometric manifolds), little is known about the practical possibility of using the spectrum for shape reconstruction and optimization. In this paper, we introduce a numerical procedure called isospectralization, consisting of deforming one shape to make its Laplacian spectrum match that of another. We implement the isospectralization procedure using modern differentiable programming techniques and exemplify its applications in some of the classical and notoriously hard problems in geometry processing, computer vision, and graphics such as shape reconstruction, pose and style transfer, and dense deformable correspondence.
AB - The question whether one can recover the shape of a geometric object from its Laplacian spectrum ('hear the shape of the drum') is a classical problem in spectral geometry with a broad range of implications and applications. While theoretically the answer to this question is negative (there exist examples of iso-spectral but non-isometric manifolds), little is known about the practical possibility of using the spectrum for shape reconstruction and optimization. In this paper, we introduce a numerical procedure called isospectralization, consisting of deforming one shape to make its Laplacian spectrum match that of another. We implement the isospectralization procedure using modern differentiable programming techniques and exemplify its applications in some of the classical and notoriously hard problems in geometry processing, computer vision, and graphics such as shape reconstruction, pose and style transfer, and dense deformable correspondence.
UR - http://hdl.handle.net/10754/679310
UR - https://ieeexplore.ieee.org/document/8953632/
UR - http://www.scopus.com/inward/record.url?scp=85073188550&partnerID=8YFLogxK
U2 - 10.1109/CVPR.2019.00771
DO - 10.1109/CVPR.2019.00771
M3 - Conference contribution
SN - 9781728132938
SP - 7521
EP - 7530
BT - 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
PB - IEEE
ER -