TY - GEN
T1 - Unsupervised deep learning for structured shape matching
AU - Roufosse, Jean Michel
AU - Sharma, Abhishek
AU - Ovsjanikov, Maks
N1 - KAUST Repository Item: Exported on 2022-06-30
Acknowledged KAUST grant number(s): CRG-2017-3426
Acknowledgements: Parts of this work were supported by the ERC Starting Grant StG-2017-758800 (EXPROTEA), KAUST OSR Award No. CRG-2017-3426, and a gift from Nvidia. We are grateful to Jing Ren, Or Litany, Emanuele Rodolà and Adrien Poulenard for their help in performing quantitative comparisons and producing qualitative results.
This publication acknowledges KAUST support, but has no KAUST affiliated authors.
PY - 2020/2/27
Y1 - 2020/2/27
N2 - We present a novel method for computing correspondences across 3D shapes using unsupervised learning. Our method computes a non-linear transformation of given descriptor functions, while optimizing for global structural properties of the resulting maps, such as their bijectivity or approximate isometry. To this end, we use the functional maps framework, and build upon the recent FMNet architecture for descriptor learning. Unlike that approach, however, we show that learning can be done in a purely emph{unsupervised setting}, without having access to any ground truth correspondences. This results in a very general shape matching method that we call SURFMNet for Spectral Unsupervised FMNet, and which can be used to establish correspondences within 3D shape collections without any prior information. We demonstrate on a wide range of challenging benchmarks, that our approach leads to state-of-the-art results compared to the existing unsupervised methods and achieves results that are comparable even to the supervised learning techniques. Moreover, our framework is an order of magnitude faster, and does not rely on geodesic distance computation or expensive post-processing.
AB - We present a novel method for computing correspondences across 3D shapes using unsupervised learning. Our method computes a non-linear transformation of given descriptor functions, while optimizing for global structural properties of the resulting maps, such as their bijectivity or approximate isometry. To this end, we use the functional maps framework, and build upon the recent FMNet architecture for descriptor learning. Unlike that approach, however, we show that learning can be done in a purely emph{unsupervised setting}, without having access to any ground truth correspondences. This results in a very general shape matching method that we call SURFMNet for Spectral Unsupervised FMNet, and which can be used to establish correspondences within 3D shape collections without any prior information. We demonstrate on a wide range of challenging benchmarks, that our approach leads to state-of-the-art results compared to the existing unsupervised methods and achieves results that are comparable even to the supervised learning techniques. Moreover, our framework is an order of magnitude faster, and does not rely on geodesic distance computation or expensive post-processing.
UR - http://hdl.handle.net/10754/679484
UR - https://ieeexplore.ieee.org/document/9009544/
UR - http://www.scopus.com/inward/record.url?scp=85081928449&partnerID=8YFLogxK
U2 - 10.1109/ICCV.2019.00170
DO - 10.1109/ICCV.2019.00170
M3 - Conference contribution
SN - 9781728148038
SP - 1617
EP - 1627
BT - 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
PB - IEEE
ER -