TY - GEN
T1 - Operatornet: Recovering 3D shapes from difference operators
AU - Huang, Ruqi
AU - Rakotosaona, Marie Julie
AU - Achlioptas, Panos
AU - Guibas, Leonidas
AU - Ovsjanikov, Maks
N1 - KAUST Repository Item: Exported on 2022-06-30
Acknowledged KAUST grant number(s): CRG-2017-3426
Acknowledgements: Parts of this work were supported by the ERC Starting Grant StG-2017-758800 (EXPRO-TEA), KAUST OSR Award CRG-2017-3426 a gift from the Nvidia Corporation, a Vannevar Bush Faculty Fellowship, NSF grant DMS-1546206, a Google Research award and gifts from Adobe and Autodesk. The authors thank Davide Boscaini and Etienne Corman for their help with baseline comparisons.
This publication acknowledges KAUST support, but has no KAUST affiliated authors.
PY - 2020/2/27
Y1 - 2020/2/27
N2 - This paper proposes a learning-based framework for reconstructing 3D shapes from functional operators, compactly encoded as small-sized matrices. To this end we introduce a novel neural architecture, called OperatorNet, which takes as input a set of linear operators representing a shape and produces its 3D embedding. We demonstrate that this approach significantly outperforms previous purely geometric methods for the same problem. Furthermore, we introduce a novel functional operator, which encodes the extrinsic or pose-dependent shape information, and thus complements purely intrinsic pose-oblivious operators, such as the classical Laplacian. Coupled with this novel operator, our reconstruction network achieves very high reconstruction accuracy, even in the presence of incomplete information about a shape, given a soft or functional map expressed in a reduced basis. Finally, we demonstrate that the multiplicative functional algebra enjoyed by these operators can be used to synthesize entirely new unseen shapes, in the context of shape interpolation and shape analogy applications.
AB - This paper proposes a learning-based framework for reconstructing 3D shapes from functional operators, compactly encoded as small-sized matrices. To this end we introduce a novel neural architecture, called OperatorNet, which takes as input a set of linear operators representing a shape and produces its 3D embedding. We demonstrate that this approach significantly outperforms previous purely geometric methods for the same problem. Furthermore, we introduce a novel functional operator, which encodes the extrinsic or pose-dependent shape information, and thus complements purely intrinsic pose-oblivious operators, such as the classical Laplacian. Coupled with this novel operator, our reconstruction network achieves very high reconstruction accuracy, even in the presence of incomplete information about a shape, given a soft or functional map expressed in a reduced basis. Finally, we demonstrate that the multiplicative functional algebra enjoyed by these operators can be used to synthesize entirely new unseen shapes, in the context of shape interpolation and shape analogy applications.
UR - http://hdl.handle.net/10754/679483
UR - https://ieeexplore.ieee.org/document/9009509/
UR - http://www.scopus.com/inward/record.url?scp=85081895586&partnerID=8YFLogxK
U2 - 10.1109/ICCV.2019.00868
DO - 10.1109/ICCV.2019.00868
M3 - Conference contribution
SN - 9781728148038
SP - 8587
EP - 8596
BT - 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
PB - IEEE
ER -