Self-Supervised Learning of Local Features in 3D Point Clouds

Ali Kassem Thabet, Humam Alwassel, Bernard Ghanem

Research output: Chapter in Book/Report/Conference proceedingConference contribution

26 Scopus citations

Abstract

We present a self-supervised task on point clouds, in order to learn meaningful point-wise features that encode local structure around each point. Our self-supervised network, operates directly on unstructured/unordered point clouds. Using a multi-layer RNN, our architecture predicts the next point in a point sequence created by a popular and fast Space Filling Curve, the Morton-order curve. The final RNN state (coined Morton feature) is versatile and can be used in generic 3D tasks on point clouds. Our experiments show how our self-supervised task results in features that are useful for 3D segmentation tasks, and generalize well between datasets. We show how Morton features can be used to significantly improve performance (+3% for 2 popular algorithms) in semantic segmentation of point clouds on the challenging and large-scale S3DIS dataset. We also show how our self-supervised network pretrained on S3DIS transfers well to another large-scale dataset, vKITTI, leading to 11% improvement. Our code is publicly available.1
Original languageEnglish (US)
Title of host publication2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)
PublisherIEEE
ISBN (Print)978-1-7281-9361-8
DOIs
StatePublished - 2020

Fingerprint

Dive into the research topics of 'Self-Supervised Learning of Local Features in 3D Point Clouds'. Together they form a unique fingerprint.

Cite this