SoftPool++: An Encoder–Decoder Network for Point Cloud Completion

• DOI: 10.1007/s11263-022-01588-7
• Publication Date: 2022-03-11T07:03:01Z
• Authors: Yida Wang; David Joseph Tan; Nassir Navab; Federico Tombari
• Keywords: FOS: Computer and information sciences; Computer Science - Artificial Intelligence; Computer Vision and Pattern Recognition (cs.CV); Computer Science - Computer Vision and Pattern Recognition; 02 engineering and technology; ddc:; 03 medical and health sciences; 0302 clinical medicine; Artificial Intelligence (cs.AI); 0202 electrical engineering, electronic engineering, information engineering; Article ; Special Issue on 3D Computer Vision ; Point cloud ; Completion ; SoftPool ; Skip-connection

AbstractWe propose a novel convolutional operator for the task of point cloud completion. One striking characteristic of our approach is that, conversely to related work it does not require any max-pooling or voxelization operation. Instead, the proposed operator used to learn the point cloud embedding in the encoder extracts permutation-invariant features from the point cloud via a soft-pooling of feature activations, which are able to preserve fine-grained geometric details. These features are then passed on to a decoder architecture. Due to the compression in the encoder, a typical limitation of this type of architectures is that they tend to lose parts of the input shape structure. We propose to overcome this limitation by using skip connections specifically devised for point clouds, where links between corresponding layers in the encoder and the decoder are established. As part of these connections, we introduce a transformation matrix that projects the features from the encoder to the decoder and vice-versa. The quantitative and qualitative results on the task of object completion from partial scans on the ShapeNet dataset show that incorporating our approach achieves state-of-the-art performance in shape completion both at low and high resolutions.