PnP-3D: A Plug-and-Play for 3D Point Clouds

  • Shi Qiu*
  • , Saeed Anwar
  • , Nick Barnes
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

33 Scopus citations

Abstract

With the help of the deep learning paradigm, many point cloud networks have been invented for visual analysis. However, there is great potential for development of these networks since the given information of point cloud data has not been fully exploited. To improve the effectiveness of existing networks in analyzing point cloud data, we propose a plug-and-play module, PnP-3D, aiming to refine the fundamental point cloud feature representations by involving more local context and global bilinear response from explicit 3D space and implicit feature space. To thoroughly evaluate our approach, we conduct experiments on three standard point cloud analysis tasks, including classification, semantic segmentation, and object detection, where we select three state-of-the-art networks from each task for evaluation. Serving as a plug-and-play module, PnP-3D can significantly boost the performances of established networks. In addition to achieving state-of-the-art results on four widely used point cloud benchmarks, we present comprehensive ablation studies and visualizations to demonstrate our approach's advantages. The code will be available at https://github.com/ShiQiu0419/pnp-3d.

Original languageEnglish
Pages (from-to)1312-1319
Number of pages8
JournalIEEE Transactions on Pattern Analysis and Machine Intelligence
Volume45
Issue number1
DOIs
StatePublished - 1 Jan 2023
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 1979-2012 IEEE.

Keywords

  • 3D deep learning
  • Point cloud
  • classification
  • detection
  • feature representation
  • plug-and-play
  • segmentation

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Computational Theory and Mathematics
  • Artificial Intelligence
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'PnP-3D: A Plug-and-Play for 3D Point Clouds'. Together they form a unique fingerprint.

Cite this