STPLS3D

Dataset Information
Modalities
Images, 3D, Point cloud
Introduced
2022
License
Unknown
Homepage

Overview

Our project (STPLS3D) aims to provide a large-scale aerial photogrammetry dataset with synthetic and real annotated 3D point clouds for semantic and instance segmentation tasks.

Although various 3D datasets with different functions and scales have been proposed recently, it remains challenging for individuals to complete the whole pipeline of large-scale data collection, sanitization, and annotation (e.g., semantic and instance labels). Moreover, the created datasets usually suffer from extremely imbalanced class distribution or partial low-quality data samples. Motivated by this, we explore the procedurally synthetic 3D data generation paradigm to equip individuals with the full capability of creating large-scale annotated photogrammetry point clouds. Specifically, we introduce a synthetic aerial photogrammetry point clouds generation pipeline that takes full advantage of open geospatial data sources and off-the-shelf commercial packages. Unlike generating synthetic data in virtual games, where the simulated data usually have limited gaming environments created by artists, the proposed pipeline simulates the reconstruction process of the real environment by following the same UAV flight pattern on a wide variety of synthetic terrain shapes and building densities, which ensure similar quality, noise pattern, and diversity with real data. In addition, the precise semantic and instance annotations can be generated fully automatically, avoiding the expensive and time-consuming manual annotation process. Based on the proposed pipeline, we present a richly-annotated synthetic 3D aerial photogrammetry point cloud dataset, termed STPLS3D, with more than 16 km^2 of landscapes and up to 18 fine-grained semantic categories. For verification purposes, we also provide a parallel dataset collected from four areas in the real environment.

Source: https://github.com/meidachen/STPLS3D
Image source: https://github.com/meidachen/STPLS3D/blob/main/imgs/STPLS3D.png

Variants: STPLS3D

Associated Benchmarks

This dataset is used in 3 benchmarks:

Recent Benchmark Submissions

Task Model Paper Date
3D Instance Segmentation Spherical Mask Spherical Mask: Coarse-to-Fine 3D Point … 2023-12-18
3D Open-Vocabulary Instance Segmentation OPENINS3D OpenIns3D: Snap and Lookup for … 2023-09-01
3D Instance Segmentation ISBNet ISBNet: a 3D Point Cloud … 2023-03-01
3D Instance Segmentation TD3D Top-Down Beats Bottom-Up in 3D … 2023-02-06
3D Open-Vocabulary Instance Segmentation PointCLIPV2 PointCLIP V2: Prompting CLIP and … 2022-11-21
3D Instance Segmentation Mask3D Mask3D: Mask Transformer for 3D … 2022-10-06
3D Instance Segmentation SoftGroup++ Scalable SoftGroup for 3D Instance … 2022-09-17
3D Instance Segmentation SoftGroup SoftGroup for 3D Instance Segmentation … 2022-03-03
3D Open-Vocabulary Instance Segmentation PointCLIP PointCLIP: Point Cloud Understanding by … 2021-12-04
3D Instance Segmentation HAIS Hierarchical Aggregation for 3D Instance … 2021-08-05
3D Semantic Segmentation Point transformer Point Transformer 2020-12-16
3D Instance Segmentation PointGroup PointGroup: Dual-Set Point Grouping for … 2020-04-03
3D Semantic Segmentation MinkowskiNet 4D Spatio-Temporal ConvNets: Minkowski Convolutional … 2019-04-18
3D Semantic Segmentation KpConv KPConv: Flexible and Deformable Convolution … 2019-04-18
3D Semantic Segmentation PointNet++ PointNet++: Deep Hierarchical Feature Learning … 2017-06-07

Research Papers

Recent papers with results on this dataset: