Stanford-ORB

Dataset Information
Introduced
2023
License
Unknown
Homepage

Overview

We introduce Stanford-ORB, a new real-world 3D Object inverse Rendering Benchmark. Recent advances in inverse rendering have enabled a wide range of real-world applications in 3D content generation, moving rapidly from research and commercial use cases to consumer devices. While the results continue to improve, there is no real-world benchmark that can quantitatively assess and compare the performance of various inverse rendering methods. Existing real-world datasets typically only consist of the shape and multi-view images of objects, which are not sufficient for evaluating the quality of material recovery and object relighting. Methods capable of recovering material and lighting often resort to synthetic data for quantitative evaluation, which on the other hand does not guarantee generalization to complex real-world environments. We introduce a new dataset of real-world objects captured under a variety of natural scenes with ground-truth 3D scans, multi-view images, and environment lighting. Using this dataset, we establish the first comprehensive real-world evaluation benchmark for object inverse rendering tasks from in-the-wild scenes, and compare the performance of various existing methods.

Variants: Stanford-ORB

Associated Benchmarks

This dataset is used in 2 benchmarks:

Recent Benchmark Submissions

Task Model Paper Date
Inverse Rendering Neural-PBIR Neural-PBIR Reconstruction of Shape, Material, … 2023-04-26
Surface Normals Estimation Neural-PBIR Neural-PBIR Reconstruction of Shape, Material, … 2023-04-26
Inverse Rendering InvRender NeFII: Inverse Rendering for Reflectance … 2023-03-29
Surface Normals Estimation InvRender NeFII: Inverse Rendering for Reflectance … 2023-03-29
Surface Normals Estimation NVDiffRecMC Shape, Light, and Material Decomposition … 2022-06-07
Inverse Rendering NVDiffRecMC Shape, Light, and Material Decomposition … 2022-06-07
Surface Normals Estimation NVDiffRec Extracting Triangular 3D Models, Materials, … 2021-11-24
Inverse Rendering NVDiffRec Extracting Triangular 3D Models, Materials, … 2021-11-24
Surface Normals Estimation NeRFactor NeRFactor: Neural Factorization of Shape … 2021-06-03
Inverse Rendering NeRFactor NeRFactor: Neural Factorization of Shape … 2021-06-03
Surface Normals Estimation PhySG PhySG: Inverse Rendering with Spherical … 2021-04-01
Inverse Rendering PhySG PhySG: Inverse Rendering with Spherical … 2021-04-01
Surface Normals Estimation NeRD NeRD: Neural Reflectance Decomposition from … 2020-12-07
Inverse Rendering NeRD NeRD: Neural Reflectance Decomposition from … 2020-12-07

Research Papers

Recent papers with results on this dataset: