The Shifts Dataset is a dataset for evaluation of uncertainty estimates and robustness to distributional shift. The dataset, which has been collected from industrial sources and services, is composed of three tasks, with each corresponding to a particular data modality: tabular weather prediction, machine translation, and self-driving car (SDC) vehicle motion prediction. All of these data modalities and tasks are affected by real, `in-the-wild' distributional shifts and pose interesting challenges with respect to uncertainty estimation.
Variants: Shifts
This dataset is used in 1 benchmark:
| Task | Model | Paper | Date |
|---|---|---|---|
| Weather Forecasting | SNN Ens U MT Np SpecFE | More layers! End-to-end regression and … | 2021-12-07 |
| Weather Forecasting | CatBoost with RMSEWithUncertainty | Shifts: A Dataset of Real … | 2021-07-15 |
Recent papers with results on this dataset: