OpenTrain AI
Maintained implementation availablenonePretrained Models Available

Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Coming

Claudio Michaelis, Benjamin Mitzkus, Robert Geirhos, Evgenia Rusak, Oliver Bringmann +3 more

July 17, 2019arXiv: 1907.07484
4 repos470 stars~a few hours to reproduce
arXiv PDF

Abstract

The ability to detect objects regardless of image distortions or weather conditions is crucial for real-world applications of deep learning like autonomous driving. We here provide an easy-to-use benchmark to assess how object detection models perform when image quality degrades. The three resulting benchmark datasets, termed Pascal-C, Coco-C and Cityscapes-C, contain a large variety of image corruptions. We show tha...

Results & Benchmarks

TaskDatasetMetricValue
Autonomous drivingCOCOAP50
Autonomous drivingPASCAL VOCAP50

Best Implementation

bethgelab/imagecorruptions

Python package to corrupt arbitrary images.

470 74 May 2025 Apache-2.0
License ✓
CI –
Deps ✓
Docker –
  • Selected bethgelab/imagecorruptions as the strongest maintained implementation for new work.
  • Includes dependency/environment manifest signals.
  • Repository activity is within the last 24 months.
  • Official repository is preserved separately as historical context.

Reproduction Path

  1. 1

    Start with bethgelab/imagecorruptions and validate setup instructions in README.

  2. 2

    Reproduce the baseline result with the provided defaults before modifying hyperparameters.

  3. 3

    Log exact dependency versions and runtime environment for reproducibility.

Time to first repro: a few hoursNo CI workflows detected

Additional Implementations

Official

  • bethgelab/robust-detection-benchmarkConfidence: low

    Code, data and benchmark from the paper "Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Coming" (NeurIPS 2019 ML4AD)

    Stars: 193Forks: 24Last push: Jul 2019License: MIT
  • bethgelab/mmdetectionConfidence: low

    Fork of the MMDetection Toolbox containing the Robustness Benchmark from the paper "Benchmarking Robustness in Object Detection: Autonomous Driving when Winter is Coming" (merged)

    Stars: 6Forks: 5Last push: Aug 2019License: Apache-2.0

Community

No additional community repositories detected yet.

Hugging Face Artifacts

No direct paper-linked artifacts were found. Showing strongest curated related artifacts.

Curated Related

Research Context