awesome-robot-failure-management

Failure Datasets

Dataset name Year Task(s) Dataset URL Data modalities Real, simulated, or both URL to associated paper (/ if there is no paper)
COFFAIL 2026 Seven skills in the context of coffee preparation https://doi.org/10.5281/zenodo.18212316 RGB images, joint states, end effector poses, applied actions Real /
Robot Localization Failure Prediction Dataset 2025 Localisation https://doi.org/10.15480/882.15836 LiDAR, odometry, localisation estimates, ground-truth poses Simulated /
RoboMIND 2025 A variety of tasks and objects https://huggingface.co/datasets/x-humanoid-robomind/RoboMIND RGB-D data, proprioception, end effector information, language commands Real https://doi.org/10.15607/RSS.2025.XXI.152
REASSEMBLE 2025 Object assembly and disassembly https://researchdata.tuwien.ac.at/records/0ewrv-8cb44 RGB video, event camera video, force/torque measurements, audio, proprioception Real https://doi.org/10.15607/RSS.2025.XXI.059
(Im)PerfectPour 2025 Preparing drinks https://drive.google.com/file/d/1hZkD2TG9LZhJLHb-JB-SZeuHdmBbSbRw/view?usp=sharing RGB video, force/torque measurements, proprioception Real https://doi.org/10.1109/LRA.2024.3520916
Stow Success Prediction 2025 Stowing objects https://www.armbench.com/success_prediction.html RGB images, object features, bin features, stow strategy features, space metrics Real https://doi.org/10.48550/arXiv.2505.04572
RoboNar 2024 Four everyday skills https://huggingface.co/datasets/robonar/robonar RGB-D data, joint states, odometry information, task planner state, diagnostic information, and natural language narration Real https://proceedings.mlr.press/v270/wang25g.html
Handover Failure Detection Dataset 2024 Object handover https://doi.org/10.5281/zenodo.10708762 RGB video, force/torque measurements, gripper state Real https://doi.org/10.1109/ICRA57147.2024.10610143
REFLEX Dataset 2024 Human reactions to robot failures and explanations https://doi.org/10.5281/zenodo.14160783 Anonymised videos, various extracted human features, questionnaire answers, failure descriptions Real https://doi.org/10.1109/HRI61500.2025.10974185
RoboFail 2023 10 different tasks https://www.cs.columbia.edu/~liuzeyi/reflect_data/ RGB-D recordings, robot state data, simulation metadata Simulated https://proceedings.mlr.press/v229/liu23g.html
Bystander Affect Detection (BAD) Dataset 2023 Robot failure prediction based on bystander reactions https://irl.tech.cornell.edu/bad-dataset/ Videos Real https://doi.org/10.1109/IROS55552.2023.10342442
ARMBench Defect Detection 2023 Pick and Place https://www.armbench.com/defects.html RGB Videos/Images Real https://doi.org/10.1109/ICRA48891.2023.10160846
AURSAD 2021 Screwdriving https://doi.org/10.5281/zenodo.4487072 Various (in total 134) extracted robot measurement features Real https://doi.org/10.48550/arXiv.2102.01409
FAILURE 2021 Manipulation http://160.75.159.4/data/failure.zip (alternate: https://huggingface.co/datasets/jesbu1/fino-net-dataset) RGB video, depth, audio Real https://doi.org/10.1109/IROS51168.2021.9636455
A Robot Dataset of Successful and Failed Placement Executions 2021 Object placement https://doi.org/10.5281/zenodo.4578538 RGB-D recordings, rendered robot images, joint measurements, force/torque measurements, camera calibration parameters Real https://doi.org/10.1109/IROS51168.2021.9636133
Robot Handle Grasping Failure Data 2021 Handle grasping https://doi.org/10.5281/zenodo.4603347 RGB image snapshots, handle detections, trajectory data, force/torque measurements Real https://doi.org/10.1109/ICRA48506.2021.9561710
UCI Robot Execution Failures Dataset 1999 Grasping https://doi.org/10.24432/C5M89N Force/torque measurements Real /