| COFFAIL |
2026 |
Seven skills in the context of coffee preparation |
https://doi.org/10.5281/zenodo.18212316 |
RGB images, joint states, end effector poses, applied actions |
Real |
/ |
| Robot Localization Failure Prediction Dataset |
2025 |
Localisation |
https://doi.org/10.15480/882.15836 |
LiDAR, odometry, localisation estimates, ground-truth poses |
Simulated |
/ |
| RoboMIND |
2025 |
A variety of tasks and objects |
https://huggingface.co/datasets/x-humanoid-robomind/RoboMIND |
RGB-D data, proprioception, end effector information, language commands |
Real |
https://doi.org/10.15607/RSS.2025.XXI.152 |
| REASSEMBLE |
2025 |
Object assembly and disassembly |
https://researchdata.tuwien.ac.at/records/0ewrv-8cb44 |
RGB video, event camera video, force/torque measurements, audio, proprioception |
Real |
https://doi.org/10.15607/RSS.2025.XXI.059 |
| (Im)PerfectPour |
2025 |
Preparing drinks |
https://drive.google.com/file/d/1hZkD2TG9LZhJLHb-JB-SZeuHdmBbSbRw/view?usp=sharing |
RGB video, force/torque measurements, proprioception |
Real |
https://doi.org/10.1109/LRA.2024.3520916 |
| Stow Success Prediction |
2025 |
Stowing objects |
https://www.armbench.com/success_prediction.html |
RGB images, object features, bin features, stow strategy features, space metrics |
Real |
https://doi.org/10.48550/arXiv.2505.04572 |
| RoboNar |
2024 |
Four everyday skills |
https://huggingface.co/datasets/robonar/robonar |
RGB-D data, joint states, odometry information, task planner state, diagnostic information, and natural language narration |
Real |
https://proceedings.mlr.press/v270/wang25g.html |
| Handover Failure Detection Dataset |
2024 |
Object handover |
https://doi.org/10.5281/zenodo.10708762 |
RGB video, force/torque measurements, gripper state |
Real |
https://doi.org/10.1109/ICRA57147.2024.10610143 |
| REFLEX Dataset |
2024 |
Human reactions to robot failures and explanations |
https://doi.org/10.5281/zenodo.14160783 |
Anonymised videos, various extracted human features, questionnaire answers, failure descriptions |
Real |
https://doi.org/10.1109/HRI61500.2025.10974185 |
| RoboFail |
2023 |
10 different tasks |
https://www.cs.columbia.edu/~liuzeyi/reflect_data/ |
RGB-D recordings, robot state data, simulation metadata |
Simulated |
https://proceedings.mlr.press/v229/liu23g.html |
| Bystander Affect Detection (BAD) Dataset |
2023 |
Robot failure prediction based on bystander reactions |
https://irl.tech.cornell.edu/bad-dataset/ |
Videos |
Real |
https://doi.org/10.1109/IROS55552.2023.10342442 |
| ARMBench Defect Detection |
2023 |
Pick and Place |
https://www.armbench.com/defects.html |
RGB Videos/Images |
Real |
https://doi.org/10.1109/ICRA48891.2023.10160846 |
| AURSAD |
2021 |
Screwdriving |
https://doi.org/10.5281/zenodo.4487072 |
Various (in total 134) extracted robot measurement features |
Real |
https://doi.org/10.48550/arXiv.2102.01409 |
| FAILURE |
2021 |
Manipulation |
http://160.75.159.4/data/failure.zip (alternate: https://huggingface.co/datasets/jesbu1/fino-net-dataset) |
RGB video, depth, audio |
Real |
https://doi.org/10.1109/IROS51168.2021.9636455 |
| A Robot Dataset of Successful and Failed Placement Executions |
2021 |
Object placement |
https://doi.org/10.5281/zenodo.4578538 |
RGB-D recordings, rendered robot images, joint measurements, force/torque measurements, camera calibration parameters |
Real |
https://doi.org/10.1109/IROS51168.2021.9636133 |
| Robot Handle Grasping Failure Data |
2021 |
Handle grasping |
https://doi.org/10.5281/zenodo.4603347 |
RGB image snapshots, handle detections, trajectory data, force/torque measurements |
Real |
https://doi.org/10.1109/ICRA48506.2021.9561710 |
| UCI Robot Execution Failures Dataset |
1999 |
Grasping |
https://doi.org/10.24432/C5M89N |
Force/torque measurements |
Real |
/ |