TWICE Dataset: Digital Twin of Test Scenarios in a Controlled Environment
Abstract: Ensuring the safe and reliable operation of autonomous vehicles under adverse weather remains a significant challenge. To address this, we have developed a comprehensive dataset composed of sensor data acquired in a real test track and reproduced in the laboratory for the same test scenarios. The provided dataset includes camera, radar, LiDAR, inertial measurement unit (IMU), and GPS data recorded under adverse weather conditions (rainy, night-time, and snowy conditions). We recorded test scenarios using objects of interest such as car, cyclist, truck and pedestrian -- some of which are inspired by EURONCAP (European New Car Assessment Programme). The sensor data generated in the laboratory is acquired by the execution of simulation-based tests in hardware-in-the-loop environment with the digital twin of each real test scenario. The dataset contains more than 2 hours of recording, which totals more than 280GB of data. Therefore, it is a valuable resource for researchers in the field of autonomous vehicles to test and improve their algorithms in adverse weather conditions, as well as explore the simulation-to-reality gap. The dataset is available for download at: https://twicedataset.github.io/site/
- “Perception and Sensing for Autonomous Vehicles Under Adverse Weather Conditions: A Survey”, 2021 DOI: 10.1016/j.isprsjprs.2022.12.021
- EUROPEAN NEW CAR ASSESSMENT PROGRAMME (Euro NCAP) “TEST PROTOCOL-AEB VRU systems” EUROPEAN NEW CAR ASSESSMENT PROGRAMME (Euro NCAP), 2017 URL: https://cdn.euroncap.com/media/26997/euro-ncap-aeb-vru-test-protocol-v20.pdf
- “Vision meets robotics: The KITTI dataset” In International Journal of Robotics Research 32, 2013, pp. 1231–1237 DOI: 10.1177/0278364913491297
- “Scalability in Perception for Autonomous Driving: Waymo Open Dataset”, 2020 arXiv:1912.04838 [cs.CV]
- “nuScenes: A multimodal dataset for autonomous driving”, 2019 URL: http://arxiv.org/abs/1903.11027
- “All-In-One Drive: A Large-Scale Comprehensive Perception Dataset with High-Density Long-Range Point Clouds” In arXiv, 2021
- “Canadian Adverse Driving Conditions Dataset”, 2020 DOI: 10.1177/0278364920979368
- “Robotic Operating System”, 2018 URL: https://www.ros.org
- NVIDIA “DriveWorks SDK Reference: Static Camera Calibration” NVIDIA) URL: https://docs.nvidia.com/drive/driveworks-3.5/dwx_camera_calibration.html
- Joris Domhof, Julian F.P. Kooij and Dariu M. Gavrila “An Extrinsic Calibration Tool for Radar, Camera and Lidar” In 2019 International Conference on Robotics and Automation (ICRA), 2019, pp. 8107–8113 DOI: 10.1109/ICRA.2019.8794186
- International Organization for Standardization “ISO 8855:2011 Road vehicles — Vehicle dynamics and road-holding ability”, 2011
- Fabio Reway, Werner Huber and Eduardo Parente Ribeiro “Test Methodology for Vision-Based ADAS Algorithms with an Automotive Camera-in-the-Loop” In 2018 IEEE International Conference on Vehicular Electronics and Safety (ICVES) IEEE, 2018 DOI: 10.1109/icves.2018.8519598
- Fabio Reway, Werner Huber and Eduardo Parente Ribeiro “Test Methodology for Vision-Based ADAS Algorithms with an Automotive Camera-in-the-Loop” In 2018 IEEE International Conference on Vehicular Electronics and Safety, ICVES 2018 Institute of ElectricalElectronics Engineers Inc., 2018 DOI: 10.1109/ICVES.2018.8519598
- “Simulation-based test methods with an automotive camera-in-the-loop for automated driving algorithms” In 2022 International Conference on Electrical, Computer, Communications and Mechatronics Engineering (ICECCME) IEEE, 2022 DOI: 10.1109/iceccme55909.2022.9988437
- “76-79 GHz Automotive Radar Test System Based on Radar Target Simulator,”” In Smart Energy and Systems, pp. 176–181
- “Highly scalable radar target simulator for autonomous driving test beds” In 2017 European Radar Conference (EURAD) IEEE, 2017 DOI: 10.23919/eurad.2017.8249168
- “Open Simulation Interface” Technische Universität München, 2017 URL: https://www.ee.cit.tum.de/hot/forschung/automotive-veroeffentlichungen
- International Organization for Standardization “ISO 23150:2021 Road vehicles — Data communication between sensors and data fusion unit for automated driving functions — Logical interface”, 2021
- Alexey Bochkovskiy, Chien-Yao Wang and Hong-Yuan Mark Liao “YOLOv4: Optimal Speed and Accuracy of Object Detection” In CoRR abs/2004.10934, 2020 arXiv: https://arxiv.org/abs/2004.10934
- Association for Standardization of Automation and Measuring Systems (ASAM) “OpenLABEL Concept Paper” ASAM) URL: https://www.asam.net/index.php?eID=dumpFile&t=f&f=3876&token=413e8c85031ae64cc35cf42d0768627514868b2f
- EUROPEAN NEW CAR ASSESSMENT PROGRAMME (Euro NCAP) “TEST PROTOCOL-AEB systems” EUROPEAN NEW CAR ASSESSMENT PROGRAMME (Euro NCAP), 2017 URL: https://cdn.euroncap.com/media/26996/euro-ncap-aeb-c2c-test-protocol-v20.pdf
- Association for Standardization of Automation and Measuring Systems (ASAM) “Open Simulation Interface”, 2022 URL: https://www.asam.net/static_downloads/ASAM_OSI_reference-documentation_v3.5.0/index.html
- “Efficient Splitting of Test and Simulation Cases for the Verification of Highly Automated Driving Functions” In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 11093 LNCS Springer Verlag, 2018, pp. 139–153 DOI: 10.1007/978-3-319-99130-6_10
- “A flexible mixed reality test environment to improve simulation-based testing for highly automated driving” In Methodenentwicklung für Aktive Sicherheit und Automatisiertes Fahren, 2016, pp. 192–204
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.