What is Multimodal-Wireless?
Multimodel-Wireless is a large-scale open-source dataset for multimodal sensing and communication research. It is generated through an integrated and customizable data pipeline built upon the CARLA simulator and Sionna framework, and features high-resolution communication channel state information (CSI) fully synchronized with five other sensor modalities, namely LiDAR, RGB and depth camera, inertial measurement unit (IMU) and radar, all sampled at 100 Hz.
- ✦ 161,400 frames collected across 4 virtual towns, 16 communication scenarios, and 3 weather conditions.
- ✦ High-resolution CSI obtained from ray tracing in Sionna and sampled at 100 Hz for diverse applications, along with 100 Hz oversampled, temporal aligned sensor data which can be easily downsampled for practical usage.
- ✦ All-weather resilience by design.
- ✦ Full flexibility and extensibility by simply modifying a configuration file.
- ✦ A unified resource for vehicle-to-everything (V2X) communication and perception.