Tutorials

The multimodality is composed of five sensory data (LiDAR, RGB and depth camera, IMU and radar) collected in CARLA and channel multi-path information collected in Sionna. The general workflow is illustrated in the following figure:

Set up your environment and software following instructions in https://github.com/le-liang/Multimodal-Wireless/, you can begin the extension or replay process by following the detailed steps in our tutorial video.

Generally, the generation of dataset includes three steps:

• CARLA: Define the scenario in CARLA via the config file and implement it via carla_main.py, which produces five sensor data and the yaml file of all frames simultaneously.
• Blender: Reconstruct the whole scenario frame by frame in Blender based on the .yaml file of each frame.
• Sionna: Load the scene of each frame and compute multi-path components and generate the corresponding channel.

➡️ Watch the Tutorial: