Hell, you could even use slower offline 3d reconstruction of vision data for training, and still ultimately rely on runtime LiDAR.

But the driver isn’t reacting to any of the LiDAR readings, only what they can see, so what is the point?

You label the recordings that involve a crash, and use the lidar to avoid doing the same.