The thing is, yes humans can do it with their eyes. But even with the giant amount of progressing power from the brain they are still not great at it.

So of the ultimate goal is to the minimum/cheapest to be almost as good as human then yes, optical sensors only are enough.

Of the goal is to prevent deaths and significantly reduce the number of accidents compared to then lidar is the best option.