Yeah no reason to go to the moon if we can’t visit other planets yet. That’s the kind of logic you are arguing.
The vegan argument is to not contribute to animal suffering, you can’t control what other people do.
And avoiding suffering doesn’t help because there will still be suffering is about as stupid as it gets.