I'll be much more irritated if you're on the sidewalk. It's more dangerous for pedestrians and for you. When you're biking you expect to have to pass people whether it's because they're a slower cyclist or using a escooter. My old apartment had an exit at a blind corner and dealing with escooter riders on the sidewalk was hellish. I would pull out slowly so that pedestrians had plenty of time to stop, but when scooters became popular I had to start creating forward at a painfully slow pace because people going bike speeds somehow thought it was okay to be on the sidewalk.