Even if you’re going off to the side you’re on, it’s a distraction. It will draw my attention back to see if you’ve fallen, crashed, or gotten hurt. I will check my mirrors for you to see if there are additional dangers to me. I ride around bike-like objects all the time. Passing you isn’t even going to be a thing that I notice. You’ll get a “On your left, passing” from me when I’m about to go by so you know not to do any funny business in my direction. I don’t expect you to exit the lane. Heck, if you’re doing 15MPH, we might ride and bullshit with each other for a bit.