I wouldn’t back out automatically. It depends on the situation for me. I did a fully on-site job in the role I had right before my current and it was worth it. Now I’m in the office usually 60% of the time. It’s not for everyone, but I would not immediately shut down a job opportunity just because it’s 100% on site.