Not just testing, it used to be an issue many years ago. I’ve let people know that I’m still getting auto-responses when I know they are back from vacation. It happened to me too and I was reminded by my coworker. Also, the idea is you don’t check the your outlook when you are on vacation. It’s not designed for people on vacation who still check and respond to every email.