Have you never heard the phrase “staring off into space”? It’s a very common thing. As long as you’re not staring directly at someone (which can come across as creepy), it’s just something people do.