That’s a bad assumption to make. Many pathogenic bacteria can survive for months with no meal.

It’s more that interacting with bacteria, even pathogenic bacteria, is a normal part of everyday life. That’s exactly what our immune systems are for. Unless you are sticking the paper inside you or doing surgery with it, you’ll be fine using a paper towel with some microbes on it.