Remove the food source and the spiders will go. They frequent certain places because the hunting is good.