“Listen, I enjoy hanging out with you, but sometimes people just need some time alone and don’t feel up to hanging out.” is probably a good place to start.