Yeah, individual emails can be picked off at any point in the chain while in transit. And someone who has hacked key infrastructure in front of your server can see all emails on transit. But your server might have stored emails, so someone with clandestine access to that will be able to access part of your email history (perhaps all of it, if you use that server for permanent email storage), and they are not limited to emails in transit.