If your router’s cpu is locked 100% because of an upload it can’t handle additional download, probably. This could be improved with a more powerful cpu or a more efficient process of sorting out up- and downloads. At least that’s what I got from the original comment. I’m not a networking expert (far from it) so take this with a big grain of salt.