That’s more because few people seriously PvP in FFXIV, so you naturally end up randomly queued with the same people repeatedly.