I’m no expert at this, but it seems to be the suffix here is ‘tard’ not ‘ard’, coming from Latin.

The root already has tard in it, from Latin retardare. It also has the word tard in it, French for late. Retard also means late in French.

Does anyone here know? It also had me wondering.