I think that's willfully distorting the situation. Punching down should refer to jokes that seem to be or obviously are made with malicious intent, it's not about certain groups being protected from humor altogether, that's infantilizing. From OP said and posted somewhere in this thread I don't think their jokes were in any way malicious.