To use the wrong gender is derogatory, not recognizing the person you are talking to. Or at least most would probably consider it that way.
So the answer would obviously be a very strong no. At worst you may ruin someones day, at best you just look like an idiot.