Saying it before something that is not disrespectful would be redundant at best and very confusing at worst.

“With all due respect, how’s the weather today?”
“I’m not racist but I prefer tea over coffee.”
“I’m not a pedophile but I think terminator 3 is a bad movie”