Depending on how you frame it, that happens all the time. For example, a speedbump causes speed reduction, but at high speeds it causes (momentary) loss of control. Or narrowing the road, which means less margin for error.

People will drive their cars as fast as feels safe. By introducing hazards, you make people slow down which increases safety, but each feature in isolation could be said to be dangerous in some way, y’know?