I think the implication is that the other big reason for not drinking that people would jump to is substance abuse. Even if untrue once the rumor starts it would be out there.