The big power use is in building/training models, not running them. Not the running them is insignificant either.