This might work on the scale of a building to even out its own power usage throughout a day, but to make a difference on a city grid scale, you need an insane amount of height and/or weight.

Check out Pumped Water Energy Storage. It’s the same concept but uses water as the weight. Doing the math on the Ludington Pumped Storage Power Plant active calacity, it stores over 100 billion pounds of water.