I agree with the towers. Worst part of the game.

My main intention on my remastered playthrough was to try to break the game through spell creation and enchanting. I ended up with a few spells that would turn me invisible and pump my speed and acrobatics to insane levels. Most of those tower levels have you running all over and opening gates, but I just jumped over them and avoided every enemy as I sprinted to the top.