I’ve always kept a microfibres cloth around for glasses.

If you don’t get them too dirty too often you can also get little glasses alcohol wipes too.