This is a great quote and one I often remember, but I would also add this:

“Many that live deserve death. And some that die deserve life. Can you give it to them? Then do not be too eager to deal out death or to let live in judgement. For even the very wise cannot see all ends.”

Live and let live works, but only if the other also does so. When one does not allow you to live as you want, because what they do harms you, then that ends there.