Perhaps both of them harm (or help) different parties by different amounts. So maybe a system where “My freedom ends where it starts infringing on other peoples rights.” looks like a common sense framework, but when scrutinized reveals that it doesn’t really stand for anything at all.