“At all” is kinda contradictory part. Limiting harm to others would already necessitate limiting freedoms and the more people and closer together they live the more freedoms are limited.

Living in the middle of nowhere and a person can do almost whatever pops in their mind, almost absolute freedom.

Living in a city and there’s a long list of laws/rules/regulations that already limit what one can do. Not that those are bad limitations.