You never need to go to a gym to get fit. It could help, for some people, but it is not a necessity by any means!

You don’t even need weights or equipment; calisthenics are valid.