I’m pretty much the same way with places I’ve lived where I had to drive everywhere. My current city though, 6 months after moving here (and 6 months of living car-free) I could give people detailed directions around a significant chunk of the city (the areas where I went).

Same when I moved to a different part of the city and started biking around that part of town.