Nah, I started with Skyrim, and I played Oblivion without mods. It’s not great, problematic in many places, but it is playable if you want to discover the story.