You really need to watch this video. It explains it all. It’s long, but it’s incredibly well researched and presented.
Raw materials are not an issue.
There are a multitude of possible downsides with nuclear and with the greater number of reactors around the world comes the greater risk of something going catastrophically wrong for large amounts of people.
Solar has none of that downside, unless you include the sun devouring us in 6 billion years time…