I haven’t tried learning Japanese (precisely because of Kanji) but what you’re describing in English is also the hardest part of English. There are plenty of languages where you can easily spell and pronounce words you’ve never seen before.