I’ve been studying Japanese for almost six years now and I would say YES kanji is difficult, but it’s not insurmountable. It’s also one of the most interesting and fulfilling parts of learning the language.
There’s a certain level of “you have to know the rules before you know how to break the rules” but kanji can often be used in interesting nonstandard ways in literature & manga and just in general carry so much meaning and depth.
There’s always something new to learn. Did you know that there’s another version of 探す (to search) that has a slightly different connotation? 探す is usually used to search for something you want, but 捜す is used to search for something that’s missing.

By the way, do we have a Japanese learning community on Lemmy?