Yeah, to my knowledge lolicon is very specifically about the attraction aspect without any accusations beyond that, while paedophile has different connotations (in spite of originally having that same meaning). But then the word lolicon in english has that specific meaning about drawn children which is also not what the word means in japanese. So there’s not really a 100% right way to translate it, but going by the context that anime characters tend to say lolicon in, translating it as paedophile seems more likely to be misleading about the actual situation portrayed.

Whether it should be treated as lightly as it often is in anime is a whole different discussion and I’d say it shouldn’t but it’s completely valid to question the translation imo