I have met a single digit number of people who prefer hard plastic earbuds over the soft tips. There’s a reason why they’re pretty much the only thing you see in “nice” earbuds.

Have you tried different tips? Apple offers like 5 different sizes because it’s so important to have the right fit. Initially they didn’t fit my ear well, but after a while of trying my ear adapted and now they fit perfectly. Foam is also worth a shot, but they get gross fast.